Patient satisfaction is one of the variables that affect the outcome of health care and the use of health-care services. As more procedures are performed on an ambulatory basis, the role of the anesthesiologist becomes more important. To improve the delivery of care, the predictors of dissatisfaction with the entire process (global dissatisfaction) of ambulatory surgery and with anesthesia itself must be identified. The authors conducted a hypothesis-generating study to identify predictors; specifically, they hypothesized that satisfaction with anesthesia was a predictor of global satisfaction with ambulatory surgery and that 24-h postoperative symptoms were a predictor of satisfaction with anesthesia.
The authors prospectively studied 5,228 consecutive patients having surgery in the ambulatory setting during a 1-yr period. Preoperative, intraoperative, and postoperative variables were gathered and patient satisfaction was assessed using a postoperative telephone questionnaire administered 24 h after operation in 2,730 respondents. Significant univariate variables and clinically important variables were entered into multiple logistic regression models. Qualitative data on dissatisfaction were obtained by asking patients' reasons for dissatisfaction.
Sixty-eight of the 2,730 respondents (2.5%) had global dissatisfaction with ambulatory surgery. Nine of these patients were dissatisfied with anesthesia. Dissatisfaction with anesthesia was associated with a 12-fold increase in global dissatisfaction (P = 0.0001). Thirty-one of the 2,730 respondents (1.1%) were dissatisfied with anesthesia. An increasing number of symptoms occurring 24 h after operation was associated with an exp(0.28 x N)-fold increase in dissatisfaction with anesthesia for N number of symptoms (P = 0.0001). Qualitative data showed that the most common reason for global dissatisfaction with ambulatory surgery was personal preference for inpatient care (26%), whereas intraoperative and postoperative adverse outcomes were the major causes of dissatisfaction with anesthesia (88%).
Dissatisfaction with anesthesia is a predictor of global dissatisfaction with ambulatory surgery. An increasing number of symptoms 24 h after operation is a predictor of dissatisfaction with anesthesia. The rate of global dissatisfaction and anesthesia dissatisfaction is very low. The predictors from this model need to be validated by a second data set from either this or another center. Given the low rate of dissatisfaction, a focused study testing specific interventions to improve patient satisfaction would be difficult.
Continuous improvement in quality is an important part of our practice, and as ambulatory surgery is becoming a major trend, data on outpatient satisfaction are needed. Patient satisfaction affects the outcome of health care and the use of health-care services. [1] Therefore, it is important to identify the reasons and the risk factors for patient dissatisfaction.
The study of patient satisfaction involves difficult issues, including the diversity of definitions and patient perceptions. Patient satisfaction has been defined by objective and subjective measures. Objective measures are defined by the provider of care; that is, patient progress and treatment outcome. [2–4] Subjective measures evaluate patient satisfaction by determining “the provider's success at meeting those client values and expectations which are matters on which the client is the ultimate authority.”[5] However, patients have been found to be more concerned with the interpersonal skills of hospital staff than with their technical skills and competence. [6] Expressions of patients are usually biased to please staff and to avoid repercussions for negative care appraisal. [7,8] Thus, in defining the quality of care as perceived by patients, all three aspects-the structure of the institution, the processes that enable the services to be delivered, and the outcome, including patient satisfaction-should be assessed to obtain a more holistic and reliable result.
Methodologic issues include the reliability and validity of the instruments used to measure satisfaction and the need to use multivariable modeling to identify predictors in observational studies. Most studies use questionnaires completed by the patient, [9–12]* whereas interviewing is the preferred method because the response rate is more favorable. [13] None of the previous outpatient studies have tried to establish the validity and reliability of the instrument. [9–12]* In addition, these surveys have provided only basic frequencies and qualitative data. [9,12,14]*
The aim of the current study was to identify the reasons for and predictors of global satisfaction and satisfaction with anesthesia in patients having surgery in the ambulatory setting. Because surgery was the main event, we hypothesized that satisfaction with anesthesia was a predictor of global patient satisfaction. We also hypothesized that the number of postoperative symptoms was a predictor of satisfaction with anesthesia.
Materials and Methods
Patients
After we received approval from the institutional ethics committee, we screened 6,285 consecutive adult patients having day surgery who were cared for by anesthesiologists in the Ambulatory Surgery Unit at The Toronto Hospital, Western Division, from March 1, 1993 through February 28, 1994. We collected data prospectively on 5,228 eligible patients. For the collection of perioperative data, written informed consent was not required by the ethics committee. Informed consent was obtained for the postoperative telephone interview. Because of logistics, we excluded patients if they were non-English speaking or if they required long-distance telephone calls. We excluded 1,057 patients for these two reasons. We also excluded patients who did not achieve the discharge criteria and were subsequently admitted and patients who were discharged successfully but were unexpectedly admitted later. Altogether, 90 patients were excluded for the latter two reasons. We decided that these excluded patients had substantially different clinical courses and would not be suitable candidates to reflect the risks of dissatisfaction in most patients receiving ambulatory care.
Measurements
The anesthesiologists entered the preoperative data (Table 1) on a specifically designed anesthesia record. Clinical management of the patients was left to the discretion of the anesthesiologists.
Intraoperative and immediate postoperative adverse events were documented on a standardized check-off form. Each adverse outcome was accompanied by a concise definition printed directly on the form. The form accompanied the patient into the postanesthesia care unit and the ambulatory surgical unit, where nursing staff recorded any adverse outcomes the patients experienced. Both anesthesiologists and nurses were instructed on standardized definitions and recording of variables before the start of the study. Patients were discharged when they achieved a score of >or= to 9 on the Postanesthesia Discharge Scoring System. [15] Charting was completed at the time of discharge, and the data were reviewed systematically the next day by a research assistant and an experienced anesthesiologist (F.C.). Telephone interviews were conducted 24 h after surgery using a standardized questionnaire. A random data check for inconsistencies such as time range, procedure, and sex matching was performed by one of the investigators (D.T.) to monitor the quality of data entry. The ambulatory surgical unit nurses trained in research interviewing were responsible for the telephone calls. Patients would be considered nonrespondents if they refused to give consent before operation for the postoperative telephone interview or if the nurses could not contact the patient after two attempts.
Intraoperative adverse events as determined by the anesthesiologist included intubation-related events; respiratory events such as desaturation, laryngospasm, bronchospasm, aspiration, and pneumothorax; fluid and metabolic events; cardiac events such as hypotension, hypertension, cardiac ischemia, tachycardia, bradycardia, dysrhythmia, and cardiac arrest; neurologic events such as excessive sedation and agitation before induction and seizure; and miscellaneous events such as muscle rigidity, drug incident, anaphylaxis, malignant hyperthermia crisis, and skin injury.
The immediate postoperative adverse events as determined by the nursing staff included respiratory events such as desaturation, hypoventilation, upper airway obstruction, reintubation in the postanesthesia care unit, pulmonary edema, bronchospasm, pneumothorax, aspiration; fluid-renal-metabolic events such as hypovolemia, oliguria, urinary retention, and abnormal results of blood tests; cardiac events such as hypotension, hypertension, bradycardia, tachycardia, dysrhythmia, ischemia, and cardiac arrest; neurologic events such as excessive pain, excessive agitation, residual paralysis, confusion, seizure, and excessive sedation; miscellaneous events such as nausea and vomiting, hypothermia, shivering, unplanned admission or a second surgery, anaphylaxis, excessive bleeding, and other surgical complications.
The following information was also collected: duration of anesthesia, duration of stay in the postanesthesia care and ambulatory surgical units, assessment scores on admission and discharge to the postanesthesia care and ambulatory surgical units, medications given, intraoperative and postoperative physiologic variables, and discharge location.
The 24-h postoperative adverse events as determined by the patient were assessed through the standardized postoperative telephone interview. The presence of 12 postoperative symptoms was assessed: pain over incision, headache, muscle ache, malaise, drowsiness, dizziness, nausea, vomiting, fever, hoarseness, sore throat, and bleeding. The severity of these symptoms was evaluated by four criteria: a pain score designed to differentiate mild, moderate, or severe incisional pain; a subjective 24-h postoperative functional score whereby the patients were asked to rate their functional level on the day of the interview on a scale of 0 to 100%; whether the patients took medications for symptoms; and whether they returned to the emergency room or consulted a physician for medical care. In addition, patients were asked whether they were given information regarding preparation for surgery, time of the procedure, ambulatory surgery routine, estimated time of discharge, need for proper escort home, and postoperative self-care.
Global satisfaction with ambulatory surgery and satisfaction with anesthesia were also assessed through the standardized 24-h postoperative telephone interview. Global satisfaction with ambulatory surgery was evaluated by asking whether the patient would return to the same facility for a similar ambulatory surgery. Global dissatisfaction was defined by the patients' refusal to return to the same facility for a similar surgery. Satisfaction with anesthesia was evaluated by asking the patient to rate the care as poor, good, or excellent. Dissatisfaction with anesthesia was defined as a rating of “poor.” Qualitative data on global satisfaction and satisfaction with anesthesia were assessed by asking the patient to give their reasons for dissatisfaction in open-ended questions.
Reliability and Validity
The reliability of the standardized check-off form for adverse events was confirmed by the high degree of chance-corrected agreement (k > 0.9) between the data included in the anesthesia record and the data on the check-off form. The same anesthesiologist was responsible for reviewing the anesthesia record throughout the 1-yr period to ensure consistency of data. The reliability of the 24-h postoperative telephone questionnaire was confirmed by a high degree of inter-rater agreement (k > 0.9) when both the research assistants and the nurses interviewed each of the first 200 patients separately. The validity of the questions about satisfaction were established by a previous study. [16] As another validity check, specific reasons were sought if the patients expressed global dissatisfaction with ambulatory surgery or dissatisfaction with anesthesia.
Statistical Analysis
Univariate analysis was used to test the significance of each independent variable (appendix 1 Table 6) with regard to the rate of global satisfaction with ambulatory surgery or satisfaction with anesthesia separately, using the chi-squared test, Fisher's exact test, or Student's t test. Because of the small number of dissatisfied patients (the outcome), there was a limitation in the number of variables we could enter into the multiple logistic model. We chose to enter into the model the most significant variables from the univariate analysis and the variables that had a biological or psychological basis. These variables were entered into backward stepwise multiple logistic regression models. For the global satisfaction model, we entered four variables; for the anesthesia satisfaction model, we entered three variables before a quasi-separation of the data resulted. We continued to eliminate variables as long as the resulting model was not significantly different from the initial model. Probability values were adjusted to less than 0.001 for multiple comparisons. Odds ratios are presented to indicate the direction and magnitude of the effect. Standard errors of the estimate are presented to indicate precision. All data were analyzed by using the Statistical Analysis Systems software (version 6.08; SAS, Cary, NC).
Results
Altogether, 5,228 patients were studied. Successful telephone interviews were conducted with 2,730 patients (52%). Forty percent of the 5,228 patients refused telephone interviews when approached before operation for their consent. The other reasons for unsuccessful telephone interviews were inability to contact (5.7%) and unspecified (1.7%). Table 1shows the characteristics of the respondents and nonrespondents.
Global Dissatisfaction
Sixty-eight of the 2,730 respondents (2.5%) would decline to return to the same unit for a similar surgery. Table 2shows the variables that were significant by univariate analysis. Nine of the 68 dissatisfied respondents (13%) were dissatisfied with anesthesia, compared with 22 of 2,662 satisfied respondents (0.83%). Some of the significant variables were highly correlated, such as the presence of postoperative symptoms and the presence of more than three symptoms. In these cases, only one of the correlated variables was entered into the multivariable model. Because of the limited number of outcomes, the following variables were entered into an initial model: age, satisfaction with anesthesia, number of 24-h postoperative symptoms, and presence and absence of adequate instructions. The final model showed that dissatisfaction with anesthesia and the number of postoperative symptoms were significant according to the probability value. Dissatisfaction with anesthesia was associated with a 12-fold increase (P = 0.0001) in global dissatisfaction with ambulatory surgery. An increasing number of 24-h postoperative symptoms was associated with an exp(0.24 x N)-fold increase in dissatisfaction with anesthesia for N number of symptoms (P = 0.0001). Table 3shows qualitative data on reasons of global dissatisfaction with ambulatory surgery. The social reasons that led to dissatisfaction included living alone, having difficulty with arranging transport, and difficulty in arranging escort or additional help at home.
Dissatisfaction with Anesthesia
Thirty-one of the 2,730 respondents (1.1%) rated anesthesia as “poor.”Table 4shows variables that were significant by univariate analysis. Simple logistic regression found that increasing number of 24-h postoperative symptoms predicted dissatisfaction with anesthesia (P = 0.0001;Figure 1). Only one of the correlated variables was entered into the multivariate models. Owing to the small number of dissatisfied patients, only the following variables were entered into an initial model: general anesthesia and monitored anesthesia care as two dummy variables and the number of postoperative symptoms. The final model showed that the number of postoperative symptoms was significant according to the probability value. An increasing number of 24-h postoperative symptoms was associated with an exp(0.28 x N)-fold increase in dissatisfaction with anesthesia for N number of symptoms (P = 0.0001;Table 4). Table 5shows qualitative data on the reasons for dissatisfaction with anesthesia. Intraoperative and postoperative adverse events were the major causes for dissatisfaction with anesthesia (88%).
Discussion
The degree of satisfaction with ambulatory surgery and with anesthesia in this study was very high, 97.5% and 98.9%, respectively. We found that an increasing number of 24-h postoperative symptoms was a predictor of dissatisfaction with anesthesia and that dissatisfaction with anesthesia was a predictor of global dissatisfaction with ambulatory surgery.
The incidence of dissatisfaction was so low that we could not help but ask if these patients were simply a deviant group. Some of the dissatisfied patients in this study did give trivial reasons. However, patient expressions are usually biased to please staff and to avoid repercussions for negative care appraisal. [7,8] Therefore, what we found could be an under-representation of the true picture. By identifying the areas for improvement for a small number of patients, we could be advancing the quality of care for an anonymous majority of patients.
The qualitative section of the questionnaire consisted of patients' actual responses for the open-ended question. Eight patients were dissatisfied globally due to social reasons (Table 4). These were elderly patients having ocular procedures who were either living alone or had difficulty in arranging transport or escort or additional help at home. A more detailed preoperative inquiry by the surgeons would have led to prior arrangement for home care and thus could have prevented these situations. Similarly, under unmet expectations, for patients who reported “did not see the doctor while in pain” or “did not see the doctor postop for surgical finding,” these situations could be avoided if the surgeons had clarified with the patients that the operating room schedule in fact did not always permit them to see the patients immediately afterward. For the one patient who reported “too early an admission,” she only waited for 2 h, and her complaint reflected inadequate knowledge of the routine running of the day surgery unit. The same applied to the patients who reported “inefficient or omitted preop tests.” The patient who reported “uncomfortable chairs” had expected to rest in a bed. And this again reflected inadequate explanation on our part. Of patients who reported “awareness” during monitored anesthesia care, they had expected to be unconscious during the procedure, and thus they reported anesthesia dissatisfaction (Table 5). We interpreted this as a lack of communication between the anesthesiologists and patients. Similarly, for patients who reported “student anesthetizing,” patients were not told that the anesthesia resident was in fact a qualified physician in training and that resident training was an essential feature in a teaching hospital. For the patient who reported “problems with lumbar puncture in the OR,” the lumbar puncture was performed without complication after a few attempts. The anesthesiologist had failed to assure the patient that multiple attempts were not unusual; we also interpret this as a lack of communication. Lack of communication, however, was not recognized in the initial phase of the study. Subsequently, communication was not included in the closed-ended entries in the postoperative questionnaire and was not tested in the statistical modeling.
Most patients are ready to go home 1–2 h after the conclusion of anesthesia and surgery. [17] Patients with persistent symptoms of pain and nausea or vomiting in the ambulatory surgical unit stayed longer in the unit and had more 24-h postoperative symptoms. Postoperative symptoms of pain, sore throat, hoarseness, drowsiness, headache, dizziness, fever, and nausea or vomiting can occur. [18] Because an increase in the number of 24-h postoperative symptoms was associated with an increase in dissatisfaction with anesthesia, efforts should be made to develop effective strategies to prevent and treat postoperative symptoms in patients having surgery in the ambulatory care setting. Simple techniques such as perioperative hydration of 20 ml/kg for fluid-restricted patients undergoing general anesthesia in ambulatory surgery is beneficial. [19] Alleviating dehydration with adequate fluid therapy reduces the incidence of postoperative symptoms such as thirst, nausea, dizziness, and drowsiness in the postanesthesia care unit, in the ambulatory surgery unit, and 24 h after operation. A multimodal approach of narcotic, nonsteroidal anti-inflammatory drugs, and local anesthesia infiltration is effective in treating postoperative pain in patients having outpatient laparoscopic cholecystectomy. [20] Thus by reducing the number and severity of postoperative symptoms, satisfaction with anesthesia can be increased.
During the initial development of the study questionnaire, we conducted a literature search that identified possible predisposing factors for global dissatisfaction with ambulatory surgery: demographic characteristics, information factors, access factors, structure factors, nursing care, [9,21–24] and postoperative minor sequelae. [9,11] Demographics included age, sex, ASA physical status, and previous hospitalization. [1,3,4,16] Information factors included postoperative self-care instructions [11] and information given by physicians. [1] Access factors included parking availability and location of the hospital. [1,9] Structure factors included waiting time and admission time. [9,12]*
Previous hospitalization was a factor in patient satisfaction in some of the inpatient studies. [1,3,4,16] Because ambulatory care is completely different from inpatient care, we conjectured that patient expectations for ambulatory surgery would not be much influenced by their previous hospital care. Therefore, we did not consider this factor.
Abramowitz et al. [16] found that global satisfaction is the most powerful predictor of the intent to recommend the service. Although dissatisfaction with professional competence appears to be one of the factors in consumers' decisions to change providers, [25] the intent to return to a hospital is related to access factors such as parking availability and location of the hospital rather than to satisfaction with hospitalization. [26] In this study, patients were asked whether they would return to the same facility if they needed a similar surgery again, and none of the reasons for global dissatisfaction were related to access factors. This confirms that the intent to return is a valid indicator of patient satisfaction.
This study, with 2,730 respondents, is the largest satisfaction survey thus far reported for ambulatory surgery. The conceptual problems with patient satisfaction might be insurmountable, because perceptions of quality of care are subjective. Methodologically, however, we improved on previous studies by including a large number of patients and by using a questionnaire that had been proved reliable and valid in a previous study. [16] We used closed-ended questions that allowed standardization of responses for statistical analysis and included qualitative open-ended questions about reasons for dissatisfaction that validated the results from the closed-ended questions.
The main limitations of this study were the low response rate and the small sample of dissatisfied patients. In future studies, the reasons for dissatisfaction should be asked of both satisfied and dissatisfied patients, to give a validity check of the global satisfaction questions for both groups. To obtain a more complete picture, other aspects of the experience that reflect the efficiency of the service delivery should also be assessed, such as the operating room turnover time and the time between the fulfillment of discharge criteria and actual discharge. Specific items on various dimensions of care would allow us to directly test other dimensions in statistical modeling.
In summary, we found a high rate of patient satisfaction with ambulatory surgery and with anesthesia. The presence of postoperative symptoms significantly contributed to patients' satisfaction or dissatisfaction with anesthesia. Satisfaction with anesthesia significantly contributed to patients' overall satisfaction with the ambulatory surgery experience. The qualitative data on reasons of dissatisfaction suggested that lack of communication was an important dimension in dissatisfaction. However, this dimension was not tested in the statistical modeling. Given the low incidence of dissatisfaction, focused research on interventions that would improve patients' satisfaction would be an enormous challenge.
The authors thank the Department of Anaesthesia, Toronto Hospital, Western Division; the ambulatory surgical unit nurses; and Dr. K. Rose, Dr. C. Cruise, Dr. R. Narendrakumar, Dr. S. Thanamayooran, and Mrs. G. Wong for helping to make this project possible.
*Harju E: Patient satisfaction among day surgery patients in a central hospital. Quality Assurance in Health Care 1991; 3:85–8.