Abstract
Previously reported incidences for intraoperative hypersensitivity reactions vary more than 15-fold. The goal was to determine the incidence of intraoperative hypersensitivity events at a U.S. surgical center.
With institutional review board (Cleveland, Ohio) approval and waiver of written/informed consent, the anesthesia records of adult patients undergoing noncardiac surgery from 2005 to 2011 at the Cleveland Clinic were queried using a novel electronic search protocol developed to identify potential hypersensitivity reactions: cardiovascular collapse defined as systolic arterial blood pressure less than 50 mmHg; administration of epinephrine; administration of diphenhydramine; physician comments in the anesthesia record suggestive of hypersensitivity reactions; laboratory tests for histamine, tryptase, or immunoglobulin-E within 24 h of surgery; and International Classification of Diseases, Ninth Revision, codes suggestive of hypersensitivity reactions. Each electronically identified candidate chart was evaluated by an adjudication committee. Hypersensitivity reactions were graded on a 5-point severity scale. From these data, the authors determined the proportion of operations having adjudicated hypersensitivity reactions, and calculated the 95% exact binomial CI.
Among 178,746 records, 4,008 charts were identified by the search strategies. After adjudication, 264 hypersensitivity cases were identified. The overall incidence of hypersensitivity reactions was 1:677 surgeries, corresponding to 15 (95% CI, 13 to 17) cases per 10,000 operations. The incidence of severe hypersensitivity reactions (grades 3 to 5) was 1:4,583, corresponding to 2 (95% CI, 2 to 3) cases per 10,000 operations.
The incidence of severe hypersensitivity reactions was similar to previous reports. However, the overall incidence of hypersensitivity reactions was much greater than reported elsewhere, possibly because of a comprehensive search strategy.
Abstract
A novel methodology combining electronic search strategies and clinical adjudication was used to identify occurrences of hypersensitivity reactions. The overall incidence of hypersensitivity reactions identified from the electronic records of 178,746 procedures performed on 120,242 patients was 1 in 677 and that of anaphylaxis was 1 in 4,583. The incidence of anaphylaxis was similar to that reported in previous studies but that of hypersensitivity reactions was nearly seven times higher.
The reported incidence of intraoperative hypersensitivity reactions ranges from 1 in 1,480 to 1 in 10,000 anesthetics
The methodological challenges of identifying, evaluating, and characterizing hypersensitivity reactions need to be addressed to estimate the true incidences accurately
A novel methodology combining electronic search strategies and clinical adjudication was used to identify occurrences of hypersensitivity reactions
The overall incidence of hypersensitivity reactions identified from the electronic records of 178,746 procedures performed on 120,242 patients was 1 in 677 and that of anaphylaxis was 1 in 4,583
The incidence of anaphylaxis was similar to that reported in previous studies but that of hypersensitivity reactions was nearly seven times higher
BUILDING upon Emil von Behring’s (1854–1917) and Louis Pasteur’s (1822–1895) vaccination work, Paul Portier and Charles Richet1 attempted to immunize dogs with purified sea anemone actinotoxin in 1902. The paradoxical effect was that the animals were sensitized to the toxin—and that subsequent tiny doses proved lethal.2 This new phenomenon was deemed anaphylaxis.
Anaphylaxis, defined as a severe hypersensitivity reaction, may be mediated by immunoglobulin-E (IgE), termed immunologic, such as with β-lactam antibiotics,3 but it turns out that this is but one mechanism. Nonimmunologic etiologies, such as with opioids and vancomycin,3 and idiopathic etiologies4 also contribute to hypersensitivity reactions. Regardless of the mechanism, the clinical spectrum ranges from benign urticaria to cardiovascular and pulmonary collapse.5 Hypersensitivity reactions remain concerning because the effects are generally unanticipated, sometimes difficult to diagnose, and can have grave consequences.6 It is not unusual, for example, for life-threatening hypotension and cardiac arrest to be the first clinical indication of intraoperative anaphylaxis.6–11
The estimated incidence of intraoperative hypersensitivity reactions varies widely among studies ranging between approximately 1 in 1,48012 and 1 in 10,0009 anesthetics, with severe, life-threatening anaphylaxis ranging between 1 in 6,00013 and 1 in 20,00010 anesthetics. Retrospective studies purport fewer incidences9,10 possibly due to limited data, while prospective studies12–14 benefit from established testing and reporting protocols. Nonetheless, studies which estimate incidences of voluntary self-reporting are still vulnerable to underreporting.15 One epidemiological study has attempted to lessen the underestimate by comparing multiple independent reporting systems16 ; however, it too was subject to reporting bias. Accurate estimates of the true incidence will need to address the methodological challenges of identifying, evaluating, and characterizing hypersensitivity reactions.
The Cleveland Clinic possesses a comprehensive searchable electronic database that combines complete intraoperative anesthesia records including hemodynamics and medication administration, inpatient and outpatient laboratory results, diagnoses, and allergies. We developed a novel methodology, combining electronic search strategies and clinical adjudication, to identify occurrences of hypersensitivity reactions.
Our primary goal was to identify potential instances of hypersensitivity reactions, designated by clinical manifestations and interventions, and to determine the incidence and severity of intraoperative hypersensitivity events in a large U.S. surgical population. Secondarily, we assessed patient characteristics associated with hypersensitivity reactions, including the previously identified risk factors of sex,17,18 muscle relaxants,17 and antibiotics.18,19
Materials and Methods
Search Strategy
With the approval of the Cleveland Clinic Institutional Review Board, Cleveland, Ohio, and waiver of written informed consent, we assessed electronic records from adult patients who had noncardiac surgery between April 2005 and December 2011 using the Cleveland Clinic Perioperative Health Documentation System. This registry contains laboratory data, pharmacy data, discharge International Classification of Diseases, Ninth Revision, codes, and the complete electronic anesthetic records including provider-entered free-text comments. During that period 120,242 patients had 179,621 noncardiac procedures, 28% (n = 33,627) of patients had multiple surgeries and 875 surgeries were excluded from all analyses after retaining the first 10 surgeries per patient. We thus studied 178,746 procedures performed on 120,242 patients.
Delphi Process
Ten senior anesthesiologists participated in a Delphi process using the diagnostic clinical criteria for anaphylaxis proposed by Sampson,7 the most common treatments, and the most common confirmatory tests as a starting point to develop independent search strategies to identify search criteria that could be used to detect potential hypersensitivity reactions in the electronic database.
Rationale for the Search Strategies
The Sampson criteria (hypotension, skin manifestations, and airway compromise) were designed to identify reactions in the nonoperative setting.7 The hypotension criterion (systolic blood pressure <100 mmHg) is unsuitable for the intraoperative period because transient hypotensive episodes are not uncommon. Our Delphi team thus felt a lower sustained threshold would be more appropriate.
The most common initial medications given to patients suspected of having hypersensitivity reactions are diphenhydramine and vasopressors depending on the severity. Epinephrine is the preferred vasopressor in suspected anaphylaxis,11,20 with other vasopressors given as second-line treatments.
Comments are nonstructured fields and must be manually entered in the anesthetic record. An extensive array of terms must be queried to assess the variable documentation of reactions. An expected nonhypersensitivity reaction, such as a patient flushing after atracurium administration, is unlikely to be manually documented. If documented, it would not be deemed a reaction in the subsequent adjudication committee. Conversely, hypersensitivity reactions are unexpected and thus unlikely to be completely unmentioned.
Perioperative immunological laboratory testing indicates a clinician’s intention to diagnose a potential allergic reaction. The values of histamine21 and tryptase22,23 are time-dependent; therefore, values in the normal ranges do not necessarily negate a hypersensitivity reaction. Conversely, an increased IgE level in patients with asymptomatic sensitization is common.24 The diagnosis of anaphylaxis based on clinical symptoms is valid regardless laboratory tests.24
International Classification of Diseases, Ninth Revision, codes may represent hypersensitivity reactions, but they are not specific to the intraoperative period; therefore, presence and timing of the reaction needs to be assessed in the subsequent adjudication process.
Identification of Episodes
The Delphi committee agreed that the following six responses were reasonable search criteria to identify potential hypersensitivity reactions:
Cardiovascular collapse, systolic blood pressure 20 to 50 mmHg for 3 min or more.
Intravenous administration of epinephrine.
Intravenous administration of diphenhydramine.
Physician comments, free-text comments in anesthesia record suggestive of a hypersensitivity reaction. Specifically, we included “Preferred Terms” for indexing anaphylactic reactions from the Medical Dictionary for Regulatory Activity (Northrop Grumman, Los Angeles, CA): allergic, allergy, anaphylactic, anaphylactoid, anaphylaxis, asthma, blood pressure decreased, bronchospasm, cardiac arrest, cardiorespiratory distress, cardiovascular insufficiency, chest discomfort, choking, circulatory collapse, cough, cardiopulmonary resuscitation, dyspnea, edema, erythema, first use syndrome, fixed eruption, flushing, hives, hypersensitivity, hyperventilation, hypotension, Kounis syndrome, laryngospasm, obstruction, pruritus, rash, reaction, respiratory arrest, respiratory distress, respiratory failure, sensation of foreign body, shock, sneezing, spasm, stridor, swelling, swollen, throat tightness, urticaria, and wheezing.
Laboratory tests for histamine, tryptase, or IgE (total or specific) within 24 h of surgery.
International Classification of Diseases, Ninth Revision, codes suggestive of hypersensitivity reactions
693.0 Dermatitis medicamentosa, not otherwise specified
782.62 Flushing
995.0 Other anaphylactic shock
995.27 Other drug allergy
995.3 Allergy, unspecified
995.4 Shock (due to) anesthetic.
Case Adjudication
We considered patients identified via one or more of the above search criteria as candidates for an intraoperative hypersensitivity reaction. We subsequently compiled all available resources including patient history, anesthesia records, surgical reports, inpatient notes, laboratory data, and outpatient consultations. These records were presented to an adjudication committee consisting of three experienced anesthesiologists.
Hypersensitivity Criteria.
Two members of the adjudication committee (L.S. and A.T.) independently evaluated each candidate identified by the electronic search process for the occurrence of a hypersensitivity reaction by clinical symptoms, arguably the principal factor in the evaluation of reactions.24,25 The adjudicators used the classical clinical criteria for anaphylaxis: mucocutaneous signs; airway compromise; or significant reduction of blood pressure without plausible alternative explanation (i.e., brisk blood loss).7,11
Treatment of these clinical symptoms by pharmacologic means and confirmation by immunologic testing were used as supporting evidence; treatment alone was insufficient to assess a hypersensitivity reaction, and lack of immunological testing was insufficient to reject a hypersensitivity reaction. We did not consider hypersensitivity reactions as diagnoses of exclusion when we could not find a discernible reason for treatment administrations; we still required at least one classic symptom above. Symptomatic manifestations of preexisting conditions (such as an asthmatic having postinduction bronchospasm) or exaggerated responses to medications (such as an elderly patient) were not deemed hypersensitivity reactions because they could reasonably be attributed to other causes.
Severity Grading of Hypersensitivity Reaction.
The severity of the hypersensitivity reaction was graded 1 to 5 corresponding to minor, low severity, life-threatening symptoms, cardiac or respiratory arrest, and death.13,26,27 Severe reactions, grades 3 to 5, were considered and termed anaphylaxis. If there was nonconsensus on hypersensitivity occurrence or grade, a final determination was made by the third adjudicator (A.K.).
Statistical Analysis
Our primary goal was to estimate the incidence of intraoperative hypersensitivity reactions and anaphylaxis. Our secondary goal was to identify baseline and intraoperative factors independently associated with hypersensitivity reactions. In all analyses, the unit of observation was the operation rather than the patient, some of whom had more than one operation.
We determined the proportion of operations having adjudicated hypersensitivity reactions, and calculated its 95% exact binomial CI. We further assessed the relationship between hypersensitivity reactions and all baseline and intraoperative variables using a multivariable generalized estimating equation logistic (i.e., logit link) model and compound symmetry within-subject correlation structure. This included the a priori specified interaction between sex and use of a neuromuscular blocking agent, with significance criterion of P value less than 0.10. All factors were forced into the model regardless of statistical significance. Factors were considered significant when P value less than 0.05/34 = 0.0015, using a Bonferroni correction for 34 potential preoperative and intraoperative factors to maintain an overall significance level of 0.05. We a priori excluded steroids, diphenhydramine, and vasopressors from our analytical model because they are rarely implicated as causative agents and more likely to be a false association due to their use as treatments for hypersensitivity reactions. We assessed diagnostics for the generalized estimating equation model by assessing the distribution of standardized “dfbeta” statistics for each predictor variable, with the goal of identifying any individual patient clusters (i.e., multiple surgeries on same patient) having undue influence on the results.
SAS statistical software (SAS Institute Inc., Carey, NC) was used for all analyses.
Results
We considered 178,746 surgeries for our analysis. The six electronic search strategies described above yielded 4,008 (2% of the study population) candidate operations, all of which were adjudicated for potential hypersensitivity reactions (fig. 1). Table 1 details the number of candidate patients identified by either 1, 2, 3, or 4 search criteria. The Adjudication Committee determined that 264 (7%) candidate operations were in fact hypersensitivity reactions (table 1). Among the 4,008 cases that were each evaluated by two anesthesiologists, only 27 were referred for adjudication by a third investigator.
The overall incidence of hypersensitivity reactions was 1:677 surgeries, corresponding to 15 (95% CI, 13 to 17) cases per 10,000 operations. Reaction severity was grade 1, 2, 3, and 4 in 67, 18, 10, and 5% of cases, respectively. No patients died consequent to a hypersensitivity response, and thus none of the reactions was deemed grade 5. The incidence of anaphylaxis, severe hypersensitivity reactions (grades 3 to 5), was 1:4,583, corresponding to 2 (95% CI, 2 to 3) cases per 10,000 operations (table 2).
The mean age ± SD was 56 ± 16 yr and 53% were female in cases without hypersensitivity reactions, while in the hypersensitivity cases, age was 54 ± 16 yr and 63% were female. Patients who demonstrated and did not demonstrate hypersensitivity reactions did not differ strikingly on distributions of American Society of Anesthesiologists physical status classification, body mass index, urgency case, or medical history (table 3).
In our multivariable model (table 3), factors that were significantly associated with experiencing a hypersensitivity reaction after Bonferroni correction were type of surgery (P = 0.001 overall), lower body mass index (odds ratio [99.8% CI] of 0.86 [0.75 to 0.99] for a 5-unit increase), having preexisting allergies (1.4 [1.1 to 1.8]) and receiving hetastarch (1.3 [1.0 to 1.6]). Use of neuromuscular-blocking agents was not significantly associated with experiencing hypersensitivity reactions (P = 0.034), and the relationship between neuromuscular blocking agents and hypersensitivity reactions did not depend on sex (interaction P = 0.56). Our generalized estimating equation model diagnostics looked good and did not identify any influential data points or patient clusters.
Discussion
We identified hypersensitivity reactions in 1:677 patients, and anaphylaxis in 1:4,583 patients. Anaphylaxis is relatively easy to identify because of their impressive clinical presentations. Where we differ is in also identifying a large number of minor-to-low severity cases which appear to have been missed in many previous studies. Both incidences are greater than previously reported,9,10,13,14,16,28–30 considerably greater in total reactions, possibly due to differences in methodologies such as prospective voluntary reporting, dependence on allergy clinic referrals, and geographic variations.
A systematic review of underreporting of adverse drug reactions concluded that the most important source of underreporting in voluntary systems is the reporting of only severe adverse reactions.31 For example, a prospective Spanish study reported the incidence of perioperative hypersensitivity reactions to be 1 in 10,263; however, 56% of the 32 reactions were severe.29 In a 6-yr prospective study in Norway,32 two thirds of reactions referred to the allergy clinic were severe; a similar proportions were seen in a prospective study by Malinovsky et al.14 in France which also excluded patients without allergy skin testing.
Retrospective studies are not immune to reporting and documentation limitations. A 17-yr retrospective study in Australia of allergy clinic referrals reported that more than half of reactions were severe.10 The response rate of a questionnaire-based retrospective study in Japan only yielded a 15% response rate and a mortality rate of almost 5%.9 Clearly, previous methodologies favored reporting of severe reactions. Our methodology differs markedly in that only 15% of the 264 reactions were severe (grades 3 and 4) and no deaths (grade 5).
Mild reactions, severity grades 1 and 2, are subtle and are obviously least likely to be identified. For example, clinicians may easily overlook isolated minor responses such as cutaneous reactions covered by surgical drapes. The importance of mild reactions is not the initial cutaneous reaction, but the subsequent possibly escalating reaction upon reexposure to the offending agent. Therefore, the mild reactions are not unimportant in context of long-term patient safety, and specific investigations dedicated to these reactions are warranted. We were only able to identify many mild reactions to the extent that clinicians included text comments in the anesthesia records. We surely therefore missed some subtle hypersensitivity reactions (that were presumably also missed clinically); the true incidence is thus likely to be even greater than we report. On the other hand, we are confident that patients designated as having severe hypersensitivity reactions truly did.
Laboratory testing for allergic reactions was rare, except after anaphylaxis. Furthermore, as is usual, most purely laboratory testing proved nondiagnostic. The causative agent was usually nonobvious in our patients, and assigning causality was complicated by the fact that anesthetized patients are usually given many drugs—often more or less simultaneously. That is not to say that follow-up testing is without merit; on the contrary, allergic testing using both laboratory and skin tests is essential for diagnostic evaluation and ultimately for patient safety. Interestingly, if we assume that the patients for whom allergy testing was ordered would also be the same patients reported in a voluntary reporting system, we would have estimated an incidence of 1 in 13,750; strikingly similar to the Perioperative Anaphylactoid Reactions Study Group’s reported incidence of 1 in 13,00030 using postoperative testing criteria.
Physician comments proved to be the most useful search criterion, identifying 74% of the cases eventually deemed to be hypersensitivity reactions. However, it was also the least efficient. A broad array of terms was queried to minimize the number of missed hypersensitivity cases. Several cases of negative statements were encountered (i.e., “no rash noted”) along with affirmative statements of past reactions not pertaining to current surgery (i.e., “history of rash with opioids”) resulting in 1,461 cases not deemed to be hypersensitivity cases. Newer techniques of natural language processing that consider context and word order in addition to text strings may make queries of physician comments more useful.33
The most efficient criterion was laboratory testing with 5 of the 13 tests (38%) adjudicated to be allergic anaphylaxis cases. The negative cases identified by allergy laboratory testing were found to be surgical evaluation of mastocytosis. The lack of allergy testing makes us unable to comment, even broadly, on the distribution of IgE-mediated versus non-IgE–mediated reactions.
The restrictive search criterion for cardiovascular collapse (systolic blood pressure 50 to 20 mmHg for ≥3 min) made this strategy independently the least useful being positive in only 4 of the 264 adjudicated hypersensitivity cases. Most cases of hypotension were aggressively treated and lasted less than 3 min. The electronic search criterion for epinephrine boli identified 20 of the 39 severe hypersensitivity reactions, though an additional 12 of the severe hypersensitivity reactions proved through manual chart review of comments and paper code sheets to have been given epinephrine boli. The remaining seven cases were treated with other vasopressors and/or started on epinephrine infusions. Advancement of electronic code charting may make this search strategy more useful in future studies. Interestingly, almost half of severe reactions (46%) were also noted to have cutaneous symptoms, though mild symptoms may fail to be documented during cardiac or pulmonary arrests.
Though our study was designed to evaluate the incidence of hypersensitivity reactions, it appears to be the first study with sufficient sample size to accurately assess associations with various factors and hypersensitivity reactions.
Higher body mass index was associated with decreased odds of hypersensitivity. It is possible that there were more frail individuals in the hypersensitivity group which may have had more previous exposures to medications leading to an increased incidence of hypersensitivity reactions in this group.
High-molecular-weight hetastarch (6%), the only synthetic colloid used at our institution, was significantly associated with hypersensitivity reactions. Although plasma expanders pose a potential for hypersensitivity reactions, they appear to be rare.34 It is thus more likely that the volume expander was given to treat hypotension consequent to a hypersensitivity reaction rather than causing the reaction.
Patients with preexisting allergies to medications were more likely to experience an intraoperative hypersensitivity reaction, cross-reactivity surely contributed to the incidence. The structure–activity relationships which confer drug function may also predispose to hypersensitivity reactions.35 Muscle relaxants show a significant amount of cross-reactivity as indicated by intradermal skin testing.36
Muscle relaxants are a commonly reported trigger for hypersensitivity reactions,10,16,17,30,32,37,38 particularly nondepolarizing muscle relaxants.16,32,37,38 Although the association was not statistically significant after Bonferroni correction in our study, with an odds ratio of 1.29 (99.85% CI,1.02 to 1.62; P = 0.006), previous large studies, such as an 8-yr survey on anaphylaxis in France, found muscle relaxants to be the leading cause of anaphylaxis.16 Interestingly, pholcodine—an agent implicated in cross-reactively sensitizing patients to nondepolarizing muscle relaxants39 —is commonly used in France,40 but is a schedule 1 controlled substance and practically unavailable in the United States.41
Our study population was 53% female, and 63% of our adjudicated reactions occurred in women. Sex was not significantly associated with reactions in our patients, but perioperative hypersensitivity reactions have many times been reported to be more common in women,16,18,29,32,38 possibly related to sex hormones.42 Furthermore, women are more often reactive to neuromuscular blocking drugs than men,43 which is consistent with our trend shown in study.
The Cleveland Clinic is a tertiary surgical center; consequently, many of our patients are of high medical acuity and are more likely to have had previous operations and to have been exposed to many drugs. Our patients therefore may be at higher risk for hypersensitivity reactions compared to first-time surgical patients presenting to other surgical environments, leading to higher rates of reactions at our institution. However, the Cleveland Clinic was latex-free throughout the study period; it is thus unlikely that any of the hypersensitivity reactions we observed were triggered by latex. Hospitals that still use latex may thus have an even greater overall risk of intraoperative hypersensitivity reactions given that it is among the most common causes of hypersensitivity reactions.16 And of course other institutions use somewhat different anesthetic approaches which may influence the incidence of hypersensitivity reactions, including use of different muscle relaxants and antibiotics.
Another limitation of our study is that we cannot interpret associations that we observed in an inferential manner since the exact timing of the hypersensitivity reactions were not known in many cases (e.g., a rash under a garment might be discovered toward the end of the case). Statistically associated intraoperative variables must be interpreted with caution, and causation should not be assumed.
Moreover, our analysis includes many mild cases of hypersensitivity, and the strength of associations with various patient factors would presumably differ if that analysis restricted to anaphylaxis per se. With only 39 severe reactions, we could not conduct a multivariable analysis limited to anaphylaxis. Morbidity of the hypersensitivity reactions was beyond the scope of this initial investigation.
In summary, we developed a novel methodology for evaluating hypersensitivity reactions and anaphylaxis which is suitable for use with dense perioperative registries. We found that the overall incidence of hypersensitivity reactions to be 1:677 among 178,746 surgeries, with the incidence of severe hypersensitivity reactions, anaphylaxis, to be 1:4,583. While the incidence of anaphylaxis was similar to the total incidence reported in previous studies, the overall incidence of hypersensitivity reactions was about sevenfold greater.
Acknowledgments
Financial support was provided by MSD Pharmaceutical (Oss, The Netherlands).
Competing Interests
Dr. Besson is employed by and receives salary from MSD Pharmaceutical. Drs. Sessler and Saager received honorarium for participation in an MSD Pharmaceutical expert panel. The other authors declare no competing interests.