Abstract
Current preoperative cardiac risk stratification practices group operations into broad categories, which might inadequately consider the intrinsic cardiac risks of individual operations. We sought to define the intrinsic cardiac risks of individual operations and to demonstrate how grouping operations might lead to imprecise estimates of perioperative cardiac risk.
Elective operations (based on Common Procedural Terminology codes) performed from January 1, 2010 to December 31, 2015 at hospitals participating in the American College of Surgeons National Surgical Quality Improvement Program were studied. A composite measure of perioperative adverse cardiac events was defined as either cardiac arrest requiring cardiopulmonary resuscitation or acute myocardial infarction. Operations’ intrinsic cardiac risks were derived from mixed-effects models while controlling for patient mix. Resultant risks were sorted into low-, intermediate-, and high-risk categories, and the most commonly performed operations within each category were identified. Intrinsic operative risks were also examined using a representative grouping of operations to portray within-group variation.
Sixty-six low, 30 intermediate, and 106 high intrinsic cardiac risk operations were identified. Excisional breast biopsy had the lowest intrinsic cardiac risk (overall rate, 0.01%; odds ratio, 0.11; 95% CI, 0.02 to 0.25) relative to the average, whereas aorto-bifemoral bypass grafting had the highest (overall rate, 4.1%; odds ratio, 6.61; 95% CI, 5.54 to 7.90). There was wide variation in the intrinsic cardiac risks of operations within the representative grouping (median odds ratio, 1.40; interquartile range, 0.88 to 2.17).
A continuum of intrinsic cardiac risk exists among operations. Grouping operations into broad categories inadequately accounts for the intrinsic cardiac risk of individual operations.
The intrinsic risk of cardiac adverse events after surgery has historically been attributed to broad categories of surgeries based upon anatomical region (e.g., intraperitoneal) or surgical service (e.g., plastic surgery)
Detailed procedure-specific risks, independent of underlying patient comorbidities, have not been robustly analyzed or reported
An analysis of 3 million surgeries in the American College of Surgeons National Surgical Quality Improvement Program registry demonstrated a broad range of procedure-specific cardiac adverse event risk for 200 commonly performed procedures
These data may advance our patient-specific risk/benefit analyses and medical decision-making
MORE than 26.8 million operations are performed annually in the United States.1 Of these, approximately 1.5% of patients will die during the subsequent 30 days, most often due to perioperative cardiac complications.2 Accurate preoperative risk stratification is paramount to mitigate the risk of perioperative cardiac complications.3–5 It allows for appropriate preoperative medical optimization, timely cardiac-specific interventions, and guidance regarding perioperative management. Most important, it provides patients the opportunity to make a truly informed decision regarding surgical treatment.6,7
Primary care physicians, internists, hospitalists, cardiologists, and anesthesiologists play an integral role in preoperative cardiac risk assessments.5 Currently, these assessments rely on clinical risk indices, such as the Revised Cardiac Risk Index (RCRI), and clinical practice guidelines to inform decision-making.7–10 These strategies typically group procedures into broadly defined anatomical categories for the sake of simplicity and to facilitate ease of use. However, these broad categories can potentially underestimate the true risk contributed by any one operation. Additionally, risk assessments such as the RCRI consider patient factors more than the risk of the operation itself. This approach may overestimate risk and result in unnecessary consultations, unnecessary costs, delays in surgery, and even harm from further interventions.5,11,12
Operations themselves carry risks for adverse outcomes beyond the influence of patient comorbidities for myriad reasons, such as amount of blood loss, fluid shifts, cytokine release from tissue injury, inflammation, and other acute pathophysiologic changes. Accordingly, surgeons and anesthesiologists recognize that different operations carry intrinsically different risks of complication, but this gestalt can be difficult to formally share with those performing preoperative cardiac risk assessments.13 For instance, the RCRI labels all intraperitoneal, intrathoracic, and suprainguinal vascular operations as high-risk.9 However, a laparoscopic cholecystectomy, gastric bypass for morbid obesity, and pancreatoduodenectomy (all intraperitoneal) appear to have different intrinsic risks for perioperative adverse cardiac events. Classifying the risk of operations based on anatomic location or clinical impression may inadequately inform risk assessment for an individual procedure. Lack of granularity may therefore result in misleading predictions of risk and affect clinical decision-making.
To improve upon current preoperative cardiac risk assessment strategies and to facilitate interdisciplinary communication, the objectives of this study were to define the intrinsic risks of operations for perioperative adverse cardiac events (PACEs), and to demonstrate how grouping operations into broad categories rather than considering operations individually might be insufficient for preoperative cardiac risk assessments.
Materials and Methods
Data Source and Study Population
The American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) is a prospective, peer-controlled, internally validated registry that quantifies 30-day risk-adjusted surgical outcomes to benchmark all voluntarily participating hospitals.14–16 Currently, more than 700 hospitals in the United States and internationally participate. The strength of the program is its use of highly standardized and robust clinical data collected by dedicated, trained, and regularly audited surgical clinical reviewers.17 Specifics have been reported elsewhere.15,18–20 Briefly, reviewers collect patient demographics, operative details, and postoperative outcomes from the clinical record, through communication with other involved physicians, or directly from patients up to 30 days from the index operation regardless of discharge status. Operations are identified by Common Procedural Terminology (CPT) codes. Certain operations are not included: ophthalmologic procedures, obstetrical procedures, primary trauma operations, and transplantations. While inpatient and outpatient operations are included, minor procedures in freestanding surgery centers or in offices are not included.
This study included elective, noncardiac operations from ACS NSQIP Essentials data between January 1, 2010, and December 31, 2015. CPT codes with less than 25 occurrences were then excluded to create the analytic data set.21 Submitted data comply with the Health Insurance Portability and Accountability Act and are subsequently deidentified for analyses. The Chesapeake Institutional Review Board (Columbia, Maryland) deemed this study exempt from oversight because it analyzed preexisting deidentified data.
Outcome
The primary outcome was any PACE, defined as either cardiac arrest requiring cardiopulmonary resuscitation or acute myocardial infarction (MI).7,10 Cardiac arrest was defined as any cardiac rhythm requiring initiation of basic or advanced cardiac life support. Patients who experienced simultaneous loss of consciousness and implantable cardioverter defibrillation were included. Acute MI was defined as evidence of acute MI on electrocardiogram (i.e., ST segment elevation greater than 1 mm in two or more contiguous leads, new left bundle branch blow, new Q-wave in two or more contiguous leads) or new troponin elevation greater than three times the upper limit of the reference range with clinical correlation with myocardial ischemia. Furthermore, troponin elevation due to myocardial supply-and-demand mismatch is included. Specifically, MI types 1 to 3 are included.22,23 Death was excluded as an endpoint because death in the ACS NSQIP database is all-cause and not cardiac-specific.
Covariates
Patient characteristics included in this study were identical to those included in the ACS NSQIP Surgical Risk Calculator18,21 and represent those typically known at the time of preoperative cardiac risk assessment: age (less than 65, 65 to 74, 75 to 84, greater than or equal to 85 yr), sex (male/female), American Society of Anesthesiologists (ASA) physical status (I, II, III, IV, or V), body mass index (underweight, normal, overweight, class I, class II, class III), ascites (yes/no), bleeding disorder (yes/no), disseminated cancer (yes/no), diabetes (none, oral, insulin-dependent), dyspnea (none, with moderate exertion, at rest), functional status (independent, partially dependent, totally dependent), history of chronic obstructive pulmonary disease (yes/no), history of congestive heart failure (yes/no), hypertension requiring medication (yes/no), renal failure (yes/no), sepsis (no, systemic inflammatory response syndrome, sepsis/septic shock), weight loss (yes/no), smoking status (yes/no), and steroid use (yes/no).
Statistical Analyses
To obtain intrinsic risks for PACE for individual operations, a mixed-effects logistic model was constructed from the analytic data set using all patient characteristics as fixed effects and with the CPT code as a random intercept (i.e., random effect).24 Akin to hospital profiling, this approach allows an empirical-Bayes shrinkage adjustment of the CPT effect from the risk-adjustment model to rank CPT codes relative to the overall average.15 Odds ratios (ORs) with 95% CIs were then generated for each CPT code (i.e., random effect); ORs greater than 1.0 represent higher than average risk for PACE, whereas values less than 1.0 represent lower than average risk for PACE.
Each CPT code’s OR was then ranked in ascending order and divided into thirds to form “low,” “intermediate,” and “high” intrinsic cardiac risk categories. Three categories were chosen to align with convention.25,26 Because of the large number of CPT codes, we report those CPT codes that accounted for 80% of the operations, or the most commonly performed operations, in each risk category for practicality.
ORs for patient-level characteristics (i.e., fixed effects) were also generated. The stability of these ORs was assessed using a 50:50 split-sample approach, representing derivation and validation cohorts. Model parameters obtained from the derivation cohort were applied to the validation cohort, and the c-statistics and Brier scores were visually compared between cohorts to assess stability. The c-statistic and Brier score were also calculated for the overall analytic data set.
The stability of each CPT code’s OR derived from the overall analytic data set was assessed by calculating statistical reliability, which reflects sample size, event rate, and variance within each CPT code, and conceptually represents the “signal-to-noise” ratio.27–30 Because hierarchical modeling “shrinks” the estimates of CPT codes with low sample sizes toward the overall average, operations might be inappropriately ranked. For example, “intermediate”-risk CPT codes may be misclassified as “intermediate” because of low sample sizes. To assess the effect of sample size, event rate, and variance within each CPT code, we calculated the statistical reliability for each CPT code’s OR following previously published methodologies.27–31 Reliability values greater than 0.7 were considered “good” and those greater than 0.9 were considered “excellent.”32,33
Because CPT code ORs are relative to the statistically estimated average operation and can be difficult to interpret, we estimated the risk for PACE of one hypothetical patient undergoing every reported operation. This hypothetical “base case” patient was a 67-year-old white female with hypertension, diabetes requiring oral therapy, and a body mass index of 32 (class I obesity), who is functionally independent, does not smoke, and is of ASA physical class 2. We calculated her estimated risk for PACE for every reported CPT code.
Finally, we selected thoracic surgery as a representative example of a broad category to demonstrate how variable intrinsic operative cardiac risk is within a single category. A box plot of CPT code ORs was constructed for all operations within the thoracic surgery specialty. ORs and 95% CIs for individual operations within the thoracic surgery specialty were also plotted. This visually depicted the variability of the intrinsic cardiac risks captured within the broad category example of thoracic surgery. All statistical analyses were two-sided, set at the 0.05 level for significance, and performed using SAS v9.4 (SAS Institute Inc., USA).
Results
Overall, there were 3,247,537 operations encompassing 1,880 unique CPT codes. The overall rate of PACE was 0.5% (n = 16,050). Characteristics of patients with PACE compared to those without can be found in table 1, along with their respective ORs on multivariable analysis. As expected, older age, male sex, higher ASA class, and presence of comorbidities had greater odds of PACE as compared to their respective reference categories. For the derivation cohort, the c-statistic was 0.876 and Brier score was 0.0048; for the validation cohort, the c-statistic was 0.866 and Brier score was 0.0048. The overall analytic data set had a c-statistic of 0.874 and Brier score of 0.005. Figure 1 ranks all 1,880 CPT codes on a caterpillar plot based upon each operation’s OR for PACE relative to the average CPT code.
There were 66 low-, 30 intermediate-, and 106 high-risk operations that accounted for the majority of the operations (80% of operations in each risk category) performed, and the descriptions of these are reported in ascending order of intrinsic cardiac risk in supplemental table 1, Supplemental Digital Content (https://links.lww.com/ALN/B593). Examples are shown in table 2. The median OR for these operations was 1.20 (interquartile range [IQR], 0.62 to 1.78). Excisional breast biopsy was the operation with the lowest intrinsic cardiac risk of PACE (OR, 0.11; 95% CI, 0.02 to 0.25) relative to the average, whereas aorto-bifemoral bypass grafting had the highest (OR, 6.61; 95% CI, 5.54 to 7.90). For a different perspective, if our hypothetical patient was to undergo an excisional breast biopsy, she would have an estimated 0.03% risk for PACE, as compared to her risk of 1.43% if she had aorto-bifemoral bypass grafting—a nearly 48-fold greater risk.
Other examples of high-risk operations included cystectomy with ileal conduit (OR, 3.76; 95% CI, 3.02 to 4.68), pylorus-preserving pancreatoduodenectomy (OR, 4.70; 95% CI, 4.00 to 5.53), and Ivor-Lewis esophagectomy (OR, 4.62; 95% CI, 3.56 to 5.99), whereas examples of low-risk operations included laparoscopic appendectomy (OR, 0.45; 95% CI, 0.33 to 0.62), sleeve gastrectomy (OR, 0.57; 95% CI, 0.45 to 0.73), and cholecystectomy (OR, 0.62; 95% CI, 0.53 to 0.72). Notably, these examples are all intraperitoneal operations and vary in their intrinsic cardiac risk profiles. Furthermore, the surgical approach also changed the intrinsic cardiac risk of the operation. For example, if our hypothetical patient was to undergo a laparoscopic cholecystectomy, she would have a 0.14% risk for PACE, whereas if she had an open cholecystectomy, she would have a 0.34% risk—two and a half–fold greater.
Statistical reliability of the most commonly performed operations was excellent: overall median reliability was 0.96 (IQR, 0.88 to 0.99). The median reliability of the 66 low-risk operations was 1.00 (IQR, 0.99 to 1.00), the 30 intermediate-risk 0.96 (IQR, 0.94 to 0.99), and the 106 high-risk 0.89 (IQR, 0.81 to 0.95).
To illustrate how variable risk is within a broad category, figure 2A shows a box plot of the ORs for operations within the thoracic surgery specialty. The median OR was 1.40 (IQR, 0.88 to 2.17). For a more granular perspective, figure 2B demonstrates the variability in intrinsic cardiac risk for each of the CPT codes within the thoracic surgery specialty.
Discussion
Using high-quality clinical data from more than 3.2 million patients, we empirically derived the intrinsic risk of individual operations for PACE. Broad groupings of operations, as has been conventionally done,9,10 can be misleading because they do not consider the continuum of intrinsic cardiac risk that exists for each operation. Current practices of preoperative cardiac risk assessments might be improved by recognizing the intrinsic cardiac risk of each operation when performing preoperative cardiac risk assessments.
Accurately predicting patients’ perioperative cardiac risk is paramount to mitigating PACE.3,6 Overestimation of risk may be as problematic as underestimation. Patients may forgo beneficial procedures; limited resources, such as intensive care, may be misappropriated; or providers may not refer patients for surgical care. Accurate estimation of risk allows patients to make informed decisions,13 and providers can appropriately plan care, such as deciding between an endovascular versus an open procedure, or between a free muscle and tissue transfer flap versus tissue expanders for breast reconstruction.
A significant contributor to a patient’s risk is the intrinsic risk the operation itself carries for PACE. However, defining this intrinsic risk has been mostly left to expert opinion.13 Operations have been traditionally grouped into categories based upon anatomy, physiology, or surgical specialty for simplicity and ease of use.9,10,26,34–36 For example, the 2014 American College of Cardiology/American Heart Association Guidelines provide “plastic surgery” as an example of low risk operations.7 However, surgeons and anesthesiologists recognize that a free flap requiring microvascular anastomoses with an operative duration potentially exceeding 12 h likely carries greater intrinsic cardiac risk as compared to the placement of breast tissue expanders for breast reconstruction, although both are “plastic surgery.” Indeed, if our hypothetical patient was to undergo a free flap with microvascular anastomosis, she would experience a 13-fold greater risk for PACE as compared to if she was to undergo placement of breast tissue expanders (0.52% vs. 0.04%, respectively).
Instead of grouping operations into anatomic or physiologic categories, our data-driven approach derives the intrinsic cardiac risk of each operation. For instance, Gupta et al.10 grouped foregut and hepatopancreatobiliary (FG/HPB) operations together. However, the FG/HPB category contains operations each with its own intrinsic cardiac risk, as we report. Without acknowledging this continuum of intrinsic cardiac risks, grouping all FG/HPB operations together implies that they all have the same risk (i.e., given equal weight in calculations). Using the thoracic surgery specialty as an example, the intrinsic cardiac risk of individual operations within the thoracic cavity varies (fig. 2). Without incorporating individual operations’ intrinsic cardiac risks into the preoperative cardiac risk stratification calculus, inaccurate assessments might be made.
Our study sorted individual operations based upon their intrinsic cardiac risks into three risk groups. However, a continuum of intrinsic cardiac risk exists based upon our framework (fig. 1) and simple classification into these three categories seem inappropriate. It is precisely because a continuum exists that we advocate for the adoption of sophisticated risk calculators that can accommodate such granularity of individual operations and their intrinsic cardiac risks. Computer-based risk calculators can handle this complex continuum of intrinsic cardiac risk, an improvement over relying on conventional broad groupings of operations.37–41 Indeed, the 2014 ACC/AHA Guidelines have begun to recognize and cautiously encourage the use of calculators.7 For those that do not wish to use a calculator, our study provides a comprehensive listing of the most commonly performed operations.
For rarely performed operations, procedure-specific risk estimates are generally less accurate (i.e., stable), partly because of low sample sizes.27–31 By using a mixed-effects model that employs empirical Bayes-like shrinkage, CPT codes with small samples are “shrunk” toward the population average. Reliability was calculated to estimate the confidence of our procedure-specific risk estimates for the CPT codes reported, which overall was “excellent.”28–33 However, for uncommonly performed operations, procedure-specific risk derived this way might have decreased levels of reliability and should be carefully interpreted.27–29,31 Computer-based calculators relying on procedure-specific cardiac risk might be subject to limitations in procedure sample size; however, issues of small CPT code sample size are likely rare in the current analysis of more than 3.2 million patients, representing the most robust and powered data available to address these issues. Furthermore, shrunken estimates might represent the best available estimate in the absence of better information, and certainly represent an improvement over currently utilized tools to assess cardiac risk.9,10 Further research is needed to determine the procedure-specific sample size acceptable for reliable estimates of procedure-specific cardiac risk, and to identify CPT codes associated with similar but more common operations that could be informative when the primary CPT code is rare.
This study is not the first to suggest that consideration of an operation’s intrinsic risk could improve risk stratification strategies. Noordzij et al.42 utilized registry data from The Netherlands and studied postoperative all-cause mortality in 3.7 million patients. Although they grouped operations into 36 bins “according to generally accepted medical theory and practice,” they concluded, as we do, that predictions of postoperative outcomes can be improved if the intrinsic risks of the operations are given more consideration in the preoperative risk assessment calculus. Estimates of risk will always be inaccurate and misleading if the intrinsic risk of an operation for an outcome is not appropriately considered.
Operations may carry intrinsic cardiac risk, independent of patient characteristics, because PACE has different etiologies from nonoperative cardiac events. Myocardial infarction is more likely to occur because of supply-and-demand mismatches (type 2 MI) rather than thrombosis (type 1 MI). Type 1 MI causes less than 5% of postoperative troponin increase.43 Many more patients will suffer myocardial injury after noncardiac surgery than overt infarction.44 These episodes are secondary to demand ischemia, which can be caused by pain, anemia, fluid shifts, inflammation, and the stress responses commensurate with an operation’s intrinsic risk.4,45 The inherent metabolic demands and levels of stress induced by surgery are likely explanations as to why certain operations or approaches (e.g., laparoscopic vs. open) to operations are associated with varying risk of PACE.46
The results of this study must be interpreted considering several limitations. First, as a retrospective cohort study, unmeasured confounding is always probable. Second, our results could not be compared to de facto low-risk operations, such as cataract surgery,47 since cataract surgeries are not available in the ACS NSQIP data. Third, the ACS NSQIP stopped collecting additional cardiac-specific risk factors other than the ones we noted in the Materials and Methods section because they did not improve the statistical models for quality improvement purposes.35 The absence of cardiac-specific variables, such as history of MI or stroke, hyperlipidemia requiring statin therapy, or whether a patient underwent preoperative cardiac testing, however, should not be overlooked. Our estimated intrinsic cardiac risks might therefore be underestimations in certain populations with greater cardiac disease burden (e.g., patients undergoing vascular operations). Our results must also be interpreted considering secular trends in preoperative cardiac risk evaluations. Vascular surgical procedures were highly scrutinized before the 2014 ACC/AHA Guidelines, which might again underestimate our risk estimates. Many operations with high intrinsic cardiac risk were, however, noted in our results to be vascular procedures, and our results should be interpreted as relative to the statistically estimated average procedure. Fourth, our data were unable to discern cardiac-specific from all-cause mortality, and our results might represent underestimations. However, it should be noted that the RCRI does not include cardiac-specific death.9 Last, the focus of ACS NSQIP hospitals on quality may be inconsistently present in non–ACS NSQIP hospitals, and this might impact the generalizability of our findings.
Our approach may challenge providers who have relied on intuition or expert opinion based on experience of estimating risk by looking at both patient factors and the planned procedure. Disassociating patient factors from the operation can thus contradict clinical intuition. The risk categories shown in this study represent the intrinsic risk of an operation for PACE without considering patient factors. But it is precisely because of the complex interplay between the intrinsic cardiac risk of each operation and patient characteristics that we recommend the use of risk calculators that can efficiently determine the most accurate predictions of cardiac risk. Notwithstanding, clinicians should be prepared to interpret these predictions in a clinical context.
In conclusion, conventional methods for preoperative cardiac risk stratification may be inadequate because they do not consider the intrinsic cardiac risk each operation itself carries. The ever-increasing use of technology in health care will allow us to adopt the use of sophisticated risk calculators at the bedside and during a clinical encounter rather than relying on simplistic risk scores. Our comprehensive lists of operations demonstrating their individual risks for PACE can serve as a reference source for routine preoperative medical consultations. Cardiologists, primary care physicians, and advanced practice providers who provide preoperative medical consultations could easily reference the intrinsic cardiac risks of operations to deliver high-quality perioperative care to surgical patients and improve multidisciplinary communication with surgeons and anesthesiologists.
Acknowledgments
The authors would like to thank Karl Y. Bilimoria, M.D., M.S. (Department of Surgery, Feinberg School of Medicine, Northwestern University, Chicago, Illinois) for providing editorial guidance during manuscript preparation.
Research Support
No sources of financial support contributed to the design and conduct of the study; analysis and interpretation of the data; and preparation, review, or approval of the manuscript. Supported by a research fellowship from the University of Chicago Medicine, under the auspices of Jeffrey B. Matthews, M.D. (Chicago, Illinois; to Dr. Liu), and by the American College of Surgeons, Clinical Scholars in Residence Program (Chicago, Illinois; to Dr. Liu).
Competing Interests
The authors declare no competing interests.