To the Editor:—  We appreciate the editorial1accompanying our article2and agree with the need to stress the limitations of propensity scores. A prospective randomized controlled trial (RCT), where possible, is always preferable to an observational study. However, RCTs have their own limitations, and prospective studies on blood transfusions based on hemoglobin thresholds are no exception. The exclusion of various diseases groups, such as patients with coronary artery disease, and the choice of treatment modality in the control group may challenge the applicability of the results of RCTs in everyday practice.3Indeed, Deans et al.  3recently highlighted the presence of coronary artery disease as a confounding factor in the RCT of Hébert et al.  4More specifically, a liberal blood transfusion strategy seemed to result in a higher mortality rate in younger patients with lower severity scores, but a lower mortality rate in the subgroup of patients with coronary artery disease.

Meticulous analyses, performed on large, unselected cohorts of critically ill patients, may provide useful additional information that can generate hypotheses and set the stage for subsequent RCTs. For example, a propensity analysis performed on a US database created a lot of turmoil when it raised serious concerns about the use of the pulmonary artery catheter,5but a similar analysis on the European Sepsis Occurrence in Acutely Ill Patients database using more meticulous adjustment did not yield similar findings.6 

Thanks to the large database from the Sepsis Occurrence in Acutely Ill Patients study,7the propensity analysis in our recent article2included a large number of variables, allowing extensive and reliable adjustment for confounders. Unfortunately, the accompanying editorial by Drs. Nuttall and Houle1was misleading when it suggested that the time to survival was considered as from intensive care unit admission: As stated in the article,2the time to survival was counted from the day on which patients received a blood transfusion, and patients who were not transfused were censored at the time of intensive care unit discharge; hence, the time factor was taken into account in our analysis. Drs. Nuttall and Houle correctly stated that performance of a propensity analysis is weak when there are seven or fewer events per confounding variable, but this limitation does not apply when the number of patients is large, as in our study.8The editorial also described the statistical process as being opaque, simulating a “black box”; this could have been a relevant argument if covariate adjustment were performed using stratification according to propensity scores or the simple use of this score as a covariate in a multivariate analysis, where adjustment is not performed at the individual level and results cannot be examined for balance between treatment groups.9However, we performed case matching, with an excellent match between patients (table 6 of our article2).

Therefore, the editorialists are correct in underlining the potential limitations of a propensity analysis, but we believe our statistical methodology was strong enough to respond to most of these concerns.

*Erasme Hospital, Université libre de Bruxelles, Brussels, Belgium.

Nuttall GA, Houle TT: Liars, damn liars, and propensity scores. Anesthesiology 2008; 108:3–4
Vincent JL, Sakr Y, Sprung CL, Harboe S, Damas P: Are blood transfusions associated with greater mortality rates? Anesthesiology 2008; 108:31–9
Deans KJ, Minneci PC, Suffredini AF, Danner RL, Hoffman WD, Ciu X, Klein HG, Schechter AN, Banks SM, Eichacker PQ, Natanson C: Randomization in clinical trials of titrated therapies: Unintended consequences of using fixed treatment protocols. Crit Care Med 2007; 35:1509–16
Hébert PC, Wells G, Blajchman MA, Marshall J, Martin C, Pagliarello G, Tweeddale M, Schweitzer I, Yetisir E: A multicenter, randomized, controlled clinical trial of transfusion requirements in critical care. N Engl J Med 1999; 340:409–17
Connors AF, Speroff T, Dawson NV, Thomas C, Harrell FE, Wagner D, Desbiens N, Goldman L, Wu AW, Califf RM, Fulkerson WJ, Vidaillet H, Broste S, Bellamy P, Lynn J, Knaus W, SUPPORT Investigators: The effectiveness of right heart catheterization in the initial care of critically ill patients. JAMA 1996;276:889–97
SUPPORT Investigators
Sakr Y, Vincent JL, Reinhart K, Payen D, Wiedermann CJ, Zandstra DF, Sprung CL: Use of the pulmonary artery catheter is not associated with worse outcome in the intensive care unit. Chest 2005; 128:2722–31
Vincent JL, Sakr Y, Sprung CL, Ranieri VM, Reinhart K, Gerlach H, Moreno R, Carlet J, Le Gall JR, Payen D: Sepsis in European intensive care units: Results of the SOAP study. Crit Care Med 2006; 34:344–53
Cepeda MS, Boston R, Farrar JT, Strom BL: Comparison of logistic regression versus  propensity score when the number of events is low and there are multiple confounders. Am J Epidemiol 2003; 158:280–7
Rosenbaum PR, Rubin DB: The central role of the propensity score on observational studies for causal effects. Biometrika 1983; 70:41–55