Can We Trust Observational Studies Using Propensity Scores in the Critical Care Literature? A Systematic Comparison with Randomized Clinical Trials

Critical Care Medicine

Volumn 43, Issue 9, 2015, Pages 1870-1879

  Kitsios, Georgios D ^a   Dahabreh, Issa J ^b   Callahan, Sean ^c   Paulus, Jessica K ^d   Campagna, Anthony C ^e   Dargin, James M ^e  

^a UNIVERSITY OF PITTSBURGH MEDICAL CENTER   (United States)

^b BROWN UNIVERSITY   (United States)

^c MEDICAL UNIVERSITY OF SOUTH CAROLINA   (United States)

^d TUFTS MEDICAL CENTER   (United States)

^e LAHEY HOSPITAL AND MEDICAL CENTER   (United States)

Author keywords

Critical care; intensive care units; meta analysis; propensity score; randomized clinical trial

Indexed keywords

ARTICLE; CLINICAL PRACTICE; CLINICAL RESEARCH; COCHRANE LIBRARY; COMPARATIVE STUDY; HUMAN; INFORMATION RETRIEVAL; INTENSIVE CARE; MEDLINE; MORTALITY; OBSERVATIONAL STUDY; OUTCOME ASSESSMENT; PATIENT SELECTION; PRIORITY JOURNAL; PROPENSITY SCORE; PUBLICATION; RANDOMIZED CONTROLLED TRIAL (TOPIC); SCIENTIFIC LITERATURE; CRITICAL ILLNESS; STATISTICS AND NUMERICAL DATA;

CRITICAL CARE; CRITICAL ILLNESS; HUMANS; OBSERVATIONAL STUDY AS TOPIC; PROPENSITY SCORE; RANDOMIZED CONTROLLED TRIALS AS TOPIC;

EID: 84946138760     PISSN: 00903493     EISSN: 15300293     Source Type: Journal    
DOI: 10.1097/CCM.0000000000001135     Document Type: Article

References (48)

1. Silverman HJ, Miller FG: Control group selection in critical care randomiz controll trials evaluating interventional strategies: An ethical assessment. Crit Care M 2004; 32:852-857
2. Angus DC: Caring for the critically ill patient: Challenges and opportunities. JAMA 2007; 298:456-458
3. Methodology Committee of the Patient-Center Outcomes Research Institute (PCORI): Methodological standards and patientcenterness in comparative effectiveness research: The PCORI perspective. JAMA 2012; 307:1636-1640
4. Berger ML, Doban V: Big data, advanc analytics and the future of comparative effectiveness research. J Comp Eff Res 2014; 3:167-176
5. Cooke CR, Iwashyna TJ: Using existing data to address important clinical questions in critical care. Crit Care M 2013; 41:886-896
6. Wunsch H, Linde-Zwirble WT, Angus DC: Methods to adjust for bias and confounding in critical care health services research involving observational data. J Crit Care 2006; 21:1-7
7. Rosenbaum PR, Rubin DB: The central role of the propensity score in observational studies for causal effects. Biometrika 1983; 70:41-55
8. Glynn RJ, Schneeweiss S, Stürmer T: Indications for propensity scores and review of their use in pharmacoepidemiology. Basic Clin Pharmacol Toxicol 2006; 98:253-259
9. Gayat E, Pirracchio R, Resche-Rigon M, et al: Propensity scores in intensive care and anaesthesiology literature: A systematic review. Intensive Care M 2010; 36:1993-2003
10. Dahabreh IJ, Sheldrick RC, Paulus JK, et al: Do observational studies using propensity score methods agree with randomiz trials? A systematic comparison of studies on acute coronary syndromes. Eur Heart J 2012; 33:1893-1901
11. Zhang Z, Ni H, Xu X: Observational studies using propensity score analysis underestimat the effect sizes in critical care micine. J Clin Epidemiol 2014; 67:932-939
12. Kitsios GD: Propensity score studies are unlikely to underestimate treatment effects in critical care micine: A critical reanalysis. J Clin Epidemiol 2015; 68:467-469
13. Austin PC: A critical appraisal of propensity-score matching in the mical literature between 1996 and 2003. Stat M 2008; 27:2037-2049
14. Austin PC: Primer on statistical interpretation or methods report card on propensity-score matching in the cardiology literature from 2004 to 2006: A systematic review. Circ Cardiovasc Qual Outcomes 2008; 1:62-67
15. Higgins JP, Altman DG, Gøtzsche PC, et al; Cochrane Bias Methods Group; Cochrane Statistical Methods Group: The Cochrane Collaboration's tool for assessing risk of bias in randomis trials. BMJ 2011; 343:d5928
16. Normand SLT: Tutorial in biostatistics meta-analysis: Formulating, evaluating, combining, and reporting. Stat M 1999; 18:321-359
17. Altman DG, Bland JM: Interaction revisit: The difference between two estimates. BMJ 2003; 326:219
18. Ferrer R, Artigas A, Suarez D, et al; usepsis Study Group: Effectiveness of treatments for severe sepsis: A prospective, multicenter, observational study. Am J Respir Crit Care M 2009; 180:861-866
19. Rowan KM, Welch CA, North E, et al: Drotrecogin alfa (activat): Real-life use and outcomes for the UK. Crit Care 2008; 12:R58
20. Martin G, Brunkhorst FM, Janes JM, et al: The international PROGRESS registry of patients with severe sepsis: Drotrecogin alfa (activat) use and patient outcomes. Crit Care 2009; 13:R103
21. Lindenauer PK, Rothberg MB, Nathanson BH, et al: Activat protein C and hospital mortality in septic shock: A propensity-match analysis. Crit Care M 2010; 38:1101-1107
22. Schortgen F, Girou E, Deye N, et al; CRYCO Study Group: The risk associat with hyperoncotic colloids in patients with shock. Intensive Care M 2008; 34:2157-2168
23. Mehta RL, Pascual MT, Soroko S, et al; PICARD Study Group: Diuretics, mortality, and nonrecovery of renal function in acute renal failure. JAMA 2002; 288:2547-2553
24. Uchino S, Doig GS, Bellomo R, et al; Beginning and Ending Supportive Therapy for the Kidney (B.E.S.T. Kidney) Investigators: Diuretics and mortality in acute renal failure. Crit Care M 2004; 32:1669-1677
25. van der Wal G, Brinkman S, Bisschops LL, et al: Influence of mild therapeutic hypothermia after cardiac arrest on hospital mortality. Crit Care M 2011; 39:84-88
26. Hörburger D, Testori C, Sterz F, et al: Mild therapeutic hypothermia improves outcomes compar with normothermia in cardiacarrest patients-A retrospective chart review. Crit Care M 2012; 40:2315-2319
27. Biersteker HA, Andriessen TM, Horn J, et al: Factors influencing intracranial pressure monitoring guideline compliance and outcome after severe traumatic brain injury. Crit Care M 2012; 40:1914-1922
28. Bajwa EK, Malhotra CK, Thompson BT, et al: Statin therapy as prevention against development of acute respiratory distress syndrome: An observational study. Crit Care M 2012; 40:1470-1477
29. Torgersen C, Luckner G, Schröder DC, et al: Concomitant argininevasopressin and hydrocortisone therapy in severe septic shock: Association with mortality. Intensive Care M 2011; 37:1432-1437
30. Scales DC, Thiruchelvam D, Kiss A, et al: The effect of tracheostomy timing during critical illness on long-term survival. Crit Care M 2008; 36:2547-2557
31. Girou E, Brun-Buisson C, Taillé S, et al: Secular trends in nosocomial infections and mortality associat with noninvasive ventilation in patients with exacerbation of COPD and pulmonary ema. JAMA 2003; 290:2985-2991
32. González M, Arroliga AC, Frutos-Vivar F, et al: Airway pressure release ventilation versus assist-control ventilation: A comparative propensity score and international cohort study. Intensive Care M 2010; 36:817-827
33. Vincent JL, Sakr Y, Sprung C, et al; Sepsis Occurrence in Acutely Ill Patients (SOAP) Investigators: Are blood transfusions associat with greater mortality rates? Results of the Sepsis Occurrence in Acutely Ill Patients study. Anesthesiology 2008; 108:31-39
34. Vincent JL, Baron JF, Reinhart K, et al; ABC (Anemia and Blood Transfusion in Critical Care) Investigators: Anemia and blood transfusion in critically ill patients. JAMA 2002; 288:1499-1507
35. Goodman SN: Toward evidence-bas mical statistics. 1: The P value fallacy. Ann Intern M 1999; 130:995-1004
36. Greenland S: Multiple-bias modeling for analysis of observational data. J R Stat Assoc 2005; 168:267-306
37. Wenzel RP, mond MB: Septic shock-Evaluating another fail treatment. N Engl J M 2012; 366:2122-2124
38. Lai PS, Thompson BT: Why activat protein C was not successful in severe sepsis and septic shock: Are we still tilting at windmills? Curr Infect Dis Rep 2013; 15:407-412
39. Lapinsky SE, Richards GA: Pro/con clinical debate: Pulmonary artery catheters increase the morbidity and mortality of intensive care unit patients. Crit Care 2003; 7:101-103
40. Connors AF Jr, Speroff T, Dawson NV, et al: The effectiveness of right heart catheterization in the initial care of critically ill patients. SUPPORT Investigators. JAMA 1996; 276:889-897
41. Lonardo NW, Mone MC, Nirula R, et al: Propofol is associat with favorable outcomes compar with benzodiazepines in ventilat intensive care unit patients. Am J Respir Crit Care M 2014; 189:1383-1394
42. Silverman H: Protecting vulnerable research subjects in critical care trials: Enhancing the inform consent process and recommendations for safeguards. Ann Intensive Care 2011; 1:8
43. Silverman HJ, Luce JM, Lanken PN, et al; NHLBI Acute Respiratory Distress Syndrome Clinical Trials Network (ARDSNet): Recommendations for inform consent forms for critical care clinical trials. Crit Care M 2005; 33:867-882
44. Vandenbroucke JP: Observational research, randomis trials, and two views of mical science. PLoS M 2008; 5:e67
45. Stürmer T, Joshi M, Glynn RJ, et al: A review of the application of propensity score methods yield increasing use, advantages in specific settings, but not substantially different estimates compar with conventional multivariable methods. J Clin Epidemiol 2006; 59:437-447
46. Collins GS, Le Manach Y: Comparing treatment effects between propensity scores and randomiz controll trials: Improving conduct and reporting. Eur Heart J 2012; 33:1867-1869
47. Dahabreh IJ, Kent DM: Can the learning health care system be ucat with observational data? JAMA 2014; 312:129-130
48. Kahn JM, Benson NM, Appleby D, et al: Long-term acute care hospital utilization after critical illness. JAMA 2010; 303:2253-2259