Observational studies using propensity score analysis underestimated the effect sizes in critical care medicine

Journal of Clinical Epidemiology

Volumn 67, Issue 8, 2014, Pages 932-939

  Zhang, Zhongheng ^a   Ni, Hongying ^a   Xu, Xiao ^a  

^a ZHEJIANG NORMAL UNIVERSITY   (China)

Author keywords

Critical care; Effect size; Observational study; Propensity score; Randomized controlled trial; Ratio of odds ratio

Indexed keywords

ARTICLE; COVARIANCE; EFFECT SIZE; EXPERIMENTAL THERAPY; HUMAN; INTENSIVE CARE; INTERMETHOD COMPARISON; MEDLINE; META ANALYSIS (TOPIC); OBSERVATIONAL STUDY; PRIORITY JOURNAL; PROPENSITY SCORE; RANDOMIZED CONTROLLED TRIAL (TOPIC); REGRESSION ANALYSIS; RISK FACTOR; SAMPLE SIZE; SENSITIVITY ANALYSIS; STATISTICAL SIGNIFICANCE; STUDY DESIGN; SYSTEMATIC REVIEW;

CRITICAL CARE; EFFECT SIZE; OBSERVATIONAL STUDY; PROPENSITY SCORE; RANDOMIZED CONTROLLED TRIAL; RATIO OF ODDS RATIO;

CRITICAL CARE; HUMANS; LOGISTIC MODELS; META-ANALYSIS AS TOPIC; OBSERVATIONAL STUDY AS TOPIC; ODDS RATIO; PROPENSITY SCORE; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN;

EID: 84902862714     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2014.02.018     Document Type: Article

References (43)

1. M. Trojano, F. Pellegrini, D. Paolicelli, A. Fuiani, and V. Di Renzo Observational studies: propensity score analysis of non-randomized data Int MS J 16 3 2009 90 97
2. B.D. Bradbury, D.T. Gilbertson, M.A. Brookhart, and R.D. Kilpatrick Confounding and control of confounding in nonexperimental studies of medications in patients with CKD Adv Chronic Kidney Dis 19 1 2012 19 26
3. P.R. Rosenbaum, and D.B. Rubin The central role of the propensity score in observational studies for causal effects Biometrika 70 1983 41 55
4. P.C. Austin A critical appraisal of propensity-score matching in the medical literature between 1996 and 2003 Stat Med 27 12 2008 2037 2049
5. P.C. Austin Propensity-score matching in the cardiovascular surgery literature from 2004 to 2006: a systematic review and suggestions for improvement J Thorac Cardiovasc Surg 134 2007 1128 1135
6. E. Gayat, G. Thabut, J.D. Christie, A. Mebazaa, J.Y. Mary, and R. Porcher Within-center matching performed better when using propensity score matching to analyze multicenter survival data: empirical and Monte Carlo studies J Clin Epidemiol 66 2013 1029 1037
7. G. Heinze, and P. Jüni An overview of the objectives of and the approaches to propensity score analyses Eur Heart J 32 2011 1704 1708
8. P.C. Austin An introduction to propensity score methods for reducing the effects of confounding in observational studies Multivariate Behav Res 46 3 2011 399 424
9. S. Suissa, and E. Garbe Primer: administrative health databases in observational studies of drug effects-advantages and disadvantages Nat Clin Pract Rheumatol 3 12 2007 725 732
10. E. Gayat, R. Pirracchio, M. Resche-Rigon, A. Mebazaa, J.Y. Mary, and R. Porcher Propensity scores in intensive care and anaesthesiology literature: a systematic review Intensive Care Med 36 12 2010 1993 2003
11. K.F. Schulz, D.G. Altman, D. Moher CONSORT Group CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials Trials 11 2010 32 http://dx.doi.org/10.1186/1745-6215-11-32
12. R. DerSimonian, and R. Kacker Random-effects model for meta-analysis of clinical trials: an update Contemp Clin Trials 28 2007 105 114
13. J.A. Sterne, P. Jüni, K.F. Schulz, D.G. Altman, C. Bartlett, and M. Egger Statistical methods for assessing the influence of study characteristics on treatment effects in 'meta-epidemiological' research Stat Med 21 2002 1513 1524
14. T.T. Leite, E. Macedo, S.M. Pereira, S.R. Bandeira, P.H. Pontes, and A.S. Garcia et al. Timing of renal replacement therapy initiation by AKIN classification system Crit Care 17 2 2013 R62
15. B. Jung, N. Clavieras, S. Nougaret, N. Molinari, A. Roquilly, and M. Cisse et al. Effects of etomidate on complications related to intubation and on mortality in septic shock patients treated with hydrocortisone: a propensity score analysis Crit Care 16 6 2012 R224
16. E.K. Bajwa, C.K. Malhotra, B.T. Thompson, D.C. Christiani, and M.N. Gong Statin therapy as prevention against development of acute respiratory distress syndrome: an observational study Crit Care Med 40 5 2012 1470 1477 http://dx.doi.org/10.1097/CCM.0b013e3182416d7a
17. M. Bojan, S. Gioanni, P. Mauriat, and P. Pouard High-frequency oscillatory ventilation and short-term outcome in neonates and infants undergoing cardiac surgery: a propensity score analysis Crit Care 15 5 2011 R259
18. M.Z. Sadique, R. Grieve, D.A. Harrison, B.H. Cuthbertson, and K.M. Rowan Is Drotrecogin alfa (activated) for adults with severe sepsis, cost-effective in routine clinical practice? Crit Care 15 5 2011 R228
19. G. Choudhury, P. Mandal, A. Singanayagam, A.R. Akram, J.D. Chalmers, and A.T. Hill Seven-day antibiotic courses have similar efficacy to prolonged courses in severe community-acquired pneumonia-a propensity-adjusted analysis Clin Microbiol Infect 17 12 2011 1852 1858
20. N.M. Schwann, Z. Hillel, A. Hoeft, P. Barash, P. Möhnle, and Y. Miao et al. Lack of effectiveness of the pulmonary artery catheter in cardiac surgery Anesth Analg 113 5 2011 994 1002
21. C. Torgersen, G. Luckner, D.C. Schröder, C.A. Schmittinger, C. Rex, and H. Ulmer et al. Concomitant arginine-vasopressin and hydrocortisone therapy in severe septic shock: association with mortality Intensive Care Med 37 9 2011 1432 1437
22. M.Y. Argalious, J.E. Dalton, E.J. Mascha, J.B. Cywinski, and D.G. Clair Association of red blood cell transfusion and postoperative outcomes after endovascular aortic repair Semin Cardiothorac Vasc Anesth 15 1-2 2011 49 55
23. G. van der Wal, S. Brinkman, L.L. Bisschops, C.W. Hoedemaekers, J.G. van der Hoeven, and D.W. de Lange et al. Influence of mild therapeutic hypothermia after cardiac arrest on hospital mortality Crit Care Med 39 1 2011 84 88
24. C. Wohlmuth, M.W. Dünser, B. Wurzinger, M. Deutinger, H. Ulmer, and C. Torgersen et al. Early fish oil supplementation and organ failure in patients with septic shock from abdominal infections: a propensity-matched cohort study JPEN J Parenter Enteral Nutr 34 4 2010 431 437
25. I. Khalid, P. Doshi, and B. DiGiovine Early enteral nutrition and outcomes of critically ill patients treated with vasopressors and mechanical ventilation Am J Crit Care 19 3 2010 261 268
26. R. Mounier, C. Adrie, A. Français, M. Garrouste-Orgeas, C. Cheval, B. Allaouchiche OUTCOMEREA Study Group Study of prone positioning to reduce ventilator-associated pneumonia in hypoxaemic patients Eur Respir J 35 4 2010 795 804
27. D.C. Scales, D. Thiruchelvam, A. Kiss, and D.A. Redelmeier The effect of tracheostomy timing during critical illness on long-term survival Crit Care Med 36 9 2008 2547 2557
28. P. Moubarak, S. Zilker, H. Wolf, B. Hofner, T. Kneib, and H. Küchenhoff et al. Activity-guided antithrombin III therapy in severe surgical sepsis: efficacy and safety according to a retrospective data analysis Shock 30 6 2008 634 641
29. J.M. Raurich, J.A. Llompart-Pou, J. Ibáñez, G. Frontera, O. Pérez, and L. García et al. Low-dose steroid therapy does not affect hemodynamic response in septic shock patients J Crit Care 22 4 2007 324 329
30. J.F. Dhainaut, S. Payet, B. Vallet, L.R. França, D. Annane, P.E. Bollaert PREMISS Study Group Cost-effectiveness of activated protein C in real-life clinical practice Crit Care 11 5 2007 R99
31. K.C. Cho, J. Himmelfarb, E. Paganini, T.A. Ikizler, S.H. Soroko, and R.L. Mehta et al. Survival by dialysis modality in critically ill patients with acute kidney injury J Am Soc Nephrol 17 11 2006 3132 3138
32. J.L. Vincent, Y. Sakr, K. Reinhart, C.L. Sprung, H. Gerlach, V.M. Ranieri 'Sepsis Occurrence in Acutely Ill Patients' Investigators Is albumin administration in the acutely ill associated with increased mortality? Results of the SOAP study Crit Care 9 6 2005 R745 R754
33. Y. Sakr, J.L. Vincent, K. Reinhart, D. Payen, C.J. Wiedermann, D.F. Zandstra Sepsis Occurrence in Acutely Ill Patients Investigators Use of the pulmonary artery catheter is not associated with worse outcome in the ICU Chest 128 2005 2722 2731
34. C.R. Cooke, and T.J. Iwashyna Using existing data to address important clinical questions in critical care Crit Care Med 41 3 2013 886 896
35. O. Kuss, T. Legler, and J. Börgermann Treatments effects from randomized trials and propensity score analyses were similar in similar populations in an example from cardiac surgery J Clin Epidemiol 64 2011 1076 1084
36. P.C. Austin, M.M. Mamdani, T.A. Stukel, G.M. Anderson, and J.V. Tu The use of the propensity score for estimating treatment effects: administrative versus clinical data Stat Med 24 2005 1563 1578
37. J.D. Sandham, R.D. Hull, R.F. Brant, L. Knox, G.F. Pineo, C.J. Doig Canadian Critical Care Clinical Trials Group A randomized, controlled trial of the use of pulmonary-artery catheters in high-risk surgical patients N Engl J Med 348 2003 5 14
38. S. Hollis, and F. Campbell What is meant by intention to treat analysis? Survey of published randomised controlled trials BMJ 319 1999 670 674
39. R. Pirracchio, M. Carone, M.R. Rigon, E. Caruana, A. Mebazaa, and S. Chevret Propensity score estimators for the average treatment effect and the average treatment effect on the treated may yield very different estimates Stat Methods Med Res 2013 Nov 6 [Epub ahead of print]
40. I.J. Dahabreh, R.C. Sheldrick, J.K. Paulus, M. Chung, V. Varvarigou, and H. Jafri et al. Do observational studies using propensity score methods agree with randomized trials? A systematic comparison of studies on acute coronary syndromes Eur Heart J 33 2012 1893 1901
41. K. Thorlund, G. Imberger, M. Walsh, R. Chu, C. Gluud, and J. Wetterslev et al. The number of patients and events required to limit the risk of overestimation of intervention effects in meta-analysis-a simulation study PLoS One 6 10 2011 e25491
42. Z. Zhang, X. Xu, and H. Ni Small studies may overestimate the effect sizes in critical care meta-analyses: a meta-epidemiological study Crit Care 17 1 2013 R2
43. D. Bassler, V.M. Montori, M. Briel, P. Glasziou, S.D. Walter, and T. Ramsay et al. Reflections on meta-analyses involving trials stopped early for benefit: is there a problem and if so, what is it? Stat Methods Med Res 22 2 2013 159 168