Treatments effects from randomized trials and propensity score analyses were similar in similar populations in an example from cardiac surgery

Journal of Clinical Epidemiology

Volumn 64, Issue 10, 2011, Pages 1076-1084

  Kuss, O ^a   Legler, T ^a   Borgermann J ^b  

^a MARTIN LUTHER UNIVERSITY HALLE WITTENBERG   (Germany)

^b RUHR UNIVERSITY BOCHUM   (Germany)

Author keywords

External validity; Internal validity; Off pump coronary artery bypass; Propensity score; Randomized controlled trial

Indexed keywords

CORONARY ARTERY BYPASS GRAFT; HEART SURGERY; HUMAN; OUTCOME ASSESSMENT; POPULATION RESEARCH; PRIORITY JOURNAL; PROPENSITY SCORE; RANDOMIZED CONTROLLED TRIAL (TOPIC); REVIEW; SYSTEMATIC REVIEW (TOPIC); THERAPY EFFECT;

BIAS (EPIDEMIOLOGY); CORONARY ARTERY BYPASS; CORONARY ARTERY BYPASS, OFF-PUMP; HUMANS; PROPENSITY SCORE; RANDOMIZED CONTROLLED TRIALS AS TOPIC;

EID: 80052038237     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2011.01.005     Document Type: Review

References (52)

1. P.M. Rothwell External validity of randomized controlled trials: "to whom do the results of this trial apply?" Lancet 365 2005 82 93 (Pubitemid 40082150)
2. A. Britton, M. McKee, N. Black, K. McPherson, C. Sanderson, and C. Bain Choosing between randomised and non-randomised studies: a systematic review Health Technol Assess 2 1998 i iv 1-124
3. C. Bartlett, L. Doyal, S. Ebrahim, P. Davey, M. Bachmann, and M. Egger The causes and effects of socio-demographic exclusions from clinical trials Health Technol Assess 9 2005 iii iv ix-x, 1-152
4. S. Macmahon, and R. Collins Reliable assessment of the effects of treatment on mortality and major morbidity, II: observational studies Lancet 357 2001 455 462 (Pubitemid 32156151)
5. O.H. Klungel, E.P. Martens, B.M. Psaty, D.E. Grobbee, S.D. Sullivan, and B.H. Stricker Methods to assess intended effects of drug treatment in observational studies are reviewed J Clin Epidemiol 57 2004 1223 1231 (Pubitemid 40023141)
6. P.R. Rosenbaum, and D.B. Rubin The central role of the propensity score in observational studies for causal effects Biometrika 70 1983 41 55
7. E.F. Cook, and L. Goldman Performance of tests of significance based on stratification by a multivariate confounder score or by a propensity score J Clin Epidemiol 42 1989 317 324 (Pubitemid 19133717)
8. L.D. Robinson, and N.P. Jewell Some surprising results about covariate adjustment in logistic-regression models Int Stat Rev 58 1991 227 240
9. M.S. Cepeda, R. Boston, J.T. Farrar, and B.L. Strom Comparison of logistic regression versus propensity score when the number of events is low and there are multiple confounders Am J Epidemiol 158 2003 280 287 (Pubitemid 36944422)
10. R. Kunz, and A.D. Oxman The unpredictability paradox: review of empirical comparisons of randomised and non-randomised clinical trials BMJ 317 1998 1185 1190 (Pubitemid 28488507)
11. R.R. MacLehose, B.C. Reeves, I.M. Harvey, T.A. Sheldon, I.T. Russell, and A.M. Black A systematic review of comparisons of effect sizes derived from randomised and non-randomised studies Health Technol Assess 4 2000 1 154
12. J.J. Deeks, J. Dinnes, R. D'Amico, A.J. Sowden, C. Sakarovitch, and F. Song Evaluating non-randomised intervention studies Health Technol Assess 7 2003 iii x 1-173
13. J.P. Ioannidis, A.B. Haidich, M. Pappa, N. Pantazis, S.I. Kokori, and M.G. Tektonidou Comparison of evidence of treatment effects in randomized and nonrandomized studies JAMA 286 2001 821 830 (Pubitemid 33015576)
14. P.H. Noel, A.C. Larme, J. Meyer, G. Marsh, A. Correa, and J.A. Pugh Patient choice in diabetes education curriculum. Nutritional versus standard content for type 2 diabetes Diabetes Care 21 1998 896 901 (Pubitemid 28488778)
15. M.R. Janevic, N.K. Janz, J.A. Dodge, X. Lin, W. Pan, and B.R. Sinco The role of choice in health education intervention trials: a review and case study Soc Sci Med 56 2003 1581 1594 (Pubitemid 36279490)
16. W.R. Shadish, M.H. Clark, and P.M. Steiner Can nonrandomized experiments yield accurate answers? A randomized experiment comparing random and nonrandom assignments J Am Stat Assoc 103 2008 1334 1343
17. S. Pohl, P.M. Steiner, J. Eisermann, R. Soellner, and T.D. Cook Unbiased causal inference from an observational study: results of a within-study comparison Educ Eval Pol Anal 31 2009 463 479
18. F.W. Sellke, J.M. DiMaio, L.R. Caplan, T.B. Ferguson, T.J. Gardner, and L.F. Hiratzka Comparing on-pump and off-pump coronary artery bypass grafting: numerous studies but few conclusions: a scientific statement from the American Heart Association council on cardiovascular surgery and anesthesia in collaboration with the interdisciplinary working group on quality of care and outcomes research Circulation 111 2005 2858 2864 (Pubitemid 40791559)
19. O. Kuss, B. von Salviati, and J. Borgermann Off-pump versus on-pump coronary artery bypass grafting: a systematic review and meta-analysis of propensity score analyses J Thorac Cardiovasc Surg 40 2010 829 835
20. J.F. Gummert, A. Funkat, A. Beckmann, W. Schiller, K. Hekmat, and M. Ernst Cardiac surgery in Germany during 2007: a report on behalf of the German society for thoracic and cardiovascular surgery Thorac Cardiovasc Surg 56 2008 328 336
21. D.C. Cheng, D. Bainbridge, J.E. Martin, and R.J. Novick Does off-pump coronary artery bypass reduce mortality, morbidity, and resource utilization when compared with conventional coronary artery bypass? A meta-analysis of randomized trials Anesthesiology 102 2005 188 203 (Pubitemid 40082856)
22. S.G. Raja Pump or no pump for coronary artery bypass: current best available evidence Tex Heart Inst J 32 2005 489 501 (Pubitemid 43275782)
23. J.T. Reston, S.J. Tregear, and C.M. Turkelson Meta-analysis of short-term and mid-term outcomes following off-pump coronary artery bypass grafting Ann Thorac Surg 76 2003 1510 1515 (Pubitemid 37378303)
24. A. Sedrakyan, A.W. Wu, A. Parashar, E.B. Bass, and T. Treasure Off-pump surgery is associated with reduced occurrence of stroke and other morbidity as compared with traditional coronary artery bypass grafting - a meta-analysis of systematically reviewed trials Stroke 37 2006 2759 2769 (Pubitemid 44922537)
25. D.N. Wijeysundera, W.S. Beattie, G. Djaiani, V. Rao, M.A. Borger, and K. Karkouti Off-pump coronary artery surgery for reducing mortality and morbidity: meta-analysis of randomized and observational studies J Am Coll Cardiol 46 2005 872 882 (Pubitemid 41224813)
26. C. Di Pietrantonj Four-fold table cell frequencies imputation in meta analysis Stat Med 25 2006 2299 2322
27. T.J. Hastie, and R.J. Tibshirani Generalized additive models 1990 Chapman & Hall London
28. M.S. Cepeda, R. Boston, J.T. Farrar, and B.L. Strom Optimal matching with a variable number of controls vs. a fixed number of controls for a cohort study: trade-offs J Clin Epidemiol 56 2003 230 237 (Pubitemid 36513484)
29. K. Ming, and P.R. Rosenbaum Substantial gains in bias reduction from matching with a variable number of controls Biometrics 56 1 2000 118 124 (Pubitemid 30165098)
30. D.B. Rubin The design versus the analysis of observational studies for causal effects: parallels with the design of randomized trials Stat Med 26 2007 20 36 (Pubitemid 46099415)
31. P.R. Rosenbaum, and D.B. Rubin Constructing a control-group using multivariate matched sampling methods that incorporate the propensity score Am Stat 39 1 1985 33 38
32. K. Imai, G. King, and E.A. Stuart Misunderstandings between experimentalists and observationalists about causal inference J R Stat Soc Ser A Stat Soc 171 2008 481 502
33. S.L.T. Normand, N.B. Landrum, E. Guadagnoli, J.Z. Ayanian, T.J. Ryan, and P.D. Cleary Validating recommendations for coronary angiography following acute myocardial infarction in the elderly: a matched analysis using propensity scores J Clin Epidemiol 54 2001 387 398 (Pubitemid 32303462)
34. P.C. Austin Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples Stat Med 28 2009 3083 3107
35. R. Wolfinger, and M. O'Connell Generalized linear mixed models - a pseudo-likelihood approach J Stat Comput Simulat 48 3-4 1998 233 243
36. A. Agresti Categorical data analysis 2nd ed. 2002 Wiley-InterScience Hoboken, NJ
37. E.J. Bergstralh, J.L. Kosanke, and S.J. Jacobsen Software for optimal matching in observational studies Epidemiology 7 1996 331 332
38. M. King, I. Nazareth, F. Lampe, P. Bower, M. Chandler, and M. Morou Impact of participant and physician intervention preferences on randomized trials: a systematic review JAMA 293 2005 1089 1099 (Pubitemid 40300283)
39. G.E. Vist, K.B. Hagen, P.J. Devereaux, D. Bryant, D.T. Kristoffersen, and A.D. Oxman Systematic review to determine whether participation in a trial influences outcome BMJ 330 2005 1175
40. S. Shikata, T. Nakayama, Y. Noguchi, Y. Taji, and H. Yamagishi Comparison of effects in randomized controlled trials with observational studies in digestive surgery Ann Surg 244 2006 668 676 (Pubitemid 44629938)
41. M.A. Hernán, A. Alonso, R. Logan, F. Grodstein, K.B. Michels, and W.C. Willett Observational studies analyzed like randomized experiments: an application to postmenopausal hormone therapy and coronary heart disease Epidemiology 19 2008 766 779
42. A.D. Furlan, G. Tomlinson, A.A. Jadad, and C. Bombardier Methodological quality and homogeneity influenced agreement between randomized trials and nonrandomized studies of the same intervention for back pain J Clin Epidemiol 61 2008 209 231
43. R.L. Tannen, M.G. Weiner, and D. Xie Use of primary care electronic medical record database in drug efficacy research on cardiovascular outcomes: comparison of database and randomised controlled trial findings BMJ 338 2009 b81
44. L. Smeeth, I. Douglas, A.J. Hall, R. Hubbard, and S. Evans Effect of statins on a wide range of health outcomes: a cohort study validated by comparison with randomized trials Br J Clin Pharmacol 67 2009 99 109
45. N.S. Abraham, C.J. Byrne, J.M. Young, and M.J. Solomon Meta-analysis of well-designed nonrandomized comparative studies of surgical procedures is as good as randomized controlled trials J Clin Epidemiol 63 2009 238-235
46. P.N. Papanikolaou, G.D. Christidi, and J.P. Ioannidis Comparison of evidence on harms of medical interventions in randomized and nonrandomized studies CMAJ 174 2006 635 641 (Pubitemid 43341873)
47. S.H. Giordano, Y.F. Kuo, Z. Duan, G.N. Hortobagyi, J. Freeman, and J.S. Goodwin Limits of observational data in determining outcomes from cancer therapy Cancer 112 2008 2456 2466
48. H.T. Sorensen, T.L. Lash, and K.J. Rothman Beyond randomized controlled trials: a critical comparison of trials with nonrandomized studies Hepatology 44 2006 1075 1082 (Pubitemid 44748358)
49. A.D. McMahon Approaches to combat with confounding by indication in observational studies of intended drug effects Pharmacoepidemiol Drug Saf 12 2003 551 558 (Pubitemid 37220641)
50. F. Kerendi, C.D. Morris, and J.D. Puskas Off-pump coronary bypass surgery for high-risk patients: only in expert centers? Curr Opin Cardiol 23 2008 573 578
51. S. Weitzen, K.L. Lapane, A.Y. Toledano, A.L. Hume, and V. Mor Principles for modeling propensity scores in medical research: a systematic literature review Pharmacoepidemiol Drug Saf 13 2004 841 853 (Pubitemid 40003819)
52. P. Juni, A. Witschi, R. Bloch, and M. Egger The hazards of scoring the quality of clinical trials for meta-analysis JAMA 282 1999 1054 1060 (Pubitemid 29436453)