Do observational studies using propensity score methods agree with randomized trials? A systematic comparison of studies on acute coronary syndromes

European Heart Journal

Volumn 33, Issue 15, 2012, Pages 1893-1901

  Dahabreh, Issa J ^a   Sheldrick, Radley C ^a   Paulus, Jessica K ^b,c   Chung, Mei ^a   Varvarigou, Vasileia ^c   Jafri, Haseeb ^d   Rassen, Jeremy A ^e,f   Trikalinos, Thomas A ^a   Kitsios, Georgios D ^a,g  

^a TUFTS MEDICAL CENTER   (United States)

^b TUFTS UNIVERSITY   (United States)

^c HARVARD SCHOOL OF PUBLIC HEALTH   (United States)

^d JOHNS HOPKINS HOSPITAL   (United States)

^e BRIGHAM AND WOMEN S HOSPITAL   (United States)

^f HARVARD MEDICAL SCHOOL   (United States)

^g LAHEY HOSPITAL AND MEDICAL CENTER   (United States)

Author keywords

Acute coronary syndromes; Myocardial infarction; Observational studies; Propensity score; Randomized controlled trials; Unstable angina

Indexed keywords

ABCIXIMAB; ANTILIPEMIC AGENT; ANTITHROMBOCYTIC AGENT; DIPEPTIDYL CARBOXYPEPTIDASE INHIBITOR;

ACUTE CORONARY SYNDROME; ARTICLE; HUMAN; LONG TERM CARE; MORTALITY; NON ST SEGMENT ELEVATION MYOCARDIAL INFARCTION; OBSERVATIONAL STUDY; PRIORITY JOURNAL; PROPENSITY SCORE; RANDOMIZED CONTROLLED TRIAL (TOPIC); RISK FACTOR; SENSITIVITY ANALYSIS; SHORT COURSE THERAPY; ST SEGMENT ELEVATION MYOCARDIAL INFARCTION;

ACUTE CORONARY SYNDROME; HUMANS; PROPENSITY SCORE; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REGRESSION ANALYSIS; REPRODUCIBILITY OF RESULTS; RISK FACTORS; TREATMENT OUTCOME;

EID: 84864626015     PISSN: 0195668X     EISSN: 15229645     Source Type: Journal    
DOI: 10.1093/eurheartj/ehs114     Document Type: Article

References (33)

1. Roger VL, Go AS, Lloyd-Jones DM, Adams RJ, Berry JD, Brown TM, Carnethon MR, Dai S, De Simone G, Ford ES, Fox CS, Fullerton HJ, Gillespie C, Greenlund KJ, Hailpern SM, Heit JA, Ho PM, Howard VJ, Kissela BM, Kittner SJ, Lackland DT, Lichtman JH, Lisabeth LD, Makuc DM, Marcus GM, Marelli A, Matchar DB, McDermott MM, Meigs JB, Moy CS, Mozaffarian D, Mussolino ME, Nichol G, Paynter NP, Rosamond WD, Sorlie PD, Stafford RS, Turan TN, Turner MB, Wong ND, Wylie-Rosett J. Heart disease and stroke statistics-2011 update: a report from the American Heart Association. Circulation 2011;123:e18-e209.
2. Kent DM, Trikalinos TA. Therapeutic innovations, diminishing returns, and control rate preservation. JAMA 2009;302:2254-2256.
3. Rosenbaum PR. Observational Studies. 2nd ed. New York, USA: Springer; 2002.
4. Byar DP. Why databases should not replace randomized clinical trials. Biometrics 1980;36:337-342.
5. Concato J, Shah N, Horwitz RI. Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med 2000;342:1887-1892.
6. Benson K, Hartz AJ. A comparison of observational studies and randomized, controlled trials. N Engl J Med 2000;342:1878-1886.
7. Ioannidis JP, Haidich AB, Pappa M, Pantazis N, Kokori SI, Tektonidou MG, Contopoulos-Ioannidis DG, Lau J. Comparison of evidence of treatment effects in randomized and nonrandomized studies. JAMA 2001;286:821-830.
8. MacLehose RR, Reeves BC, Harvey IM,, Sheldon TA, Russell IT, Black AM. A systematic review of comparisons of effect sizes derived from randomised and nonrandomised studies. Health Technol Assess 2000;4:1-154.
9. Ioannidis JP, Haidich AB, Lau J. Any casualties in the clash of randomised and observational evidence? BMJ 2001;322:879-880.
10. Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika 1983;70:41-55.
11. Rubin DB. The design versus the analysis of observational studies for causal effects: parallels with the design of randomized trials. Stat Med 2007;26:20-36.
12. Little RJ, Rubin DB. Causal effects in clinical and epidemiological studies via potential outcomes: concepts and analytical approaches. Annu Rev Public Health 2000; 21:121-145.
13. Heinze G, Juni P. An overview of the objectives of and the approaches to propensity score analyses. Eur Heart J 2011;32:1704-1708.
14. Wright RS, Anderson JL, Adams CD,, Bridges CR, Casey DE Jr, Ettinger SM, Fesmire FM, Ganiats TG, Jneid H, Lincoff AM, Peterson ED, Philippides GJ, Theroux P, Wenger NK, Zidar JP, Jacobs AK. 2011 ACCF/AHA Focused Update of the Guidelines for the Management of Patients With Unstable Angina/Non-ST-Elevation Myocardial Infarction (Updating the 2007 Guideline): a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines. Circulation 2011;123:2022-2060.
15. Stukel TA, Fisher ES, Wennberg DE,, Alter DA, Gottlieb DJ, Vermeulen MJ. Analysis of observational studies in the presence of treatment selection bias: effects of invasive cardiac management on AMI survival using propensity score and instrumental variable methods. JAMA 2007;297:278-285.
16. Foster C, Mistry NF, Peddi PF, Shivak S. The Washington Manual of Medical Therapeutics. 33rd ed. St. Louis, MO, USA: Lippincott Williams & Wilkins; 2010.
17. Austin PC. A critical appraisal of propensity-score matching in the medical literature between 1996 and 2003. Stat Med 2008;27:2037-2049.
18. Sturmer T, Joshi M, Glynn RJ,, Avorn J, Rothman KJ, Schneeweiss S. A review of the application of propensity score methods yielded increasing use, advantages in specific settings, but not substantially different estimates compared with conventional multivariable methods. J Clin Epidemiol 2006;59:437-447.
19. Austin PC. Primer on statistical interpretation or methods report card on propensity-score matching in the cardiology literature from 2004 to 2006: a systematic review. Circ Cardiovasc Qual Outcomes 2008;1:62-67.
20. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986;7: 177-188.
21. Rubin DB, Thomas N. Combining propensity score matching with additional adjustments for prognostic covariates. J Am Stat Assoc 2000;95:573-585.
22. Yusuf S, Collins R, Peto R. Why do we need some large, simple randomized trials? Stat Med 1984;3:409-422.
23. Austin PC, Grootendorst P, Normand SL, Anderson GM. Conditioning on the propensity score can result in biased estimation of common measures of treatment effect: a Monte Carlo study. Stat Med 2007;26:754-768.
24. Shah BR, Laupacis A, Hux JE, Austin PC. Propensity score methods gave similar results to traditional regression modeling in observational studies: a systematic review. J Clin Epidemiol 2005;58:550-559.
25. Cepeda MS, Boston R, Farrar JT,, Strom BL. Comparison of logistic regression versus propensity score when the number of events is low and there are multiple confounders. Am J Epidemiol 2003;158:280-287.
26. Brophy JM, Belisle P, Joseph L. Evidence for use of coronary stents. A hierarchical Bayesian meta-analysis. Ann Intern Med 2003;138:777-786.
27. Ottervanger JP, Armstrong P, Barnathan ES,, Boersma E, Cooper JS, Ohman EM, James S,Wallentin L, Simoons ML. Association of revascularisation with low mortality in non-ST elevation acute coronary syndrome, a report from GUSTO IV-ACS. Eur Heart J 2004;25:1494-1501.
28. Hollis S, Campbell F. What is meant by intention to treat analysis? Survey of published randomised controlled trials. BMJ 1999;319:670-674.
29. Sterne JA, Sutton AJ, Ioannidis JP,, Terrin N, Jones DR, Lau J, Carpenter J, Rucker G, Harbord RM, Schmid CH, Tetzlaff J, Deeks JJ, Peters J, Macaskill P, Schwarzer G, Duval S, Altman DG, Moher D, Higgins JP. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ 2011;343:d4002.
30. Concato J, Lawler EV, Lew RA,, Gaziano JM, Aslan M, Huang GD. Observational methods in comparative effectiveness research. Am J Med 2010;123(Suppl. 1): e16-e23.
31. Pocock SJ, Elbourne DR. Randomized trials or observational tribulations? N Engl J Med 2000;342:1907-1909.
32. Schneeweiss S, Rassen JA, Glynn RJ,, Avorn J, Mogun H, Brookhart MA. Highdimensional propensity score adjustment in studies of treatment effects using health care claims data. Epidemiology 2009;20:512-522.
33. Rassen JA, Avorn J, Schneeweiss S. Multivariate-adjusted pharmacoepidemiologic analyses of confidential information pooled from multiple health care utilization databases. Pharmacoepidemiol Drug Saf 2010;19:848-857.