The methods of comparative effectiveness research

Annual Review of Public Health

Volumn 33, Issue , 2012, Pages 425-445

  Sox, Harold C ^a   Goodman, Steven N ^b  

^a DARTMOUTH INSTITUTE FOR HEALTH POLICY AND CLINICAL PRACTICE   (United States)

^b STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Clinical prediction rule; Instrumental variable; Propensity score; Sensitivity analysis; Treatment response heterogeneity

Indexed keywords

PLACEBO; PROPRANOLOL;

CLINICAL PRACTICE; CLINICAL RESEARCH; CLINICAL TRIAL (TOPIC); COMPARATIVE EFFECTIVENESS; COST EFFECTIVENESS ANALYSIS; HEALTH CARE POLICY; HEALTH INSURANCE; HUMAN; MEDICAL DECISION MAKING; PATIENT CARE; PRIORITY JOURNAL; REVIEW; SYSTEMATIC REVIEW (TOPIC); TREATMENT RESPONSE;

COMPARATIVE EFFECTIVENESS RESEARCH; DATA INTERPRETATION, STATISTICAL; DECISION MAKING; HUMANS; PUBLIC HEALTH; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN;

EID: 84861403768     PISSN: 01637525     EISSN: 15452093     Source Type: Book Series    
DOI: 10.1146/annurev-publhealth-031811-124610     Document Type: Review

References (81)

1. Anderson LM, Brownson RC, Fullilove MT, Teutsch SM, Novick LF, et al. 2005. Evidence-based public health policy and practice: promises and limits. Am. J. Prev. Med. 28:226-30
2. Basu A. 2011. Estimating decision-relevant comparative effects using instrumental variables. Stat. Biosci. 3:6-27
3. Beck JR, Kassirer JP, Pauker SG, Gottlieb JE, Klein K, Kassirer JP. 1982. A convenient approximation of life expectancy (the "DEALE"). I. Validation of the method. Am. J. Med. 73:883-88
4. Beck JR, Pauker SG. 1982. A convenient approximation of life expectancy (the "DEALE"): II. Use in medical decision-making. Am. J. Med. 73:889-97
5. Beck JR, Pauker SG. 1983. The Markov process in medical prognosis. Med. Decis. Mak. 3:411-58
6. Behrman RE, Benner JS, Brown JS, McClellan M, Woodcock J, et al. 2011. Developing the Sentinel system a national resource for evidence development. N. Engl. J. Med. 364:498-99
7. Benjamini Y, Hochberg Y. 1995. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc. B 57:289-300
8. Berry DA. 2006. Bayesian clinical trials. Nat. Rev. Drug. Discov. 5:27-36
9. Braitman LE, Rosenbaum PR. 2002. Rare outcomes, common treatments: analytic strategies using propensity scores. Ann. Intern. Med. 137:693-95
10. Briss PA, Zaza S, Pappaioanou M, Fielding J, Wright, et al. 2000. Developing an evidence-based guide to community preventive services\methods. Am. J. Prev. Med. 23:35-43
11. Brookhart MA, Rassen JA, Schneeweiss S. 2010. Instrument variable methods in comparative safety and effectiveness research. Pharmacoepidemiol. Drug. Saf. 19:537-54
12. Brookhart MA, Sturmer T, Glynn RJ, Rassen J, Schneeweiss S. 2010. Confounding control in healthcare database research: challenges and potential approaches. Med. Care. 48(6 Suppl.):S114-20
13. Centor RM, Witherspoon JM, Dalton HP, Brody CE, Link K. 1981. The diagnosis of strep throat in adults in the emergency room. Med. Decis. Mak. 1(3):239-46
14. Cook N, Buring JE, Ridker PM. 2006. The effect of including C-Reactive protein in cardiovascular risk prediction models for women. Ann. Intern. Med. 145:21-29
15. Cook NR, Ridker PM. 2009. Advances in measuring the effect of individual predictors of cardiovascular risk: the role of reclassification measures. Ann. Intern. Med. 150:795-802
16. Cornelis MC, Qi L, Zhang C, Kraft P, Manson J, et al. 2009. Joint effects of common genetic variants on the risk for type 2 diabetes in US men and women of European ancestry. Ann. Intern. Med. 150:541-50
17. Detre K, Peduzzi P, Murphy M, Hultgren H, Thomsen J, et al. 1981. Effect of bypass surgery on survival in patients in low-and high-risk subgroups delineated by the use of simple clinical variables. Circulation 163:1329-38
18. Dixon DO, Simon R. 1991. Bayesian subset analysis. Biometrics 47:871-81
19. Eddy DM. 1980. Screening for Cancer: Theory, Analysis, and Design. Englewood Cliffs, NJ: Prentice-Hall
20. Edwards SJL, Braunholtz DA, Lilford RJ, Stevens AJ. 1999. Ethical issues in the design and conduct of cluster randomised controlled trials. BMJ 318:1407
21. Efron B, Tibshirani R. 1993. Introduction to the Bootstrap. Boca Raton, FL: Chapman & Hall/CRC
22. Fielding JE, Teutsch SM. 2009. Integrating clinical care and community health: delivering health. JAMA 302:317-19
23. Garber AM, Sox HC. 2010. The role of costs in comparative effectiveness research. Health Aff. 29:1805-11
24. Giles FJ, Kantarjian HM, Cortes JE, Garcia-Manero G, Verstovsek S, et al. 2003. Adaptive randomized study of idarubicin and cytarabine versus troxacitabine and cytarabine versus troxacitabine and idarubicin in untreated patients 50 years or older with adverse karyotype acute myeloid leukemia. J. Clin. Oncol. 21:1722-27
25. Gold MR, Siegel JE, Russell LB, Weinstein MC, eds. 1996. Cost-Effectiveness in Health and Medicine. New York: Oxford Univ. Press
26. Goodman SN. 1999. Toward evidence-based medical statistics. 1: Thep value fallacy. Ann. Intern. Med. 130:995-1004
27. Goodman SN. 1999. Toward evidence-based medical statistics. 2: The Bayes factor. Ann. Intern. Med. 130:1005-13
28. Graham JD, Corso PS, Morris JM, Sequi-Gomez M, Weinstein MC. 1998. Evaluating the cost-effectiveness of clinical and public health measures. Annu. Rev. Public Health 19:125-52
29. Greenland S, Robins JM. 1991. Empirical-Bayes adjustments for multiple comparisons are sometimes useful. Epidemiology 2:244-51
30. Gruppo Italiano per lo Studio della Streptochinasi nell'Infarto Miocardico (GISSI). 1986. Effectiveness of intravenous thrombolytic treatment in acute myocardial infarction. Lancet 327, 397-402
31. Hamburg MA, Sharfstein JM. 2009. The FDA as a public health agency. New Engl. J. Med. 360:2493-95
32. Hastie T, Tibshirani R, Friedman JH. 2009. Model assessment and section. In The Elements of Statistical Learning: Data mining, inference, and prediction, pp. 219-57. New York: Springer Science + Business Media. 2nd ed.
33. Higgins JPT, Green S, eds. 2008. Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. Chichester, UK: Wiley
34. Horsman J, Furlong W, Feeny D, Torrance G. 2003. The Health Utilities Index (HUI®): concepts, measurement properties and applications. Health Qual. Life Outcomes 1:54
35. Horwitz RI, Singer BH, Makuch RW, Viscoli CM. 1996. Can treatment that is helpful on average be harmful to some patients? A study of the conflicting information needs of clinical inquiry and drug regulation. J. Clin. Epidemiol. 49:395-400
36. Hsu JC. 1996. Multiple Comparisons: Theory and Methods. Boca Raton, FL: Chapman & Hall/CRC
37. Inst. Med. (IOM). 2009. Initial National Priorities for Comparative Effectiveness Research. Washington, DC: Natl. Acad. Press. http://www.nap.edu/ catalog/12648.html
38. Inst. Med. (IOM). 2011. Clinical Practice Guidelines that We Can Trust. Washington, DC: Natl. Acad. Press. http://www.iom.edu/Reports/2011/Clinical- Practice-Guidelines-We-Can-Trust.aspx
39. Inst. Med. (IOM). 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: Natl. Acad. Press. http://www.iom.edu/ Reports/2011/Finding-What-Works-in-Health-Care-Standards-for-Systematic-Reviews. aspx
40. Janes H, Pepe MS, Gu W. 2008. Assessing the value of risk predictions by using risk stratification tables. Ann. Intern. Med. 149:751-60
41. Kent DM, Alsheikh-Ali A, Hayward RA. 2008. Competing risk and heterogeneity of treatment effect in clinical trials. Trials 9:30-36
42. Komaroff AL, Pass TM, Aronson MD, Ervin CT, Cretin S, et al. 1986. The prediction of streptococcal pharyngitis in adults. J. Gen. Intern. Med. 1:1-7
43. Krams M, Lees KR, Hacke W, Grieve AP, Orgogozo JM, et al. 2003. ASTIN Study Investigators. Acute stroke therapy by inhibition of neutrophils (ASTIN): an adaptive dose-response study of UK-279, 276 in acute ischemic stroke. Stroke 34:2543-48
44. Kravitz RL, Duan N, Braslow J. 2004. Evidence-based medicine, heterogeneity of treatment effects, and the trouble with averages. Milbank Q. 82:661-87
45. Lauer M, Collins FS. 2010. Using science to improve the nation's health system. JAMA 303:2182-83
46. Lauer MS, Collins FS. 2010. NIH's commitment to comparative effectiveness research. JAMA 303:2182-83
47. Laupacis A, Sekar N, Stiell IG. 1997. Clinical prediction rules: a review and suggested modification of methodological standards. JAMA 277:488-94
48. Luce BR, Kramer JM, Goodman SN, O'Connor JT, Tunis SR, et al. 2009. Rethinking randomized clinical trials for comparative effectiveness research: the need for transformational change. Ann. Intern. Med. 151:206-9
49. Lynn J, Baily MA, Bottrell M, Jennings B, Levine RJH, et al. 2007. The ethics of using quality improvement methods in health care. Ann. Intern. Med. 146:666-73
50. Mandelblatt JS, Cronin KA, Bailey S, Berry DA, de Koning HJ, et al. 2009. For the Breast Cancer Working Group of the Cancer Intervention and Surveillance Modeling Network (CISNET). Effects of mammography screening under different screening schedules: model estimates of potential benefits and harms. Ann. Intern. Med. 151:738-47
51. McClellan M, McNeil BJ, Newhouse JP. 1994. Does more intensive treatment of acute myocardial infarction in the elderly reduce mortality? Analysis using instrumental variables. JAMA 272:859-66
52. McNeil BJ, Pauker S, Sox HC Jr, Tversky A.1982. On the elicitation of patients' preferences for alternate therapies. N. Engl. J. Med. 306:1259-62
53. Mulrow C. 1994. Systematic reviews: rationale for systematic reviews. BMJ 309:597-98
54. Nease RN, Kneeland T, O'Connor GT, Sumner W, Lumpkins C, et al. 1995 Variation in patient utilities for outcomes of the management of chronic stable angina: implications for practice guidelines. JAMA 273:1185-90
55. Paynter NP, Chasman DI, Buring JE, Shiffman D, Cook NR, et al. 2009. Cardiovascular disease risk prediction with and without knowledge of genetic variation at chromosome 9p21.3. Ann. Intern. Med. 150:65-72
56. Pignone M, Saha S, Hoerger T, Mandelblatt J. 2002. Cost-effectiveness analyses of colorectal cancer screening: a systematic review for the US Preventive Services Task Force. Ann. Intern. Med. 137:96-104
57. Platt R, Takvorian SU, Septimus E, Hickok SE, Moody J, et al. 2010. Cluster randomized trials in comparative effectiveness research: randomizing hospitals to test methods for prevention of healthcare-associated infections. Med. Care 48(6 Suppl.):S52-57
58. Reilly BM, Evans AT. 2006. Translating clinical research into clinical practice: impact ofusing prediction rules to make decisions. Ann. Intern. Med. 144:201-9
59. Rothman KJ, Greenland S, Lash TL. 2008. Modern Epidemiology. Philadelphia, PA: Lippincott Williams and Wilkins. 3rd ed.
60. Roy PM, Durieux P, Gillaizeau F, Legall C, Armand-Perroux A, et al. 2009. A computerized handheld decision-support system to improve PE diagnosis: a RCT. Ann. Intern. Med. 151:677-86
61. Roy P-M, Meyer G, Vielle B, Le Gall C, Verschuren F, et al. 2006. For the EMDEPU Study Group. Appropriateness of diagnostic management and outcomes of suspected pulmonary embolism. Ann. Intern. Med. 144:157-64
62. Rubin DB. 1997. Estimating causal effects from large data sets using propensity scores. Ann. Intern. Med. 127:757-63
63. Sabin JE, Mazor K, Meterko V, Goff SL, Platt R. 2008. Comparing drug effectiveness at health plans: the ethics of cluster randomized trials. Hastings Cent. Rep. 38:39-48
64. Sonnenberg FA, Beck JR. 1993. Markov models in medical decision making: a practical guide. Med. Decis. Mak. 13:322-38
65. Sox HC. 2010. Comparative effectiveness research: an update. Ann. Intern. Med. 153:469-72
66. Sox HC, Hickam DH, Marton KI, Skeff KS, Sox CH, et al. 1990. Using the patient's history to estimate the probability of coronary artery disease: a comparison of referral and primary care practice. Am. J. Med. 89:7-14
67. Sox HC Jr, Blatt M, Higgins M, Marton KI. 1988. Medical Decision Making. Stoneham, MA: Butterworths
68. Sox HC Jr, Margulies I, Sox CH. 1981. Psychologically mediated effects of diagnostic tests. Ann. Intern. Med. 95:680-85
69. Stiell IG, McKnight RD, Greenberg GH. 1994. Implementation of the Ottawa ankle rules. JAMA 271:827-32
70. Sumner W, Nease R, Littenberg B. 1991. U-titer: a utility assessment tool. Proc. Annu. Symp. Comput. Appl. Med. Care, pp. 701-5
71. Thorpe KE, Zwarenstein M, Oxaman AD. 2009. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. CMAJ 180:1-10
72. Torrance GW, Feeny DH, Furlong WJ, Barr RD, Zhang Y, Wang Q. 1996. Multiattribute utility function for a comprehensive health status classification system: health utilities index mark 2. Med. Care 34:702-22
73. Tunis SR, Stryer DB, Clancy DM. 2003. Practical clinical rrials: increasing the value of clinical research for decision making in clinical and health policy. JAMA 290:1624-32
74. Tversky A, Kahneman D. 1974. Judgment under uncertainty: heuristics and biases. Science 185:1124-31
75. U.S. Food Drug Adm. (FDA). 2006. Guidance for the Use of Bayesian Statistics in Medical Device Clinical Trials\Draft Guidance for Industry and FDA Staff. Rockville, MD: Cent. Biol. Eval. Res. http://www.fda.gov/MedicalDevices/ DeviceRegulationandGuidance/GuidanceDocuments/ucm071072.htm
76. U.S. Food Drug Adm. (FDA). 2010. Guidance for Industry Adaptive Design Clinical Trials for Drugs and Biologics. Rockville, MD: Cent. Biol. Eval. Res. http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/ Guidances/UCM201790.pdf
77. Van der Weele TJ, Knol MJ. 2011. Interpretation of subgroup analyses in randomized trials: heterogeneity versus secondary interventions. Ann. Intern. Med. 154:680-83
78. Von Neumann J, Morgenstern O. 1944. Theory of Games and Economic Behavior. Princeton, NJ: Princeton Univ. Press
79. Wasson JH, Sox HC, Neff RK, Goldman L. 1985. Clinical prediction rules. Applications and methodological standards. N. Engl. J. Med. 313:793-99
80. Weinstein MC, Fineberg HV, Elstein AS, Frazier HS, Neuhauser D, et al. 1980. Clinical Decision Analysis. Philadelphia, PA: Saunders
81. Zauber AG, Lansdorp-Vogelaar I, Knudsen AB, Wilschut J, van Ballegooijen M, Kuntz KM. 2008. Clinical guidelines evaluating test strategies for colorectal cancer screening: a decision analysis for the US Preventive Services Task Force. Ann. Intern. Med. 149:659-69