Real World Data in Adaptive Biomedical Innovation: A Framework for Generating Evidence Fit for Decision-Making

Clinical Pharmacology and Therapeutics

Volumn 100, Issue 6, 2016, Pages 633-646

  Schneeweiss, S ^a   Eichler, H G ^b   Garcia Altes, A ^c   Chinn, C ^d   Eggimann, A V ^e   Garner, S ^f   Goettsch, W ^g   Lim, R ^h   Lobker W ⁱ   Martin, D ^j   Muller T ⁱ   Park, B J ^k   Platt, R ^l   Priddy, S ^m   Ruhl, M ⁿ   Spooner, A ^o   Vannieuwenhuyse, B ^p   Willke, R J ^q  

^a BRIGHAM AND WOMEN S HOSPITAL   (United States)

^b EUROPEAN MEDICINES AGENCY   (United Kingdom)

^c Agency for Health Quality and Assessment of Catalonia Agència de Qualitat i Avaluació Sanitàries de Catalunya AQuAS   (Spain)

^d SANOFI   (France)

^e BLUEBIRD BIO   (United States)

^f NATIONAL INSTITUTE FOR HEALTH AND CARE EXCELLENCE   (United Kingdom)

^g UTRECHT UNIVERSITY   (Netherlands)

^h Health Canada and World Health Organization Collaborating Center for Standardization and Evaluation of Biologicals   (Canada)

ⁱ Leiterin Abteilung Arzneimittel   (Germany)

^j CENTER FOR DRUG EVALUATION AND RESEARCH   (United States)

^k Seoul National University   (South Korea)

^l HARVARD MEDICAL SCHOOL   (United States)

^m HUMANA INC   (United States)

ⁿ Aetion   (United States)

^o Health Products Regulatory Authority   (Ireland)

^p JANSSEN RESEARCH FOUNDATION   (Belgium)

^q International Society for Pharmacoeconomics and Outcomes Research   (United States)

more..

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE BIOMEDICAL INNOVATION; ARTICLE; DATA ANALYSIS; DATA BASE; DECISION SUPPORT SYSTEM; HUMAN; MEANINGFUL USE CRITERIA; MEDICAL TECHNOLOGY; PRIORITY JOURNAL; REPRODUCIBILITY; STUDY DESIGN; TREATMENT RESPONSE; BIOMEDICAL TECHNOLOGY ASSESSMENT; DECISION MAKING; ELECTRONIC HEALTH RECORD; FACTUAL DATABASE; HEALTH CARE DELIVERY; MASS COMMUNICATION; MEDICAL RESEARCH; ORGANIZATION AND MANAGEMENT; STANDARDS; STATISTICS AND NUMERICAL DATA;

BIOMEDICAL RESEARCH; DATABASES, FACTUAL; DECISION MAKING; DELIVERY OF HEALTH CARE; DIFFUSION OF INNOVATION; EFFICIENCY, ORGANIZATIONAL; ELECTRONIC HEALTH RECORDS; HEALTH SERVICES ACCESSIBILITY; HUMANS; TECHNOLOGY ASSESSMENT, BIOMEDICAL;

EID: 84991704891     PISSN: 00099236     EISSN: 15326535     Source Type: Journal    
DOI: 10.1002/cpt.512     Document Type: Article

References (70)

1. Kesselheim, A.S. & Darrow, J.J. FDA designations for therapeutics and their impact on drug development and regulatory review outcomes. Clin. Pharmacol. Ther. 97, 29–36 (2015).
2. Eichler, H.G. et al. Adaptive licensing: taking the next step in the evolution of drug approval. Clin. Pharmacol. Ther. 91, 426–437 (2012).
3. Schneeweiss, S. & Avorn, J. A review of uses of health care utilization databases for epidemiologic research on therapeutics. J. Clin. Epidemiol. 58, 323–337 (2005).
4. The International Society of Pharmacoepidemiology. Guidelines for good pharmacoepidemiology practices (GPP). Pharmacoepidemiol. Drug Saf. 17, 200–208 (2008).
5. Federal Register. Guidance for industry and Food and Drug Administration staff on best practices for conducting and reporting pharmacoepidemiologic safety studies using electronic healthcare data; availability. (2013).
6. European Network of Centres for Pharmacepidemiology and Pharmacovigilance. ENCePP guide on methodological standards in pharmacoepidemiology. (2014).
7. Johnson, M.L., Crown, W., Martin, B.C., Dormuth, C.R. & Siebert, U. Good research practices for comparative effectiveness research: analytic methods to improve causal inference from nonrandomized studies of treatment effects using secondary data sources: the ISPOR Good Research Practices for Retrospective Database Analysis Task Force Report--Part III. Value Health 12, 1062–1073 (2009).
8. Wang, S.V., Verpillat, P., Rassen, J.A., Patrick, A., Garry, E.M. & Bartels, D.B. Transparency and reproducibility of observational cohort studies using large healthcare databases. Clin. Pharmacol. Ther. 99, 325–332 (2016).
9. Schneeweiss, S. Improving therapeutic effectiveness and safety through big healthcare data. Clin. Pharmacol. Ther. 99, 262–265 (2016).
10. European Medicines Agency. Scientific guidance on post-authorisation efficacy studies. (2015).
11. West, S.L., Savitz, D.A., Koch, G., Strom, B.L., Guess, H.A. & Hartzema, A. Recall accuracy for prescription medications: self-report compared with database information. Am. J. Epidemiol. 142, 1103–1112 (1995).
12. Fischer, M.A. et al. Primary medication non-adherence: analysis of 195,930 electronic prescriptions. J. Gen. Intern. Med. 25, 284–290 (2010).
13. Glynn, R.J., Monane, M., Gurwitz, J.H., Choodnovskiy, I. & Avorn, J. Agreement between drug treatment data and a discharge diagnosis of diabetes mellitus in the elderly. Am. J. Epidemiol. 149, 541–549 (1999).
14. Stürmer, T., Schneeweiss, S., Avorn, J. & Glynn, R.J. Adjusting effect estimates for unmeasured confounding with validation data using propensity score calibration. Am. J. Epidemiol. 162, 279–289 (2005).
15. Schneeweiss, S. et al. Supplementing claims data with outpatient laboratory test results to improve confounding adjustment in effectiveness studies of lipid-lowering treatments. BMC Med. Res. Methodol. 12, 180 (2012).
16. B.R.I.D.G.E. to data. The search engine for healthcare databases. (2016). Accessed June 2016.
17. International Society for Pharmacoeconomics and Outcomes Research: ISPOR International Digest of Databases. (2016). Accessed June 2016.
18. Mandl, K.D. & Kohane, I.S. Federalist principles for healthcare data networks. Nat. Biotechnol. 33, 360–363 (2015).
19. Platt, R. et al. The U.S. Food and Drug Administration's Mini-Sentinel program: status and direction. Pharmacoepidemiol. Drug Saf. 21 Suppl 1, 1–8 (2012).
20. Laheij, R.J., Sturkenboom, M.C., Hassing, R.J., Dieleman, J., Stricker, B.H. & Jansen, J.B. Risk of community-acquired pneumonia and use of gastric acid-suppressive drugs. JAMA 292, 1955–1960 (2004).
21. Curtis, L.H. et al. Design considerations, architecture, and use of the Mini-Sentinel distributed data system. Pharmacoepidemiol. Drug Saf. 21 Suppl 1, 23–31 (2012).
22. Carnahan, R.M. & Moores, K.G. Mini-Sentinel's systematic reviews of validated methods for identifying health outcomes using administrative and claims data: methods and lessons learned. Pharmacoepidemiol. Drug Saf. 21 (suppl. 1), 82–89 (2012).
23. Schneeweiss, S., Rassen, J.A., Glynn, R.J., Avorn, J., Mogun, H. & Brookhart, M.A. High-dimensional propensity score adjustment in studies of treatment effects using health care claims data. Epidemiology 20, 512–522 (2009).
24. Najafzadeh, M. et al. A unified framework for classification of methods for benefit-risk assessment. Value Health 18, 250–259 (2015).
25. Rothman, K.J. & Greenland, S. Causation and causal inference in epidemiology. Am. J. Public Health 95 (suppl. 1), S144–S150 (2005).
26. Rubin, D.B. Estimating causal effects from large data sets using propensity scores. Ann. Intern. Med. 127(8 Pt 2), 757–763 (1997).
27. Rothman, K.J. Modern Epidemiology 3rd Edition (Philadelphia, PA, Lippincott Williams & Wilkins, 2008).
28. Gagne, J.J., Wang, S.V., Rassen, J.A. & Schneeweiss, S. A modular, prospective, semi-automated drug safety monitoring system for use in a distributed data environment. Pharmacoepidemiol. Drug Saf. 23, 619–627 (2014).
29. Spiegelman, D. & Hertzmark, E. Easy SAS calculations for risk or prevalence ratios and differences. Am. J. Epidemiol. 162, 199–200 (2005).
30. Grootendorst, P.V. A comparison of alternative models of prescription drug utilization. Health Econ. 4, 183–198 (1995).
31. Garrison, L.P. Jr, Neumann, P.J., Erickson, P., Marshall, D. & Mullins, C.D. Using real-world data for coverage and payment decisions: the ISPOR Real-World Data Task Force report. Value Health 10, 326–335 (2007).
32. Gagne, J.J. et al. Design considerations in an active medical product safety monitoring system. Pharmacoepidemiol. Drug Saf. 21 (suppl. 1), 32–40 (2012).
33. Schneeweiss, S. A basic study design for expedited safety signal evaluation based on electronic healthcare data. Pharmacoepidemiol. Drug Saf. 19, 858–868 (2010).
34. Johnson, E.S. et al. The incident user design in comparative effectiveness research. Pharmacoepidemiol. Drug Saf. 22, 1–6 (2013).
35. Brookhart, M.A., Stürmer, T., Glynn, R.J., Rassen, J. & Schneeweiss, S. Confounding control in healthcare database research: challenges and potential approaches. Med. Care 48 (suppl. 6), S114–S120 (2010).
36. Maclure, M. The case-crossover design: a method for studying transient effects on the risk of acute events. Am. J. Epidemiol. 133, 144–153 (1991).
37. Farrington, C.P. Relative incidence estimation from case series for vaccine safety evaluation. Biometrics 51, 228–235 (1995).
38. Maclure, M. et al. When should case-only designs be used for safety monitoring of medical products? Pharmacoepidemiol. Drug Saf. 21 Suppl 1, 50–61 (2012).
39. Shadish, W.R., Cook, T.D. & Campbell, D.T. Experimental and Quasi-Experimental Designs for Generalized Causal Inference (Wadsworth Publishing, Bel Air, CA, 2001).
40. Schneeweiss, S. Developments in post-marketing comparative effectiveness research. Clin. Pharmacol. Ther. 82, 143–156 (2007).
41. Rosenbaum, P.R. & Rubin, D.B. The central role of propensity scores in observational studies for causal effects. Biometrika 70, 41–55 (1983).
42. Solomon, D.H., Lunt, M. & Schneeweiss, S. The risk of infection associated with tumor necrosis factor alpha antagonists: making sense of epidemiologic evidence. Arthritis Rheum. 58, 919–928 (2008).
43. James, S.K. et al. Long-term safety and efficacy of drug-eluting versus bare-metal stents in Sweden. N. Engl. J. Med. 360, 1933–1945 (2009).
44. Sasinowski, F.J. Quantum of Effectiveness Evidence in FDA's Approval of Orphan Drugs (National Organization for Rare Disorders, Danbury, CT, 2011).
45. Maclure, M., Carleton, B. & Schneeweiss, S. Designed delays versus rigorous pragmatic trials: lower carat gold standards can produce relevant drug evaluations. Med. Care. 45 (10 suppl. 2), S44–S49 (2007).
46. Psaty, B.M. & Breckenridge, A.M. Mini-Sentinel and regulatory science--big data rendered fit and functional. N. Engl. J. Med. 370, 2165–2167 (2014).
47. Schneeweiss, S., Shrank, W.H., Ruhl, M. & Maclure, M. Decision-making aligned with rapid-cycle evaluation in health care. Int. J. Technol. Assess. Health Care 31, 214–222 (2015).
48. Zhou, X. et al. An evaluation of the THIN database in the OMOP common data model for active drug safety surveillance. Drug Saf. 36, 119–134 (2013).
49. Xu, Y. et al. A comparative assessment of observational medical outcomes partnership and Mini-Sentinel common data models and analytics: implications for active drug safety surveillance. Drug Saf. 38, 749–765 (2015).
50. Madigan, D. et al. Evaluating the impact of database heterogeneity on observational study results. Am. J. Epidemiol. 178, 645–651 (2013).
51. Schneeweiss, S. Learning from big health care data. N. Engl. J. Med. 370, 2161–2163 (2014).
52. Schneeweiss, S., Gagne, J.J., Glynn, R.J., Ruhl, M. & Rassen, J.A. Assessing the comparative effectiveness of newly marketed medications: methodological challenges and implications for drug development. Clin. Pharmacol. Ther. 90, 777–790 (2011).
53. Stratton, K.G., Cook, A.J., Jackson, L.A. & Nelson, J.C. Simulation study comparing exposure matching with regression adjustment in an observational safety setting with group sequential monitoring. Stat. Med. 34, 1117–1133 (2015).
54. Rothman, K.J. No adjustments are needed for multiple comparisons. Epidemiology 1, 43–46 (1990).
55. Rothman, K.J. Six persistent research misconceptions. J. Gen. Intern. Med. 29, 1060–1064 (2014).
56. Trifirò, G. et al. Combining multiple healthcare databases for postmarketing drug and vaccine safety surveillance: why and how? J. Intern. Med. 275, 551–561 (2014).
57. Mandl, K.D. et al. Scalable collaborative infrastructure for a learning healthcare system (SCILHS): architecture. J. Am. Med. Inform. Assoc. 21, 615–620 (2014).
58. European Medical Information Framework. . Accessed June 2016.
59. Hill, A.B. The environment and disease: association or causation? Proc. R. Soc. Med. 58, 295–300 (1965).
60. The Observational Medical Outcomes Partnership. (2015).
61. Gruber, S. et al. Design and analysis choices for safety surveillance evaluations need to be tuned to the specifics of the hypothesized drug-outcome association: safety study design and analysis choices need tuning. Pharmacoepidemiol. Drug Saf. 25, 973–981 (2016).
62. European Network of Centres for Pharmacoepidemiology and Pharmacovigilance. . Accessed June 2016.
63. Springate, D.A. et al. ClinicalCodes: an online clinical codes repository to improve the validity and reproducibility of research using electronic medical records. PLoS One 9, e99825 (2014).
64. Mini-Sentinel. (2013).
65. Sørensen, R. et al. Dabigatran use in Danish atrial fibrillation patients in 2011: a nationwide study. BMJ Open 3, e002758 (2013).
66. Seeger, J.D., Bykov, K., Bartels, D.B., Huybrechts, K., Zint, K. & Schneeweiss, S. Safety and effectiveness of dabigatran and warfarin in routine care of patients with atrial fibrillation. Thromb. Haemost. 114, 1277–1289 (2015).
67. Schneeweiss, S. et al. Increasing levels of restriction in pharmacoepidemiologic database studies of elderly and comparison with randomized trial results. Med. Care 45(10 suppl. 2), S131–S142 (2007).
68. Gagne, J.J. et al. Mini-Sentinel methods. Analytical methods to assess robustness of drug safety monitoring results. FDA Mini-Sentinel. (2015).
69. Schwarzer, R. & Siebert, U. Methods, procedures, and contextual characteristics of health technology assessment and health policy decision making: comparison of health technology assessment agencies in Germany, United Kingdom, France, and Sweden. Int. J. Technol. Assess. Health Care 25, 305–314 (2009).
70. Maclure, M. & Schneeweiss, S. Causation of bias: the episcope. Epidemiology 12, 114–122 (2001).