Routinely collected data and comparative effectiveness evidence: Promises and limitations

CMAJ

Volumn 188, Issue 8, 2016, Pages E158-E164

  Hemkens, Lars G ^a,b   Contopoulos Ioannidis, Despina G ^a   Ioannidis, John P A ^a,c  

^a STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY HOSPITAL BASEL   (Switzerland)

^c STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCESS TO INFORMATION; ARTICLE; CLINICAL DECISION MAKING; CLINICAL PROTOCOL; COMPARATIVE EFFECTIVENESS; CONFLICT OF INTEREST; COST CONTROL; DATA ANALYSIS; DATA COLLECTION METHOD; DRUG APPROVAL; ELECTRONIC HEALTH RECORD; EVIDENCE BASED MEDICINE; HEALTH CARE COST; HUMAN; INFORMATION PROCESSING; MEDICAL INFORMATICS; MEDICAL RESEARCH; OBSERVATIONAL STUDY; PERSONALIZED MEDICINE; RANDOMIZED CONTROLLED TRIAL (TOPIC); SAMPLE SIZE; METHODOLOGY; PROCEDURES; RESEARCH; STANDARDS;

BIOMEDICAL RESEARCH; CLINICAL DECISION-MAKING; COMPARATIVE EFFECTIVENESS RESEARCH; DATA COLLECTION; HUMANS; RESEARCH DESIGN; RESEARCH REPORT;

EID: 84968875304     PISSN: 08203946     EISSN: 14882329     Source Type: Journal    
DOI: 10.1503/cmaj.150653     Document Type: Article

References (35)

1. Hsing AW, Ioannidis JP. Nationwide population science: lessons from the Taiwan National Health Insurance Research Database. JAMA Intern Med. 2015;175:1527-9.
2. Hernán MA, Robins JM. Instruments for causal inference: An epidemiologist's dream? Epidemiology 2006;17:360-72.
3. Schneeweiss S, Avorn J. A review of uses of health care utilization databases for epidemiologic research on therapeutics. J Clin Epidemiol 2005;58:323-37.
4. Bohensky MA, Jolley D, Sundararajan V, et al. Data linkage: a powerful research tool with potential problems. BMC Health Serv Res 2010;10:346.
5. Naci H, Ioannidis JP. Comparative effectiveness of exercise and drug interventions on mortality outcomes: metaepidemiological study. BMJ 2013;347:f5577.
6. Geller SE, Adams MG, Carnes M. Adherence to federal guidelines for reporting of sex and race/ethnicity in clinical trials. J Womens Health (Larchmt) 2006;15:1123-31.
7. Dodd KS, Saczynski JS, Zhao Y, et al. Exclusion of older adults and women from recent trials of acute coronary syndromes. J Am Geriatr Soc 2011;59:506-11.
8. Heiat A, Gross CP, Krumholz HM. Representation of the elderly, women, and minorities in heart failure clinical trials. Arch Intern Med 2002;162:1682-8.
9. Konrat C, Boutron I, Trinquart L, et al. Underrepresentation of elderly people in randomised controlled trials. The example of trials of 4 widely prescribed drugs. PLoS ONE 2012;7:e33559.
10. Van Spall HG, Toren A, Kiss A, et al. Eligibility criteria of randomized controlled trials published in high-impact general medical journals: a systematic sampling review. JAMA 2007;297:1233-40.
11. Eisenstein EL, Lemons PW II, Tardiff BE, et al. Reducing the costs of phase III cardiovascular clinical trials. Am Heart J 2005;149:482-8.
12. Vickers AJ. Clinical trials in crisis: four simple methodologic fixes. Clin Trials 2014;11:615-21.
13. Rothwell PM. Treating individuals 2. Subgroup analysis in randomised controlled trials: importance, indications, and interpretation. Lancet 2005;365:176-86.
14. Chalmers I, Bracken MB, Djulbegovic B, et al. How to increase value and reduce waste when research priorities are set. Lancet 2014;383:156-65.
15. Lathyris DN, Patsopoulos NA, Salanti G, et al. Industry sponsorship and selection of comparators in randomized clinical trials. Eur J Clin Invest 2010;40:172-82.
16. Rizos EC, Salanti G, Kontoyiannis DP, et al. Homophily and co-occurrence patterns shape randomized trials agendas: illustration in antifungal agents. J Clin Epidemiol 2011;64:830-42.
17. Mills EJ, Thorlund K, Ioannidis JP. Demystifying trial networks and network meta-analysis. BMJ 2013;346:f2914.
18. Djulbegovic B, Hozo I. At what degree of belief in a research hypothesis is a trial in humans justified? J Eval Clin Pract 2002;8:269-76.
19. Chan AW, Song F, Vickers A, et al. Increasing value and reducing waste: addressing inaccessible research. Lancet 2014;383:257-66.
20. Rosner F. The ethics of randomized clinical trials. Am J Med 1987;82:283-90.
21. Siontis GC, Ioannidis JP. Risk factors and interventions with statistically significant tiny effects. Int J Epidemiol 2011;40:1292-307.
22. Mynatt CR, Doherty ME, Tweney RD. Confirmation bias in a simulated research environment: an experimental study of scientific inference. Q J Exp Psychol 1977;29:85-95.
23. Nickerson RS. Confirmation bias: a ubiquitous phenomenon in many guises. Rev Gen Psychol 1998;2:175.
24. Hemkens LG, Contopoulos-Ioannidis DG, Ioannidis J. Do routinely collected health data complement randomized evidence? A survey. CMAJ Open. In press.
25. Ioannidis JP, Haidich AB, Pappa M, et al. Comparison of evidence of treatment effects in randomized and nonrandomized studies. JAMA 2001;286:821-30.
26. Richardson WS, Wilson MC, Nishikawa J, et al. The well-built clinical question: a key to evidence-based decisions. ACP J Club 1995;123:A12-3.
27. Prasad V, Jena AB. Prespecified falsification end points: Can they validate true observational associations? JAMA 2013;309:241-2.
28. Young SS, Karr A. Deming, data and observational studies. A process out of control and needing fixing. Significance 2011;8:116-20.
29. Lash TL, Vandenbroucke JP. Should preregistration of epidemiologic study protocols become compulsory? Reflections and a counterproposal. Epidemiology 2012;23:184-8.
30. Ioannidis JP. The importance of potential studies that have not existed and registration of observational data sets. JAMA 2012;308:575-6.
31. Glasziou P, Altman DG, Bossuyt P, et al. Reducing waste from incomplete or unusable reports of biomedical research. Lancet 2014;383:267-76.
32. Hemkens LG, Benchimol EI, Langan SM, et al. Reporting of studies using routinely collected health data: systematic literature analysis [oral abstract presentation]. 2015 REWARD / EQUATOR Conference: Increasing value and reducing waste in biomedical research; 2015 Sept. 28-30; Edinburgh (UK).
33. Benchimol EI, Smeeth L, Guttmann A, et al. The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement. PLoS Med 2015;12:e1001885.
34. von Elm E, Altman DG, Egger M, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. PLoS Med 2007;4:e296.
35. Ioannidis JP. Informed consent, big data, and the oxymoron of research that is not research. Am J Bioeth 2013;13:40-2.