Big data and large sample size: A cautionary note on the potential for bias

Clinical and Translational Science

Volumn 7, Issue 4, 2014, Pages 342-346

  Kaplan, Robert M ^a   Chambers, David A ^b   Glasgow, Russell E ^c  

^a NATIONAL INSTITUTES OF HEALTH   (United States)

^b NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

^c UNIVERSITY OF COLORADO   (United States)

Author keywords

Bias; Big data; Research methods; Sampling

Indexed keywords

ASCERTAINMENT BIAS; CLINICAL TRIAL (TOPIC); EFFECT SIZE; ELECTRONIC MEDICAL RECORD; EPIDEMIOLOGICAL DATA; EPIDEMIOLOGY; EXTERNAL VALIDITY; HEALTH SERVICE; HEALTH SERVICES RESEARCH; HUMAN; INFORMATION PROCESSING; INTERNAL VALIDITY; MEASUREMENT ERROR; MEDICAL INFORMATION; MEDICAL RESEARCH; NOTE; OUTCOME VARIABLE; PRIORITY JOURNAL; REGISTRATION; SAMPLE SIZE; SAMPLING BIAS; SAMPLING ERROR; STATISTICAL BIAS; STUDY DESIGN; DATA BASE; RANDOMIZED CONTROLLED TRIAL (TOPIC); REPRODUCIBILITY; STANDARDS;

BIAS (EPIDEMIOLOGY); DATABASES AS TOPIC; ELECTRONIC HEALTH RECORDS; EPIDEMIOLOGIC METHODS; HUMANS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REPRODUCIBILITY OF RESULTS; SAMPLE SIZE;

EID: 84906222774     PISSN: 17528054     EISSN: 17528062     Source Type: Journal    
DOI: 10.1111/cts.12178     Document Type: Note

References (25)

1. Freedman D, Pisani R, Purves R. Statistics. 4th edn. New York: WW Norton; 2004.
2. Lauer MS. Time for a creative transformation of epidemiology in the United States. JAMA. 2012; 308: 1804-1805.
3. Schneeweiss S, Avorn J. A review of uses of health care utilization databases for epidemiologic research on therapeutics. J Clin Epidemiol. 2005; 58: 323-337.
4. Selby JV, Krumholz HM, Kuntz RE, Collins FS. Network news: powering clinical research. Sci Transl Med 2013; 5: 182fs13.
5. Overhage JM, Overhage LM. Sensible use of observational clinical data. Stat Methods Med Res. 2013; 22: 7-13.
6. Stampfer MJ, Colditz GA, Willett WC, Manson JE, Rosner B, Speizer FE, Hennekens CH. Postmenopausal estrogen therapy and cardiovascular disease. Ten-year follow-up from the nurses' health study. N Engl J Med. 1991; 325: 756-762.
7. Prentice RL, Langer R, Stefanick ML, Howard BV, Pettinger M, Anderson G, Barad D, Curb JD, Kotchen J, Kuller L et al. Combined postmenopausal hormone therapy and cardiovascular disease: toward resolving the discrepancy between observational studies and the Women's Health Initiative clinical trial. Am J Epidemiol. 2005; 162: 404-414.
8. Grodstein F, Manson JE, Stampfer MJ. Postmenopausal hormone use and secondary prevention of coronary events in the nurses' health study. a prospective, observational study. Ann Intern Med. 2001; 135: 1-8.
9. Lagu T, Krumholz HM, Dharmarajan K, Partovian C, Kim N, Mody PS, Li SX, Strait KM, Lindenauer PK. Spending more, doing more, or both? An alternative method for quantifying utilization during hospitalizations. J Hosp Med. 2013; 8: 373-379.
10. Hersh WR, Weiner MG, Embi PJ, Logan JR, Payne PR, Bernstam EV, Lehmann HP, Hripcsak G, Hartzog TH, Cimino JJ et al. Caveats for the use of operational electronic health record data in comparative effectiveness research. Med Care. 2013; 51: S30-S37.
11. Schroeder SA. Shattuck Lecture. We can do better-improving the health of the American people. N Engl J Med. 2007; 357: 1221-1228.
12. Council NR. Capturing Social and Behavioral Domains in Electronic Health Records: Phase 1. Washington, DC: The National Academies Press; 2014.
13. Estabrooks PA, Boyle M, Emmons KM, Glasgow RE, Hesse BW, Kaplan RM, Krist AH, Moser RP, Taylor MV. Harmonized patient-reported data elements in the electronic health record: supporting meaningful use by primary care action on health behaviors and key psychosocial factors. J Am Med Inform Assoc. 2012; 19: 575-582.
14. Green LA, Fryer GE Jr., Yawn BP, Lanier D, Dovey SM. The ecology of medical care revisited. N Engl J Med. 2001; 344: 2021-2025.
15. Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement Sci. 2007; 2: 42.
16. Ioannidis JP, Ntzani EE, Trikalinos TA, Contopoulos-Ioannidis DG. Replication validity of genetic association studies. Nat Genet. 2001; 29: 306-309.
17. Vul E, Pashler H. Voodoo and circularity errors. Neuroimage. 2012; 62: 945-948.
18. Kriegeskorte N, Simmons WK, Bellgowan PS, Baker CI. Circular analysis in systems neuroscience: the dangers of double dipping. Nat Neurosci. 2009; 12: 535-540.
19. Kyzas PA, Denaxa-Kyza D, Ioannidis JP. Almost all articles on cancer prognostic markers report statistically significant results. Eur J Cancer. 2007; 43: 2559-2579.
20. Vermorken J. Annals of Oncology: a statement of editorial intent. Ann Oncol. 2012; 23: 1931-1932.
21. Kho AN, Pacheco JA, Peissig PL, Rasmussen L, Newton KM, Weston N, Crane PK, Pathak J, Chute CG, Bielinski SJ et al. Electronic medical records for genetic research: results of the eMERGE consortium. Sci Transl Med. 2011; 3: 79re1.
22. Begley CG, Ellis LM. Drug development: raise standards for preclinical cancer research. Nature. 2012; 483: 531-533.
23. Masters JR. Cell-line authentication: end the scandal of false cell lines. Nature. 2012; 492: 186.
24. Greenwald AG, Gonzalez R, Harris RJ, Guthrie D. Effect sizes and p values: what should be reported and what should be replicated? Psychophysiology. 1996; 33: 175-183.
25. Lauer MS. From hot hands to declining effects: the risks of small numbers. J Am Coll Cardiol. 2012; 60: 72-74.