Interpreting observational studies: Why empirical calibration is needed to correct p-values

Statistics in Medicine

Volumn 33, Issue 2, 2014, Pages 209-218

  Schuemie, Martijn J ^a,b   Ryan, Patrick B ^b,c   Dumouchel, William ^b,d   Suchard, Marc A ^b,e   Madigan, David ^b,f  

^a ERASMUS MEDICAL CENTER   (Netherlands)

^b NATIONAL INSTITUTES OF HEALTH   (United States)

^c JANSSEN RESEARCH AND DEVELOPMENT   (United States)

^d Oracle Health Sciences   (United States)

^e UNIVERSITY OF CALIFORNIA   (United States)

^f Howard Hughes Medical Institute   (United States)

Author keywords

Calibration; Hypothesis testing; Negative controls; Observational studies

Indexed keywords

ISONIAZID; SEROTONIN UPTAKE INHIBITOR;

ARTICLE; CALCULATION; CALIBRATION; CASE CONTROL STUDY; CASE STUDY; COHORT ANALYSIS; CONTROLLED STUDY; DRUG SAFETY; EMPIRICAL CALIBRATION; HUMAN; LIVER TOXICITY; NULL HYPOTHESIS; OBSERVATIONAL STUDY; PROBABILITY; RANDOM ERROR; SCIENTIFIC LITERATURE; STATISTICAL SIGNIFICANCE; SYSTEMATIC ERROR; TREATMENT OUTCOME; UPPER GASTROINTESTINAL BLEEDING;

CALIBRATION; HYPOTHESIS TESTING; NEGATIVE CONTROLS; OBSERVATIONAL STUDIES;

BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; DRUG-INDUCED LIVER INJURY; FEMALE; GASTROINTESTINAL HEMORRHAGE; HUMANS; ISONIAZID; MALE; OBSERVATIONAL STUDY AS TOPIC; RESEARCH DESIGN; SEROTONIN UPTAKE INHIBITORS;

EID: 84890240053     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.5925     Document Type: Article

References (22)

1. Mayes LC, Horwitz RI, Feinstein AR. A collection of 56 topics with contradictory results in case-control research. International Journal of Epidemiology 1988; 17:680-685.
2. Ioannidis JP, Tarone R, McLaughlin JK. The false-positive to false-negative ratio in epidemiologic studies. Epidemiology 2011; 22:450-456.
3. Green J, Czanner G, Reeves G, Watson J, Wise L, Beral V. Oral bisphosphonates and risk of cancer of oesophagus, stomach, and colorectum: case-control analysis within a UK primary care cohort. BMJ 2010; 341:c4444.
4. Cardwell CR, Abnet CC, Cantwell MM, Murray LJ. Exposure to oral bisphosphonates and risk of esophageal cancer. Journal of the American Medical Association 2010; 304:657-663.
5. Ioannidis JP. Why most published research findings are false. PLoS Medicine 2005; 2:e124.
6. Farrington CP, Nash J, Miller E. Case series analysis of adverse reactions to vaccines: a comparative evaluation. American Journal of Epidemiology 1996; 143:1165-1173.
7. Rosenbaum P, Rubin D. The central role of the propensity score in observational studies for causal effects. Biometrika 1983; 70:41-55.
8. Smith BM, Schwartzman K, Bartlett G, Menzies D. Adverse events associated with treatment of latent tuberculosis in the general population. Canadian Medical Association Journal 2011; 183:E173-179.
9. Tata LJ, Fortun PJ, Hubbard RB, Smeeth L, Hawkey CJ, Smith CJ, Whitaker HJ, Farrington CP, Card TR, West J. Does concurrent prescription of selective serotonin reuptake inhibitors and non-steroidal anti-inflammatory drugs substantially increase the risk of upper gastrointestinal bleeding Alimentary Pharmacology & Therapeutics 2005; 22:175-181.
10. McAfee AT, Ming EE, Seeger JD, Quinn SG, Ng EW, Danielson JD, Cutone JA, Fox JC, Walker AM. The comparative safety of rosuvastatin: a retrospective matched cohort study in over 48, 000 initiators of statin therapy. Pharmacoepidemiology and Drug Safety 2006; 15:444-453.
11. El-Serag HB, Everhart JE. Diabetes increases the risk of acute hepatic failure. Gastroenterology 2002; 122:1822-1828.
12. Jinjuvadia K, Kwan W, Fontana RJ. Searching for a needle in a haystack: use of ICD-9-CM codes in drug-induced liver injury. American Journal of Gastroenterology 2007; 102:2437-2443.
13. Chan KA, Truman A, Gurwitz JH, Hurley JS, Martinson B, Platt R, Everhart JE, Moseley RH, Terrault N, Ackerson L, Selby JV. A cohort study of the incidence of serious acute liver injury in diabetic patients treated with hypoglycemic agents. Archives of Internal Medicine 2003; 163:728-734.
14. Abraham NS, Cohen DC, Rivers B, Richardson P. Validation of administrative data used for the diagnosis of upper gastrointestinal events following nonsteroidal anti-inflammatory drug prescription. Alimentary Pharmacology & Therapeutics 2006; 24:299-306.
15. Cooper GS, Chak A, Lloyd LE, Yurchick PJ, Harper DL, Rosenthal GE. The accuracy of diagnosis and procedural codes for patients with upper GI hemorrhage. Gastrointestinal Endoscopy 2000; 51:423-426.
16. Andrade SE, Gurwitz JH, Chan KA, Donahue JG, Beck A, Boles M, Buist DS, Goodman M, LaCroix AZ, Levin TR, Platt R. Validation of diagnoses of peptic ulcers and bleeding from administrative databases: a multi-health maintenance organization study. Journal of Clinical Epidemiology 2002; 55:310-313.
17. Lipsitch M, Tchetgen Tchetgen E, Cohen T. Negative controls: a tool for detecting confounding and bias in observational studies. Epidemiology 2010; 21:383-388.
18. Tisdale JE, Miller DA. Drug-Induced Diseases, American Society of Health-System Pharmacists: Prevention, Detection, and Management, Bethesda, MD 2010.
19. Gustafson P, McCandless LC. Probabilistic approaches to better quantifying the results of epidemiologic studies. International Journal of Environmental Research and Public Health 2010; 7:1520-1539.
20. Efron B. Large-scale simultaneous hypothesis testing: the choice of a null hypothesis. Journal of the American Statistical Association 2004; 99:96-104.
21. Langaas M, Lindqvist BH, Ferkingstad E. Estimating the proportion of true null hypotheses, with application to DNA microarray data. Journal of the Royal Statistical Society Series B 2005; 67:555-572.
22. Strimmer K. A unified approach to false discovery rate estimation. BMC Bioinformatics 2008; 9:303.