Why statistical inference from clinical trials is likely to generate false and irreproducible results

BMC Medical Research Methodology

Volumn 17, Issue 1, 2017, Pages

  Hanin, Leonid ^a,b  

^a Nucl Eng Idaho State University   (United States)

^b PETER THE GREAT ST PETERSBURG POLYTECHNIC UNIVERSITY   (Russian Federation)

Author keywords

Clinical trial; Heterogeneity; p value; Permutation test; Random sample; Randomization; Reproducibility; Sample size; Significance; Stochastic independence

Indexed keywords

CLINICAL TRIAL (TOPIC); HUMAN; MARKOV CHAIN; REPRODUCIBILITY; SAMPLE SIZE; STANDARDS; STATISTICAL ANALYSIS; STATISTICAL BIAS; TREATMENT OUTCOME;

BIAS; CLINICAL TRIALS AS TOPIC; DATA INTERPRETATION, STATISTICAL; HUMANS; REPRODUCIBILITY OF RESULTS; SAMPLE SIZE; STOCHASTIC PROCESSES; TREATMENT OUTCOME;

EID: 85028005055     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/s12874-017-0399-0     Document Type: Review

References (35)

1. Butler D, Callaway E. Scientists in the dark after French clinical trial proves fatal. Nature. 2016;529:263-4.
2. Wadman M. London's disastrous drug trial has serious side effects for research. Nature. 2006;440:388-9.
3. Honkoop P, Scholte HR, de Man RA, Schalm SW. Mitochondrial injury. Lessons from the fialuridine trial. Drug Saf. 1997;17:1-7.
4. Attarwala H. TGN1412: from discovery to disaster. J Young Pharm. 2010;2(3):332-6.
5. Schork N. Time for one-patient trials. Nature. 2015;520:609-11.
6. Gøetsche P. Deadly medicines and organised crime: how big Pharma has corrupted healthcare. London: Radcliffe Publishing; 2013.
7. Leaf C. Do clinical trials work? New York: The New York Times; July 13, 2013.
8. Altman DG. The scandal of poor medical research. BMJ. 1994;308(6924):283-4.
9. Horton R. Offline: what is medicine's 5 sigma? Lancet. 2015;385:1380.
10. Ioannidis JPA. Contradicted and initially stronger effects in highly cited clinical research. JAMA. 2005;294(2):218-28.
11. Ioannidis JPA. Why most published research findings are false. PLoS Med. 2005;2(8):e124.
12. Berger VW. Conflicts of interest, selective inertia, and research malpractice in randomized clinical trials: an unholy trinity. Sci Eng Ethics. 2015;21(4):857-74.
13. Friedman LM, Furberg CD, DeMets DL, Reboussin DM, Granger CB. Fundamentals of clinical trials. 5th ed. New York: Springer; 2015.
14. Hanin L. Do breast cancer patients benefit from surgery? Hypotheses, mathematical models and false beliefs, in: Perioperative inflammation as a triggering origin of metastasis development (Retsky M and Demicheli R, eds). New York: Nature/Springer; 2017. p. 161-82.
15. Demicheli R, Retsky MW, Swartzendruber DE, Bonadonna G. Proposal for a new model of breast cancer metastatic development. Ann Oncol. 1997;8:1075-80.
16. Hanin L, Pavlova L. A quantitative insight into metastatic relapse of breast cancer. J Theor Biol. 2016;394:172-81.
17. Rachev ST, Klebanov L, Stoyanov SV, Fabozzi F. The methods of distances in the theory of probability and statistics. New York: Springer; 2013.
18. Durrett R. Probability: theory and examples. Wadsworth & Brooks/Cole: Pacific Grove; 1991.
19. Soares JF, Wu CFJ. Some restricted randomization rules in sequential designs. Comm Stat Theory Methods. 1982;12:2017-34.
20. Berger VW, Ivanova A, Deloria-Knoll M. Minimizing predictability while retaining balance through the use of less restrictive randomization procedures. Stat Med. 2003;22(19):3017-28.
21. Hanin L, Zaider M. Cell-survival probability at large doses: an alternative to the linear-quadratic model. Phys Med Biol. 2010;55:4687-702.
22. Fisher RA. Statistical methods for research workers. 14th ed. Edinburgh: Oliver and Boyd; 1970.
23. Esseen C-G. A moment inequality with an application to the central limit theorem. Skand Aktuarietidskr. 1956;39:160-70.
24. Berger VW, Lunneborg C, Ernst MD, Levine JG. Parametric analyses in randomized clinical trials. J Mod Appl Stat Methods. 2002;1(1):74-82.
25. Berger VW. Pros and cons of permutation tests in clinical trials. Stat Med. 2000;19:1319-28.
26. Berry AC. The accuracy of the Gaussian approximation to the sum of independent variates. Trans Amer Math Soc. 1941;49(1):122-36.
27. Chavalarias D, Wallach JD, Li AHT, Ioannidis JPA. Evolution of reporting P values in the biomedical literature, 1990-2015. JAMA. 2016;315(11):1141-8.
28. Poincaré H. Science and hypothesis. New York: Dover Publications; 1952.
29. Bernard C. An introduction to the study of experimental medicine. New York: Dover Publications; 1957.
30. Goodman SN. Toward evidence-based medical statistics, 1: the P value fallacy. Ann Intern Med. 1999;130(12):995-1004.
31. Goodman SN. A dirty dozen: twelve p-value misconceptions. Semin Hematol. 2008;45(3):135-40.
32. Gelman A. P values and statistical practice. Epidemiology. 2013;24(1):69-72.
33. Wasserstein RL, Lazar NA. The ASA's statement on p-values: context, process and purpose. Am Stat. 2016;70(2):129-33.
34. Hill AB. The environment and disease: association or causation? Proc R Soc Med. 1965;58(5):295-300.
35. Fedak KM, Bernal A, Capshaw ZA, Gross S. Applying the Bradford Hill criteria in the 21st century: how data integration has changed causal inference in molecular epidemiology. Emerg Themes Epidemiol. 2015;12:14.