Multiplicity and replicability: Two sides of the same coin

Pharmaceutical Statistics

Volumn 13, Issue 6, 2014, Pages 343-344

  Bretz, Frank ^a   Westfall, Peter H ^b  

^a NOVARTIS PHARMA AG   (Switzerland)

^b TEXAS TECH UNIVERSITY   (United States)

Author keywords

Reproducibility; Selective inference; Subgroup analysis

Indexed keywords

DECISION MAKING; EFFECT SIZE; GENOMICS; GOOD CLINICAL PRACTICE; HUMAN; MEDICAL ETHICS; MEDICAL RESEARCH; MULTIPLICITY; NORMAL DISTRIBUTION; NOTE; OBSERVATIONAL STUDY; PHASE 2 CLINICAL TRIAL (TOPIC); PHASE 3 CLINICAL TRIAL (TOPIC); PRACTICE GUIDELINE; REPLICABILITY; REPRODUCIBILITY; SAMPLE SIZE; SIMULATION; ANIMAL; CLINICAL TRIAL (TOPIC); DRUG DEVELOPMENT; PROCEDURES; STANDARDS; STATISTICS AND NUMERICAL DATA;

ANIMALS; CLINICAL TRIALS AS TOPIC; DRUG DISCOVERY; HUMANS; REPRODUCIBILITY OF RESULTS;

EID: 84911962987     PISSN: 15391604     EISSN: 15391612     Source Type: Journal    
DOI: 10.1002/pst.1648     Document Type: Note

References (17)

1. NCI-NHGRI. Replicating genotype-phenotype associations. Nature 2007; 447(7):655-660.
2. Heller R, Bogomolov M, Benjamini Y. Deciding whether follow-up studies have replicated findings in a preliminary large-scale "omics' study", 2014. preprint Available at: http://arxiv.org/abs/1310.0606 (accessed 17.9.2014).
3. Prinz F, Schlange T, Asadullah K. Believe it or not: how much can we rely on published data on potential drug targets? Nature Reviews Drug Discovery 2011; 10:712-713.
4. Arrowsmith J. Phase II failures: 2008-2010. Nature Reviews Drug Discovery 2011; 10:328-329.
5. Ioannidis J. Why most published research findings are false. PLoS Medicine 2005; 2(8):e124. DOI: 10.1371/journal.pmed.0020124
6. Berger J. Reproducibility of Science: p-values and multiplicity, 2012. Available at: http://www.stat.purdue.edu/symp2012/docs/Purdue-Symposium-2012-Jim-Berger-Slides.pdf (accessed 17.9.2014).
7. Bauer P, Koenig F, Brannath W, Posch M. Selection and bias - two hostile brothers. Statistics in Medicine 2010; 29(1):1-13.
8. Gan HK, You B, Pond G, Chen EX. Assumptions of expected benefits in randomized Phase III trials evaluating systemic treatments for cancer. Journal of the National Cancer Institute 2012; 10(8):590-598.
9. Zia MI, Siu LL, Pond G, Chen EX. Comparison of outcomes of Phase II studies and subsequent randomized control studies using identical shemotherapeutic regimens. Journal of Clinical Oncology 2005; 23(28):6982-91.
10. Dmitrienko A, Tamhane AC, Bretz F. Multiple testing problems in pharmaceutical statistics. Chapman & Hall /CRC Press: Boca Raton, 2009.
11. Bretz F, Hothorn T, Westfall P. Multiple comparisons using R. CRC Press: Boca Raton, 2010.
12. ICH. E9 Topic: Statistical principles for clinical trials, 1998. Available at: http://www.ich.org/fileadmin/Public-Web-Site/ICH-Products/Guidelines/Efficacy/E9/Step4/E9-Guideline.pdf (accessed 17.9. 2014).
13. CPMP. Points to consider onmultiplicity issues in clinical trials, 2002. Available at: http://www.emea.europa.eu/docs/en-GB/document-library/Scientific-guideline/2009/09/WC500003640.pdf (accessed 17.9.2014).
14. FDA. Draft guidance onmultiple endpoints in clinical trials, 2014. to appear.
15. Jones HE, Ohlssen DI, Neuenschwander B, Racine A, Branson M. Bayesian models for subgroup analysis in clinical trials. Clinical Trials 2011; 8:129-143.
16. Rosenkranz G. Bootstrap corrections of treatment effect estimates following selection. Computational Statistics and Data Analysis 2014; 69:220-227.
17. Efron B. Estimation and accuracy after model selection. Journal of the American Statistical Association 2014; 109(507):991-1022 (with discussion).