Test and power considerations for multiple endpoint analyses using sequentially rejective graphical procedures

Statistics in Medicine

Volumn 30, Issue 13, 2011, Pages 1489-1501

  Bretz, Frank ^a,b   Maurer, Willi ^a   Hommel, Gerhard ^c  

^a NOVARTIS PHARMA AG   (Switzerland)

^b HANNOVER MEDICAL SCHOOL   (Germany)

^c JOHANNES GUTENBERG UNIVERSITY   (Germany)

Author keywords

Bonferroni; Closure principle; Gatekeeping procedure; Multiple comparison procedure; Multiple testing; Shortcut procedure; Step down procedure

Indexed keywords

ARTICLE; CALCULATION; CASE STUDY; CLINICAL RESEARCH; CLINICAL TRIAL (TOPIC); HUMAN; METHODOLOGY; PROBABILITY; RECURRENT DISEASE; SCORING SYSTEM; STATISTICAL ANALYSIS; TREATMENT RESPONSE;

CLINICAL TRIALS, PHASE III AS TOPIC; COMPUTER GRAPHICS; CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; DRUG THERAPY; ENDPOINT DETERMINATION; HUMANS; MULTICENTER STUDIES AS TOPIC; RANDOMIZED CONTROLLED TRIALS AS TOPIC;

EID: 79956096307     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.3988     Document Type: Article

References (36)

1. Holm S. A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics 1979; 6:65-70.
2. Maurer W, Hothorn L, Lehmacher W. Multiple comparisons in drug clinical trials and preclinical assays: a-priori ordered hypotheses. Biometrie in der chemisch-pharmazeutischen Industrie, Vollmar J (ed.). Fischer Verlag: Stuttgart, 1995; 3-18.
3. Westfall PH, Krishen A. Optimally weighted, fixed sequence, and gatekeeping multiple testing procedures. Journal of Statistical Planning and Inference 2001; 99:25-40.
4. Wiens BL. A fixed sequence Bonferroni procedure for testing multiple endpoints. Pharmaceutical Statistics 2003; 2:211-215.
5. Wiens BL, Dmitrienko A. The fallback procedure for evaluating a single family of hypotheses. Journal of Biopharmaceutical Statistics 2005; 15:929-942.
6. Bauer P, Röhmel J, Maurer W, Hothorn L. Testing strategies in multi-dose experiments including active control. Statistics in Medicine 1998; 17:2133-2146.
7. Dmitrienko A, Offen WW, Westfall PH. Gatekeeping strategies for clinical trials that do not require all primary effects to be significant. Statistics in Medicine 2003; 22:2387-2400.
8. Marcus R, Peritz E, Gabriel KR. On closed testing procedure with special reference to ordered analysis of variance. Biometrika 1976; 63:655-660.
9. Hommel G, Bretz F, Maurer W. Powerful short-cuts for multiple testing procedures with special reference to gatekeeping strategies. Statistics in Medicine 2007; 26:4063-4073.
10. Bretz F, Maurer W, Brannath W, Posch M. A graphical approach to sequentially rejective multiple test procedures. Statistics in Medicine 2009; 28:586-604.
11. Burman CF, Sonesson C, Guilbaud O. A recycling framework for the construction of Bonferroni-based multiple tests. Statistics in Medicine 2009; 28:736-761.
12. Dmitrienko A, Bretz F, Westfall PH, Troendle J, Wiens BL, Tamhane AC, Hsu JC. Multiple testing methodology. In Multiple Testing Problems in Pharmaceutical Statistics, Dmitrienko A, Tamhane AC, Bretz F (eds). Chapman & Hall/CRC Biostatistics Series: Boca Raton, 2009.
13. Brannath W, Bretz F. Shortcuts for locally consonant closed test procedures. Journal of the American Statistical Association 2010; 28:739-761. DOI: 10.1198/jasa.2010.tm08127.
14. Hochberg Y, Tamhane AC. Multiple Comparison Procedures. Wiley: New York, 1987.
15. Dmitrienko A, Tamhane A, Wang X, Chen X. Stepwise gatekeeping procedures in clinical trial applications. Biometrical Journal 2006; 48:984-991.
16. Strassburger K, Bretz F. Compatible simultaneous lower confidence bounds for the Holm procedure and other Bonferroni based closed tests. Statistics in Medicine 2008; 27:4914-4927.
17. Guilbaud O. Simultaneous confidence regions corresponding to Holm's stepdown procedure and other closed-testing procedures. Biometrical Journal 2008; 50:678-692.
18. Guilbaud O. Alternative confidence regions for Bonferroni-based closed-testing procedures that are not alpha-exhaustive. Biometrical Journal 2009; 51:721-735.
19. Hommel G, Bretz F. Aesthetics and power considerations in multiple testing-a contradiction? Biometrical Journal 2008 50:657-666.
20. Julious SA. Tutorial in Biostatistics: sample sizes for clinical trials with normal data. Statistics in Medicine 2004; 23:1921-1986.
21. Julious SA. Sample Sizes for Clinical Trials. Taylor & Francis: Boca Raton, 2009.
22. International Conference on Harmonization. ICH Topic E9: Statistical Principles for Clinical Trials. 1998.
23. Ramsey PH. Power differences between pairwise multiple comparisons. Journal of the American Statistical Association 1978; 73:479-487.
24. Maurer W, Mellein B. On new multiple tests based on independent p-values and the assessment of their power. In Multiple Hypothesenprüfung, Bauer P, Hommel G, Sonnemann E (eds). Springer: Berlin, 1988; 121-135.
25. Westfall PH, Tobias R, Rom D, Wolfinger R, Hochberg Y. Multiple Comparisons and Multiple Tests using SAS. SAS Institute Inc: Cary, 1999.
26. Senn S, Bretz F. Power and sample size when multiple endpoints are considered. Pharmaceutical Statistics 2007; 6:161-170.
27. Westfall PH, Tsai K, Ogenstad S, Tomoiaga A, Moseley S, Lu Y. Clinical trials simulation: a statistical approach. Journal of Biopharmaceutical Statistics 2008; 18:611-630.
28. Bretz F, Wang SJ. From adaptive design to modern protocol design for drug development: Part II. Success probabilities and effect estimates for Phase 3 development programs. Drug Information Journal 2010; 44(3):333-342.
29. Benda N, Branson M, Maurer W, Friede T. Aspects of modernizing drug development using clinical scenario planning and evaluation. Drug Information Journal 2010; 44:299-315.
30. Hung HMJ, Wang SJ. Some controversial multiple testing problems in regulatory applications. Journal of Biopharmaceutical Statistics 2009; 19:1-11.
31. Hung HMJ, Wang SJ. Challenges to multiple testing in clinical trials. Biometrical Journal 2010; DOI: 10.1002/bimj.
32. Maurer W, Glimm E, Bretz F. Multiple and repeated testing of primary, co-primary and secondary hypotheses. Statistics in Biopharmaceutical Reserach 2010; DOI: 10.1198/sbr.
33. Alosh M, Huque MF. A consistency-adjusted alpha-adaptive strategy for sequential testing. Statistics in Medicine 2010; DOI: 10.1002/sim.3896.
34. Brannath W, Bretz F, Maurer W, Sarkar S. Trimmed weighted Simes' test for two one-sided hypotheses with arbitrarily correlated test statistics. Biometrical Journal 2009; 51:885-898.
35. Dmitrienko A, Tamhane A, Wiens B. General multi-stage gatekeeping procedures. Biometrical Journal 2008; 50:667-677.
36. Hommel G, Kropf S. Tests for differentiation in gene expression using a data-driven order or weights for hypotheses. Biometrical Journal 2005; 47:554-562.