Multiplicity issues in exploratory subgroup analysis

Journal of Biopharmaceutical Statistics

Volumn 28, Issue 1, 2018, Pages 63-81

  Lipkovich, Ilya ^a   Dmitrienko, Alex ^b   Muysers, Christoph ^c   Ratitch, Bohdana ^a  

^a IQVIA   (United States)

^b Mediana Inc   (United States)

^c BAYER AG   (Germany)

Author keywords

Clinical trials; multiple testing; predictive biomarkers; subgroup identification

Indexed keywords

BIOLOGICAL MARKER;

ALGORITHM; ARTICLE; CASE STUDY; DATA MINING; EXPLORATORY RESEARCH; HUMAN; MACHINE LEARNING; METHODOLOGY; ONCOLOGY; PERSONALIZED MEDICINE; PHASE 3 CLINICAL TRIAL (TOPIC); POST HOC ANALYSIS; PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL (TOPIC); STATISTICAL ANALYSIS; SUBGROUP ANALYSIS; SUBGROUP IDENTIFICATION BASED ON DIFFERENTIAL EFFECT SEARCH; BIOASSAY; PATIENT SELECTION; PRACTICE GUIDELINE; PROCEDURES; STATISTICAL BIAS; STATISTICS AND NUMERICAL DATA;

ALGORITHMS; BIAS; BIOMARKERS; CLINICAL TRIALS, PHASE III AS TOPIC; DATA INTERPRETATION, STATISTICAL; ENDPOINT DETERMINATION; GUIDELINES AS TOPIC; HUMANS; PATIENT SELECTION; PRECISION MEDICINE; RANDOMIZED CONTROLLED TRIALS AS TOPIC;

EID: 85035129830     PISSN: 10543406     EISSN: 15205711     Source Type: Journal    
DOI: 10.1080/10543406.2017.1397009     Document Type: Article

References (49)

1. Alosh, M., Fritsch, F., Huque, M., Mahjoob, K., Pennello, G., Rothmann, R., Russek-Cohen, E., Smith, F., Wilson, S., Yue, L., (2015). Statistical considerations on subgroup analysis in clinical trials. Statistics in Biopharmaceutical Research 7:286–303.
2. Brookes, S. T., Whitley, E., Peters, T. J., Mulheran, P. A., Egger, M., Davey, S. G. (2001). Subgroup analyses in randomised controlled trials: Quantifying the risks of false-positives and false-negatives. Health Technology Assessment. 5:1–56.]
3. Bonetti, M., Gelber, R. D., (2000). A graphical method to assess treatmentÐcovariate interactions using the Cox model on subsets of the data. Statistics in Medicine 19:2595–2609.
4. Bonetti, M., Gelber, R. D., (2004). Patterns of treatment effects in subsets of patients in clinical trials. Biostatistics 5:465–481.
5. Berger, J., Wang, X., Shen, L., (2014). A Bayesian approach to subgroup identification. Journal of Biopharmaceutical Statistics 24:110–129.
6. Bornkamp, B., Ohlssen, D., Magnusson, B., Schmidli, H., (2017). Model averaging for treatment effect estimation in subgroups. Pharmaceutical Statistics 16:133–142.
7. Bretz, F., Westfall, P. H., (2014). Multiplicity and replicability: Two sides of the same coin. Pharmaceutical Statistics 13:343–344.
8. Brookes, S. T., Whitley, E., Peters, T. J., Mulheran, P. A., Egger, M., Davey, S. G., (2001). Subgroup analyses in randomised controlled trials: Quantifying the risks of false-positives and false-negatives. Health Technology Assessment 5:1–56.
9. Dmitrienko, A., D’Agostino, R. B., (2013). Tutorial in Biostatistics: Traditional multiplicity adjustment methods in clinical trials. Statistics in Medicine 32:5172–5218.
10. Dmitrienko, A., Lipkovich, I., Hopkins, A., Li, Y. P., Wang, W., (2015). Biomarker evaluation and subgroup identification in a pneumonia development program using SIDES. In Z., Chen, A., Liu, Y., Qu, L., Tang, N., Ting, Y., Tsong (editors.), Applied Statistics in Biomedicine and Clinical Trials Design. New York: Springer.
11. Dmitrienko, A., Muysers, C., Fritsch, A., Lipkovich, I., (2016). General guidance on exploratory and confirmatory subgroup analysis in late-stage clinical trials. Journal of Biopharmaceutical Statistics 26:71–98.
12. Dmitrienko, A., Millen, B., Lipkovich, I., (2017). Multiplicity considerations in subgroup analysis. Statistics in Medicine. doi: 10.1002/sim.7416. [Epub ahead of print].
13. Efron, B., (2007). Size, power and false discovery rates. The Annals of Statistics 35:1351–1377.
14. Efron, B., (2010). Large-Scale Inference: Empirical Bayes Methods for Estimation, Testing, and Prediction. Cambridge, UK: Cambridge University Press.
15. EMA. (2014). Draft Guideline on the Investigation of Subgroups in Confirmatory Clinical Trials. London, UK: European Medicines Agency.
16. EMA. (2017). Draft Guideline on Multiplicity Issues in Clinical Trials. London, UK: European Medicines Agency.
17. Faye, L. L., Sun, L., Dimitromanolakis, A., Bulla, S. B., (2011). A flexible genome-wide bootstrap method that accounts for ranking and threshold-selection bias in GWAS interpretation and replication study design. Statistics in Medicine 30:1898–1912.
18. FDA. (2012). Draft guidance for industry: Enrichment strategies for clinical trials to support approval of human drugs and biological products. U.S. Food and Drug Administration.
19. FDA. (2017). Draft Guidance for Industry: Multiple Endpoints in Clinical Trials. Rockville, MD: U.S. Food and Drug Administration.
20. Ferguson, J. P., Cho, J. H., Yang, C., Zhao, H., (2013). Empirical Bayes correction for the Winner’s Curse in genetic association studies. Genetic Epidemiology 37:60–68.
21. Foster, J. C., Taylor, J. M. C., Ruberg, S. J., (2011). Subgroup identification from randomized clinical trial data. Statistics in Medicine 30:2867–2880.
22. Fu, H., Zhou, J., Faries, D. E., (2016). Estimating optimal treatment regimes via subgroup identification in randomized control trials and observational studies. Statistics in Medicine 35:3285–3302.
23. G’Sell, M. G., Wager, S., Chouldechova, A., Tibshirani, R., (2016). Sequential selection procedures and false discovery rate control. Journal of the Royal Statistical Society. Series B. 78:423–444.
24. Gunter, L., Zhu, J., Murphy, S., (2011). Variable selection for qualitative interactions in personalized medicine while controlling the familywise error rate. Journal of Biopharmaceutical Statistics 21:1063–1078.
25. Huang, Y., Fong, Y., (2014). Identifying optimal biomarker combinations for treatment selection via a robust kernel method. Biometrics 70:891–901.
26. Imai, K., Ratkovic, M., (2013). Estimating treatment effect heterogeneity in randomized program evaluation. The Annals of Applied Statistics 7:443–470.
27. Jones, H. E., Ohlssen, D. I., Neuenschwander, B., Racine, A., Branson, M., (2011). Bayesian models for subgroup analysis in clinical trials. Clinical Trials 8:129–143.
28. Kang, C., Janes, H., Huang, Y., (2014). Combining biomarkers to optimize patient treatment recommendations. Biometrics 70:695–707.
29. Lipkovich, I., Dmitrienko, A., Denne, J., Enas, G., (2011). Subgroup identification based on differential effect search (SIDES): A recursive partitioning method for establishing response to treatment in patient subpopulations. Statistics in Medicine 30:2601–2621.
30. Lipkovich, I., Dmitrienko, A., (2014a). Strategies for identifying predictive biomarkers and subgroups with enhanced treatment effect in clinical trials using SIDES. Journal of Biopharmaceutical Statistics 24:130–153.
31. Lipkovich, I., Dmitrienko, A., (2014b). Biomarker identification in clinical trials. In C., Carini, S., Menon, M., Chang (editors.), Clinical and Statistical Considerations in Personalized Medicine. New York: Chapman and Hall/CRC Press.
32. Lipkovich, I., Dmitrienko, A., D’Agostino, R. B., (2017). Tutorial in Biostatistics: Data-driven subgroup identification and analysis in clinical trials. Statistics in Medicine 36:136–196.
33. Lockhart, R., Taylor, J., Tibshirani, R. J., Tibshirani, R., (2014). A significance test for the lasso. The Annals of Statistics 42:413–463.
34. Loh, W. Y., He, X., Man, M., (2015). A regression tree approach to identifying subgroups with differential treatment effects. Statistics in Medicine 34:1818–1833.
35. Loh, W.-Y., Fu, H., Man, M., Champion, V., Yu, M., (2016). Identification of subgroups with differential treatment effects for longitudinal and multiresponse variables. Statistics in Medicine 35:4837–4855.
36. Loh, W.Y., Shih,Y.S. (1997). Split selection methods for classification trees. Statistica Sinica 7:815–840.
37. Mayer, C., Lipkovich, I., Dmitrienko, A., (2015). Survey results on industry practices and challenges in subgroup analysis in clinical trials. Statistics in Biopharmaceutical Research 7:272—282.
38. Meinshausen, N., Meier, L., Bühlmann, P., (2009). P-values for high-dimensional regression. Journal of the American Statistical Association 104:1671–1681.
39. Ondra, T., Dmitrienko, A., Friede, T., Graf, A., Miller, F., Stallard, N., Posch, M., (2016). Methods for identification and confirmation of targeted subgroups in clinical trials: A systematic review. Journal of Biopharmaceutical Statistics 26:99–119.
40. Rothwell, P. M., (2005). Subgroup analysis in randomized controlled trials: Importance, indications, and interpretation. Lancet 365:176–186.
41. Royston, P., Sauerbrei, W., (2004). A new approach to modelling interaction between treatment and continuous covariates in clinical trials by using fractional polynomials. Statistics in Medicine 23:2509–2525.
42. Royston, P., Sauerbrei, W., (2013). Interaction of treatment with a continuous variable: Simulation study of power for several methods of analysis. Statistics in Medicine 32:3788–3803.
43. Rosenkranz, G. K., (2016). Exploratory subgroup analysis in clinical trials by model selection. Biometrical Journal 58:1217–1228.
44. Seibold, H., Zeileis, A., Hothorn, T., (2016). Model-based recursive partitioning for subgroup analyses. International Journal of Biostatistics 12:45–63.
45. Simon, R. M., Subramanian, J., Li, M. C., Menezes, S., (2011). Using cross validation to evaluate the predictive accuracy of survival risk classifiers based on high dimensional data. Briefings in Bioinformatics 12:203–214.
46. Sun, X., Briel, M., Walter, S. D., Guyatt, G. H., (2010). Is a subgroup effect believable? Updating criteria to evaluate the credibility of subgroup analyses. British Medical Journal 340:850–854.
47. Varadhan, R., Segal, J. B., Boyd, C. M., Wu, A. W., Weiss, C. O., (2013). A framework for the analysis of heterogeneity of treatment effect in patient-centered outcomes research. Journal of Clinical Epidemiology 66:818–825.
48. Wang, S. J., Hung, H. M. J., (2014). A regulatory perspective on essential considerations in design and analysis of subgroups correctly classified. Journal of Biopharmaceutical Statistics 24:19–41.
49. Zhao, Y., Zheng, D., Rush, A. J., Kosorok, M. R., (2012). Estimating individualized treatment rules using outcome weighted learning. Journal of the American Statistical Association 107:1106–1118.