Subgroup analyses in confirmatory clinical trials: Time to be specific about their purposes

BMC Medical Research Methodology

Volumn 16, Issue 1, 2016, Pages

  Tanniou, Julien ^a,b   Van Der Tweel, Ingeborg ^a   Teerenstra, Steven ^b,c   Roes, Kit C B ^a,b  

^a UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^b MEDICINES EVALUATION BOARD   (Netherlands)

^c RADBOUD UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

Clinical trials; Subgroup analysis; Subgroups

Indexed keywords

CLINICAL TRIAL (TOPIC); EVIDENCE BASED MEDICINE; HUMAN; MEDICAL RESEARCH; METHODOLOGY; OUTCOME ASSESSMENT; PROCEDURES; REPRODUCIBILITY; STATISTICS AND NUMERICAL DATA;

BIOMEDICAL RESEARCH; CLINICAL TRIALS AS TOPIC; EVIDENCE-BASED MEDICINE; HUMANS; OUTCOME ASSESSMENT (HEALTH CARE); REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN;

EID: 84958230954     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/s12874-016-0122-6     Document Type: Article

References (84)

1. Pocock SJ, Assmann SE, Enos LE, Kasten LE. Subgroup analysis, covariate adjustment and baseline comparisons in clinical trial reporting: current practice and problems. Stat Med. 2002;21:2917-30.
2. Hernández AV, Boersma E, Murray GD, Habbema JD, Steyerberg EW. Subgroup analyses in therapeutic cardiovascular clinical trials: are most of them misleading? Am Heart J. 2006;151:257-64.
3. Wang R, Lagakos SW, Ware JH, Hunter DJ, Drazen JM. Statistics in medicine - reporting of subgroup analyses in clinical trials. NEnglJMed. 2007;357:2189-94.
4. Gabler NB, Duan N, Liao D, Elmore JG, Ganiats TG, Kravitz RL. Dealing with heterogeneity of treatment effects: is the literature up to the challenge? Trials. 2009;10:43.
5. Sun X, Briel M, Busse JW, Akl EA, You JJ, Mejza F, Bala M, Diaz-Granados N, Bassler D, Mertz D, Srinathan SK, Vandvik PO, Malaga G, Alshurafa M, Dahm P, Alonso-Coello P, Heels-Ansdell DM, Bhatnagar N, Johnston BC, Wang L, Walter SD, Altman DG, Guyatt GH. Subgroup Analysis of Trials Is Rarely Easy (SATIRE): a study protocol for a systematic review to characterize the analysis, reporting, and claim of subgroup effects in randomized trials. Trials. 2009;10:101.
6. Sun X, Briel M, Busse JW, You JJ, Akl EA, Mejza F, Bala MM, Bassler D, Mertz D, Diaz-Granados N, Vandvik PO, Malaga G, Srinathan SK, Dahm P, Johnston BC, Alonso-Coello P, Hassouneh B, Truong J, Dattani ND, Walter SD, Heels-Ansdell D, Bhatnagar N, Altman DG, Guyatt GH. The influence of study characteristics on reporting of subgroup analyses in randomised controlled trials: systematic review. BMJ. 2011;342:d1569.
7. Oxman AD, Guyatt GH. A consumer's guide to subgroup analyses. Ann Intern Med. 1992;116:78-84.
8. Rothwell PM. Treating individuals 2. Subgroup analysis in randomised controlled trials: importance, indications, and interpretation. Lancet. 2005;365:176-86.
9. Sun X, Briel M, Busse JW, You JJ, Akl EA, Mejza F, Bala MM, Bassler D, Mertz D, Diaz-Granados N, Vandvik PO, Malaga G, Srinathan SK, Dahm P, Johnston BC, Alonso-Coello P, Hassouneh B, Walter SD, Heels-Ansdell D, Bhatnagar N, Altman DG, Guyatt GH. Credibility of claims of subgroup effects in randomised controlled trials: systematic review. BMJ. 2012;344:e1553.
10. Dijkman B, Kooistra B, Bhandari M. How to work with a subgroup analysis. CanJSurg. 2009;52:515-22.
11. Sun X, Heels-Ansdell D, Walter SD, Guyatt G, Sprague S, Bhandari M, Sanders D, Schemitsch E, Tornetta P, Swiontkowski M. Is a subgroup claim believable? A user's guide to subgroup analyses in the surgical literature. J Bone Joint Surg Am. 2011;93:e8.
12. Sun X, Briel M, Walter SD, Guyatt GH. Is a subgroup effect believable? Updating criteria to evaluate the credibility of subgroup analyses. BMJ. 2010;340:c117.
13. Hasford J, Bramlage P, Koch G, Lehmacher W, Einhaupl K, Rothwell PM. Inconsistent trial assessments by the National Institute for Health and Clinical Excellence and IQWiG: standards for the performance and interpretation of subgroup analyses are needed. J Clin Epidemiol. 2010;63:1298-304.
14. Bender R, Koch A, Skipka G, Kaiser T, Lange S. No inconsistent trial assessments by NICE and IQWiG: different assessment goals may lead to different assessment results regarding subgroup analyses. J Clin Epidemiol. 2010;63:1305-7.
15. Hasford J, Bramlage P, Koch G, Lehmacher W, Einhaupl K, Rothwell PM. Standards for subgroup analyses are needed? - we couldn't agree more. J Clin Epidemiol. 2011;64:451.
16. Grouin JM, Coste M, Lewis J. Subgroup analyses in randomized clinical trials: statistical and regulatory issues. J Biopharm Stat. 2005;15:869-82.
17. MERIT-HF Study Group. Effect of metoprolol CR/XL in chronic heart failure: Metoprolol CR/XL Randomised Intervention Trial in Congestive Heart Failure (MERIT-HF). Lancet. 1999;353:2001-7.
18. Letter of approval. Available at: http://www.accessdata.fda.gov/drugsatfda-docs/label/2009/019962s038lbl.pdf.
19. Hemmings R. An overview of statistical and regulatory issues in the planning, analysis, and interpretation of subgroup analyses in confirmatory clinical trials. J Biopharm Stat. 2014;24:4-18.
20. Li Z, Chuang-Stein C, Hoseyni C. The probability of observing negative subgroup results when the treatment effect is positive and homogeneous across all subgroups. Drug Inf J. 2007;41:47-56.
21. Wang SJ, Hung HM. A regulatory perspective on essential considerations in design and analysis of subgroups when correctly classified. J Biopharm Stat. 2014;24:19-41.
22. Koch GG, Schwartz TA. An overview of statistical planning to address subgroups in confirmatory clinical trials. J Biopharm Stat. 2014;24:72-93.
23. Keene ON, Garrett AD. Subgroups: time to go back to basic statistical principles? J Biopharm Stat. 2014;24:58-71.
24. Brookes ST, Whitely E, Egger M, Smith GD, Mulheran PA, Peters TJ. Subgroup analyses in randomized trials: risks of subgroup-specific analyses; power and sample size for the interaction test. J Clin Epidemiol. 2004;57:229-36.
25. Millen BA, Dmitrienko A, Ruberg S, Shen L. A statistical framework for decision making in confirmatory multipopulation tailoring clinical trials. Drug Inf J. 2012;46:647-56.
26. Royston P, Sauerbrei W. Interaction of treatment with a continuous variable: simulation study of significance level for several methods of analysis. Stat Med. 2013;32:3788-803.
27. Royston P, Sauerbrei W. Interaction of treatment with a continuous variable: simulation study of power for several methods of analysis. Stat Med. 2014;33:4695-708.
28. White IR, Elbourne D. Assessing subgroup effects with binary data: can the use of different effect measures lead to different conclusions? BMCMedResMethodol. 2005;5:15.
29. Peto P. Statistical Aspects of Cancer Trials. In: Halnan KE, editor. Treatment of Cancer. London: Chapman and Hall; 1982.
30. Piantadosi S, Gail MH. A comparison of the power of two tests for qualitative interactions. Stat Med. 1993;12:1239-48.
31. Zelterman D. On tests for qualitative interactions. Stat Probabil Lett. 1990;10:59-63.
32. Li J, Chan IS. Detecting qualitative interactions in clinical trials: an extension of range test. J Biopharm Stat. 2006;16:831-41.
33. Gunter L, Zhu J, Murphy S. Variable selection for qualitative interactions in personalized medicine while controlling the family-wise error rate. J Biopharm Stat. 2011;21:1063-78.
34. Kitsche A, Hothorn LA. Testing for qualitative interaction using ratios of treatment differences. Stat Med. 2014;33:1477-89.
35. Kitsche A. Detecting qualitative interactions in clinical trials with binary responses. Pharm Stat. 2014;13:309-15.
36. Varadhan R, Wang SJ. Standardization for subgroup analysis in randomized controlled trials. J Biopharm Stat. 2014;24:154-67.
37. White IR, Pocock SJ, Wang D. Eliciting and using expert opinions about influence of patient characteristics on treatment effects: a Bayesian analysis of the CHARM trials. Stat Med. 2005;24:3805-21.
38. Bayman EO, Chaloner K, Cowles MK. Detecting qualitative interaction: a Bayesian approach. Stat Med. 2010;29:455-63.
39. Jones HE, Ohlssen DI, Neuenschwander B, Racine A, Branson M. Bayesian models for subgroup analysis in clinical trials. Clin Trials. 2011;8:129-43.
40. Lipsky AM, Gausche-Hill M, Vienna M, Lewis RJ. The importance of «shrinkage» in subgroup analyses. Ann Emerg Med. 2010;55:544-52.
41. Alosh, M., Fritsch, K., Huque, M., Mahjoob, K., Pennello, G., Rothmann, M., Russek-Cohen, E., Smith, F., Wilson, S. and Yue, L. (2015). Statistical considerations on subgroup analysis in clinical trials. Statistics in Biopharmaceutical Research (accepted), available on line at: http://www.tandfonline.com/doi/full/ 10.1080/19466315.2015.1077726
42. Hayward RA, Kent DM, Vijan S, Hofer TP. Multivariable risk prediction can greatly enhance the statistical power of clinical trial subgroup analysis. BMCMedResMethodol. 2006;6:18.
43. Kent DM, Hayward RA. Limitations of applying summary results of clinical trials to individual patients: the need for risk stratification. JAMA. 2007;298:1209-12.
44. Kent DM, Rothwell PM, Ioannidis JP, Altman DG, Hayward RA. Assessing and reporting heterogeneity in treatment effects in clinical trials: a proposal. Trials. 2010;11:85.
45. Kovalchik SA, Varadhan R, Weiss CO. Assessing heterogeneity of treatment effect in a clinical trial with the proportional interactions model. Stat Med. 2013;32:4906-23.
46. Alosh M, Huque MF. Multiplicity considerations for subgroup analysis subject to consistency constraint. Biom J. 2013;55:444-62.
47. Alosh M, Huque MF, Koch GG. Statistical perspectives on subgroup analysis: testing for heterogeneity and evaluating error rate for the complementary subgroup. J Biopharm Stat. 2014;25:1161-78.
48. Tanniou J, Tweel IV, Teerenstra S, Roes KC,.,Level of evidence for promising subgroup findings in an overall non-significant trial," Stat Methods Med Res, 2014 (accepted), available on line at: http://smm.sagepub.com/content/early/2014/01/19/0962280213519705.full.pdf+html.
49. Koch A, Framke T. Reliably basing conclusions on subgroups of randomized clinical trials. J Biopharm Stat. 2014;24:42-57.
50. Wahlgren NG, Ranasinha KW, Rosolacci T, Franke CL, van Erven PM, Ashwood T, Claesson L. Clomethiazole acute stroke study (CLASS): results of a randomized, controlled trial of clomethiazole versus placebo in 1360 acute stroke patients. Stroke. 1999;30:21-8.
51. Michiels S, Potthoff RF, George SL. Multiple testing of treatment-effect-modifying biomarkers in a randomized clinical trial with a survival endpoint. Stat Med. 2011;30:1502-18.
52. Fridlyand J, Yeh RF, Mackey H, Bengtsson T, Delmar P, Spaniolo G, Lieberman G. An industry statistician's perspective on PHC drug development. Contemp Clin Trials. 2013;36:624-35.
53. Maitournam A, Simon R. On the efficiency of targeted clinical trials. Stat Med. 2005;24:329-39.
54. Simon R. Clinical trials for predictive medicine: new challenges and paradigms. Clin Trials. 2010;7:516-24.
55. Krisam J, Kieser M. Decision rules for subgroup selection based on a predictive biomarker. J Biopharm Stat. 2014;24:188-202.
56. Simon R. Clinical trials for predictive medicine. Stat Med. 2012;31:3031-40.
57. Freidlin B, Korn EL. Biomarker enrichment strategies: matching trial design to biomarker credentials. Nat Rev Clin Oncol. 2014;11:81-90.
58. Freidlin B, Korn EL, Gray R. Marker Sequential Test (MaST) design. Clin Trials. 2014;11:19-27.
59. Wang SJ, O'Neill RT, Hung HM. Approaches to evaluation of treatment effect in randomized clinical trials with genomic subset. Pharm Stat. 2007;6:227-44.
60. Spiessens B, Debois M. Adjusted significance levels for subgroup analyses in clinical trials. Contemp Clin Trials. 2010;31:647-56.
61. Song Y, Chi GY. A method for testing a prespecified subgroup in clinical trials. Stat Med. 2007;26:3535-49.
62. Alosh M, Huque MF. A flexible strategy for testing subgroups and overall population. Stat Med. 2009;28:3-23.
63. Zhao YD, Dmitrienko A, Tamura R. Design and analysis considerations in clinical trials with a sensitive subpopulation. Stat Biopharm Res. 2010;2:72-83.
64. Rothmann MD, Zhang JJ, Lu L, Fleming TR. Testing in a prespecified subgroup and the intent-to-treat population. Drug Inf J. 2012;46:175-9.
65. Chen C, Beckman RA. Hypothesis testing in a confirmatory Phase III trial with a possible subset effect. Stat Biopharm Res. 2009;1:431-40.
66. Millen BA, Dmitrienko A, Song G. Bayesian assessment of the influence and interaction conditions in multipopulation tailoring clinical trials. J Biopharm Stat. 2014;24:94-109.
67. Sivaganesan S, Laud PW, Muller P. A Bayesian subgroup analysis with a zero-enriched Polya Urn scheme. Stat Med. 2011;30:312-23.
68. Eng KH. Randomized reverse marker strategy design for prospective biomarker validation. Stat Med. 2014;33:3089-99.
69. EMA/CHMP/EWP/117211/2010, Committee for Medicinal Products for Human Use CHMP. Concept paper on the need for a Guideline on the use of Subgroup Analyses in Randomised Controlled Trials. 2010. http://www.ema.europa.eu/docs/en-GB/document-library/Scientific-guideline/2010/05/WC500090116.pdf.
70. Food and Drug Administration. Enrichment Strategies for Clinical Trials to Support Approval of Human Drugs and Biological Products. 2012. http://www.fda.gov/downloads/drugs/guidancecomplianceregulatoryinformation/guidances/ucm332181.pdf.
71. EMA/CHMP/539146/2013, Committee for Medicinal Products for Human Use CHMP. Guideline on the investigation of subgroups in confirmatory clinical trials. 2014. http://www.ema.europa.eu/docs/en-GB/document-library/Scientific-guideline/2014/02/WC500160523.pdf.
72. Lipkovich I, Dmitrienko A, Denne J, Enas G. Subgroup identification based on differential effect search - a recursive partitioning method for establishing response to treatment in patient subpopulations. Stat Med. 2011;30:2601-21.
73. Lipkovich I, Dmitrienko A. Strategies for identifying predictive biomarkers and subgroups with enhanced treatment effect in clinical trials using SIDES. JBiopharmStat. 2014;24:130-53.
74. Foster JC, Taylor JM, Ruberg SJ. Subgroup identification from randomized clinical trial data. Stat Med. 2011;30:2867-80.
75. Su X, Zhou T, Yan X, Fan J, Yang S. Interaction trees with censored survival data. Int J Biostat. 2008;4.
76. Su X, Tsai CL, Wang H, Nickerson DM, Li B. Subgroup analysis via recursive partitioning. J Mach Learn Res. 2009;10:141-58.
77. Doove LL, Dusseldorp E, Van DK, Van M I. A comparison of five recursive partitioning methods to find person subgroups involved in meaningful treatment-subgroup interactions. Adv Data Anal Classif. 2014;8:403-25.
78. Zeileis A, Hothorn T, Hornik K. Model-based recursive partitioning. J Comput Graph Stat. 2008;17:492-514.
79. Dusseldorp E, Conversano C, Van Os BJ. Combining an additive and tree-based regression model simultaneously: STIMA. J Comput Graph Stat. 2010;19:514-30.
80. Ruberg SJ, Chen L, Wang Y. The mean does not mean as much anymore: finding sub-groups for tailored therapeutics. Clin Trials. 2010;7:574-83.
81. Dusseldorp E, Van M I. Qualitative interaction trees: a tool to identify qualitative treatment-subgroup interactions. Stat. Med. 2014;33:219-37.
82. Loh WY, He X, Man M. A regression tree approach to identifying subgroups with differential treatment effects. Stat Med. 2015;34:1818-33.
83. Berger JO, Wang X, Shen L. A Bayesian approach to subgroup identification. J Biopharm Stat. 2014;24:110-29.
84. Kaiser LD. Stratification of randomization is not required for a pre-specified subgroup analysis. Pharm Stat. 2013;12:43-7.