Sample Size Requirements for Multivariate Models to Predict Between-Patient Differences in Best Treatments of Major Depressive Disorder

Clinical Psychological Science

Volumn 7, Issue 3, 2019, Pages 445-461

  Luedtke, Alex ^a,b   Sadikova, Ekaterina ^c   Kessler, Ronald C ^c  

^a UNIVERSITY OF WASHINGTON   (United States)

^b Fred Hutchinson Cancer Research Center   (United States)

^c HARVARD MEDICAL SCHOOL   (United States)

Author keywords

depression treatment; heterogeneity of treatment effects; power analysis; prescriptive predictors; targeted minimum loss estimation (TMLE)

Indexed keywords

EID: 85060648534     PISSN: 21677026     EISSN: 21677034     Source Type: Journal    
DOI: 10.1177/2167702618815466     Document Type: Article

References (76)

1. Ahmedani B. K., Simon G. E., Stewart C., Beck A., Waitzfelder B. E., Rossom R... Solberg L. I., (2014). Health care contacts in the year before suicide death. Journal of General Internal Medicine, 29, 870–877. doi:10.1007/s11606-014-2767-3
2. Anglemyer A., Horvath H. T., Bero L., (2014). Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials. Cochrane Database Syst Rev(4), Article MR000034. doi:10.1002/14651858.MR000034.pub2
3. Arnold B. F., Hogan D. R., Colford J. M., Jr. Hubbard A. E., (2011). Simulation methods to estimate design power: an overview for applied research. BMC Medical Research Methodology, 11, 94. doi:10.1186/1471-2288-11-94
4. Bertolote J. M., Fleischmann A., De Leo D., Wasserman D., (2004). Psychiatric diagnoses and suicide: Revisiting the evidence. Crisis, 25, 147–155. doi:10.1027/0227-5910.25.4.147
5. Carreno F. R., Frazer A., (2017). Vagal nerve stimulation for treatment-resistant depression. Neurotherapeutics, 14, 716–727. doi:10.1007/s13311-017-0537-8
6. Chakraborty B., Laber E. B., Zhao Y. Q., (2014). Inference about the expected performance of a data-driven dynamic treatment regime. Clinical Trials, 11, 408–417. doi:10.1177/1740774514537727
7. Cohen Z. D., DeRubeis R. J., (2018). Treatment selection in depression. Annual Review of Clinical Psychology, 14, 209–236. doi:10.1146/annurev-clinpsy-050817-084746
8. Craighead W. E., Dunlop B. W., (2014). Combination psychotherapy and antidepressant medication treatment for depression: For whom, when, and how. Annual Review of Psychology, 65, 267–300. doi:10.1146/annurev.psych.121208.131653
9. Cuijpers P., van Straten A., van Oppen P., Andersson G., (2008). Are psychological and pharmacologic interventions equally effective in the treatment of adult depressive disorders? A meta-analysis of comparative studies. Journal of Clinical Psychiatry, 69, 1675–1685, 1639–1641.
10. DeRubeis R. J., Cohen Z. D., Forand N. R., Fournier J. C., Gelfand L. A., Lorenzo-Luaces L., (2014). The Personalized Advantage Index: Translating research on prediction into individualized treatment recommendations. A demonstration. PLoS One, 9(1), Article e83875. doi:10.1371/journal.pone.0083875
11. Dorresteijn J. A., Visseren F. L., Ridker P. M., Wassink A. M., Paynter N. P., Steyerberg E. W... Cook N. R., (2011). Estimating treatment effects for individual patients based on the results of randomised clinical trials. The BMJ, 343, d5888.
12. Dunlop B. W., Binder E. B., Cubells J. F., Goodman M. M., Kelley M. E., Kinkead B... Mayberg H. S., (2012). Predictors of remission in depression to individual and combined treatments (PReDICT): Study protocol for a randomized controlled trial. Trials, 13, 106. doi:10.1186/1745-6215-13-106
13. Durand C. P., (2013). Does raising Type 1 error rate improve power to detect interactions in linear regression models? A simulation study. PLoS One, 8(8), Article e71079. doi:10.1371/journal.pone.0071079
14. Fabbri C., Crisafulli C., Calabro M., Spina E., Serretti A., (2016). Progress and prospects in pharmacogenetics of antidepressant drugs. Expert Opinion on Drug Metabolism & Toxicology, 12, 1157–1168. doi:10.1080/17425255.2016.1202237
15. Fava M., Rush A. J., Trivedi M. H., Nierenberg A. A., Thase M. E., Sackeim H. A... Kupfer D. J., (2003). Background and rationale for the Sequenced Treatment Alternatives to Relieve Depression (STAR*D) study. Psychiatric Clinics of North America, 26, 457–494.
16. Ferrari A. J., Somerville A. J., Baxter A. J., Norman R., Patten S. B., Vos T., Whiteford H. A., (2013). Global variation in the prevalence and incidence of major depressive disorder: A systematic review of the epidemiological literature. Psychological Medicine, 43, 471–481. doi:10.1017/s0033291712001511
17. Garay R. P., Zarate C. A., Jr. Charpeaud T., Citrome L., Correll C. U., Hameg A., Llorca P. M., (2017). Investigational drugs in recent clinical trials for treatment-resistant depression. Expert Review of Neurotherapeutics, 17, 593–609. doi:10.1080/14737175.2017.1283217
18. Garrison G. M., Angstman K. B., O’Connor S. S., Williams M. D., Lineberry T. W., (2016). Time to remission for depression with collaborative care management (CCM) in primary care. The Journal of the American Board of Family Medicine, 29, 10–17. doi:10.3122/jabfm.2016.01.150128
19. GBD 2015 Disease and Injury Incidence and Prevalence Collaborators. (2016). Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990-2015: A systematic analysis for the Global Burden of Disease Study 2015. Lancet, 388, 1545–1602. doi:10.1016/s0140-6736(16)31678-6
20. Greenland S., (1983). Tests for interaction in epidemiologic studies: A review and a study of power. Statistics in Medicine, 2, 243–251.
21. Hamilton M., (1960). A rating scale for depression. Journal of Neurology, Neurosurgery, and Psychiatry, 23, 56–62.
22. Hazan E., (2011). The convex optimization approach to regret minimization. In Sra S., Nowozin S., Wright S. J., (Eds.), Optimization for machine learning (pp. 287–304). Cambridge, MA: MIT Press.
23. Hirano K., Porter J. R., (2012). Impossibility results for nondifferentiable functionals. Econometrica, 80, 1769–1790. doi:10.3982/ecta8681
24. Huibers M. J., Cohen Z. D., Lemmens L. H., Arntz A., Peeters F. P., Cuijpers P., DeRubeis R. J., (2015). Predicting optimal outcomes in cognitive therapy or interpersonal psychotherapy for depressed individuals using the Personalized Advantage Index approach. PLoS One, 10(11), e0140771. doi:10.1371/journal.pone.0140771
25. Kennedy S. H., Downar J., Evans K. R., Feilotter H., Lam R. W., MacQueen G. M... Soares C., (2012). The Canadian Biomarker Integration Network in Depression (CAN-BIND): Advances in response prediction. Current Pharmaceutical Design, 18, 5976–5989.
26. Kenter R. M., Cuijpers P., Beekman A., van Straten A., (2016). Effectiveness of a web-based guided self-help intervention for outpatients with a depressive disorder: Short-term results from a randomized controlled trial. Journal of Medical Internet Research, 18(3), Article e80. doi:10.2196/jmir.4861
27. Kessler R. C., (2012). The costs of depression. Psychiatric Clinics of North America, 35, 1–14. doi:10.1016/j.psc.2011.11.005
28. Kessler R. C., (2018). The potential of predictive analytics to provide clinical decision support in depression treatment planning. Current Opinion in Psychiatry, 31, 32–39. doi:10.1097/yco.0000000000000377
29. Kessler R. C., Hwang I., Hoffmire C. A., McCarthy J. F., Petukhova M. V., Rosellini A. J... Bossarte R. M., (2017). Developing a practical suicide risk prediction model for targeting high-risk patients in the Veterans Health Administration. International Journal of Methods in Psychiatric Research, 26(3), Article e1575. doi:10.1002/mpr.1575
30. Kessler R. C., van Loo H. M., Wardenaar K. J., Bossarte R. M., Brenner L. A., Ebert D. D... Zaslavsky A. M., (2017). Using patient self-reports to study heterogeneity of treatment effects in major depressive disorder. Epidemiology and Psychiatric Sciences, 26, 22–36. doi:10.1017/s2045796016000020
31. Khan A., Brown W. A., (2015). Antidepressants versus placebo in major depression: An overview. World Psychiatry, 14, 294–300. doi:10.1002/wps.20241
32. Khondoker M., Dobson R., Skirrow C., Simmons A., Stahl D., (2016). A comparison of machine learning methods for classification using simulation with multiple real data examples from mental health studies. Statistical Methods in Medical Research, 25, 1804–1823. doi:10.1177/0962280213502437
33. Klein J. P., Spath C., Schroder J., Meyer B., Greiner W., Hautzinger M... Berger T., (2017). Time to remission from mild to moderate depressive symptoms: One year results from the EVIDENT-study, an RCT of an internet intervention for depression. Behaviour Research and Therapy, 97, 154–162. doi:10.1016/j.brat.2017.07.013
34. Kovalchik S. A., Varadhan R., Weiss C. O., (2013). Assessing heterogeneity of treatment effect in a clinical trial with the proportional interactions model. Statistics in Medicine, 32, 4906–4923. doi:10.1002/sim.5881
35. LeDell E., van der Laan M. J., Petersen M., (2016). AUC-maximizing ensembles through metalearning. The International Journal of Biostatistics, 12, 203–218. doi:10.1515/ijb-2015-0035
36. Li C., Lu Y., (2010). Evaluating the improvement in diagnostic utility from adding new predictors. Biometrical Journal, 52, 417–435. doi:10.1002/bimj.200900228
37. Liaw A., Wiener M., (2002). Classification and regression by randomForest. R News, 2-3, 18–22. Retrieved from https://www.r-project.org/doc/Rnews/Rnews_2002-3.pdf
38. Lipkovich I., Dmitrienko A., Agostino R. B., Sr., (2017). Tutorial in biostatistics: Data-driven subgroup identification and analysis in clinical trials. Statistics in Medicine, 36, 136–196. doi:10.1002/sim.7064
39. Luedtke A., Chambaz A., (2017). Faster rates for policy learning. arXiv.org. https://arxiv.org/abs/1704.06431
40. Luedtke A., van der Laan M., (2016a). Statistical inference for the mean outcome under a possibly non-unique optimal treatment strategy. Annals of Statistics, 44, 713–742. doi:10.1214/15-aos1384
41. Luedtke A. R., van der Laan M. J., (2016b). Super-learning of an optimal dynamic treatment rule. The International Journal of Biostatistics, 12, 305–332. doi:10.1515/ijb-2015-0052
42. Lurie J. D., Morgan T. S., (2013). Pros and cons of pragmatic clinical trials. Journal of Comparative Effectiveness Research, 2, 53–58. doi:10.2217/cer.12.74
43. Madigan C. D., Jolly K., Lewis A. L., Aveyard P., Daley A. J., (2014). A randomised controlled trial of the effectiveness of self-weighing as a weight loss intervention. International Journal of Behavioral Nutrition and Physical Activity, 11, 125. doi:10.1186/s12966-014-0125-9
44. McGrath C. L., Kelley M. E., Holtzheimer P. E., Dunlop B. W., Craighead W. E., Franco A. R... Mayberg H. S., (2013). Toward a neuroimaging treatment selection biomarker for major depressive disorder. JAMA Psychiatry, 70, 821–829. doi:10.1001/jamapsychiatry.2013.143
45. Murphy S. A., (2003). Optimal dynamic treatment regimes. Journal of the Royal Statistical Society Series B-Statistical Methodology, 65, 331–355.
46. Olbrich S., van Dinteren R., Arns M., (2015). Personalized medicine: Review and perspectives of promising baseline EEG biomarkers in major depressive disorder and attention deficit hyperactivity disorder. Neuropsychobiology, 72, 229–240. doi:10.1159/000437435
47. Ondra T., Dmitrienko A., Friede T., Graf A., Miller F., Stallard N., Posch M., (2016). Methods for identification and confirmation of targeted subgroups in clinical trials: A systematic review. Journal of Biopharmaceutical Statistics, 26, 99–119. doi:10.1080/10543406.2015.1092034
48. Perel P., Edwards P., Wentz R., Roberts I., (2006). Systematic review of prognostic models in traumatic brain injury. BMC Medical Informatics and Decision Making, 6, 38. doi:10.1186/1472-6947-6-38
49. Petersen M. L., LeDell E. E., Schwab J. I., Sarovar V. H., Gross R. B., Reynolds N. M... Bangsberg D. R., (2015). Super Learner analysis of electronic adherence data improves viral prediction and may provide strategies for selective HIV RNA monitoring. Journal of Acquired Immune Deficiency Syndromes, 69, 109–118.
50. Petkova E., Ogden R. T., Tarpey T., Ciarleglio A., Jiang B., Su Z... Trivedi M. H., (2017). Statistical analysis plan for Stage 1 EMBARC (Establishing Moderators and Biosignatures of Antidepressant Response for Clinical Care) Study. Contemporary Clinical Trials Communication, 6, 22–30. doi:10.1016/j.conctc.2017.02.007
51. Pirracchio R., Petersen M. L., Carone M., Rigon M. R., Chevret S., van der Laan M. J., (2015). Mortality prediction in intensive care units with the Super ICU Learner Algorithm (SICULA): A population-based study. The Lancet Respiratory Medicine, 3, 42–52.
52. Polley E., LeDell E., Kennedy C., Lendle S., van der Laan M., (2018). SuperLearner: Super Learner Prediction. R package (Version 2.0-23) [Computer program]. https://CRAN.R-project.org/package=SuperLearner
53. Polley E. C., Rose S., van der Laan M. J., (2011). Super learning. In van der Laan M. J., Rose S., (Eds.), Targeted learning (pp. 43–66). New York, NY: Springer.
54. Prendes-Alvarez S., Nemeroff C. B., (2018). Personalized medicine: Prediction of disease vulnerability in mood disorders. Neuroscience Letters, 669, 10–13. doi:10.1016/j.neulet.2016.09.049
55. Prieto-Merino D., Pocock S. J., (2012). The science of risk models. European Journal of Preventive Cardiology, 19(Suppl 2), 7–13. doi:10.1177/2047487312448995
56. Rethorst C. D., Trivedi M. H., (2013). Evidence-based recommendations for the prescription of exercise for major depressive disorder. Journal of Psychiatric Practice, 19, 204–212. doi:10.1097/01.pra.0000430504.16952.3e
57. Robins J. M., (2004). Optimal structural nested models for optimal sequential decisions. In Lin D. Y., Heagerty P. J., (Eds.), Proceedings of the Second Seattle Symposium in Biostatistics: Analysis of correlated data (pp. 189–326). New York, NY: Springer.
58. Rose S., (2013). Mortality risk score prediction in an elderly population using machine learning. American Journal of Epidemiology, 177, 443–452.
59. Rush A. J., Trivedi M. H., Wisniewski S. R., Nierenberg A. A., Stewart J. W., Warden D... Fava M., (2006). Acute and longer-term outcomes in depressed outpatients requiring one or several treatment steps: A STAR*D report. American Journal of Psychiatry, 163, 1905–1917. doi:10.1176/ajp.2006.163.11.1905
60. Rush A. J., Trivedi M. H., Wisniewski S. R., Stewart J. W., Nierenberg A. A., Thase M. E... Shores-Wilson K., (2006). Bupropion-SR, sertraline, or venlafaxine-XR after failure of SSRIs for depression. New England Journal of Medicine, 354, 1231–1242.
61. Sacks R. M., Greene J., Hibbard J. H., Overton V., (2014). How well do patient activation scores predict depression outcomes one year later? Journal of Affective Disorders, 169, 1–6. doi:10.1016/j.jad.2014.07.030
62. Saltiel P. F., Silvershein D. I., (2015). Major depressive disorder: Mechanism-based prescribing for personalized medicine. Neuropsychiatric Disease and Treatment, 11, 875–888. doi:10.2147/ndt.s73261
63. Steyerberg E. W., Vedder M. M., Leening M. J., Postmus D., D’Agostino R. B., Sr. Van Calster B., Pencina M. J., (2015). Graphical assessment of incremental value of novel markers in prediction models: From statistical to decision analytical perspectives. Biometrical Journal, 57, 556–570. doi:10.1002/bimj.201300260
64. Thornicroft G., Chatterji S., Evans-Lacko S., Gruber M., Sampson N., Aguilar-Gaxiola S... Kessler R. C., (2017). Undertreatment of people with major depressive disorder in 21 countries. The British Journal of Psychiatry, 210, 119–124. doi:10.1192/bjp.bp.116.188078
65. Trivedi M. H., McGrath P. J., Fava M., Parsey R. V., Kurian B. T., Phillips M. L... Weissman M. M., (2016). Establishing Moderators and Biosignatures of Antidepressant Response in Clinical care (EMBARC): Rationale and design. Journal of Psychiatric Research, 78, 11–23. doi:10.1016/j.jpsychires.2016.03.001
66. Uher R., Perroud N., Ng M. Y., Hauser J., Henigsberg N., Maier W... McGuffin P., (2010). Genome-wide pharmacogenetics of antidepressant response in the GENDEP project. The American Journal of Psychiatry, 167, 555–564. doi:10.1176/appi.ajp.2009.09070932
67. van der Laan M. J., Dudoit S., van der Vaart A. W., (2006). The cross-validated adaptive epsilon-net estimator. Statsitics and Decisions, 24, 373–395.
68. van der Laan M. J., Luedtke A. R., (2015). Targeted learning of the mean outcome under an optimal dynamic treatment rule. Journal of Causal Inference, 3, 61–95. doi:10.1515/jci-2013-0022
69. van der Laan M. J., Polley E. C., Hubbard A. E., (2007). Super learner. Statistical Applications in Genetics and Molecular Biology, 6(1), Article 25. doi:10.2202/1544-6115.1309
70. van der Laan M. J., Rubin D., (2006). Targeted maximum likelihood learning. The International Journal of Biostatistics, 2(1). doi:10.2202/1557-4679.1043
71. van Staa T. P., Goldacre B., Gulliford M., Cassell J., Pirmohamed M., Taweel A... Smeeth L., (2012). Pragmatic randomised trials using routine electronic health records: Putting them to the test. The BMJ, 344, e55.
72. Vuorilehto M. S., Melartin T. K., Riihimaki K., Isometsa E. T., (2016). Pharmacological and psychosocial treatment of depression in primary care: Low intensity and poor adherence and continuity. Journal of Affective Disorders, 202, 145–152. doi:10.1016/j.jad.2016.05.035
73. Wallace M. L., Frank E., Kraemer H. C., (2013). A novel approach for developing and interpreting treatment moderator profiles in randomized clinical trials. JAMA Psychiatry, 70, 1241–1247. doi:10.1001/jamapsychiatry.2013.1960
74. Webb C. A., Trivedi M. H., Cohen Z. D., Dillon D. G., Fournier J. C., Goer F... Pizzagalli D. A., Personalized prediction of antidepressant v. placebo response: evidence from the EMBARC study. Psychological Medicine. Advance online publication. doi:10.1017/S0033291718001708
75. Williams L. M., Rush A. J., Koslow S. H., Wisniewski S. R., Cooper N. J., Nemeroff C. B... Gordon E., (2011). International Study to Predict Optimized Treatment for Depression (iSPOT-D), a randomized clinical trial: Rationale and protocol. Trials, 12, 4. Article doi:10.1186/1745-6215-12-4
76. Young S., Abdou T., Bener A., (2018). Deep Super Learner: A deep ensemble for classification problems. arxiv.org. https://arxiv.org/abs/1803.02323