Inference about the expected performance of a data-driven dynamic treatment regime

Clinical Trials

Volumn 11, Issue 4, 2014, Pages 408-417

  Chakraborty, Bibhas ^a,b   Laber, Eric B ^c   Zhao, Ying Qi ^d  

^a DUKE NUS MEDICAL SCHOOL   (Singapore)

^b Och Spine at New York Presbyterian Hospitals   (United States)

^c NORTH CAROLINA STATE UNIVERSITY   (United States)

^d UNIVERSITY OF WISCONSIN SCHOOL OF MEDICINE AND PUBLIC HEALTH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BOOTSTRAPPING; CLINICAL DECISION MAKING; COMPUTER ASSISTED THERAPY; CONFERENCE PAPER; CONFIDENCE INTERVAL; CONTROLLED STUDY; DYNAMIC TREATMENT REGIME; FEASIBILITY STUDY; HUMAN; INTERVENTION STUDY; MEDICAL INFORMATICS; NORMAL DISTRIBUTION; PATIENT CARE PLANNING; PERSONALIZED MEDICINE; PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL (TOPIC); SIMULATION; STRATEGIC PLANNING; TREATMENT RESPONSE;

EID: 84906085233     PISSN: 17407745     EISSN: 17407753     Source Type: Journal    
DOI: 10.1177/1740774514537727     Document Type: Conference Paper

References (75)

1. Lei H, Nahum-Shani I, Lynch K, Oslin D, Murphy SA. A'SMART' design for building individualized treatment sequences. Annu Rev Clin Psychol. 2012 ; 8: 21-48
2. Chakraborty B, Murphy SA, Strecher V. Inference for non-regular parameters in optimal dynamic treatment regimes. Stat Methods Med Res. 2010 ; 19: 317-43
3. Thall PF, Logothetis C, Pagliaro LC, et al. Adaptive therapy for androgen-independent prostate cancer: A randomized selection trial of four regimens. J Natl Cancer Inst. 2007 ; 99: 1613-22
4. Miyahara S, Wahed AS. Weighted Kaplan-Meier estimators for two-stage treatment regimes. Stat Med. 2010 ; 29: 2581-91
5. Zhao Y, Zeng D, Socinski MA, Kosorok MR. Reinforcement learning strategies for clinical trials in non-small cell lung cancer. Biometrics. 2011 ; 67: 1422-33
6. Wang L, Rotnitzky A, Lin X, Millikan RE, Thall PF. Evaluation of viable dynamic treatment regimes in a sequentially randomized trial of advanced prostate cancer. J Am Stat Assoc. 2012 ; 107: 493-508
7. Khalili S, Armaou A. An extracellular stochastic model of early HIV infection and the formulation of optimal treatment policy. Chem Eng Sci. 2008 ; 63: 4361-72
8. Robins JM, Orellana L, Rotnitzky A. Estimation and extrapolation of optimal treatment and testing strategies. Stat Med. 2008 ; 27: 4678-21
9. Dawson R, Lavori PW. Placebo-free designs for evaluating new mental health treatments: The use of adaptive treatment strategies. Stat Med. 2004 ; 23: 3249-62
10. Shortreed SM, Moodie EEM. Estimating the optimal dynamic antipsychotic treatment regime: Evidence from the sequential-multiple assignment randomized CATIE Schizophrenia Study. J R Stat Soc Ser C Appl Stat. 2012 ; 61: 577-99
11. Chakraborty B, Laber EB, Zhao Y. Inference for optimal dynamic treatment regimes using an adaptive m-out-of-n bootstrap scheme. Biometrics. 2013 ; 69: 714-23
12. Wagner EH, Austin BT, Davis C, et al. Improving chronic illness care: Translating evidence into action. Health Aff. 2001 ; 20: 64-78
13. Chakraborty B, Moodie EEM Statistical Methods for Dynamic Treatment Regimes: Reinforcement Learning, Causal Inference, and Personalized Medicine. New York: Springer ; 2013 :
14. Marlowe DB, Festinger DS, Arabia PL, et al. Adaptive interventions in drug court: A pilot experiment. Crim Justice Rev. 2008 ; 33: 343-60
15. Marlowe DB, Festinger DS, Arabia PL, et al. Adaptive interventions may optimize outcomes in drug courts: A pilot study. Curr Psychiatry Rep. 2009 ; 11: 370-76
16. Lavori PW, Dawson R. A design for testing clinical strategies: Biased adaptive within-subject randomization. J R Stat Soc Ser A Stat Soc. 2000 ; 163: 29-38
17. Lavori PW, Dawson R. Dynamic treatment regimes: Practical design considerations. Clin Trials. 2004 ; 1: 9-20
18. Murphy SA. An experimental design for the development of adaptive treatment strategies. Stat Med. 2005 ; 24: 1455-81
19. Tummarello D, Mari D, Graziano F, et al. A randomized, controlled phase III study of cyclophosphamide, doxorubicin, and vincristine with etoposide (CAV-E) or teniposide (CAV-T), followed by recombinant interferon-α maintenance therapy or observation, in small cell lung carcinoma patients with complete responses. Cancer. 1997 ; 80: 2222-29
20. Matthay KK, Villablanca JG, Seeger RC, et al. Treatment of high-risk neuroblastoma with intensive chemotherapy, radiotherapy, autologous bone marrow transplantation, and 13-cis-retinoic acid. N Engl J Med. 1999 ; 341: 1165-73
21. Habermann TM, Weller EA, Morrison VA, et al. Rituximab-CHOP versus CHOP alone or with maintenance rituximab in older patients with diffuse large B-cell lymphoma. J Clin Oncol. 2006 ; 24: 3121-27
22. Auyeung SF, Long Q, Royster EB, et al. Sequential multiple-assignment randomized trial design of neurobehavioral treatment for patients with metastatic malignant melanoma undergoing high-dose interferon-alpha therapy. Clin Trials. 2009 ; 6: 480-90
23. Mateos MV, Oriol A, Martínez-López J, et al. Bortezomib, melphalan, and prednisone versus bortezomib, thalidomide, and prednisone as induction therapy followed by maintenance treatment with bortezomib and thalidomide versus bortezomib and prednisone in elderly patients with untreated multiple myeloma: A randomised trial. Lancet Oncol. 2010 ; 11: 934-41
24. KasariC. Developmental and Augmented Intervention for Facilitating Expressive Language (CCNIA) (ClinicalTrials.gov database, updated 26 April 2012). National Institutes of Health, Bethesda, MD, 2009. Available at: http://clinicaltrials.gov/ct2/show/NCT01013545 (accessed 24 July 2013).
25. Nahum-Shani I, Qian M, Almirall D, et al. Experimental design and primary data analysis methods for comparing adaptive interventions. Psychol Methods. 2012 ; 17: 457-77
26. Nahum-Shani I, Qian M, Almirall D, et al. Q-Learning: A data analysis method for constructing adaptive interventions. Psychol Methods. 2012 ; 17: 478-94
27. JonesH. Reinforcement-Based Treatment for Pregnant Drug Abusers (HOME II) (ClinicalTrials.gov database, updated 19 October 2012). National Institutes of Health, Bethesda, MD, 2010. Available at: http://clinicaltrials.gov/ct2/show/ NCT01177982 (accessed 24 July 2013).
28. Methodology Center. Projects involving SMART design. Available at: http://methodology.psu.edu/ra/adap-treat-strat/projects (accessed 4 May 2014).
29. LaberEB. List of SMART studies. Available at: http://www4.stat.ncsu.edu/ ∼eblaber/smart (accessed 4 May 2014).
30. Methodology Center. NIH funding for SMART. http://methodology.psu.edu/ra/ adap-inter/NIHfunding (accessed 4 May 2014).
31. Dawson R, Lavori PW. Sample size calculations for evaluating treatment policies in multi-stage designs. Clin Trials. 2010 ; 7: 643-52
32. Oetting AI, Levy JA, Weiss RD, Murphy SA Causality and Psychopathology: Finding the Determinants of Disorders and their Cures. Shrout PE Keyes KM Ornstein K, ed. New York: Oxford University Press ; 2011: 179-205.
33. Almirall D, Compton SN, Gunlicks-Stoessel M, Duan N, Murphy SA. Designing a pilot sequential multiple assignment randomized trial for developing an adaptive treatment strategy. Stat Med. 2012 ; 31: 1887-902
34. Almirall D, Lizotte D, Murphy SA. SMART design issues and the consideration of opposing outcomes: Discussion of 'Evaluation of viable dynamic treatment regimes in a sequentially randomized trial of advanced prostate cancer' by Wang, Rotnitzky, Lin, Millikan, and Thall. J Am Stat Assoc. 2012 ; 107: 509-12
35. Orellana L, Rotnitzky A, Robins JM. Dynamic regime marginal structural mean models for estimation of optimal dynamic treatment regimes, part I: Main content. Int J Biostat. 2010 ; 6 :
36. Moodie EEM, Chakraborty B, Kramer MS. Q-learning for estimating optimal dynamic treatment rules from observational data. Can J Stat. 2012 ; 40: 629-45
37. Robins JM. Optimal structural nested models for optimal sequential decisions. Proceedings of the second Seattle symposium on biostatistics ; Seattle ;. 189.
38. Murphy SA. A generalization error for Q-learning. J Mach Learn Res. 2005 ; 6: 1073-97
39. Zhao Y, Kosorok MR, Zeng D. Reinforcement learning design for cancer clinical trials. Stat Med. 2009 ; 28: 3294-315
40. Zhao YQ, Zeng D, Rush AJ, Kosorok MR. Estimating individual treatment rules using outcome weighted learning. J Am Stat Assoc. 2012 ; 107: 1106-18
41. Zhang B, Tsiatis AA, Laber EB, Davidian M. A robust method for estimating optimal treatment regimes. Biometrics. 2012 ; 68: 1010-18
42. Zhang B, Tsiatis AA, Laber EB, Davidian M. Robust estimation of optimal dynamic treatment regimes for sequential treatment decisions. Biometrika. 2013 ; 100: 681-94
43. Laber EB, Murphy SA. Adaptive confidence intervals for the test error in classification. J Am Stat Assoc. 2011 ; 106: 904-13
44. Lunceford JK, Davidian M, Tsiatis AA. Estimation of survival distributions of treatment policies in two-stage randomization designs in clinical trials. Biometrics. 2002 ; 58: 48-57
45. Wahed AS, Tsiatis AA. Optimal estimator for the survival distribution and related quantities for treatment policies in two-stage randomized designs in clinical trials. Biometrics. 2004 ; 60: 124-33
46. Wahed AS, Tsiatis AA. Semiparametric efficient estimation of survival distributions in two-stage randomisation designs in clinical trials with censored data. Biometrika. 2006 ; 93: 163-77
47. Thall PF, Millikan RE, Sung HG. Evaluating multiple treatment courses in clinical trials. Stat Med. 2000 ; 30: 1011-28
48. Thall PF, Sung HG, Estey EH. Selecting therapeutic strategies based on efficacy and death in multi- course clinical trials. J Am Stat Assoc. 2002 ; 97: 29-39
49. Politis DN, Romano JP, Wolf M Subsampling. New York: Springer Verlag ; 1999 :
50. Robins JM. A new approach to causal inference in mortality studies with sustained exposure periods - Application to control of the healthy worker survivor effect. Math Modelling. 1986 ; 7: 1393-512
51. Robins JM Health Service Research Methodology: A Focus on AIDS. Sechrest L Freeman H Mulley A, ed. New York: NCHSR, U.S. Public Health Service ; 1989: 113-59.
52. Robins JM. Information recovery and bias adjustment in proportional hazards regression analysis of randomized trials using surrogate markers. Proceedings of the biopharmaceutical section, American Statistical Association ; San Francisco, California ;. 24.
53. Robins JM Latent Variable Modeling and Applications to Causality (Lecture Notes in Statistics). Berkane M, ed. New York: Springer-Verlag ; 1997: 69-117.
54. Strecher V, McClure J, Alexander G, et al. Web-based smoking cessation components and tailoring depth: Results of a randomized trial. Am J Prev Med. 2008 ; 34: 373-81
55. Schulte PJ, Tsiatis AA, Laber EB, Davidian M. Q- and A-learning methods for estimating optimal dynamic treatment regimes. Stat Sci. :
56. Robins JM. Correcting for non-compliance in randomized trials using structural nested mean models. Commun Stat Theory. 1994 ; 23: 2379-412
57. Robins JM Statistical Models in Epidemiology, the Environment, and Clinical Trials. Halloran ME Berry D, ed. Springer New York: ; 1999: 95-134.
58. Robins JM, Hernán MA, Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology. 2000 ; 11: 550-60
59. Murphy SA, van der Laan MJ, Robins JM. Marginal mean models for dynamic regimes. J Am Stat Assoc. 2001 ; 96: 1410-23
60. Sutton RS, Barto AG Reinforcement Learning: An Introduction. Cambridge: MIT Press ; 1998 :
61. XinJChakrabortyBLaberEB. qLearn. Available at: http://cran.r-project.org/ web/packages/qLearn/index.html (2012, accessed 4 May 2014).
62. Dawid A Multivariate Analysis and Its Applications (Lecture Notes - Monograph Series). Anderson TW Fang KT Olkin I, ed. Hayward, CA: Institute of Mathematical Statistics ; 1994: 211-20.
63. Efron B. Estimating the error rate of a prediction rule: Improvement on cross-validation. J Am Stat Assoc. 1983 ; 78: 316-31
64. Hand DJ. Recent advances in error rate estimation. Pattern Recognit Lett. 1986 ; 4: 335-46
65. Hastie T, Tibshirani R, Friedman J The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2 nd edn). Springer, New York, 2009. New York: Springer ; 2009 :
66. Zhao YQ, Zeng D, Laber EB, Kosorok MR. New statistical learning methods for estimating optimal dynamic treatment regimes, submitted.. :
67. Efron B, Tibshirani R An Introduction to the Bootstrap. Chapman & Hall/CRC, Boca Raton, FL ; 1993 :
68. Laber EB, Lizotte D, Qian M, Pelham WE, Murphy SA. Statistical inference in dynamic treatment regimes. arXiv: 1006.5831v3 [stat.ME], 26 November 2013.. :
69. Bretagnolle J. Lois limites du bootstrap de certaines fonctionnelles. Annales de l'IHP Probabilit'es et statistiques. 1983 ; 19: 281-96
70. Swanepoel JWH. A note on proving that the (modified) bootstrap works. Commun Stat Theory. 1986 ; 15: 3193-203
71. Dümbgen L. On nondifferentiable functions and the bootstrap. Probab Theory Rel. 1993 ; 95: 125-40
72. Shao J. Bootstrap sample size in nonregular cases. Proc Am Math Soc. 1994 ; 122: 1251-62
73. Bickel P, Gotze F, van Zwet W. Resampling fewer than n observations: Gains, losses and remedies for losses. Statistica Sinica. 1997 ; 7: 1-31
74. Freedman B. Equipoise and the ethics of clinical research. N Engl J Med. 1987 ; 317: 141-45
75. Davison AC, Hinkley DV Bootstrap Methods and Their Application. Cambridge: Cambridge University Press ; 1997 :