Robust estimation of optimal dynamic treatment regimes for sequential treatment decisions

Biometrika

Volumn 100, Issue 3, 2013, Pages 681-694

  Zhang, Baqun ^a   Tsiatis, Anastasios A ^b   Laber, Eric B ^b   Davidian, Marie ^b  

^a RENMIN UNIVERSITY OF CHINA   (China)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

Author keywords

A learning; Double robustness; Outcome regression; Propensity score; Q learning

Indexed keywords

EID: 84882733659     PISSN: 00063444     EISSN: 14643510     Source Type: Journal    
DOI: 10.1093/biomet/ast014     Document Type: Article

References (22)

1. ALMIRALL, D., ten haVE, T. & Murphy, S. A. (2010). Structural nested mean models for assessing time-varying effect moderation. Biometrics 66, 131-9
2. Bather, J. (2000). Decision Theory: An Introduction to Dynamic Programming and Sequential Decisions. Chichester: Wiley
3. CHAKRABORTY, B., murphy, S. A. & Strecher, V. (2010). Inference for non-regular parameters in optimal dynamic treatment regimes. Statist. Meth.: Med. Res. 19, 317-43
4. Goldberg, D. E. (1989). Genetic Algorithms in Search, Optimization, and Machine Learning. Reading, MA: Addison-Wesley
5. HENDERSON, R., ansell, P. & Alshibani, D. (2010). Regret-regression for optimal dynamic treatment regimes. Biometrics 66, 1192-201
6. Mebane, W. R. & Sekhon, J. S. (2011). Genetic optimization using derivatives: The rgenoud package for R. J. Statist. Software 42, 1-26
7. Moodie, E. E. M., RICHARDSON, T. S. & Stephens, D. A. (2007). Demystifying optimal dynamic treatment regimes. Biometrics 63, 447-55
8. Murphy, S. A. (2003). Optimal dynamic treatment regimes (with discussion). J. R. Statist. Soc. B 58, 331-66 (Pubitemid 36607793)
9. Murphy, S. A. (2005). An experimental design for the development of adaptive treatment strategies. Statist. Med. 24, 1455-81 (Pubitemid 40716347)
10. Murphy, S. A., oslin, D. W., rush, A. J. & Zhu, J. (2007). Methodological challenges in constructing effective treatment sequences for chronic psychiatric disorders. Neuropsychopharmacology 32, 257-62 (Pubitemid 46106932)
11. Orellana, L., ROTNITZKY, A. & Robins, J. (2010). Dynamic regime marginal structural mean models for estimation of optimal dynamic treatment regimes, Part I: Main content. Int. J. Biostatist. 6, Article 8, DOI: 10.2202/1557-4679.1200
12. Robins, J. M. (1986). A new approach to causal inference in mortality studies with sustained exposure periods: Applications to control of the healthy worker survivor effect. Math. Mod. 7, 1393-512
13. Robins, J. M. (2004). Optimal structured nested models for optimal sequential decisions. In Proc. 2nd Seattle Symp. Biostatist., ed. D. Y. Lin and P. J. Heagerty, pp. 189-326. New York: Springer
14. ROBINS, J., ORELLANA, L. & Rotnitzky, A. (2008). Estimation and extrapolation of optimal treatment and testing strategies. Statist. Med. 27, 4678-721
15. Robins, J. M., ROTNITZKY, A. & Zhao, L. P. (1994). Estimation of regression coefficients when some regressors are not always observed. J. Am. Statist. Assoc. 89, 846-66
16. Rosthøj, S., FULLWOOD, C., HENDERSON, R. & Stewart, S. (2006). Estimation of optimal dynamic anticoagulation regimes from observational data: A regret-based approach. Statist. Med. 25, 4197-215 (Pubitemid 46023765)
17. Rubin, D. B. (1978). Bayesian inference for causal effects: The role of randomization. Ann. Statist. 6, 34-58
18. Stefanski, L. A. & Boos, D. D. (2002). The calculus of M-estimation. Am. Statistician 56, 29-38
19. Tsiatis, A.A. (2006). Semiparametric Theory and Missing Data. New York: Springer
20. WATKINS, C. J. C. H. & Dayan, P. (1992). Q-learning. Mach. Learn. 8, 279-92
21. Zhang, B., TSIATIS, A. A., laber, E. B. & Davidian, M. (2012). A robust method for estimating optimal treatment regimes. Biometrics, 68, 1010-8
22. Zhao, Y., KOSOROK, M. R. & Zeng, D. (2009). Reinforcement learning design for cancer clinical trials. Statist. Med. 28, 3294-315