Doubly robust policy evaluation and learning

Proceedings of the 28th International Conference on Machine Learning, ICML 2011

Volumn , Issue , 2011, Pages 1097-1104

  Dudik, Miroslav ^a   Langford, John ^a   Li, Hong ^a  

^a YAHOO RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EMPIRICAL COMPARISON; HISTORIC DATA; INTERNET ADVERTISING; POLICY EVALUATION; ROBUST APPROACHES; ROBUST TECHNIQUE; VALUE ESTIMATION;

LEARNING SYSTEMS;

EID: 80053456223     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Asuncion, A. and Newman, D. J. UCI machine learning repository, 2007. http://www.ics.uci.edu/~mlearn/MLRepository.html.
2. Auer, P., Cesa-Bianchi, N., Freund, Y., and Schapire, R. E. The nonstochastic multiarmed bandit problem. SIAM J. Computing, 32(1):48-77, 2002.
3. Beygelzimer, A. and Langford, J. The offset tree for learning with partial labels. In KDD, pp. 129-138, 2009.
4. Beygelzimer, A., Langford, J., and Ravikumar, P. Multiclass classification with filter-trees. Unpublished technical report: http://www.stat.berkeley.edu/~pradeepr/paperz/filter-tree.pdf, 2008.
5. Cassel, C. M., Särndal, C. E., and Wretman, J. H. Some results on generalized difference estimation and generalized regression estimation for finite populations. Biometrika, 63:615-620, 1976.
6. Chan, D., Ge, R., Gershony, O., Hesterberg, T., and Lambert, D. Evaluating online ad campaigns in a pipeline: causal models at scale. In KDD, 2010.
7. Gretton, A., Smola, A. J., Huang, J., Schmittfull, M., Borgwardt, K., and Schölkopf, B. Dataset shift in machine learning. In Covariate Shift and Local Learning by Distribution Matching, pp. 131-160. MIT Press, 2008.
8. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, I. H. The WEKA data mining software: An update. SIGKDD Explorations, 11(1):10-18, 2009.
9. Hazan, E. and Kale, S. Better algorithms for benign bandits. In SODA, pp. 38-47, 2009.
10. Horvitz, D. G. and Thompson, D. J. A generalization of sampling without replacement from a finite universe. J. Amer. Statist. Assoc., 47:663-685, 1952.
11. Kang, J. D. Y. and Schafer, J. L. Demystifying double robustness: a comparison of alternative strategies for estimating a population mean from incomplete data. Statist. Sci., 22(4):523-539, 2007. With discussions.
12. Lambert, D. and Pregibon, D. More bang for their bucks: assessing new features for online advertisers. In ADKDD, 2007.
13. Langford, J. and Zhang, T. The epoch-greedy algorithm for contextual multi-armed bandits. In NIPS, pp. 1096-1103, 2008.
14. Langford, J., Strehl, A. L., and Wortman, J. Exploration scavenging. In ICML, pp. 528-535, 2008.
15. Lunceford, J. K. and Davidian, M. Stratification and weighting via the propensity score in estimation of causal treatment effects: A comparative study. Statistics in Medicine, 23(19):2937-2960, 2004. (Pubitemid 39200133)
16. McAllester, D., Hazan, T., and Keshet, J. Direct loss minimization for structured prediction. In NIPS, pp. 1594-1602, 2011.
17. Robins, J. and Rotnitzky, A. Semiparametric efficiency in multivariate regression models with missing data. J. Amer. Statist. Assoc, 90:122-129, 1995.
18. Robins, J. M., Rotnitzky, A., and Zhao, L. P. Estimation of regression coefficients when some regressors are not always observed. J. Amer. Statist. Assoc., 89(427):846-866, 1994.
19. Strehl, A., Langford, J., Li, L., and Kakade, S. Learning from logged implicit exploration data. In NIPS, pp. 2217-2225, 2011.