Bandits for taxonomies: A model-based approach

Proceedings of the 7th SIAM International Conference on Data Mining

Volumn , Issue , 2007, Pages 216-227

  Pandey, Sandeep ^a   Agarwal, Deepak ^a   Chakrabarti, Deepayan ^a   Josifovski, Vanja ^a  

^a YAHOO RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

TAXONOMIES;

BAYESIAN FRAMEWORKS; FEATURE SPACE; MODEL BASED APPROACH; MULTI ARMED BANDIT; MULTI-ARMED BANDIT PROBLEM; ON-LINE FASHION; OPTIMAL MATCHING; SHRINKAGE ESTIMATIONS;

DATA MINING;

EID: 70049106076     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1137/1.9781611972771.20     Document Type: Conference Paper

References (24)

1. A.Agresti. Categorical Data Analysis.Wiley, New York, US, 2002.
2. C.J.C.H.Watkins and P.Dayan. Q-leaming. Machine Learning,8(3):279- 292, 1992.
3. D.A.Berry and B.Fristedt. Bandit Problems: Sequential Allocation of Experiments.Chapman and Hall, London,UK, 1985.
4. J.C.Gittins. Bandit processes and dynamic allocation indices. Journal of the Royal Statistical Society, Series B,41:148-177, 1979.
5. J.H.Albert. Computational methods using a bayesian hierarchical generalized linear model. Journal of the American Statistical Association,83:1037-1044, 1988.
6. J J.Sarkar. One-armed bandit problems with covariates. Annals of Statistics,19(4): 1978-2002, 1991.
7. T. L. Lai. Adaptive treatment allocation and multi-armed bandit problem. Annals of Statistics,15(3):1091-1114, 1987.
8. L.Cai and T.Hofmann. Hierarchical document categorization with support vector machines. In ACM 13th Conference on Information and Knowledge Management,pages 1-10, 2004.
9. L.P.Kaelbling, M.L.Littman, and A.W.Moore.Reinforce-ment learning: a survey. Journal of Artificial Intelligence Research,4:237-285, 1996.
10. O. Madani and D. DeCoste. Contextual recommender problems. In UBDM '05: Proceedings of the 1st international workshop on Utility-based data mining,pages 86-89, New York, NY, USA, 2005.
11. M.J.Kahn and A.E.Raftery. Discharge rates of medicare stroke patients to skilled nursing facilities: Bayesian logistic regression with unobserved heterogeneity. Journal of the American Statistical Association,91:29-41, 1996.
12. M.Keams, Y.Mansour, and A.Y.Ng. A sparse sampling algorithm for near optimal planning in large markovian decision processes. In Proceedings of IJCAI'99,pages 1324-1331, 1999.
13. M.L.Littman. Markov games as a framework for multi-agent reinforcement learning. In Proceedings of the 11th International conference on machine learning,pages 157-163, 1994.
14. M.Woodroofe. A one-armed bandit problem with a concomitant variable. Journal of the American Statistical Association,74:799-806, 1979.
15. N.Abe and A.Nakamura. Learning to optimally schedule internet banner advertisements. In Proceedings of the 16th International Conference on Machine Learning,1999.
16. N.Abe, A.W.Biermann, and P.M.Long. Reinforcement learning with immediate rewards and linear hypotheses. Algorith-mica,37(4):263-293,2003.
17. P.Auer, N.Cesa-Bianchi, and P.Fischer. Finite-time analysis of the multiarmed bandit problem. Machine Learning,47:235-256,2002.
18. R.Dearden, N.Friedman, and D.Andre. Model based bayesian exploration. In UA1 5th conference on Uncertainty in Artificial Intelligence, pages150-159, 1999.
19. R.E.Bellman. A markov decision process. Journal of Mathematical Mechanics,6:679-684, 1975.
20. T.Lai and H.Robbins. Asymptotically efficient adaptive allocation rules. Advances in Applied Mathematics,6:4-22, 1985.
21. C.-C. Wang, S. R. Kulkarni, and H. Poor. Bandit problems with side observations. IEEE Transactions on Automatic Control,50(3):338-355, 2005.
22. W.DuMouchel and D.Pregibon. Empirical bayes screening for multi-item associations. In Knowledge Discovery and Data Mining,pages 67-76, 2001.
23. W.F.Rosenberger, A.N.Vidyashankar, and D.K.Agarwal. Covariate-adjusted response adaptive designs for binary response. Journal of Biopharmaceutical Statistics,11:227-236,2001.
24. D. Yang and D.Zhu. Randomized allocation with non-parametric estimation for a multi-armed bandit problem with covariates. Annals of Statistics,3O(1):1OO-121, 2002.