Reinforcement learning for active model selection

Proceedings of the 1st International Workshop on Utility-Based Data Mining, UBDM '05

Volumn , Issue , 2005, Pages 17-23

  Kapoor, Aloak ^a   Greiner, Russell ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

Author keywords

budgeted learning; data acquisition; learning costs; training costs

Indexed keywords

ACTIVE MODELS; LEARNING COSTS; LEARNING DATA; LEARNING SCENARIOS; MACHINE-LEARNING; MARKOV DECISION PROBLEM; REINFORCEMENT LEARNING TECHNIQUES; TRAINING COSTS; TRAINING DATA;

BUDGET CONTROL; COSTS; DATA MINING; REINFORCEMENT;

REINFORCEMENT LEARNING;

EID: 77953565591     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1089827.1089829     Document Type: Conference Paper

References (19)

1. P. Auer, N. Cesa-Bianchi, Y. Freund, and R. E. Schapire. Gambling in a rigged casino: the adversarial multiarmed bandit problem. In Proceedings of the 36th Annual Symposium on Foundations of Computer Science, 1995.
2. K. Chaloner and I. Verdinelli. Bayesian experimental design: A review. Statistical Science, 1995.
3. V. A. Cicirello and S. F. Smith. The max k-armed bandit: a new model of exploration applied to search heuristic selection. In AAAI, 2005.
4. D. A. Cohn, Z. Ghahramani, and M. I. Jordan. Active learning with statistical models. In Advances in Neural Information Processing Systems, 1995.
5. M. Duff. Optimal learning: computational procedures for Bayesadaptive Markov Decision Processes. PhD thesis, University of Massachusetts Amherst, 2002.
6. D. Hoel and M. Sobel. Comparisons of sequential procedures for selecting the best binomial population. In Sixth Berkeley Symposium on Mathematical Statistics and Probability, 1971.
7. A. Kapoor and R. Greiner. Learning and classifying under hard budgets. In European Conference on Machine Learning, 2005.
8. M. Kearns, Y. Mansour, and A. Y. Ng. A sparse sampling algorithm for nearoptimal planning in large markov decision processes. Machine Learning, 2002.
9. D. J. Lizotte, O. Madani, and R. Greiner. Budgeted learning of naives-bayes classifiers. In Proceedings of Uncertainty In Artificial Intelligence, 2003.
10. O. Madani, D. J. Lizotte, and R. Greiner. Active model selection. In Proceedings of Uncertainty in Artificial Intelligence, 2004.
11. O. Madani, D. J. Lizotte, and R. Greiner. Active model selection. Technical report, University of Alberta, 2004.
12. P. Melville, M. Saar-Tsechansky, F. Provost, and R. Mooney. Active feature-value acquisition for classifier induction. In ICDM, 2004.
13. F. Provost, D. Jensen, and T. Oates. Efficient progressive sampling. In International Knowledge Discovery and Data Mining Conference, 1999.
14. H. Robbins. Some aspects of the sequential design of experiments. Bulletin of the American Mathematical Society, 1952.
15. S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, 2002.
16. R. S. Sutton. Learning to predict by the method of temporal differences. Machine Learning, 1988.
17. R. S. Sutton and A. G. Barto. Reinforcement Learning. The MIT Press, 1998.
18. J. N. Tsitsiklis and B. V. Roy. An analysis of temporal-difference learning with function approximation. IEEE Transactions on Automatic Control, 1997.
19. T. Wang, D. Lizotte, M. Bowling, and D. Schuurmans Bayesian sparse sampling for on-line reward optimization. In International Conference on Machine Learning, 2005.