Ensemble contextual bandits for personalized recommendation

RecSys 2014 - Proceedings of the 8th ACM Conference on Recommender Systems

Volumn , Issue , 2014, Pages 73-80

  Tang, Liang ^a   Jiang, Yexi ^a   Li, Lei ^a   Li, Tao ^a  

^a FLORIDA INTERNATIONAL UNIVERSITY   (United States)

Author keywords

Contextual bandit; CTR prediction; Ensemble recommendation; Meta learning; Personalized recommendation

Indexed keywords

CONTEXTUAL BANDITS; EMPIRICAL EXPERIMENTS; ENSEMBLE RECOMMENDATION; EXPLORATION/EXPLOITATION DILEMMAS; METALEARNING; NEWS RECOMMENDATION; PERSONALIZED RECOMMENDATION; PREDICTIVE MODELING;

PREDICTIVE ANALYTICS;

EID: 84908877655     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2645710.2645732     Document Type: Conference Paper

References (32)

1. D. Agarwal et al. Online models for content optimization. In NIPS, pages 17-24, 2008.
2. P. Auer, N. Cesa-Bianchi, Y. Freund, and R. E. Schapire. The nonstochastic multiarmed bandit problem. SIAM Journal on Computing, 32(1):48-77, 2002.
3. A. G. Barto. Reinforcement learning: An introduction. MIT press, 1998.
4. C. M. Bishop et al. Pattern recognition and machine learning, volume 1. Springer, 2006.
5. D. Bouneffouf, A. Bouzeghoub, and A. L. Gançarski. A contextual-bandit algorithm for mobile context-aware recommender system. In NIPS, pages 324-331, 2012.
6. O. Chapelle and L. Li. An empirical evaluation of thompson sampling. In NIPS, pages 2249-2257, 2011.
7. M. Gagliolo and J. Schmidhuber. Algorithm selection as a bandit problem with unbounded losses. Springer, 2010.
8. C. Giraud-Carrier. Metalearning-A tutorial. In ICMLA, 2008.
9. R. V. Hogg and E. A. Tanis. Probability and Statistical Inference. Prentice Hall, 1996.
10. M. Jahrer, A. Töscher, and R. Legenstein. Combining predictions for accurate recommender systems. In SIGKDD, pages 693-702. ACM, 2010.
11. Y. Koren. The bellkor solution to the netflix grand prize. Netflix prize documentation, 2009.
12. J. Langford and T. Zhang. The epoch-greedy algorithm for contextual multi-armed bandits. NIPS, pages 817-824, 2007.
13. L. Li, W. Chu, J. Langford, and R. E. Schapire. A contextual-bandit approach to personalized news article recommendation. In WWW, pages 661-670. ACM, 2010.
14. L. Li, W. Chu, J. Langford, and X. Wang. Unbiased offline evaluation of contextual-bandit-based news article recommendation algorithms. In WSDM, pages 297-306. ACM, 2011.
15. F. Maes, L. Wehenkel, and D. Ernst. Meta-learning of exploration/exploitation strategies: The multi-armed bandit case. Springer, 2013.
16. A. Maurer. Algorithmic stability and meta-learning. In JMLR, pages 967-994, 2005.
17. T. G. McKenzie et al. Novel models and ensemble techniques to discriminate favorite items from unrated ones for personalized music recommendation. In KDDCUP, 2011.
18. R. Polikar. Ensemble based systems in decision making. Circuits and Systems Magazine, IEEE, 6(3):21-45, 2006.
19. A. Prodromidis, P. Chan, and S. Stolfo. Meta-learning in distributed data mining systems: Issues and approaches. Advances in distributed and parallel knowledge discovery, 3, 2000.
20. J. B. Schafer, J. A. Konstan, and J. Riedl. Meta-recommendation systems: User-controlled integration of diverse recommendations. In CIKM, pages 43-51. ACM, 2002.
21. A. I. Schein, A. Popescul, L. H. Ungar, and D. M. Pennock. Methods and metrics for cold-start recommendations. In SIGIR, pages 253-260. ACM, 2002.
22. S. L. Scott. A modern bayesian look at the multi-armed bandit. Applied Stochastic Models in Business and Industry, 26(6):639-658, 2010.
23. J. Seiler. Meta learning in recommendation systems. Master Thesis, Technical University of Berlin, 2013.
24. J. Sill, G. Takács, L. Mackey, and D. Lin. Feature-weighted linear stacking. arXiv preprint arXiv:0911.0460, 2009.
25. C. Tekin and M. van der Schaar. Decentralized online big data classification-A bandit framework. arXiv preprint arXiv:1308.4565, 2013.
26. W. R. Thompson. On the likelihood that one unknown probability exceeds another in view of the evidence of two samples. Biometrika, pages 285-294, 1933.
27. M. Tiemann and S. Pauws. Towards ensemble learning for hybrid music recommendation. In RecSys, pages 177-178. ACM, 2007.
28. M. Tokic. Adaptive e-greedy exploration in reinforcement learning based on value differences. In KI, pages 203-210, 2010.
29. J. Vermorel and M. Mohri. Multi-armed bandit algorithms and empirical evaluation. In ECML, pages 437-448, 2005.
30. M. Wu. Collaborative filtering via ensembles of matrix factorizations. In KDDCUP, 2007.
31. K. Yu, A. Schwaighofer, and V. Tresp. Collaborative ensemble learning: Combining collaborative and content-based information filtering via hierarchical bayes. In UAI, pages 616-623, 2002.
32. B. Zadrozny. Learning and evaluating classifiers under sample selection bias. In ICML, pages 114-121. ACM, 2004.