Automatic ad format selection via contextual bandits

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2013, Pages 1587-1594

  Tang, Liang ^a   Rosales, Rómer ^b   Singh, Ajit P ^b   Agarwal, Deepak ^a  

^a Florida International University   (United States)

^b LINKEDIN CORPORATION   (United States)

Author keywords

Bandit algorithms; Exploration exploitation; Layout; Offline evaluation; Online advertising; Personalization; Recommender systems

Indexed keywords

EXPLORATION/EXPLOITATION; LAYOUT; OFFLINE EVALUATION; ONLINE ADVERTISING; PERSONALIZATIONS;

ALGORITHMS; KNOWLEDGE MANAGEMENT; MARKETING; RECOMMENDER SYSTEMS;

ONLINE SYSTEMS;

EID: 84889567137     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2505515.2514700     Document Type: Conference Paper

References (19)

1. D. Agarwal, B.-C. Chen, and P. Elango. Spatio-temporal models for estimating click-through rate. In WWW, pages 21-30, 2009.
2. J.-Y. Audibert, R. Munos, and C. Szepesvári. Exploration- exploitation tradeoff using variance estimates in multi-armed bandits. Theoretical Computer Science, 410(19):1876-1902, 2009.
3. P. Auer, N. Cesa-Bianchi, and P. Fischer. Finite-time analysis of the multiarmed bandit problem. Machine Learning, 47(2-3):235-256, 2002.
4. K. Bauman, A. Kornetova, V. Topinskii, and D. Khakimova. Optimization of click-through rate prediction in the Yandex search engine. Automatic Documentation and Mathematical Linguistics, 47(2):52-58, 2013.
5. O. Chapelle and L. Li. An empirical evaluation of Thompson sampling. In NIPS, pages 2249-2257, 2011.
6. O. Chapelle, E. Manavoglu, and R. Rosales. Simple and scalable response prediction for display advertising. Transactions on Intel ligent Systems and Technology, (to appear), 2013.
7. H. Cheng, E. Manavoglu, Y. Cui, R. Zhang, and J. Mao. Dynamic ad layout revenue optimization for display advertising. In Workshop on Data Mining for Online Advertising, 2012.
8. D. S. Diamond. A quantitative approach to magazine advertisement format selection. Journal of Marketing Research, 5(4):376-386, Nov 1968.
9. B. Edelman, M. Ostrovsky, and M. Schwarz. Internet advertising and the generalized second-price auction: Selling billions of dollars worth of keywords. American Economic Review, 97(1):242-259, 2005.
10. B. Edelman, M. Ostrovsky, and M. Schwarz. Internet advertising and the generalized second-price auction: Selling billions of dollars worth of keywords. American Economic Review, 99(2):430-434, 2009.
11. T. Graepel, J. Q. Candela, T. Borchert, and R. Herbrich. Web-scale Bayesian click-through rate prediction for sponsored search advertising in Microsoft's Bing search engine. In ICML, pages 13-20, 2010.
12. J. Langford, A. L. Strehl, and J. Wortman. Exploration scavenging. In ICML, pages 528-535, 2008.
13. J. Langford and T. Zhang. The epoch-greedy algorithm for multi-armed bandits with side information. In Advances in neural information processing systems, pages 817-824, 2007.
14. L. Li, W. Chu, J. Langford, and X. Wang. Unbiased offline evaluation of contextual-bandit-based news article recommendation algorithms. In I. King, W. Nejdl, and H. Li, editors, WSDM, pages 297-306. ACM, 2011.
15. H. B. McMahan, G. Holt, D. Sculley, M. Young, D. Ebner, J. Grady, L. Nie, T. Phillips, E. Davydov, D. Golovin, S. Chikkerur, D. Liu, M. Wattenberg, A. M. Hrafnkelsson, T. Boulos, and J. Kubica. Ad click prediction: a view from the trenches. In KDD, 2013.
16. M. Richardson, E. Dominowska, and R. Ragno. Predicting clicks: estimating the click-through rate for new ads. In WWW, pages 521-530, 2007.
17. R. S. Sutton and A. G. Barto. Reinforcement learning: An introduction. IEEE Transactions on Neural Networks, 9(5):1054-1054, 1998.
18. L. Tran-Thanh, A. C. Chapman, E. M. de Cote, A. Rogers, and N. R. Jennings. Epsilon-first policies for budget-limited multi-armed bandits. In AAAI, 2010.
19. J. Vermorel and M. Mohri. Multi-armed bandit algorithms and empirical evaluation. In ECML, pages 437-448, 2005.