Distributed online learning in social recommender systems

IEEE Journal on Selected Topics in Signal Processing

Volumn 8, Issue 4, 2014, Pages 638-652

  Tekin, Cem ^a   Zhang, Simpson ^a   Van Der Schaar, Mihaela ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Collaborative learning; contextual bandits; distributed recommender systems; multi agent online learning; regret

Indexed keywords

E-LEARNING; RECOMMENDER SYSTEMS; SALES;

COLLABORATIVE LEARNING; CONTEXTUAL BANDITS; ONLINE LEARNING; ONLINE RECOMMENDER SYSTEMS; RECOMMENDATION STRATEGIES; REGRET; SEQUENTIAL DECISION MAKING; SOCIAL RECOMMENDER SYSTEMS;

ONLINE SYSTEMS;

EID: 84904749323     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2014.2299517     Document Type: Article

References (33)

1. K.-C. Chen, M. Chiang, and H. Poor, "From technological networks to social networks," IEEE J. Sel. Areas Commun., vol. 31, no. 9, pp. 548-572, Sep. 2013.
2. V. Krishnamurthy, "Quickest detection POMDPs with social learning: Interaction of local and global decision makers," IEEE Trans. Inf. Theory, vol. 58, no. 8, pp. 5563-5587, Aug. 2012.
3. V. Krishnamurthy and H. V. Poor, "Social learning and Bayesian games in multiagent signal processing: How do local and global decision makers interact?," IEEE Signal Process. Mag., vol. 30, no. 3, pp. 43-57, May 2013.
4. A. Jadbabaie, P. Molavi, A. Sandroni, and A. Tahbaz-Salehi, "Non-Bayesian social learning," Games Econ. Behavior, vol. 76, no. 1, pp. 210-225, 2012.
5. A. Nedic and A. Ozdaglar, "Distributed subgradientmethods formultiagent optimization," IEEE Trans. Autom. Control, vol. 54, no. 1, pp. 48-61, Jan. 2009.
6. A. Slivkins, "Contextual bandits with similarity information," in Proc. 24th Annu. Conf. Learn. Theory (COLT), Jul. 2011.
7. M. Dudik, D. Hsu, S. Kale, N. Karampatziakis, J. Langford, L. Reyzin, and T. Zhang, Efficient optimal learning for contextual bandits ArXiv, 2011 [Online]. Available: arXiv:1106.2369, to be published
8. J. Langford and T. Zhang, "The epoch-greedy algorithm for contextual multi-armed bandits," Adv. Neural Inf. Process. Syst., vol. 20, pp. 1096-1103, 2007.
9. W. Chu, L. Li, L. Reyzin, and R. E. Schapire, "Contextual banditswith linear payoff functions," in Proc. Int. Conf. Artif. Intell. Statist. (AISTATS), 2011.
10. C. Tekin and M. van der Schaar, "Distributed online Big Data classification using context information," in Proc. 51st Allerton Conf. Commun., Control, Comput., Oct. 2013.
11. Y. Gai, B. Krishnamachari, and R. Jain, "Combinatorial network optimization with unknown variables: Multi-armed bandits with linear rewards and individual observations," IEEE/ACM Trans. Netw., vol. 20, no. 5, pp. 1466-1478, Oct. 2012.
12. L. Li, W. Chu, J. Langford, and R. E. Schapire, "A contextual-bandit approach to personalized news article recommendation," in Proc. 19th Int. Conf. World Wide Web, 2010, pp. 661-670.
13. P. Auer, N. Cesa-Bianchi, and P. Fischer, "Finite-time analysis of the multiarmed bandit problem," Mach. Learn., vol. 47, pp. 235-256, 2002. (Pubitemid 34126111)
14. K. Crammer and C. Gentile, "Multiclass classification with bandit feedback using adaptive regularization," Mach. Learn., vol. 90, no. 3, pp. 347-383, 2013.
15. A. Anandkumar, N. Michael, and A. Tang, "Opportunistic spectrum access with multiple users: Learning under competition," in Proc. 29th IEEE Conf. Comput. Commun. (INFOCOM), Mar. 2010, pp. 1-9.
16. K. Liu and Q. Zhao, "Distributed learning in multi-armed bandit with multiple players," Signal Process., IEEE Trans., vol. 58, no. 11, pp. 5667-5681, Nov. 2010.
17. C. Tekin and M. Liu, "Online learning of rested and restless bandits," IEEE Trans. Inf. Theory, vol. 58, no. 8, pp. 5588-5611, Aug. 2012.
18. H. Liu, K. Liu, and Q. Zhao, "Learning in a changing world: Restless multiarmed bandit with unknown dynamics," IEEE Trans. Inf. Theory, vol. 59, no. 3, pp. 1902-1916, Mar. 2013.
19. C. Tekin and M. Liu, "Online learning in decentralizedmulti-user spectrum access with synchronized explorations," in Proc. IEEE Military Commun. Conf. (MILCOM), 2012, pp. 1-6.
20. Y. Deshpande and A. Montanari, "Linear bandits in high dimension and recommendation systems," in Proc. 50th Annu. Allerton Conf. Commun., Control, Comput., 2012, pp. 1750-1754.
21. P. Kohli, M. Salek, and G. Stoddard, "A fast bandit algorithm for recommendations to users with heterogeneous tastes," in Proc. 27th AIII Conf. Artif. Intell., Jul. 2013.
22. T. Hofmann, "Latent semantic models for collaborative filtering," ACM Trans. Inf. Syst. (TOIS), vol. 22, no. 1, pp. 89-115, 2004.
23. N. Sahoo, P. V. Singh, and T. Mukhopadhyay, "A hidden Markov model for collaborative filtering," MIS Quarterly, vol. 36, no. 4, pp. 1329-1356, 2012.
24. G. Linden, B. Smith, and J. York, "Amazon.com recommendations: Item-to-item collaborative filtering," IEEE Internet Comput., vol. 7, no. 1, pp. 76-80, Jan./Feb. 2003.
25. U. Panniello, A. Tuzhilin, and M. Gorgoglione, "Comparing contextaware recommender systems in terms of accuracy and diversity," User Model. User-Adapt. Interact., pp. 1-31, 2012.
26. K. Miyahara and M. J. Pazzani, "Collaborative filtering with the simple Bayesian classifier," in Proc. PRICAI Topics Artif. Intell., 2000, pp. 679-689.
27. M. O'Connor and J. Herlocker, "Clustering items for collaborative filtering," in Proc. ACM SIGIR Workshop Recomm. Syst., 1999, vol. 128.
28. G. Shani, R. I. Brafman, and D. Heckerman, "An MDP-based recommender system," in Proc. 18th Conf. Uncert. Artif. Intellig., 2002, pp. 453-460.
29. C.-N. Ziegler, "Towards decentralized recommender systems," Ph.D. dissertation, Albert-Ludwigs-Universitat Freiburg, Freiburg im Breisgau, Germany, 2005.
30. M. Balabanović and Y. Shoham, "Fab: Content-based, collaborative recommendation," Commun. ACM, vol. 40, no. 3, pp. 66-72, 1997.
31. C. Tekin, S. Zhang, and M. van der Schaar, "Distributed online learning in social recommender systems - Online appendix," ArXiv, 2013 [Online]. Available: arXiv:1309.6707, to be published
32. C. Tekin and M. van der Schaar, "Distributed online learning via cooperative contextual bandits," ArXiv, 2013 [Online]. Available: arXiv:1308.4568, to be published
33. J. Leskovec, L. A. Adamic, and B. A. Huberman, "The dynamics of viral marketing," ACM Trans. Web (TWEB), vol. 1, no. 1, p. 5, 2007.