Evaluation of recommendations: Rating-prediction and ranking

RecSys 2013 - Proceedings of the 7th ACM Conference on Recommender Systems

Volumn , Issue , 2013, Pages 213-220

  Steck, Harald ^a  

^a NETFLIX INC   (United States)

Author keywords

Ranking; Rating prediction; Recommender systems; Selection bias

Indexed keywords

PRECISION AND RECALL; PREDICTION TASKS; RANKING; RANKING PROBLEMS; REAL-WORLD PROBLEM; RECOMMENDATION ACCURACY; ROOT MEAN SQUARE ERRORS; SELECTION BIAS;

FORECASTING; MEAN SQUARE ERROR; PROBLEM SOLVING; RECOMMENDER SYSTEMS;

RATING;

EID: 84887575890     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2507157.2507160     Document Type: Conference Paper

References (25)

1. KDD Cup 2007. Task 1: Who rated what, 2007. http://www.cs.uic.edu/ liub/KDD-cup- 2007/proceedings.html.
2. G. Adomavicius and A. Tuzhilin. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering, 17:734-49, 2005.
3. J. Bennet and S. Lanning. The Netflix Prize. In Workshop at SIGKDD-07, ACM Conference on Knowledge Discovery and Data Mining, 2007.
4. P. Cremonesi, Y. Koren, and R. Turrin. Performance of recommender algorithms on top-N recommendation tasks. In ACM Conference on Recommender Systems, pages 39-46, 2010.
5. MovieLens data. homepage: http://www.grouplens.org/node/73, 2006.
6. S. Funk. Netflix update: Try this at home, 2006. http://sifter.org/simon/ journal/20061211.html.
7. A. Gunawardana and G. Shani. A survey of accuracy evaluation metrics of recommendation tasks. Journal of Machine Learning Research, 10:2935-62, 2009.
8. Y. Hu, Y. Koren, and C. Volinsky. Collaborative filtering for implicit feedback datasets. In IEEE International Conference on Data Mining (ICDM), pages 263-72, 2008.
9. R. Keshavan, A. Montanari, and S. Oh. Matrix completion from noisy entries. Journal of Machine Learning Research, 11:2057-78, 2010.
10. Y. Koren. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In ACM Conference on Knowledge Discovery and Data Mining, pages 426-34, 2008.
11. S. L. Lauritzen. Graphical Models. Oxford University Press, 1996.
12. R. Little and D. B. Rubin. Statistical Analysis with missing data. Wiley, 1986.
13. B. Marlin and R. Zemel. Collaborative prediction and ranking with non-random missing data. In ACM Conference on Recommender Systems (RecSys), pages 5-12, 2009.
14. B. Marlin, R. Zemel, S. Roweis, and M. Slaney. Collaborative filtering and the missing at random assumption. In Conference on Uncertainty in Artificial Intelligence (UAI), pages 267-75, 2007.
15. R. Pan, Y. Zhou, B. Cao, N. Liu, R. Lukose, M. Scholz, and Q. Yang. One-class collaborative filtering. In IEEE International Conference on Data Mining (ICDM), pages 502-11, 2008.
16. A. Paterek. Improving regularized singular value decomposition for collaborative filtering. In KDDCup, 2007.
17. B. Pradel, N. Usunier, and P. Gallinari. Ranking with non-random missing ratings: influence of popularity and positivity on evaluation metrics. In ACM Conference on Recommender Systems (RecSys), pages 147-54, 2012.
18. D. B. Rubin. Inference and missing data. Biometrika, 63:581-92, 1976.
19. R. Salakhutdinov, A. Mnih, and G. Hinton. Restricted Boltzmann machines for collaborative filtering. In International Conference on Machine Learning (ICML), pages 791-8, 2007.
20. R. Salakhutdinov and N. Srebro. Collaborative filtering in a non-uniform world: Learning with the weighted trace norm. In Advances in Neural Information Processing Systems 24 (NIPS), 2010.
21. G. Shani and A. Gunawardana. Evaluating recommendation systems. In Recommender Systems Handbook, pages 257-97. Springer, 2011.
22. H. Steck. Training and testing of recommender systems on data missing not at random. In ACM Conference on Knowledge Discovery and Data Mining, pages 713-22, 2010.
23. H. Steck. Item popularity and recommendation accuracy. In ACM Conference on Recommender Systems (RecSys), pages 125-32, 2011.
24. M. Weimer, A. Karatzoglou, Q. Le, and A. Smola. Cofi rank - maximum margin matrix factorization for collaborative ranking. In Advances in Neural Information Processing Systems (NIPS), 2008.
25. Y. Xin and H. Steck. Multi-value probabilistic matrix factorization for IP-TV recommendations. In ACM Conference on Recommender Systems (RecSys), pages 221-8, 2011.