Tutorial on application-oriented evaluation of recommendation systems

AI Communications

Volumn 26, Issue 2, 2013, Pages 225-236

  Shani, Guy ^a   Gunawardana, Asela ^b  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^b MICROSOFT RESEARCH   (United States)

Author keywords

evaluation; Recommender systems

Indexed keywords

APPLICATION-ORIENTED; BEST PRACTICES; COMMERCIAL APPLICATIONS; EVALUATION;

ARTIFICIAL INTELLIGENCE;

RECOMMENDER SYSTEMS;

EID: 84880226978     PISSN: 09217126     EISSN: None     Source Type: Journal    
DOI: 10.3233/AIC-130551     Document Type: Article

References (22)

1. G.E.P. Box, W.G. Hunter and J.S. Hunter, Statistics for Experimenters, Wiley, New York, 1978.
2. J.S. Breese, D. Heckerman and C.M. Kadie, Empirical analysis of predictive algorithms for collaborative filtering, in: UAI, 1998, pp. 43-52.
3. J. Demšar, Statistical comparisons of classifiers over multiple data sets, J. Mach. Learn. Res. 7 (2006), 1-30.
4. C. Desrosiers and G. Karypis, A comprehensive survey of neighborhood-based recommendation methods, in: Recommender Systems Handbook, F. Ricci, L. Rokach, B. Shapira and P.B. Kantor, eds, Springer, 2011, pp. 107-144.
5. N. Good, J.B. Schafer, J. Konstan, A. Borchers, B. Sarwar, J. Herlocker and J. Riedl, Combining collaborative filtering with personal agents for better recommendations, in: 1999 Conference of the American Association of Artificial Intelligence (AAAI), 1999, pp. 439-446.
6. A. Gunawardana and G. Shani, A survey of accuracy evaluation metrics of recommendation tasks, Journal of Machine Learning Research 10 (2009), 2935-2962.
7. R. Hu and P. Pu, A comparative user study on rating vs. personality quiz based preference elicitation methods, in: IUI'09: Proceedings of the 13th International Conference on Intelligent User Interfaces, ACM, New York, NY, USA, 2009, pp. 367-372.
8. R. Kohavi, R. Longbotham, D. Sommerfield and R.M. Henne, Controlled experiments on the web: survey and practical guide, Data Min. Knowl. Discov. 18(1) (2009), 140-181.
9. Y. Koren, Factor in the neighbors: Scalable and accurate collaborative filtering, TKDD 4(1) (2010).
10. Y. Koren and R.M. Bell, Advances in collaborative filtering, in: Recommender Systems Handbook, F. Ricci, L. Rokach, B. Shapira and P.B. Kantor, eds, Springer, 2011, pp. 145-186.
11. Y. Koren, R.M. Bell and C. Volinsky, Matrix factorization techniques for recommender systems, IEEE Computer 42(8) (2009), 30-37.
12. E.L. Lehmann and J.P. Romano, Testing Statistical Hypotheses, 3rd edn, Springer Texts in Statistics, Springer, New York, 2005.
13. G. Linden, B. Smith and J. York, Amazon.com recommendations: Item-to-item collaborative filtering, IEEE Internet Computing 7(1) (2003), 76-80.
14. T. Mahmood and F. Ricci, Learning and adaptivity in interactive recommender systems, in: ICEC'07: Proceedings of the Ninth International Conference on Electronic Commerce, ACM, New York, NY, USA, 2007, pp. 75-84.
15. B.M. Marlin, Modeling user rating profiles for collaborative filtering, in: NIPS, 2003.
16. R.J. Mooney and L. Roy, Content-based book recommending using learning for text categorization, in: Proceedings of the Fifth ACM Conference on Digital Libraries, DL'00, ACM, New York, NY, USA, 2000, pp. 195-204.
17. M.J. Pazzani and D. Billsus, Content-based recommendation systems, in: The Adaptive Web, 2007, pp. 325-341.
18. P. Resnick and H.R. Varian, Recommender systems, Commun. ACM 40(3) (1997), 56-58.
19. B. Sarwar, G. Karypis, J. Konstan and J. Riedl, Item-based collaborative filtering recommendation algorithms, in: Proceedings of the 10th International Conference on World Wide Web, WWW'01, ACM, New York, NY, USA, 2001, pp. 285-295.
20. J.B. Schafer, D. Frankowski, J.L. Herlocker and S. Sen, Collaborative filtering recommender systems, in: The Adaptive Web, 2007, pp. 291-324.
21. G. Shani, D.M. Chickering and C. Meek, Mining recommendations from the web, in: RecSys'08: Proceedings of the 2008 ACM Conference on Recommender Systems, 2008, pp. 35-42.
22. G. Shani and A. Gunawardana, Evaluating recommendation systems, in: Recommender Systems Handbook, Springer, 2011, pp. 257-297.