Modeling user preferences in recommender systems: A classification framework for explicit and implicit user feedback

ACM Transactions on Interactive Intelligent Systems

Volumn 4, Issue 2, 2014, Pages

  Jawaheer, Gawesh ^a   Weller, Peter ^a   Kostkova, Patty ^b  

^a CITY UNIVERSITY   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Explicit feedback; Feedback; Implicit feedback; Improvement of feedback; Recommender systems

Indexed keywords

RECOMMENDER SYSTEMS;

CLASSIFICATION FRAMEWORK; COGNITIVE EFFORTS; COMPARISON CRITERION; EXPLICIT FEEDBACK; HUMAN BEHAVIORS; IMPLICIT FEEDBACK; STANDARD TECHNOLOGY; STATE-OF-THE-ART TECHNIQUES;

FEEDBACK;

EID: 84983587892     PISSN: 21606455     EISSN: 21606463     Source Type: Journal    
DOI: 10.1145/2512208     Document Type: Article

References (76)

1. Silvana Aciar, Debbie Zhang, Simeon Simoff, and John Debenham. 2006. Recommender system based on consumer product reviews. In Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI'06). IEEE Computer Society, Washington, DC, 719-723.
2. Gediminas Adomavicius and YoungOk Kwon. 2008. Overcoming accuracy-diversity tradeoff in recommender systems: A variance-based approach. In Proceedings of the 18thWorkshop on Information and Technology and Systems (WITS'08).
3. Gediminas Adomavicius, Bamshad Mobasher, Francesco Ricci, and Alex Tuzhilin. 2011. Context-aware recommender systems. AI Magazine 32, 3, 67-80.
4. Gediminas Adomavicius and Alexander Tuzhilin. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering 17, 6, 734-749. http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=1423975.
5. Xavier Amatriain. 2011. Recommender Systems: We're Doing It (All) Wrong. Retrieved May 26, 2014, from http://technocalifornia.blogspot.com/2011/04/ recommender-systems-were-doing-it-all.html.
6. Xavier Amatriain, Josep Pujol, and Nuria Oliver. 2009a. I like it. I like it not: Evaluating user ratings noise in recommender systems. In G.-J. Houben, G.McCalla, F. Pianesi, and M. Zancanaro (Eds.), User Modeling, Adaptation, and Personalization. Springer, Berlin, Heidelberg, 247-258.
7. Xavier Amatriain, Josep M. Pujol, Nava Tintarev, and Nuria Oliver. 2009b. Rate it again: Increasing recommendation accuracy by user re-rating. In Proceedings of the 3rd Conference on Recommender Systems. ACM Press, New York, NY, 173-180.
8. Justin Basilico and Thomas Hofmann. 2004. Unifying collaborative and content-based filtering. In Proceedings of the 21st International Conference on Machine Learning (ICML'04). ACM Press, New York, NY, 9.
9. Robert M. Bell and Yehuda Koren. 2007. Lessons from the Netflix prize challenge. ACM SIGKDD Explorations Newsletter 9, 2, 75. http://portal.acm.org/ citation.cfm?doid=1345448.1345465.
10. James Bennett and Stan Lanning. 2007. The Netflix prize. In Proceedings of the KDD-Cup and Workshop at the 13th SIGKDD International Conference on Knowledge Discovery and Data Mining.
11. Mark Claypool, Phong Le, Makoto Wased, and David Brown. 2001. Implicit interest indicators. In Proceedings of the 6th International Conference on Intelligent User Interfaces (IUI'01). ACM Press, New York, NY, 33-40.
12. Dan Cosley, Shyong K. Lam, Istvan Albert, Joseph A. Konstan, and John Riedl. 2003. Is seeing believing? How recommender interfaces affect users. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'03). ACM Press, New York, NY, 585-592. http://portal.acm.org/citation.cfm? doid=642611.642713.
13. James Davidson, Benjamin Liebald, Junning Liu, Palash Nandy, Taylor Van Vleet, Ullas Gargi, Sujoy Gupta, Yu He, Mike Lambert, Blake Livingston, and Dasarathi Sampath. 2010. The YouTube video recommendation system. In Proceedings of the 4th Conference on Recommender Systems. ACM Press, New York, NY, 293-296.
14. Mukund Deshpande and George Karypis. 2004. Item-based top-N recommendation algorithms. ACM Transactions on Information Systems 22, 1, 143-177. http://portal.acm.org/citation.cfm?doid=963770.963776.
15. Christian Desrosiers and George Karypis. 2010. A novel approach to compute similarities and its application to item recommendation. In Proceedings of the 11th Pacific Rim International Conference on Trends in Artificial Intelligence. Springer-Verlag, Berlin, Heidelberg, 39-51.
16. Andy Field and Graham Hole. 2003. How to Design and Report Experiments. Sage Publications.
17. Sandra C. Gadanho and Nicolas Lhuillier. 2007. Addressing uncertainty in implicit preferences. In Proceedings of the 2007 Conference on Recommender Systems. ACM Press, New York, NY, 97-104.
18. Sandra Garcia Esparza, Michael P. O'Mahony, and Barry Smyth. 2012. Mining the real-time Web: A novel approach to product recommendation. Journal of Knowledge-Based Systems: Special Issue on Innovative Techniques and Applications of Artificial Intelligence 29, 3-11.
19. Ken Goldberg, Theresa Roeder, Dhruv Gupta, and Chris Perkins. 2001. Eigentaste: A constant time collaborative filtering algorithm. Information Retrieval 4, 2, 133-151. http://www.springerlink.com/index/M5458KV8LJ602646.pdf.
20. GroupLens Research. 2011a. EachMovie Dataset. Retrieved May 26, 2014, from http://www.grouplens.org/node/76.
21. GroupLens Research. 2011b. MovieLens Dataset. Retrieved May 26, 2014, from http://www.grouplens.org/node/73.
22. Maxwell F. Harper, Xin Li, Yan Chen, and Joseph A. Konstan. 2005. An economic model of user rating in an online recommender system. In L. Ardissono, P. Brna, and A. Mitrovic (Eds.), User Modeling 2005. Springer, 307-316.
23. Jonathan L. Herlocker, Joseph A. Konstan, Loren G. Terveen, and John T. Riedl. 2004. Evaluating collaborative filtering recommender systems. ACMTransactions on Information Systems 22, 1, 5-53. http://portal.acm.org/ citation.cfm?doid=963770.963772.
24. Oscar Celma Herrada, 2009a. Last.fm Dataset. Retrieved May 26, 2014, from http://www.dtic.upf.edu/ocelma/MusicRecommendationDataset/index.html.
25. Oscar Celma Herrada. 2009b. Music Recommendation and Discovery in the Long Tail. Ph.D. Dissertation.
26. Will Hill, Larry Stead, Mark Rosenstein, and George Furnas. 1995. Recommending and evaluating choices in a virtual community of use. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'95). 194-201. http://portal.acm.org/citation.cfm?doid=223904.223929.
27. Yifan Hu, Yehuda Koren, and Chris Volinsky. 2008. Collaborative filtering for implicit feedback datasets. In Proceedings of the 2008 8th IEEE International Conference on Data Mining. 263-272. http://ieeexplore.ieee.org/ lpdocs/epic03/wrapper.htm?arnumber=4781121.
28. Zan Huang. 2007. Selectively acquiring ratings for product recommendation. In Proceedings of the 9th International Conference on Electronic Commerce. ACM Press, New York, NY, 379-388.
29. IMDB.com Inc. 1990. The Internet Movie Database. Retrieved May 26, 2014, from http://www.imdb.com.
30. Dietmar Jannach, Markus Zanker, Alexander Felfernig, and Friedrich Gerhard. 2011. Recommender Systems: An Introduction. Cambridge University Press.
31. Gawesh Jawaheer, Martin Szomszor, and Patty Kostkova. 2010a. Characterisation of explicit feedback in an online music recommendation service. In Proceedings of the 4th Conference on Recommender Systems. ACM Press, New York, NY, 317-320.
32. Gawesh Jawaheer, Martin Szomszor, and Patty Kostkova. 2010b. Comparison of implicit and explicit feedback from an online music recommendation service. In Proceedings of the 1st International Workshop on Information Heterogeneity and Fusion in Recommender Systems. ACM Press, New York, NY, 47-51.
33. Jester Dataset. 2012. Anonymous Ratings from the Jester Online Joke Recommender System. Retrieved May 26, 2014, from http://eigentaste.berkeley.edu/ jester-data/.
34. Jinmook Kim and Douglas W. Oard. 2001. User modeling for information access based on implicit feedback. In Proceedings of the Symposium of ISKO-France. 1-11.
35. Daniel Kluver, Tien T. Nguyen, Michael Ekstrand, Shilad Sen, and John Riedl. 2012. How many bits per rating? In Proceedings of the 6th Conference on Recommender Systems. ACM Press, New York, NY, 99-206.
36. Joseph A. Konstan, Bradley N. Miller, David Maltz, Jonathan L. Herlocker, Lee R. Gordon, and John Riedl. 1997. GroupLens: Applying collaborative filtering to Usenet news. Communications of the ACM 40, 3, 87. http://portal.acm.org/citation.cfm?id=245108.245126.
37. Yehuda Koren. 2010. Factor in the neighbors: Scalable and accurate collaborative filtering. ACMTransactions on Knowledge Discovery from Data 4, 1, 1-24. http://portal.acm.org/citation.cfm?doid=1644873.1644874.
38. Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8, 30-37.
39. Yehuda Koren and Joe Sill. 2011. OrdRec: An ordinal model for predicting personalized item rating distributions. In Proceedings of the 5th Conference on Recommender Systems (RecSys'11). ACM Press, New York, NY, 117-124.
40. Patty Kostkova, Gayo Diallo, and Gawesh Jawaheer. 2008. User profiling for semantic browsing in medical digital libraries. In The Semantic Web: Research and Applications. Springer, 827-831.
41. Patty Kostkova and Gemma Madle. 2009. User-centered evaluation model for medical digital libraries. In Knowledge Management for Health Care Procedures. Springer, 92-103.
42. Patty Kostkova and Gemma Madle. 2013. What impact do healthcare digital libraries have? An evaluation of national resource of infection control at the point of care using the Impact-ED framework. International Journal on Digital Libraries 13, 2, 77-90.
43. YoungOk Kwon. 2008. Improving top-N recommendation techniques using rating variance. In Proceedings of the 2008 Conference on Recommender Systems (RecSys'08). ACM Press, New York, NY, 307-310.
44. Juha Leino and Kari-Jouko Raiha. 2007. Case amazon: Ratings and reviews as part of recommendations. In Proceedings of the 2007 Conference on Recommender Systems (RecSys'07). ACM Press, New York, NY, 137-140.
45. Sarah Lichtenstein and Paul Slovic (Eds.). 2006. The Construction of Preference. Cambridge University Press.
46. Nathan N. Liu, Evan W. Xiang, Min Zhao, and Qiang Yang. 2010. Unifying explicit and implicit feedback for collaborative filtering. In Proceedings of the 19th Conference on Information and KnowledgeManagement (CIKM'10). ACM Press, New York, NY, 1445-1448.
47. Yue Lu, ChengXiang Zhai, and Neel Sundaresan. 2009. Rated aspect summarization of short comments. In Proceedings of the 18th International Conference on World Wide Web (WWW'09). ACM Press, New York, NY, 131-140.
48. Gemma Madle, Anouk Berger, Sebastien Cognat, SylvioMenna, and Patty Kostkova. 2009. User information seeking behaviour: Perceptions and reality. An evaluation of the WHO Labresources Internet portal. Informatics for Health and Social Care 34, 1, 30-38.
49. Benjamin M. Marlin and Richard S. Zemel. 2009. Collaborative prediction and ranking with non-random missing data. In Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys'09). ACM Press, New York, NY, 5-12. http://portal.acm.org/citation.cfm?doid=1639714.1639717.
50. Lorraine McGinty and Barry Smyth. 2002. Evaluating preference-based feedback in recommender systems. In Artificial Intelligence and Cognitive Science. Springer, 209-214.
51. Lorraine McGinty and Barry Smyth. 2005. Improving the Performance of Recommender Systems That Use Critiquing. Springer.
52. Omar Moling, Linas Baltrunas, and Francesco Ricci. 2012. Optimal radio channel recommendations with explicit and implicit feedback. In Proceedings of the 6th ACM Conference on Recommender Systems (RecSys'12). ACM Press, New York, NY, 75-82.
53. David M. Nichols. 1997. Implicit rating and filtering. In Proceedings of the 5th DELOSWorkshop on Filtering and Collaborative Filtering.
54. Douglas W. Oard. 1998. Implicit feedback for recommender systems. In Proceedings of the AAAI Workshop on Recommender Systems.
55. Douglas W. Oard and Jinmook Kim. 2001. Modeling information content using observable behavior. In Proceedings of the 64th Annual Conference of the American Society for Information Science and Technology.
56. Helen Oliver, Gayo Diallo, Ed De Quincey, Dimitra Alexopoulou, Bianca Habermann, Patty Kostkova, Michael Schroeder, Simon Jupp, Khaled Khelif, Robert Stevens, Gawesh Jawaheer, and Madle Gawesh. 2009. A user-centered evaluation framework for the Sealife semanticWeb browsers.BMC Bioinformatics 10, Suppl. 10, 1.
57. Michael P. O'Mahony, Neil J. Hurley, and Guenole C. M. Silvestre. 2006. Detecting noise in recommender system databases. In Proceedings of the 11th International Conference on Intelligent User Interfaces (IUI'06). ACM Press, New York, NY, 109. http://portal.acm.org/citation.cfm?doid=1111449.1111477.
58. Denis Parra and Xavier Amatriain. 2011.Walk the talk: Analyzing the relation between implicit and explicit feedback for preference elicitation. In Proceedings of the 19th International Conference on User Modeling, Adaptation, and Personalization (UMAP'11). Springer-Verlag, Berlin, Heidelberg, 255-268.
59. Denis Parra, Alexandros Karatzoglou, Xavier Amatriain, and Idil Yavuz. 2011. Implicit feedback recommendation via implicit-to-explicit ordinal logistic regression mapping. In Proceedings of CARS 2011.
60. Al-Manunur Rashid, George Karypis, and John Riedl. 2008. Learning preferences of new users in recommender systems: An information theoretic approach. ACM SIGKDD Explorations Newsletter 10, 2, 90-100. http://dl.acm.org/ citation.cfm?id=1540302.
61. Steffen Rendle, Christoph Freudenthaler, Gantner Zeno, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. AUAI Press, Arlington, VA, 452-461.
62. Francesco Ricci, Lior Rokach, Bracha Shapira, and Paul B. Kantor (Eds.). 2010. Recommender Systems Handbook. Springer. http://www.springerlink.com/index/ 10.1007/978-0-387-85820-3.
63. Judy Robertson. 2011. Stats:We're Doing It Wrong. Retrieved May 26, 2014, from http://cacm.acm.org/blogs/blog-cacm/107125-stats-were-doing-it-wrong/ fulltext.
64. Anjana Roy, Patty Kostkova, Mike Catchpole, and Ewart Carson. 2010. "Do users do what they think they do?" A comparative study of user perceived and actual information searching behaviour in the National Electronic Library of Infection. In Electronic Healthcare. Springer, 96-103.
65. Ruslan Salakhutdinov and Andriy Mnih. 2008. Probabilistic matrix factorization. In Advances in Neural Information Processing Systems. Vol. 20, 1257-1264.
66. J. Ben Schafer, Dan Frankowski, Jon Herlocker, and Shilad Sen. 2007. Collaborative filtering recommender systems. In P. Brusilovsky, A.Kobsa, andW. Nejdl (Eds.), The AdaptiveWeb. Springer, Berlin, Heidelberg, 291-324.
67. Stefan Siersdorfer, Sergiu Chelaru, Wolfgang Nejdl, and Jose San Pedro. 2010. How useful are your comments?: Analyzing and predicting YouTube comments and comment ratings. In Proceedings of the 19th International Conference on World Wide Web (WWW'10). ACM Press, New York, NY, 891-900.
68. E. Isaac Sparling and Shilad Sen. 2011. Rating: How difficult is it? In Proceedings of the 5th Conference on Recommender Systems. ACM Press, New York, NY, 149-156.
69. Martin Szomszor, Ciro Cattuto, Harith Alani, Kieron O'Hara, Andrea Baldassarri, Vittorio Loreto, and Vito D. P. Servedio. 2007. Folksonomies, the semantic Web, and movie recommendation. In Proceedings of the 4th European Semantic Web Conference, Bridging the Gap Between Semantic Web and Web 2.0.
70. Akhmed Umyarov and Alexander Tuzhilin. 2007. Leveraging aggregate ratings for better recommendations. In Proceedings of the 2007 Conference on Recommender Systems (RecSys'07). ACM Press, New York, NY, 161. http://portal.acm.org/citation.cfm?doid=1297231.1297261.
71. Akhmed Umyarov and Alexander Tuzhilin. 2008. Improving collaborative filtering recommendations using external data. In Proceedings of the 2008 8th International Conference on Data Mining. IEEE Computer Society, Washington, DC, 618-627. http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=4781157.
72. Akhmed Umyarov and Alexander Tuzhilin. 2009. Improving rating estimation in recommender systems using aggregation- And variance-based hierarchical models. In Proceedings of the 3rd Conference on Recommender Systems (RecSys'09). ACM Press, New York, NY, 37. http://portal.acm.org/citation.cfm?doid=1639714. 1639722.
73. Markus Weimer, Alexandros Karatzoglou, and Alex Smola. 2008. Improving maximum margin matrix factorization. Machine Learning 72, 3, 263-276.
74. Diyi Yang, Tianqi Chen, Weinan Zhang, Qiuxia Lu, and Yong Yu. 2012. Local implicit mining for music recommendation. In Proceedings of the 5th Conference on Recommender Systems. ACM Press, New York, NY, 91-98.
75. Markus Zanker and Markus Jessenitschnig. 2009. Case-studies on exploiting explicit customer requirements in recommender systems. User Modeling and User-Adapted Interaction 19, 1, 133-166.
76. Cai-Nicolas Ziegler. 2004. Book-Crossing Dataset. Retrieved May 26, 2014, from http://www.informatik.unifreiburg.de/cziegler/BX/.