User effort vs. Accuracy in rating-based elicitation

RecSys'12 - Proceedings of the 6th ACM Conference on Recommender Systems

Volumn , Issue , 2012, Pages 27-34

  Cremonesi, Paolo ^a   Garzotto, Franca ^a   Turrin, Roberto ^b  

^a POLITECNICO DI MILANO   (Italy)

^b Moviri   (Italy)

Author keywords

Accuracy; Elicitation; New user problem; Perceived quality; Perceived relevance; Profile length; User centric evaluation

Indexed keywords

ACCURACY; ELICITATION; PERCEIVED QUALITY; PERCEIVED RELEVANCE; PROFILE LENGTH; USER PROBLEMS; USER-CENTRIC;

ALGORITHMS; RATING; RECOMMENDER SYSTEMS;

QUALITY CONTROL;

EID: 84867379860     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2365952.2365963     Document Type: Conference Paper

References (29)

1. Bambini, R., Cremonesi, P. and Turrin, R., 2011. A Recommender System for an IPTV Service Provider: a Real Large-Scale Production Environment. Recommender Systems Handbook, F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor, Eds. Springer US, 299-331.
2. Adomavicius, G. and Tuzhilin, A., 2005. Toward the Next Generation of Recommender Systems: A Survey of the Stateof- the-Art and Possible Extensions. IEEE Trans. on Knowl. and Data Eng. 17(6) June 2005, 734-749. (Pubitemid 40860454)
3. Bellogn, A., Castells, P., and Cantador, I., 2011. Precisionoriented evaluation of recommender systems: An algorithmic comparison. In Proc. of RecSys'11. ACM, New York, NY, USA, 333-336.
4. Berkovsky, S., Eytani, Y., Kuflik, T., Ricci, F., 2007. Enhancing privacy and preserving accuracy of a distributed collaborative filtering. In Proc. of RecSys'07. ACM, New York, NY, USA, 9-16.
5. Chen, L. and Pu, P., 2009. Interaction design guidelines on critiquing-based recommender systems. User Modeling and User-Adapted Interaction 19(3) August 2009, 167-206.
6. Hu, R., and Pu, P., 2011. Enhancing collaborative filtering systems with personality information. In Proc. of RecSys'11. ACM, New York, NY, USA, 197-204.
7. Cremonesi, P., Garzotto, F., and Turrin, R., 2012. Investigating the Persuasion Potential of Recommender Systems from a Quality Perspective: an Empirical Study, ACM Transactions on Interactive Intelligent Systems, 2(2) June 2012, 1-41.
8. Cremonesi, P., Garzotto, F. Negro, S. Papadopoulos, A. Turrin, R., 2011. Looking for "good" recommendations: a comparative evaluation of recommender systems. In Proc. of Human-computer interaction (INTERACT'11). Vol. Part III. Springer-Verlag, 152-168.
9. Cremonesi, P., Garzotto, F. Negro, S. Papadopoulos, A. Turrin, R., 2011. Comparative evaluation of recommender system quality. In Proc. of annual conf. extended abstracts on Human factors in computing systems. CHI EA '11. ACM, New York, NY, USA, 1927-1932.
10. Cremonesi, P., Koren, Y. and Turrin, R., 2010. Performance of recommender algorithms on top-n recommendation tasks. In Proc.of RecSys'10. ACM, New York, NY, USA, 39-46.
11. Cremonesi, P., Lentini, E., Matteucci, M., Turrin, R., 2008. An evaluation methodology for recommender systems. In Proc. of Int. Conf. on Automated Solutions for Cross Media Content and Multi-channel Distribution, 224-231.
12. Drenner, S., Sen, S., and Terveen, L., 2008. Crafting the initial user experience to achieve community goals. In Proc. of RecSys'08. ACM, New York, NY, USA, 187-194.
13. Golbandi, N., Koren, Y., and Lempel, R., 2010. On bootstrapping recommender systems. In Proc. of the 19th ACM Int. Conf. on Information and knowledge management. ACM, New York, NY, USA, 1805-1808.
14. Haubl, G., Trifts, V., 2000. Consumer decision making in online shopping environments: the effects of interactive decision aids. Mark. Sci.19, 4-21.
15. Hu, R. and Pu., P., 2009. A comparative user study on rating vs. personality quiz based preference elicitation methods. In Proc. of Int.l Conf. on Intelligent user interfaces (IUI '09). ACM, New York, NY, USA, 367-372.
16. Jones, N., Pu, P., 2007. User technology adoption issues in recommender systems. In Proc. of Networking and Electronic Commerce Research Conf. (NAEC '07), 379-394.
17. Knijnenburg, B.P., Willemsen, M.C., Gantner, Z., Soncu, H. and Newell, C., 2012. Explaining the user experience of recommender systems, User Modeling and User-Adapted Interaction, 22(4-5) March 2012, 441-504.
18. Konstan, J.A., Riedl, J., 2012. Recommender systems: from algorithms to user experience. User Model. User-Adapt. Interact. 22, 101-123.
19. Lekakos, G., Giaglis, G. M., 2007. A hybrid approach for improving predictive accuracy of collaborative filtering algorithms. User Modeling and User-Adapted Interaction 17(1-2) March 2007, 5-40. (Pubitemid 46331776)
20. Liu, N.N., Meng, X, Liu, C., and Yang, Q., 2011. Wisdom of the better few: cold start recommendation via representative based rating elicitation. In Proc. of RecSys'11. ACM, New York, NY, USA, 37-44.
21. Lops, P., De Gemmis, M., and Semeraro, G., 2011. Contentbased recommender systems: State of the art and trends. In Recommender Systems Handbook, F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor, Eds. Springer US, 73-105.
22. McNee, S., Lam, S., Konstan, J., and Riedl, J., 2003. Interfaces for eliciting new user preferences in recommender systems. In Proc. of Int. Conf. on User Modeling, 178-188.
23. McNee, S. M., Riedl, J., and Konstan, J. A., 2006. Being accurate is not enough: how accuracy metrics have hurt recommender systems. In CHI '06 extended abstracts on Human factors in computing systems, ACM, New York, NY, USA, 1097-1101.
24. Pu, .P, Chen, L., Hu, R., 2012. Evaluating recommender systems from the user's perspective: survey of the state of the art. User Modeling and User-Adapted Interaction, 22(4), 317-355.
25. Pu P. Chen L, Hu R., 2011. A User-Centric Evaluation Framework for Recommender Systems. In Proc. of RecSys'11, ACM, New York, NY, USA, 157-164.
26. Pommeranz, A., Broekens, J., Wiggers, P., Brinkman, W.P., Jonker, C.M., 2012. Designing interfaces for explicit preference elicitation: a user-centered investigation of preference representation and elicitation process, User Modeling and User-Adapted Interaction, 22(4-5) 15 March 2012, 357-397.
27. Rashid, A.M., Albert, I., Cosley, D., Lam, S.K., McNee, S.M., Konstan, J.A., and Riedl, J., 2002. Getting to know you: learning new user preferences in recommender systems. In Proc. of Int. conf. on Intelligent user interfaces (IUI '02). ACM, New York, NY, USA, 127-134.
28. Rashid, A.M., Karypis, G., and Riedl, J., 2008. Learning preferences of new users in recommender systems: an information theoretic approach. SIGKDD Explorer Newsletter 10, 90-100.
29. Swearingen, K. and Sinha, R., 2000. Interaction design for recommender systems. Designing Interactive Systems. London, 25-28.