Investigating the persuasion potential of recommender systems from a quality perspective: An empirical study

ACM Transactions on Interactive Intelligent Systems

Volumn 2, Issue 2, 2012, Pages

  Cremonesi, Paolo ^a   Garzotto, Franca ^a   Turrin, Roberto ^b  

^a POLITECNICO DI MILANO   (Italy)

^b Moviri Srl   (Italy)

Author keywords

accuracy; conversion rate; design; empirical study; F measure; fallout; iTV; lift factor; long tail; novelty; perceived quality; persuasion; quality evaluation; recall; recommender algorithm; Recommender Systems; satisfaction

Indexed keywords

ALGORITHMS; DESIGN; FALLOUT;

ACCURACY; CONVERSION RATES; EMPIRICAL STUDIES; F-MEASURE; ITV; LONG TAIL; NOVELTY; PERCEIVED QUALITY; PERSUASION; QUALITY EVALUATION; RECALL; RECOMMENDER ALGORITHMS; SATISFACTION;

RECOMMENDER SYSTEMS;

EID: 84983573819     PISSN: 21606455     EISSN: 21606463     Source Type: Journal    
DOI: 10.1145/2209310.2209314     Document Type: Review

References (92)

1. ADOMAVICIUS, G. AND TUZHILIN, A. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Eng. 17, 6, 734-749.
2. AN, C. AND FROMM, H. 2005. Supply Chain Management On Demand: Strategies, Technologies, Applications. Springer.
3. ANDERSON, C. 2006. The Long Tail: Why the Future of Business Is Selling Less of More. Hyperion.
4. BAILLIE, R. T. 1980. Predictions from armax models. J. Econ. 12, 3, 365-374.
5. BALABANOVÍC,M. AND SHOHAM, Y. 1997. Fab: Content-based, collaborative recommendation. Comm. ACM 40, 3, 66-72.
6. BAMBINI, R., CREMONESI, P., AND TURRIN, R. 2011. A Recommender System for an IPTV Service Provider: A Real Large-Scale Production Environment. Springer, 299-331.
7. BELL, R. M. AND KOREN, Y. 2007. Scalable collaborative filtering with jointly derived neighborhood interpolation weights. In Proceedings of the 7th IEEE International Conference on Data Mining (ICDM). 43-52.
8. BELLOǴIN, A., CASTELLS, P., AND CANTADOR, I. 2011. Precision-oriented evaluation of recommender systems: An algorithmic comparison. In Proceedings of the 5th ACM Conference on Recommender Systems (RecSys). 1-44
9. BENNETT, J. AND LANNING, S. 2007. The Netflix Prize. In Proceedings of KDD Cup and Workshop. 3-6.
10. BERRY, M. W. 1992. Large-scale sparse singular value computations. Int. J. Supercomput. Appl. 6, 1, 13-49.
11. BOLLEN, D., KNIJNENBURG, B. P.,WILLEMSEN, M. C., AND GRAUS, M. 2010. Understanding choice overload in recommender systems. In Proceedings of the 4th ACM Conference on Recommender Systems (RecSys). 63-70.
12. BURKE, R. 2002. Hybrid recommender systems: Survey and experiments. User Model. User-Adapted Interact. 12, 331-370.
13. BURKE, R. 2007. The Adaptive Web. Springer-Verlag, Berlin, 377-408.
14. CELMA, O. 2010. Music Recommendation and Discovery - The Long Tail, Long Fail, and Long Play in the Digital Music Space. Springer.
15. CELMA, O. AND CANO, P. 2008. From hits to niches? Or how popular artists can bias music recommendation and discovery. In Proceedings of the 2nd KDD Workshop on Large-Scale Recommender Systems and the Netflix Prize Competition.
16. CELMA, O. AND HERRERA, P. 2008. A new approach to evaluating novel recommendations. In Proceedings of the ACM Conference on Recommender Systems (RecSys). 179-186.
17. CHEN, L. AND PU, P. 2008. A cross-cultural user evaluation of product recommender interfaces. In Proceedings of the ACM Conference on Recommender Systems. (RecSys). 75-82.
18. CHEN, L. AND PU, P. 2010. A user-centric evaluation framework of recommender systems. In Proceedings of the ACM Conference on Recommender Systems (RecSys), Workshop on User-Centric Evaluation of Recommender Systems and Their Interfaces (UCERSTI). 14-21.
19. CIALDINI, R. 2001. Influence: Science and Practice. Allyn and Bacon.
20. CRAMER, H., EVERS, V., RAMLAL, S., SOMEREN, M., RUTLEDGE, L., STASH, N., AROYO, L., AND WIELINGA, B. 2008. The effects of transparency on trust in and acceptance of a content-based art recommender. User Model. User-Adapted Interact 18, 455496.
21. CREMONESI, P., LENTINI, E., MATTEUCCI, M., AND TURRIN, R. 2008. An evaluation methodology for recommender systems. In Proceedings of the 4th International Conference on Automated Solutions for Cross Media Content and Multi-Channel Distribution (AXMEDIS). 224-231.
22. CREMONESI, P., KOREN, Y., AND TURRIN, R. 2010. Performance of recommender algorithms on top-n recommendation tasks. In Proceedings of the 4th ACM Conference on Recommender Systems (RecSys). 39-46.
23. CREMONESI, P., GARZOTTO, F., NEGRO, S., PAPADOPOULOS, A., AND TURRIN, R. 2011a. Comparative evaluation of recommender system quality. In Proceedings of the Annual Conference Extended Abstracts on Human Factors In Computing Systems (CHI EA). 1927-1932.
24. CREMONESI, P., GARZOTTO, F., NEGRO, S., PAPADOPOULOS, A., AND TURRIN, R. 2011b. Looking for good recommendations: A comparative evaluation of recommender systems. In Proceedings of the 13th IFIP TC13 International Conference on Human Computer Interaction (INTERACT). Springer.
25. DE ANGELI, A., SUTCLIFFE, A., AND HARTMANN, J. 2006. Interaction, usability and aesthetics: What influences users' preferences? In Proceedings of the 6th Conference on Designing Interactive Systems (DIS). 271-280.
26. DEERWESTER, S. C., DUMAIS, S. T., LANDAUER, T. K., FURNAS, G. W., AND HARSHMAN, R. A. 1990. Indexing by latent semantic analysis. J. Amer. Soc. Inform. Sci. 41, 6, 391-407.
27. DE GEMMIS, M., LOPS, P., AND SEMERARO, G. 2007. A content-collaborative recommender that exploits Wordnet-based user profiles for neighborhood formation. User Model. User-Adapt. Interact. 17, 217-255.
28. DESHPANDE, M. AND KARYPIS, G. 2004. Item-based top-n recommendation algorithms. ACM Trans. Inform. Syst. 22, 1, 143-177.
29. DESROSIERS, C. AND KARYPIS, G. 2011. A comprehensive survey of neighborhood-based recommendation methods. In Recommender Systems Handbook, F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor Eds., Springer, 107-144.
30. FELFERNIG, A., FRIEDRICH, G., GULA, B.,HITZ, M., KRUGGEL, T., LEITNER, G.,MELCHER, R., RIEPAN, D., STRAUSS, S., TEPPAN, E., AND VITOUCH, O. 2007. Persuasive recommendation: Serial position effects in knowledge-based recommender systems. In Proceedings of the 2nd International Conference On Persuasive Technology. (PERSUASIVE). Springer-Verlag, Berlin, 283294.
31. FELFERNIG, A., GULA, B., LEITNER, G., MAIER, M., MELCHER, R., AND TEPPAN, E. 2008. Persuasion in knowledge-based recommendation. In Proceedings of the 3rd International Conference on Persuasive Technology (PERSUASIVE). Springer-Verlag, Berlin, 71-82.
32. FLEDER, D. AND HOSANAGAR, K. 2009. Blockbuster culture's next rise or fall: The impact of recommender systems on sales diversity. Manage. Sci. 55, 697-712.
33. FOGG, B. 2003. Persuasive Technology: Using Computers to Change What We Think and Do. Series in Interactive Technologies. Morgan Kaufmann Publishers.
34. GOLBANDI, N., KOREN, Y., AND LEMPEL, R. 2010. On bootstrapping recommender systems. In Proceedings of the 19th ACM International Conference on Information and Knowledge Management (CIKM). 1805-1808.
35. GOLBANDI, N., KOREN, Y., AND LEMPEL, R. 2011. Adaptive bootstrapping of recommender systems using decision trees. In Proceedings of the 4th ACM International Conference on Web Search and Data Mining (WSDM). 595-604.
36. GRETZEL, U. AND FESENMAIER, D. 2005. Persuasiveness of preference elicitation processes in destination recommendation systems. In Information and Communication Technologies in Tourism 2005, A. J. Frew Ed., Springer, 194-204.
37. GRETZEL, U. AND FESENMAIER, D. 2006. Persuasion in recommender systems. Int. J. Electron. Commerce 11, 81-100.
38. HAND, S. AND VARAN, D. 2008. Interactive narratives: Exploring the links between empathy, interactivity and structure. In Proceedings of the 6th European Conference on Changing Television Environments (EUROITV).
39. HARTMANN, J., DE ANGELI, A., AND SUTCLIFFE, A. 2008. Framing the user experience: information biases on website quality judgement. In Proceedings of the 26th Annual SIGCHI Conference on Human Factors in Computing Systems. (CHI). 855-864.
40. HERLOCKER, J., KONSTAN, J., TERVEEN, L., AND RIEDL, J. 2004. Evaluating collaborative filtering recommender systems. ACM Trans. Inform. Syst. 22, 1, 5-53.
41. HU, R. AND PU, P. 2009. Acceptance issues of personality-based recommender systems. In Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys). 221-224.
42. HUSBANDS, P., SIMON, H., AND DING, C. 2000. On the Use of the Singular Value Decomposition for Text Retrieval. SIAM, Philadelphia, PA, 145-156.
43. JENSEN, J. 2008. Interactive television - a brief media history. In Proceedings of the 6th European Conference on Changing Television Environments (EUROITV). 1-10.
44. JONES, N. AND PU, P. 2007. User technology adoption issues in recommender systems. In Proceedings of the Networking and Electronic Conference (NAEC). 379-394.
45. KELLY, D. AND TEEVAN, J. 2003. Implicit feedback for inferring user preference: A bibliography. SIGIR Forum 37, 2, 18-28.
46. KOREN, Y. 2008. Factorization meets the neighborhood: A multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD). 426-434.
47. KOREN, Y. 2009. Collaborative filtering with temporal dynamics. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD). 447-456.
48. KOREN, Y. 2010. Factor in the neighbors: Scalable and accurate collaborative filtering. ACM Trans. Knowl. Discov. Data 4, 1, 1-24.
49. KRAMER, T. 2007. The effect of measurement task transparency on preference construction and evaluations of personalized recommendations. J. Market. Res. 44, 2, 224-233.
50. LEKAKOS, G. AND GIAGLIS, G. M. 2007. A hybrid approach for improving predictive accuracy of collaborative filtering algorithms. User Model. User-Adapted Interact. 17, 5-40.
51. LEWIS, D. D. AND GALE, W. A. 1994. A sequential algorithm for training text classifiers. In Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 3-12.
52. LOPS, P.,DE GEMMIS, M., AND SEMERARO, G. 2011. Content-based recommender systems: State of the art and trends. In Recommender Systems Handbook, F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor Eds., Springer, 73-105.
53. MAGNINI, B. AND STRAPPARAVA, C. 2001. Improving user modelling with content-based techniques. In Proceedings of the 8th International Conference on User Modeling (UM). 74-83.
54. MCNEE, S., LAM, S., KONSTAN, J., AND RIEDL, J. 2003. Interfaces for eliciting new user preferences in recommender systems. In Proceedings of the 9th International Conference on User Modeling (UM). 178-188.
55. MCNEE, S. M., RIEDL, J., AND KONSTAN, J. A. 2006. Being accurate is not enough: How accuracy metrics have hurt recommender systems. In Proceedings of the Annual Conference Extended Abstracts On Human Factors In Computing Systems. (CHI EA). 1097-1101.
56. MIDDLETON, S. E., SHADBOLT, N. R., AND DE ROURE, D. C. 2004. Ontological user profiling in recommender systems. ACM Trans. Inform. Syst. 22, 54-88.
57. MIHALCEA, R. AND CSOMAI, A. 2007. Wikify!: Linking documents to encyclopedic knowledge. In Proceedings of the 16th ACM Conference on Conference on Information and Knowledge Management (CIKM). 233-242.
58. MILLER, G. A., BECKWITH, R., FELLBAUM, C., GROSS, D., AND MILLER, K. 1990. Wordnet: An on-line lexical database. Int. J. Lexicog. 3, 235-244.
59. MURAKAMI, T., MORI, K., AND ORIHARA, R. 2008. Metrics for evaluating the serendipity of recommendation lists. In Proceedings of the Conference on New Frontiers in Artificial Intelligence (JSAI). 40-46.
60. NANOU, T., LEKAKOS, G., AND FOUSKAS, K. G. 2010. The effects of recommendations' presentation on persuasion and satisfaction in a movie recommender system. Multimedia Syst. 16, 4-5, 219-230.
61. NISBETT, R. E. AND WILSON, T. D. 1977. The halo effect: Evidence for unconscious alteration of judgments. J. Personal. Social Psychol. 35, 250-256.
62. PATEREK, A. 2007. Improving regularized singular value decomposition for collaborative filtering. In Proceedings of the KDD Cup and Workshop.
63. PAZZANI, M. AND BILLSUS, D. 2006. Content-based recommendation systems. In The Adaptive Web: Methods and Strategies of Web Personalization. Lecture Notes in Computer Science, 325-341.
64. PU, P. AND CHEN, L. 2006. Trust building with explanation interfaces. In Proceedings of the 11th International Conference on Intelligent User Interfaces (IUI). 93-100.
65. PU, P., CHEN, L., AND KUMAR, P. 2008. Evaluating product search and recommender systems for e-commerce environments. J. Electron. Commerce Res. 8, 1-27.
66. PU, P., ZHOU, M., AND CASTAGNOS, S. 2009. Critiquing recommenders for public taste products. In Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys). 249-252.
67. RAFEY, R. A., GIBBS, S., HOCH, M., GONG, H. L. V., AND WANG, S. 2001. Enabling custom enhancements in digital sports broadcasts. In Proceedings of WEB3D'01, 101-107.
68. RAGHAVAN, V., BOLLMANN, P., AND JUNG, G. S. 1989. A critical investigation of recall and precision as measures of retrieval system performance. ACM Trans. Inform. Syst. 7, 3, 205-229.
69. RASHID, A. M., KARYPIS, G., AND RIEDL, J. 2008. Learning preferences of new users in recommender systems: An information theoretic approach. SIGKDD Explorer Newslett. 10, 90-100.
70. RICCI, F., ROKACH, L., SHAPIRA, B., AND KANTOR, P. B., Eds. 2011. Recommender Systems Handbook. Springer.
71. SALTON, G., Ed. 1988. Automatic Text Processing. Addison-Wesley Longman Publishing Co., Inc., Boston, MA.
72. SARWAR, B., KARYPIS, G., KONSTAN, J., AND RIEDL, J. 2000. Application of dimensionality reduction in recommender system-a case study. In Proceedings of ACM WebKDD Web Mining for ECommerce Workshop. 285-295.
73. SARWAR, B., KARYPIS, G., KONSTAN, J., AND REIDL, J. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web (WWW). 285-295.
74. SCHAFER, J. B., FRANKOWSKI, D.,HERLOCKER, J., AND SEN, S. 2007. The Adaptive Web. Springer-Verlag, Berlin, 291-324.
75. SCHEIN, A., POPESCUL, A., UNGAR, L., AND PENNOCK, D. 2002. Methods and metrics for cold-start recommendations. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2002). 253-260.
76. SHANI, G. AND GUNAWARDANA, A. 2011. Evaluating recommendation systems. In Recommender Systems Handbook, F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor Eds., Springer, 257-297.
77. SHEARER, A. W. 2001. User response to two algorithms as a test of collaborative filtering. In Extended Abstracts on Human Factors In Computing Systems (CHI EA). 451-452.
78. SUN, J. AND GAO, S. 2007. IPTV based on IP network and streaming media service station. SPIE MIPPR 2007: Remote Sensing and GIS Data Processing and Applications and Innovative Multispectral Technology and Applications 6790, 1, 67904Q.
79. SWEARINGEN, K. AND SINHA, R. 2001. Beyond algorithms: An HCI perspective on recommender systems. In Proceedings of ACM SIGIR Workshop on Recommender Systems.
80. SWEARINGEN, K. AND SINHA, R. 2002. Interaction design for recommender systems. In Designing Interactive Systems. ACM.
81. TAK ́ACS, G., PIL ́ASZY, I., ŃeMETH, B., AND TIKK, D. 2009. Scalable collaborative filtering approaches for large recommender systems. J. Mach. Learn. Res. 10, 623-656.
82. TINTAREV, N. 2007. Explanations of recommendations. In Proceedings of the ACM Conference on Recommender Systems (RecSys). 203-206.
83. TINTAREV, N. AND MASTHOFF, J. 2011. Designing and evaluating explanations for recommender systems. In Recommender Systems Handbook, F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor Eds., Springer, 479-510.
84. VAN RIJSBERGEN, C. J. 1979. Information Retrieval 2nd Ed. Department of Computer Science, University of Glasgow.
85. WENG, L.-T.,XU, Y., LI, Y., AND NAYAK, R. 2007. Improving recommendation novelty based on topic taxonomy. In Proceedings of the IEEE/WIC/ACMInternational Conferences onWeb Intelligence and Intelligent Agent Technology -Workshops (WI-IATW). 115-118.
86. XIAO, B. AND BENBASAT, I. 2007. E-commerce product recommendation agents: Use, characteristics, and impact. Manage. Inform. Syst. Quarterly 31, 137-209.
87. YOO, K. H. AND GRETZEL, U. 2011. Creating more credible and persuasive recommender systems: The influence of source characteristics on recommender system evaluations. In Recommender Systems Handbook, F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor Eds., Springer, 455-477.
88. ZHANG, H., ZHENG, S., AND YUAN, J. 2005. A personalized TV guide system compliant with MHP. IEEE Trans. Consum. Electron. 51, 2, 731-737.
89. ZHANG, M. 2009. Enhancing diversity in top-n recommendation. In Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys). 397-400.
90. ZHANG, M. AND HURLY, N. 2009. Evaluating the diversity of top-n recommendations. In Proceedings of the 21st IEEE International Conference on Tools with Artificial Intelligence (ICTAI). 457-460.
91. ZHANG, Y., CALLAN, J., AND MINKA, T. 2002. Novelty and redundancy detection in adaptive filtering. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 81-88.
92. ZIEGLER, C.-N., MCNEE, S. M., KONSTAN, J. A., AND LAUSEN, G. 2005. Improving recommendation lists through topic diversification. In Proceedings of the 14th International Conference on World Wide Web. (WWW). 22-32.