Scaling-up item-based collaborative filtering recommendation algorithm based on Hadoop

Proceedings - 2011 IEEE World Congress on Services, SERVICES 2011

Volumn , Issue , 2011, Pages 490-497

  Jiang, Jing ^a   Lu, Jie ^a   Zhang, Guangquan ^a   Long, Guodong ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Cloud computing; Collaborative filtering; Hadoop; Mapreduce; Parallelization; Scalability

Indexed keywords

COLLABORATIVE FILTERING; COLLABORATIVE FILTERING ALGORITHMS; COMMUNICATION COST; DATA LOCALITY; HADOOP; HIGH QUALITY; ITEM-BASED CF; MAP-REDUCE; PARALLEL COMPUTATION; PARALLELIZATIONS; RECOMMENDATION ALGORITHMS; SCALING-UP;

CLOUD COMPUTING; SCALABILITY;

CLUSTERING ALGORITHMS;

EID: 80053404328     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SERVICES.2011.66     Document Type: Conference Paper

References (25)

1. J. Dean and S. Ghemawat, "Mapreduce:Simplified data processing on large clusters," Procedings of OSDI 2004: Sixth Sixth Symposium on Operating System Design and Implementation, 2004.
2. S. Ibrahim, H. Jin, L. Lu, L. Qi, S. Wu, and X. H. Shi, "Evaluating MapReduce on Virtual Machines: The Hadoop Case," in Cloud Computing, Proceedings, 2009, pp. 519-528.
3. J. Ekanayake, S. Pallickara, and G. Fox, "MapReduce for Data Intensive Scientific Analyses," in eScience '08. IEEE Fourth International Conference on, 2008, pp. 277-284.
4. M. Bhandarkar, "MapReduce programming with apache Hadoop," in Parallel & Distributed Processing (IPDPS), 2010 IEEE International Symposium on, 2010, pp. 1-1.
5. Hadoop. Available: http://hadoop.apache.org/core/.
6. J. Leverich and C. Kozyrakis, "On the energy (in)efficiency of Hadoop clusters," SIGOPS Oper. Syst. Rev., vol. 44, pp. 61-65, 2010.
7. T. White, Hadoop: The Definitive Guide: O'Reilly Media, Inc., 2009.
8. Z. D. Zhao and M. S. Shang, "User-Based Collaborative-Filtering Recommendation Algorithms on Hadoop," in International Workshop on Knowledge Discovery and Data Mining, 2010, pp. 478-481.
9. T. HengSong and Y. HongWu, "A Collaborative Filtering Recommendation Algorithm Based on Item Classification," in Circuits, Communications and Systems. PACCS '09. Pacific-Asia Conference on, 2009, pp. 694-697.
10. G. Song-Jie, Y. HongWu, and T. HengSong, "Combining Memory-Based and Model-Based Collaborative Filtering in Recommender System," in Circuits, Communications and Systems. PACCS '09. Pacific-Asia Conference on, 2009, pp. 690-693.
11. S. Xiaoyuan, T. M. Khoshgoftaar, and R. Greiner, "Imputed Neighborhood Based Collaborative Filtering," in Web Intelligence and Intelligent Agent Technology, 2008. WI-IAT '08. IEEE/WIC/ACM International Conference on, 2008, pp. 633-639.
12. S. Ping and Y. HongWu, "An Item Based Collaborative Filtering Recommendation Algorithm Using Rough Set Prediction," in Artificial Intelligence, 2009. JCAI '09. International Joint Conference on, 2009, pp. 308-311.
13. G. SongJie, "Joining Case-Based Reasoning and Item-Based Collaborative Filtering in Recommender Systems," in Electronic Commerce and Security, 2009. ISECS '09. Second International Symposium on, 2009, pp. 40-42.
14. W. Pu and Y. HongWu, "A Personalized Recommendation Algorithm Combining Slope One Scheme and User Based Collaborative Filtering," in Industrial and Information Systems, 2009. IIS '09. International Conference on, 2009, pp. 152-154.
15. R. M. Bell and Y. Koren, "Scalable Collaborative Filtering with Jointly Derived Neighborhood Interpolation Weights," in Data Mining, 2007. ICDM 2007. Seventh IEEE International Conference on, 2007, pp. 43-52.
16. C. F. Lai, J. H. Chang, C. C. Hu, Y. M. Huang, and H. C. Chao, "CPRS: A Cloud-Based Program Recommendation System for Digital TV Platforms," Advances in Grid and Pervasive Computing, Proceedings, vol. 6104, pp. 331-340, 2010.
17. Badrul Sarwar, George Karypis, Joseph Konstan, and John Reidl, "Item-based collaborative filtering recommendation algorithms," in Proceedings of the 10th international conference on World Wide Web, Hong Kong, Hong Kong, 2001, pp. 285-295.
18. J. Dean and S. Ghemawat, "MapReduce: simplified data processing on large clusters," Commun. ACM, vol. 51, pp. 107- 113, 2008.
19. C.-T. e. a. Chu, "Mapreduce for Machine Learing on Multicore," NIPS 2006, 2006.
20. W. Z. Zhao, H. F. Ma, and Q. He, "Parallel K-Means Clustering Based on MapReduce," Cloud Computing, Proceedings, vol. 5931, pp. 674-679, 2009.
21. B. N. Miller, I. Albert, S. K. Lam, J. A. Konstan, and J. Riedl, "MovieLens unplugged: experiences with an occasionally connected recommender system," presented at the Proceedings of the 8th international conference on Intelligent user interfaces, Miami, Florida, USA, 2003.
22. U. Ramachandran, Venkateswaran H., Sivasubramaniam Anand, and S. Aman, "Issues in understanding the scalability of parallel systems," in In Proceedings of the First Inernational Workshop on Parallel Processing, Bangalore, India, 1994, pp. 399-404.
23. X. Zhang, Yan Yong, and Ma Qian, "Measuring and analyzing parallel computing scalability," in International conference on parallel processing, 1994, pp. 295-303.
24. G. Amdahl, "Validity of the sigle-processor approach to achieving large scale computing capabilities," in Proc. AFIPS Conf., 1967, pp. 483-485.
25. V. Kumar and V. Singh, "Scalability of parallel algorithms for the all-pairs shortest path problem: A summary of results," in Proc. of Conf. on Parallel Processing, Chicago, IL, 1990, pp. 136-140.