A fast parallel SGD for matrix factorization in shared memory systems

RecSys 2013 - Proceedings of the 7th ACM Conference on Recommender Systems

Volumn , Issue , 2013, Pages 249-256

  Zhuang, Yong ^a   Chin, Wei Sheng ^a   Juan, Yu Chin ^a   Lin, Chih Jen ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Matrix factorization; Parallel computing; Recommender system; Shared memory algorithm; Stochastic gradient descent

Indexed keywords

LOAD BALANCE; MATRIX FACTORIZATIONS; SEQUENTIAL APPROACH; SHARED MEMORY ALGORITHMS; SHARED MEMORY SYSTEM; STOCHASTIC GRADIENT DESCENT;

ALGORITHMS; PARALLEL ARCHITECTURES; PARALLEL PROCESSING SYSTEMS; TIME VARYING NETWORKS;

RECOMMENDER SYSTEMS;

EID: 84887588556     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2507157.2507164     Document Type: Conference Paper

References (15)

1. R. M. Bell and Y. Koren. Lessons from the Netix prize challenge. ACM SIGKDD Explorations Newsletter, 9(2):75-79, 2007.
2. K.-W. Chang, C.-J. Hsieh, and C.-J. Lin. Coordinate descent method for large-scale L2-loss linear SVM. Journal of Machine Learning Research, 9:1369-1398, 2008.
3. G. Dror, N. Koenigstein, Y. Koren, and M. Weimer. The Yahoo! music dataset and KDD-Cup 11. In JMLR Workshop and Conference Proceedings: Proceedings of KDD Cup 2011, volume 18, pages 3-18, 2012.
4. R. Gemulla, E. Nijkamp, P. J. Haas, and Y. Sismanis. Large-scale matrix factorization with distributed stochastic gradient descent. In Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining, KDD '11, pages 69-77, New York, NY, USA, 2011. ACM.
5. K. B. Hall, S. Gilpin, and G. Mann. MapReduce/Bigtable for distributed optimization. In Neural Information Processing Systems Workshop on Leaning on Cores, Clusters, and Clouds, 2010.
6. J. Kiefer and J. Wolfowitz. Stochastic estimation of the maximum of a regression function. The Annals of Mathematical Statistics, 23(3):462-466, 1952.
7. Y. Koren, R. M. Bell, and C. Volinsky. Matrix factorization techniques for recommender systems. Computer, 42(8):30-37, 2009.
8. G. Mann, R. McDonald, M. Mohri, N. Silberman, and D. Walker. Efficient large-scale distributed training of conditional maximum entropy models. In Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta, editors, Advances in Neural Information Processing Systems 22, pages 1231-1239. 2009.
9. R. McDonald, K. Hall, and G. Mann. Distributed training strategies for the structured perceptron. In Proceedings of the 48th Annual Meeting of the Association of Computational Linguistics (ACL), pages 456-464, 2010.
10. F. Niu, B. Recht, C. Ré, and S. J. Wright. HOGWILD!: A lock-free approach to parallelizing stochastic gradient descent. In J. Shawe-Taylor, R. Zemel, P. Bartlett, F. Pereira, and K. Weinberger, editors, Advances in Neural Information Processing Systems 24, pages 693-701, 2011.
11. I. Pilászy, D. Zibriczky, and D. Tikk. Fast ALS-based matrix factorization for explicit and implicit feedback datasets. In Proceedings of the Fourth ACM Conference on Recommender Systems, pages 71-78, 2010.
12. H. Robbins and S. Monro. A stochastic approximation method. The Annals of Mathematical Statistics, 22(3):400-407, 1951.
13. H.-F. Yu, C.-J. Hsieh, S. Si, and I. S. Dhillon. Scalable coordinate descent approaches to parallel matrix factorization for recommender systems. In Proceedings of the IEEE International Conference on Data Mining, pages 765-774, 2012.
14. Y. Zhou, D. Wilkinson, R. Schreiber, and R. Pan. Large-scale parallel collaborative filtering for the Netix prize. In Proceedings of the Fourth International Conference on Algorithmic Aspects in Information and Management, pages 337-348, 2008.
15. M. Zinkevich, M. Weimer, A. Smola, and L. Li. Parallelized stochastic gradient descent. In J. Lafferty, C. K. I. Williams, J. Shawe-Taylor, R. Zemel, and A. Culotta, editors, Advances in Neural Information Processing Systems 23, pages 2595-2603. 2010.