Presto: Distributed machine learning and graph processing with sparse matrices

Proceedings of the 8th ACM European Conference on Computer Systems, EuroSys 2013

Volumn , Issue , 2013, Pages 197-210

  Venkataraman, Shivaram ^a   Bodzsar, Erik ^b   Roy, Indrajit ^c   Auyoung, Alvin ^c   Schreiber, Robert S ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

^c NONE

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION INTERFACE; COMPLEX ALGORITHMS; DISTRIBUTED MACHINE LEARNING; DISTRIBUTED SYSTEMS; GRAPH ALGORITHMS; GRAPH PROCESSING; MATRIX COMPUTATION; SINGLE-THREADED;

ALGORITHMS; MATRIX ALGEBRA;

LEARNING SYSTEMS;

EID: 84877713877     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2465351.2465371     Document Type: Conference Paper

References (37)

1. Apache mahout. http://mahout.apache.org.
2. Netflix prize. http://www.netflixprize.com/.
3. The R project for statistical computing. http://www.rproject.org.
4. Stanford network analysis package. http://snap.stanford.edu/snap.
5. G. Ananthanarayanan, S. Kandula, A. Greenberg, I. Stoica, Y. Lu, B. Saha, and E. Harris. Reining in the outliers in mapreduce clusters using Mantri. In In OSDI'10, Vancouver, BC, Canada, 2010.
6. R. D. Blumofe and C. E. Leiserson. Scheduling multithreaded computations by work stealing. In SFCS '94, pages 356-368, Washington, DC, USA, 1994.
7. U. Brandes. A faster algorithm for betweenness centrality. Journal of Mathematical Sociology, 25:163-177, 2001. (Pubitemid 33398479)
8. S. Brin and L. Page. The anatomy of a large-scale hypertextual Web search engine. In WWW7, pages 107-117, 1998.
9. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst. HaLoop: Efficient iterative data processing on large clusters. Proc. VLDB Endow., 3:285-296, September 2010.
10. P. Charles, C. Grothoff, V. Saraswat, C. Donawa, A. Kielstra, K. Ebcioglu, C. von Praun, and V. Sarkar. X10: An object-oriented approach to non-uniform cluster computing. In OOPSLA'05, pages 519-538, 2005.
11. S. Das, Y. Sismanis, K. S. Beyer, R. Gemulla, P. J. Haas, and J. McPherson. Ricardo: Integrating R and Hadoop. In SIGMOD Conference'10, pages 987-998, 2010.
12. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. Commun. ACM, 51(1), 2008.
13. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, and G. Fox. Twister: A runtime for iterative MapReduce. In HPDC '10, pages 810-818, 2010.
14. J. E. Gonzalez, Y. Low, H. Gu, D. Bickson, and C. Guestrin. PowerGraph: Distributed Graph-Parallel Computation on Natural Graphs. In OSDI'12, Hollywood, CA, October 2012.
15. V. Hernandez, J. E. Roman, and V. Vidal. Slepc: A scalable and flexible toolkit for the solution of eigenvalue problems. ACM Trans. Math. Softw., 31(3):351-362, Sept. 2005.
16. P. Hintjens. ZeroMQ: The Guide, 2010.
17. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: Distributed data-parallel programs from sequential building blocks. In EuroSys '07, pages 59-72, 2007. (Pubitemid 47281575)
18. U. Kang, B. Meeder, and C. Faloutsos. Spectral Analysis for Billion-Scale Graphs: Discoveries and Implementation. In PAKDD (2), pages 13-25, 2011.
19. J. Kepner and J. Gilbert. Graph Algorithms in the Language of Linear Algebra. Fundamentals of Algorithms. SIAM, 2011.
20. M. Kulkarni, K. Pingali, B. Walter, G. Ramanarayanan, K. Bala, and L. P. Chew. Optimistic parallelism requires abstractions. In PLDI '07, pages 211-222.
21. R. B. Lehoucq, D. C. Sorensen, and C. Yang. ARPACK users' guide - solution of large-scale eigenvalue problems with implicitly restarted Arnoldi methods. Software, environments, tools. SIAM, 1998.
22. D. Loveman. High performance Fortran. IEEE Parallel & Distributed Technology: Systems & Applications, 1(1):25-42, 1993.
23. Y. Low, J. Gonzalez, A. Kyrola, D. Bickson, C. Guestrin, and J. M. Hellerstein. GraphLab: A New Framework for Parallel Machine Learning. CoRR, pages 1-1, 2010.
24. G. Malewicz, M. H. Austern, A. J. Bik, J. C. Dehnert, I. Horn, N. Leiser, and G. Czajkowski. Pregel: A system for large-scale graph processing. In SIGMOD '10, pages 135-146, 2010.
25. Q. E. McCallum and S. Weston. Parallel R. O'Reilly Media, Oct. 2011.
26. D. G. Murray and S. Hand. CIEL: A universal execution engine for distributed data-flow computing. In NSDI '11, Boston, MA, USA, 2011.
27. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig latin: A not-so-foreign language for data processing. In SIGMOD'08, pages 1099-1110, 2008.
28. R. Power and J. Li. Piccolo: Building fast, distributed programs with partitioned tables. In OSDI '10, Vancouver, BC, Canada, 2010. USENIX Association.
29. Z. Qian, X. Chen, N. Kang, M. Chen, Y. Yu, T. Moscibroda, and Z. Zhang. MadLINQ: large-scale distributed matrix computation for the cloud. In EuroSys '12, pages 197-210, 2012.
30. S. Seo, E. J. Yoon, J. Kim, S. Jin, J.-S. Kim, and S. Maeng. Hama: An efficient matrix computation with the mapreduce framework. In In CLOUDCOM'10, pages 721-726.
31. G. L. Steele, Jr. Parallel programming and code selection in fortress. In PPoPP '06, pages 1-1, 2006.
32. G. Strang. Introduction to Linear Algebra, Third Edition. Wellesley Cambridge Pr, Mar. 2003.
33. C. E. Tsourakakis. Fast counting of triangles in large real networks without counting: Algorithms and laws. In ICDM'08, pages 608-617. IEEE, 2008.
34. L. G. Valiant. A bridging model for parallel computation. Commun. ACM, 33:103-111, August 1990.
35. Y. Yu, M. Isard, D. Fetterly, M. Budiu, U. Erlingsson, P. K. Gunda, and J. Currey. DryadLINQ: A system for general-purpose distributed data-parallel computing using a high-level language. In OSDI '08, pages 1-14, 2008.
36. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M. J. Franklin, S. Shenker, and I. Stoica. Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing. In NSDI'12, San Jose, CA, 2012.
37. Y. Zhou, D.Wilkinson, R. Schreiber, and R. Pan. Large-Scale Parallel Collaborative Filtering for the Netflix Prize. In AAIM'08, pages 337-348, Shanghai, China, 2008.