Crunching large graphs with commodity processors

3rd USENIX Workshop on Hot Topics in Parallelism, HotPar 2011

Volumn , Issue , 2011, Pages

  Nelson, Jacob ^a   Myers, Brandon ^a   Hunter, A H ^a   Briggs, Preston ^a   Ceze, Luis ^a   Ebeling, Carl ^a   Grossman, Dan ^a   Kahan, Simon ^b   Oskin, Mark ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

^b PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

GRAPH ALGORITHMS;

BIT SYNCHRONIZATION; COMMODITY PROCESSORS; EMERGING APPLICATIONS; GRAPH ANALYTICS; HARDWARE MULTITHREADING; LATENCY TOLERANCE; PERFORMANCE ANALYSIS; PERFORMANCE CHALLENGES;

MULTITASKING;

EID: 84874175020     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. Anant Agarwal, Ricardo Bianchini, David Chaiken, Kirk L. Johnson, David Kranz, John Kubiatowicz, Beng-Hong Lim, Ken Mackenzie, and Donald Yeung. The MIT Alewife machine: architecture and performance. In 22nd Annual International Symposium on Computer Architecture, 1995.
2. George Almási, Čalin Caşcaval, José G. Castaños, Monty Denneau, Derek Lieber, José E. Moreira, and Henry S. Warren, Jr. Dissecting Cyclops: a detailed analysis of a multithreaded architecture. SIGARCH Computer Architecture News, 31:26-38, March 2003.
3. Robert Alverson, David Callahan, Daniel Cummings, Brian Koblenz, Allan Porterfield, and Burton Smith. The Tera computer system. In Proceedings of the 4th International Conference on Supercomputing, ICS '90, pages 1-6, New York, NY, USA, 1990. ACM.
4. David A. Bader and Kamesh Madduri. Designing multithreaded algorithms for breadth-first search and st-connectivity on the Cray MTA-2. In International Conference on Parallel Procesing, aug. 2006.
5. Rob Von Behren, Jeremy Condit, Feng Zhou, George C. Necula, and Eric Brewer. Capriccio: Scalable threads for internet services. In In Proceedings of the 19th ACM Symposium on Operating Systems Principles, pages 268-281. ACM Press, 2003.
6. Matthias Bröcheler, Andrea Pugliese, and V.S. Subrahmanian. COSI: Cloud oriented subgraph identification in massive social networks. In 2010 International Conference on Advances in Social Networks Analysis and Mining, aug. 2010.
7. Bradford L. Chamberlain, David Callahan, and Hans P. Zima. Parallel programmability and the Chapel language. International Journal of High Performance Computing Applcations, 21:291-312, August 2007.
8. Philippe Charles, Christian Grothoff, Vijay Saraswat, Christopher Donawa, Allan Kielstra, Kemal Ebcioglu, Christoph von Praun, and Vivek Sarkar. X10: an object-oriented approach to non-uniform cluster computing. In Proceedings of the 20th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications, OOPSLA '05, pages 519-538, New York, NY, USA, 2005. ACM.
9. Frank Dehne, Alfonso Ferreira, Edson Cáceres, Siang W. Song, and Alessandro Roncato. Efficient parallel graph algorithms for coarsegrained multicomputers and BSP. Algorithmica, 33:183-200, 2002. 10.1007/s00453-001-0109-4.
10. David Ediger, Karl Jiang, Jason Riedy, and David A. Bader. Massive streaming data analytics: A case study with clustering coefficients. In 2010 IEEE International Symposium on Parallel Distributed Processing, april 2010.
11. Tarek El-Ghazawi, William Carlson, Thomas Sterling, and Katherine Yelick. UPC: Distributed Shared Memory Programming. John Wiley and Sons, Inc., Hoboken, NJ, USA, 2005.
12. Kayvon Fatahalian and Mike Houston. A closer look at GPUs. Communications of the ACM, 51:50-57, October 2008.
13. John Feo, David Harper, Simon Kahan, and Petr Konecny. ELDORADO. In Proceedings of the 2nd Conference on Computing Frontiers, CF '05, pages 28-34, New York, NY, USA, 2005. ACM.
14. Douglas Gregor and Andrew Lumsdaine. The parallel BGL: A generic library for distributed graph computations. In In Parallel Object-Oriented Scientific Computing (POOSC, 2005.
15. Timothy D. R. Hartley, Umit Catalyurek, Füsun Özgüner, Andy Yoo, Scott Kohn, and Keith Henderson. MSSG: A framework for massivescale semantic graphs. In 2006 IEEE International Conference on Cluster Computing, sept. 2006.
16. Intel. An introduction to the Intel Quick Path Interconnect, January 2009. http://www.intel.com/technology.
17. Cliff Joslyn, Bob Adolf, Sinan al Saffar, Jon Feo, Eric Goodman, David Haglin, Greg Mackey, and David Mizell. High performance semantic factoring of giga-scale semantic graph databases. In Semantic Web Challenge, 2010.
18. U Kang, Charalampos E. Tsourakakis, and Christos Faloutsos. PEGASUS: A peta-scale graph mining system implementation and observations. In Ninth IEEE International Conference on Data Mining, December 2009.
19. Tamara Kolda, David Brown, James Corones, Terence Critchlow, Tina Eliassi-Rad, Lise Getoor, Bruce Hendrickson, Vipin Kumar, Diane Lambert, Celeste Matarazzo, Kevin McCurley, Michael Merrill, Nagiza Samatova, Douglas Speck, Ramakrishnan Srikant, Jim Thomas, Michael Wertheimer, and Pak Chung Wong. Data sciences technology for homeland security information management and knowledge discovery. Technical Report UCRL-TR-208926, Lawrence Livermore National Laboratory, 2004.
20. Matthew J. Koop, Wei Huang, Karthik Gopalakrishnan, and Dhabaleswar K. Panda. Performance analysis and evaluation of PCIe 2.0 and quad-data rate Infiniband. Symposium on High-Performance Interconnects, 0:85-92, 2008.
21. Kevin J. Lang. Fixing two weaknesses of the spectral method. In Advances in Neural Information Processing Systems, pages 715-722, 2005.
22. Jure Leskovec, Kevin J. Lang, Anirban Dasgupta, and Michael W. Mahoney. Community structure in large networks: Natural cluster sizes and the absence of large well-defined clusters. Internet Mathematics, 6, 2009.
23. David Levinthal. Performance analysis guide for Intel Core i7 processor and Intel Xeon 5500 processors. Technical report, 2009. http://software.intel.com/sites.
24. Grzegorz Malewicz, Matthew H. Austern, Aart J.C Bik, James C. Dehnert, Ilan Horn, Naty Leiser, and Grzegorz Czajkowski. Pregel: a system for large-scale graph processing. In Proceedings of the 2010 International Conference on Management of Data, SIGMOD '10, pages 135-146, New York, NY, USA, 2010. ACM.
25. Anirban Mandal, Rob Fowler, and Allan Porterfield. Modeling memory concurrency for multi-socket multi-core systems. Performance Analysis of Systems Software (ISPASS), March 2010.
26. Brian D. Marsh, Michael L. Scott, Thomas J. LeBlanc, and Evangelos P. Markatos. First-class user-level threads. In Proceedings of the Thirteenth ACM Symposium on Operating Systems Principles, SOSP '91, pages 110-121, New York, NY, USA, 1991. ACM.
27. Jace Mogill. Extended memory sematics on hybrid FPGA-x86 architectures. Unpublished.
28. Todd C. Mowry and Sherwyn R. Ramkissoon. Software-controlled multithreading using informing memory operations. In Sixth International Symposium on High-Performance Computer Architecture, 2000.
29. Allan Porterfield, Nassib Nassar, and Rob Fowler. Multi-threaded library for many-core systems. In IEEE International Symposium on Parallel Distributed Processing, May 2009.
30. Mellanox Technologies. Mellanox Infiniband delivers world record message rate performance for high-performance applications, June 2010. Press Release.
31. Mellanox Technologies. Infiniband switch systems, 2011. http://www.mellanox.com.
32. Michael E. Thomadakis. The architecture of the Nehalem processor and Nehalem-EP smp platforms. Technical report, December 2010. http://sc.tamu.edu/systems/eos/nehalem.pdf.
33. Dean M. Tullsen, Susan J. Eggers, and Henry M. Levy. Simultaneous multithreading: maximizing on-chip parallelism. In Proceedings of the 22nd Annual International Symposium on Computer Architecture, ISCA '95, pages 392-403, New York, NY, USA, 1995. ACM.
34. Kyle B. Wheeler, Richard C. Murphy, and Douglas Thain. Qthreads: An API for programming with millions of lightweight threads. In IEEE International Symposium on Parallel and Distributed Processing, 2008.
35. Andy Yoo, Edmond Chow, Keith Henderson, William McLendon, Bruce Hendrickson, and Umit Catalyurek. A scalable distributed parallel breadth-first search algorithm on BlueGene/L. In Proceedings of the 2005 ACM/IEEE Conference on Supercomputing, SC '05, Washington, DC, USA, 2005. IEEE Computer Society.
36. Gengbin Zheng, Laxmikant V. Kale, and Orion Sky Lawlor. Multiple flows of control in migratable parallel programs. Proceedings of the 8th International Conference on Parallel Processing Workshops, 0:435-444, 2006.