Big data machine learning and graph analytics: Current state and future challenges

Proceedings - 2014 IEEE International Conference on Big Data, IEEE Big Data 2014

Volumn , Issue , 2014, Pages 16-17

  Huang, H Howie ^a   Liu, Hang ^a  

^a George Washington University   (United States)

Author keywords

Big Data; Graphics Processing Unit; Hardware and Software Co Design; Lambda Architecture; Non Volatile Memory; Solid State Drive

Indexed keywords

BIG DATA; COMPUTER GRAPHICS; COMPUTER GRAPHICS EQUIPMENT; DIGITAL STORAGE; LEARNING SYSTEMS; PROGRAM PROCESSORS;

BIG-DATA MACHINES; CO-DESIGNS; GRAPH-ANALYTIC; HARDWARE AND SOFTWARE; HARDWARE AND SOFTWARE CO-DESIGN; LAMBDA ARCHITECTURE; LAMBDA'S; MACHINE-LEARNING; NON-VOLATILE MEMORY; SOLID-STATE DRIVE;

GRAPHICS PROCESSING UNIT;

EID: 84921787304     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigData.2014.7004471     Document Type: Conference Paper

References (32)

1. Jeff Kelly. Big data vendor revenue and market forecast. Wikibon 2014.
2. Yunhong Zhou, Dennis Wilkinson, Robert Schreiber, and Rong Pan. Large-scale parallel collaborative filtering for the netflix prize. In Algorithmic Aspects in Information and Management, pages 337-348. Springer, 2008.
3. David M Blei, Andrew Y Ng, and Michael I Jordan. Latent dirichlet allocation. Journal of machine Learning research, 2003.
4. Amol Ghoting, Rajasekar Krishnamurthy, Edwin Pednault Berthold Reinwald, Vikas Sindhwani, Shirish Tatikonda, Yuanyuan Tian, and Shivakumar Vaithyanathan. Systemml: Declarative machine learning on mapreduce. In IEEE International Conference on Data Engineering (ICDE), 2011, pages 231-242.
5. Yucheng Low, Danny Bickson, Joseph Gonzalez, Carlos Guestrin Aapo Kyrola, and Joseph M Hellerstein. Distributed graphlab: a framework for machine learning and data mining in the cloud. Proceedings of the VLDB Endowment (VLDB), 2012.
6. Christian Doerr and Norbert Blenn. Metric convergence in social network sampling. In Proceedings of the 5th ACM workshop on HotPlanet, 2013, pages 45-50.
7. G Chin, Grant C Nakamura, Daniel G Chavarria, and Heidi J Sofia. Graph mining of networks from genome biology. In Proceedings of the 7th IEEE International Conference on Bioinformatics and Bioengineering (BIBE) 2007., pages 1265-1269.
8. Grzegorz Malewicz, Matthew H Austern, Aart JC Bik, James C Dehnert, Ilan Horn, Naty Leiser, and Grzegorz Czajkowski. Pregel: a system for large-scale graph processing. In Proceedings of the ACM SIGMOD International Conference on Management of data (SIGMOD), 2010, pages 135-146.
9. Joseph E Gonzalez, Yucheng Low, Haijie Gu, Danny Bickson, and Carlos Guestrin. Powergraph: Distributed graph-parallel computation on natural graphs. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI), 2012 volume 12, page 2.
10. Aapo Kyrola, Guy E Blelloch, and Carlos Guestrin. Graphchi: Large-scale graph computation on just a pc. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI), 2012, volume 12, pages 31-46.
11. Donald Nguyen, Andrew Lenharth, and Keshav Pingali. A lightweight infrastructure for graph analytics. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP), 2013 pages 456-471.
12. Amitabha Roy, Ivo Mihailovic, and Willy Zwaenepoel. X-stream: edge-centric graph processing using streaming partitions. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP), 2013, pages 472-488.
13. Zhao Zhao, Guanying Wang, Ali Raza Butt, Maleq Khan, VS Anil Kumar, and Madhav V Marathe. Sahad: Subgraph analysis in massive networks using hadoop. In IEEE International Parallel &Distributed Processing Symposium (IPDPS), 2012.
14. Nathan Marz. Storm-distributed and fault-tolerant realtime computation. https://storm.incubator.apache.org/, 2013.
15. Konstantin Shvachko, Hairong Kuang, Sanjay Radia, and Robert Chansler. The hadoop distributed file system. In IEEE Symposium on Mass Storage Systems and Technologies (MSST), 2010, pages 1-10.
16. David Corrigan. Integrating and governing big data. IBM Whitepaper 2013.
17. Jeffrey Dean and Sanjay Ghemawat. Mapreduce: simplified data processing on large clusters. Communications of the ACM, 2008 51(1):107-113.
18. Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave Justin Ma, Murphy McCauley, Michael J Franklin, Scott Shenker and Ion Stoica. Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. In Proceedings of the USENIX conference on Networked Systems Design and Implementation (NSDI), 2012, pages 2-2.
19. Nathan Marz. Lambda architecture. http://nathanmarz.com/blog/ how-to-beat-The-cap-theorem.html, 2013.
20. Mark Silberstein, Bryan Ford, Idit Keidar, and Emmett Witchel. Gpufs: integrating a file system with gpus. In ACM SIGARCH Computer Architecture News, volume 41, pages 485-498, 2013.
21. Pramod Bhatotia, Rodrigo Rodrigues, and Akshat Verma. Shredder: Gpu-accelerated incremental storage and computation. In Proceedings of the conference on File and Storage Technologies (FAST) 2012, page 14.
22. Weibin Sun, Robert Ricci, and Matthew L Curry. Gpustore: harnessing gpu computing for storage systems in the os kernel. In Proceedings of the ACM Annual International Systems and Storage Conference (SYSTOR), 2012, page 9.
23. Sungpack Hong, Tayo Oguntebi, and Kunle Olukotun. Efficient parallel graph exploration on multi-core cpu and gpu. In IEEE International Conference on Parallel Architectures and Compilation Techniques (PACT), 2011, pages 78-88.
24. Duane Merrill, Michael Garland, and Andrew Grimshaw. Scalable gpu graph traversal. In ACM SIGPLAN Notices, 2012.
25. Rajat Raina, Anand Madhavan, and Andrew Y Ng. Large-scale deep unsupervised learning using graphics processors. In Proceedings of the ACM International Conference on Machine Learning (ICML), 2009, volume 9, pages 873-880.
26. Bryan Catanzaro, Narayanan Sundaram, and Kurt Keutzer. Fast support vector machine training and classification on graphics processors. In Proceedings of the ACM International Conference on Machine Learning (ICML), 2008, pages 104-111.
27. Hang Liu, Jung Hee Seo, Rajat Mittal, and H Howie Huang. Matrix decomposition based conjugate gradient solver for poisson equation. In Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis (SC), 2012, pages 1499-1500.
28. Hang Liu, Jung-Hee Seo, Rajat Mittal, and H Howie Huang. Gpuaccelerated scalable solver for banded linear systems. In IEEE International Conference on Cluster Computing (CLUSTER), 2013 pages 1-8.
29. Wei Wang, Lifan Xu, John Cavazos, H Howie Huang, and Matthew Kay. Fast acceleration of 2d wave propagation simulations using modern computational accelerators. Journal of PloS one, 2014.
30. H Howie Huang, Shan Li, Alex Szalay, and Andreas Terzis. Performance modeling and analysis of flash-based storage devices. In IEEE Symposium on Mass Storage Systems and Technologies (MSST), 2011, pages 1-11.
31. Jie Chen, Guru Venkataramani, and H Howie Huang. Repram: Recycling pram faulty blocks for extended lifetime. In IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2012.
32. Ahsen J Uppal, Ron C Chiang, and H Howie Huang. Flashy prefetching for high-performance flash drives. In IEEE Symposium on Mass Storage Systems and Technologies (MSST), 2012.