Benchmarking of Distributed Computing Engines Spark and GraphLab for Big Data Analytics

Proceedings - 2016 IEEE 2nd International Conference on Big Data Computing Service and Applications, BigDataService 2016

Volumn , Issue , 2016, Pages 10-13

  Wei, Jian ^a   Chen, Kai ^b   Zhou, Yi ^b   Zhou, Qu ^b   He, Jianhua ^a  

^a ASTON UNIVERSITY   (United Kingdom)

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; DISTRIBUTED COMPUTER SYSTEMS; ENGINES; GRAPHIC METHODS; SCALABILITY;

BENCHMARK SUITES; COMPUTING ENGINES; COMPUTING RESOURCE; DISTRIBUTED PROCESSING; GENERIC PLATFORMS; PERFORMANCE ASPECTS; PERFORMANCE DEGRADATION; VIRTUAL MACHINES;

BIG DATA;

EID: 84973661545     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigDataService.2016.11     Document Type: Conference Paper

References (16)

1. Chu, C., Kim, S. K., Lin, Y. A., Yu, Y., Bradski, G., Ng, A. Y., and Olukotun, K. "Map-reduce for machine learning on multicore." Advances in neural information processing systems., 2007.
2. Low, Y. "GraphLab: A Distributed Abstraction for Large Scale Machine Learning." Doctoral dissertation, University of California, Berkeley, 2013.
3. Low, Y., Bickson, D., Gonzalez, J., Guestrin, C., Kyrola, A., and Hellerstein, J. M. "Distributed GraphLab: a framework for machine learning and data mining in the cloud." Proceedings of the VLDB Endowment, 716-727, 2012.
4. Kyrola, A., Blelloch, G. E., and Guestrin, C. "GraphChi: Large-Scale Graph Computation on Just a PC." In Proc. OSDI, 31-46, 2012.
5. Roy, A., Mihailovic, I., and Zwaenepoel, W. "X-stream: edge-centric graph processing using streaming partitions." In Proc. of the Twenty-Fourth ACM Symposium on Operating Systems Principles, pp. 472-488, 2013.
6. Guo, Y., Varbanescu A., Losup, A., Martella, C., Willke, T., "Benchmarking Graph-Processing Platforms: A Vision." In Proc. ACM ICPE'14, 2014.
7. Guo, Y., Biczak, M., Varbanescu, A. L., Iosup, A., Martella, C., and Willke, T. L. "How well do graph-processing platforms perform an empirical performance evaluation and analysis." In Proc IEEE International Parallel and Distributed Processing Symposium, 395-404, 2014.
8. Capota, M., Hegeman, T., Losup, A., Prat-Perez, A., Erling, O., Boncz, P., "Graphalytics: a big data benchmark for graph-processing platforms", In Proc. of ACM GRADES'15, 2015.
9. Lu, Y., Cheng, J., Yan, D., Wu, H., "Large-Scale Distributed Graph Computing Systems: An Experimental Evaluation", In Proc. VLDB Endowment, 2014.
10. Gao, Y., Zhou, W., Hna, J., Meng, D., Zhang, Z., Xu, Z., "An evaluation and analysis of graph processing frameworks on five key issues", In Proc. ACM CF'15, 2015.
11. Zaharia, M., Chowdhury, M., Franklin, M. J., Shenker, S., and Stoica, I. "Spark: cluster computing with working sets." In Proceedings of the 2nd USENIX conference on Hot topics in cloud computing., June, 2010.
12. Cho, J., Garcia-Molina, H., and Page, L. "Efficient crawling through URL ordering." Computer Networks and ISDN Systems, 30(1), 161-172, 1998
13. Salihoglu, S., and Widom, J. "Gps: A graph processing system". In Proc. of the 25th International Conference on Scientific and Statistical Database Management, 2013.
14. Joachims, T. "Making large scale SVM learning practical", 1999.
15. Backstrom, L., Huttenlocher, D., Kleinberg, J., and Lan, X. "Group formation in large social networks: membership, growth, and evolution." In Proc. of the 12th ACM SIGKDD, pp. 44-54, 2006.
16. Kwak, H., Lee, C., Park, H., and Moon, S. "What is Twitter, a social network or a news media" In Proc. of the 19th International Conference on World Wide Web, pp. 591-600, 2010.