Understanding big data analytics workloads on modern processors

IEEE Transactions on Parallel and Distributed Systems

Volumn 28, Issue 6, 2017, Pages 1797-1810

  Jia, Zhen ^a   Zhan, Jianfeng ^a   Wang, Lei ^a   Luo, Chunjie ^a   Gao, Wanling ^a   Jin, Yi ^b   Han, Rui ^a   Zhang, Lixin ^a  

^a UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^b Beijing Academy of Science and Technology   (China)

Author keywords

Big data analytics; Micro architectural characteristics; Performance optimization; Workload characterization

Indexed keywords

PIPELINE PROCESSING SYSTEMS;

CYCLES PER INSTRUCTIONS; DATA ANALYTICS; HARDWARE PERFORMANCE COUNTERS; INHERENT CHARACTERISTICS; MICRO-ARCHITECTURAL CHARACTERISTICS; OUT-OF-ORDER PROCESSORS; PERFORMANCE OPTIMIZATIONS; WORKLOAD CHARACTERIZATION;

BIG DATA;

EID: 85021760383     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2016.2625244     Document Type: Article

References (45)

1. J. Zhan, L. Zhang, N. Sun, L. Wang, Z. Jia, and C. Luo, "High volume throughput computing: Identifying and characterizing throughput oriented workloads in data centers", in Proc. IEEE 26th Int. Parallel Distrib. Process. Symp. Workshops PhD Forum, 2012, pp. 1712-1721.
2. L. Barroso and U. Hölzle, "The datacenter as a computer: An introduction to the design of warehouse-scale machines", Synthesis Lectures Comput. Archit., vol. 4, no. 1, pp. 1-108, 2009. [Online]. Available: http://www.cs.berkeley.edu/rxin/db-papers/WarehouseScaleComputing. pdf
3. A. Thusoo, et al., "Data warehousing and analytics infrastructure at facebook", in Proc. Int. Conf. Manage. Data, 2010, pp. 1013-1020.
4. Power by Hadoop. (2015). [Online]. Available: http://wiki. apache.org/hadoop/PoweredBy
5. J. Zhan, et al., "Cost-aware cooperative resource provisioning for heterogeneous workloads in data centers", IEEE Trans. Comput., vol. 62, no. 11, pp. 2155-2168, Nov. 2013.
6. L. Wang, J. Zhan, W. Shi, and Y. Liang, "In cloud, can scientific communities benefit from the economies of scale?" IEEE Trans. Parallel Distrib. Syst., vol. 23, no. 2, pp. 296-303, Feb. 2012.
7. B. Sang, et al., "Precise, scalable, and online request tracing for multitier services of black boxes", IEEE Trans. Parallel Distrib. Syst., vol. 23, no. 6, pp. 1159-1167, Jun. 2012.
8. Z. Jia, L. Wang, J. Zhan, L. Zhang, and C. Luo, "Characterizing data analysis workloads in data centers", in Proc. IEEE Int. Symp. Workload Characterization, 2013, pp. 66-76.
9. L. Wang, et al., "BigDataBench: A big data benchmark suite from internet services", in Proc. IEEE 20th Int. Symp. High Performance Comput. Archit., 2014, pp. 488-499.
10. BigDataBench homepage. (2015). [Online]. Available: http://prof. ict.ac.cn/BigDataBench/
11. A. Yasin, "A top-down method for performance analysis and counters architecture", in Proc. IEEE Int. Symp. Performance Anal. Syst. Softw., 2014, pp. 35-44.
12. M. Ferdman, et al., "Clearing the clouds: A study of emerging workloads on modern hardware", in Proc. 17th Int. Conf. Archit. Support Program. Languages Operating Syst., 2012, pp. 37-48.
13. R. Narayanan, B. Ozisikyilmaz, J. Zambreno, G. Memik, and A. Choudhary, "MineBench: A benchmark suite for data mining workloads", in Proc. IEEE Int. Symp. Workload Characterization, 2006, pp. 182-188.
14. S. Huang, J. Huang, J. Dai, T. Xie, and B. Huang, "The HiBench benchmark suite: Characterization of the MapReduce-based data analysis", in Proc. IEEE 26th Int. Conf. Data Eng. Workshops, 2010, pp. 41-51.
15. M. Awasthi, T. Suri, Z. Guz, A. Shayesteh, M. Ghosh, and V. Balakrishnan, "System-level characterization of datacenter applications", in Proc. 6th ACM/SPEC Int. Conf. Performance Eng., 2015, pp. 27-38.
16. A. Anwar, K. Krish, and A. R. Butt, "On the use of microservers in supporting Hadoop applications", in Proc. IEEE Int. Conf. Cluster Comput., 2014, pp. 66-74.
17. A. Ghazal, et al., "BigBench: Towards an industry standard benchmark for big data analytics", in Proc. ACM SIGMOD Int. Conf. Manage. Data, 2013, pp. 1197-1208.
18. S. Kanev, et al., "Profiling a warehouse-scale computer", in Proc. 42nd Annu. Int. Symp. Comput. Archit., 2015, pp. 158-169.
19. A. Yasin, Y. Ben-Asher, and A. Mendelson, "Deep-dive analysis of the data analytics workload in CloudSuite", in Proc. IEEE Int. Symp. Workload Characterization, 2014, pp. 202-211.
20. M. Li, et al., "MRONLINE: MapReduce online performance tuning", in Proc. 23rd Int. Symp. High-Performance Parallel Distrib. Comput., 2014, pp. 165-176.
21. K. Krish, A. Anwar, and A. R. Butt, "'Sched: A heterogeneityaware Hadoop workflow scheduler", in Proc. IEEE 22nd Model. Anal. Simulation Comput. Telecommun. Syst., 2014, pp. 255-264.
22. M. S. Iqbal, M. M. Rafique, A. R. Butt, and K. R. Krish, "Towards energy awareness in Hadoop", in Proc. 4th Int. Workshop Netw.-Aware Data Manage., 2014, pp. 16-22.
23. Apache mahout. (2015). [Online]. Available: http://mahout. apache.org/
24. Hive performance benchmarks. (2015). [Online]. Available: https://issues.apache.org/jira/browse/HIVE-396
25. Alexa: The top 500 sites on the Web. (2013). [Online]. Available: http://www.alexa.com/topsites/global;0
26. T. White, Hadoop: The Definitive Guide. Sebastopol, CA, USA: O'Reilly Media, 2009.
27. Java TPC-W implementation distribution. (2015). [Online]. Available: http://pharm.ece.wisc.edu/
28. Cloudsuite homepage. (2015). [Online]. Available: http://parsa. epfl.ch/cloudsuite/cloudsuite.html
29. B. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears, "Benchmarking cloud serving systems with YCSB", in Proc. 1st ACM Symp. Cloud Comput., 2010, pp. 143-154.
30. Faban harness and benchmark framework. (2015). [Online]. Available: http://java.net/project/faban
31. PMU-tools. (2015). [Online]. Available: https://github.com/andikleen/pmu-tools
32. T. S. Karkhanis and J. E. Smith, "A first-order superscalar processor model", in Proc. 31st Annu. Int. Symp. Comput. Archit., 2004, pp. 338-349.
33. A. Kolli, A. Saidi, and T. F. Wenisch, "RDIP: Return-address-stack directed instruction prefetching", in Proc. 46th Annu. IEEE/ACM Int. Symp. Microarchitecture, 2013, pp. 260-271.
34. M. K. Qureshi and Y. N. Patt, "Utility-based cache partitioning: A low-overhead, high-performance, runtime mechanism to partition shared caches", in Proc. 39th Annu. IEEE/ACM Int. Symp. Microarchitecture, 2006, pp. 423-432.
35. A. Jaleel, J. Nuzman, A. Moga, S. C. Steely Jr, and J. Emer, "High performing cache hierarchies for server workloads", in Proc. IEEE 21st Int. Symp. High-Performance Comput. Archit., 2015, pp. 343-353.
36. A. Rajaraman, "More data usually beats better algorithms", 2008. [Online]. Available: http://anand.typepad.com/datawocky/2008/03/more-data-usual.html
37. S. M. Stigler, "Francis Galton's account of the invention of correlation", Statist. Sci., vol. 4, pp. 73-79, 1989.
38. M. E. Thomadakis, "The architecture of the Nehalemprocessor and Nehalem-EP SMP platforms", Resource 2011-3, 2011. [Online]. Available: http://sc.tamu.edu/systems/eos/perf-nehalem.pdf
39. M. Zaharia, et al., "Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing", in Proc. 9th USENIX Conf. Netw. Syst. Des. Implementation, 2012, pp. 2-2.
40. Powered by spark. (2015). [Online]. Available: https://cwiki. apache.org/confluence/display/SPARK/Powered+By+Spark
41. K. Ren, Y. Kwon, M. Balazinska, and B. Howe, "Hadoop's adolescence: An analysis of Hadoop usage in scientific workloads", Proc. VLDB Endowment, vol. 6, no. 10, pp. 853-864, 2013.
42. C. Lam, Hadoop in Action. Greenwich, CT, USA: Manning Publications Co., 2010.
43. Chinese word segmentation library. (2015). [Online]. Available: http://ictclas.org/
44. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines", ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, 2011, Art. no. 27.
45. Z. Jia, et al., "Characterizing and subsetting big data workloads", in Proc. IEEE Int. Symp. Workload Characterization, 2014, pp. 191-201.