The implications of diverse applications and scalable data sets in benchmarking big data systems

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 8163 LNCS, Issue , 2014, Pages 44-59

  Jia, Zhen ^a,b   Zhou, Runlin ^c   Zhu, Chunge ^c   Wang, Lei ^a,b   Gao, Wanling ^a,b   Shi, Yingjie ^a   Zhan, Jianfeng ^a   Zhang, Lixin ^a  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^b UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^c National Computer Network Emergency Response Technical Team   (China)

Author keywords

Benchmarking; Big Data; Scalable Data

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER SCIENCE; COMPUTERS;

BENCHMARK DATA; BIG DATA APPLICATIONS; BIG DATUM; DIVERSE APPLICATIONS; HOT TOPICS; PERFORMANCE IMPACT; SCALABLE DATA; SIMPLE ALGORITHM;

BENCHMARKING;

EID: 84958524516     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-53974-9_5     Document Type: Conference Paper

References (30)

1. http://hadoop.apache.org/
2. Performance counters for linux, https://perf.wiki.kernel.org/index.php/ Main-Page
3. Sort benchmark home page, http://sortbenchmark.org/
4. Apacible, J., Draves, R., et al.: Minutesort with flat datacenter storage. Technical report, Microsoft Research (2012)
5. Barroso, L., Holzle, U.: The datacenter as a computer: An introduction to the design of warehouse-scale machines. Synthesis Lectures on Computer Architecture 4(1), 1-108 (2009)
6. Baru, C., et al.: Benchmarking big data systems and the bigdata top100 list. Big Data 1(1), 60-64 (2013)
7. Baru, C., Bhandarkar, M., Nambiar, R., Poess, M., Rabl, T.: Setting the direction for big data benchmark standards. In: Nambiar, R., Poess, M. (eds.) TPCTC 2012. LNCS, vol. 7755, pp. 197-208. Springer, Heidelberg (2013)
8. Buros, W.M., et al.: Understanding systems and architecture for big data. IBM Research Report (2013)
9. Chen, Y.: We Don't Know Enough to make a Big Data Benchmark Suite. In: Workshop on Big Data Benchmarking (2012)
10. Chen, Y., Raab, F., Katz, R.H.: From tpc-c to big data benchmarks: A functional workload model. Technical Report UCB/EECS-2012-174, EECS Department, University of California, Berkeley (July 2012)
11. Chen, Z., Jianfeng, Z., Zhen, J., Lixin, Z.: Characterizing os behavior of scaleout data center workloads. In: The Seventh Annual Workshop on the Interaction Amongst Virtualization, Operating Systems and Computer Architecture, WIVOSCA 2013 (2013)
12. Cook, S.A., Reckhow, R.A.: Time bounded random access machines. Journal of Computer and System Sciences 7(4), 354-375 (1973)
13. Ferdman, M., et al.: Clearing the clouds: A study of emerging workloads on modern hardware. Architectural Support for Programming Languages and Operating Systems (2012)
14. Gao, W., et al.: A benchmark suite for big data systems. In: The 19th IEEE International Symposium on High Performance Computer Architecture (HPCA 2013) (2013), Tutorial http://prof.ict.ac.cn/HPCA/BigDataBench.pdf
15. Gao, W., et al.: Bigdatabench: a big data benchmark suite from web search engines. In: The Third Workshop on Architectures and Systems for Big Data (ASBD 2013) in Conjunction with the 40th International Symposium on Computer Architecture (May 2013)
16. Ghazal, A., et al.: Bigbench: Towards an industry standard benchmark for big data analytics. In: ACM SIGMOD Conference (2013)
17. Holyer, I.: Computational complexity (1984)
18. Jia, Z., Wang, L., Zhan, J., Zhang, L., Luo, C.: Characterizing data analysis workloads in data centers. In: 2013 IEEE International Symposium on Workload Characterization (IISWC). IEEE (2013)
19. Jia, Z., Zhan, J., Wang, L., Zhang, L., et al.: Hvcbench: A benchmark suite for data center. The 19th IEEE International Symposium on High Performance Computer Architecture (HPCA 2013) (2013), Tutorial Technical Report http://prof.ict.ac.cn/HPCA/HPCA-Tutorial-HVC-4-jiazhen.pdf
20. Lotfi-Kamran, P., Grot, B., Ferdman, M., Volos, S., Kocberber, O., Picorel, J., Adileh, A., Jevdjic, D., Idgunji, S., Ozer, E., et al.: Scale-out processors. In: Proceedings of the 39th International Symposium on Computer Architecture, pp. 500-511. IEEE Press (2012)
21. Luo, C., Zhan, J., Jia, Z., Wang, L., Lu, G., Zhang, L., Xu, C., Sun, N.: Cloudrankd: benchmarking and ranking cloud computing systems for data processing applications. Frontiers of Computer Science 6(4), 347-362 (2012)
22. Rajaraman, A.: More data usually beats better algorithms. Datawocky Blog (2008)
23. Sang, B., Zhan, J., Lu, G., Wang, H., Xu, D., Wang, L., Zhang, Z., Jia, Z.: Precise, scalable, and online request tracing for multitier services of black boxes. IEEE Transactions on Parallel and Distributed Systems 23(6), 1159-1167 (2012)
24. Skiena, S.S.: The algorithm design manual: with 72 figures, vol. 1. Telos Press (1998)
25. Wang, L., Zhan, J., Shi, W., Liang, Y.: In cloud, can scientific communities benefit from the economies of scale? IEEE Transactions on Parallel and Distributed Systems 23(2), 296-303 (2012)
26. White, T.: Hadoop: The definitive guide. O'Reilly Media (2012)
27. Yelick, K.: Single processor machines: Memory hierarchies and processor features
28. Zaharia, M., et al.: Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling. In: Proceedings of the 5th European Conference on Computer Systems, pp. 265-278. ACM (2010)
29. Zhan, J., Wang, L., Li, X., Shi, W., Weng, C., Zhang, W., Zang, X.: Cost-Aware cooperative resource provisioning for heterogeneous workloads in data centers. IEEE Transactions on Computers
30. Zhan, J., Zhang, L., Sun, N., Wang, L., Jia, Z., Luo, C.: High volume throughput computing: Identifying and characterizing throughput oriented workloads in data centers. In: 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW), pp. 1712-1721. IEEE (2012)