High volume throughput computing: Identifying and characterizing throughput oriented workloads in data centers

Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2012

Volumn , Issue , 2012, Pages 1712-1721

  Zhan, Jianfeng ^a   Zhang, Lixin ^a   Sun, Ninghui ^a   Wang, Lei ^a   Jia, Zhen ^a   Luo, Chunjie ^a  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

Author keywords

Benchmarks; Data center systems; High volume throughput computing; Metrics; Throughput oriented workloads

Indexed keywords

BENCHMARKS; COMPUTING PARADIGM; COUPLING DEGREE; DATA CENTERS; DATA PROCESSING APPLICATIONS; HIGH-THROUGHPUT COMPUTING; METRICS; REAL-TIME APPLICATION; SERVICE INSTANCES; THROUGHPUT COMPUTING;

DATA PROCESSING; DISTRIBUTED PARAMETER NETWORKS;

THROUGHPUT;

EID: 84867417682     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPSW.2012.213     Document Type: Conference Paper

References (42)

1. L. Wang et al. 2012. In Cloud, Can Scientific Communities Benefit from the Economies of Scale?. IEEE TPDS. vol.23, no.2, pp.296-303, Feb. 2012.
2. P. Wang et al. 2010. Transformer: A New Paradigm for Building Data-Parallel Programming Models. IEEE Micro 30, 4 (Jul. 2010), 55-64.
3. H. Xi et al. 2011. Characterization of Real Workloads of Web Search Engines. In Proc. IISWC 2011.
4. U. Hoelzle et al. 2009. The Datacenter as a Computer: an Introduction to the Design of Warehouse-Scale Machines. 1st. Morgan and Claypool Publishers.
5. M. Ferdman et al. 2012. Clearing the Clouds: A Study of Emerging Workloads on Modern Hardware. In Proc. ASPLOS 2012.
6. D. J. DeWitt. 1993. The Wisconsin Benchmark: Past, present and future. In J. Gray, editor, The Benchmark Handbook. Morgan Kaufmann, 1993.
7. J. J. Dongarra et al. 2003. The LINPACK Benchmark: past, present and future. Concurrency and Computation: Practice and Experience, 15: 803-820.
8. J. Gray, editor. 1993. The Benchmark Handbook For Database and Transaction Processing Systems. Morgan Kaufmann, 1993.
9. Y. Chen et al. 2011. The Case for Evaluating MapReduce Performance Using Workload Suites. In Proc. MASCOTS, 2011.
10. S. Patil et al. 2011. YCSB++: benchmarking and performance debugging advanced features in scalable table stores. In Proc. SoCC, 2011.
11. C. Bienia. 2011. Benchmarking Modern Multiprocessors. PhD thesis, Princeton University, January 2011.
12. J. Laudon. 2005. Performance/Watt: the new server focus. SIGARCH Comput. Archit. News 33, 4 (November 2005), 5-13.
13. S. Huang et al. 2010. The HiBench benchmark suite: Characterization of the MapReduce-based data analysis. In Proc. ICDEW 2010.
14. I. Raicu et al. 2008. Many-task computing for grids and supercomputers, In Proc. of MTAGS 2008.
15. M. Armbrust et al. 2009. Above the clouds: A berkeley view of cloud computing, Tech. Rep. UCB/EECS-2009-28.
16. K. Gaj et. al. 2002. Performance evaluation of selected job management systems, In Proc. IPDPS 2002.
17. W. Feng et al. 2007. The Green500 List: Encouraging Sustainable Supercomputing. Computer, vol.40, no.12, pp.50-55, Dec. 2007.
18. S. Rivoire et al. 2007. Models and Metrics to Enable Energy-Efficiency Optimizations. Computer, vol.40, no.12, pp.39-48, Dec. 2007.
19. B. F. Cooper et al. 2010. Benchmarking cloud serving systems with YCSB. In Proc. SoCC '10, pp.143-154.
20. M. Anderson. 2011. Better benchmarking for super-computers. Spectrum, IEEE , vol.48, no.1, pp.12-14, Jan. 2011.
21. M. Michael et al. 2007. Scale-up x scale-out: A case study using nutch/lucene. In Proc. IPDPS 2007.
22. P.M. Chen et al. 1993. Storage performance-metrics and benchmarks. In Proc. of the IEEE , vol.81, no.8, pp.1151-1165, Aug 1993.
23. M. Poess et al. 2000. New TPC benchmarks for decision support and web commerce. SIGMOD Rec. 29, 4 (December 2000), 64-71.
24. Sun Microsystems, SWaP (Space, Watts, and Performance) Metric; www.sun.com/servers/coolthreads/swap.
25. D. Thain, T. Tannenbaum, M. Livny, Distributed Computing in Practice: The Condor Experience, Concurrency and Computation: Practice and Experience 17(2-4), pp. 323-356, 2005
26. M. Livny et al. 1997. Mechanisms for High Throughput Computing, SPEEDUP Journal 1(1), 1997
27. S. Chaudhry et al. High-performance throughput computing. Micro, IEEE , vol.25, no.3, pp. 32-45, May-June 2005
28. R. E Bryant. 2008. Data intensive scalable computing. Retrieved January 5, 2010, from: http://www.cs.cmu.edu/bryant/presentations/DISCconcept.ppt.
29. G. Ananthanarayanan et al. 2011. Disk-locality in datacenter computing considered irrelevant. In Proc. HotOS 2011.
30. J. Hamilton. 2009. Internet-scale service infrastructure efficiency. SIGARCH Comput. Archit. News 37, 3 (Jun. 2009), 232-232.
31. D. Gannon. 2011. Challenges for large scale scientific data analytics. Keynote given at PDAC-11, in conjunction with SC'11.
32. M. Isard et al. 2009. Quincy: fair scheduling for distributed computing clusters. In Proc. of SOSP 09. ACM, New York, NY, 261-276.
33. K. Beaty et al. 2009. Desktop to cloud transformation planning. In Proc. IPDPS 2009.
34. L. M. Vaquero et al. 2008. A break in the clouds: towards a cloud definition. SIGCOMM Comput. Commun. Rev. 39, 1 (Dec. 2008), 50-55.
35. TPC BENCHMARK : http://www.tpc.org/
36. Standard Performance Evaluation Corporation: http://www.spec.org/
37. Distributed stream computing platform: http://incubator.apache.org/s4/
38. E. Deelman et al. 2008. The cost of doing science on the cloud: the montage example, In Proc. of SC 08.
39. GridMix: http://hadoop.apache.org/mapreduce/docs/current/gridmix.html
40. X. Liu et al. 2011. Automatic performance debugging of SPMD-style parallel programs. J. Parallel Distrib. Comput. 71, 7 (July 2011), 925-937.
41. Z. Zhang et al. 2009. Precise request tracing and performance debugging for multi-tier services of black boxes. In Proc. DSN 2009, 337-346.
42. B. Sang et al. 2012. Precise, scalable, and online request tracing for multi-tier services of black boxes. Accepted by TPDS.