Characterizing machines and workloads on a Google cluster

Proceedings of the International Conference on Parallel Processing Workshops

Volumn , Issue , 2012, Pages 397-403

  Liu, Zitao ^a   Cho, Sangyeun ^a  

^a University of Pittsburgh   (United States)

Author keywords

Cloud computing; datacenter computing; job scheduling; system management

Indexed keywords

CLOUD SERVICES; DATA SETS; DATACENTER COMPUTING; HIGH SCALABILITIES; JOB SCHEDULING; MACHINE MAINTENANCE; SYSTEM MANAGEMENT;

SCHEDULING;

CLOUD COMPUTING;

EID: 84871144328     PISSN: 15302016     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPPW.2012.57     Document Type: Conference Paper

References (16)

1. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters," in OSDI, 2004, pp. 137-150.
2. T. White, Hadoop: The Definitive Guide. O'Reilly, 2009.
3. L. A. Barroso and U. Hölzle, The Datacenter as a Computer. Morgan & Claypool, 2009.
4. Traces of Google workloads, http://code.google.com/p/googleclusterdata/. [Online]. Available: http://code.google.com/p/googleclusterdata/
5. C. Reiss, J. Wikes, and J. Hellerstein, "Google cluster-usage traces: format+schema," November 2011.
6. B. Sharma, V. Chudnovsky, J. L. Hellerstein, R. Rifaat, and C. R. Das, "Modeling and synthesizing task placement constraints in google compute clusters," in Proceedings of the 2nd ACM Symposium on Cloud Computing, ser. SOCC '11. New York, NY, USA: ACM, 2011, pp. 3:1-3:14. [Online]. Available: http://doi.acm.org/10.1145/2038916.2038919
7. M. Calzarossa and G. Serazzi, "Workload characterization: a survey," in Proceedings of the IEEE, vol. 81, no. 8, 1993, pp. 1136-1150.
8. W. Cirne and F. Berman, "A comprehensive model of the supercomputer workload," in IEEE International Workshop on Workload Characterization, 2001, pp. 140-148.
9. P. Barford and M. Crovella, "Generating representative web workloads for network an server performance evaluation," in ACM SIGMETRICS Performance Evaluation Review, vol. 26, no. 1, 1998, pp. 151-160.
10. H. P. Artis, "Capacity planning for mvs computer system," in ACM SIGMETRICS Performance Evaluation Review, vol. 8, no. 4, 1979, pp. 45-62.
11. A. B. Downey and D. G. Feitelson, "The elusive goal of workload characterization," in ACM SIGMETRICS Performance Evaluation Review, vol. 26, no. 4, 1999.
12. A. K. Mishra, J. L. Hellerstein, W. Cirne, and C. R. Das, "Towards characterizing cloud backend workloads: insights from google compute clusters," in ACM SIGMETRICS Performance Evaluation Review, vol. 37, no. 4, 2010.
13. Y. Chen, A. S. Ganapathi, R. Griffith, and R. H. Katz, "Towards understanding cloud performance tradeoffs using statistical workload analysis and replay," EECS Department, University of California, Berkeley, Tech. Rep. UCB/EECS-2010-81, May 2010. [Online]. Available: http://www.eecs.berkeley. edu/Pubs/TechRpts/2010/EECS-2010-81.html
14. S. T. Arijit Khan, Xifeng Yan and N. Anerousis, "Workload characterization and prediction in the cloud: A multiple time series approach," in Cloudman, 2012.
15. R. G. Soila Kavulya, Jiaqi Tan and P. Narasimhan, "An analysis of traces from a production mapreduce cluster," Carnegie Mellon University, Tech. Rep., 2009.
16. Y. Chen, A. S. Ganapathi, R. Griffith, and R. H. Katz, "Analysis and lessons from a publicly available google cluster trace," EECS Department, University of California, Berkeley, Tech. Rep. UCB/EECS-2010-95, Jun 2010. [Online]. Available: http://www.eecs.berkeley.edu/Pubs/TechRpts/2010/EECS-2010- 95.html