Towards characterizing cloud backend workloads: Insights from google compute clusters

Performance Evaluation Review

Volumn 37, Issue 4, 2010, Pages 34-41

  Mishra, Asit K ^a   Hellerstein, Joseph L ^a   Cirne, Walfredo ^b   Das, Chita R ^b  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLOUD COMPUTING; EMBEDDED SYSTEMS; INFORMATION RETRIEVAL; MULTITASKING; SCHEDULING ALGORITHMS; WEB SERVICES; WEBSITES;

APPLICATION TASKS; CAPACITY PLANNING; FLEXIBLE COMPUTING; ITS APPLICATIONS; MACHINE RESOURCES; MACHINE UTILIZATION; RESOURCE CONSUMPTION; SERVICE LEVEL OBJECTIVE;

VOICE/DATA COMMUNICATION SYSTEMS;

EID: 85031898917     PISSN: 01635999     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1773394.1773400     Document Type: Conference Paper

References (24)

1. Google Cluster Data, http://googleresearch.blogspot.com/2010/01/google-cluster-data.html.
2. Y. Aridor, T. Domany, O. Goldshmidt, E. Shmueli, J. Moreira, and L. Stockmeier. Multi-Toroidal Interconnects: Using Additional Communication Links to Improve Utilization of Parallel Computers. Job Scheduling Strategies for Parallel Processing, LNCS, 2004.
3. H. P. Artis. Capacity Planning for MVS Computer Systems. SIGMETRICS PER, 8(4):45-62, 1980.
4. P. Barford and M. Crovella. Generating Representative Web Workloads for Network and Server Performance Evaluation. SIGMETRICS PER, 1998.
5. M. Calzarossa and D. Ferrari. A Sensitivity Study of the Clustering Approach to Workload Modeling. In SIGMETRICS'85: Proceedings of the ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, 1985.
6. M. Calzarossa and G. Serazzi. Workload characterization: A survey. Proceedings of the IEEE, 81(8):1136-1150, Aug 1993.
7. S. J. Chapin, W. Cirne, D. G. Feitelson, J. P. Jones, S. T. Leutenegger, U. Schwiegelshohn, W. Smith, and D. Talby. Benchmarks and Standards for the Evaluation of Parallel Job Schedulers. In Job Scheduling Strategies for Parallel Processing, LNCS. 1999.
8. L. Cherkasova and P. Phaal. Session-Based Admission Control: A Mechanism for Peak Load Management of Commercial Web Sites. IEEE Transactions on Computers, 51(6):669-685, 2002.
9. W. Cirne and F. Berman. A Comprehensive Model of the Supercomputer Workload. In 4th Workshop on Workload Characterization, pages 140-148, Dec 2001.
10. M. E. Crovella. Performance Evaluation with Heavy Tailed Distributions. In Job Scheduling Strategies for Parallel Processing, LNCS. 2001.
11. A. B. Downey and D. G. Feitelson. The Elusive Goal of Workload Characterization. SIGMETRICS PER, 1999.
12. D. Ersoz, M. S. Yousif, and C. R. Das. Characterizing network traffic in a cluster-based, multi-tier data center. In ICDCS'07: Proceedings of the 27th Intl. Conference on Distributed Computing Systems, 2007.
13. D. G. Feitelson. Metric and Workload Effects on Computer Systems Evaluation. Computer, 36(9):18-25, Sep 2003.
14. D. G. Feitelson and B. Nitzberg. Job Characteristics of a Production Parallel Scientific Workload on the NASA Ames iPSC/860. In Job Scheduling Strategies for Parallel Processing, LNCS. 1995.
15. D. Ferrari. On The Foundations of Artificial Workload Design. In SIGMETRICS'84: Proceedings of the 1984 ACM SIGMETRICS Conf. on Measurement and Modeling of Computer Systems, 1984.
16. J. A. Hartigan. Probability and Mathematical Statistics. John Wiley, 1975.
17. J. L. Hellerstein, F. Zhang, and P. Shahabuddin. A Statistical Approach to Predictive Detection. Computer Networks, 2001.
18. E. Hernández-Orallo and J. Vila-Carbó. Web Server Performance Analysis using Histogram Workload Models. Comput. Netw., 2009.
19. C. B. Lee, Y. Schwartzman, J. Hardy, and A. Snavely. Are User Runtime Estimates Inherently Inaccurate? In Job Scheduling Strategies for Parallel Processing, LNCS. 2004.
20. F. Petrini, E. Frachtenberg, A. Hoisie, and S. Coll. Performance Evaluation of the Quadrics Interconnection Network. Cluster Comput., 6(2):1125-142, Apr 2003.
21. B. Song, C. Ernemann, and R. Yahyapour. Parallel Computer Workload Modeling with Markov Chains. In Job Scheduling Strategies for Parallel Processing, LNCS. 2004.
22. D. Talby, D. G. Feitelson, and A. Raveh. A Co-Plot Analysis of Logs and Models of Parallel Workloads. ACM Transactions on Modeling & Comput. Simulation (TOMACS), 12(3), Jul 2007.
23. D. Tsafrir and D. G. Feitelson. The Dynamics of Backfilling: Solving the Mystery of Why Increased Inaccuracy May Help. In IEEE International Symposium on Workload Characterization (IISWC), 2006.
24. F. Wang, Q. Xin, B. Hong, S. A. Brandt, E. L. Miller, D. D. E. Long, and T. T. Mclarty. File System Workload Analysis for Large Scale Scientific Computing Applications. In Proc. of the 21st IEEE / 12th NASA Goddard Conf. on Mass Storage Systems and Tech., 2004.