Statistics-driven workload modeling for the cloud

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2010, Pages 87-92

  Ganapathi, Archana ^a   Chen, Yanpei ^a   Fox, Armando ^a   Katz, Randy ^a   Patterson, David ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALTERNATIVE CONFIGURATIONS; CLOUD COMPUTING; DATA-INTENSIVE COMPUTATION; DATA-INTENSIVE WORKLOADS; EXECUTION ENVIRONMENTS; GUIDE SYSTEM; INITIAL DESIGN; PAY-AS-YOU-GO; RECENT TRENDS; RESOURCE REQUIREMENTS; STATISTICAL MODELING; STATISTICAL MODELS; WORKLOAD MODELING;

EID: 77952653919     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDEW.2010.5452742     Document Type: Conference Paper

References (16)

1. J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters," Communications of the ACM, vol. 51, no. 1, pp. 107-113, January 2008.
2. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. H. Katz, A. Konwinski, G. Lee, D. A. Patterson, A. Rabkin, I. Stoica, and M. Zaharia, "Above the Clouds: A Berkeley View of Cloud Computing," EECS Department, University of California, Berkeley, Tech. Rep. UCB/EECS-2009-2028, 2009.
3. A. Thusoo, J. Sen Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wyckoff, and R. Murthy, "Hive - A Warehousing Solution Over a MapReduce Framework," in Proc. International Conference on Very Large Data Bases, 2009.
4. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins, "Pig Latin: A Not-So-Foreign Language for Data Processing," in Proc. ACM SIGMOD International Conference on Management of Data, 2008.
5. A. Ganapathi, H. Kuno, U. Daval, J. Wiener, A. Fox, M. Jordan, and D. Patterson, "Predicting Multiple Performance Metrics for Queries: Better Decisions Enabled by Machine Learning," in Proc International Conference on Data Engineering, 2009.
6. "Hadoop Power-By Page," http://wiki.apache.org/hadoop/ PoweredBy.
7. "Hadoop," http://hadoop.apache.org.
8. S. Ghemawat, H. Gobioff, and S.-T. Leung, "The Google file system," SIGOPS Operating Systems Review, vol. 37, no. 5, pp. 29-43, 2003.
9. M. Zaharia, A. Konwinski, A. D. Joseph, R. Katz, and I. Stoica, "Improving MapReduce Performance in Heterogeneous Environments," in Symposium on Operating Systems Design and Implementation, 2008.
10. M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, and I. Stoica, "Job Scheduling for Multi-User MapReduce Clusters," EECS Department, University of California, Berkeley, Tech. Rep. UCB/EECS-2009-2055, 2009.
11. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears, "MapReduce Online," EECS Department, University of California, Berkeley, Tech. Rep. UCB/EECS-2009-2136, 2009.
12. B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. D. Joseph, S. Shenker, and I. Stoica, "Nexus: A Common Substrate for Cluster Computing," Workshop on Hot Topics in Cloud Computing, 2009.
13. A. Ganapathi, "Predicting and Optimizing System Utilization and Performance via Statistical Machine Learning," Ph.D. dissertation, UC Berkeley, 2009.
14. K. Morton, A. Friesen, M. Balazinska, and D. Grossman, "Estimating the Progress of MapReduce Pipelines," in Proc. International Conference on Data Engineering, 2010.
15. "Gridmix," HADOOP-HOME/src/benchmarks/gridmix in all recent Hadoop distributions.
16. "Mumak," http://issues.apache.org/jira/browse/MAPREDUCE-728, last retrieved Nov. 2009.