Improving resource utilization in a heterogeneous cloud environment

APCC 2012 - 18th Asia-Pacific Conference on Communications: "Green and Smart Communications for IT Innovation"

Volumn , Issue , 2012, Pages 185-189

  Shih, Hsin Yu ^a   Leu, Jenq Shiou ^a  

^a NATIONAL TAIWAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

Author keywords

Cloud Computing; Hadoop; Large Scale Data Processing; MapReduce

Indexed keywords

COMMON PLATFORM; COMPUTATION LOADS; COMPUTATION RESOURCES; COMPUTING ENVIRONMENTS; COMPUTING PERFORMANCE; COMPUTING RESOURCE; COMPUTING SERVICES; CPU UTILIZATION; FLEXIBLE COMPUTING; HADOOP; LOGICAL FRAMEWORKS; MAP-REDUCE; NETWORK BANDWIDTH; OPEN SOURCE IMPLEMENTATION; PARALLEL COMPUTING MODELS; PROCESSING NODES; RESOURCE UTILIZATIONS; SLOT NUMBERS; TYPICAL MODEL; WORKING NODES;

CLOUD COMPUTING; COMPUTER SYSTEMS; DATA PROCESSING; PARALLEL ARCHITECTURES;

INFORMATION TECHNOLOGY;

EID: 84872577500     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/APCC.2012.6388127     Document Type: Conference Paper

References (11)

1. J. Dean and S. Ghemawat, "MapReduce: Simplified data processing on large clusters," in USENIX Symposium on Operating Systems Design and Implementation, San Francisco, CA, Dec 2004, pp. 137-150.
2. Apache Software Foundation, "Hadoop," 2007. Available: http://Hadoop.apache.org/core
3. M. Hong, Z. Zhenzhong, Z. Bin, X. Limin, and R. Li, "Towards Deploying Elastic Hadoop in the Cloud," in Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC), 2011 International Conference on, 2011, pp. 476-482.
4. H. C. Lim, S. Babu, and J. S. Chase, "Automated control for elastic storage," presented at the Proceedings of the 7th international conference on Autonomic computing, Washington, DC, USA, 2010.
5. M. Chowdhury, M. Zaharia, J. Ma, M. I. Jordan, and I. Stoica, "Managing data transfers in computer clusters with orchestra," SIGCOMM Comput. Commun. Rev., vol. 41, pp. 98-109, 2011.
6. D. Jiang, B. C. Ooi, L. Shi, and S. Wu, "The performance of MapReduce: an in-depth study," Proc. VLDB Endow., vol. 3, pp. 472-483, 2010.
7. S. Babu, "Towards automatic optimization of MapReduce programs," presented at the Proceedings of the 1st ACM symposium on Cloud computing, Indianapolis, Indiana, USA, 2010.
8. K. Kambatla, A. Pathak, and H. Pucha, "Towards optimizing hadoop provisioning in the cloud," presented at the Proceedings of the 2009 conference on Hot topics in cloud computing, San Diego, California, 2009.
9. R. Boutaba, L. Cheng, and Q. Zhang, "On Cloud computational models and the heterogeneity challenge," Journal of Internet Services and Applications, vol. 3, pp. 77-86, 2012.
10. J. Dean and S. Ghemawat, "MapReduce: simplified data processing on large clusters," Commun. ACM, vol. 51, pp. 107-113, 2008.
11. M. Zaharia, A. Konwinski, A. D. Joseph, R. Katz, and I. Stoica, "Improving MapReduce performance in heterogeneous environments," presented at the Proceedings of the 8th USENIX conference on Operating systems design and implementation, San Diego, California, 2008.