Improving MapReduce performance in heterogeneous network environments and resource utilization

Proceedings - 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2012

Volumn , Issue , 2012, Pages 714-716

  Guo, Zhenhua ^a   Fox, Geoffrey ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

heterogeneity; MapReduce; scheduling; utilization

Indexed keywords

CURRENT MECHANISMS; DATA PARALLEL; HETEROGENEITY; HETEROGENEOUS NETWORK ENVIRONMENTS; JOB EXECUTION; MAP-REDUCE; NETWORK HETEROGENEITY; RESOURCE UTILIZATIONS; RUNNING TASKS; SPECULATIVE EXECUTION;

SCHEDULING; WASTE UTILIZATION;

GRID COMPUTING;

EID: 84863654403     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2012.12     Document Type: Conference Paper

References (10)

1. X. Qiu, J. Ekanayake, S. Beason, T. Gunarathne, G. Fox, R. Barga, and D. Gannon, "Cloud technologies for bioinformatics applications,"in Proc. of MTAGS '09. New York, NY, USA: ACM, 2009.
2. M. Zaharia, A. Konwinski, A. D. Joseph, R. Katz, and I. Stoica, "Improving MapReduce performance in heterogeneous environments," in Proc. of OSDI'08. Berkeley, CA, USA:pp. 29-42.
3. J. Xie, S. Yin, X. Ruan, Z. Ding, Y. Tian, J. Majors, A. Manzanares, and X. Qin, "Improving MapReduce performance through data placement in heterogeneous hadoop clusters," in IPDPSW'10, Apr. 2010, pp. 1-9
4. Y. Luo, Z. Guo, Y. Sun, B. Plale, J. Qiu, and W. W. Li, "A hierarchical framework for cross-domain MapReduce execution," in Proc. of ECMLS '11. New York, NY, USA: ACM, 2011, pp. 15-22.
5. M. Tsugawa and J. A. B. Fortes, "A virtual network (ViNe) architecture for grid computing," in Proc. of IPDPS'06
6. R. Wolski, N. T. Spring, and J. Hayes, "The network weather service: a distributed resource performance forecasting service for metacomputing," Future Gener. Comput. Syst., vol. 15, no. 5-6, pp. 757-768, Oct. 1999.
7. M. Maheswaran, S. Ali, H. J. Siegel, D. Hensgen, and R. F. Freund, "Dynamic mapping of a class of independent tasks onto heterogeneous computing systems," J. Parallel Distrib. Comput., vol. 59, pp. 107-131, Nov. 1999. (Pubitemid 129557480)
8. T. D. Braun, H. J. Siegel, N. Beck, L. L. Bölöni, M. Maheswaran, A. I. Reuther, J. P. Robertson, M. D. Theys, B. Yao, D. Hensgen, and R. F. Freund, "A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems," J. Parallel Distrib. Comput., vol. 61, no. 6, pp. 810-837, Jun. 2001. (Pubitemid 33658407)
9. S. Ibrahim, H. Jin, L. Lu, S. Wu, B. He, and L. Qi, "LEEN: Locality/Fairness-aware key partitioning for MapReduce in the cloud," in Proc. of CloudCom '10. Washington, DC, USA pp. 17-24.
10. Z. Guo, M. Pierce, G. Fox, and M. Zhou, "Automatic task reorganization in MapReduce," in Proc. of IEEE CLUSTER '11