Network-aware scheduling of mapreduce framework on distributed clusters over high speed networks

FederatedClouds'12 - Proceedings of the 2012 Workshop on Cloud Services, Federation, and the 8th Open Cirrus Summit, Co-located with ICAC'12

Volumn , Issue , 2012, Pages 38-43

  Kondikoppa, Praveenkumar ^a   Chiu, Chui Hui ^a   Cui, Cheng ^a   Xue, Lin ^a   Park, Seung Jong ^a  

^a LOUISIANA STATE UNIVERSITY   (United States)

Author keywords

Federated clouds; Hadoop scheduling

Indexed keywords

CLUSTER ENVIRONMENTS; COMPUTING RESOURCE; DISTRIBUTED CLUSTERS; DISTRIBUTED DATA PROCESSING; EXECUTION TIME; ITS DATA; MAP TASK; MAP-REDUCE; NETWORK AWARENESS; NETWORK-AWARE SCHEDULING; OPEN SOURCE IMPLEMENTATION;

CLOUDS; DATA PROCESSING; DISTRIBUTED DATABASE SYSTEMS; SCHEDULING; WEB SERVICES;

HIGH SPEED NETWORKS;

EID: 84867880774     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2378975.2378985     Document Type: Conference Paper

References (13)

1. Apache Hadoop. http://hadoop.apache.org/.
2. Dummynet software emulator. http://info.iet.unipi.it/luigi/dummynet/.
3. Eucalyptus Cloud Computing Software. http://www.eucalyptus.com/.
4. Guture Grid Project. http://www.futuregrid.org/.
5. Louisiana Optical Network Initiative. http://www.loni.org/.
6. Neuca Eucalyptus Cloud Computing Software. https://geni-orca.renci.org/ trac/wiki/Eucalyptus-2.0-Setup/.
7. Openstack Cloud Computing Software. http://www.openstack.org/.
8. XSEDE: Extreme Science and Engineering Deicovery Environment. http://www.futuregrid.org/.
9. CRON Project: Cyberinfrastructure for Reconfigurable Optical Networking Environment, 2011. http://www.cron.loni.org/.
10. M. Cardosa, C. Wang, A. Nangia, A. Chandra, and J. Weissman. Exploring mapreduce efficiency with highly-distributed data. In Proceedings of the second international workshop on MapReduce and its applications, MapReduce '11, pages 27-34, New York, NY, USA, 2011. ACM.
11. J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. In OSDI 2004, pages 137-150, 2004.
12. Y. Luo, Z. Guo, Y. Sun, B. Plale, J. Qiu, and W. W. Li. A hierarchical framework for cross-domain mapreduce execution. In Proceedings of the second international workshop on Emerging computational methods for the life sciences, ECMLS '11, pages 15-22, New York, NY, USA, 2011. ACM.
13. M. Zaharia, K. Elmeleegy, D. Borthakur, S. Shenker, J. S. Sarma, and I. Stoica. Delay scheduling: A simple technique for achieving locality and fairness in cluster scheduling. In In Proc. EuroSys, 2010.