Cloud mapReduce: A mapReduce implementation on top of a cloud operating system

Proceedings - 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2011

Volumn , Issue , 2011, Pages 464-474

  Liu, Huan ^a   Orban, Dan ^a  

^a ACCENTURE   (United States)

Author keywords

Amazon web services; cloud; mapreduce

Indexed keywords

AMAZON WEB SERVICES; APPLICATION PROGRAMMERS; CONSISTENCY MODEL; EVENTUAL CONSISTENCY; HIGH LEVEL INTERFACE; HORIZONTAL SCALING; LOW-LEVEL CLOUDS; MAP-REDUCE; PRACTICAL SYSTEMS; PROGRAMMING MODELS;

CLUSTER COMPUTING; COMPUTER PROGRAMMING; GRID COMPUTING; SYSTEMS ANALYSIS; USER INTERFACES; WEB SERVICES;

CLOUD COMPUTING;

EID: 79961137349     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2011.25     Document Type: Conference Paper

References (20)

1. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters," in OSDI'04: Sixth Symposium on Operating System Design and Implementation, December 2004.
2. S. Ghemawat, H. Gobioff, and S.-T. Leung, "The google file system," in 19th ACM Symposium on Operating Systems Principles, October 2003.
3. F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, and D. A. Wallach, "Bigtable: A distributed storage system for structured data," in Proc. OSDI, 2006, pp. 205-218.
4. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels, "Dynamo: amazon's highly available key-value store," SIGOPS Oper. Syst. Rev., vol. 41, no. 6, pp. 205-220, 2007.
5. E. A. Brewer, "Towards robust distributed systems (abstract)," in PODC '00: Proceedings of the nineteenth annual ACM symposium on Principles of distributed computing. New York, NY, USA: ACM, 2000, p. 7.
6. S. Gilbert and N. Lynch, "Brewer's conjecture and the feasibility of consistent, available, partition-tolerant web services," SIGACT News, vol. 33, no. 2, pp. 51-59, 2002.
7. W. Vogels, "Eventually consistent," Commun. ACM, vol. 52, no. 1, pp. 40-44, 2009.
8. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, "Dryad: Distributed data-parallel programs from sequential building blocks," in European Conference on Computer Systems (EuroSys), March 2007.
9. "Hadoop," http://lucene.apache.org/hadoop.
10. T. Condie, N. Conway, P. Alvaro, and J. M. Hellerstein, "Mapreduce online," in Proc. NSDI, 2010.
11. A. Phanishayee, E. Krevat, V. Vasudevan, D. Andersen, G. Ganger, G. Gibson, and S. Seshan, "Measurement and analysis of tcp throughput collapse in cluster-based storage systems," in Proc. File and Storage Technologies (FAST), Feb 2008.
12. V. Vasudevan, A. Phanishayee, H. Shah, E. Krevat, D. Andersen, G. Ganger, G. Gibson, and B. Mueller, "Safe and effective fine-grained tcp retransmissions for datacenter communication," in Proc. SIGCOMM, 2009.
13. R. Griffith, Y. Chen, J. Liu, A. Joseph, and R. Katz, "Understanding tcp incast throughput collapse in datacenter networks," in Proc. SIGCOMM WREN Workshop, 2009.
14. M. Al-Fares, A. Loukissas, and A. Vahdat, "A scalable, commodity data center network architecture," in Proc. SIGCOMM, 2008.
15. R. N. Mysore, A. Pamboris, N. Farrington, N. Huang, P. Miri, S. Radhakrishnan, V. Subramanya, and A. Vahdat, "Portland: A scalable fault-tolerant layer 2 data center network fabric," in Proc. SIGCOMM, 2009.
16. C. Guo, G. Lu, D. Li, H. Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu, "Bcube: A high performance, server-centric network architecture for modular data centers," in Proc. SIGCOMM, 2009.
17. C. Guo, H. Wu, K. Tan, L. Shiy, Y. Zhang, and S. Luz, "Dcell: A scalable and fault-tolerant network structure for data centers," in Proc. SIGCOMM, 2008.
18. A. Greenberg, N. Jain, S. Kandula, C. Kim, P. Lahiri, D. A. Maltz, P. Patel, and S. Sengupta, "Vl2: A scalable and flexible data center network," in Proc. SIGCOMM, 2009.
19. Y. Yu, P. K. Gunda, and M. Isard, "Distributed aggregation for dataparallel computing: interfaces and implementations," in SOSP '09: Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles. New York, NY, USA: ACM, 2009, pp. 247-260.
20. C. Ranger, R. Raghuraman, A. Penmetsa, G. Bradski, and C. Kozyrakis, "Evaluating mapreduce for multi-core and multiprocessor systems," in Proceedings of the 13th Intl. Symposium on High-Performance Computer Architecture (HPCA), Feb. 2007.