An advanced MapReduce: Cloud MapReduce, enhancements and applications

IEEE Transactions on Network and Service Management

Volumn 11, Issue 1, 2014, Pages 101-115

  Dahiphale, Devendra ^a   Karve, Rutvik ^a   Vasilakos, Athanasios V ^b   Liu, Huan ^c   Yu, Zhiwei ^d   Chhajer, A ^a   Wang, Jianmin ^d   Wang, Chaokun ^d  

^a Department of Electronics and Telecommunication   (India)

^b KUWAIT UNIVERSITY   (Kuwait)

^c Jamo ^*  (United States)

^d TSINGHUA UNIVERSITY   (China)

Author keywords

Cloud computing; MapReduce; pipelining; spot market; stream processing

Indexed keywords

CLOUD COMPUTING; DATA PROCESSING; PIPE LININGS; SCALABILITY;

CONFIGURABLE COMPUTING; DATA INTENSIVE; MAP-REDUCE; REALTIME MULTIMEDIA; SPOT INSTANCES; SPOT MARKET; STREAM DATA PROCESSING; STREAM PROCESSING;

COSTS;

EID: 84900008084     PISSN: 19324537     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSM.2014.031714.130407     Document Type: Article

References (21)

1. J. Dean and S. Ghemawat, "MapReduce: simplified data processing on large clusters," in OSDI, 2004, pp. 137-150.
2. H. Liu and D. Orban, "Cloud mapreduce: a mapreduce implementation on top of a cloud operating system," in Proc. 2011 IEEE International Symposium on Cluster Computing and the Grid, vol. 0, pp. 464-474.
3. "Amazon products and services. " Available: http://aws. amazon. com/ products/
4. "Hadoop. " Available: http://hadoop. apache. org/
5. R. Karve, D. Dahiphale, and A. Chhajer, "Optimizing cloud mapreduce for processing stream data using pipelining," in EMS, 2011, pp. 344-349.
6. Z. Yang, S. Kamata, and A. Ahrary, "NIR: content based image retrieval on cloud computing," in Proc. 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems, vol. 3, pp. 556-559.
7. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears, "MapReduce," in NSDI, 2010, pp. 313-328.
8. Z. Yu, C. Wang, C. D. Thomborson, J. Wang, S. Lian, and A. V. Vasilakos, "Multimedia applications and security in mapreduce: opportunities and challenges," Concurrency and Computation: Practice and Experience, vol. 24, no. 17, pp. 2083-2101, 2012.
9. "Windows azure services. " Available: http://www. windowsazure. com/ en-us/documentation/
10. W. Vogels, "Eventually consistent," Commun. ACM, vol. 52, no. 1, pp. 40-44, 2009.
11. A. Phanishayee, E. Krevat, V. Vasudevan, D. G. Andersen, G. R. Ganger, G. A. Gibson, and S. Seshan, "Measurement and analysis of tcp throughput collapse in cluster-based storage systems," in FAST, 2008, pp. 175-188.
12. V. Vasudevan, A. Phanishayee, H. Shah, E. Krevat, D. G. Andersen, G. R. Ganger, G. A. Gibson, and B. Mueller, "Safe and effective finegrained tcp retransmissions for datacenter communication," in Proc. 2009 SIGCOMM, pp. 303-314.
13. Y. Chen, R. Griffith, J. Liu, R. H. Katz, and A. D. Joseph, "Understanding TCP incast throughput collapse in datacenter networks," in WREN, 2009, pp. 73-82.
14. N. Chohan, C. Castillo, M. Spreitzer, M. Steinder, A. Tantawi, and C. Krintz, "See spot run: using spot instances for mapreduce workflows," in Proc. 2010 USENIX Conference on Hot Topics in Cloud Computing, ser. HotCloud'10. USENIX Association, 2010, pp. 7-7. Available: http://dl. acm. org/citation. cfm?id=1863103. 1863110
15. S. Yi, D. Kondo, and A. Andrzejak, "Reducing costs of spot instances via checkpointing in the amazon elastic compute cloud," in IEEE CLOUD, 2010, pp. 236-243.
16. C. Ranger, R. Raghuraman, A. Penmetsa, G. R. Bradski, and C. Kozyrakis, "Evaluating mapreduce for multi-core and multiprocessor systems," in HPCA, 2007, pp. 13-24. (Pubitemid 47208148)
17. R. Cytron and V. Bala, "Dynamo: a transparent, dynamic, native binary optimizer (panel session)," in Dynamo, 2000, p. 75.
18. M. Al-Fares, A. Loukissas, and A. Vahdat, "A scalable, commodity data center network architecture," in Proc. 2008 SIGCOMM, pp. 63-74.
19. R. N. Mysore, A. Pamboris, N. Farrington, N. Huang, P. Miri, S. Radhakrishnan, V. Subramanya, and A. Vahdat, "Portland: a scalable faulttolerant layer 2 data center network fabric," in Proc. 2009 SIGCOMM, pp. 39-50.
20. C. Guo, G. Lu, D. Li, H. Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu, "Bcube: a high performance, server-centric network architecture for modular data centers," in Proc. 2009 SIGCOMM, pp. 63-74.
21. C. Guo, H. Wu, K. Tan, L. Shi, Y. Zhang, and S. Lu, "Dcell: a scalable and fault-tolerant network structure for data centers," in Proc. 2008 SIGCOMM, pp. 75-86.