P2P-MapReduce: Parallel data processing in dynamic Cloud environments

Journal of Computer and System Sciences

Volumn 78, Issue 5, 2012, Pages 1382-1402

  Marozzo, Fabrizio ^a   Talia, Domenico ^a,b   Trunfio, Paolo ^a  

^a UNIVERSITY OF CALABRIA   (Italy)

^b ICAR CNR   (Italy)

Author keywords

Cloud computing; MapReduce; P2P MapReduce; Parallel processing; Peer to peer computing

Indexed keywords

CLOUD COMPUTING; DATA HANDLING; FAULT TOLERANCE; MIDDLEWARE; PLATFORM AS A SERVICE (PAAS);

CLOUD COMPUTING ENVIRONMENTS; MAP-REDUCE; MASTER-SLAVE ARCHITECTURE; P2P-MAPREDUCE; PARALLEL DATA PROCESSING; PARALLEL PROCESSING; PEER-TO-PEER COMPUTING; PROTOTYPE IMPLEMENTATIONS;

PEER TO PEER NETWORKS;

EID: 84861610314     PISSN: 00220000     EISSN: 10902724     Source Type: Journal    
DOI: 10.1016/j.jcss.2011.12.021     Document Type: Conference Paper

References (25)

1. J. Dean, S. Ghemawat, MapReduce: Simplified data processing on large clusters, in: 6th USENIX Symposium on Operating Systems Design and Implementation (OSDI04), San Francisco, USA, 2004.
2. Hadoop http://hadoop.apache.org (site visited December 2010)
3. Amazon Elastic MapReduce http://aws.amazon.com/elasticmapreduce (site visited December 2010)
4. Mapper API for Google App Engine http://googleappengine.blogspot.com/ 2010/07/introducing-mapper-api.html (site visited December 2010)
5. J. Dean, and S. Ghemawat MapReduce: Simplified data processing on large clusters Comm. ACM 51 1 2008 107 113
6. Googles Map Reduce http://labs.google.com/papers/mapreduce.html (site visited December 2010)
7. F. Marozzo, D. Talia, P. Trunfio, Adapting MapReduce for dynamic environments using a peer-to-peer model, in: 1st Workshop on Cloud Computing and its Applications (CCA08), Chicago, USA, 2008.
8. F. Marozzo, D. Talia, and P. Trunfio A peer-to-peer framework for supporting MapReduce applications in dynamic Cloud environments N. Antonopoulos, L. Gillam, Cloud Computing: Principles, Systems and Applications 2010 Springer 113 125 Chapter 7
9. A. Dou, V. Kalogeraki, D. Gunopulos, T. Mielikainen, V.H. Tuulos, Misco: A MapReduce framework for mobile systems, in: 3rd Int. Conference on Pervasive Technologies Related to Assistive Environments (PETRA10), New York, USA, 2010.
10. Gridgain http://www.gridgain.com (site visited December 2010)
11. Skynet http://skynet.rubyforge.org (site visited December 2010)
12. MapSharp http://mapsharp.codeplex.com (site visited December 2010)
13. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, G. Fox, Twister: A runtime for iterative MapReduce, in: 1st International Workshop on MapReduce and its Applications (MAPREDUCE10), Chicago, USA, 2010.
14. Disco http://discoproject.org (site visited December 2010)
15. Y. Gu, and R. Grossman Sector and sphere: The design and implementation of a high performance data Cloud Philos. Trans. Ser. A Math. Phys. Eng. Sci. 367 1897 2009 2429 2445
16. M. Zaharia, A. Konwinski, A.D. Joseph, R.H. Katz, I. Stoica, Improving MapReduce performance in heterogeneous environments, in: 8th USENIX Symposium on Operating Systems Design and Implementation (OSDI08), San Diego, USA, 2008.
17. T. Condie, N. Conway, P. Alvaro, J.M. Hellerstein, K. Elmeleegy, R. Sears, MapReduce online, in: 7th USENIX Symposium on Networked Systems Design and Implementation (NSDI10), San Jose, USA, 2010.
18. C. Ranger, R. Raghuraman, A. Penmetsa, G. Bradski, C. Kozyrakis, Evaluating MapReduce for multi-core and multiprocessor systems, in: 13th International Symposium on High-Performance Computer Architecture (HPCA07), Phoenix, USA, 2007.
19. H. Lin, X. Ma, J. Archuleta, W.-c. Feng, M. Gardner, Z. Zhang, MOON: MapReduce on opportunistic eNvironments, in: 19th International Symposium on High Performance Distributed Computing (HPDC10), Chicago, USA, 2010.
20. B. Tang, M. Moca, S. Chevalier, H. He, G. Fedak, Towards MapReduce for desktop Grid computing, in: 5th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC10), Fukuoka, Japan, 2010.
21. G. Fedak, H. He, and F. Cappello BitDew: A data management and distribution service with multi-protocol and reliable file transfer J. Netw. Comput. Appl. 32 5 2009 961 975
22. H. Garcia-Molina Election in a distributed computing system IEEE Trans. Comput. 31 1 1982 48 59
23. L. Gong JXTA: A network programming environment IEEE Internet Comput. 5 3 2001 88 95
24. I. Stoica, R. Morris, D. Liben-Nowell, D.R. Karger, M.F. Kaashoek, F. Dabek, and H. Balakrishnan Chord: A scalable peer-to-peer lookup protocol for internet applications IEEE/ACM Trans. Networking 11 1 2003 17 32
25. K. Albrecht, R. Arnold, M. Gahwiler, R. Wattenhofer, Join and leave in peer-to-peer systems: The steady state statistics service approach, Technical Report 411, ETH Zurich, 2003.