Internet-scale support for map-reduce processing

Journal of Internet Services and Applications

Volumn 4, Issue 1, 2013, Pages 1-17

  Costa, Fernando ^a   Veiga, Luís ^a   Ferreira, Paulo ^a  

^a UNIVERSITY OF LISBON   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

BANDWIDTH; FAULT TOLERANT COMPUTER SYSTEMS;

CENTRALIZED ARCHITECTURE; CLIENT COMMUNICATIONS; COMPLEX APPLICATIONS; COMPUTING RESOURCE; DISTRIBUTED MODELING; MASTER/WORKER MODELS; ORDERS OF MAGNITUDE; VOLUNTEER COMPUTING;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 84897421484     PISSN: 18674828     EISSN: 18690238     Source Type: Journal    
DOI: 10.1186/1869-0238-4-18     Document Type: Article

References (23)

1. Anderson DP, Cobb J, Korpela E, Lebofsky M, Werthimer D (2002) SETI@home: an experiment in public-resource computing. Commun ACM 45: 56-61
2. Beberg AL, Ensign DL, Jayachandran G, Khaliq S, Pande VS Folding@home: Lessons from eight years of volunteer distributed computing. In: Parallel & Distributed Processing, 2009. IPDPS 2009. IEEE International Symposium on, 23-29 May 2009, IEEE Computer Society, Washington, DC, USA, pp 1-8
3. Anderson DP (2004) BOINC: A system for public-resource computing and storage. In: Proceedings of the 5th IEEE/ACM International workshop on grid computing, GRID'04, IEEE Computer Society, Washington, DC, USA, pp 4-10
4. Cisco I (2012) Cisco visual networking index: forecast and methodology, 2011-2016. CISCO White Paper. http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/white_paper_c11-481360_ns827_Networking_Solutions_White_Paper.html
5. Snir M, Otto SW, Walker DW, Dongarra J, Huss-Lederman S (1995) MPI: The Complete Reference. MIT Press, Cambridge, MA, USA
6. da Silva Silva FJ, Kon F, Goldman A, Finger M, de Camargo RY, Filho FC, Costa FM (2010) Application execution management on the InteGrade opportunistic grid middleware. J Parallel Distributed Comput 70(5): 573-583
7. Dean J, Ghemawat S (2008) MapReduce: simplified data processing on large clusters. Commun. ACM 51: 107-113
8. Lamport L, Shostak R, Pease M (1982) The Byzantine generals problem. ACM Trans Program Lang Syst 4(3): 382-401
9. Cirne W, Brasileiro F, Andrade N, Costa L, Andrade A, Novaes R, Mowbray M (2006) Labs of the world, unite!!! J Grid Comput 4: 225-246
10. Cappello F, Djilali S, Fedak G, Herault T, Magniette F, Néri V, Lodygensky O (2005) Computing on large-scale distributed systems: XtremWeb architecture, programming models, security, tests and convergence with grid. Future Gener Comput Syst 21: 417-437
11. Costa F, Kelley I, Silva L, Fedak G (2008) Optimizing data distribution in desktop grid platforms. Parallel Process Lett (PPL) 18(3): 391-410
12. Costa F, Silva L, Fedak G, Kelley I (2008) Optimizing the data distribution layer of BOINC with BitTorrent. Parallel Distributed Process Symp Int 0: 1-8
13. Fedak G, He H, Cappello F (2008) BitDew: a programmable environment for large-scale data management and distribution. In: Proceedings of the 2008 ACM/IEEE conference on Supercomputing, SC'08, vol 1-45. IEEE Press, Piscataway, NJ, USA, p 12
14. Chun B, Culler D, Roscoe T, Bavier A, Peterson L, Wawrzoniak M, Bowman M (2003) PlanetLab: an overlay testbed for broad-coverage services. SIGCOMM Comput Commun Rev 33: 3-12
15. Marsaglia G, Bray TA (1964) A convenient method for generating normal variables. Siam Rev 6(3): 260-264
16. Kondo D, Javadi B, Malecot P, Cappello F, Anderson DP (2009) Cost-benefit analysis of Cloud Computing versus desktop grids. In: Proceedings of the 2009 IEEE International symposium on parallel& distributed processing, IPDPS'09, IEEE Computer Society, Washington, DC, USA, pp 1-12
17. Marozzo F, Talia D, Trunfio P (2012) P2P-MapReduce: Parallel data processing in dynamic Cloud environments. J Comput Syst Sci 78(5): 1382-1402
18. Gong L (2001) JXTA: A network programming environment. Internet Comput IEEE 5(3): 88-95
19. th ACM International symposium on high performance distributed computing, HPDC'10, ACM, New York, NY, USA, pp 95-106
20. Tang B, Moca M, Chevalier S, He H, Fedak G (2010) Towards MapReduce for desktop grid computing. In: Proceedings of the 2010 International conference on P2P, parallel, grid, cloud and internet computing, 3PGCIC'10, IEEE Computer Society, Washington, DC, USA, pp 193-200
21. Moca M, Silaghi G, Fedak G (2011) Distributed results checking for MapReduce in volunteer computing. In: Parallel and distributed processing workshops and Phd Forum (IPDPSW), 2011 IEEE international symposium on, IEEE Computer Society, Washington, DC, USA, pp 1847-1854
22. Perry R (2009) High speed raster image streaming for digital presses using the Hadoop file system. HP Laboratories, HPL-2009-345, Technical Report. http://www.hpl.hp.com/techreports/2009/HPL-2009-345.html
23. Ganapathiraju M, Manoharan V, Klein-Seetharaman J (2004) BLMT. Appl Bioinformatics 3(2-3): 193-200