Grid and P2P middleware for wide-area parallel processing

Concurrency and Computation: Practice and Experience

Volumn 23, Issue 5, 2011, Pages 458-476

  Xhafa, Fatos ^a   Pllana, Sabri ^b   Barolli, Leonard ^c   Spaho, Evjola ^c  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

^b UNIVERSITY OF VIENNA   (Austria)

^c FUKUOKA INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

communications libraries; e Science applications; Grid computing; middleware; P2P computing; parallel processing

Indexed keywords

DATA HANDLING; E-SCIENCE; LIBRARIES; MIDDLEWARE; PEER TO PEER NETWORKS;

COMMUNICATION LIBRARY; DISTRIBUTED PLATFORMS; E-SCIENCE APPLICATIONS; HIGH PERFORMANCE COMPUTING; P2P COMPUTING; PARALLEL PROCESSING; REAL-LIFE APPLICATIONS; SCIENCE AND ENGINEERING;

GRID COMPUTING;

EID: 79952466726     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.1657     Document Type: Conference Paper

References (74)

1. Foster I, Kesselman C,. The Grid-Blueprint for a New Computing Infrastructure. Morgan: Los Altos, CA, 1998.
2. Foster I, Kesselman C, Tuecke S,. The anatomy of the grid. International Journal of Supercomputer Applications 2001; 15 (3): 200-222.
3. Arnold D, Agrawal S, Blackford S, Dongarra J, Miller M, Seymour K, Sagi K, Shi Z, Vadhiyar S,. Users' Guide to NetSolve V1.4.1. Technical Report, ICL-UT-02-05, University of Tennessee, 2002.
4. Available at: [August 2010 ].
5. Wright SJ,. Solving optimization problems on computational grids. Optima 2001; 65: 8-13.
6. Linderoth L, Wright SJ,. Decomposition algorithms for stochastic programming on a computational grid. Computational Optimization and Applications 2003; 24: 207-250.
7. Abramson D, Giddy J, Kotler L,. High performance parametric modeling with Nimrod/G: killerapplication for the global grid? Proceedings of 14th International Parallel and Distributed Processing Symposium (IPDPS 2000). IEEE CS: Silver Spring, MD, 2000; 520-528. (Pubitemid 30591179)
8. Casanova H, Zagorodnov D, Berman F, Legrand A,. Heuristics for scheduling parameter sweep applications in Grid environments. Proceedings of the Ninth Heterogeneous Computing Workshop. IEEE CS: Silver Spring, MD, 2000; 349.
9. Stockinger H, Pagni M, Cerutti L, Falquet L,. Grid approach to embarrassingly parallel CPU-intensive bioinformatics problems. Second IEEE International Conference on e-Science and Grid Computing (e-Science 2006), Amsterdam, Netherlands, 4-6 December 2006; 58.
10. Zheng C, Katz MJ, Papadopoulos PM, Abramson D, Ayyub S, Enticott C, Garic S, Goscinski W, Arzberger P, Lee BS, Phatanapherom S, Sriprayoonsakul S, Uthayopas P, Tanaka Y, Tanimura Y, Tatebe O,. Lessons learned through driving science applications in the PRAGMA grid. International Journal of Web and Grid Services 2007; 3 (3): 287-312. (Pubitemid 47617192)
11. Chervenak A, Foster I, Kesselman C, Salisbury Ch, Tuecke S,. The data grid: towards an architecture for the distributed management and analysis of large scientific data sets. Journal of Network and Computer Applications 2001; 23: 187-200.
12. Oram A,. Peer-to-Peer: Harnessing the Power of Disruptive Technologies. O'Reilly, 2001. Available at:.
13. Crowcroft J, Moreton T, Pratt I, Twigg A,. Peer-to-peer technologies. The Grid: Blueprint for a New Computing Infrastructure, ch. 29, Foster I, Kesselman C, (eds.). Morgan: Los Altos, CA, 2003; 593-622.
14. Oaks S, Traversat B, Gong L,. JXTA in a Nutshell. O'Reilly, 2003. Available at:.
15. Baker M, Carpenter B, Shafi A,. MPJ Express: Towards thread safe Java HPC. The IEEE International Conference on Cluster Computing, Barcelona, Spain, 25-28 September 2006; 1-10.
16. Anderson DP, Fedak G,. The computational and storage potential of volunteer computing. Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid. IEEE Computer Society: Silver Spring, MD, 2006; 73-80. (Pubitemid 44761684)
17. Tanaka K, Uehara M, Mori H,. The performance evaluation of a grid using windows PCs. International Journal of Web and Grid Services 2008; 4 (4): 395-417.
18. Bal H, Casanova H, Dongarra J, Matsuoka S,. Application-level tools. The Grid: Blueprint for a New Computing Infrastructure, ch. 24, Foster I, Kesselman C, (eds.). Morgan: Los Altos, CA, 2003; 463-489.
19. Kra D,. Six levels of grid application enablement. IBM, 2004.
20. Berman F, Chien A, Cooper K, Dongarra J, Foster I, Gannon D, Johnsson L, Kennedy K, Kesselman C, Mellor-Crummey J, Reed D, Torczon L, Wolski R,. The GrADS project: Software support for high-level grid application development. International Journal of High Performance Computing Applications 2001; 15: 327-344. (Pubitemid 35008997)
21. Karonis N, Toonen B, Foster I,. MPICH-G2: A grid-enabled implementation of the message passing interface. Journal of Parallel and Distributed Computing 2003; 63 (5): 551-563. (Pubitemid 36831722)
22. Brune MA, Fagg GE, Resch M,. Message-passing environments for meta-computing. Future Generation Computer Systems 1999; 15 (5-6): 699-712.
23. Kielmann Th, Bal HE, Gorlatch S, Verstoep K, Hofman R,. Network performance-aware collective communication for clustered wide area systems. Parallel Computing 2001; 27 (11): 1431-1456. (Pubitemid 32723673)
24. Fagg GE, Dongarra JJ,. FT-MPI: Fault Tolerant MPI, supporting dynamic applications in a dynamic world. Euro PVM/MPI User's Group Meeting (Lecture Notes in Computer Science, vol. 1908). Springer: Berlin, 2000; 346-353.
25. Maassen J, Kielmann Th, Bal HE,. GMI: Flexible and efficient group method invocation for parallel programming. Sixth Workshop on Languages, Compilers, and Run-time Systems for Scalable Computers, Washington, DC, U.S.A., 22-23 March 2002; 1-6.
26. Maassen J, Kielmann Th, Bal HE,. Parallel application experience with replicated method invocation. Concurrency and Computation: Practice and Experience 2001; 13 (8-9): 681-712. (Pubitemid 32651267)
27. Frey J, Tannenbaum T, Foster I, Livny M, Tuecke S,. Condor-G: A computation management agent for multi-institutional grids. Cluster Computing 2002; 5 (3): 237-246.
28. Brzezniak M, Makiela T, Meyer N,. Integration of NetSolve with Globus-based grids. Proceedings of Fifth IEEE/ACM International Workshop on Grid Computing, Pittsburgh, U.S.A., 8 November 2004; 449-455.
29. Available at: [August 2010 ].
30. Chrysanthakopoulos G, Singh S,. An asynchronous messaging library for C#, synchronization and concurrency. Object-oriented Languages (SCOOL) at OOPSLA 2005 Workshop, San Diego, CA, 2005.
31. Qiu X, Fox G, Yuan H, Bae S, Chrysanthakopoulos G, Nielsen HF,. High performance multi-paradigm messaging runtime integrating Grids and multicore systems. Third IEEE International Conference on e-Science and Grid Computing, Bangalore, India, 10-13 December 2007; 407-414.
32. Prodan R, Fahringer Th,. ZENTURIO: A grid middleware-based tool for experiment management of parallel and distributed applications. Journal of Parallel and Distributed Computing 2004; 64 (6): 693-707. (Pubitemid 40000778)
33. Fahringer Th, Jugravu A, Pllana S, Prodan R, Seragiotto C Jr, Truong HL,. ASKALON: A tool set for cluster grid computing. Concurrency and Computation: Practice and Experience 2005; 17: 1-27.
34. Li Z, Parashar M,. A computational infrastructure for grid-based asynchronous parallel applications. Proceedings of the 16th International Symposium on High Performance Distributed Computing, 2007; 229-230. (Pubitemid 47291216)
35. Denis A, Prez Ch, Priol Th,. PadicoTM: An open integration framework for communication middleware and runtimes. Future Generation Computer Systems 2003; 19 (4): 575-585.
36. Skillicorn D, Talia D,. Models and languages for parallel computation. ACM Computing Surveys 1998; 30 (2): 123-169.
37. Lee C, Matsuoka S, Talia D, Sussman A, Karonis N, Allen G, Saltz J,. A Grid programming primer. Global Grid Forum, Advanced Programming Models Working Group, 2001.
38. Laforenza D,. Grid programming: Some indications where we are headed. Parallel Computing 2002; 28 (12): 1733-1752. (Pubitemid 35412374)
39. Ching Lian Ch, Tang F, Issac P, Krishnan A,. GEL: Grid execution language. Journal of Parallel and Distributed Computing 2005; 65 (7): 857-869. (Pubitemid 40749341)
40. Tröger P, von Löwis M, Polze A,. The Grid-Occam project. Grid Services Engineering and Management (Lecture Notes in Computer Science, vol. 3726). Springer: Berlin, 2004; 151-164. (Pubitemid 39744156)
41. Allen G, Kelly D, Tom G, Andrei H, Hartmut K, Thilo K, M. Andr, Rob VN, Alexander R, Florian S, Thorsten S, Ed S, Brygg U,. The grid application toolkit: Toward generic and easy application programming interfaces for the grid. Proceedings of the IEEE 2005; 93 (3): 534-550.
42. Wang X, Xiao L, Li W, Yu H, Xu Zh,. Abacus: A service-oriented programming language for grid applications. IEEE International Conference on Services Computing, Orlando, FL, U.S.A., 11-15 July 2005; 225-232.
43. De Sterck H, Markel RS, Phol T, Rde U,. A lightweight Java taskspaces framework for scientific computing on computational grids. Proceedings of the 2003 ACM Symposium on Applied Computing, Melbourne, FL, U.S.A., 9-12 March 2003; 1024-1030.
44. Aldinucci M, Campa S, Danelutto M, Laforenza D, Scarponi L, Vanneschi M, Zoccolo C,. Components for high performance Grid programming in Grid.it. Proceedings of the Workshop on Component Models and Systems for Grid Applications (CoreGRID Series). Springer: Berlin, 2005; 19-38.
45. Murphy T,. ML grid programming with ConCert. Proceedings of the 2006 Workshop on ML, Portland, OR, U.S.A., 16 September 2006; 2-11.
46. Ben Hassen S, Bal HE, Jacobs CJ,. A task- and data-parallel programming language based on shared objects. ACM Transactions on Programming Languages and Systems 1998; 20 (6): 1131-1170.
47. Tudor D, Cretu V,. Experiences on Grid shared data programming. Proceedings of International Conference on Complex, Intelligent and Software Intensive Systems (CISIS 2008), Barcelona, Spain, 4-7 March 2008; 387-393.
48. Xhafa F, Barolli L, Daradoumis Th, Fernandez R, Caballé S,. JXTA-Overlay: An interface for efficient peer selection in P2P JXTA-based systems. Computer Standards and Interfaces 2009; 31 (5): 886-893.
49. Xhafa F, Barolli L, Daradoumis T, Fernandez R, Caball S,. Extension and evaluation of JXTA protocols for supporting reliable P2P distributed computing. International Journal of Web Information Systems 2008; 4 (1): 121-135.
50. Shudo K, Tanaka Y, Sekiguchi S,. P3: P2P-based middleware enabling transfer and aggregation of computational resources. Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05), Cardiff, U.K., 9-12 May 2005; 259-266.
51. Saitoh Y, Sumitomo K, Izaiku T, Oono T, Yagyu K, Wang H, Guo M,. JXTPIA: A JXTABased P2P network interface and architecture for Grid computing. Proceedings of 2005 International Conference on High Performance Computing and Networks (HPCC 2005) (Lecture Notes in Computer Science, vol. 3726). Springer: Berlin, 2005; 409-418.
52. Therning N, Bengtsson L,. Jalapeno: Decentralized grid computing using peer-to-peer technology. Proceedings of the Second Conference on Computing Frontiers, Ischia, Italy, 4-6 May 2005; 59-65.
53. Verbeke J, Nadgir N, Ruetsch G, Sharapov I,. Framework for Peer-to-peer Distributed Computing in a Heterogeneous, Decentralized Environment (Lecture Notes in Computer Science, vol. 2536). Springer: Berlin, 2002; 1-12.
54. Andrade N, Cirne W, Brasileiro FV, Roisenberg P,. In Ourgrid: An Approach to Easily Assemble Grids with Equitable Resource Sharing, (Lecture Notes in Computer Science, vol. 2862), Feitelson DG, Rudolph L, Schwiegelshohn U, (eds.), JSSPP. Springer: Berlin, 2003; 61-86.
55. Taylor I, Shields M, Wang I,. Resource management for the Triana peer-to-peer services. Grid Resource Management: State of the Art and Future Trends, Nabrzyski J, Schopf JM, Weglarz J, (eds.). Kluwer: Dordrecht, 2004; 451-462.
56. Cappello F, Djilali S, Fedak G, Herault T, Magniette F, Neri V, Lodygensky O,. Computing on large scale distributed systems: XtremWeb architecture, programming models, security, tests and convergence with grid. Future Generation Computer Systems 2005; 21 (3): 417-437.
57. Genaud S, Rattanapoka Ch,. P2P-MPI: A peer-to-peer framework for robust execution of message passing parallel programs on grids. Journal of Grid Computing 2007; 5 (1): 27-42. (Pubitemid 46909011)
58. Kurmanowytsch R, Kirda E, Kerer C, Dustdar S,. OMNIX: A topology-independent P2P middleware. CAiSE Workshops, Information Systems for a Connected Society, Klagenfurt/Velden, Austria, vol. 75, 16-20 June 2003; 47-57.
59. Ng WS, Ooi BC, Tan KL,. BestPeer: A self-configurable peer-to-peer system. Proceedings of the 18th International Conference on Data Engineering, IEEE Computer Society: San Jose, CA, 26 February-1 March 2002; 272.
60. Dabek F, Zhao B, Druschel P, Kubiatowicz J, Stoica I,. Towards a common API for structured peer-to-peer overlays. Proceedings of IPTPS'03 (Lecture Notes in Computer Science, vol. 2735). Springer: Berlin, 2003; 33-44.
61. Li M, Sun X-H, Deng Q, Ni J, (eds.). Grid and Cooperative Computing, Second International Workshop, GCC 2003, part I, Shanghai, China (Lecture Notes in Computer Science, vol. 3032). Springer, 2004; 277-284.
62. Antoniu G, Boug L, Jan M,. JuxMem: An adaptive supportive platform for data sharing on the grid. Scalable Computing: Practice and Experience 2005; 6 (3): 45-55.
63. Evans H, Dickman P,. Peer-to-peer programming with Teaq. Web Engineering and Peer-to-peer Computing (Lecture Notes in Computer Science, vol. 2376). Springer: Berlin, 2008; 289-294.
64. Riedel M, Streit A, Wolf F, Lippert Th, Kranzlmller D,. Classification of different approaches for e-Science applications in next generation computing infrastructures. IEEE Fourth International Conference on e-Science, Indianapolis, IN, U.S.A., 7-12 December 2008; 198-205.
65. Talbi E-G, Bendjoudi A, Melab N,. A parallel peer to peer branch and bound algorithm for computational Grids. Proceedings of the International Workshop on Peer to Peer, Parallel, Grid and Internet Computing (3PGIC-2007), Vienna, Austria, 10-12 April 2007; 271-278.
66. Tagashira S, Mito M, Fujita S,. Towards generic solver of combinatorial optimization problems with autonomous agents in P2P networks. Transactions on Information and Systems E89-D 2005; 6: 1940-1947.
67. Laredo JL, Eiben AE, Steen M, Castillo PA, Mora AM, Merelo JJ,. P2P Evolutionary algorithms: A suitable approach for tackling large Instances in hard optimization problems. Proceedings of the 14th Euro-Par Conference on Parallel Processing (Lecture Notes in Computer Science, vol. 5168). Springer: Berlin, 2008; 622-631.
68. Guan H,. A study of parallel data mining in a peer-to-peer network. Concurrent Engineering 2007; 15 (3): 281-289.
69. Fox G, Pallickara Sh, Rao X,. Towards enabling peer to peer grids. Journal of Concurrency and Computation: Practice and Experience 2008; 17 (7-8): 1109-1131.
70. Reddy MV, Srinivas AV, Gopinath T, Janakiram D,. Vishwa: A reconfigurable P2P middleware for Grid computations. Thirty-fifth International Conference on Parallel Processing (ICPP-2006), Columbus, OH, U.S.A., 14-18 August 2006; 381-390.
71. Chazapis A, Zissimos A,. A peer-to-peer replica management service for high-throughput Grids. Proceedings of the 2005 International Conference on Parallel Processing. IEEE CS: Silver Spring, MD, 2005; 443-451. (Pubitemid 43898254)
72. Planet lab. Available at: [August 2010 ].
73. Xhafa F, Paniagua C, Barolli L, Caballé S,. A parallel grid-based implementation for real time processing of event log data in collaborative applications. International Journal of Web and Grid Services 2010; 6 (2): 124-140.
74. Comito C, Talia D, Trunfio P,. Grid services: Principles, implementations and use. International Journal of Web and Grid Services 2005; 1 (1): 48-68.