Computing on large-scale distributed systems: XtremWeb architecture, programming models, security, tests and convergence with grid

Future Generation Computer Systems

Volumn 21, Issue 3, 2005, Pages 417-437

  Cappello, Franck ^a   Djilali, Samir ^a   Fedak, Gilles ^a   Herault, Thomas ^a   Magniette, Frédéric ^a   Néri, Vincent ^b   Lodygensky, Oleg ^c  

^a INRIA   (France)

^b UFR 919 Laboratoire d'Informatique Pour la Mécanique et les Sciences de l'Ingénieur   (France)

^c UNIVERSITÉ PARIS SUD   (France)

Author keywords

Global Computing systems; Large scale distributed systems; XtremWeb

Indexed keywords

COMPUTER PROGRAMMING; HIGH ENERGY PHYSICS; MOLECULAR DYNAMICS; PROTEINS; SECURITY OF DATA; SUPERCOMPUTERS; WORLD WIDE WEB;

GLOBAL COMPUTING SYSTEMS; HIGH-PERFORMANCE COMPUTING (HPC); LARGE-SCALE DISTRIBUTED SYSTEMS; XTREMWEB;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 10644223387     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2004.04.011     Document Type: Article

References (53)

1. Web Services. www.webservices.org.
2. Mithral Communications and Design Inc., The COSM Project, 2002. http://www.mithral.com/projects/cosm/.
3. I. Foster, C. Kesselman, J. Nick, S. Tuecke, The physiology of the grid: an open grid services architecture for distributed systems integration, Globus Project, 2002, www.globus. org/research/papers/ogsa.pdf.
4. A.D. Alexandrov, M. Ibel, K.E. Schauser, C.J. Scheiman, SuperWeb: towards a global web-based parallel computing infrastructure, in: Proceedings of the 11th IEEE International Parallel Processing Symposium (IPPS), April 1997.
5. J. Almond, M. Romberg, The Unicore project: uniform access to supercomputing over the Web, in: Proceedings of the 40th Cray User Group Meeting, Stuttgart, Germany, 1998.
6. D. Anderson, BOINC: Berkeley Open Infrastructure for Network Computing, 2002.
7. R. Baldoni, C. Marchetti, Three-tier replication for FT-CORBA infrastructures, Software Pract. Exper. 33 (2003) 767-797.
8. A. Barak, S. Guday, R.G. Wheeler, The MOSIX distributed operating system: load balancing for UNIX v. 672, Springer-Verlag, New York, NY, 1993, p. 221.
9. A. Baratloo, M. Karaul, Z. Kedem, P. Wyckoff, Charlotte: metacomputing on the Web, in: Proceedings of the Ninth Conference on Parallel and Distributed Computing Systems, 1996.
10. E. Belani, A. Vahdat, T. Anderson, M. Dahlin, The CRISIS wide area security architecture, in: Proceedings of the USENIX Security Symposium, San Antonio, Texas, 1998.
11. G. Bosilca, A. Bouteiller, F. Cappello, S. Djilali, G. Fédak, C. Germain, T. Hérault, P. Lemarinier, O. Lodygensky, F. Magniette, V. Néri, A. Selikhov, MPICH-V: Toward a Scalable Fault Tolerant MPI for Volatile Nodes, SC02, Baltimore, USA, November 2002.
12. A. Bouteiller, F. Cappello, T. Hérault, G. Krawezik, P. Lemarinier, F. Magniette, MPICH-V2: A Scalable Fault Tolerant MPI for Volatile Nodes Based on the Pessimistic Sender Based Message Logging, Proceedings of the 16th High Performance Networking and Computing conference (SC'03), Phoenix, USA, November 2003.
13. T. Brecht, H. Sandhu, M. Shan, J. Talbot, ParaWeb: towards world-wide super-computing, in: Proceedings of the Seventh ACM SIGOPS European Workshop on System Support for Worldwide Applications, 1996.
14. H. Casanova, J. Dongarra, NetSolve: a network-enabled server for solving computational science problems, Int. J. Supercomput. Appl. High Perform. Comput., Sage Publications 11 (3) (1997) 212-223.
15. B.O. Christiansen, P. Cappello, M.F. Ionescu, M.O. Neary, K.E. Schauser, D. Wu, Javelin: Internet-based parallel computing using Java, Concurrency Pract. Exper. 9 (11) (1997) 1139-1160.
16. K. Czajkowski, S. Fitzgerald, I. Foster, C. Kesselman, Grid information services for distributed resource sharing, in: High-Performance Distributed Computing (HPDC-10), IEEE Press, 2001.
17. S. Djilali, P2P-RPC: programming scientific applications on peer to peer systems with remote procedure call, in: I. Press (Ed.), Proceedings of the Third International Symposium on Cluster Computing and the Grid, Tokyo, Japan, November 2003.
18. G. Fagg, J. Dongarra, FT-MPI: fault tolerant MPI, supporting dynamic applications in a dynamic world, in: Euro PVM/MPI User's Group Meeting 2000, Springer-Verlag, Berlin, Germany, 2000, pp. 346-353.
19. G.E. Fagg, A. Bukovsky, J.J. Dongarra, HARNESS and fault tolerant MPI, Parallel Comput. 27 (11) (2001) 1479-1495.
20. S. Fanning, Napster: a P2P file sharing, 1999. http://www. napster.com.
21. G. Fedak, C. Germain, V. Neri, F. Cappello, XtremWeb: a generic global computing platform (CCGRID-2001), in: Special Session Global Computing on Personal Devices, IEEE Press, 2000.
22. D.O. Feitelson, L. Rudolph, U. Schwiegelshohn, K.C. Sevcik, P. Wong, Theory and practice in parallel job scheduling, in: D.G. Feitelson, L. Rudolph (Eds.), Job Scheduling Strategies for Parallel Processing, Springer-Verlag, 1997, pp. 1-34.
23. M. Fischer, N. Lynch, M. Paterson, Impossibility of distributed consensus with one faulty process, J. ACM 32 (1985) 374-382.
24. I. Foster, A. Iamnitchi, On death, taxes, and the convergence of peer-to-peer and grid computing, in: Proceedings of the Second International Workshop on Peer-to-Peer Systems (IPTPS'03), February 2003.
25. I. Foster, C. Kesselman, J. Nick, S. Tuecke, Grid services for distributed system integration, in: IEEE Comput., June 2002, pp. 37-46.
26. D.P. Ghormley, D. Petrou, S.H. Rodrigues, A.M. Vahdat, T.E. Anderson, GLUnix: a global layer Unix for a network of workstations, Software Pract. Exper. 28 (9) (1998) 929-961.
27. J.P. Goux, S. Kulkarni, J. Linderoth, M. Yoder, An enabling framework for master-worker applications on the computational grid, in: I.C. Society (Ed.), Proceedings of the Ninth IEEE Symposium on High Performance Distributed Computing, Pittsburgh, PA, 2000, pp. 43-50.
28. W. Gropp, E. Lusk, Fault tolerance in MPI programs, Special Issue of the J. High Perform. Comput. Appl., 2002.
29. W. Gropp, E. Lusk, N. Doss, A. Skjellum, High-performance, portable implementation of the MPI message passing interface standard, Parallel Comput. 22 (6) (1996) 789-828.
30. S.M. Inc., RFC: remote procedure call protocol specification version 2, in: Tech. Rep. DARPA-Internet RFC 1057, SUN Microsystems Inc., June 1988.
31. B. Lampson, M. Abadi, M. Burrows, T. Wobber, Authentication in distributed systems: theory and practice, in: Proceedings of the 13th ACM Symposium on Operating Systems Principles, 13-16 October 1991, pp. 165-182.
32. M. Litzkow, M. Livny, M. Mutka, Condor-a hunter of idle workstations, in: Proceedings of the Eighth International Conference of Distributed Computing Systems, IEEE Computer Society Press, Madison, Wisconsin, 1988, pp. 104-111.
33. M.J. Litzkow, M. Livny, M.W. Mutka, Condor-a hunter of idle workstations, in: Proceedings of the Eighth International Conference on Distributed Computing Systems (ICDCS), IEEE Computer Society, Washington, DC, 1988, pp. 104-111.
34. C. Mike, M. Pavel, Subterfugue: a frame-work for observing and playing with the reality of software, http://subterfugue.org/.
35. N. Nisan, S. London, O. Regev, N. Camiel, Globally distributed computation over the interaet-the popcorn project, in: Proceedings for the 18th International Conference on Distributed Computing Systems, 1998.
36. CORBA 2.1 Common Object Request Broker: Architecture and Specification Revision 2.0, July 1995, updated July 1996, http://www.opengroup.org/openbrand/register/ormO.htm.
37. H. Pedroso, L.M. Suva, J.G. Suva, Web-based metacomputing with JET, in: Proceedings of the ACM 1997 PPoPP Workshop on Java for Science and Engineering Computation, ACM, June 1997.
38. J.S. Plank, H. Casanova, M. Beck, J. Dongarra, Deploying fault tolerance and task migration with NetSolve, Future Gener. Comput. Syst. 15 (1999) 745-755.
39. S. Ratnasamy, P. Francis, M. Handley, R. Karp, S. Shenker, A Scalable Content Addressable Network, Technical Report TR-00-010, Berkeley, CA, 2000.
40. A. Rowstron, P. Druschel, Pastry: scalable, decentralized object location, and routing for large-scale peer-to-peer systems, Lecture Notes in Computer Science, 2001, p. 2218.
41. T. Sandholm, J. Gawor, Globus Toolkit 3 Core - a grid service container Framework, in: Globus Toolkit Core White Paper, July 2003. http://www-unix.globus.Org/toolkit/3.0/ogsa/docs/ gt3-core.pdf.
42. L.F.G. Sarmenta, Volunteer computing, Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge, USA, June 2001.
43. L.F.G. Sarmenta, Sabotage-tolerance mechanisms for volunteer computing systems, in: Proceedings of the ACM/ IEEE International Symposium on Cluster Computing and the Grid (CCGrid'01), Brisbane, Australia, 15-18 May 2001.
44. L.F.G. Sarmenta, S. Hirano, S.A. Ward, Towards Bayanihan: builing an extensible framework for Volonteer Computing using Java, in: Proceedings of the ACM Workshop on Java for High-Performance Network Computing, 1998.
45. S. Saroiu, P.K. Gummadi, S.D. Grabble, A measurement study of peer-to-peer file sharing systems, in: Proceedings of Multimedia Computing and Networking 2002 (MMCN'02), San Jose, CA, January 2002. http://www.cite-seer.nj.nec. com/saroiu02measurement.html.
46. M. Sato, M. Hirano, Y. Tanaka, S. Sekiguchi, Omm'RPC: a grid RFC facility for cluster and global computing in OpenMP, in: Springer (Ed.), Proceedings of the Workshop on OpenMP Applications and Tools 2001, volume LNCS 2104, West Lafayette, IN, July 2001, pp. 130-135.
47. M. Sato, H. Nakada, S. Sekiguchi, S. Matsuoka, U. Nagashima, H. Takagi, Ninf: a network based information library for global world-wide computing infrastructure, in: Proceedings of the High-Performance Computing and Networking, International Conference and Exhibition, HPCN Europe, volume LNCS 1225, Vienna, Austria, Springer, April 1997, pp. 491-502.
48. S.J. Sciutto, Aires: Air Showers Extended Simulation, Department of Physics of the Universidad Nacional de La Plata, Argentina, 1995. http://www.fisica.unlp.edu.ar/auger/ aires/.
49. K. Seymour, H. Nakada, S. Matsuoka, J. Dongarra, C. Lee, H. Casanova, GridRPC: a remote procedure call API for grid computing, in: Technical Report, University of Tennesse, ICL-UT-02-06, June 2002.
50. J. Shoch, J. Hupp, Computing practices: the 'Worm' programs - early experience with a distributed computation, Comm. ACM 25 (3) (1982) 172-180.
51. M. Snir, S. Otto, S. Huss-Lederman, D. Walker, J. Dongarra, MPI: The Complete Reference, The MIT Press, 1996. http://www.netlib.org/utk/papers/mpi-book/mpi-book.html.
52. I. Stoica, R. Morris, D. Karger, F. Kaashoek, H. Balakrishnan, Chord: A Scalable Peer-To-Peer Lookup Service for Internet Applications, Technical Report TR-819, MIT, 2001.
53. B.Y. Zhao, J.D. Kubiatowicz, A.D. Joseph, Tapestry: An Infrastructure for Fault-tolerant Wide-area Location and Routing, Technical Report UCB/CSD-01-1141, UC Berkeley, April 2001.