HARNESS fault tolerant MPI design, usage and performance issues

Future Generation Computer Systems

Volumn 18, Issue 8, 2002, Pages 1127-1142

  Fagg, Graham E ^a   Dongarra, Jack J ^b  

^a UNIVERSITY OF STUTTGART   (Germany)

^b University of Tennessee Knoxville   (United States)

Author keywords

Fault tolerant message passing; FT MPI; HARNESS; Meta computing; MPI implementation

Indexed keywords

COMPUTER NETWORKS; COMPUTER SUPPORTED COOPERATIVE WORK; DATA HANDLING; MULTIPROCESSING SYSTEMS; SEMANTICS;

STATIC PROCESS MODELS;

FAULT TOLERANT COMPUTER SYSTEMS;

EID: 0036788098     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-739X(02)00090-0     Document Type: Article

References (30)

1. M. Beck, J.J. Dongarra, G.E. Fagg, G.A. Geist, P. Gray, J. Kohl, M. Migliardi, K. Moore, T. Moore, P. Papadopoulous, S. Scott, V. Sunderam, HARNESS: a next generation distributed virtual machine, J. Future Generation Comput. Syst. 15 (1999) 571-582.
2. G. Stellner, CoCheck: Checkpointing and process migration for MPI, in: Proceedings of the International Parallel Processing Symposium, Honolulu, April 1996, pp. 526-531.
3. A. Agbaria, R. Friedman, Starfish: Fault-tolerant dynamic MPI programs on clusters of workstations, in: Proceedings of the Eighth IEEE International Symposium on High Performance Distributed Computing, 1999.
4. G.E. Fagg, K. Moore, J.J. Dongarra, Scalable networked information processing environment (SNIPE), J. Future Generation Comput. Syst. 15 (1999) 595-605.
5. M. Migliardi, V. Sunderam, PVM emulation in the Harness MetaComputing system: a plug-in based approach, Lecture Notes in Computer Science, Vol. 1697, September 1999, pp. 117-124.
6. P.H. Worley, I.T. Foster, B. Toonen, Algorithm comparison and benchmarking using a parallel spectral transform shallow water model, in: G.-R. Hoffmann, N. Kreitz (Eds.), Proceedings of the Sixth Workshop on Parallel Processing in Meteorology, World Scientific, Singapore, 1995, pp. 277-289.
7. T. Kielmann, H.E. Bal, S. Gorlatch, Bandwidth-efficient collective communication for clustered wide area systems, in: Proceedings of the IPDPS 2000, Cancun, Mexico, May 1-5, 2000.
8. L.P. Huse, Collective communication on dedicated clusters of workstations, in: Proceedings of the Sixth European PVM/MPI Users' Group Meeting, Lecture Notes in Computer Science, Vol. 1697, Springer, Bareclona, September 1999, pp. 469-476.
9. D. Culler, R. Karp, D. Patterson, A. Sahay, K.E. Schauser, E. Santos, R. Subramonian, T. von Eicken, LogP: towards a realistic model of parallel computation, in: Proceedings of the Symposium on Principles and Practice of Parallel Programming (PpoPP), San Diego, CA, May 1993, pp. 1-12.
10. R. Rabenseifner, A new optimized MPI reduce algorithm, 1997. http://www.hlrs.de/structure/support/parallel_computing/models/mpi/myreduce.html .
11. M. Snir, S. Otto, S. Huss-Lederman, D. Walker, J. Dongarra, MPI: The Complete Reference, Vol. 1, The MPI Core, second ed., 1998.
12. M. Frigo, FFTW: an adaptive software architecture for the FFT, in: Proceedings of the ICASSP Conference, Vol. 3, 1998, p. 1381.
13. R.C. Whaley, J. Dongarra, Automatically tuned linear algebra software, SC98: high performance networking and computing, 1998. http://www.cs.utk.edu/̃rwhaley/ATL/INDEX.HTM.
14. L. Prylli, B. Tourancheau, BIP: a new protocol designed for high performance networking on myrinet, in: Proceedings of the PC-NOW workshop, IPPS/SPDP 1998, Orlando, USA, 1998.
15. S. Louca, N. Neophytou, A. Lachanas, P. Evripidou, MPI-FT: a portable fault tolerance scheme for MPI, in: Proceedings of PDPTA'98 International Conference, Las Vegas, Nevada, 1998.
16. J.L. Traff, R. Hempel, H. Ritzdort, F. Zimmermann, Flattening on the fly: efficient handling of MPI derived datatypes, in: Proceedings of the Sixth European PVM/MPI Users' Group Meeting, Lecture Notes in Computer Science, Vol. 1697, Springer, Bareclona, September 1999, pp. 109-116.
17. W.D. Gropp, E. Lusk, D. Swider, Improving the performance of MPI derived datatypes, in: Proceedings of the Third MPI Developer's and User's Conference (MPIDC'99), 1999, pp. 25-30.
18. G.E. Fagg, K.S. London, J.J. Dongarra, MPI_Connect, managing heterogeneous MPI application interoperation and process control, EuroPVM-MPI 98, Lecture Notes in Computer Science, Vol. 1497, Springer, 1998, pp. 93-96.
19. E. Gabriel, M. Resch, T. Beisel, R. Keller, Distributed computing in a heterogeneous computing environment, EuroPVM-MPI 98, Lecture Notes in Computer Science, Vol. 1497, Springer, Berlin, 1998, pp. 180-187.
20. S. Blackford, J. Choi, A. Cleary, E. D'Azevedo, J. Demmel, I. Dhillon, J. Dongarra, S. Hammarling, G. Henry, A. Petitet, K. Stanley, D. Walker, R. Whaley, Scalapack: a linear algebra library for message-passing computers, in: Proceedings of the 1997 SIAM Conference on Parallel Processing, May 1997.
21. J. Choi, J. Dongarra, S. Ostrouchov, A. Petitet, D. Walker, R. Whaley, A proposal for a set of parallel basic linear algebra subprograms, LAPACK Working Note #100, CS-95-292, May 1995.
22. W. Gropp, E. Lusk, R. Thakur, Using MPI-2: Advanced Features of the Message Passing Interface, first ed., MIT Press, Cambridge, MA, February 2000.
23. Al Geist, A. Beguelin, J. Dongarra, W. Jiang, R. Manchek, V. Sunderam, PVM - parallel virtual machine: a users' guide and tutorial for networked parallel computing, Scientific and Engineering Computation, MIT Press, Cambridge, MA, 1994.
24. W.R. Elwasif, D.E. Bernholdt, J.A. Kohl, G.A. Geist, An architecture for a multi-threaded harness kernel, in: Proceedings of the Eighth EuroPVM/MPI Users Group Meeting, LNCS, Vol. 2131, Springer, Berlin, 2001, pp. 126-134.
25. F. Berman, A. Chen, K. Cooper, J. Dongarra, I. Foster, D. Gannon, L. Johnsson, K. Kennedy, C. Kesselman, J. Mellow-Crummey, D. Reed, L. Torczon, R. Wolski, The GrADS Project, Int. J. High Perform. Comput. Appl. 15 (4) (2001) 327-344.
26. A. Petitet, S. Blackford, J. Dongarra, B. Ellis, G. Fagg, K. Roche, S. Vadhiyar, Numerical libraries and the grid, Int. J. High Perform. Comput. Appl. 15 (4) (2001) 359-374.
27. I. Foster, C. Kesselmann, The globus toolkit, in: I. Foster, C. Kesselmann (Eds.), The GRID: Blueprint for a New Computing Infrastructure, Morgan Kaufmann, San Francisco, 1999, pp. 259-278.
28. I. Foster, N. Karonis, A grid enabled MPI: message passing in heterogeneous distributed computing systems, in: Proceedings of the SuperComputing'98 (SC98), Orlando, FL.
29. J.S. Plank, M. Beck, W.R. Elwasif, T. Moore, M. Swany, R. Wolski, The internet backplane protocol: storage in the network, in: Proceedings of the NetStore99: The Network Storage Symposium, Seattle, WA, 1999.
30. I. Foster, C. Kesselmann, The GRID: Blueprint for a New Computing Infrastructure, Morgan Kaufmann, San Francisco, 1999.