A simple MPI process swapping architecture for iterative applications

International Journal of High Performance Computing Applications

Volumn 18, Issue 3, 2004, Pages 341-352

  Sievert, Otto ^a   Casanova, Henri ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

MPI; Over allocation; Parallel computing; Process swapping

Indexed keywords

AUTOMATION; C (PROGRAMMING LANGUAGE); COMPUTER ARCHITECTURE; COMPUTER PROGRAMMING; COMPUTER WORKSTATIONS; DATA COMMUNICATION SYSTEMS; FAULT TOLERANT COMPUTER SYSTEMS; ITERATIVE METHODS; PARALLEL PROCESSING SYSTEMS; PERSONAL COMPUTERS; REAL TIME SYSTEMS; RESPONSE TIME (COMPUTER SYSTEMS);

DYNAMIC LOAD BALANCING; MESSAGE PASSING INTERFACE; PROCESS SWAPPING; RUNTIME; SOURCE CODE;

INTERFACES (COMPUTER);

EID: 4344683638     PISSN: 10943420     EISSN: None     Source Type: Journal    
DOI: 10.1177/1094342004047430     Document Type: Article

References (28)

1. Allen, G., Angulo, D., Foster, I., Lanfermann, G., Liu, C., Radke, T., Seidel, E., and Shalf, J. 2001. The Cactus Worm: experiments with dynamic resource discovery and allocation in a grid environment, International Journal of High Performance Computing Applications 15(4):345-358.
2. Barak, A., Guday, S., and Wheeler, R. G. 1993. The MOSIX Distributed Operating System, Load Balancing for UNIX, Lecture Notes in Computer Science Vol. 672. Springer-Verlag, Berlin.
3. Batchu, R. et al. 2001. MPI/FT: architecture and taxonomies for fault-tolerant, message-passing middleware for performance-portable parallel computing. In Proceedings of the 1st International Symposium on Cluster Computing and the Grid, May, Brisbane, Australia.
4. Berman, F., Wolski, R., Figueira, S., Schopf, J., and Shao, G. 1996. Application-level scheduling on distributed heterogeneous networks. In Proceedings of Supercomputing 1996, Pittsburgh, PA.
5. Bosilca, G. et al. 2002. MPICH-V: toward a scalable fault tolerant MPI for volatile nodes. In Proceedings of Supercomputing 2002, Baltimore, MD.
6. Chandra, R., Menon, R., Dagum, L., Kohr, D., Maydan, D., and McDonald, J. 2000. Parallel Programming in OpenMP. Morgan Kaufmann, San Mateo, CA.
7. Chien, A., Calder, B., Elbert, S., and Bhatia, K. 2003. Entropia: architecture and performance of an enterprise desktop grid system. Journal of Parallel and Distributed Computing 63(5):597-610.
8. Cybenko, G. 1989. Load balancing for distributed memory processors. Journal of Parallel and Distributed Computing 7:279-301.
9. Diekmann, R., Monien, B., and Preis, R. 1997. Load balancing strategies for distributed memory machines. In Multiscale Phenomena and Their Simulation, H. Satz, F. Karsch, and B. Monien, editors, World Scientific, Singapore, pp. 255-266.
10. Elsässer, E., Monien, B., and Preis, R. 2002. Diffusion schemes for load balancing on heterogeneous networks. Theory of Computing Systems 35:305-320.
11. Fagg, G. and Dongarra, J. 2000. FT-MPI: fault tolerant MPI, supporting dynamic applications in a dynamic world. In Proceedings of the Euro PVM/MPI User's Group, Berlin, Germany, pp. 346-353.
12. Fedak, G., Germain, C., Nri, V., and Cappello, F. 2001. Xtrem-Web: a generic global computing system. In Proceedings of the Workshop on Global Computing on Personal Devices, May, Brisbane, Australia.
13. Fitzgerald, S., Foster, I., Kesselman, C., von Laszewski, G., Smith, W., and Tuecke, S. 1997. A directory service for configuring high-performance distributed computations. In Proceedings of the 6th IEEE Symposium on High Performance Distributed Computing, Portland, OR, pp. 365-375.
14. Foster, I. and Karonis, N. 1998. A grid-enabled MPI: message passing in heterogeneous distributed computing systems. In Proceedings of Supercomputing 1998, Orlando, FL.
15. Heirich, A. and Arvo, J. 1998. A competitive analysis of load balancing strategies for parallel ray tracing. Journal of Supercomputing 12(1-2):57-68.
16. Kennedy, K. et al. 2002. Toward a framework for preparing and executing adaptive grid programs. In Proceedings of NSF Next Generation Systems Program Workshop (International Parallel and Distributed Processing Symposium 2002), Fort Lauderdale, FL, April.
17. Le Sergent, T. and Berthomieu, B. 1994. Balancing load under large and fast load changes in distributed computing systems - a case study. In Conference on Algorithms and Hardware for Parallel Processing, Linz, Austria, pp. 854-865.
18. Litzkow, M., Livny, M., and Mutka, M. 1988. Condor - a hunter of idle workstations. In Proceedings of the 8th International Conference of Distributed Computing Systems (ICDCS), San Jose, CA.
19. MPI Forum. 1994. MPI: a message-passing interface standard. International Journal of Supercomputer Applications and High Performance Computing 8(3/4):159-416.
20. Protic, J., Tomaevic, M., and Milutinovic, V. 1997. Distributed Shared Memory: Concepts and Systems, Wiley, New York.
21. Ribler, R. L., Vetter, J. S., Simitci, H., and Reed, D. A. 1998. Autopilot: adaptive control of distributed applications. In Proceedings of the 7th IEEE Symposium on High Performance Distributed Computing, pp. 172-179.
22. Snir, M., Otto, S., Huss-Lederman, S., Walker, D., and Dongarra, J. 1998. MPI: The Complete Reference, MIT Press, Cambridge, MA.
23. Stellner, G. 1996. CoCheck: checkpointing and process migration for MPI. In Proceedings of the 10th International Parallel Processing Symposium (IPPS 96), Honolulu, HI.
24. Toonen, K. and Foster, I. 2003. MPICH-G2: a grid-enabled implementation of the message passing interface. Journal of Parallel and Distributed Computing 63(5):551-563.
25. Vadhiyar, S. and Dongarra, J. 2002. A metascheduler for the grid. In Proceedings of the 11th IEEE Symposium on High-Performance Distributed Computing, Edinburgh, Scotland, July.
26. Wolski, R. 1998. Dynamically forecasting network performance using the Network Weather Service. Cluster Computing 1(1):119-132.
27. Zhou, S. 1988. A trace-driven simulation study of dynamic load balancing. IEEE Transactions on Software Engineering 14(9):1327-1341.
28. Zhu, W. and Steketee, C. 1995. An experimental study of load balancing on Amoeba. In Proceedings of the 1st Aizu International Symposium on Parallel Algorithms/Architecture Synthesis, Fukushima, Japan, pp. 220-226.