Optimizing a conjugate gradient solver with non-blocking collective operations

Parallel Computing

Volumn 33, Issue 9, 2007, Pages 624-633

  Hoefler, Torsten ^a,b   Gottschling, Peter ^a   Lumsdaine, Andrew ^a   Rehm, Wolfgang ^b  

^a INDIANA UNIVERSITY   (United States)

^b CHEMNITZ UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Collective operations; Communication; Computation overlap; Message passing interface (MPI); Non blocking collective operations; Poisson solver

Indexed keywords

COMMUNICATION SYSTEMS; INTERFACES (COMPUTER); MESSAGE PASSING; OPTIMIZATION; PARALLEL PROCESSING SYSTEMS; POISSON DISTRIBUTION;

COLLECTIVE OPERATIONS; COMPUTATION OVERLAPS; MESSAGE PASSING INTERFACE (MPI); NON-BLOCKING COLLECTIVE OPERATIONS; POISSON SOLVERS;

BLOCKING PROBABILITY;

EID: 34548698431     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2007.06.006     Document Type: Article

References (27)

1. Alexandrov A., Ionescu M.F., Schauser K.E., and Scheiman C. LogGP: incorporating long messages into the LogP model. Journal of Parallel and Distributed Computing 44 1 (1995) 71-79
2. Almasi G., Heidelberger P., Archer C.J., Martorell X., Chris Erway C., Moreira J.E., Steinmacher-Burow B., and Zheng Y. Optimization of MPI collective communication on BlueGene/L systems. ICS '05: Proceedings of the 19th Annual International Conference on Supercomputing (2005), ACM Press, New York, NY, USA 253-262
3. Bell C., Bonachea D., Cote Y., Duell J., Hargrove P., Husbands P., Iancu C., Welcome M., and Yelick K. An evaluation of current high-performance networks. IPDPS '03: Proceedings of the 17th International Symposium on Parallel and Distributed Processing. Washington, DC, USA (2003), IEEE Computer Society p. 28.1
4. Faraj A., and Yuan X. Automatic generation and tuning of MPI collective communication routines. ICS '05: Proceedings of the 19th Annual International Conference on Supercomputing (2005), ACM Press, New York, NY, USA 393-402
5. Edgar Gabriel, Graham E. Fagg, George Bosilca, Thara Angskun, Jack J. Dongarra, Jeffrey M. Squyres, Vishal Sahay, Prabhanjan Kambadur, Brian Barrett, Andrew Lumsdaine, Ralph H. Castain, David J. Daniel, Richard L. Graham, Timothy S. Woodall, Open MPI: goals, concept, and design of a next generation MPI implementation, in: Proceedings, 11th European PVM/MPI Users' Group Meeting, Budapest, Hungary, September 2004.
6. Gorlatch S. Send-receive considered harmful: myths and realities of message passing. ACM Trans. Program. Lang. Syst. 26 1 (2004) 47-56
7. Peter Gottschling, Wolfgang E. Nagel, An efficient parallel linear solver with a cascadic conjugate gradient method, in: EuroPar 2000, LNCS, 1900, 2000.
8. Hackbusch W. Iterative Solution of Large Sparse Systems of Equations (1994), Springer
9. Hestenes M.R., and Stiefel E. Methods of conjugate gradients for solving linear systems. J. Res. Natl. Bur. Stand. 49 (1952) 409-436
10. T.Hoefler, T. Mehlan, F. Mietke, W, Rehm. Adding low-cost hardware barrier support to small commodity clusters, in: Proceedings of 19th International Conference on Architecture and Computing Systems - ARCS'06, vol. 3, 2006, pp. 343-250.
11. T. Hoefler, J. Squyres, G. Bosilca, G. Fagg, A. Lumsdaine, W. Rehm. Non-Blocking Collective Operations for MPI-2. Technical report, Open Systems Lab, Indiana University, 08 2006.
12. T. Hoefler, J. Squyres, W. Rehm, A. Lumsdaine, A case for non-blocking collective operations, in: Frontiers of High Performance Computing and Networking - ISPA 2006 Workshops, vol. 4331/2006, Springer, Berlin, Heidelberg, 2006, 12, pp. 155-164.
13. Torsten Hoefler, Torsten Mehlan, Frank Mietke, Wolfgang Rehm, Fast barrier synchronization for InfiniBand, in: Proceedings, 20th International Parallel and Distributed Processing Symposium IPDPS 2006 (CAC 06), April 2006.
14. L.V. Kale, Sameer Kumar, Krishnan Vardarajan, A framework for collective personalized communication, in: Proceedings of IPDPS'03, Nice, France, April 2003.
15. Arkady Kanevsky, Anthony Skjellum, Anna Rounbehler, MPI/RT - an emerging standard for high-performance real-time systems, in: HICSS, vol. 3, 1998, pp. 157-166.
16. G. Liu, T.S. Abdelrahman, Computation-communication overlap on network-of-workstation multiprocessors, in: Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, July 1998, pp. 1635-1642.
17. J. Liu, A. Mamidala, D. Panda, Fast and Scalable MPI-Level Broadcast using InfiniBand's Hardware Multicast Support, Technical report, OSU-CISRC-10/03-TR57, 2003.
18. Message Passing Interface Forum. MPI: A Message Passing Interface Standard. 1995.
19. Message Passing Interface Forum. MPI-2: Extensions to the Message-Passing Interface. Technical Report, University of Tennessee, Knoxville, 1997.
20. Message Passing Interface Forum. MPI-2 Journal of Development, July (1997).
21. MPICH2 Developers. , 2006.
22. Fabrizio Petrini, Darren J. Kerbyson, Scott Pakin, The case of the missing supercomputer performance: achieving optimal performance on the 8, 192 processors of ASCI Q, in: Proceedings of the ACM/IEEE SC2003 Conference on High Performance Networking and Computing, 15-21 November 2003, ACM, Phoenix, AZ, USA, CD-Rom, 2003, pp. 55.
23. Saad Y., and Schultz M.H. GMRES: a generalized minimum residual algorithm for solving nonsymmetric linear systems. SIAM J. Sci. Statist. Comput. 7 3 (1986) 856-869
24. Sonnefeld P. CGS, a fast Lanczos-type solver for nonsymmetric linear systems. SIAM J. Sci. Statist. Comput. 10 (1989) 36-52
25. Vinod Tipparaju, Jarek Nieplocha. Optimizing all-to-all collective communication by exploiting concurrency in modern networks, in: SC '05: Proceedings of the 2005 ACM/IEEE Conference on Supercomputing, IEEE Computer Society, Washington, DC, USA, 2005, pp. 46.
26. Trottenberg U., Oosterlee C., and Schüller A. Multigrid (2000), Academic Press
27. van der Vorst H. Bi-CGSTAB: a fast and smoothly converging variant of Bi-CG for the solution of nonsymmetric linear systems. SIAM J. Sci. Statist. Comput. 13 (1992) 631-644