Overlapping communication and computation by using a hybrid MPI/SMPSs approach

Proceedings of the International Conference on Supercomputing

Volumn , Issue , 2010, Pages 5-16

  Marjanović, Vladimir ^a   Labarta, Jesús ^a,b   Ayguadé, Eduard ^a,b   Valero, Mateo ^a,b  

^a BARCELONA SUPERCOMPUTING CENTER   (Spain)

^b UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

hybrid MPI SMPSs; LINPACK; MPI; parallel programming model

Indexed keywords

ASYMPTOTIC PERFORMANCE; ASYNCHRONOUS COMMUNICATION; ASYNCHRONY; CODE COMPLEXITY; COMMUNICATION OVERHEADS; CONJUGATE GRADIENT; DOMINANT FACTOR; HIGH-END COMPUTING; INTEROPERATIONS; LINPACK; LINPACK BENCHMARK; MATRIX; NEGATIVE IMPACTS; NETWORK BANDWIDTH; OPERATING SYSTEM NOISE; PARALLEL PROGRAMMING MODEL; PROBLEM SIZE; RUNTIMES; SHARED-MEMORY PROGRAMMING MODEL; SUPERSCALAR; TASK-BASED;

BENCHMARKING; COMMUNICATION; COMPUTER OPERATING SYSTEMS; CONJUGATE GRADIENT METHOD; INTELLIGENT CONTROL;

PARALLEL PROGRAMMING;

EID: 77954725202     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1810085.1810091     Document Type: Conference Paper

References (27)

1. The Message Passing Interface. unix.mcs.anl.gov/mpi/.
2. T. Q. Viet and T. Yoshinaga. Improving Linpack Performance on SMP Clusters with Asynchronous MPI Programming. IPSJ Digital Courier, vol. 2, pp.598-606. 2006.
3. M. Schulz. Extracting Critical Path Graphs from MPI Applications. Proceedings of the 2005 IEEE International Conference on Cluster Computing, 2005.
4. T. Hoefler and A. Lumsdaine. Non-Blocking Collective Operations for MPI-3. MPI Forum. January 2008.
5. J. M. Perez, L. Martinell, R. M. Badia and J. Labarta. A dependency aware task-based programming environment for multi-core architectures. Proceedings of the 2008 IEEE International Conference on Cluster Computing, 2008.
6. P. Bellens, J. M. Perez, R. M. Badia and J. Labarta, CellSs: a programming model for the cell BE architecture. Proceedings of the 2006 ACM/IEEE Conference on Supercomputing SC'06. November 2006.
7. E. Ayguadé, R. M. Badia, F. D. Igual, J Labarta, R. Mayo and E. S. Quintana. An Extension of the StarSs Programming Model for Platforms with Multiple GPUs. Proceedings of Euro-Par 2009. August 2009.
8. J. Dongarra, P. Luszczek and A. Petitet. The LINPACK Benchmark: Past, Present and Future. Concurrency and Computation: Practise and Experience, vol. 15, no. 9, pp. 803-820. 2003.
9. V. Marjanovic, J.M. Perez, E. Ayguadé, J. Labarta and M. Valero. Overlapping Communication and Computation by Using a Hybrid MPI/SMPSs Approach. UPC-DAC-RR-2009-35 Research Report, Technical University of Catalunya. May 2009.
10. J. Choi, J. Dongarra, L. Ostrouchov, A. Petitet, D. Walker and R. C. Whaley. The Design and Implementation of the ScaLAPACK LU, QR, and Cholesky Factorization Routines. Scientific Programming, vol. 5, no. 3, pp. 173-184. 1996.
11. T. H. Kaiser and S. B. Baden. Overlapping communication and computation with OpenMP and MPI. Scientific Programming, vol. 9, no. 2-3, pp. 73-81. August 2001.
12. M. Jiayin, S. Bo, W. Yongwei, and Y. Guangwen. Overlapping Communication and Computation in MPI by Multithreading. Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Application (PDPTA'06), March 2006.
13. V. Subotic, J. Labarta and M. Valero. Overlapping MPI Computation and Communication by Enforcing Speculative Dataflow. Proceedings of the 2008 International Conference on High Performance Embedded Architectures and Compilers (HiPEAC-2008), January 2008.
14. R. Rabenseifner and G. Wellein. Comparison of Parallel Programming Models on Clusters of SMP Nodes. Proceedings of the International Conference on High Performance Scientifc Computing. March 2003.
15. R. Rabenseifner. Hybrid Parallel Programming: Performance Problem and Chances. Proceeding of the 45th CUG Conference, May 2003.
16. G. Jost and H. Jin. Comparing the OpenMP, MPI, and Hybrid Programming Paradigms on an SMP Cluster. NAS Technical Report NAS-03-019, November 2003.
17. F. Song, A YarKhan, and J. Dongarra. "Dynamic Task Scheduling for Linear Algebra Algorithms on Distributed-Memory Multicore Systems. Proceedings of the 2009 ACM/IEEE Conference on Supercomputing SC'09. November 2009.
18. PLASMA. U. Tennessee. http://icl.cs.utk.edu/plasma, 2009.
19. G. Quintana-Orti, F. D. Igual, E. S. Quintana-Orti and R. van de Geijn. Solving dense linear algebra problems on platforms with multiple hardware accelerators. Proceedings of the 14th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2009.
20. Top500 list. www.top500.org.
21. G. Almasi, C. Archer, J. G. Castanos, J. A. Gunnels, C. C. Erway, P. Heidelberger, X. Martorell, J. E. Moreira, K. Pinnow, J. Ratterman, B. D. Steinmacher-Burow, W. Gropp, and B. Toonen. Design and implementation of message-passing services for the Blue Gene/L supercomputer. IBM Journal of Reasearch and Development, vol. 49, no. 2-3, pp. 393-406. March 2005.
22. E. Ayguadé, R. M. Badia, D. Cabrera, A. Duran, M. González, F. D. Igual, D. Jimenez, J. Labarta, X. Martorell, R. Mayo, J. M. Pérez and E. S. Quintana-Ortí. A Proposal to Extend the OpenMP Tasking Model for Heterogeneous Architectures. Proceedings of the 5th International Workshop on OpenMP (IWOMP 2009). 2009.
23. T. Hoefler, P. Gottschling, A. Lumsdaine and W. Rehm. Optimizing a conjugate gradient solver with non-blocking collective operations. Parallel Computing, vol. 33, no. 9, pp. 624-633. 2007.
24. D. Bailey, T. Harris, W. Saphir, R. van der Wijngaart, A. Woo and M. Yarrow. The NAS Parallel Benchmarks 2.0. NAS Technical Report NAS-95-020, NASA Ames Research Center, December 1995.
25. T. Bunting and W. Kimble. IBM BladeCenter JS21 Technical Overview and Introduction. IBM Red Paper REDP-4130-00. 2006.
26. Myricom. Myrinet overview. http://www.myri.com/myrinet/overview/.
27. K. Goto and R. A. van de Geijn. Anatomy of High-Performance Matrix Multiplication. ACM Transactions on Mathematical Software, vol. 34, no. 3, pp. 1-25. May 2008.