Scheduling block-cyclic array redistribution

IEEE Transactions on Parallel and Distributed Systems

Volumn 9, Issue 2, 1998, Pages 192-205

  Desprez, Frédéric ^b   Dongarra, Jack ^a,c,d   Petitet, Antoine ^c   Randriamaro, Cyril ^b   Robert, Yves ^a,c  

^a IEEE   (United States)

^b UNIVERSITÉ DE LYON   (France)

^c University of Tennessee Knoxville   (United States)

^d OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

Block cyclic distribution; Distributed arrays; HPF; MPI; Redistribution; Scheduling

Indexed keywords

PROBLEM SOLVING; RESPONSE TIME (COMPUTER SYSTEMS);

BLOCK CYCLIC DISTRIBUTION;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 0032002536     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/71.663945     Document Type: Article

References (21)

1. C. Ancourt, F. Coelho, F. Irigoin, and R. Keryell, "A Linear Algebra Framework for Static HPF Code Distribution," Scientific Programming, to appear. Available as CRI-Ecole des Mines Technical Report A-278-CRI, http://www.cri.ensmp.fr.
2. C. Berge, Graphes et Hypergraphes. Dunod, 1970. English translation by Elsevier, Amsterdam (1985).
3. S. Chatterjee, J.R. Gilbert, F.J.E. Long, R. Schreiber, and S.-H. Teng, "Generating Local Addresses and Communication Sets for Data-Parallel Programs," J. Parallel and Distributed Computing, vol. 26, no. 1, pp. 72-84, 1995.
4. J. Choi, J. Demmel, I. Dhillon, J. Dongarra, S. Ostrouchov, A. Petitet, K. Stanley, D. Walker, and R.C. Whaley, "ScaLAPACK: A Portable Linear Algebra Library for Distributed Memory Computers - Design Issues and Performance," Proc. Computer Physics Comm., vol. 97, pp. 1-15, 1996. (also LAPACK Working Note #95).
5. J.J. Dongarra and D.W. Walker, "Software Libraries for Linear Algebra Computations on High Performance Computers," SIAM Review, vol. 37, no. 2, pp. 151-180, 1995.
6. G.H. Golub and C.F. Van Loan, Matrix Computations, second ed. Johns Hopkins, 1989.
7. R.L. Graham, M. Grötschel, and L. Lovaśz. Handbook of Combinatorics. Elsevier, 1995.
8. S.K.S. Gupta, S.D. Kaushik, C.-H. Huang, and P. Sadayappan, "Compiling Array Expressions for Efficient Execution on Distributed-Memory Machines," J. Parallel and Distributed Computing, vol. 32, no. 2, pp. 155-172, 1996.
9. E.T. Kalns and L.M. Ni, "Processor Mapping Techniques Towards Efficient Data Redistribution," IEEE Trans. Parallel and Distributed Systems, vol. 6, no. 12, pp. 1,234-1,247, Dec. 1995.
10. K. Kennedy, N. Nedeljkovic, and A. Sethi, "Efficient Address Generation for Block-Cyclic Distributions," Proc. 1995 ACM/IEEE Supercomputing Conf., http://www.supercomp.org/sc95/proceedings, 1995.
11. K. Kennedy, N. Nedeljkovic, and A. Sethi, "A Linear-Time Algorithm for Computing the Memory Access Sequence in Data-Parallel Programs," Proc. Fifth ACM SIGPLAN Symp. Principles and Practice of Parallel Programming, pp. 102-111, 1995.
12. C.H. Koelbel, D.B. Loveman, R.S. Schreiber, G.L. Steele Jr., and M.E. Zosel, The High Performance Fortran Handbook. MIT Press, 1994.
13. A. Petitet, "Algorithmic Redistribution Methods for Block Cyclic Decompositions," PhD thesis, Univ. of Tennessee, Knoxville, Dec. 1996.
14. L. Prylli and B. Tourancheau, "Efficient Block-Cyclic Data Redistribution," Proc. EuroPar'96, Lectures Notes in Computer Science, vol. 1,123, pp. 155-164. Springer Verlag, 1996.
15. M. Snir, S.W. Otto, S. Huss-Lederman, D.W. Walker, and J. Dongarra, MPI: The Complete Reference. MIT Press, 1996.
16. J.M. Stichnoth, D. O'Hallaron, and T.R. Gross," Generating Communication for Array Statements: Design, Implementation, and Evaluation," J. Parallel and Distributed Computing, vol. 21, no. 1, pp. 150-159, 1994.
17. A. Thirumalai and J. Ramanujam, "Fast Address Sequence Generation for Data-Parallel Programs Using Integer Lattices," Languages and Compilers for Parallel Computing, C.-H. Huang, P. Sadayappan, U. Banerjee, D. Gelernter, A. Nicolau, and D. Padua, eds., Lectures Notes in Computer Science, vol. 1,033, pp. 191-208. Springer Verlag, 1995.
18. K. van Reeuwijk, W. Denissen, H.J. Sips, and E.M.R.M. Paalvast, "An Implementation Framework for HPF Distributed Arrays on Message-Passing Parallel Computer Systems," IEEE Trans. Parallel and Distributed Systems, vol. 7, no. 9, pp. 897-914, Sept. 1996.
19. A. Wakatani and M. Wolfe, "Redistribution of Block-Cyclic Data Distributions Using MPI," Parallel Computing, vol. 21, no. 9, pp. 1,485-1,490, 1995.
20. D.W. Walker and S.W. Otto, "Redistribution of Block-Cyclic Data Distributions Using MPI," Concurrency: Practice and Experience, vol. 8, no. 9, pp. 707-728, 1996.
21. L. Wang, J.M. Stichnoth, and S. Chatterjee, "Runtime Performance of Parallel Array Assignment: An Empirical Study," Proc. 1996 ACM/IEEE Supercomputing Conf., http://www.supercomp.org/sc96/proceedings, 1996.