A basic-cycle calculation technique for efficient dynamic data redistribution

IEEE Transactions on Parallel and Distributed Systems

Volumn 9, Issue 4, 1998, Pages 359-377

  Chung, Yeh Ching ^a   Hsu, Ching Hsien ^a   Bai, Sheng Wen ^a  

^a FENG CHIA UNIVERSITY   (Taiwan)

Author keywords

Data redistribution; Distributed memory multicomputers; The basic cycle calculation technique; The multiphase method; The PITFALLS method

Indexed keywords

ALGORITHMS; COMPUTATIONAL METHODS; DISTRIBUTED COMPUTER SYSTEMS; MATHEMATICAL MODELS; PARALLEL PROCESSING SYSTEMS; PROGRAM PROCESSORS; RESPONSE TIME (COMPUTER SYSTEMS);

DATA REDISTRIBUTION; DISTRIBUTED MEMORY MULTICOMPUTERS; MULTIPHASE METHOD; PITFALLS METHOD;

COMPUTER PROGRAMMING;

EID: 0032045475     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/71.667897     Document Type: Article

References (33)

1. S. Benkner, "Handling BLOCK-CYCLIC Distribution Arrays in Vienna Fortran 90," Proc. Int'l. Conf. Parallel Architectures and Compilation Techniques, Limassol, Cyprus, June 1995.
2. B. Chapman, P. Mehrotra, H. Moritsch, and H. Zima, "Dynamic Data Distribution in Vienna Fortran," Proc. Supercomputing '93, pp. 284-293, Nov. 1993.
3. S. Chatterjee, J.R. Gilbert, F.J.E. Long, R. Schreiber, and S.-H. Teng, "Generating Local Address and Communication Sets for Data Parallel Programs," J. Parallel and Distributed Computing, vol. 26, pp. 72-84, 1995.
4. J.J. Dongarra, R. Van De Geijn, and D.W. Walker, "A Look at Scalable Dense Linear Algebra Libraries," Technical Report ORNL/TM-12126, Oak Ridge Nat'l Laboratory, Apr. 1992.
5. G. Fox, S. Hiranandani, K. Kennedy, C. Koelbel, U. Kremer, C.-W. Tseng, and M. Wu, "Fortran-D Language Specification," Technical Report TR-91-170, Dept. of Computer Science, Rice Univ., Dec. 1991.
6. S.K.S. Gupta, S.D. Kaushik, C.-H. Huang, and P. Sadayappan, "On the Generation of Efficient Data Communication for Distributed-Memory Machines," Proc. Int'l. Conf. Computing Symp., pp. 504-513, Taiwan, 1992.
7. S.K.S. Gupta, S.D. Kaushik, C.-H. Huang, and P. Sadayappan, "On Compiling Array Expressions for Efficient Execution on Distributed-Memory Machines," J. Parallel and Distributed Computing, vol. 32, pp. 155-172, 1996.
8. High Performance Fortran Forum, "High Performance Fortran Language Specification (version 1.1)," Rice Univ., Nov. 1994.
9. S. Hiranandani, K. Kennedy, J. Mellor-Crammey and A. Sethi, "Compilation Technique for BLOCK-CYCLIC Distribution," Proc. Supercomputing '94, pp. 392-403, July 1994.
10. E.T. Kalns, and L.M. Ni, "Processor Mapping Technique Toward Efficient Data Redistribution," IEEE Trans. Parallel and Distributed Systems, vol. 6, no. 12, Dec. 1995.
11. E.T. Kalns and L.M. Ni, "DaReL: A Portable Data Redistribution Library for Distributed-Memory Machines," Proc. 1994 Scalable Parallel Libraries Conf. II, Oct. 1994.
12. S.D. Kaushik, C.H. Huang, R.W. Johnson, and P. Sadayappan, "An Approach to Communication Efficient Data Redistribution," Proc. Supercomputing '94, pp. 364-373, July 1994.
13. S.D. Kaushik, C.H. Huang, J. Ramanujam, and P. Sadayappan, "Multiphase Array Redistribution: Modeling and Evaluation," Proc. Int'l. Parallel Processing Symp., pp. 441-445, 1995.
14. S.D. Kaushik, C.H. Huang, and P. Sadayappan, "Efficient Index Set Generation for Compiling HPF Array Statements on Distributed-Memory Machines," J. Parallel and Distributed Computing, vol. 38, pp. 237-247, 1996.
15. K. Kennedy, N. Nedeljkovic, and A. Sethi, "Efficient Address Generation for BLOCK-CYCLIC Distribution," Proc. Supercomputing '95, Barcelona, pp. 180-184, July 1995.
16. C. Koelbel, "Compiler-Time Generation of Communication for Scientific Programs," Proc. Supercomputing '91, pp. 101-110, Nov. 1991.
17. P-Z. Lee and W.Y Chen, "Compiler Techniques for Determining Data Distribution and Generating Communication Sets on Distributed-Memory Multicomputers," Proc. 29th Hawaii Int'l. Conf. System Sciences, vol. 1, pp. 537-546, Jan. 1996.
18. Y.W. Lim, P.B. Bhat, and V.K. Prasanna, "Efficient Algorithms for BLOCK-CYCLIC Redistribution of Arrays," Proc. Eighth Symp. Parallel and Distributed Processing, pp. 74-83, 1996.
19. Y.W. Lim, N. Park, and V.K. Prasanna, "Efficient Algorithms for Multi-Dimensional Block-Cyclic Redistribution of Arrays," Proc. Int'l. Conf. Parallel Processing, pp. 234-241, 1997.
20. L. Prylli and B. Touranchean, "Fast Runtime Block Cyclic Data Redistribution on Multiprocessors," J. Parallel and Distributed Computing, vol. 45, pp. 63-72, Aug. 1997.
21. S. Ramaswamy and P. Banerjee, "Automatic Generation of Efficient Array Redistribution Routines for Distributed Memory Multicomputers," Proc. Frontier '95: Fifth Symp. Frontiers of Massively Parallel Computation, pp. 342-349, McLean, Va., Feb. 1995.
22. S. Ramaswamy, B. Simons, and P. Banerjee, "Optimization for Efficient Array Redistribution on Distributed Memory Multicomputers," J. Parallel and Distributed Computing, vol. 38, pp. 217-228, 1996.
23. J.M. Stichnoth, D. O'Hallaron, and T.R. Gross, "Generating Communication for Array Statements: Design, Implementation, and Evaluation," J. Parallel and Distributed Computing, vol. 21, pp. 150-159, 1994.
24. R. Thakur, A. Choudhary and G. Fox, "Runtime Array Redistribution in HPF Programs," Proc. 1994 Scalable High Performance Computing Conf., pp. 309-316, May 1994.
25. R. Thakur, A. Choudhary, and J. Ramanujam, "Efficient Algorithms for Array Redistribution," IEEE Trans. Parallel and Distributed Systems, vol. 7, no. 6, pp. 587-594, June 1996.
26. A. Thirumalai and J. Ramanujam, "HPF Array Statements: Communication Generation and Optimization," Proc. Third Workshop Languages, Compilers and Run-Time System for Scalable Computers, Troy, N.Y, May 1995.
27. A. Thirumalai and J. Ramanujam, "Efficient Computation of Address Sequences in Data Parallel Programs Using Closed Forms for Basis Vectors," J. Parallel and Distributed Computing , vol. 38, pp. 188-203, 1996.
28. V. Van Dongen, C. Bonello, and C. Freehill, "High Performance C - Language Specification Version 0.8.9," Technical Report CRIM-EPPP-94/04-12, 1994.
29. C. Van Loan, Computational Frameworks for the Fast Fourier Transform. SIAM, 1992.
30. D.W. Walker and S.W. Otto, "Redistribution of BLOCK-CYCLIC Data Distributions Using MPI," Concurrency: Practice and Experience, vol. 8, no. 9, pp. 707-728, Nov. 1996.
31. A. Wakatani and M. Wolfe, "A New Approach to Array Redistribution: Strip Mining Redistribution," Proc. Parallel Architectures and Languages Europe, July 1994.
32. A.i Wakatani and M. Wolfe, "Optimization of Array Redistribution for Distributed Memory Multicomputers," Parallel Computing, vol. 21, no. 9, 1995.
33. H. Zima, P. Brezany, B. Chapman, P. Mehrotra, and A. Schwald, "Vienna Fortran - A Language Specification Version 1.1," ICASE Interim Report 21, ICASE NASA Langley Research Center, Hampton, Va., Mar. 1992.