Optimal remapping in dynamic bulk synchronous computations via a stochastic control approach

IEEE Transactions on Parallel and Distributed Systems

Volumn 14, Issue 1, 2003, Pages 51-62

  George Yin, Gang ^a   Xu, Cheng Zhong ^b   Wang, Le Yi ^b  

^a WAYNE STATE UNIVERSITY   (United States)

^b Wayne State University   (United States)

Author keywords

Bulk synchronous computation; Mapping; Optimal stopping; Remapping; Stochastic control

Indexed keywords

CONFORMAL MAPPING; ITERATIVE METHODS; MARKOV PROCESSES; MATRIX ALGEBRA; OPTIMAL CONTROL SYSTEMS; PROBABILITY; STATISTICAL METHODS; STOCHASTIC CONTROL SYSTEMS; SYNCHRONIZATION;

OPTIMAL REMAPPING;

PARALLEL PROCESSING SYSTEMS;

EID: 0038476095     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2003.1167370     Document Type: Article

References (30)

1. V.D. Agrawal and S.T. Chakradhar, "Performance Analysis of Synchronized Iterative Algorithms on Multiprocessor Systems," IEEE Trans. Parallel and Distributed Systems, vol. 3, no. 6, pp. 739-746, Nov. 1992.
2. D. Bertsekas, Dynamic Programming Deterministic and Stochastic Models. Englewood Cliffs, N.J.: Prentice Hall, 1987.
3. D.P. Bertsekas and J.N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods. Prentice Hall, 1989.
4. A.N. Choudhary, B. Narahari, and R. Krishnamurti, "An Efficient Heuristic Scheme for Dynamic Remapping of Parallel Computations," Parallel Computing, vol. 19, pp. 621-632, 1993.
5. A.N. Choudhary and R. Ponnusamy, "Run-Time Data Decomposition for Parallel Implementation of Image Processing and Computer Vision Tasks," Concurrency. Practice and Experience, vol. 4, no. 4, pp. 313-334, June 1992.
6. D. Culler, J.P. Singh, and A. Gupta, Parallel Computer Architecture: A Hardware/Software Approach. Morgan Kaufmann, 1998.
7. G. Edjlali, G. Agrawal, A. Sussman, J. Humphries, and J. Saltz, "Compiler and Runtime Support for Programming in Adaptive Parallel Environments," Scientific Programming, Jan. 1997.
8. W. Fleming and R. Rishel, Deterministic and Stochastic Optimal Control. New York: Springer-Verlag, 1975.
9. F.-T. Fong, C.-Z. Xu, and L. Wang, "Optimal Periodic Remapping of Bulk Synchronous Computations on Multiprogrammed Distributed Systems." Proc. 14th IEEE Int'l Parallel and Distributed Processing Symp. (IPDPS), pp. 103-108, Apr. 2000.
10. R.V. Hanxleden and L.R. Scott, "Load Balancing on Message Passing Architectures," J. Parallel and Distributed Computing, vol. 13, no. 3, pp. 312-324, Nov. 1991.
11. J. De Keyser and D. Roose, "Multigrid with Solution-Adaptive Irregular Grids on Distributed Memory Computers," Parallel Computing, D.J. Evans, G.R. Joubert, and H. Liddell, eds., pp. 375-382, 1992.
12. H. Kushner, Introduction to Stochastic Control Theory. New York: Holt, Rinehart and Winston, 1972.
13. H.J. Kushner and G. Yin, Stochastic Approximation Algorithms and Applications. New York: Springer-Verlag, 1997.
14. S. Madala and J.B. Sinclair, "Performance of Synchronous Parallel Algorithms with Regular Structures," IEEE Trans. Parallel and Distributed Systems, vol. 2, no. 1, pp. 105-116, Jan. 1991.
15. D.C. Marinescu and J.R. Rice, "Synchronization and Load Imbalance Effects in Distributed Memory Multiprocessor Systems," Concurrency: Practice and Experience, vol. 3, no. 6, pp. 593-625, Dec. 1991.
16. B. Moon and J. Saltz, "Adaptive Runtime Support for Direct Simulation Monte Carlo Methods on Distributed Memory Architectures," Scalable High-Performance Computing Conf., pp. 176-183, May 1994.
17. J.E. Moreira, V.K. Naik, and S.P. Midkiff, "Dynamic Data Distribution and Processor Repartitioning for Irregularly Structured Computation," J. Parallel and Distributed Computing, vol. 50, pp. 28-60, 1998.
18. D. Nicol and G. Ciardo, "Automated Parallelization of Discrete State-Space Generation," J. Parallel and Distributed Computing. vol. 47, no. 2, pp. 153-167, Dec. 1997.
19. D.M. Nicol and P.F. Reynolds, "Optimal Dynamic Remapping of Data Parallel Computation," IEEE Trans. Computers, vol. 39, no. 2, pp. 206-219, Feb. 1990.
20. D.M. Nicol and J.H. Saltz, "Dynamic Remapping of Parallel Computations with Varying Resource Demands," IEEE Trans. Computers, vol. 37, no. 9, pp. 1073-1087, Sept. 1988.
21. D.M. Nicol and J.H. Saltz, "An Analysis of Scatter Decomposition," IEEE Trans. Computers, vol. 39, no. 11, pp. 1337-1345, Nov. 1990.
22. L. Oliker and R. Biswas, "Efficient Load Balancing and Data Remapping for Adaptive Grid Calculations," Proc. Ninth Ann. ACM Symp. Parallel Algorithms and Architectures (SPAA '97), 1997.
23. G.D. Peterson and R.D. Chamberlain, "Beyond Execution Time: Expanding the Use of Performance Models," IEEE Parallel and Distributed Technology, pp. 37-49, Summer 1994.
24. W. Shu and M.-Y. Wu, "Runtime Incremental Parallel Scheduling (RIPS) on Distributed Memory Computers," IEEE Trans. Parallel and Distributed Systems, vol. 7, no. 6, pp. 637-649, June 1996.
25. J. Watts and S. Taylor, "A Practical Approach to Dynamic Load Balancing," IEEE Trans. Parallel and Distributed Systems, vol. 9, no. 3, pp. 235-248, Mar. 1998.
26. R.D. Williams; "Performance of Dynamic Load Balancing Algorithms for Unstructured Mesh Calculations," Concurrency: Practice and Experience, vol. 3, no. 5, pp. 451-481, Oct. 1991,
27. C.-Z. Xu and F. Lau, "Decentralized Remapping of Data-Parallel Computations with the Generalized Dimension Exchange Method," Proc. 1994 Scalable High Performance Computing Conf., pp. 414-421, May 1994.
28. C.-Z. Xu and F. Lau, Load Balancing in Parallel Computers: Theory and Practice. Kluwer Academic. 1997.
29. C.-Z. Xu, F. Lau, and R. Diekmann, "Decentralized Remapping of Data Parallel Applications in Distributed Memory Multiprocessors," Concurrency: Practice and Experience, pp. 1351-1376, Dec. 1997.
30. C.-Z. Xu and N. Nie, "Relaxed Implementation of Spectral Methods for Graph Partitioning," Proc. Fifth Int'l Symp. Solving Irregular Problems in Parallel, pp. 366-375, Aug. 1998.