Optimal periodic remapping of dynamic bulk synchronous computations

Journal of Parallel and Distributed Computing

Volumn 63, Issue 11, 2003, Pages 1036-1049

  Fong, Ngo Tai ^a   Xu, Cheng Zhong ^a   Wang, Le Yi ^a  

^a WAYNE STATE UNIVERSITY   (United States)

Author keywords

Bulk synchronous computations; Dynamic remapping; Load balancing; Stochastic optimization; Task assignment

Indexed keywords

EID: 0344152886     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2003.07.004     Document Type: Article

References (31)

1. V.D. Agrawal, S.T. Chakradhar, Performance analysis of synchronized iterative algorithms on multiprocessor systems, IEEE Trans. Parallel Distrib. Systems 3 (6) (1992) 739-746.
2. A.H.-S. Ang, W.H. Tang, Probability Concepts in Engineering Planning and Design, Vol. II, Rainbow Bridge, John Wiley & Sons, 1984.
3. R. Armstrong, D. Hensgen, T. Kidd, The relative performance of various mapping algorithms is independent of sizable variances in run-time predictions, Proceedings of the Seventh Heterogeneous Computing Workshop, Orlando, FL, 1998.
4. A.N. Choudhary, B. Narahari, R. Krishnamurti, An efficient heuristic scheme for dynamic remapping of parallel computations, Parallel Comput. 19 (1993) 621-632.
5. H.A. David, Order Statistics, 2nd Edition, Wiley, New York, 1981.
6. G. Edjlali, G. Agrawal, A. Sussman, J. Humphries, J. Saltz, Compiler and runtime support for programming in adaptive parallel environments, Sci. Programming 6 (1997) 215-227.
7. R.V. Hanxleden, L.R. Scott, Load balancing on message passing architectures, J. Parallel Distrib. Comput. 13 (3) (1991) 312-324.
8. J. De Keyser, D. Roose, Multigrid with solution-adaptive irregular grids on distributed memory computers, in: D.J. Evans, G.R. Joubert, H. Liddell (Eds.), Parallel Computing, Elsevier Science Publishers, Amsterdam, 1992, pp. 375-382.
9. Y.-K. Kwok, I. Ahmad, Static scheduling algorithms for allocating directed task graphs to multiprocessors, ACM Comput. Surveys 31 (4) (1999) 406-471.
10. Y.-K. Kwok, A. Maciejewski, H.J. Siegel, A. Ghafoor, I. Ahmad, Evaluation of a semi-static approach to mapping dynamic iterative tasks onto heterogeneous computing systems, Proceedings of the Fourth International Symposium on Parallel Architectures, Algorithms and Networks (I-SPAN'99), Free-mantle, Australia, June 1999, pp. 204-209.
11. K. Li, Stochastic bounds for parallel program execution times with processor constrains, IEEE Trans. Comput. 46 (1997) 630-636.
12. S. Madala, J.B. Sinclair, Performance of synchronous parallel algorithms with regular structures, IEEE Trans. Parallel Distrib. Systems 2 (1) (1991) 105-116.
13. M. Maheswaran, H. Siegel, A dynamic matching and scheduling algorithm for heterogeneous computing systems, Proceedings of the 7th Heterogeneous Computing Workshop, Orlando, FL, 1998, pp. 57-69.
14. D.C. Marinescu, J.R. Rice, Synchronization and load imbalance effects in distributed memory multi-processor systems, Concurrency: Pract. Exper. 3 (6) (1991) 593-625.
15. B. Moon, J. Saltz, Adaptive runtime support for direct simulation Monte Carlo methods on distributed memory architectures, Scalable High-Performance Computing Conference, Knoxville, TN, May 1994, pp. 176-183.
16. J.E. Moreira, V.K. Naik, S.P. Midkiff, Dynamic data distribution and processor repartitioning for irregularly structured computation, J. Parallel Distrib. Comput. 50 (1998) 28-60.
17. D. Nicol, G. Ciardo, Automated parallelization of discrete state-space generation, J. Parallel Distrib. Comput. 47 (2) (1997) 153-167.
18. D.M. Nicol, P.F. Reynolds, Optimal dynamic remapping of data parallel computation, IEEE Trans. Comput. 39 (2) (1990) 206-219.
19. D.M. Nicol, J.H. Saltz, Dynamic remapping of parallel computations with varying resource demands, IEEE Trans. Comput. 37 (9) (1988) 1073-1087.
20. L. Oliker, R. Biswas, Efficient load balancing and data remapping for adaptive grid calculations, In Proceedings of SPAA'97, Newport, RI, 1997.
21. G.D. Peterson, R.D. Chamberlain, Beyond execution time: expanding the use of performance models, IEEE Parallel Distrib. Technol. Vol. 2, 1994, pp. 37-49.
22. Y. Rabani, A. Sinclair, R. Wanka, Local divergence of Markov chains and the analysis of iterative load-balancing schemes, Proceedings of the 39th Annual Foundations of Computer Science, Palo Alto, CA, 1998.
23. S.M. Ross, Introduction to Probability Models, 6th Edition, Academic Press, New York, 1997.
24. W. Shu, M.-Y. Wu, Runtime incremental parallel scheduling (RIPS) on distributed memory computers, IEEE Trans. Parallel Distrib. Systems 7 (6) (1996) 637-649.
25. H. Topcuoglu, S. Hariri, M.-Y. Wu, Performance-effective and low-complexity task scheduling for heterogeneous computing, IEEE Trans. Parallel Distrib. Systems 13 (3) (2002) 260-274.
26. J. Watts, S. Taylor, A practical approach to dynamic load balancing, IEEE Trans. Parallel Distrib. Systems 9 (3) (1998) 235-248.
27. R.D. Williams, Performance of dynamic load balancing algorithms for unstructured mesh calculations, Concurrency: Practice Exper. 3 (5) (1991) 451-481.
28. C. Xu, F. Lau, Load Balancing in Parallel Computers: Theory and Practice, Kluwer Academic Publishers, Dordrecht, 1997.
29. C. Xu, F. Lau, R. Diekmann, Decentralized remapping of data parallel applications in distributed memory multiprocessors, Concurrency: Practice Exper. 9 (1997) 1351-1376.
30. C. Xu, L. Wang, N.-T. Fong, Stochastic prediction of execution time for dynamic bulk synchronous computations, J. Super-computing 21 (2002) 91-103.
31. G. Yin, C. Xu, L. Wang, Optimal remapping in dynamic bulk synchronous computations via a stochastic control approach, IEEE Trans. Parallel Distrib. Systems 14 (1) (2003) 51-62.