A semi-static approach to mapping dynamic iterative tasks onto heterogeneous computing systems

Journal of Parallel and Distributed Computing

Volumn 66, Issue 1, 2006, Pages 77-98

  Kwok, Yu Kwong ^a,f,g   MacIejewski, Anthony A ^b,f,h   Siegel, Howard Jay ^b,c,f,g,h,i   Ahmad, Ishfaq ^d,j,k   Ghafoor, Arif ^e,f,l  

^a UNIVERSITY OF HONG KONG   (Hong Kong)

^b Engineering Research Center and Hydraulics Laboratory   (United States)

^c Colorado State University   (United States)

^d The University of Texas at Arlington   (United States)

^e PURDUE UNIVERSITY   (United States)

^f IEEE   (Japan)

^g ACM

^h Department of Environmental and Radiological Health Sciences   (United States)

ⁱ IEEE Communications Society ^*  (United States)

^j UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

^k IRIS (Institute for Research in Security)   (United States)

^l Distributed Multimedia Systems Laboratory   (United States)

more..

Author keywords

Automatic target recognition; Genetic algorithms; Heterogeneous computing; Iterative task graphs; Mapping; Parallel processing; Scheduling

Indexed keywords

HETEROGENEOUS COMPUTING; ITERATIVE TASK GRAPHS;

AUTOMATIC TARGET RECOGNITION; DATA ACQUISITION; GENETIC ALGORITHMS; ONLINE SYSTEMS; PARALLEL PROCESSING SYSTEMS; PROGRAM PROCESSORS; SCHEDULING;

ITERATIVE METHODS;

EID: 29244445082     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2005.06.015     Document Type: Article

References (60)

1. I. Ahmad, and A. Ghafoor Semi-distributed load balancing for massively parallel multicomputer systems IEEE Trans. Software Eng. 17 10 October 1991 987 1004
2. S. Ali, T.D. Braun, H.J. Siegel, A.A. Maciejewski, N. Beck, L.L. Bölöni, M. Maheswaran, A.I. Reuther, J.P. Robertson, M.D. Theys, and B. Yao Characterizing resource allocation heuristics for heterogeneous computing systems A.R. Hurson Advances in Computers, Parallel, Distributed, and Pervasive Computing vol. 63 2005 Elsevier Amsterdam, The Netherlands 91 128
3. H.M. Alnuweiri, and V.K. Prasanna Parallel architectures and algorithms for image component labeling IEEE Trans. Pattern Anal. Mach. Intell. 14 10 October 1992 1014 1034
4. P. Baglietto, M. Maresca, M. Migliardi, and N. Zingirian Image processing on high-performance RISC systems Proc. IEEE 84 7 July 1996 917 930
5. R. Bajaj, and D.P. Agrawal Improving scheduling of tasks in a heterogeneous environment IEEE Trans. Parallel Distributed Systems 15 2 February 2004 107 118
6. C. Banino, O. Beaumont, L. Carter, J. Ferrante, A. Legrand, Y. Robert, Scheduling strategies for master-slave tasking on heterogeneous processor platforms, IEEE Trans. Parallel Distributed Systems 15 (4) (April 2004) 319-300.
7. T.D. Braun, H.J. Siegel, N. Beck, L.L. Bölöni, M. Maheswaran, A.I. Reuther, J.P. Robertson, M.D. Theys, B. Yao, D. Hensgen, and R.F. Freund A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems J. Parallel Distributed Comput. 61 6 June 2001 810 837
8. L.L. Bölöni, and D.C. Marinescu Robust scheduling of metaprograms J. Scheduling 5 5 September 2002 395 412
9. J.R. Budenske, R.S. Ramanujan, H.J. Siegel, Modeling ATR applications for intelligent execution upon a heterogeneous computing platform, Proceedings of the 1997 IEEE International Conference on Systems, Man, and Cybernetics, October 1997, pp. 649-656.
10. J.R. Budenske, R.S. Ramanujam, and H.J. Siegel A method for the on-line use of off-line derived remappings of iterative automatic target recognition tasks onto a particular class of heterogeneous parallel platforms J. Supercomput. 12 4 October 1998 387 406
11. E.A. Carmona, and M.D. Rice Modeling the serial and parallel fractions of a parallel program J. Parallel Distributed Comput. 13 3 November 1991 286 298
12. C.G. Cassandras Discrete Event Systems: Modeling and Performance Analysis 1993 Irwin Homewood, IL
13. A. Choudhary, and R. Thakur Connected component labeling on coarse grain parallel computers: an experimental study J. Parallel Distributed Comput. 20 1 January 1994 78 83
14. C.H. Chu, E.J. Delp, H.J. Siegel, F.J. Weil, and A.B. Whinston A model for an intelligent operating system for executing image understanding tasks on a reconfigurable parallel architectures J. Parallel Distributed Comput. 6 3 June 1989 598 622
15. N. Copty, S. Ranka, G. Fox, and R.V. Shankar A data parallel algorithm for solving the region growing problem on the connection machine J. Parallel Distributed Comput. 21 1 April 1994 160 168
16. P. David, S. Balakirsky, D. Hillis, A real-time automatic target acquisition system, Proceedings of the International Conference on Unmanned Vehicle Systems, July 1990, pp.183-198.
17. P. David, P. Emmerman, S. Ho, A scalable architecture system for automatic target recognition, Proceedings of the 13th AIAA/IEEE Digital Avionics Systems Conference, October 1994, pp. 414-420.
18. T.H. Einstein, Mercury Computer Systems' Modular Heterogeneous RACE Multicomputer, Proceedings of the Sixth Heterogeneous Computing Workshop, April 1997, pp. 60-71.
19. M.M. Eshaghian (Ed.), Heterogeneous Computing, Artech House, Norwood, MA, 1996.
20. M.M. Eshaghian, J.G. Nash, M.E. Shaaban, D.B. Shu, Heterogeneous algorithms for image understanding architecture, Proceedings of the Workshop on Computer Architectures for Machine Perception, December 1993, pp. 286-292.
21. T. Fahringer Estimating and optimizing performance for parallel programs Computer 28 11 November 1995 47 56
22. D. Fernandez-Baca Allocating modules to processors in a distributed systems IEEE Trans. Software Eng. SE-15 11 November 1989 1427 1436
23. M.R. Garey, and D.S. Johnson Computers and Intractability: A Guide to the Theory of NP-Completeness 1979 W.H. Freeman and Company New York
24. A. Ghafoor, and J. Yang A distributed heterogeneous supercomputing management system Computer 26 6 June 1993 78 86
25. N. Guil, and E.L. Zapata Fast Hough transform on multiprocessors: a branch and bound approach J. Parallel Distributed Comput. 45 1 August 1997 82 89
26. K. Hwang, Z. Xu, and M. Arakawa Benchmark evaluation of the IBM SP2 for parallel signal processing IEEE Trans. Parallel Distributed Systems 7 5 May 1996 522 536
27. A.A. Khokhar, G.W. Cook, L.H. Jamieson, E.J. Delp, Coarse-grained algorithms and implementations of structural indexing-based object recognition on Intel touchstone delta, Proceedings of the 12th International Conference on Pattern Recognition, vol. 3, October 1994, pp. 279-283.
28. A.A. Khokhar, V.K. Prasanna, M. Shaaban, and C.-L. Wang Heterogeneous computing: challenges and opportunities Computer 26 6 June 1993 18 27
29. Y.-K. Kwok, and I. Ahmad Dynamic critical-path scheduling: an effective technique for allocating task graphs onto multiprocessors IEEE Trans. Parallel Distributed Systems 7 5 May 1996 506 521
30. G.O. Ladd Jr., Practical issues in heterogeneous processing systems for military applications, Proceedings of the Sixth Heterogeneous Computing Workshop, April 1997, pp. 162-169.
31. C. Lee, Y.-F. Wang, and T. Yang Global optimization for mapping parallel image processing tasks on distributed memory machines J. Parallel Distributed Comput. 45 1 August 1997 29 45
32. Q. Liu, R.J. Sclabassi, M.L. Scheuer, M. Sun, A two-step method for compression of medical monitoring video, Proceedings of the 25th Annual International IEEE Engineering in Medicine and Biology Society, vol. 1, September 2003, pp. 845-848.
33. S. Madala, and J.B. Sinclair Performance of synchronous parallel algorithms with regular structures IEEE Trans. Parallel Distributed Systems 2 1 January 1991 105 116
34. M. Maheswaran, S. Ali, H.J. Siegel, D. Hensgen, and R.F. Freund Dynamic mapping of a class of independent tasks onto heterogeneous computing systems J. Parallel Distributed Comput. 59 2 November 1999 107 131
35. M. Maheswaran, T.D. Braun, and H.J. Siegel Heterogeneous distributed computing J. Webster Encyclopedia of Electrical and Electronics Engineering vol. 8 1999 Wiley New York, NY 679 690
36. D.C. Marinescu, and J.R. Rice On high level characterization of parallelism J. Parallel Distributed Comput. 20 1 January 1994 107 113
37. D.G. Morris III, D.K. Lowenthal, Accurate data redistribution cost estimation in software distributed shared memory systems, Proceedings of the Eighth ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'2001), June 2001, pp. 62-71.
38. D.M. Nicol, and J.H. Saltz Dynamic remapping of parallel computations with varying resource demands IEEE Trans. Comput. 37 9 September 1988 1073 1087
39. C.-I. Park, and T.-Y. Choe An optimal scheduling algorithm based on task duplication IEEE Trans. Comput. 51 4 April 2002 444 448
40. A. Radulescu, C. Nicolescu, A.J.C. van Gemund, P.P. Jonker, CPR: mixed task and data parallel scheduling for distributed systems, Proceedings of the 15th International Parallel and Distributed Processing Symposium (IPDPS'2001), April 2001.
41. S. Ramaswamy, S. Sapatnekar, and P. Banerjee A framework for exploiting task and data parallelism on distributed memory multicomputers IEEE Trans. Parallel Distributed Systems 8 11 November 1997 1098 1116
42. Remos, http://www-2.cs.cmu.edu/ ∼ cmcl/remulac/remos.html, 2003.
43. U. Rencuzogullari, S. Dwarkadas, Dynamic adaptation to available resources for parallel computing in an autonomous network of workstations, Proceedings of the Eighth ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'2001), June 2001, pp. 72-81.
44. K.C. Sevcik Characterizations of parallelism in applications and their use in scheduling Performance Eval. Rev. 17 1 May 1989 171 180
45. G. Shao, R. Wolski, F. Berman, Modeling the cost of redistribution in scheduling, Proceedings of the Eighth SIAM Conference on Parallel Processing for Scientific Computing, March 1997.
46. H.J. Siegel, J.K. Antonio, R.C. Metzger, M. Tan, and Y.A. Li Heterogeneous computing A.Y. Zomaya Parallel and Distributed Computing Handbook 1996 McGraw-Hill New York, NY 725 761
47. H.J. Siegel, T.D. Braun, H.G. Dietz, M.B. Kulaczewski, M. Maheswaran, P.H. Pero, J.M. Siegel, J.E. So, M. Tan, M.D. Theys, L. Wang, The PASM Project: a study of reconfigurable parallel computing, Proceedings of the Second International Symposium on Parallel Architectures, Algorithms, and Networks, June 1996, pp. 529-536.
48. H.J. Siegel, H.G. Dietz, and J.K. Antonio Software support for heterogeneous computing A.B. Tucker Jr. The Computer Science and Engineering Handbook 1997 CRC Press Boca Raton, FL 1886 1909
49. H.J. Siegel, T. Schwederski, W.G. Nation, J.B. Armstrong, L. Wang, J.T. Kuehn, R. Gupta, M.D. Allemang, D.G. Meyer, and D.W. Watson The design and prototyping of the PASM reconfigurable parallel processing system A.Y. Zomaya Parallel Computing Paradigms and Applications 1996 International Thomson Computer Press London, UK 78 114
50. M. Singh, S. Singh, Image segmentation optimisation for X-ray images of airline luggage, Proceedings of the 2004 IEEE International Conference on Computational Intelligence for Homeland Security and Personal Safety (CIHSPS'2004), July 2004, pp. 10-17.
51. M. Srinivas, and L.M. Patnaik Genetic algorithms: a survey Computer 27 6 June 1994 17 26
52. J. Subhlok, P. Lieu, B. Lowekamp, Automatic node selection for high performance applications on networks, Proceedings of the Seventh ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'1999), May 1999, pp. 163-172.
53. M. Tan, and H.J. Siegel A stochastic model for heterogeneous computing and its application in data relocation scheme development IEEE Trans. Parallel Distributed Systems 9 11 November 1998 1088 1101
54. M. Tan, H.J. Siegel, J.K. Antonio, and Y.A. Li Minimizing the application execution time through scheduling of subtasks and communication traffic in a heterogeneous computing system IEEE Trans. Parallel Distributed Systems 8 8 August 1997 857 871
55. B. Veeravalli, and W.H. Min Scheduling divisible loads on heterogeneous linear daisy chain networks with arbitrary processor release times IEEE Trans. Parallel Distributed Systems 15 3 March 2004 273 288
56. J.G. Verly, and R.L. Delanoy Model-based automatic target recognition (ATR) system for forwardlooking groundbased and airborne imaging Laser Radars (LADAR) Proc. IEEE 84 2 February 1996 126 163
57. Q. Wang, and K.H. Cheng List scheduling of parallel tasks Inform. Process. Lett. 37 5 March 1991 291 297
58. L. Wang, H.J. Siegel, V.P. Roychowdhury, and A.A. Maciejewski Task matching and scheduling in heterogeneous computing environments using a genetic-algorithm-based approach J. Parallel Distributed Comput. 47 1 November 1997 8 22
59. F.J. Weil, L.H. Jamieson, and E.J. Delp Dynamic intelligent scheduling and control of reconfigurable parallel architectures for computer vision/image processing J. Parallel Distributed Comput. 13 3 November 1991 273 285
60. T. Yang, and C. Fu Heuristic algorithms for scheduling iterative task computations on distributed memory machines IEEE Trans. Parallel Distributed Systems 8 6 June 1997 608 622