A taxonomy of application scheduling tools for high performance cluster computing

Cluster Computing

Volumn 9, Issue 3, 2006, Pages 355-371

  Cao, Jiannong ^a   Chan, Alvin T S ^a   Sun, Yudong ^b   Das, Sajal K ^d   Guo, Minyi ^c  

^a HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

^b NEWCASTLE UNIVERSITY   (United Kingdom)

^c UNIVERSITY OF AIZU   (Japan)

^d The University of Texas at Arlington   (United States)

Author keywords

Cluster; Directed acyclic graph; Scheduling tool; Task graph; Task scheduling

Indexed keywords

EID: 33748871681     PISSN: 13867857     EISSN: 15737543     Source Type: Journal    
DOI: 10.1007/s10586-006-9747-2     Document Type: Article

References (59)

1. I. Ahmad and Y. Kwok, On exploiting task duplication in parallel program scheduling. IEEE Trans. on Parallel and Distributed Systems 9(9) (September 1998) 872-892.
2. I. Ahmad, Y. Kwok, M. Yu, and W. Shu, CASCH: A software tool for automatic parallelization and scheduling of programs on message-passing multiprocessors. IEEE Concurrency 8(4) (October-December 2000) 21-33.
3. G. Aloisio and M. Bochicchio, The use of PVM with workstation clusters for distributed SAR data processing, in: Proceedings of HPCN Europe 1995, Milan, Italy, LNCS 919, Springer, (May 1995) pp. 570-581.
4. O. Arndt, B. Freisleben, T. Kielmann, and F. Thilo, A comparative study of online scheduling algorithms for networks of workstations, Cluster Computing 3(2) (2000) 95-112.
5. M. Baker, G. Fox, and H. Yau, Cluster management software (1996) http://www.crpc.rice.edu/NHSEreview/CMS/.
6. M. Baker, (ed.), Cluster computing white paper, IEEE Computer Society Task Force on Cluster Computing (TFCC) http://www.csm.port.ac.uk/~mab/ tfcc/WhitePaper/ (December 2000).
7. A. Beguelin, J. Dongarra, A. Geist, R. Manchek, K. Moore, R. Wade, and V. Sunderam, HeNCE: Graphical development tools for network-based concurrent computers, in: Proceedings of the Scalable High Performance Computing Conference, Williamsburg, IEEE Computer Society Press, (April 1992) pp. 129-136.
8. A. Beguelin, J. Dongarra, A. Geist, R. Manchek, and K. Moore, HeNCE: A heterogeneous network computing environment, Scientific Programming 3(1) (1994) 49-60.
9. J. Bernabeu, Y. Khalidi, V. Matena, K. Shirriff, and M. Thadani, Solaris MC: A multi-computer OS, Technical Report: TR-95-48, Sun Microsystems http://research.sun.com/research/techrep/1995/abstract-48.html.
10. R. Buyya (ed), High Performance Cluster Computing: Architectures and Systems, vol. 1, (Prentice Hall PTR, NJ, USA 1999).
11. R. Buyya, (ed), High performance cluster computing: Programming and applications, vol. 2, Prentice Hall PTR, NJ, USA (1999).
12. J. Cao, A. Chan, Y. Sun, and K. Zhang, Dynamic Configuration Management in Graph-Oriented Distributed Programming Environment, Science of Computer Programming 48(1) (July 2003) 43-65.
13. Condor, http://www.cs.wisc.edu/condor/.
14. M. Cosnard and E. Jeannot, Compact DAG representation and its dynamic scheduling, Journal of Parallel and Distributed Computing 58(3) (September 1999) 487-514.
15. S. Darbha and D. Agrawal, A fast and scalable scheduling algorithm for distributed memory systems, in: Proceedings of the 7th IEEE Symposium on Parallel and Distributed Processing, San Antonio, TX (October 25-28, 1995) pp. 60-63.
16. S. Darbha and D. Agrawal, A task duplication based scalable scheduling algorithm for distributed memory systems, Journal of Parallel and Distributed Systems 46(1) (October 1997) 15-27.
17. J. Dongarra, J. Croz, I. Duff, and S. Hammarling, A set of level 3 basic linear algebra subprograms, ACM Trans. on Mathematical Software 16(1) (1990) 1-17.
18. D. Feitelson, L. Rudolph, U. Schwiegelshohn, K. Sevcik, and P. Wong, Theory and practice in parallel job scheduling, in: Proceedings of 3rd Workshop on Job Scheduling Strategies for Parallel Processing, LNCS 1291, Springer-Verlag, (1997) pp. 1-34.
19. D. Feitelson, A survey of scheduling in multiprogrammed parallel systems, Research Report RC 19790 (87657), IBM T. J. Watson Research Center (October 1994), Revised version in August 1997.
20. D. Feitelson, Scheduling parallel jobs on clusters, in: High Performance Cluster Computing: Architectures and Systems, vol. 1, Rajkumar Buyya (ed.), Prentice-Hall (1999) pp. 519-533.
21. J. Gehring and A. Reinefeld, MARS-a framework for minimizing the job execution time in a metacomputing environment, Future Generation Computer Systems 12(1) (1996) 87-99.
22. A. Gerasoulis, J. Jiao, and T. Yang, A multistage approach to scheduling task graphs, DIMACS Series in Discrete Mathematics and Theoretical Computer Science 22 (1995) 81-105.
23. GLUnix, http://now.cs.berkeley.edu/Glunix/glunix.html.
24. A. Grama, A. Gupta, G. Karypis, and V. Kumar, Introduction to Parallel Computing, 2nd ed., Pearson Education (2003).
25. A. Grimshaw, J. Weissman, and W. Strayer, Portable run-time support for dynamic object-oriented parallel processing, ACM Trans. on Computer Systems 14(2) (May 1996) 139-170.
26. A. Grimshaw, W. Wulf, and the Legion team, The Legion vision of a worldwide virtual computer, Communications of ACM 40(1) (January 1997) 39-45.
27. A. Grimshaw, A. Ferrari, F. Knabe, and M. Humphrey, Legion: An operating system for wide-area computing, IEEE Computer 32(5) (May 1999) 29-37.
28. L. Huang, M. Oudshoorn and J. Cao, Design and implementation of an adaptive task mapping environment for parallel programming, Australian Computer Science Communications 19(1) (February 1997) 326-335.
29. K. Hwang and Z. Xu, Scalable Parallel Computing: Technology, Architecture, Programming, (WCB/McGraw-Hill 1998).
30. IBM Redbook, Workload management with LoadLeveler, http://publib-b.boulder.ibm.com/Redbooks.nsf/RedbookAbstracts/ sg246038.html?Open.
31. IBMσerver Cluster 1600 http://www-1.ibm.com/servers/eserver/clusters/ hardware/1600.html.
32. H. James, Scheduling in metacomputing systems, Ph.D. thesis, University of Philosophy (July 1999) http://www.dhpc.adelaide.edu.au/reports/057/ html.
33. C. Jenssen, Parallel computational fluid dynamics 2000: Trends and applications, Elsevier Science (2001).
34. J. Krallmann, U. Schwiegelshohn, and R. Yahyapour, On the design and evaluation of job scheduling algorithms, in: Proce of 5th Workshop on Job Scheduling Strategies for Parallel Processing, in conjunction with IPPS/SPDP'99, San Juan, Puerto Rico (April 16, 1999) pp. 17-42.
35. Y. Kwok and I. Ahmad, Benchmarking and comparison of the task graph scheduling algorithms, Journal of Parallel and Distributed Computing 59(3) (December 1999) 381-422.
36. Y. Kwok and I. Ahmad, Static scheduling algorithms for allocating directed task graphs to multiprocessors, ACM Computing Surveys 31(4) (December 1999) 406-471.
37. C. Lee, J. Hwang, Y. Chow, and F. Anger, Multiprocessor scheduling with interprocessor communication delays, Operations Research Letters 7(3) (June 1988) 141-147.
38. Legion, http://legion.virginia.edu/.
39. LSF, http://www.platform.com/products/wm/LSF/index.asp.
40. MOSIX, http://www.mosix.com/.
41. MPI, http://www-unix.mcs.anl.gov/mpi/.
42. Myricom: Creator of Myrinet, http://www.myri.com/.
43. OpenMP, http://www.openmp.org/.
44. G. F. Pfister, In Search of Clusters, 2nd ed., (Prentice Hall 1998).
45. PVM, http://www.csm.ornl.gov/pvm/pvm_home.html.
46. S. Ranaweera and D. Agrawal, A task duplication based scheduling algorithm for heterogeneous systems, in: Proceedings of 14th International Parallel and Distributed Processing Symposium (IPDPS'2000), Cancun, Mexico (May 1-5, 2000) pp. 445-450.
47. H. El-Rewini, T. Lewis, and H. Ali, Task Scheduling in Parallel and Distributed Systems, (Prentice Hall PTR, NJ 1994).
48. M. Senar, A. Ripoll, A. Cortes, and E. Luque, Clustering and reassignment-based mapping strategy for message-passing architectures, in: Proceedings of IPPS/SPDP 1998, Orlando, Florida (March 30-April 3, 1998) pp. 415-421.
49. H. Shen, S. Lor, and P. Maheshwari, An architecture-independent graphical tool for automatic contention-free process-to-processor mapping, The Journal of Supercomputing 18(2) (February 2001) 115-139.
50. S. Spach and R. Pulleyblank, Parallel raytraced image generation, Hewlett-Packard Journal 43(3) (June 1992) 76-83.
51. J. Squyres, A. Lumsdaine, and R. Stevenson, A cluster-based parallel image processing toolkit, Visual Data Exploration and Analysis III, vol. 2421 of SPIE Proceedings, Society of Photo-optical Instrumentation Engineers (SPIE) (1995) pp. 228-239.
52. Sun Microsystems, Sun[tm] Clusters: Providing enterprise-wide business-critical computing, White Paper (October 1997) http://wwws.sun.com/software/cluster/wp-sunclusters/.
53. Y. Sun and C. Wang, Solving irregularly structured problems based on distributed object model, Parallel Computing 29(11/12) (November 2003) 1539-1562.
54. T. Tamura, M. Oguchi, and M. Kitsuregawa, Parallel database processing on a 100 node PC cluster: Cases for decision support query processing and data mining, in: Proceedings of Supercomputing Conference (SC'97), San Jose (November 15-21, 1997).
55. H. Topcuoglu, S. Hariri, W. Furmanski, J. Valente, I. Ra, D. Kim, Y. Kim, X. Bing, and B. Ye, The software architecture of a virtual distributed computing environment, in: Proceedings of 6th International Symposium on High Performance Distributed Computing (HPDC' 97), Portland, OR (August 5-8, 1997) pp. 40-49.
56. H. Topcuoglu, S. Hariri, D. Kim, Y. Kim, X. Bing, B. Ye, I. Ra, and J Valente, The design and evaluation of a virtual distributed computing environment, Cluster Computing 1(1) (1998) 81-93.
57. Windows 2000 Cluster Technologies, http://www.microsoft.com/windows2000/ technologies/clustering/
58. M. Wu and D. Gajski, Hypertool: A programming aid for message-passing systems, IEEE Trans. on Parallel and Distributed Systems 3(1) (1990) 330-343.
59. T. Yang and A. Gerasoulis, PYRROS: Static task scheduling and code generation for message passing multiprocessors, in: Proceedings of the 1992 ACM International Conference on Supercomputing, Washington D.C. (1992) pp. 428-437.