Meta-heuristics for grid scheduling problems

Studies in Computational Intelligence

Volumn 146, Issue , 2008, Pages 1-37

  Xhafa, Fatos ^a   Abraham, Ajith ^b  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

^b NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

Author keywords

Grid computing; Grid workflow; Heuristics; Independent scheduling; Meta heuristics; Multi objective optimization; Scheduling

Indexed keywords

EID: 51649112187     PISSN: 1860949X     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-540-69277-5_1     Document Type: Review

References (81)

1. Alba, E., Almeida, F., Blesa, M., Cotta, C., Díaz, M., Dorta, I., Gabarró, J., León, C., Luque, G., Petit, J., Rodríguez, C., Rojas, A., Xhafa, F.: Efficient parallel LAN/WAN algorithms for optimization. The MALLBA project. Parallel Computing 32(5-6), 415-440 (2006)
2. Abraham, A., Buyya, R., Nath, B.: Nature's heuristics for scheduling jobs on computational grids. In: The 8th IEEE International Conference on Advanced Computing and Communications (ADCOM 2000), India (2000)
3. Abraham, A., Liu, H., Zhang, W., Chang, T.: Scheduling jobs on computational grids using fuzzy particle swarm algorithm. In: 10th Int. Conf. on Knowledge-Based & Intelligent Information & Engineering Systems. LNCS. Springer, Heidelberg (2006)
4. Abramson, D., Buyya, R., Giddy, J.: A computational economy for grid computing and its implementation in the Nimrod-G resource broker. Future Generation Computer Systems Journal 18(8), 1061-1074 (2002)
5. Ali, S., Siegel, H.J., Maheswaran, M., Hensgen, D.: Task execution time modeling for heterogeneous computing systems. In: Proceedings of Heterogeneous Computing Workshop (HCW 2000), pp. 185-199 (2000)
6. Beynon, M.D., Sussman, A., Catalyurek, U., Kure, T., Saltz, J.: Optimization for data intensive grid applications. In: Third Annual International Workshop on Active Middleware Services, California, pp. 97-106 (2001)
7. Braun, T.D., Siegel, H.J., Beck, N., Boloni, L.L., Maheswaran, M., Reuther, A.I., Robertson, J.P., Theys, M.D., Yao, B.: A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J. of Parallel and Distributed Comp. 61(6), 810-837 (2001)
8. Burke, E., Kendall, G., Landa Silva, D., O'Brien, R., Soubeiga, E.: An ant algorithm hyperheuristic for the project presentation scheduling problem. The 2005 IEEE Congress on Evolutionary Computation 3, 2263-2270 (2005)
9. Burke, E.K., Kendall, G., Newall, J., Hart, E., Ross, P., Schulemburg, S.: HyperheAristics: an Emerging Direction in Modern Search Technology. In: Glover, F.W., Kochenberger, G.A. (eds.) Handbook of Meta-heuristics. Kluwer, Dordrecht (2003)
10. Burke, E.K., Kendall, G., Soubeiga, E.: A Tabu-Search Hyperheuristic for Timetabling and Rostering. J. Heuristics 9(6), 451-470 (2003)
11. Burke, E., Soubeiga, E.: Scheduling Nurses Using a Tabu-Search Hyperheuristic. In: Proceedings of the 1st Multidisciplinary International Conference on Scheduling: Theory and Applications (MISTA 2003), Nottingham, UK, pp. 180-197 (2003)
12. Buyya, R.: Economic-based Distributed Resource Management and Scheduling for Grid Computing. PhD thesis, Monash University, Australia (2002)
13. Buyya, R., Abramson, D., Giddy, J.: Nimrod/G: An architecture for a resource management and scheduling system in a global computational grid. In: The 4th Int. Conf. on High Performance Comp., Asia-Pacific, China (2000)
14. Cahon, S., Melab, N., Talbi, E.: ParadisEO: A Framework for the Reusable Design of Parallel and Distributed Meta-heuristics. Journal of Heuristics 10(3), 357-380 (2004)
15. Cao, J., Jarvis, S.A., Saini, S., Nudd, G.R.: GridFlow: Workflow Management for Grid Computing. In: Proc. of the 3rd International Symposium on Cluster Computing and the Grid (CCGrid 2003), Tokyo, Japan, May 2003, pp. 198-205 (2003)
16. Carretero, J., Xhafa, F.: Using Genetic Algorithms for Scheduling Jobs in Large Scale Grid Applications. Journal of Technological and Economic Development -A Research Journal of Vilnius Gediminas Technical University 12(1), 11-17 (2006)
17. Casanova, H., Dongarra, J.: Netsolve: Network enabled solvers. IEEE Computational Science and Engineering 5(3), 57-67 (1998)
18. Casanova, H., Kim, M., Plank, J.S., Dongarra, J.J.: Adaptive Scheduling for Task Farming with Grid Middleware. Int. J. High Perform. Comput. Appl. 13(3), 231-240 (1999)
19. Chin, S., Lee, J., Yoon, T., Yu, H.: List Scheduling Method for Service Oriented Grid Applications. In: Proceedings of the Second international Conference on Semantics, Knowledge, and Grid, p. 44. IEEE Computer Society, Los Alamitos (2006)
20. Chunlin, L., Layuan, L.: Joint QoS optimization for layered computational grid. Inf. Sci. 177(15), 3038-3059 (2007)
21. Domingues, P., Andrzejak, A., Silva, L.: Scheduling for fast touraround time on institutional desktop grid. CoreGRID TechRep No. 0027
22. Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A Fast and Elitist Multiobjective Genetic Algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6(2), 182-197 (2002)
23. Ehrgott, M., Gandibleux, X.: Approximative solution methods for multiobjective combinatorial optimization. TOP -Trabajos de Investigaci'on Operativa 12(1), 1-88 (2004)
24. Ernemann, C., Hamscher, V., Yahyapour, R.: Benefits of Global Grid Computing for Job Scheduling. In: Proceedings of the Fifth IEEE/ACM International Workshop on Grid Computing. International Conference on Grid Computing, pp. 374-379. IEEE Computer Society, Washington (2004)
25. Fibich, P., Matyska, L., Rudová, H.: Model of Grid Scheduling Problem. In: Exploring Planning and Scheduling for Web Services, Grid and Autonomic Computing, pp. 17-24. AAAI Press, Menlo Park (2005)
26. Foster, I., Kesselman, C.: The Grid - Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco (1998)
27. Foster, I., Kesselman, C., Tuecke, S.: The anatomy of the grid. International Journal of Supercomputer Applications 15(3) (2001)
28. Fujimoto, N., Hagihara, K.: Near-Optimal Dynamic Task Scheduling of Precedence Constrained Coarse-Grained Tasks onto a Computational Grid. In: Second International Symposium on Parallel and Distributed Computing (ISPDC 2003), pp. 80-87 (2003)
29. Gao, Y., Rong, H., Huang, J.Z.: Adaptive Grid job scheduling with genetic algorithms. Future Gener. Comput. Syst. 21(1), 151-161 (2005)
30. Garey, M.R., Johnson, D.S.: Computers and Intractability - A Guide to the Theory of NP-Completeness. W.H. Freeman and Co., New York (1979)
31. Gendreau, M., Potvin, J.-Y.: Meta-heuristics in Combinatorial Optimization. Annals of Operations Research 140(1), 189-213 (2005)
32. Glover, F.: Future Paths for Integer Programming and Links to Artificial Intelligence. Computers and Op. Res. 5, 533-549 (1986)
33. Gomoluch, J., Schroeder, M.: Market-based Resource Allocation for Grid Computing: A Model and Simulation. In: Middleware Workshops 2003, pp. 211-218 (2003)
34. Goux, J.P., Kulkarni, S., Linderoth, J., Yoder, M.: An enabling framework for master-worker applications on the computational grid. In: 9th IEEE Int. Symposium on High Performance Distributed Computing (HPDC 2000) (2000)
35. Hao, X., Dai, Y., Zhang, B., Chen, T., Yang, L.: QoS-Driven Grid Resource Selection Based on Novel Neural Networks. In: Chung, Y.-C., Moreira, J.E. (eds.) GPC 2006. LNCS, vol. 3947, pp. 456-465. Springer, Heidelberg (2006)
36. Hotovy, S.: Workload evolution on the Cornell Theory Center IBM SP2. In: Job Scheduling Strategies for Parallel Proc. Workshop, IPPS 1996, pp. 27-40 (1996)
37. The Hebrew University Parallel Systems Lab. Parallel workload archive, http://www.cs.huji.ac.il/labs/parallel/workload/
38. Huedo, E., Montero, R.S., Llorente, I.M.: Experiences on Adaptive Grid Scheduling of Parameter Sweep Applications. In: 12th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2004), p. 28 (2004)
39. Hoos, H.H., Stützle, Th.: Stochastic Local Search: Foundations and Applications. Elsevier/Morgan Kaufmann (2005)
40. Kondo, D.: Scheduling Task Parallel Applications for Rapid Turnaround on Desktop Grids. Doctoral Thesis, University of California at San Diego (2005)
41. Kondo, D., Chien, A., Casanova, H.: Scheduling Task Parallel Applications for Rapid Turnaround on Enterprise Desktop Grids. Journal of Grid Computing 5(4), 379-405 (2007)
42. Lee, L., Liang, C., Chang, H.: An Adaptive Task Scheduling System for Grid Computing. In: Proceedings of the Sixth IEEE international Conference on Computer and information Technology (CIT 2006), September 20-22, p. 57. IEEE Computer Society, Washington (2006)
43. Linderoth, L., Wright, S.J.: Decomposition algorithms for stochastic programming on a computational grid. Computational Optimization and Applications (Special issue on Stochastic Programming) 24, 207-250 (2003)
44. Maheswaran, M., Ali, S., Siegel, H.J., Hensgen, D., Freund, R.F.: Dynamic mapping of a class of independent tasks onto heterogeneous computing systems. Journal of Parallel and Distributed Computing 59(2), 107-131 (1999)
45. Di GaspAro, L., Schaerf, A.: EasyLocal++: an object-oriented framework for the flexible design of local search algorithms and metaheuristics. In: 4th Metaheuristics International Conference (MIC 2001), pp. 287-292 (2001)
46. Di Martino, V., Mililotti, M.: Sub optimal scheduling in a grid using genetic algorithms. Parallel Computing 30, 553-565 (2004)
47. Lee, Y.C., Zomaya, A.Y.: Practical Scheduling of Bag-of-Tasks Applications on Grids with Dynamic Resilience. IEEE Transactions on Computers 56(6), 815-825 (2007)
48. MichalewiczM Z., Fogel, D.B.: How to solve it: modern heuristics. Springer, Heidelberg (2000)
49. Moscato, P.: On evolution, search, optimization, genetic algorithms and martial arts: Towards memetic algorithms. Technical report No. 826, California Institute of Technology, USA (1989)
50. MacLaren, J., Sakellariou, R., Krishnakumar, K.T., Garibaldi, J., Ouelhadj, D.: Towards Service Level Agreement Based Scheduling on the Grid. In: Workshop on Planning and Scheduling for Web and Grid Services (held in conjunction with the 14th International Conference on Automated Planning and Scheduling (ICAPS 2004)), Canada (2004)
51. Newman, H.B., Ellisman, M.H., Orcutt, J.A.: Data-intensive e-Science frontier research. Communications of ACM 46(11), 68-77 (2003)
52. Othman, A., Dew, P., Djemame, K., Gourlay, K.: Adaptive Grid Resource Brokering. In: IEEE International Conference on Cluster Computing (CLUSTER 2003), p. 172 (2003)
53. Page, J., Naughton, J.: Framework for task scheduling in heterogeneous distributed computing using genetic algorithms. AI Review 24, 415-429 (2005)
54. Paniagua, C., Xhafa, F., Caballé, S., Daradoumis, T.: A parallel grid-based implementation for real time processing of event log data in collaborative applications. In: Parallel and Distributed Processing Techniques (PDPT 2005), Las Vegas, USA, pp. 1177-1183 (2005)
55. Perez, J., Kégl, B., Germain-Renaud, C.: Reinforcement learning for utility-based Grid scheduling. In: NIPS 2007 (Twenty-First Annual Conference on Neural Information Processing Systems) Workshops, Vancouver, Canada (2007)
56. Raman, R., Solomon, M., Livny, M., Roy, A.: The classads language. In: Nabrzyski, J., Schopf, J.M., Weglarz, J. (eds.) Grid Resource Management: State of the Art and Future Trends, pp. 255-270. Kluwer Academic Publishers, Norwell
57. Ritchie, G.: Static multi-processor scheduling with ant colony optimisation & local search. Master's thesis, School of Informatics, Univ. of Edinburgh (2003)
58. Ritchie, G., Levine, J.: A fast, effective local search for scheduling independent jobs in heterogeneous computing environments. Technical report, Centre for Intelligent Systems and their Applications, University of Edinburgh (2003)
59. Ritchie, G., Levine, J.: A hybrid ant algorithm for scheduling independent jobs in heterogeneous computing environments. In: 23rd Workshop of the UK Planning and Scheduling Special Interest Group (PLANSIG 2004) (2004)
60. Schwiegelshohn, U., Yahyapour, R.: Analysis of First-Come-First- Serve Parallel Job Scheduling. In: Proceedings of the 9th SIAM Symposium on Discrete Algorithms, January 1998, pp. 629-638 (1998)
61. Schopf, J.M.: Ten Actions when Grid Scheduling. In: Nabrzyski, Schopf, Weglarz (eds.) Grid Resource Management, ch. 2. Kluwer, Dordrecht (2004)
62. Steuer, R.E.: Multiple Criteria Optimization: Theory, Computation and Application. Series in Probability and Mathematical Statistics. Wiley, Chichester (1987)
63. Talbi, E.G.: A Taxonomy of Hybrid Meta-heuristics. J. Heuristics 8(5), 541-564 (2002)
64. Vengerov, D.: Adaptive Utility-Based Scheduling in Resource-Constrained Systems. In: Zhang, S., Jarvis, R. (eds.) AI 2005. LNCS (LNAI), vol. 3809, pp. 477-488. Springer, Heidelberg (2005)
65. Venugopal, S., Buyya, R., Winton, L.: A Grid service broker for scheduling e- Science applications on global data Grids. Concurrency and Computation: Practice and Experience 18(6), 685-699 (2006)
66. Wright, S.J.: Solving optimization problems on computational grids. Optima 65 (2001)
67. Wu, M.Y., Shu, W.: A high-performance mapping algorithm for heterogeneous computing systems. In: Proceedings of the 15th International Parallel & Distributed Processing Symposium, p. 74 (2001)
68. Xhafa, F.: A Hybrid Evolutionary Heuristic for Job Scheduling in Computational Grids, ch. 10. Studies in Computational Intelligence, vol. 75. Springer, Heidelberg (2007)
69. Xhafa, F.: A Hyper-heuristic for Adaptive Scheduling in Computational Grids. International Journal on Neural and Mass-Parallel Computing and Information Systems 17(6), 639-656 (2007)
70. Xhafa, F., Duran, B., Abraham, A., Dahal, K.P.: Tuning Struggle Strategy in Genetic Algorithms for Scheduling in Computational Grids. In: IEEE CelGrid Workshop, OOstrava, The Czech Republic, June 26-June 28 (to appear, 2008)
71. Xhafa, F., Alba, E., Dorronsoro, B., Duran, B.: Efficient Batch Job Scheduling in Grids using Cellular Memetic Algorithms. Journal of Mathematical Modelling and Algorithms (accepted, 2008) Published Online DOI: http://dx.doi.org/10.1007/s10852-008-9076-y
72. Xhafa, F., Barolli, L., Durresi, A.: An Experimental Study On Genetic Algorithms for Resource Allocation On Grid Systems. Journal of Interconnection Networks 8(4), 427-443 (2007)
73. Xhafa, F., Carretero, J., Abraham, A.: Genetic Algorithm Based Schedulers for Grid Computing Systems. International Journal of Innovative Computing, Information and Control 3(5), 1-19 (2007)
74. Xhafa, F., Carretero, J., Alba, E., Dorronsoro, B.: Design and Evaluation of a Tabu Search Method for Job Scheduling in Distributed Environments. In: The 11th International Workshop on Nature Inspired Distributed Computing (NIDISC 2008) held in conjunction with the 22th IEEE/ACM International Parallel and Distributed Processing Symposium (IPDPS 2008), Miami, Florida, USA, April 14-18 (2008)
75. YarKhan, A., Dongarra, J.: Experiments with scheduling using simulated annealing in a grid environment. In: Parashar, M. (ed.) GRID 2002. LNCS, vol. 2536, pp. 232-242. Springer, Heidelberg (2002)
76. Yu, J., Buyya, R.: A Taxonomy of Workflow Management Systems for Grid Computing. Journal of Grid Computing 3(3), 171-200 (2006)
77. Yu, K.-M., Zhou, J., Chou, C.-H., Luo, Z.-J., Chen, C.-K.: A Fuzzy Neural Network Based Scheduling Algorithm for Job Assignment on Computational Grids. In: Enokido, T., Barolli, L., Takizawa, M. (eds.) NBiS 2007. LNCS, vol. 4658, pp. 533-542. Springer, Heidelberg (2007)
78. Yu, J., Li, M., Li, Y., Hong, F.: An Economy-Based Accounting System for Grid Computing Environments. In: Web Information Systems - WISE 2004 Workshops, pp. 233-238. Springer, Heidelberg (2004)
79. Zhang, S., Zong, Y., Ding, Z., Liu, J.: Workflow-Oriented Grid Service Composition and Scheduling. In: Proceedings of the International Conference on information Technology: Coding and Computing (Itcc 2005), vol. II, pp. 214-219. IEEE Computer Society, Los Alamitos (2005)
80. Zhou, J., Yu, K.M., Chou, Ch.H., Yang, L.A., Luo, Zh.J.: A Dynamic Resource Broker and Fuzzy Logic Based Scheduling Algorithm in Grid Environment. ICANNGA 2007(1), 604-613 (2007)
81. Zomaya, A.Y., Teh, Y.H.: Observations on using genetic algorithms for dynamic load-balancing. IEEE Transactions on Parallel and Distributed Systems 12(9), 899-911 (2