A sequential cooperative game theoretic approach to scheduling multiple large-scale applications in grids

Future Generation Computer Systems

Volumn 30, Issue 1, 2014, Pages 27-43

  Duan, Rubing ^a   Prodan, Radu ^b   Li, Xiaorong ^a  

^a INSTITUTE OF HIGH PERFORMANCE COMPUTING   (Singapore)

^b UNIVERSITY OF INNSBRUCK   (Austria)

Author keywords

Economic cost; Game theory; Grid computing; Performance; Scheduling; Storage

Indexed keywords

DISTRIBUTED COMPUTING SYSTEMS; ECONOMIC COSTS; GRID APPLICATIONS; LARGE-SCALE APPLICATIONS; PERFORMANCE; RELATED ALGORITHMS; SCHEDULING PROBLEM; STORAGE REQUIREMENTS;

ALGORITHMS; COMPUTATIONAL COMPLEXITY; COSTS; ENERGY STORAGE; GAME THEORY; GRID COMPUTING;

SCHEDULING;

EID: 84885086982     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2013.09.001     Document Type: Article

References (49)

1. I.J. Taylor, E. Deelman, D.B. Gannon, and M. Shields Scientific Workflows for Grids, Workflows for e-Science 2007 Springer-Verlag
2. C.L. Smith The large hadron collider Scientific American 283 1 2000 70
3. S.S. Vadhiyar, and J.J. Dongarra A metascheduler for the grid 11th International Symposium on High Performance Distributed Computing 2002 IEEE Computer Society
4. F. Berman New grid scheduling and rescheduling methods in the GrADS project International Journal of Parallel Programming 33 2-3 2005 209 229 (Pubitemid 41202442)
5. T.D. Braun A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems Journal of Parallel and Distributed Computing 61 6 2001 810 837 (Pubitemid 33658407)
6. K. Czajkowski, I. Foster, N. Karonis, S. Martin, W. Smith, and S. Tuecke A resource management architecture for metacomputing systems Job Scheduling Strategies for Parallel Processing Workshop Lecture Notes Computer Science vol. 1459 1998 Springer-Verlag 62 82 (Pubitemid 128119031)
7. O.H. Ibarra, and C.E. Kim Heuristic algorithms for scheduling independent tasks on nonidentical processors Journal of the ACM 24 2 1977 280 289
8. J. Volkert, Austrian grid: overview on the project with focus on parallel applications, in: International Symposium on Parallel and Distributed Computing, 2006.
9. T.D. Braun, H.J. Siegel, N. Beck, L.L. Bölöni, M. Maheswaran, A.I. Reuther, J.P. Robertson, M.D. Theys, B. Yao, D. Hensgen, and R.F. Freund A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems Journal of Parallel and Distributed Computing 61 6 2001 810 837 (Pubitemid 33658407)
10. R. Duan, F. Nadeem, J. Wang, R. Prodan, and T. Fahringer A hybrid intelligent approach for performance modeling and prediction of workflow activities in grids 9th IEEE/ACM International Symposium on Cluster Computing and the Grid 2009 IEEE Computer Society 339 347
11. F. Nadeem, and T. Fahringer Optimizing execution time predictions of scientific workflow applications in the grid through evolutionary programming Future Generation Computer Systems 29 4 2013 926 935
12. S. Ostermann, M. Brejla, R. Prodan, T. Fahringer, and S. Schindler Developing astrophysics workflow applications with the ASKALON environment in the Austrian Grid J. Volkert, T. Fahringer, D. Kranzlmüller, R. Kobler, W. Schreiner, 3rd Austrian Grid Symposium, Vol. 269 2009 Austrian Computer Society 114 128
13. K. Plankensteiner, J. Vergeiner, R. Prodan, G. Mayr, and T. Fahringer Porting LinMod to predict precipitation in the Alps using ASKALON on the Austrian Grid J. Volkert, T. Fahringer, D. Kranzlmüller, R. Kobler, W. Schreiner, 3rd Austrian Grid Symposium, Vol. 269 2009 Austrian Computer Society 103 114
14. R. Prodan, S. Ostermann, and K. Plankensteiner Performance analysis of grid applications in the ASKALON environment 10th ACM/IEEE International Conference on Grid Computing 2009 IEEE Computer Society 97 104
15. G. Morar, F. Schüller, S. Ostermann, R. Prodan, and G. Mayr Meteorological simulations in the cloud with the ASKALON environment I. Caragiannis, M. Alexander, R.M. Badia, M. Cannataro, A. Costan, M. Danelutto, F. Desprez, B. Krammer, J. Sahuquillo, S.L. Scott, J. Weidendorfer, Euro-Par 2012: Parallel Processing Workshops Lecture Notes in Computer Science vol.7640 2013 Springer 68 78
16. W. Kapferer, W. Domainko, S. Schindler, E.V. Kampen, S. Kimeswenger, M. Mair, T. Kronberger, and D. Breitschwerdt Metal enrichment and energetics of galactic winds in galaxy clusters Advances in Space Research 36 2005 682
17. K. Schwarz, P. Blaha, and G.K.H. Madsen Electronic structure calculations of solids using the WIEN2k package for material sciences Computer Physics Communications 147 1-2 2002 71 76 (Pubitemid 34822669)
18. I. Foster Globus toolkit version 4: software for service-oriented systems Journal of Computer Science and Technology 21 4 2006 513 520 (Pubitemid 46224406)
19. R.B. Myerson Game Theory: Analysis of Conflict 1997 Harvard University Press
20. R. Armstrong, D. Hensgen, and T. Kidd The relative performance of various mapping algorithms is independent of sizable variances in run-time predictions 7th Heterogeneous Computing Workshop 1998 IEEE Computer Sociery Press 79 87
21. M. Maheswaran, S. Ali, H.J. Siegel, D.A. Hensgen, and R.F. Freund Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems Heterogeneous Computing Workshop 1999 IEEE Computer Sociery Press 30 45
22. H. Casanova, D. Zagorodnov, F. Berman, and A. Legrand Heuristics for scheduling parameter sweep applications in grid environments 9th Heterogeneous Computing Workshop 2000 IEEE Computer Sociery Press Cancun, Mexico 349 363 (Pubitemid 30592800)
23. M. Maheswaran, S. Ali, H.J. Siegel, D. Hensgen, and R.F. Freund Dynamic mapping of a class of independent tasks onto heterogeneous computing systems Journal of Parallel and Distributed Computing 59 2 1999 107 131 (Pubitemid 129557480)
24. H. Topcuouglu, S. Hariri, and Min-You Wu Performance-effective and low-complexity task scheduling for heterogeneous computing IEEE Transactions on Parallel and Distributed Systems 13 3 2002 260 274 (Pubitemid 34448780)
25. J.H. Holland Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control and Artificial Intelligence 1992 MIT Press Cambridge, MA, USA
26. S. Russell, and P. Norvig Artificial Intelligence: A Modern Approach Third revised edition 2010 Prentice Hall
27. R.L. Graham Bounds for certain multiprocessor anomalies Bell System Technical Journal 45 1966 1563 1581
28. R.K. Jain, D.-M.W. Chiu, and W.R. Hawe A quantitative measure of fairness and discrimination for resource allocation in shared computer systems, Tech. Rep. DEC-TR-301 1984 Eastern Research Lab URL: http://www1.cse.wustl.edu/~jain/ papers/ftp/fairness.pdf
29. R. Duan, Grid workflow enactment, optimization, and fault tolerance, Ph.D. Thesis, University of Innsbruck, Innsbruck, Austria, 2008.
30. B. Kao, and H. Garcia-Molina Deadline assignment in a distributed soft real-time system IEEE Transactions on Parallel and Distributed Systems 8 12 1997 1268 1274 (Pubitemid 127767772)
31. Condor Project, DAGMan: directed acyclic graph manager, University of Wisconsin-Madison. http://www.cs.wisc.edu/condor/dagman/.
32. R. Buyya, and S. Venugopal The gridbus toolkit for service oriented grid and utility computing: an overview and status report 1st International Workshop on Grid Economics and Business Models 2004 IEEE Computer Society Press 19 36
33. J. Yu, and R. Buyya A budget constrained scheduling of workflow applications on utility grids using genetic algorithms 1st Workshop on Workflows in Support of Large-Scale Science 2006 IEEE Computer Society
34. S. Venugopal, and R. Buyya A deadline and budget constrained scheduling algorithm for e-science applications on data grids 6th International Conference on Algorithms and Architectures for Parallel Processing LNCS vol. 3719 2005 Springer
35. P.-F. Dutot, T. N'Takpé, F. Suter, and H. Casanova Scheduling parallel task graphs on (almost) homogeneous multicluster platforms IEEE Transactions on Parallel and Distributed Systems 20 7 2009 940 952
36. D. Ghose, and T.G. Robertazzi Cluster Computing Special Issue on Divisible Load Scheduling vol. 6 2003 Springer
37. Y. Yang, and K. van der Raadt Multiround algorithms for scheduling divisible loads IEEE Transactions on Parallel and Distributed Systems 16 11 2005 1092 1102 Member-Casanova, Henri (Pubitemid 41709712)
38. A. Ramakrishnan, G. Singh, H. Zhao, E. Deelman, R. Sakellariou, K. Vahi, K. Blackburn, D. Meyers, and M. Samidi Scheduling data-intensiveworkflows onto storage-constrained distributed resources 7th International Symposium on Cluster Computing and the Grid 2007 IEEE Computer Society 401 409 (Pubitemid 47334578)
39. J.-Y.L. Boudec Rate adaptation, congestion control and fairness: A tutorial, Tech. Rep. 2008 Ecole Polytechnique Federale de Lausanne
40. R. Raman, M. Livny, and M.H. Solomon Matchmaking: an extensible framework for distributed resource management Cluster Computing 2 2 1999 129 138
41. G. Sabin, and P. Sadayappan Unfairness metrics for space-sharing parallel job schedulers D. Feitelson, L. Rudolph, U. Schwiegelshohn, 11th Inernational Workshop on Job Scheduling Strategies for Parallel Processing 2005 Springer-Verlag Heidelberg
42. U. Schwiegelshohn, and R. Yahyapour Fairness in parallel job scheduling Journal of Scheduling 3 5 2000 297 320
43. H. Zhao, and R. Sakellariou Scheduling multiple DAGs onto heterogeneous systems International Parallel and Distributed Processing Symposium 2006 IEEE Computer Society
44. C. Kim, and H. Kameda An algorithm for optimal load balancing in distributed computer systems IEEE Transactions on Computers 41 3 1992 381 384
45. S. Penmatsa, A.T. Chronopoulos, Cooperative load balancing for a network of heterogeneous computers, in: Proc. of the 21st IEEE Intl. Parallel and Distributed Processing Symposium, IPDPS 2006, Rhodes Island, Greece, 2006.
46. J. Bredin, R.T. Maheswaran, C. Imer, T. Başar, D. Kotz, and D. Rus A game-theoretic formulation of multi-agent resource allocation Proceedings of the Fourth International Conference on Autonomous Agents 2000 ACM Press Barcelona, Catalonia, Spain 349 356
47. Y. Kwok, S. Song, and K. Hwang Selfish grid computing: Game-theoretic modeling and nas performance results 5th IEEE International Symposium on Cluster Computing and the Grid, Vol. 2 2005 IEEE Computer Sociery Press 1143 1150 (Pubitemid 44868444)
48. P. Ghosh, K. Basu, and S.K. Das A game theory-based pricing strategy to support single/multiclass job allocation schemes for bandwidth-constrained distributed computing systems IEEE Transactions on Parallel and Distributed Systems 18 3 2007 289 306 (Pubitemid 46453566)
49. L. Young, S. McGough, S. Newhouse, and J. Darlington Scheduling architecture and algorithms within the iceni grid middleware, Tech. Rep., UK e-Science All Hands Meeting, EPSRC 2003