Efficient resource management for running multiple concurrent jobs in a computational grid environment

Future Generation Computer Systems

Volumn 27, Issue 8, 2011, Pages 1070-1082

  Roy, Sarbani ^a   Mukherjee, Nandini ^a  

^a JADAVPUR UNIVERSITY   (India)

Author keywords

Concurrent jobs; Grid; Optimal resource allocation; Resource brokering

Indexed keywords

COMPUTATIONAL GRIDS; CONCURRENT JOBS; ESSENTIAL COMPONENT; GRID; GRID ENVIRONMENTS; HETEROGENEOUS RESOURCES; MANAGING RESOURCES; MULTIAGENT FRAMEWORK; MULTIPLE ORGANIZATIONS; OPTIMAL ALLOCATION; OPTIMAL RESOURCE ALLOCATION; RESOURCE BROKERING; RESOURCE BROKERS; RESOURCE MANAGEMENT; RESOURCE PROVIDERS; SYSTEM LOADS; USER LEVELS;

OPTIMIZATION; RESOURCE ALLOCATION;

GRID COMPUTING;

EID: 79960454673     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2011.04.008     Document Type: Article

References (40)

1. Condor. Web site: http://www.cs.wisc.edu/condor.
2. D. Thain, T. Tannenbaum, and M. Livny Distributed computing in practice: the condor experience Concurrency and Computation: Practice and Experience 17 24 2005 323 356 (Pubitemid 40285781)
3. European data Grid project. Web site: http://eu-dataGrid.web.cern.ch/eu- dataGrid/.
4. F. Berman, R. Wolski, H. Casanova, W. Cirne, H. Dail, M. Faerman, S. Figueira, J. Hayes, G. Obertelli, J. Schopf, G. Shao, S. Smallen, N. Spring, A. Su, and D. Zagorodnov Adaptive computing on the Grid using AppLeS IEEE Transactions on Parallel and Distributed Systems 14 4 2003 369 382
5. Y. Caniou, E. Caron, F. Desprez, H. Nakada, Y. Tanaka, and K. Seymour High performance GridRPC middleware G.A. Gravvanis, J.P. Morrison, H.R. Arabnia, D.A. Power, Recent Developments in Grid Technology and Applications 2008 Nova Science Publishers 141 181
6. NetSolve. Web site: http://icl.cs.utk.edu/netsolve/.
7. K. Seymour, A. YarKhan, S. Agrawal, and J. Dongarra NetSolve: Grid enabling scientific computing environments L. Grandinetti, Grid Computing and New Frontiers of High Performance Processing Advances in Parallel Computing vol. 14 2005 Elsevier
8. A. Clematis, A. Corana, D. D'Agostino, A. Galizia, and A. Quarat Job-resource matchmaking on Grid through two-level benchmarking Future Generation Computer Systems 26 8 2010 1165 1179
9. E. Elmroth, and J. Tordsson Grid resource brokering algorithms enabling advance reservations and resource selection based on performance predictions Future Generation Computer Systems 24 2008 585 593 (Pubitemid 351479224)
10. T.S. Somasundaram, B.R. Amarnath, R. Kumar, P. Balakrishnan, K. Rajendar, R. Rajiv, G. Kannan, G. Rajesh Britto, E. Mahendran, and B. Madusudhanan CARE resource broker: a framework for scheduling and supporting virtual resource management Future Generation Computer Systems 26 3 2010 337 347
11. T.S. Somasundaram, and P. Balakrishnan SLA enabled CARE resource broker Future Generation Computer Systems 27 3 2011 265 279
12. S. Roy, and N. Mukherjee Adaptive execution of jobs in computational Grid environment Journal of Computer Science and Technology 24 5 2009 Springer
13. A. De Sarkar, S. Roy, D. Ghosh, R. Mukhopadhyay, and N. Mukherjee An adaptive execution scheme for achieving guaranteed performance in computational Grids Journal of Grid Computing 8 1 2009 109 131
14. C. Yang, P. Shih, K. Li, A high-performance computational resource broker for Grid computing environments, in: Proceedings of the 19th International Conference on Advanced Information Networking and Applications, AINA'05, March 2005, pp. 333336.
15. S. Roy, and N. Mukherjee Multi-agent framework for performance-based resource management in computational Grid environment International Journal of Multiagent and Grid Systems 6 1 2010 25 53 IOS Press
16. S. Roy, Performance-based resource management in computational Grid environment, Thesis for the Degree of Doctor of Philosophy of Jadavpur University, Kolkata, India, July 2008.
17. S. Roy, S. Dasgupta, N. Mukherjee, A multi-agent framework for resource brokering of multiple concurrent jobs in Grid environment, in: Proceedings ofInternational Symposium on Parallel and Distributed Computing, ISPDC '06, Timisoara, Romania, July 69, 2006, pp. 329336. (Pubitemid 47179310)
18. Globus. Web site: http://www.globus.org.
19. M. Sarkar, R. Mukhopadhyay, D. Ghosh, S. Roy, N. Mukherjee, Feedback guided job modeling in PRAGMA environment, in: Published in International Conference on Grid Computing and Applications, GCA'10, USA, July 1215, 2010.
20. M. Sarkar, S. Roy, N. Mukherjee, Feedback-guided analysis for resource requirements in large distributed system, in: Published in 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, CCGrid 2010, Melbourne, Victoria, Australia, May 1720, 2010.
21. M. Cabeza, M. Clemente, M. Rubio, CacheSim: a cache simulator for teaching memory hierarchy behaviour, in: Proceedings of the 4th Annual SIGCSE/SIGCUE ITiCSE Conference on Innovation and Technology in Computer Science Education, Cracow, Poland, September 1999, p. 181.
22. PAPI. Web site: http://icl.cs.utk.edu/papi/.
23. J. Dongarra, K. London, S. Moore, P. Mucci, D. Terpstra, Using PAPI for hardware performance monitoring on linux systems, in: Conference on Linux Clusters: The HPC Revolution, Linux Clusters Institute, Urbana, Illinois, June 2527, 2001.
24. K. Czajkowski, I. Foster, and C. Kesselman Resource and service management Ian Foster, Carl Kesselman, The Grid 2: Blueprint for a New Computing Infrastructure 2nd ed. 2003 Morgan Kaufmann Chapter 18 of
25. R. Buyya, and D. Abramson The Nimrod/G Grid resource broker for economic-based scheduling Rajkumar Buyya, Kris Bubendorfer, Market-Oriented Grid and Utility Computing Wiley Series on Parallel and Distributed Computing 2009 ISBN-13:978-0470287682
26. Munkres Assignment: http://www.nist.gov/dads/HTML/munkresAssignment.html.
27. J.L. Hennessy, and D.A. Patterson Computer Architecture a Quantitative Approach fourth ed. 2007 Elsevier
28. D. Fangpeng, S.G. Akl, Scheduling algorithms for Grid computing: state of the art and open problems, Technical Report 2006-504. Available from: http://www.cs.queensu.ca/TechReports/Reports/2006-504.pdf.
29. M. Maheswaran, S. Ali, H.J. Siegel, D. Hensgen, and R.F. Freund Dynamic mapping of a class of independent tasks onto heterogeneous computing systems Journal of Parallel and Distributed Computing 59 2 1999 107 131 (Pubitemid 129557480)
30. S. Klous, J. Frey, S.C. Son, D. Thain, A. Roy, M. Livny, and J. van den Brand Transparent access to Grid resources for user software Concurrency and Computation: Practice and Experience 18 7 2006 787 801 (Pubitemid 43774320)
31. Condor-G. Web site: http://www.cs.wisc.edu/condor/condorg.
32. Nimrod-G. Web site: http://www.csse.monash.edu.au/~davida/nimrod/nimrodg. htm.
33. K. Kurowski, B. Ludwiczak, J. Nabrzyski, A. Oleksiak, and J. Pukacki Dynamic Grid scheduling with job migration and rescheduling in the GridLab resource management system Scientific Programming 12 4 2004 263 273 (Pubitemid 40173746)
34. GridLab resource management system. Web site: http://www.Gridlab.org/ grms.
35. GRACE. Web site: http://www.grace-ist.org/.
36. D. Abramson, R. Buyya, and J. Giddy A computational economy for Grid computing and its implementation in the Nimrod-G resource broker Future Generation Computer Systems, FGCS 18 8 2002 1061 1074
37. H.K. Kyong, and R. Buyya Fair resource sharing in hierarchical virtual organizations for global Grids Proceedings of the Eighth IEEE/ACM International Conference on Grid Computing Grid 2007 2007 IEEE Press New York, USA, Austin, TX, USA
38. C. Li, and L. Li Three-layer control policy for Grid resource management Journal of Network and Computer Applications 32 3 2009 525 537
39. V. Kravtsov, D. Carmeli, W. Dubitzky, K. Kurowski, and A. Schuster Grid-enabling complex system applications with QosCosGrid: an architectural perspective H.R. Arabnia, Proceedings of the 2008 International Conference on Grid Computing & Applications GCA 2008 2008 CSREA Press Las Vegas, Nevada, USA 168 174
40. S. Roy, M. Sarkar, N. Mukherjee, Implementation of a resource broker for efficient resource management in Grid environment, in: Proceedings of 15th International Conference on Advanced Computing & Communication, ADCOM 2007, Guwahati, India, December 1821, 2007.