An SCP-based heuristic approach for scheduling distributed data-intensive applications on global grids

Journal of Parallel and Distributed Computing

Volumn 68, Issue 4, 2008, Pages 471-487

  Venugopal, Srikumar ^a   Buyya, Rajkumar ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Data intensive applications; Grid computing; Task mapping

Indexed keywords

CONFORMAL MAPPING; DATA STRUCTURES; HEURISTIC ALGORITHMS; PATTERN MATCHING; PROBLEM SOLVING; RESOURCE ALLOCATION; SCHEDULING;

DATA INTENSIVE APPLICATIONS; MATCHING HEURISTIC; TASK MAPPING;

GRID COMPUTING;

EID: 39749091830     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2007.07.004     Document Type: Article

References (46)

1. Acharya A., Uysal M., Bennett R., Mendelson A., Beynon M., Hollingsworth J., Saltz J., and Sussman A. Tuning the performance of I/O-intensive parallel applications. Proceedings of the Fourth Workshop on I/O in Parallel and Distributed Systems (IOPADS '96). ACM Press, Philadelphia, PA, USA (1996)
2. Balas E., and Padberg M.W. On the set-covering problem. Oper. Res. 20 6 (1972) 1152-1161
3. Bell W.H., Cameron D.G., Capozza L., Millar A.P., Stockinger K., and Zini F. Simulation of dynamic grid replication strategies in OptorSim. Proceedings of the Third International Workshop on Grid Computing (GRID 02). Springer-Verlag, Berlin, Germany, Baltimore, MD, USA (2002) 46-57
4. Blythe J., Jain S., Deelman E., Gil Y., Vahi K., Mandal A., and Kennedy K. Task scheduling strategies for workflow-based applications in grids. Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2005). Cardiff, UK, IEEE CS Press, Los Alamitos, CA, USA (2005)
5. Braun T.D., Siegel H.J., Beck N., Bölöni L.L., Maheswaran M., Reuther A.I., Robertson J.P., Theys M.D., Yao B., Hensgen D., and Freund R.F. A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J. Parallel Distributed Comput. 61 6 (2001) 810-837
6. Breslau L., Cao P., Fan L., Phillips G., and Shenker S. Web catching and zipf-like distributions. evidence and implications. Proceedings of the 18th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM '99). New York, NY, USA (1999)
7. R. Buyya, Economic-based distributed resource management and scheduling for grid computing, Ph.D. Thesis, Monash University, Australia (2002).
8. Buyya R., and Murshed M. GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for grid computing. Concurrency Comput. Practice and Experience (CCPE) 14 13-15 (2002) 1175-1220
9. Cameron D.G., Carvajal-Schiaffino R., Millar A.P., Nicholson C., Stockinger K., and Zini F. Evaluating scheduling and replica optimisation strategies in OptorSim. Proceedings of the Fourth International Workshop on Grid Computing (Grid2003). IEEE CS Press, Los Alamitos, CA, USA, Phoenix, AZ, USA (2003)
10. H. Casanova, Simgrid: a toolkit for the simulation of application scheduling, in: Proceedings of the First International Symposium on Cluster Computing and the Grid (CCGRID '01), IEEE CS Press, Los Alamitos, CA, USA, Brisbane, Australia, 2001.
11. Casanova H., Legrand A., Zagorodnov D., and Berman F. Heuristics for scheduling parameter sweep applications in grid environments. Proceedings of the Ninth Heterogeneous Computing Systems Workshop (HCW 2000). IEEE CS Press, Los Alamitos, CA, USA, Cancun, Mexico (2000)
12. Chervenak A., Foster I., Kesselman C., Salisbury C., and Tuecke S. The data grid: towards an architecture for the distributed management and analysis of large scientific datasets. J. Network Comput. Appl. 23 3 (2000) 187-200
13. N. Christofides, Graph Theory: An Algorithmic Approach, Academic Publishers, London, UK, 1975, Ch. Independent and Dominating Sets-The Set Covering Problem, pp. 30 - 57, ISBN 012 1743350 0.
14. Cormen T.H., Stein C., Rivest R.L., and Leiserson C.E. Introduction to Algorithms (2001), McGraw-Hill Higher Education
15. Deelman E., et al. Mapping abstract complex workflows onto grid environments. J. Grid Comput. 1 1 (2003) 25-39
16. Foster I., and Kesselman C. The Grid: Blueprint for a Future Computing Infrastructure (1999), Morgan Kaufmann Publishers, San Francisco, USA
17. R. Gardner, et al., The Grid2003 production grid: principles and practice, in: Proceedings of the 13th Symposium on High Performance Distributed Computing (HPDC 13), IEEE CS Press, Los Alamitos, CA, USA, Honolulu, HI, USA, 2004.
18. Giersch A., Robert Y., and Vivien F. Scheduling tasks sharing files from distributed repositories. Proceedings of the 10th International Euro-Par Conference (EuroPar '04). Springer-Verlag, Berlin, Germany, Pisa, Italy (2004)
19. Hoschek W., Jaen-Martinez F.J., Samar A., Stockinger H., and Stockinger K. Data management in an international data grid project. Proceedings of the First IEEE/ACM International Workshop on Grid Computing (GRID '00). Springer-Verlag, Berlin, Germany, Bangalore, India (2000)
20. Jain R., Somalwar K., Werth J., and Browne J.C. Heuristics for scheduling I/O operations. IEEE Trans. Parallel Distributed Systems 8 3 (1997) 310-320
21. Kafil M., and Ahmad I. Optimal task assignment in heterogeneous distributed computing systems. IEEE Concurrency 6 3 (1998) 42-50
22. Khan S., and Ahmad I. Non-cooperative, semi-cooperative, and cooperative games-based grid resource allocation. Proceedings of the 20th International Parallel and Distributed Processing Symposium (IPDPS 2006). Rhodes Island, Greece, IEEE CS Press, Los Alamitos, CA, USA (2006)
23. Khanna G., Vydyanathan N., Kurc T., Catalyurek U., Wyckoff P., Saltz J., and Sadayappan P. A hypergraph partitioning-based approach for scheduling of tasks with batch-shared I/O. Proceedings of the 2005 IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2005). IEEE CS Press, Cardiff, UK (2005)
24. Kwok Y.-K., and Ahmad I. Dynamic critical-path scheduling: an effective technique for allocating task graphs to multiprocessors. IEEE Trans. Parallel Distrib. System 7 5 (1996) 506-521
25. Kwok Y.-K., and Ahmad I. Static scheduling algorithms for allocating directed task graphs to multiprocessors. ACM Comput. Surveys 31 4 (1999) 406-471
26. Kwok Y.-K., Song S., and Hwang K. Selfish grid computing. game-theoretic modeling and nas performance results. Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05). IEEE Computer Society, Washington, DC, USA (2005) 1143-1150
27. Legrand I.C., and Newman H.B. The MONARC toolset for simulating large network-distributed processing systems. Proceedings of the 32nd Winter Simulation Conference (WSC '00), Society for Computer Simulation International. San Diego, CA, Orlando, FL (2000)
28. Maheshwaran M., Ali S., Siegel H.J., Hengsen D., and Freund R.F. Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems. Eighth Heterogeneous Computing Systems Workshop (HCW '99). San Juan, Puerto Rico (1999)
29. Maheswaran M., Ali S., Siegel H.J., Hensgen D., and Freund R.F. Dynamic mapping of a class of independent tasks onto heterogeneous computing systems. J. Parallel Distributed Comput. 59 (1999) 107-131
30. Mohamed H., and Epema D. An evaluation of the close-to-files processor and data co-allocation policy in multiclusters. Proceedings of the 2004 IEEE International Conference on Cluster Computing. IEEE CS Press, Los Alamitos, CA, USA, San Diego, CA, USA (2004)
31. Park K., Kim G., and Crovella M. On the relationship between file sizes. Proceedings of the 1996 International Conference on Network Protocols (ICNP '96). IEEE CS Press, Atlanta, GA, USA (1996)
32. S.-M. Park, J.-H. Kim, Chameleon: a resource scheduler in a data grid environment, in: Proceedings of the Third IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2003), IEEE CS Press, Los Alamitos, CA, USA, Tokyo, Japan, 2003.
33. A. Rajasekar, M. Wan, R. Moore, MySRB & SRB: components of a data grid, in: Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing (HPDC-11), IEEE CS Press, Los Alamitos, CA, USA, Edinburgh, UK, 2002.
34. Ranganathan K., and Foster I. Decoupling computation and data scheduling in distributed data-intensive applications. Proceedings of the 11th IEEE Symposium on High Performance Distributed Computing (HPDC). IEEE CS Press, Los Alamitos, CA, USA, Edinburgh, UK (2002)
35. Ranganathan K., and Foster I. Simulation studies of computation and data scheduling algorithms for data grids. J. Grid Comput. 1 1 (2003) 53-62
36. Salem K., and Garcia-Molina H. Disk striping. Proceedings of the Second International Conference on Data Engineering (ICDE-86). IEEE CS Press, Los Alamitos, CA, USA, Los Angeles, USA (1986)
37. Seidel E., Allen G., Merzky A., and Nabrzyski J. GridLab: a grid application toolkit and testbed. Future Generation Comput. Systems 18 8 (2002) 1143-1153
38. Shi Z., and Dongarra J.J. Scheduling workflow applications on processors with different capabilities. Future Generation Comput. Systems 22 6 (2006) 665-675
39. A. Sulistio, U. Cibej, B. Robic, R. Buyya, A tool for modelling and simulation of data grids with integration of data storage, Replication and Analysis, Technical Report GRIDS-TR-2005-13, University of Melbourne, Australia, November 2005.
40. A. Sulistio, G. Poduval, R. Buyya, C.-K. Tham, On incorporating differentiated network service into GridSim, Technical Report GRIDS-TR-2006-5, The University of Melbourne, Australia, March 2006.
41. Sulistio A., Yeo C.S., and Buyya R. A taxonomy of computer-based simulations and its mapping to parallel and distributed systems simulation tools. Software Practice and Experience (SPE) 34 7 (2004) 653-673
42. Thakur R., Choudhary A., Bordawekar R., More S., and Kuditipudi S. Passion: optimized I/O for parallel applications. Computer 29 6 (1996) 70-78
43. S. Venugopal, R. Buyya, A deadline and budget constrained scheduling algorithm for e-science applications on data grids, in: Proceedings of the 6th International Conference on Algorithms and Architectures for Parallel Processing (ICA3PP-2005), Lecture Notes in Computer Science, vol. 3719, Springer-Verlag, Berlin, Germany, Melbourne, Australia, 2005.
44. Venugopal S., Buyya R., and Winton L. A grid service broker for scheduling distributed data-oriented applications on global grids. Proceedings of the Second Workshop on Middleware in Grid Computing (MGC 04). ACM Press, New York, USA, Toronto, Canada (2004)
45. Wolski R., Spring N., and Hayes J. The network weather service: a distributed resource performance forecasting service for metacomputing. J. Future Generation Comput. Systems 15 (1999) 757-768
46. Yamamoto N., Tatebe O., and Sekiguchi S. Parallel and distributed astronomical data analysis on grid datafarm. Proceedings of Fifth IEEE/ACM International Workshop on Grid Computing (Grid 2004). IEEE CS Press, Los Alamitos, CA, USA, Pittsburgh, USA (2004)