Genetic algorithm in finding Pareto frontier of optimizing data transfer versus job execution in grids

Concurrency and Computation: Practice and Experience

Volumn 28, Issue 6, 2016, Pages 1715-1736

  Taheri, Javid ^a   Zomaya, Albert Y ^a   Khan, Samee U ^b  

^a UNIVERSITY OF SYDNEY   (Australia)

^b North Dakota State University   (United States)

Author keywords

data replication; job schedulling; Pareto frontier

Indexed keywords

DATA TRANSFER; SCHEDULING;

DATA INTENSIVE; DATA REPLICATION; JOB EXECUTION; JOB SCHEDULLING; OPTIMIZATION TECHNIQUES; PARETO FRONT; PARETO FRONTIERS; SCHEDULING TECHNIQUES;

GENETIC ALGORITHMS;

EID: 84869884171     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.2960     Document Type: Article

References (31)

1. CERN. (Visited 2011). Compact Muon Solenoid (CMS) http://public.web.cern.ch/public/en/lhc/CMS-en.html.
2. Anjum A, McClatchey R, Ali A, Willers I,. Bulk scheduling with the DIANA scheduler. IEEE Transactions on Nuclear Science 2006; 53: 3818-3829.
3. Subrata R, Zomaya AY, Landfeldt B,. Cooperative power-aware scheduling in grid computing environments. Journal of Parallel and Distributed Computing 2010; 70: 84-91.
4. Berman F, Fox G, Hey AJG,. Grid Computing: Making the Global Infrastructure a Reality. John Wiley & Sons: New York, 2003.
5. Taheri J, Lee YC, Zomaya AY,. Simultaneous Job and Data Allocation in Grid Environments. The University of Sydney: Sydney, Australia, TR 671, 2011.
6. Taheri J, Lee YC, Zomaya AY, Siegel HJ,. A bee colony based optimization approach for simultaneous job scheduling and data replication in grid environments. Computers and Operations Research 2011. DOI: 10.1016/j.cor.2011.11.012
7. Tang M, Lee B-S, Tang X, Yeo C-K,. The impact of data replication on job scheduling performance in the data grid. Future Generation Computer Systems 2006; 22: 254-268.
8. McClatchey R, Anjum A, Stockinger H, Ali A, Willers I, Thomas M,. Data intensive and network aware (DIANA) grid scheduling. Journal of Grid Computing 2007; 5: 43-64.
9. GILDA. (Visited 2011). https://gilda.ct.infn.it/.
10. SAM. (Visited 2011). http://projects.fnal.gov/samgrid/.
11. Frey J, Tannenbaum T, Livny M, Foster I, Tuecke S,. Condor-G: a computation management agent for multi-institutional grids. Cluster Computing 2002; 5: 237-246.
12. Andreetto P, Borgia S, Dorigo A, Gianelle A, Mordacchini M, Sgaravatto M, Zangr L, Andreozzi S, Ciaschini V, Di Giusto C, Giacomini F, Medici V, Ronchieri E, Venturi V,. Practical approaches to grid workload and resource management in the EGEE project. In Proceedings of the Conference on Computing in High Energy and Nuclear Physics (CHEP '04), 2004, 899-902.
13. Kosar T, Livny M,. A framework for reliable and efficient data placement in distributed computing systems. Journal of Parallel and Distributed Computing 2005; 65: 1146-1157.
14. Cirne W, Da Silva DP, Costa L, Santos-Neto E, Brasileiro FV, Sauve J, Silva FAB, Barros CO, Silveira C,. Running bag-of-tasks applications on computational grids: the MyGrid approach. In Proceedings of the 2003 International Conference on Parallel Processing (ICPP'03), 2003; 407-416.
15. Huedo E, Montero RS, Llorente IM,. The GridWay framework for adaptive scheduling and execution on grids. Scalable Computing: Practice and Experience 2005; 6: 1-8.
16. Strazdins PE, Uhlmann J,. A comparison of local and gang scheduling on a Beowulf cluster. In Proceedings of 2004 IEEE International Conference on Cluster Computing (CLUSTER'04), 2004; 55-62.
17. Maheswaran M, Ali S, Siegel HJ, Hensgen D,., Freund RF,. Dynamic mapping of a class of independent tasks onto heterogeneous computing systems. Journal of Parallel and Distributed Computing. Special Issue on Software Support for Distributed Computing 1999; 59: 107-131.
18. Casanova H, Zagorodnov D, Berman F, Legrand A,. Heuristics for scheduling parameter sweep applications in grid environments. In Proceedings of the 9th Heterogeneous Computing Workshop, 2000; 349-363.
19. Hoschek W, Jaen-Martinez J, Samar A, Stockinger H, Stockinger K,. Data management in an international data grid project. In Grid Computing. vol. 1971, Buyya R, Baker M, (eds). Springer-Verlag: New York, 2000; 77-90.
20. Mohamed HH, Epema DHJ,. An evaluation of the close-to-files processor and data co-allocation policy in multiclusters. In Proceedings of 2004 IEEE International Conference on Cluster Computing, 2004; 287-298.
21. Chang R-S, Chang J-S, Lin S-Y,. Job scheduling and data replication on data grids. Future Generation Computer Systems 2007; 23: 846-860.
22. Sang-Min P, Jair-Hoom K,. Chameleon: a resource scheduler in a data grid environment. In Proceedings of 3rd IEEE International Symposium on Cluster Computing and the Grid (CCGRID'03) 2003; 258-265.
23. Abdi S, Mohamadi S,. Two level job scheduling and data replication in data grid. International Journal of Grid Computing & Applications (IJGCA) 2010; 1: 23-37.
24. Dang NN, Lim SB,. Combination of replication and scheduling in data grids. International Journal of Computer Science and Network Security (IJCSNS) 2007; 7: 304-308.
25. Bell WH, Cameron DG, Capozza L, Millar AP, Stockinger K, Zini F,. OptorSim: a grid simulator for studying dynamic data replication strategies. The International Journal of High Performance Computing Applications 2003; 17: 403-416.
26. Ranganathan K, Foster I,. Decoupling computation and data scheduling in distributed data-intensive applications. In Proceedings of 11th IEEE International Symposium on High Performance Distributed Computing (HPDC'02) 2002; 352-358.
27. Hongzhang S, Oliker L, Biswas R,. Job superscheduler architecture and performance in computational grid environments. In Proceedings of the ACM/IEEE SC2003 Conference (SC'03), 2003; 44-58.
28. Subrata R, Zomaya AY, Landfeldt B,. A cooperative game framework for QoS guided job allocation schemes in grids. IEEE Transactions on Computers 2008; 57: 1413-1422.
29. Dick RP
30. Wikipedia. (Visited 2011). Pareto efficiency. http://en.wikipedia.org/wiki/Pareto-efficiency.
31. Taheri J, Zomaya A, Khan SU,. Grid simulation tools for job scheduling and datafile replication. In Scalable Computing and Communications: Theory and Practice, Khan SU, Zomaya AY, Wang L, (eds). John Wiley & Sons, Inc.: Hoboken, New Jersey, (in press).