Improving scalability of Bag-of-Tasks applications running on master-slave platforms

Parallel Computing

Volumn 35, Issue 2, 2009, Pages 57-71

  da Silva, Fabrício A B ^a   Senger, Hermes ^b,c  

^a UNIVERSITY OF LISBON   (Portugal)

^b MACKENZIE PRESBYTERIAN UNIVERSITY   (Brazil)

^c CATHOLIC UNIVERSITY OF SANTOS   (Brazil)

Author keywords

Bag of Tasks applications; Master slave platforms; Scalability analysis

Indexed keywords

ALGORITHMS; APPLICATIONS; CLUSTER ANALYSIS; CLUSTERING ALGORITHMS; DATA MINING; INFORMATION MANAGEMENT; MONTE CARLO METHODS; SCALABILITY;

BAG-OF-TASKS APPLICATIONS; IMAGE MANIPULATIONS; INDEPENDENT TASKS; MASTER-SLAVE PLATFORMS; MINING ALGORITHMS; MONTE CARLO SIMULATION (MCS); PARALLEL APPLICATIONS; SCALABILITY ANALYSIS; TASK EXECUTIONS;

SCHEDULING ALGORITHMS;

EID: 58749105462     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2008.09.013     Document Type: Article

References (23)

1. Baker M., Buyya R., and Laforenza D. Grids and Grid Technologies for Wide-area Distributed Computing. Software - Practice and Experience vol. 32 (2002), John Wiley and Sons pp. 1437-1466
2. Beaumont O., Legrand A., and Robert Y. Scheduling divisible workloads on heterogeneous platforms. Parallel Computing 29 9 (2003) 1121-1152
3. Berman F., Wolski R., Casanova H., Cirne W., Dail H., Faerman M., Figueira S., Hayes J., Obertelli G., Schopf J., Shao G., Smallen S., Spring N., Su A., and Zagorodnov D. Adaptive computing on the grid using AppLeS. IEEE Transactions on Parallel and Distributed Systems 14 4 (2003) 369-382 10.1109/TPDS.2003.1195409
4. Casanova H., Legrand A., Zagorodnov D., and Berman F. Heuristics for scheduling parameter-sweep applications in grid environments. Proceedings of the Ninth Heterogeneous Computing Workshop (HCW'2000) (2000), IEEE Computer Society Press
5. Casanova H. Simgrid: a toolkit for the simulation of application scheduling. Proceedings of the IEEE Symposium on Cluster Computing and the Grid (CCGrid'01), May (2001), IEEE Computer Society
6. H. Casanova, A. Legrand, D. Zagorodnov, F. Berman, Using simulation to evaluate scheduling heuristics for a class of applications in grid environments, Research Report RR-1999-46, LIP, ENS Lyon, France, 1999.
7. W. Cirne, D. Paranhos, L. Costa, E. Santos-Neto, F. Brasileiro, J. Sauve, F.A.B. Silva, C.O. Barros, C. Silveira, Running Bag-of-Tasks applications on computational grids: the MyGrid approach, in: Proceedings of the International Conference on Parallel Processing (ICPP'03), October 2003, pp. 407-416.
8. Giersch A., Robert Y., and Vivien F. Scheduling task sharing files on heterogeneous master-slave platforms. Journal of Systems Architecture 52 2 (2006) 88-104
9. Hagerup T. Allocating independent tasks to parallel processors: an experimental study. Journal of Parallel and Distributed Computing 47 (1997) 185-197
10. E. Heymann, M. Senar, E. Luque, M. Livny, Adaptive scheduling for master-worker applications on the computational grid, in: Proceedings of the First IEEE/ACM International Workshop on Grid Computing (GRID 2000), Bangalore, India, December 17, 2000.
11. Kaya K., and Aykanat C. Iterative improvement-based heuristics for adaptive scheduling of tasks sharing files on heterogeneous master-slave environments. IEEE Transactions on Parallel and Distributed Systems 17 8 (2006) 883-896
12. Kumar V., and Rao V.N. Parallel depth-first search on multiprocessors. Part II: Analysis. International Journal of Parallel Programming 16 6 (1987) 501-519
13. Lee Y.C., and Zomaya A.Y. Practical scheduling of Bag-of-Tasks applications on grids with dynamic resilience. IEEE Transactions on Computers 56 6 (2007) 815-825
14. Liu G.L. Introduction to Combinatorial Mathematics (1968), McGraw Hill
15. Maheswaran M., Ali S., Siegel H.J., Hensgen D., and Freund R.F. Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems. Proceeding of the Eighth Heterogeneous Computing Workshop (HCW'99) (1999), IEEE Computer Society Press
16. D. Paranhos, W. Cirne, F. Brasileiro, Trading cycles for information: using replication to schedule bag-of-tasks applications on computational grids, in: Proceedings of the Euro-Par 2003: International Conference on Parallel and Distributed Computing, Klagenfurt, Austria, August 2003.
17. E. Santos-Neto, W. Cirne, F. Brasileiro, A. Lima, Exploiting replication and data reuse to efficiently schedule data-intensive applications on grids, in: Proceedings of the 10th Workshop on Job Scheduling Strategies for Parallel Processing, June 2004.
18. Silva F.A.B., Carvalho S., and Hruschka E.R. A scheduling algorithm for running data mining applications on the grid. Proceedings of International Conference on Euro-Par 2004, Pisa, Italy. LNCS vol. 3419 (2004), Springer-Verlag 254-262
19. D. Silva, W. Cirne, F. Brasileiro, Trading cycles for information: using replication to schedule Bag-of-Tasks applications on computational grids, in: Proceedings of the Ninth Workshop on Job Scheduling Strategies for Parallel Processing, June 2003.
20. Silva F.A.B., Carvalho S., Senger H., Hruschka E.R., and Farias C.R. Running data mining applications on the grid: a Bag-of-Tasks approach. Proceedings of the International Conference on Computational Science and its Applications (ICCSA 2004), May 2004, Asisi. Lecture Notes in Computer Science vol. 3044 (2004), Springer-Verlag, Berlin 168-177
21. Sun X., and Rover D.T. Scalability of parallel algorithm-machine combinations. IEEE Transactions on Parallel and Distributed Systems 5 6 (1994)
22. Yang Y., Raadt K., and Casanova H. Multi-round algorithm for scheduling divisible loads. IEEE Transactions on Parallel and Distributed Systems 16 11 (2005) 1092-1102
23. Zhang X., Yan Y., and He K. Latency metric: an experimental metric for measuring and evaluating parallel program and architecture scalability. Journal of Parallel and Distributed Computing 22 3 (1994)