Scalability limits of Bag-of-Tasks applications running on hierarchical platforms

Journal of Parallel and Distributed Computing

Volumn 71, Issue 6, 2011, Pages 788-801

  Da Silva, Fabrcio A B ^a   Senger, Hermes ^b  

^a Brazilian Army Technological Center   (Brazil)

^b FEDERAL UNIVERSITY OF SÃO CARLOS   (Brazil)

Author keywords

Multiprocessor systems; Scalability; Scheduling and task partitioning

Indexed keywords

APPLICATION EXECUTION; BAG-OF-TASKS APPLICATIONS; COMMUNICATION LINKS; COMMUNICATION PARADIGM; CONCURRENT TASKS; DATA MINING ALGORITHM; HIERARCHICAL PLATFORMS; IMAGE MANIPULATION; INPUT FILES; MASTER-SLAVE; MONTE CARLO SIMULATION; MULTI PROCESSOR SYSTEMS; PARALLEL APPLICATION; SCHEDULING AND TASK PARTITIONING;

COMPUTER SIMULATION; DATA MINING; HIERARCHICAL SYSTEMS; MONTE CARLO METHODS; MULTIPROCESSING SYSTEMS; OPTICAL COMMUNICATION;

SCALABILITY;

EID: 79955595874     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2011.01.002     Document Type: Article

References (51)

1. M. Adler, Y. Gong, and A.L. Rosenberg On exploiting node-heterogeneous clusters optimally Theory of Computing Systems 42 2008 465 487
2. L.A. Barroso, and U. Hlzle The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines Synthesis Lectures on Computer Architecture 2009 Morgan and Claypool Publishers
3. O. Beaumont, L. Carter, J. Ferrante, A. Legrand, L. Marchal, Y. Robert, Scheduling multiple bags of tasks on heterogeneous masterworker platforms: centralized versus distributed solutions, Research Report No 2005-45, cole Normale Suprieure de Lyon, 2005. Available at: http://www.ens-lyon.fr/LIP/Pub/ Rapports/RR/RR2005/RR2005-45.pdf.
4. Olivier Beaumont, Larry Carter, Jeanne Ferrante, Arnaud Legrand, Loris Marchal, and Yves Robert Centralized versus distributed schedulers for bag-of-tasks applications IEEE Transactions on Parallel and Distributed Systems 2008 698 709 (Pubitemid 351583571)
5. O. Beaumont, A. Legrand, and Y. Robert Scheduling divisible workloads on heterogeneous platforms Parallel Computing 29 9 2003 1121 1152 10.1016/S0167-8191(03)00095-4
6. F. Berman, R. Wolski, H. Casanova, W. Cirne, H. Dail, M. Faerman, S. Figueira, J. Hayes, G. Obertelli, J. Schopf, G. Shao, S. Smallen, N. Spring, A. Su, and D. Zagorodnov Adaptive computing on the grid using apples IEEE Transactions on Parallel and Distributed Systems 14 4 2003 369 382 10.1109/TPDS.2003.1195409
7. J.L. Bosque, L.P. Perez, Theoretical scalability analysis for heterogeneous clusters, in: Proceedings of the 2004 IEEE International Symposium on Cluster Computing and the Grid, 2004.
8. H. Casanova, A. Legrand, M. Quinson, SimGrid: a generic framework for large-scale distributed experimentations, in: 10th IEEE International Conference on Computer Modelling and Simulation, UKSIM/EUROSIM'08.
9. H. Casanova, A. Legrand, D. Zagorodnov, F. Berman, Heuristics for scheduling parameter-sweep applications in grid environments, in: Proc. 9th Heterogeneous Computing Workshop, HCW'2000, 2000, pp. 349363. (Pubitemid 30592800)
10. C. Cassandras Discrete Event Systems: Modeling and Performance Analysis 1993 Aksen Associates Inc. Publishers Boston, MA
11. A. Chaintreau, Sharpness: a tight condition for throughput scalability, in: Proceeding of 15th International Colloquium on Structural Information and Communication Complexity, SIROCCO, June 2008.
12. Y.-C. Cheng, and T. Robertazzi Distributed computation for a tree-network with communication delay IEEE Transactions on Aerospace and Electronic Systems 26 3 1990 511 516 (Pubitemid 20737479)
13. Y. Chen, X.-H. Sun, and M. Wu Algorithm-system scalability of heterogeneous computing Journal of Parallel and Distributed Computing 68 11 2008 1403 1412
14. W. Cirne, D. Paranhos, L. Costa, E. Santos-Neto, F. Brasileiro, J. Sauve, F.A.B. Silva, C.O. Barros, C. Silveira, Running bag-of-tasks applications on computational grids: the MyGrid approach, in: Proc. International Conference on Parallel Processing, ICPP'03, October 2003, pp. 407416.
15. S. Ghemawat, H. Gobioff, S. Leung, The google file system, in: Proceeding of the 2003 ACM Symposium on Operating Systems Principles, 2003.
16. A. Giersch, Y. Robert, and F. Vivien Scheduling task sharing files on heterogeneous masterslave platforms Journal of Systems Architecture 52 2 2006 88 104 10.1016/j.sysarc.2004.10.008 (Pubitemid 43098940)
17. A. Grama, A. Gupta, and V. Kumar Isoefficiency: measuring the scalability of parallel algorithms and architectures IEEE Parallel and Distributed Technology 1 3 1993 12 21 10.1109/88.242438
18. T. Hagerup Allocating independent tasks to parallel processors: an experimental study Journal of Parallel and Distributed Computing 47 2 1997 185 197 (Pubitemid 127174400)
19. E. Heymann, M. Senar, E. Luque, M. Livny, Adaptive scheduling for masterworker applications on the computational grid, in: Proc. IEEE/ACM International Workshop on Grid Computing, GRID 2000, December 2000, pp. 214227.
20. Torsten Hoefler, Christian Siebert, Wolfgang Rehm, A practically constant-time mpi broadcast algorithm for large-scale infiniband clusters with multicast, in: 2007 IEEE International Parallel and Distributed Processing Symposium, 2007, p. 285.
21. A. Iosup, M. Jan, O. Sonmez, and D. Epema The characteristics and performance of groups of jobs in grids Europar 2007 LNCS vol. 4641 2007 Springer 382 393
22. A. Iosup, O. Sonmez, S. Anoep, D. Epema, The performance of bags-of-tasks in large-scale distributed systems, in: High Performance Distributed Computing, HPDC'08, Boston, USA, 2008, pp. 97108.
23. K. Kaya, and C. Aykanat Iterative-improvement-based heuristics for adaptive scheduling of tasks sharing files on heterogeneous masterslave environments IEEE Transactions on Parallel and Distributed Systems 17 8 2006 883 896 http://dx.doi.org/10.1109/TPDS.2006.105 (Pubitemid 44070155)
24. E. Korpela, D. Werthimer, D. Anderson, J. Cobb, and M. Lebofsky SETI@home-massively distributed computing for SETI Computing in Science & Engineering 3 1 2001 78 83 10.1109/5992.895191
25. V. Kumar, and V.N. Rao Parallel depth-first search on multiprocessors part II: analysis International Journal of Parallel Programming 16 6 1987 501 519
26. Y.C. Lee, and A.Y. Zomaya Practical scheduling of bag-of-tasks applications on grids with dynamic resilience IEEE Transactions on Computers 56 6 2007 815 825
27. K. Li Parallel processing of divisible loads on partitionable static interconnection networks Cluster Computing 6 1 2003 47 55
28. J. Liu, A.R. Mamidala, D.K. Panda, Fast and scalable MPI-level broadcast using infiniband's hardware multicast support, in: Proceedings of the 2004 IEEE International Parallel and Distributed Processing Symposium, 2004.
29. J. Mache, R. Broadhurst, J. Ely, Ray tracing on cluster computers, in: Intl. Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2000.
30. M. Maheswaran, S. Ali, H.J. Siegel, D. Hensgen, R.F. Freund, Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems, in: Proc. Heterogeneous Computing Workshop, HCW'99, 1999, pp. 3044.
31. A.R. Mamidala, L. Chai, H.-W. Jin, D.K. Panda, Efficient SMP-aware MPI-level broadcast over infiniband's hardware multicast, in: Proceedings of the 2006 IEEE International Parallel and Distributed Processing Symposium, 2006.
32. D. Paranhos, W. Cirne, F.V. Brasileiro, Trading cycles for information: using replication to schedule bag-of-tasks applications on computational grids, in: Proc. International Euro-Par Conference, June 2003.
33. L.P. Perez, J.L. Bosque, An efficiency and scalalabiltiy model for heterogeneous clusters, in: Proceedings of the 2001 IEEE International Symposium on Cluster Computing, 2001.
34. G. Romanazzi, P.K. Jimack, Parallel performance prediction for numerical codes in a multi-cluster environment, in: Proc. of the 2008 International MultiConference on Comp. Science and Information Technology, IMCSIT'08, 2008.
35. A.L. Rosenberg, R.C. Chiang, Toward understanding heterogeneity in computing, in: Proceedings of the 2010 IEEE International Parallel and Distributed Processing Symposium, 2010.
36. S.M. Sadjadi, S. Shimizu, J. Figueroa, R. Rangaswami, J. Delgado, H. Duran, X.J. Collazo-Mojica, A modeling approach for estimating execution time of long-running scientific applications, in: Proceedings of the 22nd IEEE International Symposium on Parallel and Distributed Processing, IPDPS'08, 2008.
37. E. Santos-Neto, W. Cirne, F.V. Brasileiro, and A. Lima Exploiting replication and data reuse to efficiently schedule data-intensive applications on grids Proc. Workshop on Job Scheduling Strategies for Parallel Processing, JSSPP'04 Lecture Notes in Computer Science vol. 3277 2004 Springer-Verlag 210 232
38. R. Schmidt, F. Pedone, Consistent main-memory database federations under deferred disk writes, in: Proceedings of the 24th IEEE Symposium on Reliable Distributed Systems, SRDS'05, 2005.
39. H. Senger, E.R. Hruschka, F.A.B. Silva, L.M. Sato, C.P. Bianchini, and B.F. Jerosch Exploiting idle cycles to execute data mining applications on clusters of PCs Journal of Systems and Software 80 5 2007 778 790 10.1016/j.jss.2006.05.035
40. H. Senger, F.A.B. Silva, W.M. Nascimento, Hierarchical scheduling of independent tasks with shared files, in: Proc. of the Sixth IEEE International Symposium on Cluster Computing and the Grid Workshops, IEEE/CCGRIDW'06, 2006. pp. 5156.
41. F.A.B. Silva, S. Carvalho, and E.R. Hruschka A scheduling algorithm for running data mining applications on the grid Proc. International Euro-Par Conference, 2004 Lecture Notes in Computer Science vol. 3419 2004 Springer-Verlag 254 262
42. F.A.B. Silva, S. Carvalho, H. Senger, E.R. Hruschka, and C.R.G. Farias Running data mining applications on the grid: a bag-of-tasks approach Proc. International Conference on Computational Science and its Applications, ICCSA 2004 Lecture Notes in Computer Science vol. 3044 2004 Springer-Verlag Berlin 168 177
43. F.A.B. Silva, and H. Senger Improving scalability of bag-of-tasks applications running on masterslave platforms Parallel Computing 35 2 2009 57 71
44. X. Sun, and D.T. Rover Scalability of parallel algorithmmachine combinations IEEE Transactions on Parallel and Distributed Systems 5 6 1994 599 613
45. D. Thain, T. Tannenbaum, and M. Livny Distributed computing in practice: the condor experience Concurrency and Computation: Practice and Experience 17 24 2005 http://dx.doi.org/10.1002/cpe.938
46. J.L. Trff, and A. Ripkea Optimal broadcast for fully connected processor-node networks Journal of Parallel and Distributed Computing 68 7 2008 887 901
47. S.W. White, and D.C. Torney Use of a workstation cluster for the physical mapping of chromosomes SIAM News 1993 14 17
48. Y. Yang, K. Raadt, and H. Casanova Multiround algorithms for scheduling divisible loads IEEE Transactions on Parallel and Distributed Systems 16 11 2005 1092 1102 (Pubitemid 41709712)
49. E. Yero, and M. Henriques Speedup and scalabiltity analysis of masterslave applications on large heterogeneous clusters Journal of Parallel and Distributed Computing 67 2007 1155 1167 (Pubitemid 47446132)
50. X. Zhang, Y. Yan, and K. He Latency metric: an experimental metric for measuring and evaluating parallel program and architecture scalability Journal of Parallel and Distributed Computing 22 3 1994 392 410
51. J. Zhou, X.-Y. Lin, and Y.-C. Chung Hardware supported multicast in fat-tree-based infiniBand networks Journal of Supercomputing 40 2007 333 352 (Pubitemid 46589205)