The user-level scheduling of divisible load parallel applications with resource selection and adaptive workload balancing on the grid

IEEE Systems Journal

Volumn 3, Issue 1, 2009, Pages 121-130

  Korkhov, Vladimir V ^a   Moscicki, Jakub T ^b   Krzhizhanovskaya, Valeria V ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b CERN   (Switzerland)

Author keywords

Adaptive workload balancing; Grid; Resource selection; User level scheduling

Indexed keywords

ADAPTIVE ALGORITHMS; APPLICATIONS; COMPUTER SYSTEM FIREWALLS; NATURAL RESOURCES MANAGEMENT; RESOURCE ALLOCATION; SCHEDULING;

ADAPTIVE WORKLOAD BALANCING; APPLICATION PERFORMANCE; APPLICATION REQUIREMENTS; DISTRIBUTED ANALYSIS; DIVISIBLE LOADS; DIVISIBLE WORKLOADS; EXECUTION TIME; GRID; GRID RESOURCES; PARALLEL APPLICATIONS; PERFORMANCE COMPARISONS; RESOURCE MANAGEMENTS; RESOURCE PARAMETERS; RESOURCE SELECTION; SELF-SCHEDULING; SYSTEM LEVELS; USER-LEVEL SCHEDULING; WORK-LOAD DISTRIBUTIONS;

PARALLEL PROCESSING SYSTEMS;

EID: 63049122066     PISSN: 19328184     EISSN: 19379234     Source Type: Journal    
DOI: 10.1109/JSYST.2008.2011301     Document Type: Article

References (31)

1. F. Gagliardi, B. Jones, F. Grey, M.-E. Begin, and M. Heikkurinen, "Building an infrastructure for scientific grid computing: Status and goals of the EGEE project," Philosophical Trans. Royal Soc. A., vol. 363, no. 1833, pp. 1729-1742, 2005.
2. C. Germain-Renaud, C. Loomis, J. Moscicki, and R. Texier, "Scheduling for responsive grids," Grid Comput. J., vol. 6, no. 1, pp. 15-27, 2006.
3. J. T. Moscicki, M. Bubak, H.-C. Lee, A. Muraru, and P. Sloot, "Quality of service on the grid with user level scheduling," in Cracow Grid Workshop Proc., 2006, pp. 119-129.
4. V. V. Korkhov and V. V. Krzhizhanovskaya, "Benchmarking and adaptive load balancing of the virtual reactor application on the Russian-Dutch grid," LNCS, vol. 3991, pp. 530-538, 2006.
5. V. V. Korkhov, V. V. Krzhizhanovskaya, and P. M. A. Sloot, "A grid based virtual reactor: Parallel performance and adaptive load balancing," J. Parallel Distrib. Comput., vol. 68, no. 5, pp. 596-608, 2008.
6. V. V. Krzhizhanovskaya and V. V. Korkhov, "Dynamic load balancing of black-box applications with a resource selection mechanism on heterogeneous resources of the grid," in Conf. Parallel Comput. Technol. (PaCT), LNCS, Berlin/Heidelberg, 2007, vol. 4671, pp. 245-260.
7. J. Frey, T. Tannenbaum, M. Livny, I. Foster, and S. Tuecke, "A computation management agent for multi-institutional grids," Cluster Comput. J., vol. 5, no. 3, pp. 237-246, 2002.
8. F. Berman, R. Wolski, H. Casanova, W. Cirne, H. Dail, M. Faerman, S. Figueira, J. Hayes, G. Obertelli, J. Schopf, G. Shao, S. Smallen, N. Spring, A. Su, and D. Zagorodnov, "Adaptive computing on the grid using AppLeS," IEEE Trans. Parallel Distrib. Syst., vol. 14, no. 4, pp. 369-382, Apr. 2003.
9. D. Abramson, J. Giddy, and L. Kotler, "High Performance Parametric Modeling with Nimrod/G: Killer Application for the Global Grid?," in Proc. Int. Parallel Distrib. Process. Symp. (IPDPS), Cancun, Mexico, May 2000, pp. 520-528.
10. P. Saiz, L. Aphecetche, P. Buncic, R. Piskac, J.E. Revsbech, and V. Sego, "AliEn - ALICE environment on the GRID," Nucl. Instruments Methods Phys. Res. Sect. A, vol. 502, no. 2-3, pp. 437-440, 2003.
11. A. Tsaregorodtsev, V. Garonne, and I. Stokes-Rees, "DIRAC: A scalable lightweight architecture for high throughput computing," in Proc. 5th IEEE/ACM Int. Workshop Grid Comput. (GRID), 2004, pp. 19-25.
12. C. Germain-Renaud, R. Texier, and A. Osorio, "Interactive reconstruction and measurement on the grid," Methods Inf. Med., vol. 44, no. 2, pp. 227-232, 2005.
13. D. Weissenbach and E. Clevede, "Faster earthquake source mechanism determination with EGEE," presented at the 1st EGEE Conf., Geneva, Switzerland, 2006.
14. H. C. Lee, J. Salzemann, N. Jacq, H.Y. Chen, L.Y. Ho, I. Merelli, L. Milanesi, V. Breton, S.C. Lin, and Y.T. Wu, "Grid-enabled high-throughput in silico screening against influenza a neuraminidase," IEEE Trans. Nanobiosci., vol. 5, no. 4, pp. 288-295, Apr. 2006.
15. A. Darling, L. Carey, and W. Feng, "The design, implementation, and evaluation of mpiBLAST," presented at the 4th Int. Conf. Linux Clusters: HPC Revolution Conjunction With Cluster World Conf. Expo, San Jose, CA, Jun. 2003.
16. A. Barak and O. La'adan, "The MOSIX multicomputer operating system for high perfomance cluster computing," FGCS, vol. 13, no. 4-5, pp. 361-372, 1998.
17. K. A. Iskra, F. van der Linden, Z.W. Hendrikse, B.J. Overeinder, G.D. van Albada, and P.M.A. Sloot, "The implementation of dynamite - An environment for migrating PVM tasks," Operat. Syst. Rev., vol. 34, no. 3, pp. 40-55, 2000.
18. G. Shao, F. Berman, and R. Wolski, "Master/Slave computing on the grid," in Proc. Heterogeneous Comput. Workshop, 2000, pp. 3-16.
19. S. Sinha and M. Parashar, "Adaptive runtime partitioning of AMR applications on heterogeneous clusters," in Proc. 3rd IEEE Int. Conf. Cluster Comput., 2001, pp. 435-442.
20. R. David, S. Genaud, A. Giersch, B. Schwarz, and E. Violard, "Source code transformations strategies to load-balance grid applications," in Lecture Notes in Computer Science. New York: Springer-Verlag, 2002, vol. 2536, pp. 82-87.
21. J. T. Moscicki, "Distributed analysis environment for HEP and interdisciplinary applications," Nucl. Instruments Methods Phys. Res. A, vol. 502, pp. 426-429, 2003.
22. CERN, Geneva, Switzerland, "DIstributed ANalysis Environment," [Online]. Available: http://cern.ch/diane
23. J. T. Moscicki, "Ganga - A computational task management tool for easy access to Grid," Comput. Phys. Commun., accepted for publication.
24. G. Carrera, E. de Andres, J.T. Moscicki, A. Muraru, S.H.W. Scheres, and J.M. Carazo, "Heavy computational tasks on the EGEE Grid: 2D/3D maximum-likelihood refinement," presented at the Netw. Excellence 3DEM Ann. Meet., Palma, Jan. 2007.
25. A. Manara, "Integration of new communities in the Grid for mission critical applications: Distributed radio-frequency compatibility analysis for the ITU RRC06 conference," in Proc. EGEE Conf., Geneva, Switzerland, Sep. 2006.
26. CERN, Geneva, Switzerland, "Atlas Computing - Technical design report," CERN-LHCC-2005-022, 2005.
27. CERN, Geneva, Switzerland, "Geant4 VO," 2005. [Online]. Available: http://lcg-voms.cern.ch/vo/geant4
28. C. Anastasiou, S. Beerli, and A. Daleo, Evaluating multi-loop feynman diagrams with infrared and threshold singularities numerically CERN, Geneva, Switzerland, CERN-PH-TH-2007-058, Mar. 2007.
29. N. Karonis, B. Toonen, and I. Foster, "MPICH-G2: A grid-enabled implementation of the message passing interface," J. Parallel Distrib. Comput. (JPDC), vol. 63, no. 5, pp. 551-563, May 2003.
30. B. Veeravalli, D. Ghose, and T. G. Robertazzi, "Divisible load theory: A new paradigm for load scheduling in distributed systems," Cluster Comput., vol. 6, no. 1, pp. 7-17, 2003.
31. G. Borges, "Interactive European Grid Project," INGRID, Lacco Ameno, Ischia, Italy, 2008 [Online]. Available: http://www.interactive-grid.eu/