A decoupled scheduling approach for Grid application development environments

Journal of Parallel and Distributed Computing

Volumn 63, Issue 5, 2003, Pages 505-524

  Dail, Holly ^a   Berman, Fran ^a,b   Casanova, Henri ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Grid computing; Parallel computing; Programming environments; Scheduling

Indexed keywords

EID: 2942625187     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0743-7315(03)00011-X     Document Type: Article

References (44)

1. D. Abramson, J. Giddy, L. Kotler, High performance parametric modeling with Nimrod/G: Killer application for the global Grid? in: International Parallel and Distributed Processing Symposium, Cancun, Mexico, 2000, pp. 520-528.
2. A.H. Alhusaini, V.K. Prasanna, C. Raghavendra, A unified resource scheduling framework for heterogeneous computing environments, in: Proceedings of the Eighth Heterogeneous Computing Workshop, San Juan, Puerto Rico, 1999, pp. 156-165.
3. G. Allen, D. Angulo, I. Foster, G. Lanfermann, C. Liu, T. Radke, E. Seidel, J. Shalf, The cactus worm: experiments with dynamic resource discovery and allocation in a Grid environment, Int. J. High Performance Comput. Appl. 15 (4) (2001) 345-358.
4. G. Allen, T. Dramlitsch, I. Foster, N. Karonis, M. Ripeanu, E. Seidel, B. Toonen, Supporting efficient execution in heterogeneous distributed computing environments with Cactus and Globus, in: Proceedings of Supercomputing, Denver, Colorado, 2001.
5. M. Banikazemi, J. Sampathkumar, S. Prabhu, D.K. Panda, P. Sadayappan, Communication modeling of heterogeneous networks of workstations for performance characterization of collective operations, in: Proceedings of the Eighth Heterogeneous Computing Workshop, San Juan, Puerto Rico, 1999.
6. R. Barrett, M.W. Berry, T.F. Chan, J. Demmel, J. Donato, J. Dongarra, V. Eijkhout, R. Pozo, C. Romine, H. van der Vorst, Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods, 2nd Edition, SIAM, Philadelphia, PA, 1994.
7. F. Berman, A. Chien, K. Cooper, J. Dongarra, I. Foster, D. Gannon, L. Johnsson, K. Kennedy, C. Kesselman, J. Mellor-Crummey, D. Reed, L. Torczon, R. Wolski, The GrADS project: software support for high-level Grid application development, Int J. Supercomput. Appl. 15 (4) (2001) 327-344.
8. F. Berman, R. Wolski, H. Casanova, W. Cirne, H. Dail, M. Faerman, S. Figueira, J. Hayes, G. Obertelli, J. Schopf, G Shao, S. Smallen, N. Spring, A. Su, D. Zagorodnov, Adaptive computing on the Grid using AppLeS, IEEE Trans. Parallel Distrib. Systems 14 (4) (2003) 369-382.
9. F. Berman, R. Wolski, S. Figueira, J. Schopf, G. Shao, Application level scheduling on distributed heterogeneous networks, in: Proceedings of Supercomputing, Pittsburgh, Pennsylvania, 1996.
10. L.S. Blackford, J. Choi, A. Cleary, E. D'Azevedo, J. Demmel, I. Dhillon, J. Dongarra, S. Hammarling, G. Henry, A. Petitet, K. Stanley, D. Walker, R.C. Whaley, ScaLAPACK Users' Guide, Society for Industrial and Applied Mathematics, Philadelphia, PA, 1997.
11. H. Casanova, G. Obertelli, F. Berman, R. Wolski, The AppLeS parameter sweep template: user-level middleware for the Grid, in: Proceedings of Supercomputing, Dallas, Texas, 2000.
12. K. Czajkowski, S. Fitzgerald, I. Foster, C. Kesselman, Grid information services for distributed resource sharing, in: Proceedings of the Tenth IEEE Symposium on High-Performance Distributed Computing, San Francisco, California, 2001.
13. H. Dail, A modular framework for adaptive scheduling in Grid application development environments, Master's Thesis, University of California at San Diego, available as UCSD Technical Report, CS2002-0698, March 2002.
14. H. Dail, H. Casanova, F. Berman, A decoupled scheduling approach for the GrADS program development environment, in: Proceedings of Supercomputing, Baltimore, Maryland, 2002.
15. H. Dail, G. Obertelli, F. Berman, R. Wolski, A. Grimshaw, Application-aware scheduling of a magnetohydrodynamics application in the Legion metasystem, in: Proceedings of the Ninth Heterogenous Computing Workshop, Cancun, Mexico, 2000.
16. G.W. Flake, The Computational Beauty of Nature: Computer Explorations of Fractals, Chaos, Complex Systems, and Adaptation, MIT Press, Cambridge, MA, 1998.
17. I. Foster, Designing and Building Parallel Programs, Addison-Wesley, Reading, MA, 1995 (Chapter 2), available at http://www-unix.mcs.anl.gov/dbpp.
18. I. Foster, J. Geisler, W. Gropp, N. Karonis, E. Lusk, G. Thiruvathukal, S. Tuecke, Wide-area implementation of the Message Passing Interface, Parallel Comput. 24 (12) (1998) 1735-1749.
19. I. Foster, C. Kesselman, The globus project: a status report, in: Proceedings of the Seventh Heterogeneous Computing Workshop, IEEE Press, New York, 1998, pp. 4-18.
20. I. Foster, C. Kesselman (Eds.), The Grid: Blueprint for a New Computing Infrastructure, Morgan Kaufmann Publishers, Inc., Los Altos, CA, 1999.
21. I. Foster, C. Kesselman (Eds.), The Grid: Blueprint for a New Computing Infrastructure, Morgan Kaufmann Publishers, Inc., Los Altos, CA, 1999, pp. 279-309, Chapter 12: High-performance schedulers by Fran Berman.
22. G.C. Fox, R.D. Williams, P.C. Messina, Parallel Computing Works! Morgan Kaufmann, San Francisco, CA, 1994, available at http://www.npac.syr.edu/pcw.
23. J. Frey, T. Tannenbaum, M. Livny, I. Foster, S. Tuecke, Condorg: a computation management agent for multi-institutional Grids, Cluster Comput. 5 (3) (2002) 237-246.
24. A. Grimshaw, A. Ferrari, F. Knabe, M. Humphrey, Wide-area computing: resource sharing on a large scale, IEEE Comp. 32 (5) (1999) 29-37.
25. W. Gropp, E. Lusk, N. Doss, A. Skjellum, A high-performance, portable implementation of the MPI message passing interface standard, Parallel Comput. 22 (6) (1996) 789-828.
26. N. Karonis, B. Toonen, I. Foster, MPICH-G2: a Grid-enabled implementation of the message passing interface, J. Parallel Distrib. Comput., to appear.
27. K. Kennedy, B. Broom, K. Cooper, J. Dongarra, R. Fowler, D. Gannon, L. Johnsson, J. Mellor-Crummey, L. Torczon, Telescoping languages: a strategy for automatic generation of scientific problem-solving systems from annotated libraries, J. Parallel Distrib. Comput. 61 (12) (2001) 1803-1826.
28. K. Kennedy, M. Mazina, R. Aydt, C. Mendes, H. Dail, O. Sievert, GrADSoft and its application manager: an execution mechanism for Grid applications, GrADS Project Working Document V, available at http://hipersoft.cs.rice.edu/grads/publications_reports.htm (October 2001).
29. Y.-K. Kwok, I. Ahmad, Benchmarking and comparison of the task graph scheduling algorithms, J. Parallel Distrib. Comput. 59 (3) (1999) 381-422.
30. C. Liu, L. Yang, I. Foster, D. Angulo, Design and evaluation of a resource selection framework for Grid applications, in: Proceedings of the 11th IEEE Symposium on High-Performance Distributed Computing, Edinburgh, Scotland, 2002.
31. N. Miller, P. Steenkiste, Collecting network status information for network aware applications, in: INFOCOM'00, Tel-Aviv, Israel, 2000.
32. D. Mirkovic, R. Mahasoom, L. Johnsson, An adaptive software library for fast fourier transforms, in: Proceedings of the 2000 International Conference on Supercomputing, Santa Fe, New Mexico, 2000.
33. MPI Forum webpage at http://www.mpi-forum.org.
34. W. Pearson, D. Lipman, Improved tools for biological sequence comparison, Proc. Nat. Acad. Sci. USA 85 (1988) 2444-2448.
35. A. Petitet, S. Blackford, J. Dongarra, B. Ellis, G. Fagg, K. Roche, S. Vadhiyar, Numerical libraries and the Grid, Int. J. High Performance Comput. Appl. 15 (4) (2001) 359-374.
36. R. Raman, M. Livny, M.H. Solomon, Matchmaking: an extensible framework for distributed resource management, Cluster Comput. 2 (2) (1999) 129-138.
37. G. Shao, F. Berman, R. Wolski, Using effective network views to promote distributed application performance, in: Proceedings of the 1999 International Conference on Parallel and Distributed Processing Techniques and Applications, Las Vegas, Nevada, 1999.
38. G. Shao, R. Wolski, F. Berman, Master/slave computing on the Grid, in: Proceedings of the Ninth Heterogenous Computing Workshop, Cancun, Mexico, 2000.
39. S. Smallen, H. Casanova, F. Berman, Applying scheduling and tuning to on-line parallel tomography, in: Proceedings of Supercomputing, Denver, Colorado, 2001.
40. A. Su, F. Berman, R. Wolski, M.M. Strout, Using AppLeS to schedule simple SARA on the Computational Grid, Int. J. High Performance Comput. Appl. 13 (3) (1999) 253-262.
41. J. Weissman, Prophet: automated scheduling of SPMD programs in workstation networks, Concurrency: Practice and Experience 11 (6) (1999).
42. J. Weissman, X. Zhao, Scheduling parallel applications in distributed networks, J. Cluster Comput. 1 (1) (1998) 109-118.
43. H. Williams, Model Building in Mathematical Programming, 2nd Edition, Wiley, Chichester, New York, 1995.
44. R. Wolski, N.T. Spring, J. Hayes, The Network Weather Service: a distributed resource performance forecasting service for metacomputing, J. Future Generation Comput. Systems 15 (5-6) (1999) 757-768.