Decoupling computation and data scheduling in distributed data-intensive applications

Proceedings of the IEEE International Symposium on High Performance Distributed Computing

Volumn 2002-January, Issue , 2002, Pages 352-358

  Ranganathan, K ^a   Foster, I ^a,b  

^a THE UNIVERSITY OF CHICAGO   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

Application software; Bioinformatics; Computer science; Distributed computing; Laboratories; Large scale systems; Physics computing; Processor scheduling; Resource management; Scheduling algorithm

Indexed keywords

APPLICATION PROGRAMS; BIOINFORMATICS; COMPUTER RESOURCE MANAGEMENT; COMPUTER SCIENCE; DIGITAL STORAGE; HIGH ENERGY PHYSICS; LABORATORIES; LARGE SCALE SYSTEMS; SCHEDULING; SCHEDULING ALGORITHMS;

COMPUTATION SCHEDULING; DESIGN AND IMPLEMENTATIONS; GEOGRAPHICALLY DISTRIBUTED RESOURCES; INDEPENDENT SOURCES; PROCESSOR SCHEDULING; RESOURCE MANAGEMENT; SCHEDULING FRAMEWORKS; SIMULATION STUDIES;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 51849099250     PISSN: 10828907     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HPDC.2002.1029935     Document Type: Conference Paper

References (29)

1. CMS: Compact Muon Solenoid: http://cmsinfo.cern.ch/Welcome.html/
2. Fermi National Accelerator Laboratory: http://www.fnal.gov
3. Parsec : Parallel Simulation Environment for Complex Systems: http://pcl.cs.ucla.edu/projects/parsec
4. Proceedings of Job Scheduling Strategies for Parallel Processing Workshop: http://www.link.springer.de/link/service/series/0558/tocs/t2221.htm
5. Alhusaini, A.H., Prasanna, V.K. and Raghavendra, C.S., A Unified Resource Scheduling Framework for Heterogeneous Computing Environments. in 8th Heterogeneous Computing Workshop, (1999).
6. Avery, P. and Foster, I. The GriPhyN Project: Towards Petascale Virtual Data Grids, 2001.
7. Avery, P., Foster, I., Gardner, R., Newman, H. and Szalay, A. An International Virtual-Data Grid Laboratory for Data Intensive Science, 2001.
8. Basney, J., Livny, M. and Mazzanti, P., Harnessing the Capacity of Computational Grids for High Energy Physics. in Computing in High Energy and Nuclear Physics, (2000).
9. Basney, J., Livny, M. and Mazzanti, P. Utilizing Widely Distributed Computational Resources Efficiently with Execution Domains. Computer Physics Communications.
10. Berman, F., Wolski, R., Figueira, S., Schopf, J. and Shao, G., Application-Level Scheduling on Distributed Heterogeneous Networks. in Supercomputing'96, (Pittsburg, 1996).
11. Bestavros, A., Demand-based document dissemination to reduce traffic and balance load in distributed information systems. in IEEE symposium on Parallel and Distributed Processing, (San Antonio, TX, 1995), 338-345.
12. Bester, J., Foster, I., Kesselman, C., Tedesco, J. and Tuecke, S., GASS: A data movement and access service for wide area computing systems. in Sixth Workshop on Input/Output in Parallel and Distributed Systems, (1999).
13. Braun, T., A Taxonomy of scheduling in general-purpose distributed computing systems. in Workshop on Advances in Parallel and Distributed Systems (APADS), (West Lafayette, IN, 1998).
14. Casanova, H., Obertelli, G., Berman, F. and Wolski, R., The AppLeS Parameter Sweep Template: User-Level Middleware for the Grid. in Super Computing, (Denver, 2000).
15. Czajkowski, K., Fitzzgerald, S., Foster, I. and Kesselman, C., Grid Information Services for Distributed Resource Sharing. in Tenth IEEE International Symposium on High Performance Distributed Computing(HPDC-10), (2001).
16. Fan, L., Cao, P., Almeida, J. and Broder, A., Summary Cache: A Scalable Wide-Area Web Cache Sharing Protocol. in Proceedings of ACM SIGCOMM'98, (Vancouver, Canada, 1998).
17. Foster, I. and Kesselman, C. Globus: A Metacomputing Infrastructure Toolkit. International Journal of Supercomputing Applications, 11 (2). 115-128.
18. Foster, I. and Kesselman, C. (eds.). The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, 1999.
19. Foster, I., Kesselman, C. and Tuecke, S. The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of High Performance Computing Applications, 15 (3). 200-222.
20. Hamscher, V., Schwiegelshohn, U., Streit, A. and Yahyapour, R., Evaluation of Job-Scheduling Strategies for Grid Computing. in 7th International Conference of High Performance Computing, (Bangalore, India, 2000).
21. Holtman, K., CMS Requirements for the Grid. in CHEP, (Beijing, 2001).
22. M.Maheswaran, S.Ali, H.J.Siegel and D.Hensgen, Dynamic Matching and Scheduling of a Class of Independent Tasks onto Heterogeneous Computing Systems. in 8th Heterogeneous Computing Workshop, (1999).
23. Ranganathan, K. and Foster, I., Identifying Dynamic Replication Strategies for a High Performance Data Grid. in International Workshop on Grid Computing, (Denver, CO, 2001), Springer-Verlag.
24. Sih, G.C. and Lee, E.A., Dynamic-level scheduling for heterogeneous processor networks. in Second IEEE Symposium on Parallel and Distributed Systems, (1990).
25. Thain, D., Basney, J., Son, S.-C. and Livny, M., The Kangaroo approach to data movement on the grid. in Tenth IEEE Symposium on High Performance Distributed Computing, (San Francisco, 2001).
26. Thain, D., Bent, J., Arpaci-Dusseau, A., Arpaci-Dusseau, R. and Livny, M., Gathering at the Well: Creating Communities for Grid I/O. in Supercomputing, (Denver, CO, 2001).
27. Wolman, A., Voelker, G.M., Sharma, N., Cardwell, N., Karlin, A. and Levy, H.M., On the scale and performance of cooperative Web proxy caching. in Proceedings of 17th ACM Symposium on Operating Systems Principles (SOPS'99), (Kiawah Island Resort, SC, USA, 1999), 16-31.
28. Wolski, R. Forecasting Network Performance to Support Dynamic Scheduling Using the Network Weather Service. in Proc. 6th IEEE Symp. on High Performance Distributed Computing, Portland, Oregon, 1997.
29. Yu, P.S. and MacNair, E.A., Performance study of a collaborative method for hierarchical caching in proxy servers. in Proceedings of 7th International World Wide Web Conference (WWW7), (1998).