Data Grids: Supporting Data-Intensive Applications in Wide-Area Networks

High-Performance Computing: Paradigm and Infrastructure

Volumn , Issue , 2006, Pages 481-494

  Qin, Xiao ^a   Jiang, Hong ^b  

^a NEW MEXICO INSTITUTE OF MINING AND TECHNOLOGY   (United States)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Consistency maintenance; Data access; Data grids; Data replication; Metadata services; Security

Indexed keywords

EID: 57149087522     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/0471732710.ch24     Document Type: Chapter

References (44)

1. D. Abramson, J. Giddy, I. Foster, and L. Kotler, High Performance Parametric Modeling with Nimrod/G: Killer Application for the Global Grid, in Proceedings of the International Parallel and Distributed Processing Symposium, May, 2000.
2. J. Al-Jaroodi, N. Mohamed, H. Jiang, and D. Swanson, An Agent-Based Infrastructure for Parallel Java on Heterogeneous Clusters, in Proceedings of 4th IEEE International Conference on Cluster Computing, Chicago, Illinois, September (2002).
3. B. Allcock, J. Bester, J. Bresnahan, A. Chervenak, I. Foster, et. al., Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing, in Proceedings 18th IEEE Symposium on Mass Storage Systems, 2001.
4. C. Baru, R. Moore, A. Rajasekar, and M. Wan, The SDSC Storage Resource Broker, Proc of CASCON Conference, 1998.
5. J. Basney, M. Livny, and P. Mazzanti, Utilizing Widely Distributed Computational Resources Efficiently with Execution Domains, Computer Physics Communications, 140, 2001.
6. J. Basney, R. Raman, and M. Livny, High-throughput Monte Carlo, in Proceedings of the Ninth SIAM Conference on Parallel Processing for Scientific Computing, March 1999.
7. F. Berman, R. Wolski, S. Figueira, J. Schopf, and G. Shao, Application-Level Scheduling on Distributed Heterogeneous Networks, in Proceedings of Supercomputing, 1996.
8. J. Bester, I. Foster, C. Kesselman, J. Tedesco, and S. Tuecke, GASS: A Data Movement and Access Service for Wide Area Computing Systems, in Proceedings of Sixth Workshop on I/O in Parallel and Distributed Systems, May 5, 1999.
9. W. Bethel, B. Tierney, J. Lee, D. Gunter, and S. Lau, Using High-Speed WANs and Network Data Caches to Enable Remote and Distributed Visualization, in Proceedings of the IEEE Supercomputing Conference, 2002.
10. T. Bray, J. Paoli, and C. Sperberg-McQueen, The Extensible Markup Language (XML)1.0W3C Recommendation, World Wide Web Consortium, Feb. 1998.
11. L. Breslau, P. Cao, L, Fan, G. Phillips, and S. Shenker, Web Caching and Zipflike Distributions:Evidence and Implications, in Proceedings of IEEE Infocom, 1999.
12. H. Casanova, G. Obertelli, F. Berman, and R. Wolski, The AppLeS Parameter Sweep Template: User-Level Middleware for the Grid, in Proceedings Supercomputing, 2000.
13. A. Chervenak, I. Foster, C. Kesselman, C. Salisbury, and S. Tuecke, The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets, in Proceedings of Network Storage Symposium, 2000.
14. A. Chervenak, E. Deelman, C. Kesselman, L. Pearlman, and G. Singh, A Metadata Catalog Service for Data Intensive Applications, GriPhyN Technical Report, Information Science Institute, 2002.
15. A. Chervenak, E. Deelman, I. Foster, et al., Giggle: A Framework for Constructing Scalable Replica Location Services, in Proceedings IEEE Supercompuing Conference, 2002.
16. A. Ching, A. Choudhary, W. Liao, R. Ross, and W. Gropp, Noncontiguous I/O through PVFS, in Proceedings of IEEE International Conference on Cluster Computing, September, 2002.
17. S. Fitzgerald, I. Foster, C. Kessenlman, G. Laszewski, W. Smith, and S. Tuecke, A Directory Service for Configuring High-performance Distributed Computations, in Proceedings 6th IEEE Symposiumon High-Performance Distributed Computing, pp. 365-375, 1997.
18. I. Foster and C. Kesselman, Globus: A Metacomputing Infrastructure Toolkit, International Journal of Supercomputer Applications, 11, 2, 115-128, 1997.
19. J. Howard, M. Kazar, S. Menees, D. Nichols, M. Satyanarayanan, R. Sidebotham, and M. West, Scale and Performance in a Distributed File System, ACM Transactions on Computer Systems, 6, 1, 51-81, 1988.
20. H. Lamehamedi, B. Szymanski, Z. Shentu, and E. Deelman, Data Replication Strategies in Grid Environments, in Proceedings Of the Fifth International Conference on Algorithms and Architectures for Parallel Processing, 2002.
21. J. Lee, D. Gunter, M. Stoufer, and B. Tiemey, Monitoring Data Archives for Grid Environments, in Proceedings Supercomputing, 2002.
22. M. Litzkow, M. Livny, and M. Mutka, Condor-A Hunter of IdleWorkstations, in Proceedings of the 8th International Conference on Distributed Computing Systems, pp. 104-111, 1988.
23. D. Mullmann, W. Hosckek, J. Jaen-Martinez, and B. Segal, Models for Replica Synchronization and Consistency in Data Grid, in Proceedings IEEE Symposium on High Performance on Distributed Computing, 2001.
24. C. J. Patten and K. A. Hawick, Flexible High-performance Access to Distributed Storage Resources, in Proceedings of High Performance Distributed Computing, 2000.
25. K. Ranganathan and I. Foster, Identifying Dynamic Replication Strategies for a High-Performance Data Grid, in Proceedings International Grid Computing Workshop, Denver, November 2001.
26. K. Ranganathan and I. Foster, Decoupling Computation and Data Scheduling in Distributed Data-Intensive Applications, in Proceedings of the 11th IEEE Symposium on High Performance Distributed Computing, 2002.
27. A. Samar and H. Stockinger, Grid Data Management Pilot (GDMP): A Tool for Wide Area Replication, in Proceedings of International Conference on Applied Informatics, Feb. 2001.
28. R. Sandberg, D. Goldberg, S. Kleiman, D. Walsh, and B. Lyon, Design and Implementation of the Sun Network Filesystem, in Proceedings of USENIX Conference, Berkeley, 1985.
29. R. Snodgrass, A Relational Approach to Monitoring Complex System, ACM Transactions on Computer Systems, 6, 2, 157-196, 1988.
30. N. Spring and R. Wolski, Application level scheduling: Gene Sequence Library Comparison, in Proceedings of ACM International Conference on Supercomputing, 1998.
31. H. Stockinger, A. Samar, B. Allock, I. Foster, K. Holtman, and B. Tierney, File and Object Replication in Data Grids, in Proceedings of IEEE Symposium on High Performance Distributed Computing, 2001.
32. H. Stockinger, Distributed Database Management Systems and the Data Grid, 18th IEEE Symposium on Mass Storage Systems and 9th NASA Goddard Conference on Mass Storage Systems and Technologies, San Diego, April 17-20, 2001.
33. C. Sun, X. Jia, Y. Zhang, Y. Yang, and D. Chen, Achieving Convergence, Causality-Preservation, and Intention-Preservation in Real-Time Cooperative Editing Systems, ACM Transactions on Computer-Human Interaction, 5, 1, 63-108, March, 1998.
34. M. Swany and R. Wolski, Representing Dynamic Performance Information in Grid Environments with Network Weather Service, in Proceedings of the 2nd IEEE International Symposium on Cluster Computing and the Grid, May 2002.
35. R. Tewari, M. Dahlin, H. Vin, and J. Kay, Design Considerations for Distributed Caching on the Internet, in Proceedings of IEEE International Conference on Distributed Computing Systems, 1999.
36. D. Thain, J. Bent, A. Arpaci-Dusseau, R. Arpaci-Dusseau, and M. Livny, Gathering at the Well: Creating Communities for Grid I/O, in Proceedings Supercomputing, 2001.
37. D. Thain, J. Basney, S. Son, and M. Livny, The Kangaroo Approach to Data Movement on theGrid, in Proceedings of the 10th IEEE SymposiumonHigh Performance Distributed Computing, 2001.
38. B. Tierney, R. Aydt, D. Gunter, W. Smith, V. Taylor, R. Wolski, and M. Swany, A Grid Monitoring Service Architecture, Global Grid Forum While Paper, 2001.
39. B. Tierney, W. Johnston, B. Crowley, G. Hoo, C. Brooks, and D. Gunter, The NetLogger Methodology for High Performance Distributed Systems Performance Analysis, in Proceedings of IEEE High Performance Distributed Computing, July, 1998.
40. S. Vazhkudai, S. Tuecke, and I. Foster, Replica Selection in the Global Data Grid, in Proceedings of the International Workshop on Data Models and Databases on Clusters and the Grid, 2001.
41. M. Wahl, T. Howes, and S. Kille, Lightweight Directory Access Protocol, RFC 2251, Internet Engineering Task Force, 1997.
42. B. White, A. S. Grimshaw, and A. Nguyen-Tuong, Grid-Based File Access: The Legion I/O Model, in Proceedings of High Performance Distributed Computing, 2000.
43. H. Yu and A. Vahdat, Design and Evaluation of a Conit-based Continuous Consistency Model for Replicated Services, ACM Transactions on Computer Systems, August, 2002.
44. Y. Zhu, H. Jiang, X. Qin, and D. Swanson, A Case Study of Parallel I/O for Biological Sequence Analysis on Linux Clusters, in Proceedings of the 5th IEEE International Conference on Cluster Computing, pp. 308-315, Hong Kong, Dec. 1-4, 2003.