A scientific data management system for irregular applications

Proceedings - 15th International Parallel and Distributed Processing Symposium, IPDPS 2001

Volumn , Issue , 2001, Pages 1216-1223

  No, Jaechun ^a   Thakur, R ^a   Kaushik, D ^a   Freitag, L ^a   Choudhary, A ^b  

^a ARGONNE NATIONAL LABORATORY   (United States)

^b Northwestern University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION PROGRAMMING INTERFACES (API); COMPUTATIONAL FLUID DYNAMICS; DIGITAL STORAGE; FILE ORGANIZATION; METADATA; USER INTERFACES;

ARGONNE NATIONAL LABORATORY; DATABASE SUPPORT; INDEX DISTRIBUTION; IRREGULAR APPLICATIONS; PARALLEL FILE SYSTEM; RAYLEIGH-TAYLOR INSTABILITIES; SCIENTIFIC APPLICATIONS; SCIENTIFIC DATA MANAGEMENT;

INFORMATION MANAGEMENT;

EID: 84981156270     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2001.925096     Document Type: Conference Paper

References (33)

1. W. K. Anderson, W. D. Gropp, D. K. Kaushik, D. E. Keyes, and B. F. Smith. Achieving High Sustained Performance in an Unstructured Mesh CFD Application. In Proc. of SC1999, Winter 1999.
2. C. Baru, R. Moore, A. Rajasekar, and M. Wan. The SDSC Storage Resource Broker. In Proceedings of CASCON '98, December 1998.
3. R. Bennett, K. Bryant, A. Sussman, R. Das, and J. Saltz. Jovian: A Framework for Optimizing Parallel I/O. In Proceedings of the Scalable Parallel Libraries Conference, pages 10-20. IEEE Computer Society Press, Oct. 1994.
4. M. D. Beynon, R. Ferreira, T. Kurc, A. Sussman, and J. Saltz. DataCutter: Middleware for Filtering Very Large Scientific Datasets on Archival Storage Systems. In Proceedings of the Eighth Goddard Conference on Mass Storage Systems and Technologies, March 2000.
5. R. Bordawekar, J. M. del Rosario, and A. Choudhary. Design and Evaluation of Primitives for Parallel I/O. In Proceedings of Supercomputing '93, pages 452-461, November 1993.
6. P. F. Corbett and D. G. Feitelson. The Vesta parallel file system. ACM Transactions on Computer Systems, 14(3):225-264, August 1996.
7. R. Das, M. Uysal, J. Saltz, and Y.-S. Hwang. Communication optimizations for irregular scientific computations on distributed memory architectures. Journal of Parallel and Distributed Computing, 22(3):462-479, September 1994.
8. J. M. del Rosario and A. Choudhary. High performance I/O for parallel computers: Problems and prospects. IEEE Computer, 27(3):59-68, March 1994.
9. L. Freitag, M. Jones, and P. Plassmann. The Scalability of Mesh Improvement Algorithms. IMA Volumes in Mathematics and Its Applications, 105:185-212, May 1998.
10. W. Gropp, E. Lusk, and R. Thakur. Using MPI-2: Advanced Features of the Message-Passing Interface. MIT Press, Cambridge, MA, 1999.
11. R. V. Hanxleden, K. Kennedy, and J. Saltz. Value-Based Distributions and Alignments in Fortran D. Journal of Programming Languages - Special Issue on Compiling and Run-Time Issues for Distributed Address Space Machines, May 1994.
12. High Performance Fortran Forum. High Performance Fortran Language Specification, Version 1.0. Technical Report Version 1.0, Rice University Houston Texas, May 1993.
13. M. Holton and R. Das. XFS: A Next Generation Journalled 64-Bit Filesystem With Guaranteed Rate I/O. Technical report, SGI, Inc, 1994.
14. J. Huber, C. L. Elford, D. A. Reed, A. A. Chien, and D. S. Blumenthal. PPFS: A High Performance Portable Parallel File System. In Proceedings of the 9th ACM International Conference on Supercomputing, pages 385-394. ACM Press, July 1995.
15. G. Karypis and V. Kumar. A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs. Journal on Scientific Computing, 1997.
16. D. Kotz. Disk-directed I/O for MIMD Multiprocessors. ACM Transactions on Computer Systems, 15(1):41-74, February 1997.
17. T. Kurc, C. Chang, R. Ferreira, A. Sussman, and J. Saltz. Querying Very Large Multi-dimensional Datasets in ADR. In Proceedings of SC99: High Performance Networking and Computing, November 1999.
18. T. M. Madhyastha and D. A. Reed. Intelligent, Adaptive File System Policy Selection. In Proceedings of the Sixth Symposium on the Frontiers of Massively Parallel Computation, pages 172-179. IEEE Computer Society Press, October 1996.
19. Message Passing Interface Forum. MPI-2: Extensions to the Message-Passing Interface, July 1997. http://www.mpi-forum.org/docs/docs.html.
20. MySQL Reference Manual. http://www.mysql.com, 1999. Version 3.23.10-alpha.
21. National Center for Supercomputing Applications, University of Illinois. NCSA HDF Reference Manual. Version3.3, February 1994.
22. N. Nieuwejaar and D. Kotz. The Galley Parallel File System. Parallel Computing, 23(4):447-476, June 1997.
23. J. No, R. Thakur, and A. Choudhary. Integrating Parallel File I/O and Database Support for High-Performance Scientific Data Management. In Proc. of SC2000: High Performance Networking and Computing, November 2000.
24. R. Ponnusamy, Y.-S. Hwang, R. Das, J. Saltz, A. Choudhary, and G. Fox. Supporting irregular distributions in FORTRAN 90D/HPF compliers. Technical report, University of Maryland, Syracuse University, Spring 1995.
25. J. T. Pool. Preliminary survey of I/O intensive applications. Technical Report CCSF-38, Scalable I/O Initiative, Caltech Concurrent Supercomputing Facilities, Caltech, 1994.
26. K. Schloegel, G. Karypis, and V. Kumar. Graph Partitioning for High Performance Scientific Simulations. 2000.
27. K. E. Seamons, Y. Chen, P. Jones, J. Jozwiak, and M. Winslett. Server-Directed Collective I/O in Panda. In Proceedings of Supercomputing '95. ACM Press, December 1995.
28. A. Shoshani, L. M. Bernardo, H. Nordberg, D. Rotem, and A. Sim. Storage Management for High Energy Physics Applications. In Proceedings of Computing in High Energy Physics (CHEP '98), 1998.
29. A. Shoshani, L. M. Bernardo, H. Nordberg, D. Rotem, and A. Sim. Multidimensional Indexing and Query Coordination for Tertiary Storage Management. In Proc. of SSDBM'99, pages 214-225, July 1999.
30. A. Sweeney, D. Doucette, W. Hu, C. Anderson, M. Nishimoto, and G. Peck. Scalability in the XFS File System. In Proc. of USENIX 1996 Annual Technical Conference, San Diego, CA, January 1996.
31. R. Thakur and A. Choudhary. An Extended Two-Phase Method for Accessing Sections of Out-of-Core Arrays. Scientific Programming, 5(4):301-317, Winter 1996.
32. R. Thakur, W. Gropp, and E. Lusk. A Case for Using MPI's Derived Datatypes to Improve I/O Performance. In Proceedings of SC98: High Performance Networking and Computing, November 1998.
33. Unidata Program Center, University Corporation for Atmospheric Research. netCDF User's Guide. Version 2.0, October 1991.