Scalable I/O and analytics

Journal of Physics: Conference Series

Volumn 180, Issue 1, 2009, Pages

  Choudhary, Alok ^a   Liao, Wei Keng ^a   Gao, Kui ^a   Nisar, Arifa ^a   Ross, Robert ^b   Thakur, Rajeev ^b   Latham, Robert ^b  

^a NORTHWESTERN UNIVERSITY   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MIDDLEWARE;

DATA ANALYTICS; DATA INTENSIVE; HIGH PERFORMANCE COMPUTING SYSTEMS; MODEL DEPENDENCIES; RESEARCH AND DEVELOPMENT; RUNTIME SYSTEMS; SCALABLE I/O; STORAGE SYSTEMS;

DIGITAL STORAGE;

EID: 77954066066     PISSN: 17426588     EISSN: 17426596     Source Type: Conference Proceeding    
DOI: 10.1088/1742-6596/180/1/012048     Document Type: Conference Paper

References (30)

1. Committee 2008 National Research Council Report (National Academies Press: Washington, DC)
2. netCDF Network Common Data Form The UniData program center, University Corporation for Atmospheric Research http://www.unidata.ucar.edu/software/ netcdf/
3. Li J, Liao W, Choudhary A, Ross R, Thakur R, Gropp W, Latham R, Siegel A, Gallagher B and Zingale M 2003 Parallel netCDF: A Scientific High-Performance I/O Interface the Supercomputing Conf.
4. Message Passing Interface Forum 1997 MPI-2: Extensions to the Message Passing Interface http://www.mpi-forum.org/docs/docs.html
5. Carns P, Ligon W, Ross R and Thakur R 2000 PVFS: A Parallel File System for Linux Clusters the Third Ann. Linux Showcase and Conf. p 317-327
6. Ching A, Choudhary A, Coloma K, Liao W, Ross R and Gropp W 2003 Noncontiguous I/O Accesses Through MPI-IO IEEE/ACM International Symposium on Cluster Computing and the Grid
7. Ma X, Winslett M, Lee J and Yu S 2003 Improving MPI-IO Output Performance with Active Buffering Plus Threads the International Parallel and Distributed Processing Symposium
8. Coloma K, Choudhary A, Liao W, Lee W, Russell E and Pundit N 2004 Scalable High-level Caching for Parallel I/O the International Parallel and Distributed Processing Symposium
9. Coloma K, Choudhary A, Liao W, Lee W and Tideman S 2005 DAChe: Direct Access Cache System for Parallel I/O the 20th Int. Supercomputer Conf.
10. Coloma K, Ching A, Choudhary A, Liao W, Ross R, Thakur R and Ward L 2006 A new flexible MPI collective I/O implementation the IEEE Conf. on Cluster Computing
11. Liao W, Ching A, Coloma K, Choudhary A and Ward L 2007 An Implementation and Evaluation of Client-Side File Caching for MPI-IO the International Parallel and Distributed Processing Symposium
12. Ross R, Latham R, Gropp W, Thakur R and Toonen B 2005 Implementing MPI-IO Atomic Mode Without File System Support the 5th IEEE/ACM International Symposium on Cluster Computing and the Grid
13. IEEE/ANSI Std 10031 1996 Portable Operating System Interface (POSIX)-Part 1: System Application Program Interface (API) [C Language]
14. Yu H, Sahoo R, Howson C, Almasi G, Castanos J, Gupta M, Moreira J, Parker J, Engelsiepen T, Ross R, Thakur R, Latham R and Gropp W D 2006 High Performance File I/O for the BlueGene/L Supercomputer the 12th International Symposium on High-Performance Computer Architecture (HPCA-12)
15. Almasi G, Archer C, Castanos J, Erway C, Heidelberger P, Martorell X, Moreira J, Pinnow K, Ratterman J, Smeds N, Steinmacher-burow B, Gropp W and Toonen B 2004 Implementing MPI on the BlueGene/L Supercomputer Euro-Par Conf. on Parallel Processing
16. Loft R D 2005 Blue Gene/L Experiences at NCAR IBM System Scientific User Group meeting (SCICOMP11)
17. Nisar A, Liao W and Choudhary A 2008 Scaling Parallel I/O Performance Through I/O Delegate and Caching System Int. Conf. for High Performance Computing, Networking, Storage and Analysis
18. Thakur R, Gropp W and Lusk E 1997 Users Guide for ROMIO: A High-Performance, Portable MPI-IO Implementation Technical Report ANL/MCS-TM-234, Mathematics and Computer Science Division, Argonne National Laboratory
19. HDF Group Hierarchical Data Format, Version 5 The National Center for Supercomputing Applications http://hdf.ncsa.uiuc.edu/HDF5
20. del Rosario J, Brodawekar R and Choudhary A 1993 Improved Parallel I/O via a Two-Phase Run-time Access Strategy the Workshop on I/O in Parallel Computer Systems at IPPS '93 p 56-70
21. Kotz D 1997 ACM Trans. Comput. Syst. 15 41-74
22. Liao W and Choudhary A 2008 Dynamically Adapting File Domain Partitioning Methods for Collective I/O Based on Underlying Parallel File System Locking Protocols International Conference for High Performance Computing, Networking, Storage and Analysis
23. Hertel E, Bell R, Elrick M, Farnsworth A, Kerley G, Mcglaun J, Petney S, Silling S, Taylor P and Yarrington L 1993 CTH: A Software Family for Multi-Dimensional Shock Physics Analysis the 19th International Symposium on Shock Waves p 377-382
24. McGlaun J, Thompson S and Elrick M 1989 CTH: A three-dimensional shock wave physics code the Hypervelocity Impact Symposium p 12-14
25. Klundt R, Weston M and Ward L 2008 I/O Tracing on Catamount Tech. Rep. SAND2008-3684 Sandia National Laboratories Albuquerque, New Mexico
26. Riedel E, Gibson G and Faloutsos C 1998 Active storage for large-scale data mining and multimedia Int. Conf. on Very Large Data Bases (San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.) p 62-73 ISBN 1-55860-566-5
27. Keeton K, Patterson D and Hellerstein J 1998 SIGMOD Record 27 42-52
28. Acharya A, Uysal M and Saltz J 1998 Active disks: programming model, algorithms and evaluation Int. Conf. on Architectural support for programming languages and operating systems (New York, NY, USA: ACM) p 81-91 ISBN 1-58113-107-0
29. Lim H, Kapoor V, Wighe C and Du D 2001 Mass Storage Syst., IEEE Symposium on 0 101 ISSN 1051-9173
30. Felix E, Fox K, Regimbal K and Nieplocha J 2006 Active storage processing in a parallel file system Int. Conf. on Linux Clusters: The HPC Revolution