H5hut: A high-performance I/O library for particle-based simulations

2010 IEEE International Conference on Cluster Computing Workshops and Posters, Cluster Workshops 2010

Volumn , Issue , 2010, Pages

  Howison, Mark ^a   Adelmann, Andreas ^b   Bethel, E Wes ^a   Gsell, Achim ^b   Oswald, Benedikt ^b   Prabhat, ^a  

^a LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

^b PAUL SCHERRER INSTITUTE   (Switzerland)

Author keywords

Parallel I O

Indexed keywords

DATA MANAGEMENT; DATA MODELS; FIELD-BASED DATA; HIGH PERFORMANCE COMPUTING SYSTEMS; PARALLEL I/O; PARTICLE-BASED SIMULATION; POST PROCESSING; TIME STEP; VISUALIZATION TOOLS;

COMPUTER SIMULATION; DATA VISUALIZATION; VISUALIZATION;

CLUSTER COMPUTING;

EID: 78649842175     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTERWKSP.2010.5613098     Document Type: Conference Paper

References (22)

1. K. Wu, E. Otoo, and A. Shoshani, "Optimizing bitmap indices with efficient compression," ACM Transactions on Database Systems, vol. 31, pp. 1-38, 2006.
2. The HDF Group, "Hierarchical data format version 5," 2000-2010, http: //www.hdfgroup.org/HDF5.
3. Unidata, "netCDF (network Common Data Form)," http://www.unidata.ucar.edu/software/netcdf.
4. J. Li, W.-k. Liao, A. Choudhary, R. Ross, R. Thakur, W. Gropp, R. Latham, A. Siegel, B. Gallagher, and M. Zingale, "Parallel netCDF: A high-performance scientific I/O interface," in SC '03: Proceedings of the 2003 ACM/IEEE conference on Supercomputing, 2003, p. 39.
5. K. Schuchardt, "Data services for the Global Cloud Resolving Model (GCRM)," https://svn.pnl.gov/gcrm.
6. W. Benger, "The Fiber Bundle HDF5 Library," http://www.fiberbundle.net/.
7. W. Benger, A. Hamilton, M. Folk, Q. Koziol, S. Su, E. Schnetter, M. Ritter, and G. Ritter, "Using geometric algebra for navigation in Riemannian and hard disc space," in Proceedings of Computer Graphics, Computer Vision and Mathematics, Plzen, Czech Republic, 2008, pp. 80-92.
8. Lawrence Livermore National Laboratory, "Silo: A mesh and field I/O library and scientific database," https://wci.llnl.gov/codes/silo.
9. J. Bent, G. Gibson, G. Grider, B. McClelland, P. Nowoczynski, J. Nunez, M. Polte, and M. Wingate, "PLFS: a checkpoint filesystem for parallel applications," in SC '09: Proceedings of the 2009 ACM/IEEE Conference on Supercomputing, Portland, Oregon, 2009.
10. J. Lofstead, F. Zheng, S. Klasky, and K. Schwan, "Adaptable, metadata rich IO methods for portable high performance IO," in IEEE International Parallel and Distributed Processing Symposium (IPDPS), Rome, Italy, 2009.
11. T. Schietinger, "H5PartROOT: a ROOT based graphical user interface for H5Part," 2006-2010, http://amas.web.psi.ch/tools/H5PartROOT/index.html.
12. Lawrence Livermore National Laboratory, "Visit Visualization Tool,"https://wci.llnl.gov/codes/visit.
13. A. Adelmann et al., "The OPAL (Object Oriented Parallel Accelerator Library) Framework," Paul Scherrer Institut, Tech. Rep. PSI-PR-08-02, 2008-2010.
14. A. Adelmann, "The IPPL (Independent Parallel Particle Layer) Framework ," Paul Scherrer Institut, Tech. Rep. PSI-PR-09-05, 2009.
15. J. J. Yang, A. Adelmann, M. Humbel, M. Seidel, and T. J. Zhang, "Beam dynamics in high intensity cyclotrons including neighboring bunch effects: Model, implementation, and application," Phys. Rev. ST Accel. Beams, vol. 13, no. 6, p. 064201, Jun 2010.
16. A. Adelmann, P. Arbenz, and Y. Ineichen, "A fast parallel Poisson solver on irregular domains applied to beam dynamics simulations," Journal of Computational Physics, vol. 229, no. 12, pp. 4554-4566, 2010.
17. K. Heitmann, P. M. Ricker, M. S. Warren, and S. Habib, "Robustness of cosmological simulations i: Large scale structure," Astrophys. J. Suppl. 160, 28, 2005, [arXiv:astro-ph/0411795].
18. O. Rübel, Prabhat, K. Wu, H. Childs, J. Meredith, C. G. R. Geddes, E. Cormier-Michel, S. Ahern, G. H. weber, P. Messmer, H. Hagen, B. Hamann, and E. W. Bethel, "High performance multivariate visual data exploration for extemely large data," in SC '08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing, Austin, Texas, 2008, LBNL-716E.
19. L. Gosink, J. Shalf, K. Stockinger, K. Wu, and E. W. Bethel, "HDF5- FastQuery: Accelerating complex queries on HDF datasets using fast bitmap indices," in Proceedings of the 18th International Conference on Scientific and Statistical Database Management, July 2006, LBNL-59602.
20. R. Thakur, W. Gropp, and E. Lusk, "Optimizing noncontiguous accesses in MPI-IO," Parallel Computing, vol. 28, no. 1, pp. 83-105, 2002.
21. H. Shan, K. Antypas, and J. Shalf, "Characterizing and predicting the I/O performance of HPC applications using a parameterized synthetic benchmark," in SC '08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing, Austin, Texas, 2008.
22. W. Yu, J. S. Vetter, and S. Oral, "Performance characterization and optimization of parallel I/O on the Cray XT," in IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2008.