Data redistribution using one-sided transfers to in-memory HDF5 files

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6960 LNCS, Issue , 2011, Pages 198-207

  Soumagne, Jerome ^a,b   Biddiscombe, John ^a   Esnard, Aurélien ^b  

^a Centro Svizzero Di Calcolo Scientifico   (Switzerland)

^b INRIA   (France)

Author keywords

Data Redistribution; Distributed Shared Memory; HDF5; One sided Communication

Indexed keywords

BLOCK SIZES; DATA REDISTRIBUTION; DATA SETS; DISTRIBUTED SHARED MEMORY; FILE FORMATS; HDF5; PERFORMANCE IMPROVEMENTS; SIMULATION CODE; ONE SIDED COMMUNICATION;

METADATA; MEMORY ARCHITECTURE;

MESSAGE PASSING;

EID: 80053000908     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-24449-0_23     Document Type: Conference Paper

References (13)

1. MPICH2, http://www.mcs.anl.gov/research/projects/mpich2
2. MVAPICH: MPI over InfiniBand, 10GigE/iWARP and RoCE, http://mvapich.cse. ohio-state.edu/index.shtml
3. Alverson, R., Roweth, D., Kaplan, L.: The Gemini System Interconnect. In: Symposium on High-Performance Interconnects, pp. 83-87 (2010)
4. Bruggencate, M., Roweth, D.: DMAPP - An API for One-sided Program Models on Baker Systems. In: Proceedings of Cray User Group (2010)
5. Gropp, W., Lusk, E., Thakur, R.: Using MPI-2: Advanced Features of the Message-Passing Interface. MIT Press, Cambridge (1999)
6. Howison, M., Koziol, Q., Knaak, D., Mainzer, J., Shalf, J.: Tuning HDF5 for Lustre File Systems. In: Proceedings of Workshop on Interfaces and Abstractions for Scientific Data Storage (2010), LBNL-4803E
7. Pritchard, H., Gorodetsky, I.: A uGNI-Based MPICH2 Nemesis Network Module for Cray XE Computer Systems. In: Proceedings of Cray User Group (2011)
8. Soumagne, J., Biddiscombe, J.: Computational Steering and Parallel Online Monitoring Using RMA through the HDF5 DSM Virtual File Driver. Procedia Computer Science 4, 479-488 (2011), ICCS 2011
9. Soumagne, J., Biddiscombe, J., Clarke, J.: An HDF5 MPI Virtual File Driver for Parallel In-situ Post-processing. In: Keller, R., Gabriel, E., Resch, M., Dongarra, J. (eds.) EuroMPI 2010. LNCS, vol. 6305, pp. 62-71. Springer, Heidelberg (2010)
10. Thakur, R., Gropp, W., Lusk, E.: Optimizing noncontiguous accesses in MPI-IO. Parallel Computing 28(1), 83-105 (2002) (Pubitemid 33143370)
11. The HDF Group: Hierarchical Data Format Version 5 (2000-2011), http://www.hdfgroup.org/HDF5
12. UPC Consortium: UPC Language Specifications, v1.2. Tech report (2005), http://upc.gwu.edu/docs/upc-specs-1.2.pdf
13. Walker, D.W., Otto, S.W.: Redistribution of Block-Cyclic Data Distributions Using MPI. Concurrency - Practice and Experience 8(9), 707-728 (1996) (Pubitemid 126662884)