Computational steering and parallel online monitoring using RMA through the HDF5 DSM virtual file driver

Procedia Computer Science

Volumn 4, Issue , 2011, Pages 479-488

  Soumagne, Jerome ^a,b   Biddiscombe, John ^a  

^a Centro Svizzero Di Calcolo Scientifico   (Switzerland)

^b INRIA   (France)

Author keywords

Computational steering; HDF5; One sided communications; Parallel virtual file driver

Indexed keywords

COMPUTATIONAL STEERING; DATA SETS; FILE CONTENTS; FILE SYSTEMS; HDF5; IN-SITU; ONE-SIDED COMMUNICATIONS; ONLINE MONITORING; PARALLEL APPLICATION; PARALLEL COUPLING; PARALLEL VIRTUAL FILE DRIVER; PARALLEL VISUALIZATION; POST PROCESS; POST PROCESSING; POST PROCESSING SOFTWARE; REMOTE MEMORY ACCESS; SIMULATION CODE;

APPLICATION PROGRAMMING INTERFACES (API); COMPUTER SOFTWARE; ELECTRONIC DOCUMENT EXCHANGE; ONLINE SYSTEMS; PARALLEL PROCESSING SYSTEMS; VISUALIZATION;

AUTOMOBILE STEERING EQUIPMENT;

EID: 79958282206     PISSN: None     EISSN: 18770509     Source Type: Conference Proceeding    
DOI: 10.1016/j.procs.2011.04.050     Document Type: Conference Paper

References (15)

1. D. Lorenz, P. Buchholz, C. Uebing, W. Walkowiak, R. Wismüller, Steering of sequential jobs with a distributed shared memory based model for online steering, Future Gener. Comput. Syst. 26 (2010) 155-161. doi:10.1016/j.future.2009.05.016.
2. The HDF group, Hierarchical Data Format Version 5 (2000-2011). URL http://www.hdfgroup.org/HDF5.
3. J. Soumagne, J. Biddiscombe, J. Clarke, An HDF5 MPI Virtual File Driver for Parallel In-situ Post-processing, in: R. Keller, E. Gabriel, M. Resch, J. Dongarra (Eds.), Recent Advances in the Message Passing Interface, Vol. 6305 of Lecture Notes in Computer Science, Springer Berlin/Heidelberg, 2010, pp. 62-71. doi:10.1007/978-3-642-15646-5 7.
4. M. Howison, Q. Koziol, D. Knaak, J. Mainzer, J. Shalf, Tuning HDF5 for Lustre File Systems, in: Workshop on Interfaces and Abstractions for Scientific Data Storage, 2010.
5. J. Liu, J.Wu, D. Panda, High Performance RDMA-Based MPI Implementation over InfiniBand, International Journal of Parallel Programming 32 (2004) 167-198. doi:10.1023/B:IJPP.0000029272.69895.c1.
6. W. Gropp, R. Thakur, Revealing the Performance of MPI RMA Implementations, in: F. Cappello, T. Herault, J. Dongarra (Eds.), Recent Advances in Parallel Virtual Machine and Message Passing Interface, Vol. 4757 of Lecture Notes in Computer Science, Springer Berlin/Heidelberg, 2007, pp. 272-280. doi:10.1007/978-3-540-75416-9 38.
7. A. Henderson, ParaView Guide, A Parallel Visualization Application, Kitware Inc., 2005. URL http://www.paraview.org.
8. A. Cedilnik, B. Geveci, K. M. J. Ahrens, J. Favre, Remote Large Data Visualization in the Paraview Framework, in: B. Raffin, A. Heirich, L. P. Santos (Eds.), Eurographics Symposium on Parallel Graphics and Visualization, Eurographics Association, Braga, Portugal, 2006, pp. 163-170. doi:10.2312/EGPGV/EGPGV06/163-170.
9. J. Soumagne, J. Biddiscombe, J. Clarke, In-situ Visualization and Analysis of SPH Data using a ParaView Plugin and a Distributed Shared Memory Interface, in: B. Rogers (Ed.), 5th International SPHERIC Workshop, 2010, pp. 186-193.
10. J. A. Clarke, E. R. Mark, Enhancements to the eXtensible Data Model and Format (XDMF), in: HPCMP-UGC'07: Proceedings of the 2007 DoD High Performance Computing Modernization Program Users Group Conference, IEEE Computer Society, Washington, DC, USA, 2007, pp. 322-327. doi:10.1109/HPCMP-UGC.2007.30.
11. V. Springel, The cosmological simulation code GADGET-2, Monthly Notices of the Royal Astronomical Society 364 (2005) 1105-1134. doi:10.1111/j.1365-2966. 2005.09655.x. (Pubitemid 41815492)
12. N. Richart, A. Esnard, O. Coulaud, Toward a Computational Steering Environment for Legacy Coupled Simulations, in: Parallel and Distributed Computing, 2007. ISPDC'07. Sixth International Symposium on, 2007, p. 43. doi:10.1109/ISPDC.2007.55. (Pubitemid 47586986)
13. H. Childs, E. S. Brugger, K. S. Bonnell, J. S. Meredith, M. Miller, B. J. Whitlock, N. Max, A Contract-Based System for Large Data Visualization, in: Proceedings of IEEE Visualization 2005, 2005, pp. 190-198.
14. K. Moreland, N. Fabian, P. Marion, B. Geveci, Visualization on Supercomputing Platform Level II ASC Milestone (3537-1B) Results from Sandia, Tech. rep., Sandia National Laboratories, SAND 2010-6118 (September 2010).
15. P. Maruzewski, G. Oger, D. L. Touze, J. Biddiscombe, High performance computing 3D SPH model: Sphere impacting the water free surface, in: Proceedings of the 3rd SPHERIC, 2008.