Scientific data exchange: A schema for HDF5-based storage of raw and analyzed data

Journal of Synchrotron Radiation

Volumn 21, Issue 6, 2014, Pages 1224-1230

  De Carlo, Francesco ^a   Gürsoy, Doa ^a   Marone, Federica ^b   Rivers, Mark ^c   Parkinson, Dilworth Y ^d   Khan, Faisal ^a   Schwarz, Nicholas ^a   Vine, David J ^a   Vogt, Stefan ^a   Gleber, Sophie Charlotte ^a   Narayanan, Suresh ^a   Newville, Matt ^c   Lanzirotti, Tony ^c   Sun, Yue ^e   Hong, Young Pyo ^e   Jacobsen, Chris ^a,e  

^a ARGONNE NATIONAL LABORATORY   (United States)

^b PAUL SCHERRER INSTITUTE   (Switzerland)

^c ARGONNE NATIONAL LABORATORY   (United States)

^d LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

^e NORTHWESTERN UNIVERSITY   (United States)

Author keywords

data storage; HDF5; provenance

Indexed keywords

ELECTRONIC DATA INTERCHANGE; FLUORESCENCE; FLUORESCENCE SPECTROSCOPY; OPTICAL TOMOGRAPHY; PHOTON CORRELATION SPECTROSCOPY; TOMOGRAPHY;

DATA ANALYSIS TOOL; DATA EXCHANGE MODELS; DATA STORAGE; FLUORESCENCE TOMOGRAPHY; HDF5; PROVENANCE; SCIENTIFIC DATA; X-RAY TECHNIQUES;

DIGITAL STORAGE;

EID: 84923054241     PISSN: 09090495     EISSN: 16005775     Source Type: Journal    
DOI: 10.1107/S160057751401604X     Document Type: Article

References (28)

1. ALS (2014). The SPOT Suite Portal, http://spot.nersc.gov/.
2. Argonne (2014). The Scientific Data Exchange, http://www.aps.anl.gov/DataExchange/.
3. Bethel, E.W., Leinweber, D., Rübel, O. & Wu, K. (2011). Proceedings of the Fourth Workshop on High Performance Computational Finance (WHPCF 11), pp. 23-30. New York: ACM. http://doi.acm.org/10.1145/2088256.2088267.
4. Bible (undated). The Bible, 11, 1-9.
5. Donath, T., Rissi, M. & Billich, H. (2013). Synchrotron Radiat. News, 26, 34-35.
6. Dougherty, M. T., Folk, M. J., Zadok, E., Bernstein, H. J., Bernstein, F. C., Eliceiri, K.W., Benger, W. & Best, C. (2009). Commun. ACM, 52, 42-47.
7. Eliceiri, K. W., Berthold, M. R., Goldberg, I. G., Ibañez, L., Manjunath, B. S., Martone, M. E., Murphy, R. F., Peng, H., Plant, A. L., Roysam, B., Stuurmann, N., Swedlow, J. R., Tomancak, P. & Carpenter, A. E. (2012). Nat. Methods, 9, 697-710.
8. GeoTIFF (2013). GeoTIFF, http://trac.osgeo.org/geotiff/.
9. Gürsoy, D., De Carlo, F., Xiao, X. & Jacobsen, C. (2014). J. Synchrotron Rad. 21, 1188-1193.
10. Kanitpanyacharoen, W., Parkinson, D. Y., De Carlo, F., Marone, F., Stampanoni, M., Mokso, R., MacDowell, A. & Wenk, H.-R. (2013). J. Synchrotron Rad. 20, 172-180.
11. Khan, F., Hammonds, J., Narayanan, S., Sandy, A. & Schwarz, N. (2013). Proceedings of the 14th International Conference on Accelerator and Large Experimental Physics Control Systems (ICALEPCS2013), 6-11 October 2013, San Francisco, CA, USA.
12. Maia, F. R. N. C. (2012). Nat. Methods, 9, 854-855.
13. Medjoubi, K., Leclercq, N., Langlois, F., Buteau, A., Le, S., Poirier, S., Mercere, P., Sforna, M. C., Kewish, C. M. & Somogyi, A. (2013). J. Synchrotron Rad. 20, 293-299.
14. Mokso, R., Marone, F. & Stampanoni, M. (2010). AIP Conf. Proc. 1234, 87-90.
15. NeXus (2013). NeXus, http://www.nexusformat.org/.
16. OME-TIFF (2013). The OME-TIFF Format, http://www.openmicro scopy.org/site/support/ome-model/ome-Tiff/.
17. PANdata (2013). NeXus/HDF5 developments, http://pan-Data.eu/NeXus/.
18. PDB (2013). Protein Data Bank Contents Guide: Atomic Coordinate Entry Format Description, http://www.wwpdb.org/documentation/format33/v3.3.html.
19. PNI-HDR, ( 2013 Pni-hdr http://www.pni-hdri.de
20. Ravel, B., Hester, J. R., Sole, V. A. & Newville, M. (2012). J. Synchrotron Rad. 19, 869-874.
21. Rivers, M. (2010). AIP Conf. Proc. 19, 51-54.
22. Schwarz, N., De Carlo, F., Glowacki, A., Hammonds, J., Khan, F. & Yue, K. (2013). Proceedings of the 14th International Conference on Accelerator and Large Experimental Physics Control Systems (ICALEPCS2013), 6-11 October 2013, San Francisco, CA, USA.
23. Sole, V. A., Papillon, E., Cotte, M., Walter, P. & Susini, J. (2007). Spectrochim. Acta B, 62, 63-68.
24. Steinbrener, J., Nelson, J., Huang, X., Marchesini, S., Shapiro, D., Turner, J. J. & Jacobsen, C. (2010). Opt. Express, 18, 18598-18614.
25. The HDF Group (2013). HDF5, http://www.hdfgroup.org/HDF5/.
26. Tischler, J. Z. (1984). Nucl. Instrum. Methods Phys. Res. 222, 339-340.
27. UCAR (2013). UDUNITS, http://www.unidata.ucar.edu/software/udunits/.
28. Vogt, S. (2003). J. Phys. IV, 104, 635-638.