Increasing the efficiency of data storage and analysis using indexed compression

e-Science 2009 - 5th IEEE International Conference on e-Science

Volumn , Issue , 2009, Pages 66-71

  Beagley, Nathaniel ^a   Scherrer, Chad ^a   Shi, Yan ^a   Clowers, Brian H ^a   Danielson, William F ^a   Shah, Anuj R ^a  

^a PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPRESSION ALGORITHMS; COMPUTATIONAL TIME; DATA ACCESS; DATA ANALYSIS; DATA SETS; DATA STORAGE; HIGH-THROUGHPUT; MASSIVE DATA SETS; PROTEOMICS;

COMPUTATIONAL EFFICIENCY; DATA HANDLING; EXTRACTION; MASS SPECTROMETRY; MOLECULAR BIOLOGY; PROTEINS;

DATA COMPRESSION;

EID: 77949799730     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/e-Science.2009.18     Document Type: Conference Paper

References (20)

1. A. Panday and M. Mann, "Proteomics to study genes and genomes", Nature 2000, 405(6788):837-846.
2. E.F. Petricoin, K.C. Zoon, E.C. Kohn, J.C. Barrett, and L.A. Liotta, "Clinical proteomics: Translating benchside promise into bedside reality", Nature Reviews Drug Discovery, 2002, 1(9): 683-695.
3. T. Liu, M.E. Belov, N. Jaitly, W.J. Qian, and R.D. Smith, "Accurate Mass Measurements in Proteomics", Chemical Reviews, 2007, 107:3621-3653.
4. L.N. Mueller, M.Y. Brusniak, D.R. Mani, and R. Aebersold, "An assessment of software solutions for the analysis of mass spectrometry based quantitative proteomics data", Journal of Proteome Research, 2008, 7(1):51-61.
5. AD Popitiya, et al., "DAnTE: a statistical tool for quantitative analysis of -omics data", Bioinformatics, 2008, 24(23):1556-1558.
6. N. Jaitly, A. Mayampurath, K. Littlefield, J.N. Adkins, G.A. Anderson, and R.D. Smith, "Decon2LS: An open-source software package for automated processing and visualization of high resolution mass spectrometry", BMC Bioinformatics, 2009, 10(87)
7. A.R. Shah, V.M. Markowitz, and C.S. Oehman "Highthroughput computation of pairwise sequence similarities for multiple genome comparison using ScalaBLAST." IEEE Life Science Systems and Applications Workshop, 2007:89-91.
8. B.H. Clowers, W.F. Siems, H.H. Hill, and S.M. Massick, "Hadamard Transform Ion Mobility Spectrometry", Anal. Chem., 2006, 78(1):44-51.
9. M Belov et al., "Multiplexed Ion Mobility Spectrometry - Orthogonal Time-of-Flight Mass Spectrometry". Anal.Chem. 2007, 79(6):2451-2462.
10. G. Graefe and L. Shapiro, "Data compression and database performance", Proc ACM/IEEE-CS Symp on Applied Computing, Kansas City, MO, 1991
11. L. Cao, P.B. Harrington, and C. Liu, "Two-dimensional nonlinear wavelet compression of Ion Mobility Spectra of chemical warfare agent simulants", Anal Chem, 2004, 76:2859-2868.
12. S.E. Reichenbach, A. Henderson, R. Lindquist, and Q. Tao, "Efficient encoding and rapid decoding for interactive visualization of large three-dimensional hyperspectral chemical images", Rapid Communications in Mass Spectrometry, 2009, 23:1229-1233.
13. D.J. Mackay, Information Theory, Inference, and Learning Algorithms, Cambridge University Press, Cambridge, UK, 2003
14. I.H. Witten, A. Moffat, and T.C. Bell, Managing Gigabytes: Compressing and Indexing Documents and Images, Academic Press, San Diego, CA, 1999
15. RLE algorithm: http://www.data-compression.info/Algorithms/RLE/index.htm
16. RLE algorithm: http://michael.dipperstein.com/rle/index.html
17. ZLIB algorithm: http://www.zlib.net/
18. LZF algorithm: http://oldhome.schmorp.de/marc/liblzf.html
19. LZF benchmark comparisons: http://h5py.alfven.org/lzf/
20. Indexed compression in HDF5: http://www.hdfgroup.org/HDF5/doc1.6/ Chunking.html