ISABELA-QA: Query-driven analytics with ISABELA-compressed extreme-scale scientific data

Proceedings of 2011 SC - International Conference for High Performance Computing, Networking, Storage and Analysis

Volumn , Issue , 2011, Pages

  Lakshminarasimhan, Sriram ^a,c   Jenkins, John ^a,c   Arkatkar, Isha ^a,c   Gong, Zhenhuan ^a   Kolla, Hemanth ^d   Ku, Seung Hoe ^b   Ethier, Stephane ^e   Chen, Jackie ^d   Chang, C S ^b   Klasky, Scott ^c   Latham, Robert ^f   Ross, Robert ^f   Samatova, Nagiza F ^a,c  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

^b NEW YORK UNIVERSITY   (United States)

^c OAK RIDGE NATIONAL LABORATORY   (United States)

^d SANDIA NATIONAL LABORATORIES   (United States)

^e PRINCETON PLASMA PHYSICS LABORATORY   (United States)

^f ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

Compression; Data reduction; Data intensive computing; High performance applications; Query driven analytics

Indexed keywords

COMPRESSION TECHNOLOGIES; DATA ANALYTICS; DATA STORAGE; DATA-INTENSIVE COMPUTING; DATABASE INDEXING; HIGH PERFORMANCE APPLICATIONS; HIGH-ACCURACY; IN-SITU; LIGHT WEIGHT; MULTI CORE; OUTPUT DATA; PARADIGM SHIFTS; PARALLEL QUERY PROCESSING; PROOF OF PRINCIPLES; QUERY-DRIVEN ANALYTICS; SCIENTIFIC DATA; SPATIAL REGIONS; SPATIO-TEMPORAL;

COMPACTION; COMPUTER SOFTWARE SELECTION AND EVALUATION; DATA COMPRESSION; DATA REDUCTION; IN SITU PROCESSING; INDEXING (MATERIALS WORKING); INDEXING (OF INFORMATION); INFORMATION MANAGEMENT; METADATA; OPTIMIZATION; QUERY PROCESSING; TECHNOLOGY;

SEARCH ENGINES;

EID: 83155160935     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2063384.2063425     Document Type: Conference Paper

References (25)

1. http://www.nvidia.com/object/cuda-whats-new.html. Retrieved 4/14/2011.
2. D. J. Abadi, S. R. Madden, and N. Hachem. Column-stores vs. row-stores: How different are they really? In In SIGMOD, 2008.
3. P. A. Boncz, M. L. Kersten, and S. Manegold. Breaking the memory wall in MonetDB. Commun. ACM, 51:77-85, December 2008.
4. C. D. Boor. A Practical Guide to Splines. New York, Springer-Verlag, 1978.
5. J. Chen, A. Choudhary, B. Supinski, M. DeVries, E. Hawkes, S. Klasky, W. Liao, K. Ma, J. Mellor-Crummey, N. Podhorszki, R. Sankaran, S. Shende, and C. Yoo. Terascale direct numerical simulations of turbulent combustion using S3D. Computational Science & Discovery, 2(1):015001, 2009.
6. P. Cudré-Mauroux, H. Kimura, K. Lim, J. Rogers, R. Simakov, E. Soroush, P. Velikhov, D. L. Wang, M. Balazinska, and J. Becla. A demonstration of SciDB: A science-oriented DBMS. Proceedings of the VLDB Endowment, 2(2):1534-1537, 2009.
7. R. Dagum, L. and Menon. OpenMP: an industry standard API for shared-memory programming. IEEE Computational Science & Engineering, 5(1):46 - 55, 1998.
8. B. Fryxell, K. Olson, P. Ricker, F. X. Timmes, M. Zingale, D. Q. Lamb, P. MacNeice, R. Rosner, J. W. Truran, and H. Tufo. FLASH: An adaptive mesh hydrodynamics code for modeling astrophysical thermonuclear flashes. The Astrophysical Journal Supplement Series, 131:273-334, Nov. 2000. (Pubitemid 33209104)
9. G. Antoshenkov. Byte-aligned bitmap compression. In DCC, page 476. Published by the IEEE Computer Society, 1995.
10. G. Ostrouchov and N.F. Samatova. High end computing for full-context analysis and visualization: when the experiment is done. In High End Computing Revitalization Task Force (HECRTF), June 2003.
11. D. Johnson, S. Krishnan, J. Chhugani, S. Kumar, and S. Venkatasubramanian. Compressing large Boolean matrices using reordering techniques. In Proceedings of the Thirtieth international conference on Very large data bases-Volume 30, pages 13-23. VLDB Endowment, 2004.
12. K. Wu, E. Otoo and A. Shoshani. On the performance of bitmap indices for high cardinality attributes. In Proceedings of the Thirtieth international conference on Very large data bases - Volume 30, VLDB'04, pages 24-35. VLDB Endowment, 2004.
13. S. Lakshminarasimhan, N. Shah, S. Ethier, S. Klasky, R. Latham, R. Ross, and N. F. Samatova. Compressing the incompressible with ISABELA: In-situ reduction of spatio-temporal data. In 17th International European Conference on Parallel and Distributed Computing (Euro-Par 2011), Bordeaux, France, 8 2011.
14. M. Stabno, and R. Wrembel. RLH: Bitmap compression technique based on run-length and Huffman encoding. Information Systems, 34(4-5):400-414, 2009.
15. E. O'Neil, P. O'Neil, and K. Wu. Bitmap index design choices and their performance implications. In Proceedings of the 11th International Database Engineering and Applications Symposium, pages 72-84, Washington, DC, USA, 2007. IEEE Computer Society.
16. P.G. Brown. Overview of SciDB: Large scale array storage, processing and analysis. In Proceedings of the 2010 International Conference on Management of Data, pages 963-968. ACM, 2010.
17. A. Pinar, T. Tao, and N. Ferhatosmanoglu. Compressing bitmap indices by data reorganization. In Proceedings. 21st International Conference on Data Engineering, 2005. ICDE 2005., pages 310 - 321, April 2005. (Pubitemid 41731143)
18. R.H. Güting. An Introduction to Spatial Database Systems. The VLDB Journal, 3(4):357-399, 1994.
19. O. Rubel, C. G. R. Geddes, E. Cormier-Michel, K. Wu, Prabhat, G. H. Weber, D. M. Ushizima, P. Messmer, H. Hagen, B. Hamann, and W. Bethel. Automatic beam path analysis of laser wakefield particle acceleration data. Computational Science & Discovery, 2(1):015005, 2009.
20. S. Ku, C.S. Chang, and P.H. Diamond. Full-f gyrokinetic particle simulation of centrally heated global ITG turbulence from magnetic axis to edge pedestal top in a realistic tokamak geometry. Nuclear Fusion, 49(11):115021, 2009.
21. K. Stockinger, J. Shalf, W. Bethel, and K. Wu. DEX: Increasing the capability of scientific data analysis pipelines by using efficient bitmap indices to accelerate scientific visualization. In International Conference on Scientific and Statistical Database Management (SSDBM). IEEE Computer Society Press, 2005.
22. W. X. Wang and et al. Gyro-kinetic simulation of global turbulent transport properties in Tokamak experiments. Physics of Plasmas, 13(9):092505, 2006.
23. K. Wu, S. Ahern, E. W. Bethel, J. Chen, H. Childs, E. Cormier-Michel, C. Geddes, J. Gu, H. Hagen, B. Hamann, W. Koegler, J. Lauret, J. Meredith, P. Messmer, E. Otoo, V. Perevoztchikov, A. Poskanzer, Prabhat, O. Rubel, A. Shoshani, A. Sim, K. Stockinger, G. Weber, and W.-M. Zhang. FastBit: interactively searching massive data. Journal of Physics: Conference Series, 180(1):012053, 2009.
24. K. Wu, E. J. Otoo, and A. Shoshani. Compressing bitmap indexes for faster search operations. In SSDBM, pages 99-108, 2002.
25. K. Wu, R. R. Sinha, C. Jones, S. Ethier, S. Klasky, K.-L. Ma, A. Shoshani, and M. Winslett. Finding regions of interest on toroidal meshes. Computational Science and Discovery, 4(1):015003, 2011.