FastQuery: a parallel indexing system for scientific data

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2011, Pages 455-464

  Chou, Jerry ^a   Wu, Kesheng ^a   Prabhat, ^a  

^a LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA SETS; GENERIC MAPPING; GLOBAL CLIMATE MODEL; INDEXING SYSTEMS; INPUT AND OUTPUTS; MANY-CORE ARCHITECTURE; PARALLEL STRATEGIES; PARALLELIZATIONS; PERFORMANCE STUDY; QUERY TIME; RELATIONAL DATA MODELS; SCIENTIFIC DATA; USER DATA;

CLIMATE MODELS; CLUSTER COMPUTING; INDEXING (OF INFORMATION); MODELS; PARALLEL ARCHITECTURES;

INFORMATION MANAGEMENT;

EID: 80955140990     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTER.2011.86     Document Type: Conference Paper

References (30)

1. M. K. Aguilera, W. Golab, and M. A. Shah. A practical scalable distributed b-tree. Proc. VLDB Endow., 1:598-609, August 2008.
2. C. Ballinger and R. Fryer. Born to be parallel: Why parallel origins give teradata an enduring performance edge. IEEE Data Eng. Bull., 20(2):3-12, 1997.
3. J. Chou, K. Wu, O. Rübel, M. Howison, J. Qiang, Prabhat, B. Austin, E. W. Bethel, R. D. Ryne, and A. Shoshani. Parallel index and query for large scale data analysis. In SC11, 2011.
4. D. Comer. The ubiquitous B-tree. Computing Surveys, 11(2):121-137, 1979.
5. G. S. Davidson, K. W. Boyack, R. A. Zacharski, S. C. Helmerich, and J. R. Cowie. Data-centric computing with the netezza architecture. Technical Report SAND2006-3640, Sandia National Laboratory, 2006.
6. D. J. DeWitt, R. H. Katz, F. Olken, L. D. Shapiro, M. Stone-braker, and D. A. Wood. Implementation techniques for main memory database systems. In SIGMOD Conference, pages 1-8, 1984. http://doi.acm.org/10.1145/602259.602261.
7. D. J. DeWitt, M. Smith, and H. Boral. A single-user performance evaluation of the teradata database machine. In Proceedings of the 2nd International Workshop on High Performance Transaction Systems, pages 244-276, London, UK, 1989. Springer-Verlag.
8. C. G. R. Geddes, C. Toth, J. van Tilborg, E. Esarey, C. B. Schroeder, D. Bruhwiler, C. Nieter, J. Cary, and W. P. Leemans. High-quality electron beams from a laser wakefield accelerator using plasma-channel guiding. Nature, 431:538-541, 2004. (Pubitemid 39336328)
9. L. Gosink, J. Shalf, K. Stockinger, K. Wu, and W. Bethel. HDF5- FastQuery: Accelerating complex queries on HDF datasets using fast bitmap indices. In SSDBM, pages 149-158, 2006.
10. G. Graefe. Query evaluation techniques for large databases. ACM Comput. Surv., 25:73-169, June 1993.
11. T. Hey, S. Tansley, and K. Tolle, editors. The Fourth Paradigm: Data- Intensive Scientific Discovery. Microsoft, Oct. 2009.
12. Hopper II: Cray XE6. http://www.nersc.gov/nusers/systems/hopper2.
13. M. Howison, A. Adelmann, E. W. Bethel, A. Gsell, B. Oswald, and Prabhat. H5hut: A High-Performance I/O Library for Particle-Based Simulations. In Proceedings of Workshop on Interfaces and Abstractions for Scientific Data Storage, pages 1-8, 2010.
14. H. Lu, Y. Y. Ng, and Z. Tian. T-tree or b-tree: Main memory database index structure revisited. In Australasian Database Conference, pages 65-73, 2000.
15. R. Musick and T. Critchlow. Practical lessons in supporting large-scale computational science. SIGMOD Rec., 28(4):49-57, 1999. (Pubitemid 129542721)
16. P. J. Neiman, F. M. Ralph, G. A. Wick, Y. Kuo, T. Wee, Z. Ma, G. H. Taylor, and M. D. Dettinger. Diagnosis of an intense atmospheric river impacting the pacific northwest: Storm summary and offshore vertical structure observed with COSMIC satellite retrievals. Monthly Weather Review, 136(11):4398-4420, 2008.
17. P. O'Neil. Model 204 architecture and performance. In 2nd International Workshop in High Performance Transaction Systems, Asilomar, CA, volume 359 of Lecture Notes in Computer Science, pages 40-59. Springer-Verlag, Sept. 1987.
18. P. O'Neil and E. O'Neil. Database: principles, programming, and performance. Morgan Kaugmann, 2nd edition, 2000.
19. M. T. Ozsu. Principles of Distributed Database Systems. Prentice Hall Press, Upper Saddle River, NJ, USA, 3rd edition, 2007.
20. J. Qiang, R. D. Ryne, M. Venturini, and A. A. Zholents. High resolution simulation of beam dynamics in electron linacs for x-ray free electron lasers. Physical Review, 12:100702-1 - 100702-11, 2009.
21. F. M. Ralph, P. J. Neiman, G. A. Wick, S. I. Gutman, M. D. Dettinger, D. R. Cayan, and A. B. White. Flooding on California's Russian River: Role of atmospheric rivers. Geophysical Research Letters, 33:L13801, 2006.
22. O. Rübel, Prabhat, K. Wu, H. Childs, J. Meredith, C. G. R. Geddes, E. Cormier-Michel, S. Ahern, G. H. weber, P. Messmer, H. Hagen, B. Hamann, and E. W. Bethel. High performance multivariate visual data exploration for extemely large data. In SuperComputing, pages 1-12, Nov. 2008.
23. A. Shoshani and D. Rotem, editors. Scientific Data Management: Challenges, Technology, and Deployment, chapter 6. Chapman & Hall/CRC Press, 2010.
24. M. Stonebraker. The case for shared nothing. IEEE Database Eng. Bull., 9(1):4-9, 1986. http://sites.computer.org/debull/86MAR-CD.pdf.
25. The HDF Group. HDF5 user guide. http://hdf.ncsa.uiuc.edu/HDF5/doc/H5. user.html, 2010.
26. Unidata. The NetCDF users' guide. http://www.unidata.ucar.edu/software/ netcdf/docs/netcdf/, 2010.
27. M. F. Wehner, L. Oliker, and J. Shalf. Towards ultra-high resolution models of climate and weather. IJHPCA, 22(2):149-165, 2008. (Pubitemid 351566450)
28. K. Wu, S. Ahern, E. W. Bethel, J. Chen, H. Childs, E. Cormier- Michel, C. Geddes, J. Gu, H. Hagen, B. Hamann, W. Koegler, J. Lauret, J. Meredith, P. Messmer, E. Otoo, V. Perevoztchikov, A. Poskanzer, Prabhat, O. Rubel, A. Shoshani, A. Sim, K. Stockinger, G. Weber, and W.-M. Zhang. FastBit: Interactively searching massive data. In SciDAC, 2009. http://sdm.lbl.gov/ fastbit/.
29. K. Wu, E. Otoo, and A. Shoshani. Optimizing bitmap indices with efficient compression. ACM Transactions on Database Systems, 31:1-38, 2006.
30. K. Wu, A. Shoshani, and K. Stockinger. Analyses of multi-level and multi-component compressed bitmap indexes. ACM Trans. Database Syst., pages 1-52, 2010.