Parallel index and query for large scale data analysis

Proceedings of 2011 SC - International Conference for High Performance Computing, Networking, Storage and Analysis

Volumn , Issue , 2011, Pages

  Chou, Jerry ^a   Wu, Kesheng ^a   Rübel, Oliver ^a   Howison, Mark ^a   Qiang, Ji ^a   Prabhat, ^a   Austin, Brian ^a   Bethel, E Wes ^a   Ryne, Rob D ^a   Shoshani, Arie ^a  

^a NONE

Author keywords

Indexing systems; Large scale data analysis; Performance

Indexed keywords

DATA SETS; INDEXING SYSTEMS; INTERACTIVE EXPLORATION; LARGE DATASETS; LARGE SCALE DATA; MASSIVE DATA SETS; MULTI-CORE PLATFORMS; PERFORMANCE; SEARCH TIME; SOFTWARE FRAMEWORKS;

COMPUTER PROGRAMMING; COMPUTER SOFTWARE SELECTION AND EVALUATION; INFORMATION MANAGEMENT;

SEARCH ENGINES;

EID: 83155188481     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2063384.2063424     Document Type: Conference Paper

References (30)

1. M. K. Aguilera, W. Golab, and M. A. Shah. A practical scalable distributed b-tree. Proc. VLDB Endow., 1:598-609, August 2008. http://dx.doi.org/10.1145/1453856.1453922.
2. C. Ballinger and R. Fryer. Born to be parallel: Why parallel origins give teradata an enduring performance edge. IEEE Data Eng. Bull., 20(2):3-12, 1997.
3. P. A. Boncz, M. Zukowski, and N. Nes. MonetDB/X100: Hyper-pipelining query execution. In CIDR, pages 225-237, 2005.
4. D. Comer. The ubiquitous B-tree. Computing Surveys, 11(2):121-137, 1979.
5. J. Corlett, K. Baptiste, J. Byrd, P. Denes, R. Donahue, L. Doolittle, R. Falcone, D. Filippetto, J. Kirz, D. Li, H. Padmore, C. F. Papadopoulos, G. Pappas, G. Penn, M. Placidi, S. Prestemon, J. Qiang, A. Ratti, M. Reinsch, F. Sannibale, D. Schlueter, R. Schoenlein, J. Staples, T. Vecchione, M. Venturini, R. Wells, R. Wilcox, J. Wurtele, A. Charman, E. Kur, and A. Zholents. A next generation light source facility at lbnl. In Proceedings of PAC 2011, New York, USA, April 2011.
6. G. S. Davidson, K. W. Boyack, R. A. Zacharski, S. C. Helmerich, and J. R. Cowie. Data-centric computing with the netezza architecture. Technical Report SAND2006-3640, Sandia National Laboratory, 2006.
7. D. J. DeWitt, R. H. Katz, F. Olken, L. D. Shapiro, M. Stonebraker, and D. A. Wood. Implementation techniques for main memory database systems. In SIGMOD Conference, pages 1-8, 1984. http://doi.acm.org/10.1145/602259.602261. (Pubitemid 15469530)
8. D. J. DeWitt, M. Smith, and H. Boral. A single-user performance evaluation of the teradata database machine. In Proceedings of the 2nd International Workshop on High Performance Transaction Systems, pages 244-276, London, UK, 1989. Springer-Verlag.
9. L. Gosink, J. Shalf, K. Stockinger, K. Wu, and W. Bethel. HDF5-FastQuery: Accelerating complex queries on HDF datasets using fast bitmap indices. In SSDBM, pages 149-158, 2006.
10. G. Graefe. Query evaluation techniques for large databases. ACM Comput. Surv., 25:73-169, June 1993.
11. W. Gropp, S. Huss-Lederman, A. Lumsdaine, E. Lusk, B. Nitzberg, W. Saphir, and M. Snir. MPI: The Complete Reference. Volume 2, The MPI-2 Extensions. Scientific and Engineering Computation. MIT Press, Cambridge, MA, USA, second edition, 1998.
12. T. Hey, S. Tansley, and K. Tolle, editors. The Fourth Paradigm: Data-Intensive Scientific Discovery. Microsoft, Oct. 2009.
13. M. Howison, Q. Koziol, D. Knaak, J. Mainzer, and J. Shalf. Tuning hdf5 for lustre file systems. In Workshop on Interfaces and Abstractions for Scientific Data Storage, 2010.
14. H. Lu, Y. Y. Ng, and Z. Tian. T-tree or b-tree: Main memory database index structure revisited. In Australasian Database Conference, pages 65-73, 2000.
15. R. Musick and T. Critchlow. Practical lessons in supporting large-scale computational science. SIGMOD Rec., 28(4):49-57, 1999. (Pubitemid 129542721)
16. large-scale computational science. SIGMOD Rec., 28(4):49-57, 1999.
17. P. O'Neil. Model 204 architecture and performance. In 2nd International Workshop in High Performance Transaction Systems, Asilomar, CA, volume 359 of Lecture Notes in Computer Science, pages 40-59. Springer-Verlag, Sept. 1987.
18. P. O'Neil and E. O'Neil. Database: principles, programming, and performance. Morgan Kaugmann, 2nd edition, 2000.
19. M. T. Ozsu. Principles of Distributed Database Systems. Prentice Hall Press, Upper Saddle River, NJ, USA, 3rd edition, 2007.
20. J. Qiang, R. D. Ryne, M. Venturini, and A. A. Zholents. High resolution simulation of beam dynamics in electron linacs for x-ray free electron lasers. Physical Review, 12:1007021 - 10070211, 2009.
21. O. Rübel, Prabhat, K. Wu, H. Childs, J. Meredith, C. G. R. Geddes, E. Cormier-Michel, S. Ahern, G. H. weber, P. Messmer, H. Hagen, B. Hamann, and E. W. Bethel. High Performance Multivariate Visual Data Exploration for Extemely Large Data. In SuperComputing 2008 (SC08), Austin, Texas, USA, November 2008.
22. A. Shoshani and D. Rotem, editors. Scientific Data Management: Challenges, Technology, and Deployment. Chapman & Hall/CRC Press, 2010.
23. K. Stockinger, E. W. Bethel, S. Campbell, E. Dart, and K. Wu. Detecting Distributed Scans Using High-Performance Query-Driven Visualization. In SC'06: Proceedings of the 2006 ACM/IEEE Conference on High Performance Computing, Networking, Storage and Analysis. IEEE Computer Society Press, November 2006.
24. M. Stonebraker. The case for shared nothing. IEEE Database Engineering Bulletin, 9(1):4-9, 1986. http://sites.computer.org/debull/86MAR-CD.pdf.
25. M. Stonebraker, J. Becla, D. Dewitt, K. tat Lim, D. Maier, O. Ratzesberger, and S. B. Zdonik. Requirements for science data bases and scidb. In Conference on Innovative Data Systems Research, 2009.
26. The HDF Group. HDF5 user guide. http://hdf.ncsa.uiuc.edu/HDF5/doc/H5. user.html 2010.
27. Unidata. The NetCDF users'guide. http://www.unidata.ucar.edu/software/ netcdf/docs/netcdf/2010.
28. K. Wu, S. Ahern, E. W. Bethel, J. Chen, H. Childs, E. Cormier-Michel, C. Geddes, J. Gu, H. Hagen, B. Hamann, W. Koegler, J. Lauret, J. Meredith, P. Messmer, E. Otoo, V. Perevoztchikov, A. Poskanzer, Prabhat, O. Rubel, A. Shoshani, A. Sim, K. Stockinger, G. Weber, and W.-M. Zhang. FastBit: Interactively searching massive data. In SciDAC, 2009.
29. K. Wu, E. Otoo, and A. Shoshani. Optimizing bitmap indices with efficient compression. ACM Transactions on Database Systems, 31:1-38, 2006.
30. K. Wu, A. Shoshani, and K. Stockinger. Analyses of multi-level and multi-component compressed bitmap indexes. ACM Transactions on Database Systems, pages 1-52, 2010.