I/O streaming evaluation of batch queries for data-intensive computational turbulence

Proceedings of 2011 SC - International Conference for High Performance Computing, Networking, Storage and Analysis

Volumn , Issue , 2011, Pages

  Kanov, Kalin ^a   Perlman, Eric ^a   Burns, Randal ^a   Ahmad, Yanif ^a   Szalay, Alexander ^b  

^a Johns Hopkins University   (United States)

^b JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

Data intensive computing; Database clusters; I O streaming; Query evaluation; Query optimization; Software for high throughput computing

Indexed keywords

DATA SHARING; DATA-INTENSIVE COMPUTING; DATA-INTENSIVE WORKLOADS; DATABASE CLUSTERS; DISTRIBUTED EVALUATION; LAGRANGE POLYNOMIALS; PARTIAL SUMS; QUERY EVALUATION; QUERY OPTIMIZATION; SINGLE PASS; STREAM DATA;

COMPUTER SOFTWARE SELECTION AND EVALUATION; INTERPOLATION; TURBULENCE;

QUERY LANGUAGES;

EID: 83155184554     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2063384.2063423     Document Type: Conference Paper

References (23)

1. P. Agrawal, D. Kifer, and C. Olston. Scheduling shared scans of large data files. Proceedings of VLDB, 1(1):958-969, August 2008.
2. P. A. Boncz, W. Quak, and M. L. Kersten. Monet and its geographic extensions: A novel approach to high performance GIS processing. In Extending Database Technology, 1996.
3. G. P. Copeland and S. N. Khoshafian. A decomposition storage model. In SIGMOD, 1985.
4. A. Deshpande and S. Madden. MauveDB: supporting model-based user views in database systems. In SIGMOD, 2006.
5. M. Erez, J. H. Ahn, J. Gummaraju, M. Rosenblum, and W. J. Dally. Executing irregular scientific applications on stream architectures. In International Conference on Supercomputing, 2007.
6. S. Grumbach, P. Rigaux, and L. Segoufin. Manipulating interpolated data is easier than you thought. In Conference on Very Large Data Bases, 2000.
7. Y. Li, E. Perlman, M. Wan, Y. Yang, C. Meneveau, R. Burns, S. Chen, A. Szalay, and G. Eyink. A public turbulence database cluster and applications to study Lagrangian evolution of velocity increments in turbulence. Journal of Turbulence, 9:31+, 2008.
8. C. Moretti, H. Bui, K. Hollingsworth, B. Rich, P. Flynn, and D. Thain. All-pairs: An abstraction for data-intensive computing on campus grids. IEEE Trans. Parallel Distrib. Syst., 21:33-46, January 2010.
9. L. Neugebauer. Optimization and evaluation of database queries including embedded interpolation procedures. In SIGMOD, 1991.
10. E. Perlman, R. Burns, Y. Li, and C. Meneveau. Data exploration of turbulence simulations using a database cluster. In Supercomputing, 2007.
11. R. J. Purser and L. M. Leslie. An Efficient Interpolation Procedure for High-Order Three-Dimensional Semi-Lagrangian Models. Monthly Weather Review, 119:2492+, 1991.
12. J. W. Romein, P. C. Broekema, E. van Meijeren, K. van der Schaaf, and W. H. Zwart. Astronomical real-time streaming signal processing on a Blue Gene/L supercomputer. In Symposium on Parallel Algorithms and Architectures, 2006.
13. M. Stonebraker, D. J. Abadi, A. Batkin, X. Chen, M. Cherniack, M. Ferreira, E. Lau, A. Lin, S. Madden, E. O'Neil, P. O'Neil, A. Rasin, N. Tran, and S. Zdonik. C-store: a column-oriented DBMS. In Conference on Very large Data Bases, 2005.
14. A. S. Szalay, G. Bell, J. Vandenberg, A. Wonders, R. Burns, D. Fay, J. Heasley, T. Hey, M. Nieto-Santisteban, A. Thakar, C. van Ingen, and R. Wilton. Graywulf: Scalable clustered architecture for data intensive computing. Hawai'i International Conference on System Sciences, 2009.
15. A. Thiagarajan and S. Madden. Querying continuous functions in a database system. In SIGMOD, 2008.
16. P. Unterbrunner, G. Giannikis, G. Alonso, D. Fauser, and D. Kossmann. Predictable performance for unpredictable workloads. Proceedings of Very Large Data Bases, 2(1), August 2009.
17. X. Wang, R. C. Burns, and T. Malik. Liferaft: Data-driven, batch processing for the exploration of scientific databases. In CIDR, 2009.
18. X. Wang, E. Perlman, R. Burns, T. Malik, T. Budavári, C. Meneveau, and A. Szalay. Jaws: Job-aware workload scheduling for the exploration of turbulence simulations. In Supercomputing, 2010.
19. R. H. Wolniewicz and G. Graefe. Algebraic optimization of computations over scientific databases. In Conference on Very Large Data Bases, pages 13-24, 1993.
20. H.-c. Yang, A. Dasdan, R.-L. Hsiao, and D. S. Parker. Map-reduce-merge: simplified relational data processing on large clusters. In SIGMOD, 2007.
21. X. Yang, J. Du, X. Yan, and Y. Deng. Matrix-based streamization approach for improving locality and parallelism on ft64 stream processor. J. Supercomput., 47(2):171-197, February 2009.
22. L. Yi, C. Moretti, S. Emrich, K. Judd, and D. Thain. Harnessing parallelism in multicore clusters with the all-pairs and wavefront abstractions. In High Performance Distributed Computing, 2009.
23. J.-B. Yu and D. J. DeWitt. Query pre-execution and batching in Paradise: A two-pronged approach to the efficient processing of queries on tape-resident raster images. In Conference on Scientific and Statistical Database Management, 1997.