Indexing and parallel query processing support for visualizing climate datasets

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2012, Pages 249-258

  Su, Yu ^a   Agrawal, Gagan ^a   Woodring, Jonathan ^b  

^a OHIO STATE UNIVERSITY   (United States)

^b LOS ALAMOS NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BIT MAPS; DATA MANAGEMENT SOLUTION; DATA SET SIZE; DATA SETS; HIGH-LEVEL QUERIES; PARALLEL QUERY PROCESSING; SCIENTIFIC DATA;

INFORMATION MANAGEMENT;

INDEXING (OF INFORMATION);

EID: 84871117589     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2012.33     Document Type: Conference Paper

References (24)

1. J. Ahrens, B. Hendrickson, G. Long, S. Miller, R. Ross, and D. Williams, "Data intensive science in the department of energy," Los Alamos National Laboratory, Tech. Rep. LA-UR-10-07088, Oct. 2010. [Online]. Available: http://viz.lanl.gov/publication/paper/DOEDISC.pdf
2. C. Johnson and R. Ross, "Visualization and knowledge discovery: Report from the DOE/ASCR workshop on visual analysis and data exploration at extreme scale," Department of Energy Office of Science ASCR, Tech. Rep., Oct. 2007. [Online]. Available: http://www.er.doe.gov/ascr/ProgramDocuments/ Docs/DOE-Visualization-Report-2007.pdf
3. W. Schroeder, K. Martin, and B. Lorensen, Visualization Toolkit: An Object-Oriented Approach to 3D Graphics, 4th Edition, 4th ed. Kitware, Dec. 2006.
4. J. Ahrens, B. Geveci, and C. Law, "Paraview: An end user tool for large data visualization," The Visualization Handbook, p. 71731, 2005.
5. H. Childs, E. Brugger, K. Bonnell, J. Meredith, M. Miller, B. Whitlock, and N. Max, "A contract based system for large data visualization," 2005, pp. 191-198.
6. J. F. Lofstead, S. Klasky, K. Schwan, N. Podhorszki, and C. Jin, "Flexible IO and integration for scientific codes through the adaptable IO system (ADIOS)," in Proceedings of the 6th international workshop on Challenges of large applications in distributed environments, ser. CLADE '08. New York, NY, USA: ACM, 2008, p. 1524. [Online]. Available: http://doi.acm.org/ 10.1145/1383529.1383533
7. V. Vishwanath, M. Hereld, and M. E. Papka, "Toward simulation-time data analysis and I/O acceleration on leadership-class systems," in 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV). IEEE, Oct. 2011, pp. 9-14.
8. M. Folk, G. Heber, Q. Koziol, E. Pourmal, and D. Robinson, "An overview of the HDF5 technology suite and its applications," in Proceedings of the EDBT/ICDT 2011 Workshop on Array Databases, ser. AD '11. New York, NY, USA: ACM, 2011, p. 3647. [Online]. Available: http://doi.acm.org/10.1145/ 1966895.1966900
9. N. Fabian, K. Moreland, D. Thompson, A. C. Bauer, P. Marion, B. Gevecik, M. Rasquin, and K. E. Jansen, "The ParaView coprocessing library: A scalable, general purpose in situ visualization library," in 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV). IEEE, Oct. 2011, pp. 89-96.
10. B. Whitlock, J. M. Favre, and J. S. Meredith, "Parallel in situ coupling of simulation with a fully featured visualization system," pp. 101-109. [Online]. Available: http://diglib.eg.org/EG/DL/WS/EGPGV/EGPGV11/101- 109.pdf
11. K. Wu, W. Koegler, J. Chen, and A. Shoshani, "Using bitmap index for interactive exploration of large datasets," in 15th International Conference on Scientific and Statistical Database Management, 2003. IEEE, Jul. 2003, pp. 65-74.
12. J. Chou, K. Wu, O. Rübel, M. Prabhat, B. Austin, E. Bethel, R. Ryne, and A. Shoshani, "Parallel index and query for large scale data analysis," in SC, 2011.
13. R. Rew and G. Davis, "Netcdf: an interface for scientific data access," Computer Graphics and Applications, IEEE, vol. 10, no. 4, pp. 76-82, 1990.
14. P. O'Neil and D. Quass, "Improved query performance with variant indexes," in ACM Sigmod Record, vol. 26, no. 2. ACM, 1997, pp. 38-49.
15. G. Antoshenkov, "Byte-aligned bitmap compression," in Data Compression Conference, 1995. DCC'95. Proceedings. IEEE, 1995, p. 476.
16. K. Wu, E. Otoo, and A. Shoshani, "Compressing bitmap indexes for faster search operations," in Scientific and Statistical Database Management, 2002. Proceedings. 14th International Conference on. IEEE, 2002, pp. 99-108.
17. Y. Su and G. Agrawal, "Supporting user-defined subsetting and aggregation over parallel netcdf datasets," in CCGrid, 2012.
18. P. Jones, P. Worley, Y. Yoshida, J. White III, and J. Levesque, "Practical performance portability in the parallel ocean program (pop)," Concurrency and Computation: Practice and Experience, vol. 17, no. 10, pp. 1317-1327, 2005.
19. P. Cornillon, J. Gallagher, and T. Sgouros, "Opendap: Accessing data in a distributed, heterogeneous environment," Data Science Journal, vol. 2, no. 0, pp. 164-174, 2003.
20. B. Ludäscher, I. Altintas, C. Berkley, D. Higgins, E. Jaeger, M. Jones, E. Lee, J. Tao, and Y. Zhao, "Scientific workflow management and the kepler system," Concurrency and Computation: Practice and Experience, vol. 18, no. 10, pp. 1039-1065, 2006.
21. J. Buck, N. Watkins, J. LeFevre, K. Ioannidou, C. Maltzahn, N. Polyzotis, and S. Brandt, "Scihadoop: Array-based query processing in hadoop," in SC, 2011.
22. D. Wang, C. Zender, and S. Jenks, "Clustered workflow execution of retargeted data analysis scripts," in Cluster Computing and the Grid, 2008. CCGRID'08. 8th IEEE International Symposium on. IEEE, 2008, pp. 449-458.
23. D. Comer, "Ubiquitous b-tree," ACM Computing Surveys (CSUR), vol. 11, no. 2, pp. 121-137, 1979.
24. T. Apaydin, G. Canahuate, H. Ferhatosmanoglu, and A. Tosun, "Approximate encoding for direct access and query processing over compressed bitmaps," in Proceedings of the 32nd international conference on Very large data bases. VLDB Endowment, 2006, pp. 846-857.