FlexQuery: An online query system for interactive remote visual data exploration at large scale

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2013, Pages

  Zou, Hongbo ^a   Schwan, Karsten ^a   Slawinska, Magdalena ^a   Wolf, Matt ^a,b   Eisenhauer, Greg ^a   Zheng, Fang ^a   Dayal, Jai ^a   Logan, Jeremy ^b   Liu, Qing ^b   Klasky, Scott ^b   Bode, Tanja ^c   Clark, Michael ^c   Kinsey, Matt ^c  

^a Georgia Institute of Technology   (United States)

^b OAK RIDGE NATIONAL LABORATORY   (United States)

^c GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

data reduction; online query; remote visualization

Indexed keywords

COMMUNICATION BANDWIDTH; ONLINE QUERY; ONLINE VISUALIZATIONS; PERFORMANCE MONITORING; REMOTE VISUALIZATION; SCIENTIFIC APPLICATIONS; SCIENTIFIC SIMULATIONS; VISUAL DATA EXPLORATION;

ASTROPHYSICS; CLUSTER COMPUTING; DATA REDUCTION; DATA VISUALIZATION; PIPELINES; RELATIONAL DATABASE SYSTEMS; TELECOMMUNICATION SYSTEMS; VISUALIZATION;

SEARCH ENGINES;

EID: 84893540205     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTER.2013.6702635     Document Type: Conference Paper

References (35)

1. Nics computing resources, http://www.nics.tennessee.edu.
2. The RDAV Project, http://rdav. nics.tennessee.edu.
3. Vtk6.0.0 documentation. 2013.
4. J. P. Ahrens, J. Woodring, D. E. De Marle, J. Patchett, and M. Maltrud. Interactive remote large-scale data visualization via prioritized multiresolution streaming. In Proceedings of the 2009 Workshop on Ultrascale Visualization, UltraVis'09, 2009.
5. J. M. B. Whitlock, J. Favre. Parallel in situ coupling of a simulation with a fully featured visualization system. In Eurographics Symposium on Parallel Graphics and Visualization (EGPGV) in association with Eurographics, 2011.
6. W. Bethel, B. Tierney, J. Lee, D. Gunter, and S. Lau. Using high-speed WANs and network data caches to enable remote and distributed visualization. In Proceedings of the 2000 ACM/IEEE conference on Supercomputing, Supercomputing'00, 2000.
7. K. Brodlie, D. Duce, J. Gallop, M. Sagar, J. Walton, and J. Wood. Visualization in grid computing environments. In In Proceedings of IEEE Visualization, pages 155-162, 2004. (Pubitemid 40497920)
8. A. Cedilnik, B. Geveci, K. Moreland, J. Ahrens, and J. Favre. Remote large data visualization in the paraview framework. 2006.
9. H. R. Childs, E. S. Brugger, K. S. Bonnell, J. S. Meredith, and etc. A Contract Based System for Large Data Visualization. In Proc. IEEE Visualization 2005, pages 190-198, Minneapolis, MN, 2005.
10. E. Dart and B. Tierney. Advanced scientific computing research network requirements, ascr network requirements review. In Final Report, Office of Advanced Scientific Computing Research, DOE Office of Science Energy Sciences Network, DoE Report. DoE, 2012.
11. G. Eisenhauer and K. Schwan. Event-based systems: opportunities and challenges at exascale. In Proceedings of the Third ACM International Conference on Distributed Event-Based Systems, DEBS'09, pages 2:1-2:10, 2009.
12. G. Eisenhauer, M. Wolf, H. Abbasi, S. Klasky, and K. Schwan. A type system for high performance communication and computation. In Proceedings of the 2011 IEEE Seventh International Conference on e-Science Workshops, ESCIENCEW'11, pages 183-190, 2011.
13. E. R. Hawkes, R. Sankaran, J. C. Sutherland, and J. H. Chen. Direct numerical simulation of turbulent combustion: fundamental insights towards predictive models. Journal of Physics: Conference Series, 16:65-79, 2005. (Pubitemid 41259331)
14. W. Hu, A. Hicks, L. Zhang, and J. Matthews. A quantitative study of virtual machine live migration. In Proc. of the ACM Cloud and Autonomic Computing Conference, CAC2013, 2013.
15. L. Huston, R. Sukthankar, R. Wickremesinghe, M. Satyanarayanan, G. R. Ganger, E. Riedel, and A. Ailamaki. Diamond: A storage architecture for early discard in interactive search. In Proceedings of the 3rd USENIX Conference on File and Storage Technologies, 2004.
16. L. Ice, N. Fabian, and etc. Scalable analysis tools for sensitivity analysis and uq (3160) results. In SANDIA REPORT SAND2009-6032 September 2009. DoE, 2009.
17. C. Jordan. Evaluation of parallel and distributed file system technologies for xsede. In Proceedings of the 1st Conference of the Extreme Science and Engineering Discovery Environment: Bridging from the eXtreme to the campus and beyond, XSEDE'12, 2012.
18. O. Kreylos, A. M. Tesdall, B. Hamann, J. K. Hunter, and K. I. Joy. Interactive visualization and steering of cfd simulations, 2002.
19. B. S. Lee and R. Musick. Meshsql: the query language for simulation mesh data. Inf. Sci. Inf. Comput. Sci., 159(3-4):177-202, Feb. 2004.
20. J. Lofstead, F. Zheng, S. Klasky, and K. Schwan. Adaptable, Metadata Rich IO Methods for Portable High Performance IO. In In IPDPS'09, May 25-29, Rome, Italy, 2009.
21. K.-L. Ma. A new approach to remote visualization of large volume data. SIGGRAPH Comput. Graph., 44(3):5:1-5:2, Aug. 2010.
22. R. Oldfield and D. Kotz. Armada: a parallel i/o framework for computational grids. Future Generation Computer Systems, 2002.
23. Paraview. Open source scientific visualization.
24. M. Slawinska, T. Bode, J. Logan, H. Zou, and etc. A Maya Use Case: Adaptable Scientific Workflows with ADIOS for General Relativistic Astrophysics. In XSEDE13, San Diego, CA, USA, 2013.
25. K. Stockinger, J. Shalf, K. Wu, and E. W. Bethel. Query-driven visualization of large data sets, 2005.
26. J. Tai, J. Zhang, J. Li, W. Meleis, and N. Mi. Ara: Adaptive resource allocation for cloud computing environments under bursty workloads. IEEE International Performance Computing and Communications Conference, 0:1-8, 2011.
27. Visit. Visit visualization tool. April 2011.
28. W. X. Wang, Z. Lin, W. M. Tang, W. W. Lee, S. Ethier, J. L. V. Lewandowski, G. Rewoldt, T. S. Hahm, and J. Manickam. Gyrokinetic simulation of global turbulent transport properties in tokamak experiments. Physics of Plasma, 13, 2006.
29. H. Yu, T. Tu, J. Bielak, O. Ghattas, J. C. Lez, K. Liu Ma, D. R. Oallaron, L. Ramirez-guzman, N. Stone, R. Taborda-rios, J. Urbanic, and S. California. Remote runtime steering of integrated terascale simulation and visualization. In HPC Analytics Challenge, ACM/IEEE Supercomputing 2006 Conference., 2006.
30. H. Yu, C. Wang, R. W. Grout, J. H. Chen, and K.-L. Ma. In Situ Visualization for Large-Scale Combustion Simulations. IEEE Computer Graphics and Applications, 30(3):45-57, 2010.
31. Y. Yu, D. H. Rudd, Z. Lan, N. Y. Gnedin, A. Kravtsov, and J. Wu. Improving parallel io performance of cell-based amr cosmology applications. Parallel and Distributed Processing Symposium, International, 0:933-944, 2012.
32. F. Zheng, H. Zou, G. Eisenhauer, and etc. FlexIO: I/O Middleware for Location-Flexible Scientific Data Analytics. In IPDPS, 2013.
33. M. Zhu. Adaptive remote visualization system with optimized network performance for large scale scientific data. PhD thesis, 2005.
34. H. Zou, X.-H. Sun, S. Ma, and X. Duan. A source-aware interrupt scheduling for modern parallel i/o systems. In Proc. of the 2012 IEEE 26th Intl. Par. and Distr. Processing Symposium, IPDPS'12, pages 156-166, Washington, DC, USA, 2012. IEEE Computer Society.
35. H. Zou, W. Wu, and etc. An evaluation of parallel optimization for opensolaris network stack. Proc. of the 37th Annual IEEE Conference on Local Computer Networks, 2010.