Revisiting wavelet compression for large-scale climate data using JPEG 2000 and ensuring data precision

1st IEEE Symposium on Large-Scale Data Analysis and Visualization 2011, LDAV 2011 - Proceedings

Volumn , Issue , 2011, Pages 31-38

  Woodring, Jonathan ^a   Mniszewski, Susan ^a   Brislawn, Christopher ^a   DeMarle, David ^b   Ahrens, James ^a  

^a LOS ALAMOS NATIONAL LABORATORY   (United States)

^b KITWARE INC   (United States)

Author keywords

H.3.m Information Storage and Retrieval : Miscellaneous; I.3.8 Computer Graphics : Applications E.4 Data : Coding and Information Theory Data compaction and compression

Indexed keywords

BIT RATES; CLIMATE DATA; COMPRESSION EFFECTS; COMPUTING ENVIRONMENTS; DATA COMPACTION; DATA MOVEMENTS; DATA QUALITY; DATA SIZE; DOMAIN EXPERTS; INFORMATION STORAGE AND RETRIEVAL; JPEG 2000; LIMITED BANDWIDTH; MAXIMUM ERROR; PARALLEL OCEAN PROGRAMS; PRECISION GUARANTEES; PROCESSING TIME; QUALITY METRICES; REMOTE SITES; SCIENTIFIC ANALYSIS; VISUALIZATION AND ANALYSIS; WAVELET COMPRESSION;

ARTS COMPUTING; BIT ERROR RATE; COMPACTION; DATA HANDLING; DATA TRANSFER; DATA VISUALIZATION; INFORMATION THEORY; QUALITY CONTROL; SIGNAL PROCESSING; VISUALIZATION;

DATA COMPRESSION;

EID: 84055184208     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/LDAV.2011.6092314     Document Type: Conference Paper

References (58)

1. http://www.ece.uvic.ca/~mdadams/jasper/.
2. http://www.openjpeg.org/.
3. http://www.kakadusoftware.com.
4. WSQ Gray-Scale Fingerprint Image Compression Specification, IAFIS-IC-0110v2, Washington, DC, Feb. 1993. US Federal Bureau of Investigation.
5. Information technology - Digital Compression and Coding of Continuous-Tone Still Images, Part 1: Requirements and Guidelines, ISO/IEC Int'l. Standard 10918-1. Int'l. Org. Standardization, 1994.
6. Information technology - JPEG 2000 image coding system, Part 1, ISO/IEC Int'l. Standard 15444-1, ITU-T Rec. T.800. Int'l. Org. Standardization, Dec. 2000.
7. Information technology - JPEG 2000 Image Coding System, Part 5 (Reference Software), ISO/IEC Int'l. Standard 15444-5. Int'l. Org. Standardization, Nov. 2003.
8. Information technology - JPEG 2000 image coding system, Part 2: Extensions, ISO/IEC Int'l. Standard 15444-2, ITU-T Rec. T.801. Int'l. Org. Standardization, May 2004.
9. Information technology - JPEG 2000 Image Coding System, Part 9: Interactivity tools, APIs, and protocols, ISO/IEC Int'l. Standard 15444-9. Int'l. Org. Standardization, Oct. 2004.
10. Information technology - JPEG 2000 image coding system, Part 10: Extensions for three-dimensional data, ISO/IEC Int'l. Standard 15444-10, ITU-T Rec. T.809. Int'l. Org. Standardization, 2008.
11. T. Acharya and P.-S. Tsai. JPEG2000 Standard for Image Compression: Concepts, Algorithms and VLSI Architectures. Wiley-Interscience, 2004.
12. J. Ahrens, K. Heitmann, M. Petersen, J. Woodring, S. Williams, P. Fasel, C. Ahrens, C. Hsu, and B. Geveci. Verifying scientific simulations via comparative and quantitative visualization. IEEE Computer Graphics and Applications, 30(6):16-28, 2010.
13. J. Ahrens, B. Hendrickson, G. Long, S. Miller, R. Ross, and D. Williams. Data intensive science in the department of energy. Technical Report LA-UR-10-07088, Los Alamos National Laboratory, Oct. 2010.
14. J. Ahrens, J. Woodring, D. DeMarle, J. Patchett, and M. Maltrud. Interactive remote Large-Scale data visualization via prioritized Multi-Resolution streaming. In Proceedings of the 2009 Workshop on Ultrascale Visualization, pages 1-10, Portland, Oregon, 2009.
15. C. M. Brislawn, J. N. Bradley, R. J. Onyshczak, and T. Hopper. The FBI compression standard for digitized fingerprint images. In Proc. SPIE, volume 2847, pages 344-355, Denver, CO, Aug. 1996. SPIE.
16. C. M. Brislawn and M. D. Quirk. Image compression with the JPEG-2000 standard. In R. G. Driggers, editor, Encyclopedia of Optical Engineering, pages 780-785. Dekker, New York, 2003.
17. M. Burtscher and P. Ratanaworabhan. FPC: a High-Speed compressor for Double-Precision Floating-Point data. Computers, IEEE Transactions on, 58(1):18-31, 2009.
18. H. Childs, D. Pugmire, S. Ahern, B. Whitlock, M. Howison, Prabhat, G. Weber, and E. Bethel. Extreme scaling of production visualization software on diverse architectures. Computer Graphics and Applications, IEEE, 30(3):22-31, 2010.
19. C. Christopoulos, A. Skodras, and T. Ebrahimi. The JPEG 2000 still image coding system: An overview. IEEE Trans. Consumer Electron., 46(4):1103-1127, Nov. 2000.
20. J. Clyne, P. Mininni, A. Norton, and M. Rast. Interactive desktop analysis of high resolution simulations: Application to turbulent plume dynamics and current sheet formation. New Journal of Physics, 9(8):301-301, 2007.
21. M. F. Deering. The limits of human vision. In 2nd International Immersive Projection Technology Workshop, 1998.
22. D. Ellsworth, L. Chiang, and H. Shen. Accelerating time-varying hardware volume rendering using TSP trees and color-based error metrics. Proceedings of the 2000 IEEE symposium on Volume visualization, pages 119-128, 2000. ACM ID: 353908.
23. A. Gersho and R. M. Gray. Vector Quantization and Signal Compression. Kluwer, Norwell, MA, 1992.
24. S. Guthe andW. Strasser. Advanced techniques for high-quality multi-resolution volume rendering. Computers & Graphics, 28(1):51-58, Feb. 2004.
25. S. Guthe, M. Wand, J. Gonser, and W. Strasser. Interactive rendering of large volume data sets. In Visualization Conference, IEEE, pages 50-60, Los Alamitos, CA, USA, 2002. IEEE Computer Society.
26. I. Ihm and S. Park. Wavelet-based 3D compression scheme for very large volume data. In Graphics Interface, pages 107-116, 1998.
27. N. S. Jayant and P. Noll. Digital Coding of Waveforms. Prentice-Hall, Englewood Cliffs, NJ, 1984.
28. C. Johnson and R. Ross. Visualization and knowledge discovery: Report from the DOE/ASCR workshop on visual analysis and data exploration at extreme scale. Technical report, Department of Energy Office of Science ASCR, Oct. 2007.
29. C. Johnson and A. Sanderson. A next step: Visualizing errors and uncertainty. Computer Graphics and Applications, IEEE, 23(5):6-10, 2003.
30. T. Kim and Y. Shin. An efficient wavelet-based compression method for volume rendering. In Computer Graphics and Applications, 1999. Proceedings. Seventh Pacific Conference on, pages 147-156, 1999.
31. E. LaMar, B. Hamann, and K. Joy. Multiresolution techniques for interactive Texture-Based volume visualization. In Proceedings of the conference on Visualization'99: celebrating ten years, pages 355-361, 1999.
32. E. LaMar, B. Hamann, and K. Joy. Efficient error calculation for multiresolution texture-base volume visualization. In Hierarchical and geometrical methods in scientific visualization, pages 51-62. Springer, Feb. 2003.
33. P. Lindstrom and M. Isenburg. Fast and efficient compression of Floating-Point data. Visualization and Computer Graphics, IEEE Transactions on, 12(5):1245-1250, 2006. (Pubitemid 44955661)
34. E. Luke and C. Hansen. Semotus visum: A flexible remote visualization framework. In IEEE Visualization, 2002. VIS 2002., pages 61-68, Boston, MA, USA, 2002. (Pubitemid 35444834)
35. M. W. Marcellin, M. J. Gormish, A. Bilgin, and M. P. Boliek. An overview of JPEG 2000. In Proc. Data Compression Conf., pages 523-541, Snowbird, UT, mar 2000. IEEE Computer Soc.
36. S. Muraki. Approximation and rendering of volume data using wavelet transforms. Proceedings of the 3rd conference on Visualization '92, pages 21-28, 1992. ACM ID: 949694.
37. V. Pascucci and R. Frank. Global static indexing for Real-Time exploration of very large regular grids. In Supercomputing, ACM/IEEE 2001 Conference, page 45, 2001.
38. W. B. Pennebaker and J. L. Mitchell. JPEG Still Image Data Compression Standard. Van Nostrand Reinhold, New York, NY, 1992.
39. K. Potter, J. Kniss, R. Riesenfeld, and C. Johnson. Visualizing summary statistics and uncertainty. Computer Graphics Forum, 29(3):823-832, 2010.
40. J. G. Proakis. Digital Communications. McGraw-Hill, New York, NY, 4 edition, 2000.
41. M. Rabbani and R. Joshi. An overview of the JPEG 2000 still image compression standard. Signal Process. Image Commun., 17:3-48, 2002. (Pubitemid 33142063)
42. F. Rodler. Wavelet based 3D compression with fast random access for very large volume data. In Computer Graphics and Applications, 1999. Proceedings. Seventh Pacific Conference on, pages 108-117, 1999.
43. J. Sanyal, S. Zhang, J. Dyer, A. Mercer, P. Amburn, and R. Moorhead. Noodles: A tool for visualization of numerical weather model ensemble uncertainty. Visualization and Computer Graphics, IEEE Transactions on, 16(6):1421-1430, 2010.
44. H. Shen, L. Chiang, and K. Ma. A fast volume rendering algorithm for Time-Varying fields using a Time-Space partitioning (TSP) tree. In Visualization Conference, IEEE, page 62, Los Alamitos, CA, USA, 1999. IEEE Computer Society.
45. B. Sklar. Digital Communications: Fundamentals and Applications. Prentice-Hall, Upper Saddle River, NJ, 2 edition, 2000.
46. R. D. Smith and P. Gent. Reference manual of the parallel ocean program (POP). Los Alamos National Laboratory report LA-UR-02-2484, Los Alamos National Laboratory, Los Alamos, NM, 2002.
47. A. S. Szalay, G. C. Bell, H. H. Huang, A. Terzis, and A. White. Low-Power Amdahl-Balanced blades for data intensive computing. ACM SIGOPS Operating Systems Review, 44(1):71, 2010.
48. D. S. Taubman. Directionality and Scalability in Image and Video Compression. PhD thesis, University of California, Berkeley, CA, 1994.
49. D. S. Taubman and M.W. Marcellin. JPEG2000: Image Compression Fundamentals, Standards, and Practice. Kluwer, Boston, MA, 2002.
50. A. Trott, R. Moorhead, and J. McGinley. Wavelets applied to lossless compression and progressive transmission of floating point data in 3-D curvilinear grids. In Visualization '96. Proceedings., pages 385-388. IEEE, Nov. 1996.
51. B. E. Usevitch. A tutorial on modern lossy wavelet image compression: Foundations of JPEG 2000. IEEE Signal Process. Mag., 18(5):22-35, Sept. 2001.
52. C. Wang, J. Gao, L. Li, and H. Shen. A multiresolution volume rendering framework for Large-Scale Time-Varying data visualization. In Volume Graphics, 2005. Fourth International Workshop on, pages 11-223, 2005.
53. C. Wang, A. Garcia, and H. Shen. Interactive Level-of-Detail selection using Image-Based quality metric for large volume visualization. IEEE Transactions on Visualization and Computer Graphics, 13(1):122-134, 2007.
54. R. Westermann. A multiresolution framework for volume rendering. Proceedings of the 1994 symposium on Volume visualization, page 51-58, 1994. ACM ID: 197963.
55. J. Woodring, J. Ahrens, J. Figg, J. Wendelberger, S. Habib, and K. Heitmann. In-situ sampling of a large-scale particle simulation for interactive visualization and analysis. Computer Graphics Forum, 30(3):1151-1160, June 2011.
56. J. Woodring and H. Shen. Multiscale time activity data exploration via temporal clustering visualization spreadsheet. IEEE Transactions on Visualization and Computer Graphics, 15(1):123-137, 2009.
57. J. W. Woods, editor. Subband Image Coding. Kluwer, Boston, MA, 1991.
58. Z. Zhu, R. Machiraju, B. Fry, and R. Moorhead. Wavelet-based multiresolutional representation of computational field simulation datasets. In Visualization '97., Proceedings, pages 151-158. IEEE, Oct. 1997.