Optimizing a tone curve for backward-compatible high dynamic range image and video compression

IEEE Transactions on Image Processing

Volumn 20, Issue 6, 2011, Pages 1558-1571

  Mai, Zicong ^a   Mansour, Hassan ^a   Mantiuk, Rafal ^b   Nasiopoulos, Panos ^a   Ward, Rabab ^a   Heidrich, Wolfgang ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b BANGOR UNIVERSITY   (United Kingdom)

Author keywords

Bit depth scalable; HDR video compression; high dynamic range imaging; tone mapping

Indexed keywords

BACKWARD COMPATIBLE; BIT DEPTH; CLOSED FORM SOLUTIONS; COMBINED PROCESS; HDR VIDEO; HIGH DYNAMIC RANGE; HIGH DYNAMIC RANGE IMAGES; HIGH DYNAMIC RANGE IMAGING; LOW DYNAMIC RANGE; NUMERICAL OPTIMIZATIONS; OPTIMIZATION PROBLEMS; PERFORMANCE EVALUATION; SIMPLIFIED MODELS; STATISTICAL MODELS; TONE-MAPPING; VIDEO COMPRESSION;

COMPUTATIONAL COMPLEXITY; CURVE FITTING; IMAGE QUALITY; MAPPING; MEAN SQUARE ERROR; OPTIMIZATION;

IMAGE COMPRESSION;

ALGORITHM; ARTICLE; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; INFORMATION PROCESSING; MATHEMATICAL COMPUTING; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; VIDEORECORDING;

ALGORITHMS; DATA COMPRESSION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; VIDEO RECORDING;

EID: 79957475988     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2010.2095866     Document Type: Article

References (40)

1. H. Seetzen, W. Heidrich, W. Stuerzlinger, G.Ward, L. Whitehead, M. Trentacoste, A. Ghosh, and A. Vorozcovs, "High dynamic range display systems," ACMTrans. Graph. (Proc. SIGGRAPH), vol. 23, no. 3, pp. 757-765, 2004.
2. IEC61966-2-4, Colour Measurement and Management-Part 2-4: Colour Management-Extended-Gamut YCC Colour Space for Video Applications- xvYCC 2006.
3. R. Mantiuk, G. Krawczyk, K. Myszkowski, and H.-P. Seidel, "Perception- motivated high dynamic range video encoding," ACM Trans. Graph. (Proc. SIGGRAPH), vol. 23, no. 3, pp. 730-738, 2004.
4. G. Ward, "Real pixels," Graphics Gems II, pp. 80-83, 1991.
5. R. Bogart, F. Kainz, and D. Hess, "Openexr image file format," in Proc. ACM SIGGRAPH 2003, Sketches Applicat., 2003.
6. G. W. Larson, "Logluv encoding for full-gamut, high-dynamic range images," J. Graph. Tools, vol. 3, no. 1, pp. 15-31, 1998.
7. Y. Gao and Y.Wu, "Applications and Requirement for Color Bit Depth Scalability," Oct. 2006, Tech. Rep., ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT-U049.
8. G. J. Sullivan, H. Yu, S.-I. Sekiguchi, H. Sun, T. Wedi, S. Wittmann, Y.-L. Lee, A. Segall, and T. Suzuki, "New standardized extensions of mpeg4-avc/h.264 for professional-quality video applications," in Proc. ICIP, 2007, vol. 1, pp. I-13-I-16.
9. M. Winken, D. Marpe, H. Schwarz, and T. Wiegand, "Bit-depth scalable video coding," in Proc. ICIP, 2007, vol. 1, pp. I-5-I-8.
10. A. Segall and J. Zhao, "Bit-stream rewriting for SVC-to-AVC conversion," in Proc. ICIP, 2008, pp. 2776-2779.
11. Y. Gao and Y. Wu, "Bit Depth Scalability," Jan. 2007, Tech. Rep., ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT-V061.
12. Y. Ye, H. Chung, M. Karczewicz, and I. S. Chong, "Improvements to Bit Depth Scalability Coding," Oct. 2007, Tech. Rep., ISO/IEC JTC1/ SC29/WG11 and ITU-T SG16 Q.6, JVT-Y048.
13. M. Winken, H. Schwarz, D. Marpe, and T. Wiegand, "SVC Bit Depth Scalability," Jan. 2007, Tech. Rep., ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT-V078.
14. Y.Yu, S.Gordon, andM.Yang, "Improving Compression Preformance in Bit Depth SVC With a Prediction Filter," Jan. 2008, Tech. Rep., ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT-Z045.
15. A. Segall and Y. Su, "System for Bit-Depth Scalable Coding," Apr. 2007, Tech. Rep., ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT-W113.
16. A. Segall, L. Kerofsky, and S. Lei, "Tone Mapping SEI Message," Jul. 2006, Tech. Rep., ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT-T060.
17. K. E. Spaulding, G. J.Woolfe, and R. L. Joshi, "Using a residual image to extend the color gamut and dynamic range of an sRGB image," in Proc. IS&T PICS Conf., 2003, pp. 307-314.
18. G. Ward and M. Simmons, "JPEG-HDR: A backwards-compatible, high dynamic range extension to JPEG," in Proc. 13th Color Imaging Conf., 2005, pp. 283-290. (Pubitemid 43098550)
19. R. Mantiuk, A. Efremov, K. Myszkowski, and H.-P. Seidel, "Backward compatible high dynamic range mpeg video compression," ACM Trans. Graphics (Proc. SIGGRAPH), vol. 25, no. 3, pp. 713-723, 2006. (Pubitemid 44481032)
20. A. Segall, "Scalable coding of high dynamic range video," in Proc. ICIP, 2007, vol. 1, pp. I-1-I-4.
21. Y. Wu, Y. Gao, and Y. Chen, "Bit-depth scalability compatible to H. 264/AVC-scalable extension," J. Vis. Commun. Image Represent., vol. 19, no. 6, pp. 372-381, 2008.
22. H. Schwarz, D. Marpe, and T. Wiegand, "Overview of the scalable video coding extension of the H.264/AVC standard," Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1103-1120, Sep. 2007. (Pubitemid 47483052)
23. S. Liu, W.-S. Kim, and A. Vetro, "Bit-depth scalable coding for high dynamic range video," in Proc. SPIE Vis. Commun. Image Process. 2008, W. A. Pearlman, J. W.Woods, and L. Lu, Eds., 2008, vol. 6822, p. 649212.
24. P. Ledda, A. Chalmers, T. Troscianko, and H. Seetzen, "Evaluation of tone mapping operators using a high dynamic range display," ACM Trans. Graphics (Proc. SIGGRAPH), vol. 24, no. 3, pp. 640-648, 2005.
25. R. Mantiuk, S. Daly, and L. Kerofsky, "Display adaptive tone mapping," ACM Trans. Graphics-TOG, vol. 27, no. 3, pp. 68-68, 2008.
26. E. Reinhard, G. Ward, S. Pattanaik, and P. Debevec, High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting. New York: Morgan Kaufmann, 2005.
27. Y. Li, L. Sharan, and E. H. Adelson, "Compressing and companding high dynamic range images with subband architectures," ACM Trans. Graph., vol. 24, no. 3, pp. 836-844, 2005.
28. C. Lee and C.-S.Kim, "Gradient domain tonemapping of high dynamic range videos," in Proc. ICIP, 2007, vol. 3, pp. III-461-III-464.
29. R. Fattal, D. Lischinski, and M. Werman, "Gradient domain high dynamic range compression," Comput. Graph. Forum (Proc. Eurographics), vol. 21, no. 3, pp. 249-256, 2002.
30. R. Mantiuk and H. P. Seidel, "Modeling a generic tone-mapping operator," Comput. Graph. Forum (Proc. Eurographics), vol. 27, no. 2, pp. 699-708, 2008. (Pubitemid 351612884)
31. E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda, "Photographic tone reproduction for digital images," ACM Trans. Graphics (Proc. SIGGRAPH), vol. 21, no. 3, pp. 267-276, 2002.
32. F. Drago, K. Myszkowski, T. Annen, and N. Chiba, "Adaptive logarithmic mapping for displaying high contrast scenes," Comput. Graph. Forum (Proc. Eurographics), vol. 22, no. 3, pp. 419-426, 2003.
33. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
34. R. Mantiuk, R. Mantiuk, A. Tomaszewska, and W. Heidrich, "Color correction for tone mapping," Comput. Graph. Forum (Proc. Eurographics), vol. 28, no. 2, pp. 193-202, 2009.
35. S. Hecht, "The visual discrimination of intensity and the weber-fechner law," J. General Physiol., vol. 7, no. 2, pp. 235-267, Nov. 1924.
36. H.264/AVC JM14.2 Reference Software [Online]. Available: http:// iphome.hhi.de/suehring/tml/
37. T. O. Aydin, R. Mantiuk, K. Myszkowski, and H.-P. Seidel, "Dynamic range independent image quality assessment," ACM Trans. Graphics (Proc. SIGGRAPH), vol. 27, no. 3, 2008.
38. R. Mantiuk, S. Daly, K. Myszkowski, and H.-P. Seidel, "Predicting visible differences in high dynamic range images model and its calibration," in Proc. Human Vis. Electronic Imag., 2005, vol. 5666, pp. 204-214, SPIE. (Pubitemid 40949015)
39. P. Topiwala and H. Yu, "New Test Sequences in the VIPER 10-bit HD Data," Oct. 2005, Tech. Rep., ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT-Q090.
40. Supplimentary Documents and Results [Online]. Available: http://www.ece.ubc.ca/~zicongm/tmo-hdr-enc/HTMLReport.html