High dynamic range and wide color gamut video coding in HEVC: Status and potential future enhancements

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 26, Issue 1, 2016, Pages 63-75

  François, Edouard ^a   Fogg, Chad ^b   He, Yuwen ^c   Li, Xiang ^d   Luthra, Ajay ^e   Segall, Andrew ^f  

^a TECHNICOLOR   (France)

^b MovieLabs   (United States)

^c INTERDIGITAL COMMUNICATIONS   (United States)

^d QUALCOMM INC   (United States)

^e ARRIS Broadband   (United States)

^f SHARP LABORATORIES OF AMERICA   (United States)

Author keywords

High dynamic range (HDR); High Efficiency Video Coding (HEVC); Scalable extension of HEVC (SHVC); Video coding; Wide color gamut (WCG)

Indexed keywords

CODES (SYMBOLS); COLOR; EFFICIENCY; HIGH DEFINITION TELEVISION; IMAGE CODING; SCALABLE VIDEO CODING; STANDARDIZATION;

CONSUMER MARKET; HIGH DYNAMIC RANGE; HIGH EFFICIENCY VIDEO CODING (HEVC); HIGH-EFFICIENCY VIDEO CODING; INTENSITY RANGE; SCALABLE EXTENSION OF HEVC (SHVC); ULTRA-HIGH DEFINITIONS; WIDE COLOR GAMUT;

VIDEO SIGNAL PROCESSING;

EID: 85009253095     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2015.2461911     Document Type: Article

References (76)

1. B. Bross, W.-J. Han, J.-R. Ohm, G. J. Sullivan, Y.-K. Wang, and T. Wiegand, High Efficiency Video Coding (HEVC) Text Specification Draft 10 (for FDIS & Final Call), document JCTVC-L1003, Geneva, Switzerland, Jan. 2013.
2. J. Boyce, Draft High Efficiency Video Coding (HEVC) Version 2, Combined Format Range Extensions (RExt), Scalability (SHVC), and Multi-View (MV-HEVC) Extensions, document JCTVC-R1013, Sapporo, Japan, Jul. 2014.
3. P. Björkman, "The ultra HD equation," EBU Tech-I J., no. 17, p. 9, Sep. 2013. [Online]. Available: https://tech.ebu.ch/docs/tech-i/ebu-techi-017.pdf
4. Y. Thomas. (Mar. 2014). Behind the Scene of UHDTV. [Online]. Available: http://www.hoek.nl/dg/18mrt14/Dutch-Guild-2014-Yvonne-Thomas-handout.pdf
5. J. A. Ferwerda, "Elements of early vision for computer graphics," IEEE Comput. Graph. Appl., vol. 21, no. 5, pp. 22-33, Sep./Oct. 2001.
6. F. Xiao, J. M. DiCarlo, P. B. Catrysse, and B. A. Wandell, "High dynamic range imaging of natural scenes," in Proc. 10th Color Imag. Conf., Scottsdale, AZ, USA, Nov. 2002, pp. 337-342.
7. J. M. Valeton and D. van Norren, "Light adaptation of primate cones: An analysis based on extracellular data," Vis. Res., vol. 23, no. 12, pp. 1539-1547, 1983.
8. T. Kunkel and E. Reinhard, "A reassessment of the simultaneous dynamic range of the human visual system," in Proc. 7th Symp. Appl. Perception Graph. Visualizat., New York, NY, USA, Jul. 2010, pp. 17-24.
9. P. Ledda, L. P. Santos, and A. Chalmers, "A local model of eye adaptation for high dynamic range images," in Proc. 3rd Int. Conf. Comput. Graph. Comput. Graph., Virt. Reality, Visualisat. Interact. Africa (AFRIGRAPH), Cape Town, South Africa, Nov. 2004, pp. 151-160.
10. S. N. Pattanaik, J. Tumblin, H. Yee, and D. P. Greenberg, "Time-dependent visual adaptation for fast realistic image display," in Proc. 27th Annu. Conf. SIGGRAPH, New Orleans, LA, USA, 2000, pp. 47-54.
11. A. Luthra, E. François, and W. Husak, Draft Requirements and Explorations for HDR/WCG Content Distribution and Storage, document ISO/IEC JTC1/SC29/WG11 MPEG2015/N15084, Geneva, Switzerland, Feb. 2015.
12. User Requirements for Video Monitors in Television Production, document TECH 3320, Geneva, Switzerland, Oct. 2014.
13. T. Smith and J. Guild, "The C.I.E. colorimetric standards and their use," Trans. Opt. Soc., vol. 33, no. 3, pp. 73-134, 1931.
14. Parameter Values for the HDTV Standards for Production and International Programme Exchange, document Rec. ITU-R BT.709-5, Apr. 2002. [Online]. Available: http://www.itu.int/rec/R-REC-BT.709
15. Parameter Values for Ultra-High Definition Television Systems for Production and International Programme Exchange, document Rec. ITU-R BT.2020-1, Jun. 2014. [Online]. Available: http://www.itu.int/rec/R-REC-BT.2020
16. K. Jansen. (Feb. 2014). The Pointer's Gamut - The Coverage of Real Surface Colors by RGB Color Spaces and Wide Gamut Displays. TFT Central. [Online]. Available: http://www.tftcentral.co.uk/articles/pointers-gamut.htm
17. T. Mitsunaga and S. K. Nayar, "Radiometric self calibration," in Proc. IEEE Comput. Soc. Conf. CVPR, Fort Collins, CO, USA, Jun. 1999, pp. 374-380.
18. M. D. Tocci, C. Kiser, N. Tocci, and P. Sen, "A versatile HDR video production system," ACM Trans. Graph., vol. 30, no. 4, 2011, Art. ID 41.
19. M. Schoberl, A. Belz, J. Seiler, S. Foessel, and A. Kaup, "High dynamic range video by spatially non-regular optical filtering," in Proc. 19th IEEE ICIP, Orlando, FL, USA, Sep./Oct. 2012, pp. 2757-2760.
20. E. Reinhard, E. François, R. Boitard, C. Chamaret, C. Serré, and T. Pouli, "High dynamic range video chains," in Proc. Int. Broadcast. Conv. (IBC), Amsterdam, The Netherlands, Sep. 2014.
21. M. Price et al., "Production of high dynamic range video," BBC Res. Develop., London, U.K., White Paper WHP269, Sep. 2013.
22. Science and Technology Council, The Academy Color Encoding System, Academy Motion Picture Arts Sci., Beverly Hills, CA, USA, 2013.
23. E. Reinhard, W. Heidrich, P. Debevec, S. Pattanaik, G. Ward, and K. Myszkowski, High Dynamic Range Imaging, 2nd ed. San Francisco, CA, USA: Morgan Kaufmann, 2010.
24. K. Myszkowsi, R. Mantiuk, and G. Krawczyk, High Dynamic Range Video. San Rafael, CA, USA: Morgan & Claypool, 2008.
25. P. Hanhart, P. Korshunov, T. Ebrahimi, Y. Thomas, and H. Hoffmann, "Subjective quality evaluation of high dynamic range video and display for future TV," in Proc. Int. Broadcast. Conv. (IBC), Amsterdam, The Netherlands, Sep. 2014.
26. C. Fogg, J. Helman, M. Smith, and M. Zink, Content Light Level Information SEI, document JCTVC-T0101, Geneva, Switzerland, Feb. 2015.
27. S. Miller, M. Nezamabadi, and S. Daly, "Perceptual signal coding for more efficient usage of bit codes," SMPTE Motion Imag. J., vol. 122, no. 4, pp. 52-59, May/Jun. 2013.
28. T. Borer, "Non-linear opto-electrical transfer functions for high dynamic range television," BBC Res. Develop., London, U.K., White Paper WHP 283, Jul. 2014.
29. Y. Nishida, T. Yamashita, A. Ichigaya, and T. Shimizu, Proposed Addition of Transfer Characteristics in VUI, document JCTVC-U0032, Warsaw, Poland, Jun. 2015.
30. R. Mantiuk, G. Krawczyk, K. Myszkowski, and H.-P. Seidel, "High dynamic range image and video compression - Fidelity matching human visual performance," in Proc. IEEE ICIP, vol. 1. San Antonio, TX, USA, Sep./Oct. 2007, pp. I-9-I-12.
31. C. Poynton, J. Stessen, and R. Nijland, "Deploying wide color gamut and high dynamic range in HD and UHD," in Proc. Int. Broadcast. Conv. (IBC), Amsterdam, The Netherlands, Sep. 2014.
32. S. Y. Choi, K.-J. Oh, D. S. Park, and D. K. Nam, "Constant vs. non-constant luminance video signals for UHDTV," in SID Symp. Dig. Tech. Papers, Jun. 2013, vol. 44, no. 1, pp. 1082-1085.
33. High Dynamic Range Electro-Optical Transfer Function of Mastering Reference Displays, SMPTE Standard ST 2084, 2014.
34. Mastering Display Color Volume Metadata Supporting High Luminance and Wide Color Gamut Images, SMPTE Standard ST 2086, 2014.
35. G. J. Sullivan, J. Ohm, W.-J. Han, and T. Wiegand, "Overview of the High Efficiency Video Coding (HEVC) standard," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1649-1668, Dec. 2012.
36. J. Ohm, G. J. Sullivan, H. Schwarz, T. K. Tan, and T. Wiegand, "Comparison of the coding efficiency of video coding standards - Including High Efficiency Video Coding (HEVC)," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1669-1684, Dec. 2012.
37. V. Sze, M. Budagavi, and G. J. Sullivan, Eds., High Efficiency Video Coding (HEVC): Algorithms and Architectures. Berlin, Germany: Springer-Verlag, Jul. 2014.
38. M. Wien, High Efficiency Video Coding: Coding Tools and Specification. Berlin, Germany: Springer-Verlag, Jan. 2015.
39. A. Luthra, E. François, and W. Husak, Draft Call for Evidence (CfE) for HDR and WCG Video Coding, document ISO/IEC JTC1/SC29/WG11 MPEG2015/N15083, Geneva, Switzerland, Feb. 2015.
40. Test Results of Call for Evidence (CfE) for HDR and WCG Video Coding, document ISO/IEC JTC1/SC29/WG11 MPEG2015/N15350, Warsaw, Poland, Jun. 2015.
41. R. Boitard, R. K. Mantiuk, and T. Pouli, "Evaluation of color encodings for high dynamic range pixels," Proc. SPIE, Human Vis. Electron. Imag XX, p. 93941K, Mar. 2015.
42. DVB, "UHDTV - The building blocks," DVB Scene J., no. 44, Sep. 2014.
43. Evidence Motivates MPEG to Launch New Standardization Effort for HDR, document ISO/IEC JTC1/SC29/WG11 MPEG2015/N15328, Warsaw, Poland, Jun. 2015.
44. P. G. J. Barten, "Formula for the contrast sensitivity of the human eye," Proc. SPIE, Image Quality Syst. Perform., pp. 231-238, Dec. 2003.
45. Reference Electro-Optical Transfer Function for Flat Panel Displays Used in HDTV Studio Production, document Rec. ITU-R BT.1886, Mar. 2011. [Online]. Available: http://www.itu.int/rec/R-REC-BT.1886
46. C. Fogg, Compression Performance of StEM Content, document JCTVC-R0216, Sapporo, Japan, Jul. 2014.
47. A. Segall, L. Kerofsky, and S. Lei, Tone Mapping SEI Message, document JVT-S087, Geneva, Switzerland, Apr. 2006.
48. A. Segall, L. Kerofsky, and S. Lei, Tone Mapping SEI Message, document JVT-T060, Klagenfurt, Austria, 2006.
49. P. Bordes, P. Andrivon, P. Lopez, and F. Hiron, Color Mapping SEI Message, document JCTVC-N0180, Vienna, Austria, Jul. 2013.
50. P. Andrivon, P. Bordes, and E. François, SEI Message for Colour Mapping Information, document JCTVC-Q0074, Valencia, Spain, Mar. 2014.
51. S. Hattori, O. Nakagami, and T. Suzuki, HLS: SEI Message for Knee Function Information, document JCTVC-P0050, San José, Costa Rica, Jan. 2014.
52. J. Boyce and Y. Ye, "HEVC scalability extensions," IEEE Trans. Circuits Syst. Video Technol., vol. 26, no. 1, Jan. 2016.
53. Y. W. He, Y. Ye, J. Dong, X. Li, J. Chen, and M. Karczewicz, Non-SCE1: Improved Color Gamut Scalability, document JCTVC-P0197, San Jose, CA, USA, Jan. 2014.
54. X. Li, J. Chen, and M. Karczewicz, Non-SCE1: Asymmetric 3D LUT for Color Gamut Scalability, document JCTVC-P0063, San Jose, CA, USA, Jan. 2014.
55. G. Bjøntegaard, Improvements of the BD-PSNR Model, document VCEG-AI11, Berlin, Germany, Jul. 2008.
56. P. Bordes, P. Andrivon, F. Hiron, P. Salmon, and R. Boitard, SCE4: Results on 5.3-test1 and 5.3-test2, document JCTVC-O0159, Geneva, Switzerland, Oct./Nov. 2013.
57. X. Li et al., Non-SCE1: Improved CGS Partitioning on Top of SHM-6, document JCTVC-R0151, Sapporo, Japan, Jul. 2014.
58. A. Aminlou, K. Ugur, M. M. Hannuksela, E. Alshina, and A. Alshin, SCE4: Test 5.1 Results on Bit-Depth and Color-Gamut Scalability, document JCTVC-O0194, Geneva, Switzerland, Oct.-Nov. 2013.
59. Y. He, Y. Ye, and J. Dong, Non-SCE4/AHG14: Combined Bit-Depth and Color Gamut Conversion With 3D LUT for SHVC Color Gamut Scalability, document JCTVC-O0161, Geneva, Switzerland, Oct./Nov. 2013.
60. C. Fogg and J. Helman, VUI Entries for YXZ and Digital Cinema EOTF, document JCTVC-Q0084, Valencia, Spain, Mar./Apr. 2014.
61. G. M. Johnson, X. Song, E. D. Montag, and M. D. Fairchild, "Derivation of a color space for image color difference measurement," Color Res. Appl., vol. 35, no. 6, pp. 387-400, 2010.
62. M. D. Fairchild and D. R. Wyble, "HDR-CIELAB and HDR-IPT: Simple models for describing the color of high-dynamic-range and wide-color-gamut images," in Proc. IS&T/SID 18th Color Imag. Conf., San Antonio, TX, USA, 2010, pp. 322-326.
63. C. Lee and C.-S. Kim, "Rate-distortion optimized compression of high dynamic range videos," in Proc. 16th Eur. Signal Process. Conf. (EUSIPCO), Lausanne, Switzerland, Aug. 2008, pp. 1-5.
64. G. Ward and M. Simmons, "Subband encoding of high dynamic range imagery," in Proc. 1st Symp. Appl. Perception Graph. Visualizat., Aug. 2004, pp. 83-90.
65. Z. Mai, H. Mansour, R. Mantiuk, P. Nasiopoulos, R. Ward, and W. Heidrich, "Optimizing a tone curve for backward-compatible high dynamic range image and video compression," IEEE Trans. Image Process., vol. 20, no. 6, pp. 1558-1571, Jun. 2011.
66. A. Koz and F. Dufaux, "Optimized tone mapping with perceptually uniform luminance values for backward-compatible high dynamic range video compression," in Proc. IEEE VCIP, San Diego, CA, USA, Nov. 2012, pp. 1-6.
67. R. Mantiuk, A. Efremov, K. Myszkowski, and H.-P. Seidel, "Backward compatible high dynamic range MPEG video compression," in Proc. ACM SIGGRAPH, Saarbrücken, Germany, 2006, pp. 713-723.
68. A. Motra and H. Thoma, "An adaptive LogLuv transform for high dynamic range video compression," in Proc. 17th IEEE ICIP, Hong Kong, Sep. 2010, pp. 2061-2064.
69. Y. Zhang, E. Reinhard, and D. Bull, "Perception-based high dynamic range video compression with optimal bit-depth transformation," in Proc. 18th IEEE ICIP, Brussels, Belgium, Sep. 2011, pp. 1321-1324.
70. E. François, C. Gisquet, G. Laroche, and P. Onno, AHG18: On 16-Bits Support for Range Extensions, document JCTVC-N0142, Vienna, Austria, Jul. 2013.
71. W.-S. Kim, W. Pu, J. Chen, Y.-K. Wang, J. Sole, and M. Karczewicz, AhG 5 and 18: High Bit-Depth Coding Using Auxiliary Picture, document JCTVC-O0190, Geneva, Switzerland, Oct. 2013.
72. A. Aminlou and K. Ugur, On 16-Bit Coding, document JCTVC-P0162, San Jose, CA, USA, Jan. 2014.
73. C. Auyeung and J. Xu, AhG 5 and 18: Cross-Check of Coding of High Bit-Depth Source With Lower Bit-Depth Encoders and a Continuity Mapping, document JCTVC-P0173, San Jose, CA, USA, Jan. 2014.
74. S. Lasserre, F. Le Leannec, and E. François, High Dynamic Range Video Coding, document JCTVC-P0159, San Jose, CA, USA, Jan. 2014.
75. F. Le Léannec, S. Lasserre, and E. François, Modulation Channel SEI Message, document JCTVC-R0139, Sapporo, Japan, Jul. 2014.
76. F. Le Léannec, S. Lasserre, and E. François, Usage of Modulation Channel for High Bit-Depth Signal Encoding, document JCTVC-R0267, Sapporo, Japan, Jul. 2014.