Perceptual video coding: Challenges and approaches

2010 IEEE International Conference on Multimedia and Expo, ICME 2010

Volumn , Issue , 2010, Pages 784-789

  Chen, Zhenzhong ^a   Lin, Weisi ^b   Ngi Ngan, King ^c  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Human visual system; Perceptual video coding; Quality optimization; Visual perception

Indexed keywords

3D VIDEO; BOTTOM-UP AND TOP-DOWN; COMPUTATIONAL MODEL; CONTRAST SENSITIVITY FUNCTION; FUTURE RESEARCH DIRECTIONS; HIGH DYNAMIC RANGE VIDEO; HUMAN PERCEPTION; HUMAN VISUAL SYSTEM; HYBRID VIDEO CODING; IMMERSIVE; LATEST TECHNOLOGY; MASKING EFFECT; PERCEPTUAL QUALITY; PHYSIOLOGICAL CHARACTERISTICS; QUALITY OPTIMIZATION; SENSITIVITY MODELING; VIDEO APPLICATIONS; VIDEO CODING; VIDEO CODING SYSTEMS; VISUAL ATTENTION; VISUAL PERCEPTION; VISUAL SIGNALS;

CONSTRAINED OPTIMIZATION; FACE RECOGNITION; IMAGE CODING; MULTIMEDIA SERVICES; SIGNAL ENCODING; SIGNAL PROCESSING; THREE DIMENSIONAL; VIDEO RECORDING; VISION;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 78349261189     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICME.2010.5582549     Document Type: Conference Paper

References (48)

1. A57 dataset: foulard.ece.cornell.edu/dmc27/vsnr/vsnr.html
2. R. Blake and R. Sekuler, Perception, McGraw-Hill, 2006.
3. D. Chai and K. N. Ngan, "Foreground/background video coding scheme," ISCAS, 1997.
4. Z. Chen and C. Guillemot, "Perception-oriented video coding based on foveated JND Model," Picture Coding Symposium, 2009.
5. Z. Chen, J. Han, and K. N. Ngan, "Dynamic bit allocation for multiple video objects coding," IEEE Trans. Multimedia, pp. 1117-1124, Dec. 2006.
6. C.-H. Chou and Y.-C. Li, "A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile," IEEE Trans. Circuits Syst. Video Technol., pp. 467-476, Dec. 1995.
7. F. De Simone, M. Naccari, M. Tagliasacchi, F. Dufaux, S. Tubaro, and T. Ebrahimi, "Subjective assessment of H.264/AVC video sequences transmitted over a noisy channel", International Workshop on Quality of Multimedia Experience, July 2009.
8. W. S. Geisler and J. S. Perry, "A real-time foveated multisolution system for low-bandwidth video communication," SPIE Proceedings, vol. 3299, pp. 294-305, July 1998.
9. B. Girod, "Eye movements and coding of video sequences," in SPIE Visual Communications and Image Processing, 1988.
10. C.T.E.R. Hewage, S. Worrall, S. Dogan, and A.M. Kondoz, "Quality evaluation of colour plus depth map based stereoscopic video", IEEE Journal of Selected Topics in Signal Processing, pp. 304-318, April 2009.
11. L. Itti, "Automatic foveation for video compression using a neurobiological model of visual attention," IEEE Trans. Image Process., pp. 1304-1318, Oct. 2004.
12. L. Itti and C. Koch, "Computational modeling of visual attention," Nature Reviews Neuro., pp. 194-203, Mar. 2001.
13. ITU-R BT.500-11, "Methodology for the subjective assessment of the quality of television pictures," 2002.
14. ITU-T Rec. H.264 and ISO/IEC 14496-10, "Advanced Video Coding for Generic Audiovisual Services," May 2003.
15. N. Jayant, J. Johnston, and R. Safranek, "Signal compression based on models of human perception," Proc. IEEE, pp. 1385-1422, Oct. 1993.
16. Y. Jia, W. Lin, and A. A. Kassim, "Estimating just-noticeable distortion for video," IEEE Trans. Circuits Syst. Video Tech., pp. 820-829, July 2006.
17. D. H. Kelly, "Motion and vision II stabilized spatio-temporal surface," J. Opt. Soc. Amer., pp. 1340-1349, Oct. 1979.
18. W.-S. Kim, A. Ortega, P. Lai, D. Tian, and C. Gomila, "Depth map distortion analysis for view rendering and depth coding," ICIP, 2009.
19. G. Krawczyk, K. Myszkowski, H.-P. Seidel, "Perceptual effects in real-time tone mapping," Proceedings of the 21st spring conference on computer graphics, 2005.
20. W. Lin, "Computational models for just-noticeable difference," in Digital Video Image Quality and Perceptual Coding, H. R. Wu and K. R. Rao, Eds., CRC Press, 2006.
21. Z. Lu, W. Lin, X. Yang, E. Ong, and S. Yao, "Modeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation," IEEE Trans. Image Process., pp. 1928 - 1942, Nov. 2005.
22. J. Malo, J. Gutierrez, I. Epifanio, F. Ferri, and J. M. Artigas, "Perceptual feed-back in multigrid motion estimation using an improved DCT quantization," IEEE Trans. on Image Process., pp. 1411-1427, Oct. 2001.
23. J. L. Mannos and D. J. Sakrison, "The effects of a visual fidelity criterion on the encoding of images," IEEE Trans. Information Theory, vol. IT-20, pp. 525-536, July 1974.
24. R. Mantiuk, K. Myszkowski, H.-P. Seidel, "A perceptual framework for contrast processing of high dynamic range images," ACM Transactions on Applied Perception, pp. 286-308, 2006.
25. L. M. J. Meesters, W. A. Ijsselsteijn, and P. J. H. Seuntiëns, "A survey of perceptual evaluations and requirements of threedimensional TV," IEEE Trans. Circuits Syst. Video Tech., pp. 381-391, 2004.
26. P. Ndjiki-Nya, D. Bull, and T. Wiegand, "Perception-oriented video coding based on texture analysis and synthesis," ICIP, 2009.
27. A. G. Nguyen and J.-N. Hwang, "A novel hybrid HVPC/mathematical model rate control for low bit-rate streaming video," Signal Process.: Image Commun., pp. 423-440, May 2002.
28. A. Ninassi, O. L. Meur, P. L. Callet, and D. Barba, "Which semi-local masking model for wavelet base image quality metric," ICIP, 2008.
29. A. Ninassi, O. L. Meur, P. L. Callet, and D. Barba, "Considering temporal variations of spatial visual distortions in video quality assessment," IEEE Journal of Selected Topics in Signal Processing, pp. 253-265, April 2009.
30. M. Pinson and S. Wolf, "A new standardized method for objectively measuring video quality," IEEE Trans. on Broadcasting, pp. 312-322, Sept., 2004.
31. D. A. Robinson, "The mechanics of human smooth pursuit eye movement," J. Physiol., vol. 180, pp. 569-591, Oct. 1965.
32. T. Serre, L. Wolf, S. Bileschi, M. Riesenhuber, and T. Poggio, "Object recognition with cortex-like mechanisms," IEEE Trans. PAMI, pp. 411-426, 2007.
33. K. Seshadrinathan, R. Soundararajan, A. C. Bovik and L. K. Cormack, "A Subjective Study to Evaluate Video Quality Assessment Algorithms", SPIE Proceedings Human Vision and Electronic Imaging, Jan. 2010.
34. H.R. Sheikh and A.C. Bovik, "Image information and visual quality," IEEE Trans. Image Process., pp. 430-444, 2006.
35. C.-W. Tang, C.-H. Chen, Y.-H. Yu, and C.-J. Tsai, "Visual sensitivity guided bit allocation for video coding," IEEE Trans. Multimedia, pp. 11-18, Feb. 2006.
36. A. M. Treisman and G. Gelade, "A feature-integration theory of attention," ACM Computing Surveys Cognitive Psychology, pp. 97-136, 1980.
37. A. M. Triesman and R. Paterson, "Emergent features, attention and object perception," J. Exp. Psychol: Human Perception and Performance, pp. 12-31, 1984.
38. VQEG (Video Quality Experts Group) Phase-I Database. Available: http://www.vqeg.org
39. B. Wandell, Foundations of Vision, Sinauer Associates, Inc., Sunderland, MA, 1995.
40. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: from error visibility to structural similarity," IEEE Trans. on Image Process., pp. 600-612, Apr. 2004.
41. Z. Wang, L. Lu, and A. C. Bovik, "Foveation scalable video coding with automatic fixation selection," IEEE Trans. Image Process., pp. 243-254, Feb. 2003.
42. Z. Wei and K.N. Ngan, "Spatio-temporal just noticeable distortion profile for grey scale image/video in DCT domain," IEEE Trans. Circuits Syst. Video Tech., pp. 337-346, Mar. 2009.
43. S. Winkler and P. Mohandas, "The evolution of video quality measurement: From PSNR to hybrid metrics," IEEE Transactions on Broadcasting, pp. 660-668, Sept. 2008.
44. S. Winkler, Digital Video Quality: Vision Models and Metrics. West Sussex, England: John Wiley & Sons Ltd., 2005.
45. J. M. Wolfe, "Visual search," in Attention, H. Pashler, Ed. London, UK: Psychology Press, pp. 13-74, 1998.
46. K. C. Yang, C. C. Guest, K. El-Maleh, and P. K. Das, "Perceptual temporal quality metric for compressed video," IEEE Trans. on Multimedia, pp.1528-1535, Nov 2007.
47. X. Yang, W. Lin, Z. Lu, X. Lin, S. Rahardja, E. Ong, and S. Yao, "Rate control for videophone using perceptual sensitivity cues," IEEE Trans. Circuits Syst. Video Tech., pp. 496-507, April 2005.
48. C. Zhu, X. Sun, F. Wu, and H. Li, "Video coding with spatiotemporal texture synthesis and edge-based inpainting," ICME, 2008.