Spatiotemporal visual considerations for video coding

IEEE Transactions on Multimedia

Volumn 9, Issue 2, 2007, Pages 231-238

  Tang, Chih Wei ^a,b  

^a IEEE   (Taiwan)

^b NATIONAL CENTRAL UNIVERSITY   (Taiwan)

Author keywords

Adaptive quantization; Bit allocation; Eye movement; H.264; Spatiovelocity contrast sensitivity; Visual attention; Visual masking

Indexed keywords

ADAPTIVE QUANTIZATION; BIT ALLOCATION; EYE MOVEMENT; SPATIOVELOCITY CONTRAST SENSITIVITY; VISUAL ATTENTION; VISUAL MASKING;

COSINE TRANSFORMS; IMAGE COMPRESSION; IMAGE QUALITY; SENSORY PERCEPTION; VISION;

IMAGE CODING;

EID: 33846650999     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2006.886328     Document Type: Article

References (34)

1. S. Winkler, "A perceptual distortion metric for digital color video," in Proc. SPIE Human Vision and Electronic Imaging, San Jose, CA, Jan. 1999, vol. 3644, pp. 175-184.
2. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video quality assessment," IEEE Trans. Multimedia, vol. 4, no. 1, pp. 129-132, Mar. 2002.
3. S. J. P. Westen, R. L. Lagendijk, and J. Biemond, "Spatio-temporal model of human vision for digital video compression," in Proc. SPIE Conf. Human Vision and Electronic Imaging, San Jose, CA, 1997.
4. A. B. Watson, J. J. F. Hu, and McGowan, "Digital video quality metric based on human vision," J. Electron, Imag., vol. 10, no. 1, pp. 20-29, 2001.
5. L. Itti, "Automatic foveation for video compression using a neurobiological model of visual attention," IEEE Trans. Image Process., vol. 13, no. 10, pp. 1304-1318, Oct. 2004.
6. D. Agrafiotis, N. Canagarajah, D. R. Bull, and M. Dye, "Perceptually optimized sign language video coding based on eye tracking analysis," Electron. Lett., vol. 39, no. 2, pp. 1703-1705, Nov. 2003.
7. Z. Wang, L. Lu, and A. C. Bovik, "Foveation scalable video coding with automatic fixation selection," IEEE Trans. Image Process., vol. 12, no. 2, pp. 243-254, Feb. 2003.
8. A. Basu and K. Wiebe, "Videoconferencing using spatially varying sensing with multiple and moving foveas," in Proc. IEEE Int. Conf. Pattern Recognition, Oct. 1994.
9. R. A. Rensink, J. K. O. Regan, and J. J. Clark, "To see or not to see: The need for attention to perceive changes in scenes," Psychol. Sci., vol. 8, pp. 368-373, 1997.
10. C. M. Privitera and L. M. Stark, "Algorithms for defining visual regions-of-interest: Comparison with eye fixations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 9, pp. 970-982, Sep. 2000.
11. Y.-F. Ma and H.-J. Zhang, "A model of motion attention for video skimming," in Proc. Int. Conf. Image Processing, 2002, vol. 1, pp. I-129-132.
12. J. G. Robson, "Spatial and temporal contrast sensitivity functions of the visual system," J. Opt. Soc. Amer., vol. 56, pp. 1141-1142, 1966.
13. D. H. Kelly, "Motion and vision ii. Stabilized spatio-temporal threshold surface," J. Opt. Soc. Amer., vol. 69, no. 10, pp. 1340-1349, Oct. 1979.
14. F. X. J. Lukas and Z. L. Budrikis, "Picture quality prediction based on a visual model," IEEE Trans. Commun., vol. 30, no. COMM-7, pp. 1679-1692, Jul. 1982.
15. S.-C. Pei and C.-L. Lai, "Very low bit-rate coding algorithm for stereo video with spatio-temporal HVS model and binary correlation disparity estimator," IEEE J. Select. Areas Commun., vol. 16, no. 1, pp. 98-107, Jan. 1998.
16. S. Daly, "Engineering observations from spatiovelocity and spatiotemporal visual models," in IS&T/SPIE Conf. Human Vision and Electronic and Electronic Imaging IV, 1999, vol. 3644, pp. 162-166.
17. H. Yee, S. Pattanaik, and D. P. Greenberg, "Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments," ACM Trans. Comput. Graph., vol. 20, no. 1, pp. 39-65, Jan. 2001.
18. F. Pereira and T. Ebrahimi, The MPEG-4 Book. Upper Saddle River, NJ: Prentice-Hall, 2002, pp. 669-675.
19. J. A. Solomon, A. B. Watson, and A. J. Ahumada, "The visibility of DCT basis functions: Effects of contrast masking," in Proc. Data Compress. Conf., 1994, pp. 361-370.
20. J. A. Ferwerda, S. N. Pattanaik, P. Shirley, and D. P. Greenberg, "A model of visual masking for computer graphics," Comput. Graph., pp. 143-152, 1997.
21. A. B. Watson and J. A. Solomon, "A model of visual contrast gain control and pattern masking," J. Opt. Soc. Amer. A, vol. 14, pp. 2377-2391, 1997.
22. S. H. Tan, K. K. Pang, and K. N. Ngan, "Classified perceptual coding with adaptive quantization," IEEE Trans. Circuits Syst. Video Technol., vol. 6, no. 4, pp. 375-388, Aug. 1996.
23. X. Yang, W. Lin, Z. lu, Z. Lin, S. Rahardja, E. Ong, and S. Yao, "Rate control for videophone using local perceptual cues," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 4, pp. 496-507, Apr. 2005.
24. L. Itti, "Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes," Vis. Cognit., vol. 12, no. 6, pp. 1093-1123, Aug. 2005.
25. C. Koch, Biological Models of Motion Perception: Spatio-Temporal Energy Models and Electrophysiology, Caltech, Pasadena, CA, 2004 [Online]. Available: www.klab.caltech.edu/cns186/cns186-motion-2.pdf
26. A. Mack and I. Rock, Inattentional Blindness. Cambridge, MA: MIT Press, 1998.
27. D. C. Dennett, Consciousness Explained. Baltimore, MD: Penguin, 1991.
28. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
29. R. A. Rensink, "A model of saliency-based visula attention for rapid scence analysis," in ACM Proc. 2nd Int. Symp. Smart Graphics, New York, 2002, pp. 63-70.
30. L. Itti and P. Baldi, "A principled approach to detecting surprising events in video," in Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, San Diego, CA, Jun. 2005.
31. A. B. Watson, "Visual optimization of DCT quantization matrices for individual images," in Proc. AIAA Computing in Aerospace 9. San Diego, CA: American Institute of Aeronautics and Astronautics, 1993, pp. 286-291.
32. B. Chitprasert and K. R. Rao, "Human visual weighted progressive image transmission," IEEE Trans. Commun., vol. 38, no. 7, pp. 1040-1944, Jul. 1990.
33. H.264/AVC Software [Online]. Available: http://iphome.hhi.de/ suehring/tml
34. F. Pereira and T. Ebrahimi, The MPEG-4 Book. Upper Saddle River, NJ: Prentice-Hall, 2002, pp. 669-675.