A practical foveation-based rate-shaping mechanism for MPEG videos

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 15, Issue 11, 2005, Pages 1365-1372

  Ho, Chia Chiang ^a,b   Wu, Ja Ling ^a,c,d   Cheng, Wen Huang ^a,c  

^a IEEE   (Taiwan)

^b CyberLink Corp   (Taiwan)

^c NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^d Dept of Comp Science Engineering   (Taiwan)

Author keywords

Foveated image processing; Foveation model; Human visual system (HVS); MPEG; Rate shaping

Indexed keywords

FOVEATED IMAGE PROCESSING; FOVEATION MODEL; HUMAN VISUAL SYSTEM (HVS); MPEG; RATE SHAPING;

COMPUTER SIMULATION; IMAGE PROCESSING; IMAGE QUALITY; OPTICAL RESOLVING POWER; VISION;

IMAGE CODING;

EID: 27844517008     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2005.856929     Document Type: Article

References (39)

1. S. Lee, M. S. Pattichis, and A. C. Bovik, "Rate control for foveated MPEG/H.263 video," in Proc. Int. Conf. Image Processing, vol. 2, 1998, pp. 365-369.
2. S. Lee and A. C. Bovik, "Very low bit rate foveated video coding for H.263," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing, vol. 6, 1999, pp. 3113-3116.
3. Z. Wang, L. Lu, and A. C. Bovik, "Rate scalable video coding using a foveation-based human visual system model," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing, vol. 3, 2001, pp. 1785-1788.
4. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video quality assessment," IEEE Trans. Multimedia, vol. 4, pp. 129-132, Mar. 2002.
5. Information Technology - Generic Coding of Moving Pictures and Associated Audio. Part 2: Video, 1995.
6. Information Technology - Coding of Audio-Visual Objects. Part 2: Visual, 1999.
7. W. H. R. Equitz and T. M. Cover, "Successive refinement of information," IEEE Trans. Inf. Theory, vol. 37, pp. 269-275, 1991.
8. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video compression with optimal rate control," IEEE Trans. Image Process., vol. 10, no. 7, pp. 977-992, Jul. 2001.
9. S. Lee and A. C. Bovik, "Fast algorithms for foveated video processing," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 2, pp. 149-162, 1 Feb. 2003.
10. R. S. Wallace, P.-W. Ong, B. B. Bederson, and E. L. Schwartz, "Space-variant image processing," Int. J. Comput. Vis., vol. 13, no. 1, pp. 71-90, 1994.
11. N. Tsumura, C. Endo, H. Haneishi, and Y. Miyake, "Image compression and decomposition based on gazing area," Proc. SPIE, vol. 2657, pp. 361-367, 1996.
12. T. Kuyel, W. Geisler, and J. Ghosh, "Retinally reconstructed images: digital images having a resolution match with the human eyes," IEEE Trans. Syst, Man, Cybern. A, vol. 29, no. 3, pp. 235-243, Mar. 1999.
13. W. S. Geisler and J. S. Perry, "A real-time foveated multiresolution system for low-bandwidth video communication," in Proc. SPIE, vol. 3299, Human Vision and Electronic Imaging, 1998, pp. 294-305.
14. Z. Wang and A. C. Bovik, "Embedded foveation image coding," IEEE Trans. Image Process., vol. 10, pp. 1397-1410, Oct. 2001.
15. W. S. Geisler, "Visual detection following retinal damage: predictions of an inhomogeneous retino-cortical model," in Proc. SPIE, vol. 2674, Human Vision and Electronic Imaging, 1996, pp. 119-130.
16. M. S. Banks, A. B. Sekuler, and S. J. Anderson, "Peripheral spatial vision: limits imposed by optics, photoreceptors and receptor pooling," J. Opt. Soc. Amer. A, vol. 8, pp. 1775-1787, 1991.
17. J. Ahumada, Jr. and H. A. Peterson, "Luminance-model-based DCT quantization for color image compression," in Proc. SPIE, vol. 1666, Human Vision, Visual Processing, and Digital Display III, 1992, pp. 365-374.
18. G. C. Phillips and H. R. Wilson, "Orientation bandwidths of spatial mechanisms measured by masking," J. Opt. Soc. Amer. A, vol. 1, pp. 226-232, 1984.
19. B. Watson, "Detection and recognition of simple spatial forms," in Physical and Biological Processing of Images, O. J. Braddick and A. C. Sleigh, Eds. Berlin, Germany: Springer-Verlag, 1983, pp. 100-114.
20. A. C. Eleftheriadis and D. Anastassiou, "Constrained and general dynamic rate shaping of compressed digital video," in Proc. Int. Conf. Image Proc., vol. 3, Oct. 1995, pp. 396-399.
21. _, "Meeting arbitrary QoS constraints using dynamic rate shaping of coded digital video," in Proc. NOSDAV, 1995, pp. 95-106.
22. Y. Wang, J. Ostermann, and Y.-Q. Zhang, Video Processing and Communications. Upper Saddle River, NJ: Prentice-Hall, 2002.
23. S. Jacobs and A. Eleftheriadis, "Real-time video on the web using dynamic rate shaping," in Proc. Int. Conf. Image Proc., vol. 2, 1997, pp. 250-253.
24. W. Zeng and B. Liu, "Rate shaping by block dropping for transmission of MPEG-precoded video over channel of dynamic bandwidth," in Proc. ACM Multimedia, Boston, MA, Nov. 1996, pp. 385-393.
25. W.-J. Zeng, B. Guo, and B. Liu, "Feature-oriented rate shaping of pre-compressed image/video," in Proc. Int. Conf. Image Proc., vol. 2, 1997, pp. 772-775.
26. N. Celandroni, E. Ferro, F. Potorti, A. Chimienti, and M. Lucenteforte, "DRS compression applied to MPEG-2 video data transmission over a satellite channel," in Proc. 5th IEEE Symp. Computers and Communications (ISCC), Antibes-Juan Les Pins, France, Jul. 2000, pp. 259-266.
27. T. P. Chen and T. Chen, "Adaptive joint source-channel coding using rate shaping," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing, vol. 2, Orlando, FL, May 2002, pp. 1985-1988.
28. H. R. Sheikh, S. Liu, Z. Wang, and A. C. Bovik, "Foveated multipoint videoconferencing at low bit rates," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing, vol. 2, Orlando, FL, May 2002, pp. 2069-2072.
29. T. H. Reeves and J. A. Robinson, "Adaptive foveation of MPEG video," in Proc. ACM Multimedia, Boston, MA, Nov. 1996, pp. 231-241.
30. _, "Rate control of foveated MPEG video," in Proc. IEEE Canadian Conf. Electrical and Computer Engineering, vol. 1, 1997, pp. 379-382.
31. D.-P. Wu, Y.-W. T. Hou, and Y.-Q. Zhang, "Transporting real-time video over the Internet: challenges and approaches," Proc. IEEE, vol. 88, no. 12, pp. 1855-1875, Dec. 2000.
32. Y. K. Kim, Z. He, and S. K. Mitra, "A novel linear source model and a unified rate control algorithm for H.263/MPEG-2/MPEG-4," in Proc. Intl. Conf. Acoustics, Speech, and Signal Processing, vol. 3, Salt Lake City, UT, May 2001, pp. 1777-1780.
33. Z. He and S. K. Mitra, "A unified rate-distortion analysis framework for tranform coding," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 12, pp. 1221-1236, Dec. 2001.
34. H.-J. Lee, T.-H. Chiang, and Y.-Q. Zhang, "Scalable rate control for MPEG-4 video," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 6, pp. 878-894, Sep. 2000.
35. B. Tao, B. W. Dickinson, and H. A. Peterson, "Adaptive model-driven bit allocation for MPEG video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 1, pp. 147-157, Feb. 2000.
36. C.-C. Ho, W.-H. Cheng, T.-J. Pan, and J.-L. Wu, "A user-attention based focus detection framework and its applications," in Proc. 4th IEEE Pacific-Rim Conf. Multimedia, Singapore, Dec. 2003.
37. C.-C. Ho, "A study of effective techniques for user oriented video streaming," Ph.D. dissertation, Dept. Comp. Sci. Inf. Eng., National Taiwan Univ., Taipei, May 2003.
38. L. Itti, "Automatic foveation for video compression using a neurobiological model of visual attention," IEEE Trans. Image Process., vol. 13, no. 10, pp. 1304-1318, Oct. 2004.
39. C.-C. Ho, W.-T. Chu, C.-H. Huang, and J.-L. Wu, "User-oriented approach in spatial and temporal domain video coding," in Proc. 4th IEEE Pacific-Rim Conf. Multimedia, Singapore, Dec. 2003, pp. 1341-1345.