Foveated image and video coding

Digital Video Image Quality and Perceptual Coding

Volumn , Issue , 2017, Pages 431-457

  Wang, Zhou ^a   Bovik, Alan C ^b  

^a UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85133621728     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (66)

1. T. L. Arnow and W. S. Geisler. Visual detection following retinal damage: Prediction of an inhomogeneous retino-cortical model. Proc. SPIE: Human Vision and Electronic Imaging, 2674:119-130, 1996.
2. S. Aramvith and M.-T. Sun. Handbook of Image and Video Processing(MPEG-1 and MPEG-2 video standards). San Diego, CA: Academic Press, May 2000.
3. P. J. Burt and E. H. Adelson. The Laplacian pyramid as a compact image code. IEEE Trans. Communications, 31:532-540, April 1983.
4. C. Bandera and P. Scott. Foveal machine vision systems. IEEE Inter. Conf. Systems, Man and Cybernetics, 569-599, November 1989.
5. M. S. Banks, A. B. Sekuler, and S. J. Anderson. Peripheral spatial vision: Limits imposed by optics, photoreceptors, and receptor pooling. Journal of the Optical Society of America, 8:1775-1787, 1981.
6. A. Basu, A. Sullivan, and K. J. Wiebe. Variable resolution teleconferencing. IEEE Inter. Conf. Systems, Man, and Cybernetics, 170-175, October 1993.
7. P. J. Burt. Smart sensing within a pyramid vision machine. Proc. IEEE, 76:1005-1015, August 1988.
8. A. Basu and K. J. Wiebe. Videoconferencing using spatially varying sensing with multiple and moving fovea. IEEE Trans. Systems, Man and Cybernetics, 28(2):137-148, March 1998.
9. P. Camacho, F. Arrebola, and F. Sandoval. Shifted fovea multiresolution geometries. IEEE Inter. Conf. Image Processing, 1:307-310, 1996.
10. E.-C. Chang, S. Mallat, and C. Yap. Wavelet foveation. Journal of Applied and Computational Harmonic Analysis, 9(3):312-335, October2000.
11. S.-J. Choi and J. W. Woods. Motion-compensated 3-D subband coding of video. IEEE Trans. Image Processing, 8(2):155-167, February 1999.
12. E.-C. Chang and C. Yap. A wavelet approach to foveating images. ACMSymposiumon Computational Geometry, 397-399, June 1997.
13. S. Daly, K. Matthews, and J. Ribas-Corbera. As plain as the noise on your face: Adaptive video compression using face detection and visual eccentricity models. Journal of Electronic Imaging, 10:30-46, January 2001.
14. R. Etienne-Cummings, J. van der Spiegel, P. Mueller, and M.-Z. Zhang. A foveated silicon retina for two-dimensional tracking. IEEE Trans. Circuits and Systems II, 47(6):504-517, June 2000.
15. W. S. Geisler and M. S. Banks. Handbook of Optics:Visual performance. New York: McGraw-Hill, 1995.
16. W. S. Geisler and J. S. Perry. A real-time foveated multiresolution system for low-bandwidth video communication. Proc. SPIE: Human Vision and Electronic Imaging, 3299(2):294-305, July 1998.
17. W. S. Geisler and J. S. Perry. Space variant imaging. Center for Perceptual Systems, The University of Texas at Austin, 2002. http://fi.cvis.psy.utexas.edu/.
18. C. Garcia and G. Tziritas. Face detection using quantized skin color regions merging and wavelet packet analysis. IEEE Trans. Multimedia, 1(3):264-277, September 1999.
19. L. Itti. Models of bottom-up and top-down visual attention. Ph.D. thesis, California Institute of Technology, Pasadena, CA, 2000.
20. A. Koz and A. Alatan. Foveated image watermarking. IEEE Inter. Conf. Image Processing, 3:661-664, September 2002.
21. W. N. Klarquist and A. C. Bovik. FOVEA: A foveated vergent active stereo vision system for dynamic three-dimensional scene recovery. IEEE Trans. Robotics and Automation, 14(5):755-770, October 1998.
22. P. Kortum and W. S. Geisler. Implementation of a foveal image coding system for image bandwidth reduction. Proc. SPIE: Human Vision and Electronic Imaging, 2657:350-360, 1996.
23. T. Kuyel, W. Geisler, and J. Ghosh. Retinally reconstructed images: digital images having a resolution match with the human eyes. IEEE Trans. Systems, Man and Cybernetics, Part A: Systems and Humans, 29(2):235-243, March 1999.
24. J. M. Kinser. Foveation from pulse images. IEEE Inter. Conf. Information Intelligence and Systems, 86-89, 1999.
25. S. Lee and A. C. Bovik. Foveated video demonstration, 2000. Department of Electrical and Computer Engineering, The University of Texas at Austin. http://live.ece.utexas.edu/research/foveated_video/demo.html.
26. S. Lee and A. C. Bovik. Fast algorithms for foveated video processing. IEEE Trans. Circuits and Systems for Video Tech., 13(2):148-162, February 2003.
27. S. Lee. Foveated video compression and visual communications over wireless and wireline networks. Ph.D. thesis, Dept. of ECE, University of Texas, Austin, May 2000.
28. S. Liu. DCT domain video foveation and transcoding for heterogeneous video communication. Ph.D. thesis, Dept. of ECE, University of Texas, Austin, 2002.
29. S. Lee, M. S. Pattichis, and A. C. Bovik. Foveated video compression with optimal rate control. IEEE Trans. Image Processing, 10(7):977-992, July 2001.
30. S. Lee, M. S. Pattichis, and A. C. Bovik. Foveated video quality assessment. IEEE Trans. Multimedia, 4(1):129-132, March 2002.
31. S. Lee, C. Podilchuk, V. Krishnan, and A. C. Bovik. Foveation-based error resilience and unequal error protection over mobile networks. Journal of VLSI Signal Processing, 34(1/2):149-1666, May 2003.
32. M. Levoy and R. Whitaker. Gaze-Directed Volume Rendering. Computer Graphics, 24(2):217-223, 1990.
33. S. G. Mallat. A wavelet tour of signal processing, vol. 31. San Diego, CA: Academic Press, 2nd ed., September 1999.
34. C. M. Privitera and L. W. Stark. Algorithms for defining visual regions-of-interest: comparison with eye fixations. IEEE Trans. Pattern Analysis and Machine Intelligence, 22(9):970-982, September 2000.
35. U. Rajashekar, L. K. Cormack, and A. C. Bovik. Image features that draw fixations. IEEE Inter. Conf. Image Processing, 3:313-316, September 2003.
36. J. G. Robson and N. Graham. Probability summation and regional variation in contrast sensitivity across the visual field. Vision Research, 21:409-418, 1981.
37. T. H. Reeves and J. A. Robinson. Adaptive foveation of MPEG video. ACM Multimedia, 231-241, 1996.
38. A. S. Rojer and E. L. Schwartz. Design considerations for a space-variant visual sensor with complex-logarithmic geometry. IEEE Inter. Conf. Pattern Recognition, 2:278-285, 1990.
39. D. L. Ruderman. The statistics of natural images. Network: Computation in Neural Systems, 5:517-548, 1996.
40. U. Rajashekar, Z. Wang, and A. C. Bovik. Real-time foveation: An eye tracker-driven imaging system, 2001. Accessible at http://live.ece.utexas.edu/research/realtime_foveation/.
41. M. F. Sabir. Unequal error protection for scalable foveated image communication. Master's thesis, Dept. of ECE, University of Texas, Austin, May 2002.
42. P. L. Silsbee, A. C. Bovik, and D. Chen. Visual pattern image sequence coding. IEEE Trans. Circuits and Systems for Video Tech., 3(4):291-301, August 1993.
43. E. L. Schwartz. Spatial mapping in primate sensory projection: Analytic structure and relevance to perception. Biological Cybernetics, 25:181-194, 1977.
44. E. L. Schwartz. Computational anatomy and functional architecture of striate cortex: a spatial mapping approach to perceptual coding. Vision Research, 20:645-669, 1980.
45. K. S. Shen and E. J. Delp. Wavelet based rate scalable video compression. IEEE Trans. Circuits and Systems for Video Technology, 9(1):109-122, February 1999.
46. H. R. Sheikh, B. L. Evans, and A. C. Bovik. Real-time foveation techniques for low bit rate video coding. Real-time Imaging, 9(1):27-40, February 2003.
47. J. M. Shapiro. Embedded image coding using zerotrees of wavelets coefficients. IEEE Trans. Signal Processing, 41:3445-3462, December 1993.
48. H. Sun, W. Kwok, and J. W. Zdepski. Architectures for MPEG compressed bitstream scaling. IEEE Trans. Circuits and Systems for Video Technology, 6(2):191-199, April 1996.
49. H. R. Sheikh, S. Liu, Z. Wang, and A. C. Bovik. Foveated multipoint videoconferencing at low bit rates. IEEE Inter. Conf. Acoust.,Speech, and Signal Processing, 2:2069-2072, May 2002.
50. A. Said and W. A. Pearlman. A new, fast, and efficient image codec based on set partitioning in hierarchical trees. IEEE Trans. Circuits and Systems for Video Technology, 6(3):243-250, June 1996.
51. N. Tsumura, C. Endo, H. Haneishi, and Y. Miyake. Image compression and decompression based on gazing area. Proc. SPIE: Human Vision and Electronic Imaging, 2657:361-367, 1996.
52. D. S. Taubman and M. W. Marcellin. JPEG2000: Image Compression Fundamentals, Standards, and Practice. Norwell, MA: Kluwer Academic Publishers, November 2001.
53. D. L. Tennenhouse, J. M. Smith, W. D. Sincoskie, D. J. Wetherall, and G. J. Mindenk. A survey of active network research. Proc. IEEE, 35, January 1997.
54. D. Taubman and A. Zakhor. Multirate 3-D subband coding of video. IEEE Trans. Image Processing, 3:572-588, September 1994.
55. J. D. Villasenor, Y.-Q. Zhang, and J. Wen. Robust video coding algorithms and systems. Proc. IEEE, 87:1724-1733, October 1999.
56. B. A. Wandell. Foundations of Vision. Sunderland, MA: Sinauer Associates, Inc., 1995.
57. Z. Wang. Rate scalable foveated image and video communications. Ph.D. thesis, Dept. of ECE, The University of Texas at Austin, December 2001.
58. ~zwang/files/research/efic/demo.html.
59. Z. Wang and A. C. Bovik. Embedded foveation image coding. IEEE Trans. Image Processing, 10(10):1397-1410, October 2001.
60. Z. Wang, A. C. Bovik, and L. Lu. Wavelet-based foveated image quality measurement for region of interest image coding. IEEE Inter. Conf. Image Processing, 2:89-92, October 2001.
61. H. Wang and S.-F. Chang. A highly efficient system for automatic face region detection in MPEG video. IEEE Trans. Circuits and Systems for Video Technology, 7(4):615-628, 1997.
62. C. Weiman. Video compression via a log polar mapping. Proc. SPIE: Real Time Image Processing II, 1295:266-277, 1990.
63. Z. Wang, L. Lu, and A. C. Bovik. Foveation scalable vidoe coding with automatic fixation selection. IEEE Trans. Image Processing, 11(2):243-254, February 2003.
64. R. S. Wallace, P. W. Ong, B. Bederson, and E. L. Schwartz. Space variant image processing. International Journal of Computer Vision, 13(1):71-90, 1994.
65. A. B. Watson, G. Y. Yang, J. A. Solomon, and J. Villasenor. Visibility of wavelet quantization noise. IEEE Trans. Image Processing, 6(8):1164-1175, 1997.
66. Y. Y. Zeevi and E. Shlomot. Nonuniform sampling and antialiasing in image representation. IEEETrans. Signal Processing, 41(3):1223-1236, March 1993.