Fast algorithms for foveated video processing

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 13, Issue 2, 2003, Pages 149-162

  Lee, Sanghoon ^a   Bovik, Alan C ^b  

^a Yonsei University   (South Korea)

^b The University of Texas at Austin   (United States)

Author keywords

Foveated video; Foveated video algorithms; Foveated video processing

Indexed keywords

ALGORITHMS; BANDWIDTH; COMPUTATIONAL COMPLEXITY; DECODING; IMAGE CODING; IMAGE ENHANCEMENT; IMAGE QUALITY; MOTION COMPENSATION; MOTION ESTIMATION; NETWORK PROTOCOLS; REAL TIME SYSTEMS; SIGNAL TO NOISE RATIO;

DATA DENSITY; FOVEATED VIDEO ALGORITHMS; FOVEATED VIDEO STREAMS; FOVEATION PROTOCOL; VIDEO RATE CONTROL;

IMAGE COMMUNICATION SYSTEMS;

EID: 0037306285     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2002.808441     Document Type: Article

References (48)

1. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video quality assessment," IEEE Trans. Multimedia, vol. 4, pp. 129-132, Mar. 2002.
2. ____, "Foveated video compression with optimal rate control," IEEE Trans. Image Processing, vol. 10, pp. 977-992, July 2001.
3. S. Lee and A. C. Bovik, "Very low bit rate foveated video coding for \mboxH.263," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing '99, Phoenix, AZ, Mar. 1999, pp. VI3113-VI3116.
4. S. Lee, A. C. Bovik, and Y. Y. Kim, "Low delay foveated visual communications over wireless channels," in Proc. IEEE Int. Conf. Image Processing '99, Kobe, Japan, Oct. 1999.
5. S. Lee, C. Podilchuk, V. Krishnan, and C. Bovik, "Foveation-based error resilience and unequal error protection over mobile networks," J. VLSI Signal Processing Syst. for Signal, Image, and Video Technol., vol. 32, 2002.
6. B. A. Wandell, Foundations of Vision. Sunderland, MA: Sinauer Associates, 1994.
7. D. Pollen and S. Ronner, "Visual cortical neurons as localized spatial frequency filters," IEEE Trans. Syst., Man, Cybern., vol. SMC-13, pp. 907-916, Sept. 1983.
8. R. E. Kronauer and Y. Y. Zeevi, "Reorganization and diversification of signals in vision," IEEE Trans. Syst., Man, Cybern., vol. 15, pp. 91-101, Jan./Feb. 1985.
9. J.L. Mannos and D.J. Sakrison, "The effects of a visual fidelity criterion on the encoding of images," IEEE Trans. Inform. Technol., vol. 20, pp. 525-536, July 1974.
10. P. G. J. Barten, "Evaluation of subjective image quality with the square-root integral method," J. Opt. Soc. Amer., vol. 7, no. 10, pp. 2024-2031, Oct. 1990.
11. W. S. Geisler and J. S. Perry, "A real-time foveated multiresolution system for low-bandwidth video communication," in SPIE Proc., vol. 3299, 1998.
12. M. S. Banks, A. B. Sekuler, and S. J. Anderson, "Peripheral spatial vision: limits imposed by optics, photoreceptors, and receptor pooling," J. Opt. Soc. Amer., vol. 8, no. 10, pp. 1775-1787, Nov. 1991.
13. E. Peli, "Contrast in complex images," J. Opt. Soc. Amer., vol. 8, no. 10, pp. 1775-1787, Nov. 1991.
14. N. D. Venkata, T. D. Kite, W. S. Geisler, B. L. Evans, and A. C. Bovik, "Image quality assessment based on a degradation model," IEEE Trans. Image Processing, vol. 9, pp. 636-650, Apr. 2000.
15. T. D. Kite, B. L. Evans, and A. C. Bovik, "A fast, high-quality inverse halftoning algorithm for error diffused halftones," IEEE Trans. Image Processing, vol. 9, pp. 1583-1592, Sept. 2000.
16. K. J. Wiebe, "Variable resolution vision: biologically motivated foveal compression and prioritization," Ph.D. dissertation, Univ. of Alberta, Alberta, Canada, 1996.
17. E. L. Schwartz, "Spatial mapping in primate sensory projection: analytic structure and relevance to perception," Biol. Cybern., vol. 25, no. 4, pp. 181-194, 1977.
18. ____, "Computational anatomy and functional architecture of striate cortex: spatial mapping approach to perceptual coding," Vis. Res., vol. 20, no. 4, pp. 645-669, 1980.
19. G. Sandini and T. Tagliasco, "An anthropomorphic retina-like structure for scene analysis," Comput. Graph. Image Processing, no. 14, pp. 365-372, 1980.
20. R. S. Wallace, P. W. Ong, B. B. Bederson, and E. L. Schwartz, "Space variant image processing," Int. J. Comput. Vis., vol. 13, no. 1, pp. 71-90, Sept. 1994.
21. M. Tistarelli and G. Sandini, "On the advantages of polar and log-polar mapping for direct estimation of time-to-impact from optical flow," IEEE Trans. Pattern Anal. Machine Intell., vol. 15, pp. 401-410, Apr. 1993.
22. W. N. Klarquist and A. C. Bovik, "FOVEA: a foveated, multi-fixation, vergent active stereo system for dynamic three-dimensional scene recovery," IEEE Trans. Robot. Automat., vol. 14, pp. 755-770, Oct. 1998.
23. A. Basu and K. J. Wiebel, "Enhancing videoconferencing using spatially varying sensing," IEEE Trans. Syst., Man, Cybern. A, vol. 28, no. 2, pp. 137-148, Mar. 1998.
24. A. Basu, A. Sullivan, and K. J. Wiebe, "Variable resolution teleconferencing," in Proc. IEEE Int. Conf. Systems, Man & Cybernetics, France, Oct. 1993, pp. 170-175.
25. J. I. Yellott, "Image sampling properties of photoreceptors: a reply to Miller and Bernard vision res," Vision Res., vol. 24, pp. 281-282, 1984.
26. R. E. Kronauer and Y. Y. Zeevi, "Reorganization and diversification of signals in vision," IEEE Trans. Syst., Man, Cybern., vol. SMC-15, pp. 91-101, Jan./Feb. 1985.
27. J. J. Clark, M. R. Palmer, and P. D. Lawrence, "A transformation method for the reconstruction of functions from nonuniformly spaced samples," IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-33, pp. 1151-1165, Oct. 1985.
28. Y. Y. Zeevi and E. Eyal Shlomot, "Nonuniform sampling and antialiasing in image representation," IEEE Trans. Signal Processing, vol. 41, pp. 1223-1236, Mar. 1993.
29. M. S. Pattichis and A. C. Bovik, "AM-FM expansions for images," in Proc. European Signal Processing Conf., Trieste, Italy, Sept. 1996.
30. S. Qian and D. Chen, Joint Time-Frequency Analysis: Methods and Applications. Upper Saddle River, NJ: Prentice-Hall, 1996.
31. A. C. Bovik, N. Gopal, T. Emmoth, and A. Restrepo, "Localized measurement of emergent image frequencies by Gabor wavelets," IEEE. Trans. Inform. Theory, vol. 38, pp. 691-712, Mar. 1992.
32. M. Porat and Y. Y. Zeevi, "The generalized Gabor scheme of image representation in biological and machine vision," IEEE Trans. Pattern Anal. Machine Intell., vol. 10, pp. 452-468, July 1988.
33. R. W. Hamming, Digital Filters. Upper Saddle River, NJ: Prentice-Hall, 1989, pp. 140-147.
34. E. Chang and C. K. Yap, "A wavelet approach to foveating images," in ACM Symp. Computational Geometry, vol. 13, 1997, pp. 397-399.
35. Z. Wang and A. C. Bovik, "Embedded foveation image coding," IEEE Trans. Image Processing, vol. 10, pp. 1397-1410, Oct. 2001.
36. P. L. Silsbee, A. C. Bovik, and D. Chen, "Visual pattern image sequence coding," IEEE Trans. Circuits Syst. Video Technol., vol. 3, pp. 291-301, Aug. 1993.
37. S. Daly, K. Matthewsm, and J. Ribas-Corbera, "Visual eccentricity models in face-based video compression," in Proc. SPIE (Human Vision and Electronic Imaging IV), vol. 3644, San Jose, CA, Jan. 1999.
38. A. Eleftheriadis and A. Jacquin, "Automatic face location detection for model-assisted rate control in H.261-compatible coding of video," Signal Processing and Image Commun., vol. 7, pp. 435-455, 1995.
39. J. Hartung, A. Jacquin, J. Pawlyk, J. Rosenberg, H. Okada, and P. E. Crouch, "Object-oriented H.263 compatible video coding platform for conferencing applications," IEEE J. Select. Areas Commun., vol. 16, Jan. 1998.
40. W. Rabiner and A. Jacquin, "Motion-adaptive modelling of scene content for very low bit rate model-assisted coding of video," J. Vis. Commun. Image Repres., vol. 8, no. 3, pp. 250-262, Sept. 1997.
41. S. Lee, A. C. Bovik, and B. L. Evans, "Efficient implementation of foveation filtering," in Proc. Texas Instruments DSP Educator's Conf., Houston, TX, Aug. 1999.
42. J. R. Jain and A. K. Jain, "Displacement measurement and its application in interframe image coding," IEEE Trans. Commun., vol. COM-29, pp. 1799-1808, Dec. 1981.
43. M. Bierling, "Displacement estimation by hierarchical blockmatching," in Proc. SPIE, Visual Communications and Image Processing '88, vol. 1001, 1988, pp. 942-951.
44. T. Hanamura, W. Kameyama, and H. Tominaga, "Hierarchical coding scheme of video signal with scalability and compatibility," Signal Processing and Image Commun., pp. 159-184, Feb. 1993.
45. G. Gupta and C. Chakrabarti, "Architectures for hierarchical and other block matching algorithms," IEEE Trans. Circuits Syst. Video Technol., vol. 5, pp. 477-489, Dec. 1995.
46. A. Basu and K. J. Wiebe, "Videoconferencing using spatially varying sensing with multiple and moving fovea," in Proc. 12th IAPR Int. Conf. Pattern Recognition, Jerusalem, Israel, Oct. 1994, pp. 30-34.
47. "Draft Text of Recommendation H.263 Version 2 ("H.263+") for Decision," ITU Telecom. Standardization Section of ITU, Sept. 1997.
48. Foveated Video Demonstration, S. Lee and A. C. Bovik, (1999). Available: http://pineapple.ece.utexas.edu/class/Video/demo.html [Online]