Bayesian integration of face and low-level cues for foveated video coding

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 18, Issue 12, 2008, Pages 1727-1740

  Boccignone, Giuseppe ^a   Marcelli, Angelo ^a   Napoletano, Paolo ^a   Di Fiore, Gianluca ^b   Iacovoni, Giovanni ^c   Morsa, Salvatore ^a  

^a UNIVERSITY OF SALERNO   (Italy)

^b Wind Telecomunicazioni Spa   (Italy)

^c SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

Face detection; Foveated video coding; Foveation filtering; Image coding; Video quality measurement

Indexed keywords

BAYESIAN NETWORKS; IMAGE COMPRESSION; PROGRAMMING THEORY; VISUAL COMMUNICATION;

AUTOMATICALLY GENERATE; BAYESIAN INTEGRATIONS; BAYESIAN MODELS; BOTTOM-UP; COMPRESSION GAINS; COMPRESSION PROCESSES; EXPERIMENTAL PROTOCOLS; FACE DETECTION; FOVEATED VIDEO CODING; FOVEATION FILTERING; HUMAN FACES; PERCEIVED QUALITIES; PRIOR INFORMATIONS; RELEVANT OBJECTS; TOP DOWNS; VIDEO CLIPS; VIDEO COMPRESSION SYSTEMS; VIDEO FRAMES; VIDEO QUALITY MEASUREMENT;

IMAGE CODING;

EID: 56849128398     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2008.2005798     Document Type: Article

References (38)

1. Z. Wang and A. C. Bovik, "Embedded foveation image coding," IEEE Trans. Image Process., vol. 10, no. 10, pp. 1397-1410, Oct. 2001.
2. Z. Wang, L. Lu, and A. C. Bovik, "Foveation scalable video coding with automatic fixation selection," IEEE Trans. Image Processing, vol. 12, no. 2, pp. 1-12, Feb. 2003.
3. L. Itti, "Automatic foveation for video compression using a neurobi-ological model of visual, attention," IEEE Trans. Image Process., vol. 13, no. 10, pp. 1304-1318, Oct. 2004.
4. A. Yarbus, Eye Movements and Vision. New York: Plenum, 1967.
5. D. Noton and L. Stark, "Scanpaths in eye movements during pattern perception," Science, vol. 171, no. 968, pp. 308-311, 1971.
6. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video quality as-sessment," IEEE Trans. Multimedia, vol. 4, no. 1, pp. 129-132, Mar. 2002.
7. L. Sanghoon and A. C. Bovik, "Fast algorithms for foveated video pro-cessing," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 2, pp. 149-162, Feb. 2003.
8. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video compression with optimal rate control," IEEE Trans. Image Processing, vol. 10, no. 7, pp. 977-992, Jul. 2001.
9. H. R. Sheikh, S. Liu, B. L. Evans, and A. C. Bovik, "Real-time foveation techniques for h.263 video encoding in software," in Proc. IEEE ICASSP, May 2001, vol. 3, pp. 1781-1784.
10. D. A. Chernyak and L. W. Stark, '"Top-down guided eye movements," IEEE Trans. Syst., Man, Cybern. B, vol. 31, no. 4, pp. 514-522, Aug 2001.
11. A. Torralba, "Modeling global scene factors in attention," J. Opt. Soc. Amer. A, vol. 20, no. 7, pp. 1407-1418, 2003.
12. Y. Sun and R. Fisher, "Object-based visual attention for computer vision," Artif. Intell., vol. 146, pp. 77-123, 2003.
13. M. Dorr, M. Bohme, T. Martinetz, K. Gegenfurtner, and E. Barth, "Variability of eye movements on natural videos," in Proc. 8th Tubingen Perception Conf., Tubingen, Germany, Feb. 2005, p. 162.
14. L. Stelmach, W. Tam, and P. Hearty, "Static and dynamic spatial resolution in image coding: An investigation of eye movements," Proc. SPIE ser. Human Vision, Visual Processing and Digital Display II Bellingham, WA, SPIE Press, 1991, vol. 1453, pp. 147-152.
15. L. Stelmach and. W. Tam, "Static and dynamic spatial resolution in image coding: An investigation of eye movements," Proc. SPIE ser. Human Vision, Visual Processing and Digital Display V, B. Rogowitz and J. Allebach, Eds. Bellingham, WA, SPIE Press, 1994, vol. 2179, pp. 90-98.
16. V. Tosi, L. Mecacci, and E. Pasquali, "Scanning eye movements made when viewing film: Preliminary observations," Int. J. Neurosci., vol. 92, no. 1-2, pp. 47-52, 1997.
17. R. B. Goldstein, R. Woods, and E. Peli, "Where people look when watching movies: Do all viewers look at the same place?," Comput. Biol Med., vol. 37, no. 7, pp. 957-964, 2007.
18. A. Yuille and D. Kersten, "Vision as bayesian inference: Analysis by synthesis?," Trends Cogn. Sci., vol. 10, no. 7, pp. 301-308, 2006.
19. N. Kanwisherand and M. Moscovitch, "The cognitiveneuroscience of face processing: An introduction," Cognitive Neuropsych., vol. 17, pp. 1-11, 2000.
20. A. Torralba, "Contextual, priming for object detection," Int. J. Comput. Vis., vol. 53, pp. 153-167, 2003.
21. ITU-T Recommendation P.910: Subjective Video Quality Assessment Methods for Multimedia Applications, International Telecommunication Union Std., 1996.
22. Z. Wang, L. Lu, and A. C. Bovik, "Foveation scalable video coding with automatic fixation selections," IEEE Trans. Image Process., vol. 12, no. 2, pp. 243-254, Feb. 2003.
23. P. Anandan, "A computational framework and an algorithm, for the measurment of visual motion," Int. J. Comput. Vis., vol. 2, pp. 283-310, 1989.
24. G. Boccignone, M. Ferrara, and P. Napoletano, "Diffused expectation maximisation for image segmentation," Electron. Lett., vol. 40, no. 18, pp. 1107-1108, 2004.
25. M. Jones and J. Rehg, "Statistical color models with application to skin detection," Int. J. Comput. Vis., vol. 46, no. 1, pp. 81-96, 2002.
26. D. Reisfeld, H. Wolfson and Y. Yeshurun, "Context-free attentional operators: The generalized symmetry transform," Int. J. Comput. Vis., vol. 14, no. 2, pp. 119-130, 1995.
27. V. D. Ges- and C. Valenti, "Symmetry operators in computer vision," Vistas Astronomy, vol. 40, no. 4, pp. 461-468, 1996.
28. Z. Zhou and J. Wu, "Efficient face candidate selector for face detection," Pattern Recognit., vol. 36, no. 5, pp. 1175-1186, 2003.
29. W. Huang and R. Mariani, "Face detection and precise eyes location," in Proc. 15th ICPR, Sep. 2000, vol. 4, pp. 722-727.
30. R. Hsu, M. Abdel-Mottaleb, and A. Jain, "Face detection in color images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 696-706, May 2002.
31. H. R. Sheikh, B. L. Evans, and A. C. Bovik, "Real-time foveation techniques for low bit rate video coding," J. Real-Time Imag., vol. 9, no. 1, pp. 27-40, Feb. 2003.
32. H. Greenspan, S. Belongie, R. Goodman, P. Perona, S. Rakshit, and C. Anderson, "Overcomplete steerable pyramid filters and rotation invariance," in Proc. IEEE CVPR, Jun. 1994, pp. 222-228.
33. P. Burt, "A pyramid-based front-end processor for dynamic vision applications," Proc. IEEE, vol. 90, no. 7, pp. 1188-1200, Jul. 2002.
34. T. Camus, "Real-time quantized optical flow," J. Real-Time Imaging, vol. 3, pp. 71-86, 1997.
35. H. Liu, R. Chellappa, and A. Rosenfeld, "Fast two-frame multiscale dense optical flow estimation using discrete wavelet filters," J. Opt. Soc. Amer. A, vol. 20, no. 8, pp. 1505-1515, 2003.
36. S. Daly, K. E. Matthews, and J. Ribas-Corbera, "Face-based visually-optimized image sequence coding," in Proc. IEEE ICIP, Nagoya, Japan, Oct. 1998, vol. 3, pp. 443-447.
37. L. Yang and M. Robertson, "Multiple-face tracking system for general region-of-interest videocoding," in Proc. IEEE ICIP, 2000, pp. 347-350.
38. W. S. Geisler and J. S. Perry, "A real-time foveated system for lowbandwidth video communication," in Proc. SPIE, 1998, vol. 3299, pp. 294-305.