Automatic attention-based prioritization of unconstrained video for compression

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 5292, Issue , 2004, Pages 272-283

  Itti, Laurent ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Attention; Priority encoding; Region of interest; Saliency; Video compression

Indexed keywords

ALGORITHMS; BANDWIDTH; COMMUNICATION CHANNELS (INFORMATION THEORY); FILTRATION; IMAGE CODING; PROBLEM SOLVING; WIRELESS TELECOMMUNICATION SYSTEMS;

FILE SIZE REDUCTIONS; PRIORITY ENCODING; REGION OF INTEREST; UNCONSTRAINED VIDEO;

IMAGE COMPRESSION;

EID: 8844282525     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.527057     Document Type: Conference Paper

References (41)

1. B. Wandell, Foundations of vision, Sinauer Associates, Sunderland, MA, 1995.
2. J. M. Shapiro, "Embedded image coding using zerotrees of wavelet coefficients," IEEE Trans. Signal Proc., pp. 3445-3462, 1993.
3. D. Taubman and A. Zakhor, "Multirate 3-d subband coding of video," IEEE Trans. Image Proc. 3, pp. 572-588.
4. Z. Wang, L. Lu, and A. Bovik, "Foveation scalable video coding with automatic fixation selection," IEEE Trans. Image Proc. 12(2), pp. 243-254, 2003.
5. P. M. J. van Diepen, P. De Graef, and J. van Rensbergen, "On-line control of moving masks and windows on a complex background using the atvista videographics adapter," Behav. Res. Meth. 26, pp. 454-460, 1994.
6. P. T. Kortum and W. S. Geisler, "Implementation of a foveated image-coding system for bandwidth reduction of video images," in Proc. SPIE, vol. 2657, pp. 350-360, 1996.
7. N. Doulamis, A. Doulamis, D. Kalogeras, and S. Kollias, "Improving the performance of mpeg coders using adaptive regions of interest," IEEE Trans. Circuits and Systems for Video Tech. 8, pp. 928-934, Dec 1998.
8. S. Lee, A. C. Bovik, and Y. Y. Kim, "Low delay foveated visual communications over wireless channels," in Proc. IEEE Int. Conf. Image Proc., pp. 90-94, 1999.
9. U. Rauschenbach and H. Schumann, "Demand-driven image transmission with levels of detail and regions of interest," Computers & Graphics 23(6), pp. 857-866, 1999.
10. E. M. Reingold and L. C. Loschky, "Saliency of peripheral targets in gaze-contingent multiresolutional displays," Behav. Res. Meth., Instr. and Comp. 34(4), pp. 491-499, 2002.
11. D. J. Parkhurst and E. Niebur, "Variable-resolution displays: a theoretical, practical, and behavioral evaluation," Hum. Factors 44(4), pp. 611-629, 2002.
12. W. S. Geisler and J. S. Perry, "A real-time foveated multi-resolution system for low-bandwidth video communication," in Proc. SPIE, pp. 294-305, 1998.
13. J. H. Goldberg and J. C. Schryver, "Eye-gaze-contingent control of the computer interface: Methodology and example for zoom detection," Behav. Res. Meth., Instr. and Comp. 27, pp. 338-350, Aug 1995.
14. L. B. Stelmach, W. J. Tam, and P. J. Hearty, "Static and dynamic spatial resolution in image coding: An investigation of eye movements," in Proc. SPIE, vol. 1453, pp. 147-152, 1991.
15. A. T. Duchowski and B. H. McCormick, "Pre-attentive considerations for gaze-contingent image processing," in Proc. SPIE, vol. 2411, pp. 128-139, 1995.
16. A. T. Duchowski and B. H. McCormick, "Modeling visual attention for gaze-contingent video processing," in Ninth Image and Multidim.l Signal Proc. (IMDSP) Workshop, pp. 130-131, 1996.
17. W. Osberger and A. J. Maeder, "Automatic identification of perceptually important regions in an image using a model of the human visual system," in Int. Conf. Patt. Recogn., pp. 701-704, Aug 1998.
18. X. Yang and K. Ramchandran, "A low-complexity region-based video coder using backward morpho-logical motion field segmentation," IEEE Trans. Image Proc. 8, pp. 332-345, Mar 1999.
19. F. Stentiford, "An estimator for visual attention through competitive novelty with application to image compression," in Picture Coding Symp., pp. 101-104, Apr 2001.
20. W. Osberger, A. J. Maeder, and N. Bergmann, "Perceptually based quantization technique for mpeg encoding," in Proc. SPIE, vol. 3299, pp. 148-159, 1998.
21. M. W. Marcellin, M. J. Gormish, A. Bilgin, and M. P. Boliek, "An overview of JPEG-2000," in Data Compr. Conf., pp. 523-544, 2000.
22. E. Mandel and P. Penev, "Facial feature tracking and pose estimation in video sequences by factorial coding of the low-dimensional entropy manifolds due to the partial symmetries of faces," in Proc. 25th IEEE Int. Conf. Acoustics, Speech, and Signal Proc. (ICASSP2000), vol. IV, pp. 2345-2348, Jun 2000.
23. S. W. Kuffler, "Discharge patterns and functional organization of mammalian retina," J. Neurophysiol. 16, pp. 37-68, 1953.
24. D. H. Rubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex," J. Physiol. (London) 160, pp. 106-54, 1962.
25. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Patt. Anal. Mach. Intell. 20, pp. 1254-1259, Nov 1998.
26. L. Itti and C. Koch, "Computational modeling of visual attention," Nat. Rev. Neurosci. 2, pp. 194-203, Mar 2001.
27. L. Itti and C. Koch, "Feature combination strategies for saliency-based visual attention systems," J. Elec. Imaging 10, pp. 161-169, Jan 2001.
28. S. Ullman, High-level vision: Object recognition and visual cognition, MIT Press, Cambridge, MA, 1996.
29. G. Borgefors, "Distance transformations in digital images," in CVGIP: Image Understanding, vol. 54, p. 301, 1991.
30. "Online: http://ilab.usc.edu/toolkit/."
31. D. L. Sparks, "The brainstem control of saccadic eye movements," Nat. Rev. Neurosci. 3(12), pp. 952-964, 2002.
32. S. Maskell, M. Rollason, D. Salmond, and N. Gordon, "Efficient particle filtering for multiple target tracking with application to tracking in structured images," in Proc. SPIE, vol. 4728, 2002.
33. "Online: http://bmrc.berkeley.edu/research/mpeg/mpeg-encode.html. "
34. "Online: http://www.mplayerhq.hu."
35. D. Noton and L. Stark, "Scanpaths in eye movements during pattern perception," Science 171(968), pp. 308-11, 1971.
36. D. Parkhurst, K. Law, and E. Niebur, "Modeling the role of salience in the allocation of overt visual attention," Vision Res. 42(1), pp. 107-123, 2002.
37. S. A. Finney, "Real-time data collection in linux: A case study," Behav. Res. Meth., Instr. and Comp. 33, pp. 167-173, 2001.
38. H. Collewijn, R. M. Steinman, C. J. Erkelens, Z. Pizlo, and J. van der Steen, "Effect of freeing the head on eye movement characteristics during three-dimensional shifts of gaze and tracking," in The Head-Neck Sensory Motor System. A. Berthoz, W. Graf, and P. P. Vidai, eds., Oxford University Press, 1992.
39. F. Bookstein, "Principal warps: Thin-plate splines and the decomposition of deformations," IEEE Trans. Patt. Anal. Mach. Intell. 11, pp. 567-585, 1989.
40. "Online: http://ilab.usc.edu/bu/co/."
41. A. Yarbus, Eye Movements and Vision, Plenum Press, New York, 1967.