Relevance of a feed-forward model of visual attention for goal-oriented and free-viewing tasks

IEEE Transactions on Image Processing

Volumn 19, Issue 11, 2010, Pages 2801-2813

  Le Meur, Olivier ^a   Chevet, Jean Claude ^b  

^a UNIVERSITÉ DE RENNES 1   (France)

^b Technicolor R and i   (France)

Author keywords

Bottom up; saliency; visual attention

Indexed keywords

ART MODEL; BOTTOM-UP; DATA SETS; DEGREE OF SIMILARITY; EYE-TRACKING; FEED-FORWARD; GOAL-ORIENTED; GROUND TRUTH; HUMAN VISUAL; OBJECT OF INTERESTS; SALIENCY; VISUAL ATTENTION; VISUAL FEATURE; VISUAL SCENE; VISUAL TASKS;

DATA VISUALIZATION;

EXPERIMENTS;

ALGORITHM; ARTICLE; ATTENTION; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; EYE FIXATION; HUMAN; IMAGE PROCESSING; PHOTOSTIMULATION; PHYSIOLOGY;

ALGORITHMS; ATTENTION; FIXATION, OCULAR; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MODELS, BIOLOGICAL; PATTERN RECOGNITION, AUTOMATED; PHOTIC STIMULATION;

EID: 78049300537     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2010.2052262     Document Type: Article

References (34)

1. R. VanRullen, "Visual saliency and spike timing in the ventral visual pathway," J. Physiol. , vol. 97, pp. 365-377, 2003.
2. Z. Li, "A saliency map in primary visual cortex," Trends Cogn. Sci. , vol. 6, pp. 9-16, 2002.
3. D. Hubel and T. Wiesel, "Receptive fields of single neurons in the cat's striate visual cortex," J. Physiol. , vol. 148, pp. 575-591, 1959.
4. D. Perrett, E. Rolls, and W. Caan, "Visual neurons responsive to faces in the monkey temporal cortex," Exp. Brain Res. , vol. 47, pp. 329-342, 1982.
5. J. Hupe, A. James, L. S. Payne, B. R. , P. Girard, and J. Bullier, "Cortical feedback improves discrimination between figure and background by v1, v2 and v3 neurons," Nature, vol. 394, no. 6695, pp. 784-787, 1998.
6. A. Ninassi, O. Le Meur, P. Le Callet, and D. Barba, "Does where you gaze on an image affect your perception of quality? Applying to image quality metric," in Proc. Int. Conf. Image Process. , Sep. 2007, pp. 169-172.
7. C. Chamaret and O. Le Meur, "Attention-based video reframing: Validation using eye-tracking," in Proc. Int. Conf. Pattern Recognit. , 2008, pp. 1-4.
8. L. Elazary and L. Itti, "Interesting objects in natural scenes are more salient," in Proc. Vis. Sci. Soc. Annu. Meeting, May 2007.
9. A. Yarbus, Eye Movements and Vision. New York: Plenum, 1967.
10. S. Thorpe, D. Fize, and C. Marlot, "Speed of processing in the human visual system," Nature, vol. 381, pp. 520-522, 1996.
11. A. Delorme, G. Richard, and M. Fabre-Thorpe, "Utra-rapid categorisation of natural scenes does not rely on colour cues: A study in monkeys and humans," Vis. Res. , vol. 40, pp. 187-200, 2000.
12. P. Schyns and A. Oliva, "From blobs to boundary edges: Evidence for time- and spatial-scale-dependent scene recognition," Psychol. Sci. , vol. 5, pp. 195-200, 1994.
13. A. Oliva and P. Schyns, "Diagnostic colors mediate scene recognition," Cogn. Psychol. , vol. 41, pp. 176210-176212, 2000.
14. O. Le Meur, P. Le Callet, D. Barba, and D. Thoreau, "A coherent approach to model bottom-up visual attention," IEEE Trans. Pattern Anal. Mach. Intell. , vol. 28, no. 5, pp. 802-817, May 2006.
15. C. Koch and S. Ullman, "Shifts in selection in visual attention: Towards the underlying neural circuitry," Hum. Neurobiol. , vol. 4, no. 4, pp. 219-227, 1985.
16. A. Treisman and G. Gelade, "A feature-integration theory of attention," Cognit. Psychol. , vol. 12, no. 1, pp. 97-136, 1980.
17. W. Geisler, J. S. Perry, and J. Najemnik, "Visual search: The role of peripheral information measured using gaze-contingent displays," J. Vis. , vol. 6, no. 9, pp. 858-873, 2006.
18. L. Itti and C. Koch, "A comparison of feature combination strategies for saliency-based visual attention systems," Hum. Vis. Electr. Imag. , vol. 3644, pp. 373-382, 1999.
19. O. Le Meur, P. Le Callet, and D. Barba, "Predicting visual fixations on video based on low-level visual features," Vis. Res. , vol. 47, no. 19, pp. 2483-2498, 2007.
20. N. Ouerhani, A. Bur, and H. Hugli, "Linear vs. nonlinear feature combination for saliency computation: A comparison with human vision," Lecture Notes in Computer Science, vol. 4174, pp. 314-323, 2006.
21. N. Ouerhani, T. Jost, A. Bur, and H. Hugli, "Cue normalization schemes in saliency-based visual attention models," presented at the Proc. Int. Cogn. Vis. Workshop, Graz, Austria, 2006.
22. J. Fecteau and D. Munoz, "Salience, relevance and firing: A priority map for target selection," Trends Cogn. Sci. , vol. 10, no. 8, pp. 617-631, 2006.
23. T. Liu, N. Zheng, X. Tang, and H. Shum, "Learning to detect a salient object," Comput. Vis. Pattern Recognit. , pp. 1-8, 2007.
24. B. Russell, A. Torralba, K. Murphy, and W. Freeman, "Labelme: A database and web-based tool for image annotation," Int. J. Comput. Vis. , vol. 77, no. 1-3, pp. 157-173, 2008.
25. M. A. T. Figueiredo and A. K. Jain, "Unsupervised learning of finite mixture models," IEEE Trans. Pattern Anal. Mach. Intell. , vol. 24, no. 3, pp. 381-396, Mar. 2002.
26. L. Itti, C. Koch, and E. Niebur, "Model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell, vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
27. D. Walther and C. Koch, "Modeling attention to salient proto-objects," Neural Netw. , vol. 19, pp. 1395-1407, 2006.
28. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," Comput. Vis. Pattern Recognit. , vol. 17, no. 22, pp. 1-8, 2007.
29. N. Bruce and J. Tsotsos, "Saliency based on information maximization," Adv. Neural Inf. Process. Syst. , vol. 18, pp. 155-162, 2006.
30. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G. W. Cottrell, "SUN: A Bayesian framework for saliency using natural statistics," J. Vis. vol. 8, no. 7, pp. 1-20, Dec. 12, 2008.
31. D. Parkhurst, K. Law, and E. Niebur, "Modelling the role of salience in the allocation of overt visual attention," Vis. Res. , vol. 42, pp. 107-123, 2002.
32. R. Peters, A. Iyer, L. Itti, and C. Koch, "Components of bottom-up gaze allocation in natural images," Vis. Res. , 2005.
33. T. Jost, N. Ouerhani, R. Wartburg, R. Muri, and H. Hugli, "Assessing the contribution of color in visual attention," Comput. Vis. Image Understand. , vol. 100, Special Issue: Attention and Performance in Computer Vision, no. 1-2, pp. 107-123, 2005.
34. H. Frey, C. Honey, and P. Knig, "Whats color got to do with it? the influence of color on visual attention in different categories," J. Vis. , vol. 8, no. 14, pp. 1-17, 2008.