Attention in hierarchical models of object recognition

Progress in Brain Research

Volumn 165, Issue , 2007, Pages 57-78

  Walther, Dirk B ^a   Koch, Christof ^b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

attention; bottom up attention; modeling; object; object based attention; recognition; top down attention

Indexed keywords

ATTENTION; BRAIN MAPPING; CONCEPTUAL FRAMEWORK; DEPTH PERCEPTION; HIERARCHICAL MODEL; MODEL; OBJECT RECOGNITION; PERCEPTION; PRIORITY JOURNAL; RECEPTIVE FIELD; RECOGNITION; REVIEW; SPATIAL ORIENTATION; VISION; VISUAL STIMULATION;

ATTENTION; DISCRIMINATION (PSYCHOLOGY); HUMANS; MODELS, BIOLOGICAL; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION;

EID: 34848850395     PISSN: 00796123     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0079-6123(06)65005-X     Document Type: Review

References (105)

1. Amit Y., and Mascaro M. An integrated network for invariant visual detection and recognition. Vision Res. 43 (2003) 2073-2088
2. Bar M. Visual objects in context. Nat. Rev. Neurosci. 5 (2004) 617-629
3. Biederman I. Recognition-by-components: a theory of human image understanding. Psychol. Rev. 94 (1987) 115-147
4. Biederman I., and Cooper E.E. Priming contour-deleted images: evidence for intermediate representations in visual object recognition. Cognit. Psychol. 23 (1991) 393-419
5. Bülthoff H.H., Edelman S.Y., and Tarr M.J. How are three-dimensional objects represented in the brain?. Cereb. Cortex 5 (1995) 247-260
6. Carmi R., and Itti L. Visual causes versus correlates of attentional selection in dynamic scenes. Vision Res. 46 (2006) 4333-4345
7. Cave K.R. The FeatureGate model of visual selection. Psychol. Res. 62 (1999) 182-194
8. Chelazzi L., Duncan J., Miller E.K., and Desimone R. Responses of neurons in inferior temporal cortex during memory-guided visual search. J. Neurophysiol. 80 (1998) 2918-2940
9. Chelazzi L., Miller E.K., Duncan J., and Desimone R. Responses of neurons in macaque area V4 during memory-guided visual search. Cereb. Cortex 11 (2001) 761-772
10. Connor C.E., Preddie D.C., Gallant J.L., and van Essen D.C. Spatial attention effects in macaque area V4. J. Neurosci. 17 (1997) 3201-3214
11. Darrel T., Gordon G., Harville M., and Woodfill J. Integrated person tracking using stereo, color, and pattern detection. Int. J. Comput. Vis. 37 (2000) 175-185
12. Deco G., and Rolls E.T. A neurodynamical cortical model of visual attention and invariant object recognition. Vision Res. 44 (2004) 621-642
13. Deco G., and Schürmann B. A hierarchical neural system with attentional top-down enhancement of the spatial resolution for object recognition. Vision Res. 40 (2000) 2845-2859
14. Desimone R., and Duncan J. Neural mechanisms of selective visual-attention. Annu. Rev. Neurosci. 18 (1995) 193-222
15. Duncan J. Selective attention and the organization of visual information. J. Exp. Psychol. Gen. 113 (1984) 501-517
16. Duncan J., and Humphreys G.W. Visual search and stimulus similarity. Psychol. Rev. 96 (1989) 433-458
17. Edelman S. Computational theories of object recognition. Trends Cognit. Sci. 1 (1997) 296-304
18. Egly R., Driver J., and Rafal R.D. Shifting visual attention between objects and locations: evidence from normal and parietal lesion subjects. J. Exp. Psychol. Gen. 123 (1994) 161-177
19. Eriksen C.W., and James J.D. Visual attention within and around the field of focal attention: a zoom lens model. Percept. Psychophys. 40 (1986) 225-240
20. Fei-Fei L., Iyer A., Koch C., and Perona P. What do we perceive in a glance of a real-world scene?. J. Vis. 7 1 (2007) 1-29
21. Freedman D.J., Riesenhuber M., Poggio T., and Miller E.K. A comparison of primate prefrontal and inferior temporal cortices during visual categorization. J. Neurosci. 23 (2003) 5235-5246
22. Frintrop S., Rome E., Nüchter A., and Surmann H. A bimodal laser-based attention system. Comput. Vis. Image Underst. 100 (2005) 124-151
23. Fukushima K. Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36 (1980) 193-202
24. Gauthier I., and Tarr M.J. Becoming a "Greeble" expert: exploring mechanisms for face recognition. Vision Res. 37 (1997) 1673-1682
25. Grossberg S., and Raizada R.D. Contrast-sensitive perceptual grouping and object-based attention in the laminar circuits of primary visual cortex. Vision Res. 40 (2000) 1413-1432
26. Hamker F.H. The reentry hypothesis: linking eye movements to visual perception. J. Vis. 3 (2003) 808-816
27. Hamker F.H. A dynamic model of how feature cues guide spatial attention. Vision Res. 44 (2004) 501-521
28. Hamker F.H. The emergence of attention by population-based inference and its role in distributed processing and cognitive control of vision. Comput. Vis. Image Underst. 100 (2005) 64-106
29. Hayworth K.J., and Biederman I. Neural evidence for intermediate representations in object recognition. Vision Res. 46 (2006) 4024-4031
30. Heinke, D. and Humphreys, G.W. (1997) SAIM: a model of visual attention and neglect. In: 7th international conference on artificial neural networks - ICANN 97, Springer Verlag, Lausanne, Switzerland, pp. 913-918.
31. Heinke D., and Humphreys G.W. Attention, spatial representation, and visual neglect: simulating emergent attention and spatial memory in the selective attention for identification model (SAIM). Psychol. Rev. 110 (2003) 29-87
32. Hershler O., and Hochstein S. At first sight: a high-level pop out effect for faces. Vision Res. 45 (2005) 1707-1724
33. Hopfield J.J. Neurons with graded response have collective computational properties like those of two-state neurons. Proc. Natl. Acad. Sci. U.S.A. 81 (1984) 3088-3092
34. Hubel D.H., and Wiesel T.N. Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J. Physiol. 160 (1962) 106-154
35. Hummel J.E., and Biederman I. Dynamic binding in a neural network for shape recognition. Psychol. Rev. 99 (1992) 480-517
36. Itti L. Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes. Vis. Cogn. 12 (2005) 1093-1123
37. Itti L., and Koch C. Computational modelling of visual attention. Nat. Rev. Neurosci. 2 (2001) 194-203
38. Itti L., Koch C., and Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Machine Intell. 20 (1998) 1254-1259
39. Koch C., and Ullman S. Shifts in selective visual-attention: towards the underlying neural circuitry. Hum. Neurobiol. 4 (1985) 219-227
40. LeCun, Y., Bottou, L., Bengio, Y. and Haffner, P. (1998) Gradient-based learning applied to document recognition. Proc. IEEE, pp. 2278-2324.
41. Lee, S.I. and Lee, S.Y. (2000) Top-down attention control at feature space for robust pattern recognition. In: Biologically Motivated Computer Vision, Seoul, Korea.
42. Logothetis N.K., Pauls J., Bülthoff H.H., and Poggio T. View-dependent object recognition by monkeys. Curr. Biol. 4 (1994) 401-414
43. Lowe D.G. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60 (2004) 91-110
44. Luck S.J., Chelazzi L., Hillyard S.A., and Desimone R. Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. J. Neurophysiol. 77 (1997) 24-42
45. Marr D. Vision (1982), W. H. Freeman and Company, New York
46. Marr D., and Nishihara H.K. Representation and recognition of the spatial organization of three-dimensional shapes. Proc. R. Soc. Lond. B Biol. Sci. 200 (1978) 269-294
47. McAdams C.J., and Maunsell J.H.R. Effects of attention on orientation-tuning functions of single neurons in macaque cortical area V4. J. Neurosci. 19 (1999) 431-441
48. McAdams C.J., and Maunsell J.H.R. Attention to both space and feature modulates neuronal responses in macaque area V4. J. Neurophysiol. 83 (2000) 1751-1755
49. Mel B.W. SEEMORE: combining color, shape, and texture histogramming in a neurally inspired approach to visual object recognition. Neural Comput. 9 (1997) 777-804
50. Miau, F., Papageorgiou, C. and Itti, L. (2001) Neuromorphic algorithms for computer vision and attention. In: SPIE 46 Annual International Symposium on Optical Science and Technology, Vol. 4479, San Jose, CA, pp. 12-23.
51. Milanese, R., Wechsler, H., Gill, S., Bost, J.M. and Pun, T. (1994) Integration of bottom-up and top-down cues for visual attention using non-linear relaxation. In: International Conference on Computer Vision and Pattern Recognition, Seattle, WA, pp. 781-785.
52. Mitchell J.F., Stoner G.R., Fallah M., and Reynolds J.H. Attentional selection of superimposed surfaces cannot be explained by modulation of the gain of color channels. Vision Res. 43 (2003) 1323-1328
53. Moore C.M., Yantis S., and Vaughan B. Object-based visual selection: evidence from perceptual completion. Psychol. Sci. 9 (1998) 104-110
54. Motter B.C. Neural correlates of attentive selection for color or luminance in extrastriate area V4. J. Neurosci. 14 (1994) 2178-2189
55. Mozer M.C. The Perception of Multiple Objects: A Connectionist Approach (1991), MIT Press, Cambridge, MA
56. Mozer M.C., and Sitton M. Computational modeling of spatial attention. In: Pashler H. (Ed). Attention (1998), Psychology Press, London 341-393
57. Mutch, J. and Lowe D.G. (2006). Multiclass object recognition with sparse, localized features. In: IEEE International Conference on Computer Vision and Pattern Recognition, New York, NY, pp. 11-18.
58. Navalpakkam V., and Itti L. Modeling the influence of task on attention. Vision Res. 45 (2005) 205-231
59. Navalpakkam V., and Itti L. Search goal tunes visual features optimally. Neuron 53 (2007) 605-617
60. O'Craven K.M., Downing P.E., and Kanwisher N. fMRI evidence for objects as the units of attentional selection. Nature 401 (1999) 584-587
61. Oliva, A. and Torralba, A. (2006) Building the gist of a scene: the role of global image features in recognition. In: Progress in Brain Research: Visual Perception, Vol. 155. Elsevier, Amsterdam, pp. 23-36.
62. Oliva, A., Torralba, A., Castelhano, M. and Henderson, J. (2003) Top-down control of visual attention in object detection. In: International Conference on Image Processing, Barcelona, Spain.
63. Olshausen B.A., Anderson C.H., and Van Essen D.C. A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. J. Neurosci. 13 (1993) 4700-4719
64. Peters R.J., Iyer A., Itti L., and Koch C. Components of bottom-up gaze allocation in natural images. Vision Res. 45 (2005) 2397-2416
65. Plato. (1968). Book vii in The Republic, p. 195. Basic Books, New York, NY.
66. Poggio T., and Edelman S. A network that learns to recognize three-dimensional objects. Nature 343 (1990) 263-266
67. Posner M.I. Orienting of attention. Q. J. Exp. Psychol. 32 (1980) 3-25
68. Raizada R.D., and Grossberg S. Context-sensitive bindings by the laminar circuits of V1 and V2: a unified model of perceptual grouping, attention, and orientation contrast. Vis. Cogn. 8 (2001) 431-466
69. Rao, R.P.N. (1998) Visual attention during recognition. In: Advances in Neural Information Processing Systems, Vol. 10, pp. 80-86.
70. Rees G., Frackowiak R., and Frith C. Two modulatory effects of attention that mediate object categorization in human cortex. Science 275 (1997) 835-838
71. Rensink R.A. The dynamic representation of scenes. Vis. Cogn. 7 (2000) 17-42
72. Rensink R.A. Seeing, sensing, and scrutinizing. Vision Res. 40 (2000) 1469-1487
73. Reynolds J.H., Alborzian S., and Stoner G.R. Exogenously cued attention triggers competitive selection of surfaces. Vision Res. 43 (2003) 59-66
74. Reynolds J.H., Pasternak T., and Desimone R. Attention increases sensitivity of V4 neurons. Neuron 26 (2000) 703-714
75. Riesenhuber M., and Poggio T. Hierarchical models of object recognition in cortex. Nat. Neurosci. 2 (1999) 1019-1025
76. Roelfsema P.R., Lamme V.A.F., and Spekreijse H. Object-based attention in the primary visual cortex of the macaque monkey. Nature 395 (1998) 376-381
77. Rolls E.T., and Deco G. Attention in natural scenes: neurophysiological and computational bases. Neural Netw. 19 (2006) 1383-1394
78. Rothenstein, A.L. and Tsotsos, J.K. (2007) Attention links sensing to recognition. Image Vis. Comput. (in press).
79. Rutishauser, U., Walther, D., Koch, C. and Perona, P. (2004) Is attention useful for object recognition? In: IEEE International Conference on Computer Vision and Pattern Recognition, Washington, DC, Vol. 2, pp., 37-44.
80. Rybak I.A., Gusakova V.I., Golovan A.V., Podladchikova L.N., and Shevtsova N.A. A model of attention-guided visual perception and recognition. Vision Res. 38 (1998) 2387-2400
81. Saenz M., Buracas G.T., and Boynton G.M. Global effects of feature-based attention in human visual cortex. Nat. Neurosci. 5 (2002) 631-632
82. Schill K., Umkehrer E., Beinlich S., Krieger G., and Zetzsche C. Scene analysis with saccadic eye movements: top-down and bottom-up modeling. J. Electronic Imaging 10 (2001) 152-160
83. Serre, T., Kouh, M., Cadieu, C., Knoblich, U., Kreiman, G. and Poggio, T. (2005a) A theory of object recognition: computations and circuits in the feedforward path of the ventral stream in primate visual cortex, CBCL Paper #259/AI Memo #2005-036 Technical report, Massachusetts Institute of Technology.
84. Serre, T., Wolf, L. and Poggio, T. (2005b) Object recognition with features inspired by visual cortex. In: IEEE International Conference on Computer Vision and Pattern Recognition, San Diego, CA, Vol. 2, pp. 994-1000.
85. Serre, T., Kreiman, G., Kouh, M., Cadieu, C., Knoblich, U. and Poggio, T. (2007a) A quantitative theory of immediate visual recognition. In: Progress in Brain Research, pp. 33-56.
86. Serre T., Wolf L., Bileschi S., Riesenhuber M., and Poggio T. Object recognition with cortex-like mechanisms. IEEE Trans. Pattern Anal. Machine Intell. 29 (2007) 411-426
87. Spitzer H., Desimone R., and Moran J. Increased attention enhances both behavioral and neuronal performance. Science 240 (1988) 338-340
88. Tarr M.J., and Bülthoff H.H. Is human object recognition better described by geon structural descriptions or by multiple views? Comment on Biederman and Gerhardstein (1993). J. Exp. Psychol. Hum. Percept. Perform. 21 (1995) 1494-1505
89. Torralba, A., Murphy, K. and Freeman, W. (2004) Sharing features: efficient boosting procedures for multiclass object detection. In: IEEE International Conference on Computer Vision and Pattern Recognition, Washington, DC.
90. Treisman A.M., and Gelade G. A feature-integration theory of attention. Cogn. Psychol. 12 (1980) 97-136
91. Treue S., and Martinez Trujillo J.C. Feature-based attention influences motion processing gain in macaque visual cortex. Nature 399 (1999) 575-579
92. Tsotsos J.K., Culhane S.M., Wai W.Y.K., Lai Y.H., Davis N., and Nuflo F. Modeling visual-attention via selective tuning. Artif. Intell. 78 (1995) 507-545
93. Tsotsos J.K., Liu Y., Martinez-Trujillo J.C., Pomplun M., Simine E., and Zhou K. Attending to motion. Comput. Vis. Image Underst. 100 (2005) 3-40
94. Ullman S. The Interpretation of Visual Motion (1979), MIT Press, Cambridge, MA
95. Ullman S. Object recognition and segmentation by a fragment-based hierarchy. Trends Cogn. Sci. 11 (2007) 58-64
96. Ullman S., Vidal-Naquet M., and Sali E. Visual features of intermediate complexity and their use in classification. Nat. Neurosci. 5 (2002) 682-687
97. VanRullen R. On second glance: still no high-level pop-out effect for faces. Vision Res. 46 (2006) 3017-3027
98. Wallis G., and Rolls E.T. Invariant face and object recognition in the visual system. Prog. Neurobiol. 51 (1997) 167-194
99. Walther, D.B. and Fei-Fei, L. (2007) Task-set switching with natural scenes: measuring the cost of deploying top-down attention. J. Vis., 7(11):9, 1-12, http://journalofvision.org/7/11/9/, doi:10.1167/7.11.9.
100. Walther, D., Itti, L., Riesenhuber, M., Poggio, T. and Koch, C. (2002) Attentional selection for object recognition: a gentle way. In: Lecture Notes in Computer Science, Vol. 2525. Springer, Berlin, Germany, pp. 472-479.
101. Walther D., and Koch C. Modeling attention to salient proto-objects. Neural Netw. 19 (2006) 1395-1407
102. Walther D., Rutishauser U., Koch C., and Perona P. Selective visual attention enables learning and recognition of multiple objects in cluttered scenes. Comput. Vis. Image Underst. 100 (2005) 41-63
103. Walther D., Serre T., Poggio T., and Koch C. Modeling feature sharing between object detection and top-down attention [abstract]. J. Vis. 5 (2005) 1041a
104. Wolfe J.M. Guided Search 2.0: a revised model of visual search. Psychon. Bull. Rev. 1 (1994) 202-238
105. Wolfe J.M., Cave K.R., and Franzel S.L. Guided search: an alternative to the feature integration model for visual search. J. Exp. Psychol. Hum. Percept. Perform. 15 (1989) 419-433