A saliency-based search mechanism for overt and covert shifts of visual attention

Vision Research

Volumn 40, Issue 10-12, 2000, Pages 1489-1506

  Itti, Laurent ^a   Koch, Christof ^a  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Saliency; Vision systems; Visual attention

Indexed keywords

ASSOCIATION; ATTENTION; COLOR; CONFERENCE PAPER; EYE MOVEMENT; HUMAN; IMAGE DISPLAY; ORIENTATION; PRIORITY JOURNAL; STIMULUS; VISION; VISUAL MEMORY; VISUAL SYSTEM;

ADOLESCENT; ADULT; ATTENTION; COLOR PERCEPTION; FEMALE; HUMANS; MALE; MIDDLE AGED; MODELS, NEUROLOGICAL; MODELS, PSYCHOLOGICAL; PSYCHOPHYSICS; VISUAL PERCEPTION;

EID: 0034003645     PISSN: 00426989     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0042-6989(99)00163-7     Document Type: Conference Paper

References (81)

1. Andersen, R.A. (1997). Multimodal integration for the representation of space in the posterior parietal cortex. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences, 352, 1421-1428.
2. Andersen R.A., Bracewell R.M., Barash S., Gnadt J.W., Fogassi L. Eye position effects on visual, memory, and saccade-related activity in areas LIP and 7A of macaque. Journal of Neuroscience. 10:1990;1176-1196.
3. Bergen J.R., Julesz B. Parallel versus serial processing in rapid pattern discrimination. Nature. 303:1983;696-698.
4. Beymer D., Poggio T. Image representations for visual learning. Science. 272:1996;1905-1909.
5. Bijl, P., Kooi, F. K., & van Dorresteijn, M. (1997). Visual search performance for realistic target imagery from the DISSTAF field trials. Soesterberg, The Netherlands: TNO Human Factors Research Institute.
6. Braun J., Julesz B. Withdrawing attention at little or no cost: detection and discrimination tasks. Perception and Psychophysics. 60:1998;1-23.
7. Braun J., Sagi D. Vision outside the focus of attention. Perception and Psychophysics. 48:1990;45-58.
8. Braun J. Vision and attention: the role of training (letter; comment). Nature (Comment on: Nature June 19;387(6635), 805-807)). 393:1998;424-425.
9. Burt P., Adelson E. The laplacian pyramid as a compact image code. IEEE Transactions on Communications. 31:1983;532-540.
10. Cannon M.W., Fullenkamp S.C. Spatial interactions in apparent contrast: inhibitory effects among grating patterns of different spatial frequencies, spatial positions and orientations. Vision Research. 31:1991;1985-1998.
11. Colby C.L., Goldberg M.E. Space and attention in parietal cortex. Annual Review of Neuroscience. 22:1999;319-349.
12. Corbetta M. Frontoparietal cortical networks for directing attention and the eye to visual locations: identical, independent, or overlapping neural systems? Proceedings of the National Academy of Sciences of the United States of America. 95:1998;831-838.
13. Crick F., Koch C. Constraints on cortical and thalamic projections: the no-strong-loops hypothesis. Nature. 391:1998;245-250.
14. Desimone R., Duncan J. Neural mechanisms of selective visual attention. Annual Review of Neuroscience. 18:1995;193-222.
15. DeValois R.L., Albrecht D.G., Thorell L.G. Spatial-frequency selectivity of cells in macaque visual cortex. Vision Research. 22:1982;545-559.
16. Driver J., Mcleod P., Dienes Z. Motion coherence and conjunction search-implications for guided search theory. Perception and Psychophysics. 51:1992;79-85.
17. Engel S., Zhang X., Wandell B. Colour tuning in human visual cortex measured with functional magnetic resonance imaging. Nature. 388:1997;68-71.
18. Gallant J.L., Connor C.E., Essen D.C.V. Neural activity in areas Vl, V2 and V4 during free viewing of natural scenes compared to controlled viewing. Neuroreport. 9:1998;85-90.
19. Gilbert C.D., Wiesel T.N. Clustered intrinsic connections in cat visual cortex. Journal of Neuroscience. 3:1983;1116-1133.
20. Gilbert C.D., Wiesel T.N. Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex. Journal of Neuroscience. 9:1989;2432-2442.
21. Gilbert C.D., Das A., Ito M., Kapadia M., Westheimer G. Spatial integration and cortical dynamics. Proceedings of the National Academy of Sciences of the United States of America. 93:1996;615-622.
22. Gottlieb J.P., Kusunoki M., Goldberg M.E. The representation of visual salience in monkey parietal cortex. Nature. 391:1998;481-484.
23. Greenspan, H., Belongie, S., Goodman, R., Perona, P., Rakshit, S., & Anderson, C. H. (1994). Overcomplete steerable pyramid filters and rotation invariance. In Proc. IEEE Computer Vision and Pattern Recognition (CVPR), Seattle, WA (June), 222-228.
24. Hamker, F. H. (1999). The role of feedback connections in task-driven visual search. In D. von Heinke, G. W. Humphreys, & A. Olson, Connectionist Models in Cognitive Neuroscience, Proc. of the 5th neural computation and psychology workshop (NCPW'98). London: Springer-Verlag.
25. Heisenberg, M., & Wolf, R. (1984). Studies of brain function, vol. 12: vision in Drosophila. Berlin: Springer-Verlag.
26. Hikosaka O., Miyauchi S., Shimojo S. Orienting a spatial attention - its reflexive, compensatory, and voluntary mechanisms. Brain Research and Cognitive Brain Research. 5:1996;1-9.
27. Hillstrom A.P., Yantis S. Visual-motion and attentional capture. Perception and Psychophysics. 55:1994;399-411.
28. Horiuchi, T., Morris, T., Koch, C. & DeWeerth, S. 1997. Analog vlsi circuits for attention-based, visual tracking. In M. Mozer, M. Jordan, & T. Petsche, Neural information processing systems (NIPS*9) (706-712). Cambridge, MA: MIT Press.
29. Horowitz T.S., Wolfe J.M. Visual search has no memory. Nature. 394:1998;575-577.
30. Itti, L., & Koch, C. (1999). A comparison of feature combination strategies for saliency-based visual attention systems. In SPIE human vision and electronic imaging IV (HVEI'99), San Jose, CA (pp. 473-482).
31. Itti L., Koch C., Niebur E. A model of saliency-based visual-attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence. 20:1998;1254-1259.
32. James W. The principles of psychology. 1890/1980;Harvard University Press, Cambridge, MA.
33. Knierim J.J., van Essen D.C. Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. Journal of Neurophysiology. 67:1992;961-980.
34. Koch C., Ullman S. Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology. 4:1985;219-227.
35. Koch C. Biophysics of computation: information processing in single neurons. 1998;Oxford University Press, Oxford, UK.
36. Kustov A.A., Robinson D.L. Shared neural control of attentional shifts and eye movements. Nature. 384:1996;74-77.
37. Kwak H.W., Egeth H. Consequences of allocating attention to locations and to other attributes. Perception and Psychophysics. 51:1992;455-464.
38. Laberge D., Buchsbaum M.S. Positron emission tomographic measurements of pulvinar activity during an attention task. Journal of Neuroscience. 10:1990;613-619.
39. Lee D.K., Itti L., Koch C., Braun J. Attention activates winner-take-all competition among visual filters. Nature Neuroscience. 2:1999;375-381.
40. Leventhal, A., 1991. The neural basis of visual function. In Vision and visual dysfunction, vol. 4. Boca Raton, FL: CRC Press.
41. Levitt J.B., Lund J.S. Contrast dependence of contextual effects in primate visual cortex. Nature. 387:1997;73-76.
42. Luschow A., Nothdurft H.C. Pop-out of orientation but no pop-out of motion at isoluminance. Vision Research. 33:1993;91-104.
43. Malach R. Cortical columns as devices for maximizing neuronal diversity. Trends in Neuroscience. 17:1994;101-104.
44. Malach R., Amir Y., Harel M., Grinvald A. Relationship between intrinsic connections and functional architecture revealed by optical imaging and in vivo targeted biocytin injections in primate striate cortex. Proceedings of the National Academy of Sciences of the United States of America. 90:1993;10469-10473.
45. Malik J., Perona P. Preattentive texture discrimination with early vision mechanisms. Journal of the Optical Society of America A. 7:1990;923-932.
46. Motter B.C., Belky E.J. The guidance of eye movements during active visual search. Vision Research. 38:1998;1805-1815.
47. Nakayama K., Mackeben M. Sustained and transient components of focal visual attention. Vision Research. 29:1989;1631-1647.
48. Niebur, E., & Koch, C. (1996). Control of selective visual attention: modeling the 'where' pathway. In D. Touretzky, M. Mozer, & M. Hasselmo, Neural information processing systems (NIPS 8), (802-808). Cambridge, MA: MIT Press.
49. Niebur E., Koch C. Computational architectures for attention. Parasuraman R. The attentive brain. 1998;163-186 MIT Press, Cambridge, MA.
50. Niyogi P., Girosi F., Poggio T. Incorporating prior information in machine learning by creating virtual examples. Proceedings of the IEEE. 86:1998;2196-2209.
51. Noton D., Stark L. Scanpaths in eye movements during pattern perception. Science. 171:1971;308-311.
52. O'Regan J.K., Rensink R.A., Clark J.J. Change-blindness as a result of 'mudsplashes'. Nature. 398:1999;34.
53. Olshausen B.A., Anderson C.H., Van Essen D.C. A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. Journal of Neuroscience. 13:1993;4700-4719.
54. Poggio T. Image representations for visual learning. Lecture Notes in Computer Science. 1206:1997;143.
55. Polat U., Sagi D. The architecture of perceptual spatial interactions. Vision Research. 34:1994;73-78.
56. Polat U., Sagi D. Spatial interactions in human vision: from near to far via experience-dependent cascades of connections. Proceedings of the National Academy of Sciences of the United States of America. 91:1994;1206-1209.
57. Posner M.I., Cohen Y., Rafal R.D. Neural systems control of spatial orienting. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences. 298:1982;187-198.
58. Rao R.P.N., Ballard D.H. An active vision architecture based on iconic representations. Artificial Intelligence. 78:1995;461-505.
59. Robinson D.L., Petersen S.E. The pulvinar and visual salience. Trends in Neuroscience. 15:1992;127-132.
60. Rockland K.S., Lund J.S. Intrinsic laminar lattice connections in primate visual cortex. Journal of Comparative Neurology. 216:1983;303-318.
61. Rockland K.S., Andresen J., Cowie R.J., Robinson D.L. Single axon analysis of pulvinocortical connections to several visual areas in the macaque. Journal of Comparative Neurology. 406:1999;221-250.
62. Saarinen J., Julesz B. The speed of attentional shifts in the visual field. Proceedings of the National Academy of Sciences of the United States of America. 88:1991;1812-1814.
63. Sheliga B.M., Riggio L., Rizzolatti G. Orienting of attention and eye movements. Experimantal Brain Research. 98:1994;507-522.
64. Shepherd M., Findlay J.M., Hockey R.J. The relationship between eye movements and spatial attention. Quarterly Journal of Experimental Psychology. 38:1986;475-491.
65. Sillito A.M., Jones H.E. Context-dependent interactions and visual processing in vl. Journal of Physiology Paris. 90:1996;205-209.
66. Sillito A.M., Grieve K.L., Jones H.E., Cudeiro J., Davis J. Visual cortical mechanisms detecting focal orientation discontinuities. Nature. 378:1995;492-496.
67. Simoncelli E.P., Freeman W.T., Adelson E.H., Heeger D.J. Shiftable multiscale transforms. IEEE Transactions on Information Theory. 38:1992;587-607.
68. Simons D.J., Levin D.T. Failure to detect changes to attended objects. Investigative Opthalmology and Visual Science. 38:1997;3273.
69. Toet, A., Bijl, P., Kooi, F. L., & Valeton, J. M. (1998). A high-resolution image dataset for testing search and detection models (TNO-TM-98-A020). TNO Human Factors Research Institute, Soesterberg, The Netherlands.
70. Tootell R.B., Hamilton S.L., Silverman M.S., Switkes E. Functional anatomy of macaque striate cortex. i. ocular dominance, binocular interactions, and baseline conditions. Journal of Neuroscience. 8:1988;1500-1530.
71. Treisman A.M., Gelade G. A feature-integration theory of attention. Cognitive Psychology. 12:1980;97-136.
72. Treisman A., Gormican S. Feature analysis in early vision: evidence from search asymmetries. Psychology Review. 95:1988;15-48.
73. Treisman A. Features and objects: the fourteenth bartlett memorial lecture. Quarterly Journal of Experimental Psychology A. 40:1988;201-237.
74. Ts'o D.Y., Gilbert C.D., Wiesel T.N. Relationships between horizontal interactions and functional architecture in cat striate cortex as revealed by cross-correlation analysis. Journal of Neuroscience. 6:1986;1160-1170.
75. Tsotsos J.K., Culhane S.M., Wai W.Y.K., Lai Y.H., Davis N., Nuflo F. Modeling visual-attention via selective tuning. Artificial Intelligence. 78:1995;507-545.
76. Wagenaar W.A. Note on the construction of digram-balanced latin squares. Psychology Bulletin. 72:1969;384-386.
77. Weliky M., Kandler K., Fitzpatrick D., Katz L.C. Patterns of excitation and inhibition evoked by horizontal connections in visual cortex share a common relationship to orientation columns. Neuron. 15:1995;541-552.
78. Wolfe J.M. Visual search in continuous, naturalistic stimuli. Vision Research. 34:1994;1187-1195.
79. Yarbus A.L. Eye movements and vision. 1967;Plenum, New York.
80. Yuille A.L., Grzywacz N.M. A mathematical-analysis of the motion coherence theory. International Journal of Computer Vision. 3:1989;155-175.
81. Zenger B., Sagi D. Isolating excitatory and inhibitory nonlinear spatial interactions involved in contrast detection. Vision Research. 36:1996;2497-2513.