Visual saliency and spike timing in the ventral visual pathway

Journal of Physiology Paris

Volumn 97, Issue 2-3, 2003, Pages 365-377

  VanRullen, Rufin ^a  

^a California Institute of Technology HHMI   (United States)

Author keywords

Attention; Neural coding; Object recognition; Spike timing; Visual saliency

Indexed keywords

ATTENTION; AWARENESS; CELL ACTIVATION; COLOR; HUMAN; LUMINANCE; NERVE CELL; NONHUMAN; REVIEW; SPIKE WAVE; STRIATE CORTEX; TEMPORAL CORTEX; VISION; VISUAL CORTEX; VISUAL MEMORY; VISUAL ORIENTATION; VISUAL STIMULATION; VISUAL SYSTEM;

EID: 0842346365     PISSN: 09284257     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jphysparis.2003.09.010     Document Type: Article

References (97)

1. Adrian E.D. The impulses produced by sensory nerve endings: Part I. J. Physiol. (Lond.). 61:1926;49-72.
2. Allman J., Miezin F., McGuinness E. Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. Annu. Rev. Neurosci. 8:1985;407-430.
3. Anderson C.H., Van Essen D.C. Shifter circuits: a computational strategy for dynamic aspects of visual processing. Proc. Natl. Acad. Sci. USA. 84(17):1987;6297-6301.
4. Baizer J.S., Ungerleider L.G., Desimone R. Organization of visual inputs to the inferior temporal and posterior parietal cortex in macaques. J. Neurosci. 11(1):1991;168-190.
5. Barlow H.B. Single units and sensation: a neuron doctrine for perceptual psychology? Perception. 1(4):1972;371-394.
6. Bichot N.P., Cave K.R., Pashler H. Visual selection mediated by location: feature-based selection of noncontiguous locations. Percept. Psychophys. 61(3):1999;403-423.
7. Blaser E., Sperling G., Lu Z.L. Measuring the amplification of attention. Proc. Natl. Acad. Sci. USA. 96(20):1999;11681-11686.
8. Borg-Graham L.J., Monier C., Fregnac Y. Visual input evokes transient and strong shunting inhibition in visual cortical neurons. Nature. 393(6683):1998;369-373.
9. Brefczynski J.A., DeYoe E.A. A physiological correlate of the 'spotlight' of visual attention. Nat. Neurosci. 2(4):1999;370-374.
10. Bullier J., Schall J.D., Morel A. Functional streams in occipito-frontal connections in the monkey. Behav. Brain Sci. 76:1996;89-97.
11. Celebrini S., Thorpe S., Trotter Y., Imbert M. Dynamics of orientation coding in area V1 of the awake monkey. Visual Neurosci. 10:1993;811-825.
12. Colby C.L., Goldberg M.E. Space and attention in parietal cortex. Annu. Rev. Neurosci. 22:1999;319-349.
13. Crick F., Koch C. Consciousness and neuroscience. Cereb. Cortex. 8(2):1998;97-107.
14. Deco G., Schurmann B. A hierarchical neural system with attentional top-down enhancement of the spatial resolution for object recognition. Vision Res. 40(20):2000;2845-2859.
15. Deco G., Zihl J. A neurodynamical model of visual attention: feedback enhancement of spatial resolution in a hierarchical system. J. Comput. Neurosci. 10(3):2001;231-253.
16. Delorme A., Thorpe S.J. Face identification using one spike per neuron: resistance to image degradations. Neural Netw. 14(6-7):2001;795-803.
17. Desimone R., Duncan J. Neural mechanisms of selective visual attention. Ann. Rev. Neurosci. 18:1995;193-222.
18. Distler C., Boussaoud D., Desimone R., Ungerleider L.G. Cortical connections of inferior temporal area TEO in macaque monkeys. J. Comp. Neurol. 334(1):1993;125-150.
19. Driver J., Baylis G.C. Movement and visual attention: the spotlight metaphor breaks down. J. Exp. Psychol. Hum. Percept. Perform. 15(3):1989;448-456.
20. Eriksen C.W., Yeh Y.Y. Allocation of attention in the visual field. J. Exp. Psychol. Hum. Percept. Perform. 11(5):1985;583-597.
21. Gallant J.L., Braun J., Van Essen D.C. Selectivity for polar, hyperbolic, and Cartesian gratings in macaque visual cortex. Science. 259(5091):1993;100- 103.
22. Gawne T.J., Kjaer T.W., Richmond B.J. Latency: another potential code for feature binding in striate cortex. J. Neurophysiol. 76(2):1996;1356-1360.
23. Glass L. Moire effect from random dots. Nature. 223(206):1969;578-580.
24. Gottlieb J.P., Kusunoki M., Goldberg M.E. The representation of visual salience in monkey parietal cortex. Nature. 391(6666):1998;481-484.
25. Gross C.G., Rocha-Miranda C.E., Bender D.B. Visual properties of neurons in inferotemporal cortex of the Macaque. J. Neurophysiol. 35(1):1972;96-111.
26. Hamker F.H. The role of feedback connections in task-driven visual search. Heinke D., Humphreys G.W., Olson A. Proceedings of the 5th Neural Computation and Psychology Workshop (NCPW'98). Connectionist Models in Cognitive Neuroscience. 1999;252-261 Springer Verlag, London.
27. Hartline H.K. The effects of spatial summation in the retina on the excitation of the fibers of the optic nerve. Am. J. Physiol. 130:1940;700-711.
28. Hubel D.H., Wiesel T.N. Receptive fields of single neurons in the cat's striate visual cortex. J. Physiol. 148:1959;574-591.
29. Hupe J.M., James A.C., Payne B.R., Lomber S.G., Girard P., Bullier J. Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons. Nature. 394(6695):1998;784-787.
30. Itti L., Koch C. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Res. 40(10-12):2000;1489-1506.
31. Itti L., Koch C. Computational modelling of visual attention. Nat. Rev. Neurosci. 2(3):2001;194-203.
32. Itti L., Koch C. Feature combination strategies for saliency-based visual attention systems. J. Electron. Imag. 10(1):2001;161-169.
33. Klein R.M. Inhibition of return. Trends. Cognit. Sci. 4(4):2000;138-147.
34. Koch C., Ullman S. Shifts in selective visual attention: towards the underlying neural circuitry. Hum. Neurobiol. 4(4):1985;219-227.
35. Koechlin E., Basso G., Pietrini P., Panzer S., Grafman J. The role of the anterior prefrontal cortex in human cognition. Nature. 399(6732):1999;148- 151.
36. Kustov A.A., Robinson D.L. Shared neural control of attentional shifts and eye movements. Nature. 384(6604):1996;74-77.
37. LaBerge D. Spatial extent of attention to letters and words. J. Exp. Psychol. Hum. Percept. Perform. 9(3):1983;371-379.
38. LaBerge D., Buchsbaum M.S. Positron emission tomographic measurements of pulvinar activity during an attention task. J. Neurosci. 10(2):1990;613-619.
39. I. Lampl, M. Riesenhuber, T. Poggio, D. Ferster, The MAX operation in cells in the cat visual cortex, Paper presented at the Society for Neuroscience, San Diego, CA, 2001.
40. Lee D.K., Itti L., Koch C., Braun J. Attention activates winner-take-all competition among visual filters. Nat. Neurosci. 2(4):1999;375-381.
41. Levitt J.B., Lund J.S. Contrast dependence of contextual effects in primate visual cortex. Nature. 387(6628):1997;73-76.
42. F.-F. Li, R. VanRullen, C. Koch, P. Perona, Rapid natural scene categorization without attention, Paper presented at the Society for Neuroscience, San Diego, CA, 2001.
43. Li Z. A saliency map in primary visual cortex. Trends. Cognit. Sci. 6(1):2002;9-16.
44. Logothetis N.K., Pauls J., Poggio T. Shape representation in the inferior temporal cortex of monkeys. Curr. Biol. 5(5):1995;552-563.
45. Lu Z.L., Sperling G. Attention-generated apparent motion. Nature. 377(6546):1995;237-239.
46. Mallat S.G. A theory for multiresolution signal decomposition: the wavelet representation. Inst. Electrical Electron. Eng. Trans. Pattern Anal. Mach. Intell. 11:1989;674-693.
47. Miyashita Y., Hayashi T. Neural representation of visual objects: encoding and top-down activation. Curr. Opin. Neurobiol. 10(2):2000;187-194.
48. Morel A., Bullier J. Anatomical segregation of two cortical visual pathways in the macaque monkey. Vis. Neurosci. 4(6):1990;555-578.
49. Mozer M.C., Sitton M. Computational modeling of spatial attention. Pashler H. Attention. 1998;341-393 Psychology Press, London.
50. Nakamura K. Neural processing in the subsecond time range in the temporal cortex. Neural Comput. 10(3):1998;567-595.
51. Niebur E., Koch C. A model for the neuronal implementation of selective visual attention based on temporal correlation among neurons. J. Comput. Neurosci. 1(1-2):1994;141-158.
52. Nothdurft H.C. Saliency effects across dimensions in visual search. Vis. Res. 33(5-6):1993;839-844.
53. Nothdurft H. Salience from feature contrast: additivity across dimensions. Vis. Res. 40(10-12):2000;1183-1201.
54. Olshausen B.A., Anderson C.H., Van Essen D.C. A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. J. Neurosci. 13(11):1993;4700-4719.
55. Perrett D.I., Rolls E.T., Caan W. Visual neurons responsive to faces in the monkey temporal cortex. Exp. Brain Res. 47:1982;329-342.
56. Posner M.I., Snyder C.R.R., Davidson B.J. Attention and the detection of signals. J. Exp. Psychol.: General. 109:1980;160-174.
57. Potter M.C., Levy E.I. Recognition memory for a rapid sequence of pictures. J. Exp. Psychol. 81(1):1969;10-15.
58. Potter M.C. Understanding Sentences and Scenes: The role of Conceptual Short-Term Memory. Coltheart V. Fleeting Memories: Cognition of Brief Visual Stimuli. 1999;13-46 MIT Press.
59. Rainer G., Asaad W.F., Miller E.K. Selective representation of relevant information by neurons in the primate prefrontal cortex. Nature. 393(6685):1998;577-579.
60. Reynolds J.H., Desimone R. The role of neural mechanisms of attention in solving the binding problem. Neuron. 24(1):1999;19-29. 111-125.
61. Reynolds J.H., Pasternak T., Desimone R. Attention increases sensitivity of V4 neurons. Neuron. 26(3):2000;703-714.
62. Richmond B.J., Gawne T.J., Jin G.X. Neuronal codes: reading them and learning how their structure influences network organization. Biosystems. 40(1-2):1997;149-157.
63. Riesenhuber M., Poggio T. Hierarchical models of object recognition in cortex. Nat. Neurosci. 2(11):1999;1019-1025.
64. Robinson D.L., Petersen S.E. The pulvinar and visual salience. Trends Neurosci. 15(4):1992;127-132.
65. Rodieck R.W. Quantitative analysis of cat retinal ganglion cell response to visual stimuli. Vis. Res. 5:1965;583-601.
66. Rodieck R.W. The First Steps in Seeing. 1998;Sinauer Associates, Sunderland, MA.
67. Rybak I.A., Gusakova V.I., Golovan A.V., Podladchikova L.N., Shevtsova N.A. A model of attention-guided visual perception and recognition. Vis. Res. 38:1998;2387-2400.
68. Salinas E., Abbott L.F. Invariant visual responses from attentional gain fields. J. Neurophysiol. 77(6):1997;3267-3272.
69. Schill K., Umkehrer E., Beinlich S., Krieger G., Zetzsche C. Scene analysis with saccadic eye movements: top-down and bottom-up modeling. Journal of Electronic Imaging. 10(1):2001;152-160.
70. Singer W., Gray C.M. Visual feature integration and the temporal correlation hypothesis. Annu. Rev. Neurosci. 18:1995;555-586.
71. Singer W. Time as coding space? Curr. Opin. Neurobiol. 9(2):1999;189-194.
72. Subramaniam S., Biederman I., Madigan S. Accurate identification but no priming and chance recognition memory for pictures in RSVP sequences. Vis. Cognit. 7(4):2000;511-535.
73. Suzuki W.A. The anatomy, physiology and functions of the perirhinal cortex. Curr. Opin. Neurobiol. 6(2):1996;179-186.
74. Suzuki W.A. The long and the short of it: memory signals in the medial temporal lobe. Neuron. 24(2):1999;295-298.
75. Tanaka K. Neuronal mechanisms of object recognition. Science. 262:1993;685-688.
76. Tanaka K. Inferotemporal cortex and object vision. Ann. Rev. Neurosci. 19:1996;109-139.
77. Theeuwes J. Visual selective attention: a theoretical analysis. Acta. Psychol. (Amst). 83(2):1993;93-154.
78. Thompson K.G., Schall J.D. Antecedents and correlates of visual detection and awareness in macaque prefrontal cortex. Vis. Res. 40(10-12):2000;1523-1538.
79. Thorpe S.J., Imbert M. Biological constraints on connectionist models. Pfeifer R., Schreter Z., Fogelman-Soulié F., Steels L. Connectionism in Perspective. 1989;63-92 Elsevier, Amsterdam.
80. Thorpe S.J. Spike arrival times: a highly efficient coding scheme for neural networks. Eckmiller R., Hartman G., Hauske G. Parallel Processing in Neural Systems. 1990;91-94 North-Holland, Elsevier.
81. Thorpe S.J., Fize D., Marlot C. Speed of processing in the human visual system. Nature. 381:1996;520-522.
82. Thorpe S.J., Gautrais J. Rank order coding: a new coding scheme for rapid processing in neural networks. Bower J. Computational Neuroscience: Trends in Research. 1998;Plenum Press, New York.
83. Thorpe S., Delorme A., VanRullen R. Spike-based strategies for rapid processing. Neural Netw. 14(6-7):2001;715-725.
84. Treisman A.M., Gelade G. A feature-integration theory of attention. Cognit. Psychol. 12(1):1980;97-136.
85. Tsotsos J.K., Culhane S.M., Wai W.Y.K., Lai Y., Davis N., Nuflo F. Modeling visual attention via selective tuning. Artificial Intell. 78:1995;507-545.
86. Ungerleider L.G., Mishkin M. Two cortical visual systems. Ingle D.J., Goodale M.A., Mansfield R.J.W. Analysis of Visual Behavior. 1982;549-586 MIT Press, Cambridge, MA.
87. VanRullen R., Gautrais J., Delorme A., Thorpe S.J. Face processing using one spike per neuron. Biosystems. 48(1-3):1998;229-239.
88. VanRullen R., Thorpe S.J. Spatial attention in asynchronous neural networks. Neurocomputing. 26-27:1999;911-918.
89. VanRullen R., Thorpe S.J. The time course of visual processing: from early perception to decision-making. J. Cognit. Neurosci. 13(4):2001;454-461.
90. VanRullen R., Thorpe S.J. Is it a bird. Is it a plane? Ultra-rapid visual categorisation of natural and artifactual objects. Perception. 30(6):2001;655-668.
91. VanRullen R., Thorpe S.J. Rate coding versus temporal order coding: what the retinal ganglion cells tell the visual cortex. Neural Comput. 13(6):2001;1255-1283.
92. Vidyasagar T.R. Gating of neuronal responses in macaque primary visual cortex by an attentional spotlight. Neuroreport. 9(9):1998;1947-1952.
93. Vidyasagar T.R. A neuronal model of attentional spotlight: parietal guiding the temporal. Brain Res. Brain Res. Rev. 30(1):1999;66-76.
94. von der Heydt R., Peterhans E., Baumgartner G. Illusory contours and cortical neuron responses. Science. 224(4654):1984;1260-1262.
95. Wallis G., Rolls E.T. Invariant face and object recognition in the visual system. Prog. Neurobiol. 51(2):1997;167-194.
96. Wallis J.D., Anderson K.C., Miller E.K. Single neurons in prefrontal cortex encode abstract rules. Nature. 411(6840):2001;953-956.
97. Wolfe J.M., Cave K.R., Franzel S.L. Guided search: an alternative to the feature integration model for visual search. J. Exp. Psychol. Hum. Percept. Perform. 15(3):1989;419-433.