Stereopsis and 3D surface perception by spiking neurons in laminar cortical circuits: A method for converting neural rate models into spiking models

Neural Networks

Volumn 26, Issue , 2012, Pages 75-98

  Cao, Yongqiang ^a   Grossberg, Stephen ^a  

^a BOSTON UNIVERSITY   (United States)

Author keywords

Binocular vision; Depth perception; Integrate and fire neuron; Laminar cortical circuits; LAMINART model; Lightness perception; Monocular binocular interactions; Perceptual grouping; Spiking neurons; Stereopsis; Surface perception; V1; V2; V4; Visual cortex; VLSI

Indexed keywords

INTEGRATE-AND-FIRE NEURONS; LAMINART MODELS; LIGHTNESS PERCEPTION; MONOCULAR-BINOCULAR INTERACTIONS; PERCEPTUAL GROUPING; SPIKING NEURON; STEREOPSIS; SURFACE PERCEPTION; V1; V2; V4; VISUAL CORTEXES; VLSI;

BINOCULAR VISION; BINOCULARS; DEPTH PERCEPTION; LAMINAR BOUNDARY LAYER; NEURAL NETWORKS; NEURONS; VLSI CIRCUITS;

THREE DIMENSIONAL;

ARTICLE; BINOCULAR VISION; BRAIN CORTEX; CELL INTERACTION; DEPTH PERCEPTION; FEEDBACK SYSTEM; INTERNEURON; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; MEMBRANE POTENTIAL; MOLECULAR DYNAMICS; MORPHOMETRICS; NERVE CELL; NEUROPHYSIOLOGY; PRIORITY JOURNAL; PSYCHOPHYSICS; PYRAMIDAL NERVE CELL; STEREOSCOPIC VISION; VISUAL ACUITY; VISUAL CORTEX;

ACTION POTENTIALS; ANIMALS; BRAIN MAPPING; COMPUTER SIMULATION; DEPTH PERCEPTION; HUMANS; MODELS, NEUROLOGICAL; NERVE NET; NEURONS; PERCEPTUAL CLOSURE; PHOTIC STIMULATION; REACTION TIME; VISION, BINOCULAR; VISUAL CORTEX; VISUAL PATHWAYS;

EID: 84855920586     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2011.10.010     Document Type: Article

References (71)

1. Abbott L.F., Varela K., Sen K., Nelson S.B. Synaptic depression and cortical gain control. Science 1997, 275:220-223.
2. Bakin J.S., Nakayama K., Gilbert C.D. Visual responses in monkey area V1 and V2 to three-dimensional surface configurations. The Journal of Neuroscience 2000, 20:8188-8198.
3. Bringuier V., Chavane F., Glaeser L., Frégnac Y. Horizontal propagation of visual activity in the synaptic integration field of area 17 neurons. Science 1999, 283:695-699.
4. Cao Y., Grossberg S. A laminar cortical model of stereopsis and 3D surface perception: closure and da Vinci stereopsis. Spatial Vision 2005, 18:515-578.
5. Cao, Y., & Grossberg, S. (2011). Laminar cortical computation of stereo disparity by spiking neurons (submitted for publication).
6. Cao Y., Grossberg S., Markowitz J. How does the brain rapidly learn and reorganize view-invariant and position-invariant object representations in the inferotemporal cortex?. Neural Networks 2011, 24:1050-1061.
7. Cohen M.A., Grossberg S. Neural dynamics of brightness perception: features, boundaries, diffusion, and resonance. Perception and Psychophysics 1984, 36:428-456.
8. Crook J.M., Engelmann R., Lowel S. Caba-inactivation attenuates collinear facilitation in cat primary visual cortex. Experimental Brain Research 2002, 143:295-302.
9. Fang L., Grossberg S. From stereogram to surface: how the brain sees the world in depth. Spatial Vision 2009, 22:45-82.
10. Fazl A., Grossberg S., Mingolla E. View-invariant object category learning, recognition, and search: how spatial and object attention are coordinated using surface-based attentional shrouds. Cognitive Psychology 2009, 58:1-48.
11. Francis G., Grossberg S., Mingolla E. Cortical dynamics of feature binding and reset: control of visual persistence. Vision Research 1994, 34:1089-1104.
12. Gillam B., Blackburn S., Cook M. Panum's limiting case: double fusion, convergence error, or 'da Vinci stereopsis'. Perception 1995, 24:333-346.
13. Gillam B., Blackburn S., Nakayama K. Stereopsis based on monocular gaps: metrical encoding of depth and slant without matching contours. Vision Research 1999, 39:493-502.
14. Grimson W.E. A computer implementation of a theory of human stereo vision. Philosophical Transactions of the Royal Society (B) 1981, 292:217-253.
15. Grossberg S. Some physiological and biochemical consequences of psychological postulates. Proceedings of the National Academy of Sciences 1968, 60:758-765.
16. Grossberg S. On the production and release of chemical transmitters and related topics in cellular control. Journal of Theoretical Biology 1969, 22:325-364.
17. Grossberg S. Contour enhancement, short-term memory and constancies in reverberating neural networks. Studies in Applied Mathematics 1973, 52:217-257.
18. Grossberg S. How does a brain build a cognitive code?. Psychological Review 1980, 87:1-51.
19. Grossberg S. Outline of a theory of brightness, color, and form perception. Trends in mathematical psychology 1984, 5559-5586. North-Holland, Amsterdam. E. Degreef, J. van Buggenhaut (Eds.).
20. Grossberg S. 3D vision and figure-ground separation by visual cortex. Perception and Psychophysics 1994, 55:48-120.
21. Grossberg S. Cortical dynamics of three-dimensional figure-ground perception of two-dimensional figures. Psychological Review 1997, 104:618-658.
22. Grossberg S., Mingolla E. Neural dynamics of perceptual grouping: textures, boundaries, and emergent segmentations. Perception and Psychophysics 1985, 38:141-147.
23. Grossberg S., Mingolla E. Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. Psychological Review 1985, 92:173-211.
24. Grossberg S. How does the cerebral cortex work? Learning, attention and grouping by the laminar circuits of visual cortex. Spatial Vision 1999, 12:163-186.
25. Grossberg S. The link between brain learning, attention, and consciousness. Consciousness and Cognition 1999, 8:1-44.
26. Grossberg S. The complementary brain: unifying brain dynamics and modularity. Trends in Cognitive Sciences 2000, 4:233-246.
27. Grossberg S. Cortical and subcortical predictive dynamics and learning during perception, cognition, emotion, and action. Philosophical Transactions of the Royal Society of London 2009, 364:1223-1234.
28. Grossberg S., Hong S. A neural model of surface perception: lightness, anchoring, and filling-in. Spatial Vision 2006, 19:263-321.
29. Grossberg S., Howe P.D.L. A laminar cortical model of stereopsis and three-dimensional surface perception. Vision Research 2003, 43:801-829.
30. Grossberg S., Kelly F. Neural dynamics of binocular brightness perception. Vision Research 1999, 39:3796-3816.
31. Grossberg S., McLoughlin N.P. Cortical dynamics of 3-D surface perception: binocular and half-occluded scenic images. Neural Networks 1997, 10:1583-1605.
32. Grossberg S., Mingolla E., Ross W.D. Visual brain and visual perception: how does the cortex do perceptual grouping?. Trends in Neurosciences 1997, 20:106-111.
33. Grossberg S., Raizada R.D. Contrast-sensitive perceptual grouping and object-based attention in the laminar circuits of primary visual cortex. Vision Research 2000, 40:1413-1432.
34. Grossberg S., Swaminathan G. A laminar cortical model for 3D perception of slanted and curved surfaces and of 2D images: development, attention and bistability. Vision Research 2004, 44:1147-1187.
35. Grossberg S., Todorović D. Neural dynamics of 1-D and 2-D brightness perception: a unified model of classical and recent phenomena. Perception and Psychophysics 1988, 43:241-277.
36. Grossberg S., Versace M. Spikes, synchrony, and attentive learning by laminar thalamocortical circuits. Brain Research 2008, 1218:278-312.
37. Grossberg S., Williamson J.R. A neural model of how horizontal and interlaminar connections of visual cortex develop into adult circuits that carry out perceptual groupings and learning. Cerebral Cortex 2001, 11:37-58.
38. Grossberg S., Yazdanbakhsh A. Laminar cortical dynamics of 3D surface perception: stratification, transparency, and neon color spreading. Vision Research 2005, 45:1275-1743.
39. Grossberg S., Yazdanbakhsh A., Cao Y., Swaminathan G. How does binocular rivalry emerge from cortical mechanisms of 3-D vision?. Vision Research 2008, 48:2232-2250.
40. Hodgkin A.L. The conduction of the nervous impulse 1964, Charles C Thomas, Springfield, IL.
41. Howard I.P., Rogers B.J. Binocular vision and stereopsis 1995, Oxford University Press, New York.
42. Howe P.D.L., Watanabe T. Measuring the depth induced by an opposite-luminance (but not anticorrelated) stereogram. Perception 2003, 32:415-421.
43. Hubel D.H., Wiesel T.N. Receptive fields and functional architecture of monkey striate cortex. The Journal of Physiology 1968, 195:215-243.
44. Ito M., Gilbert C.D. Attention modulates contextual influences in the primary visual cortex of alert monkeys. Neuron 1999, 22:593-604.
45. Julesz B. Foundations of cyclopean perception 1971, The University of Chicago Press, Chicago.
46. Kapadia M.K., Ito M., Gilbert C.D., Westheimer G. Improvement in visual sensitivity by changes in local context: parallel studies in human observers and in V1 of alert monkeys. Neuron 1995, 15:843-856.
47. Kelly F.J., Grossberg S. Neural dynamics of 3-D surface perception: figure-ground separation and lightness perception. Perception and Psychophysics 2000, 62:1596-1619.
48. Lamme V.A.F., Rodriguez-Rodriguez V., Spekreijse H. Separate processing dynamics for texture elements, boundaries and surfaces in primary visual cortex of the Macaque monkey. Cerebral Cortex 1999, 9(4):406-413.
49. Marr D., Poggio T. Cooperative computation of stereo disparity. Science 1976, 194:283-287.
50. McKee S.P., Bravo M.J., Smallman H.S., Legge G.E. The 'uniqueness constraint' and binocular masking. Perception 1995, 24:49-65.
51. McKee S.P., Bravo M.J., Taylor D.G., Legge G.E. Stereo matching precedes dichoptic masking. Vision Research 1994, 34:1047-1060.
52. McLoughlin N.P., Grossberg S. Cortical computation of stereo disparity. Vision Research 1998, 38:91-99.
53. Nakayama K., Shimojo S. da Vinci stereopsis: depth and subjective occluding contours from unpaired image points. Vision Research 1990, 30:1811-1825.
54. Panum P.L. Physiologische Untersuchungen ueber das Sehen mit zwei Augen 1858, Schwerssche Buchhandlung, Kiel, Translated by C. Hubscher 1940 (Hanover, NH: Dartmouth Eye Institute).
55. Paradiso M.A., Nakayama K. Brightness perception and filling-in. Vision Research 1991, 31:1221-1236.
56. Pessoa L., Neumann H. Why does the brain fill-in?. Trends in Cognitive Sciences 1998, 2(11):422-424.
57. Pessoa L., Thompson E., Noë A. Finding out about filling-in: a guide to perceptual completion for visual science and the philosophy of perception. Journal of Behavioral and Brain Science 1998, 21(6):723-802.
58. Pinna B., Brelstaff G., Spillmann L. Surface color from boundaries: a new 'watercolor' illusion. Vision Research 2001, 41:2669-2676.
59. Poggio G.F. Physiological basis of stereoscopic vision. Vision and visual dysfunction. Binocular vision 1991, 224-238. CRC, Boston, MA.
60. Polat U., Mizobe K., Pettet M.W., Kasamatsu T., Norcia A.M. Collinear stimuli regulate visual responses depending on cell's contrast threshold. Nature 1998, 391:580-584.
61. Ramachandran V.S., Nelson J.I. Global grouping overrides point-to-point disparities. Perception 1976, 5:125-128.
62. Roelfsema P.R., Lamme V.A.F., Spekreijse H. Object-based attention in the primary visual cortex of the Macaque monkey. Nature 1998, 395:376-381.
63. Roelfsema P.R., Spekreijse H. Correlates of gradual spread of attention over a traced curve in Macaque area V1. Society for neuroscience abstr., 7.2 1999.
64. Rossi A.F., Rittenhouse C.D., Paradiso M.A. The representation of brightness in primary visual cortex. Science 1996, 273:1104-1107.
65. Schor C., Heckmann T. Interocular differences in contrast and spatial frequency: effects on stereopsis and fusion. Vision Research 1989, 29:837-847.
66. Smallman H.S., McKee S.P. A contrast ratio constraint on stereo matching. Proceedings of the Royal Society of London. Series B 1995, 260:265-271.
67. Tausch R. Die beidaugige Raumwahmehmung-ein Prozess auf Grund der Korrespondenz und Disparation von Gestalten anstelle der Korrespondenz oder Disparation einzelner Netzhautelemente. Zeitschrift für Experimentelle und Angewandte Psychologie 1953, 1:394-421.
68. von der Heydt R., Peterhans E. Mechanisms of contour perception in monkey visual cortex. I. Lines of pattern discontinuity. Journal of Neuroscience 1989, 9:1731-1748.
69. von der Heydt R., Peterhans E., Baumgartner G. Illusory contours and cortical neuron responses. Science 1984, 224:1260-1262.
70. Wilde K. Der Punktreiheneffekt und die Rolle der binocularen Querdisparation beim Tienfenshen. Psychologische Forschung 1950, 23:223-262.
71. Yazdanbakhsh A., Watanabe T. Asymmetry between horizontal and vertical illusory lines in determining the depth of their embedded surface. Vision Research 2004, 44:2621-2627.