A model of motion transparency processing with local center-surround interactions and feedback

Neural Computation

Volumn 23, Issue 11, 2011, Pages 2868-2914

  Raudies, Florian ^a   Mingolla, Ennio ^a   Neumann, Heiko ^b  

^a BOSTON UNIVERSITY   (United States)

^b UNIVERSITY OF ULM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; BIOLOGICAL MODEL; BRAIN; HUMAN; LETTER; MOVEMENT PERCEPTION; PHYSIOLOGY; THEORETICAL MODEL;

ALGORITHMS; ANIMALS; BRAIN; HUMANS; MODELS, NEUROLOGICAL; MODELS, THEORETICAL; MOTION PERCEPTION;

EID: 80053989479     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00193     Document Type: Letter

References (104)

1. Adelson, E., & Bergen, J. (1985). Spatiotemporal energy models for the perception of motion. Journal of the Optical Society of America, Series A, 2, 284-299.
2. Albright, T. (1984). Direction and orientation selectivity of neurons in visual areaMT of the macaque. Journal of Neurophysiology, 52, 1106-1130.
3. Albright, T., & Desimone, R. (1987). Local precision of visuotopic organization in middle temporal area (MT) of the macaque. Experimental Brain Research, 65, 582-592.
4. Angelucci, A., Levitt, J., Walton, E., Huṕe, J.-M., Bullier, J., & Lund, J. (2002). Circuits for local and global signal integration in primary visual cortex. Journal of Neuroscience, 22, 8633-8646.
5. Atick, J. (1992). Could information theory provide an ecological theory of sensory processing? Network, 3, 213-251.
6. Bayerl, P., &Neumann, H. (2004). Disambiguating visualmotion through contextual feedback modulation. Neural Computation, 16, 2041-2066.
7. Black, M., & Anandan, P. (1993). A framework for the robust estimation of optical flow. In Proceeding of the Fourth International Conference on Computer Visions (p. 231-236). Piscataway, NJ: IEEE.
8. Black, M.,&Anandan, P. (1996). The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields. Computer Vision and Image Understanding, 63, 75-104.
9. Black, M. J., & Fleet, D. J. (2000). Probabilistic detection and tracking of motion boundaries. International Journal of Computer Vision, 38, 231-245.
10. Blatt, G., Andersen, R., & Stoner, G. (1990). Visual receptive field organization and corticocortical connections of the lateral intraparietal area (area LIP) in the macaque. Journal of Comparative Neurology, 299, 421-445.
11. Born, R., & Bradley, D. (2005). Structure and function of visual area MT. Annual Review of Neuroscience, 28, 157-189.
12. Born, R., & Tootell, R. (1992). Segregation of global and local motion processing in primate middle temporal visual area. Nature, 357, 497-499.
13. Boussaoud, D.,Ungerleider, L.,&Desimone,R. (1990). Pathways for motion analysis: Conical connections of the medial superior temporal and fundus of the superior temporal visual areas in the macaque. Journal of Comparative Neurology, 296, 462-495.
14. Braddick,O.,&Qian, N. (2001). The organization of globalmotion and transparency. In J. Zanker & J. Zeil (Eds.) Motion vision: Computational, neural, and ecological constraints (p. 85-112). Heidelberg: Springer-Verlag.
15. Braddick, O., Wishart, K., & Curran, W. (2002). Directional performance in motion transparency. Vision Research, 42, 1237-1248.
16. Bruyn, B. D., & Orban, G. A. (1999). What is the speed of transparent and kinetic boundary displays? Perception, 28, 703-709.
17. Brunel, N. (2000). Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. Journal of Computational Neuroscience, 8, 183-208.
18. Bullier, J. (2003). Hierarchies of cortical areas. In J. H. Kaas & C. E. Collins (Eds.), The primate visual system (p. 181-204). Boca Raton, FL: CRC Press.
19. Bullier, J., Huṕe, J., James, A., & Girard, P. (2001). The role of feedback connections in shaping the responses of visual cortical neurons. Progress in Brain Research, 134, 193-204.
20. Burr, D., McKee, S., & Morrone, C. (2006). Resolution for spatial segregation and spatial localization by motion signals. Vision Research, 46, 932-939.
21. Darrell, T., & Pentland, A. (1991). Robust estimation of a multi-layered motion representation. In IEEE Workshop on Visual Motion. Piscataway, NJ: IEEE.
22. Darrell, T., & Simoncelli, E. (1993). Separation of transparent motion into layers using velocity-tuned mechansims (Tech. Rep. No. 244). Cambridge, MA: MIT Media Laboratory, Vision and Modeling Group.
23. Daugman, J. (1985). Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. Journal of the Optical Society of America, Series A, 2, 1160-1169.
24. Desimone, R., & Duncan, J. (1995). Neural mechanisms of selective visual attention. Annual Review of Neuroscience, 18, 193-222.
25. DeValois, R., Albrecht, D., & Thorell, L. (1982). Spatial frequency selectivity of cells in macaque visual cortex. Vision Research, 22, 545-559.
26. DeValois, R., Yund, E., & Helper, N. (1982). The orientation and direction selectivity of cells in macaque visual cortex. Vision Research, 22, 531-544.
27. Dow, B., Snyder, A.,Vautin, R.,&Bauer, R. (1981).Magnification factor and receptive field size in foveal striate cortex of the monkey. Experimental Brain Research, 44, 213-228.
28. Dubin, M., & Duffy, C. (2007). Behavioral influences on cortical neuronal responses to optic flow. Cerebral Cortex, 17, 1722-1732.
29. Duffy, C.,&Wurtz, R. (1995). Response ofmonkeyMST neurons to optic flow stimuli with shifted centers of motion. Journal of Neuroscience, 15, 5192-5208.
30. Durant, S., Donoso-Barrera, A., Tan, S., & Johnston, A. (2006).Moving fromspatially segregated to transparent motion: A modeling approach. Biology Letters, 2, 101-105.
31. Eckhorn, R., Reitboeck, H., Arndt, M., & Dicke, P. (1990). Feature linking via synchronization among distributed assemblies: Simulations of results fromcat visual cortex. Neural Computation, 2, 293-307.
32. Edwards, M.,&Nishida, S. (1999).Global-motion detection with transparent-motion signals. Vision Research, 39, 2239-2249.
33. Eifuku, S., &Wurtz, R. (1998). Response to motion in extrastriate area MSTl: Centersurround interactions. Journal of Neurophysiology, 80, 282-296.
34. Felisberti, F., & Zanker, J. (2005). Attention modulates perception of transparent motion. Vision Research, 45, 2587-2599.
35. Felleman, D., & van Essen, D. (1984). Distributed hierarchical processing in the primate visual cortex. Cerebral Cortex, 1, 1-47.
36. Fleet, D. J., &Weiss, Y. (2005). Optical flow estimation. In N. Paragios, Y. Chen, & O. Faugeras (Eds.) Mathematical models for computer vision: The handbook. NewYork: Springer.
37. Gabor, D. (1946). Theory of communication. Journal of the Institution of Electrical Engineers Part III: Radio and Communication Engineering, 93, 429-457.
38. Gold, J., & Shadlen, M. (2007). The neural basis of decision making. Annual Review of Neuroscience, 30, 535-574.
39. Graziano, M., Andersen, R., & Snowden, R. (1994). Tuning of MST neurons to spiral motions. Journal of Neuroscience, 14, 54-67.
40. Greenwood, J., & Edwards, M. (2009). The detection of multiple global directions: Capacity limitswith spatially segregated and transparent-motion signals. Journal of Vision, 9, 1-15.
41. Hassenstein, B., & Reichardt, W. (1956). Systemtheoretische Analyse der Zeitreihenfolgen und Vorzeichenauswertung bei der Bewegungsperzeption des R̈ usselk̈afers, Chlorophanus. 2. Naturforschung Teil B, 11, 513-524.
42. Heeger, D. (1987).Model the extraction of image flow. Journal of the Optical Society of America, Series A, 4, 1455-1471.
43. Hill, G., & Raymond, J. (2002). Deficits of motion transparency perception in adult developmental dyslexis with normal unidirectional motion sensitivity. Vision Research, 42, 1195-1203.
44. Horn, B., & Schunk, B. (1981). Determining optical flow. Artifical Intelligence, 17, 185-203.
45. Huṕe, H., Girard, A., Lomber, S., Paynen, B., & Bullier, J. (2001). Feedback connections act on the early part of the responses in monkey visual cortex. Journal of Neurophysiology, 85, 134-145.
46. Husain, M., Treue, S., & Andersen, R. A. (1989). Surface interpolation in threedimensional structure-from-motion perception. Neural Computation, 1, 324-333.
47. Johnston, A., McOwan, P., & Benton, C. (1999). Robust velocity computation from a biologically motivated model of motion perception. Proceedings of the Royal Society, Series B, 266, 509-518.
48. Ju, S., Black, M.,&Jepson, A. (1996). Skin and bones: Multi-layer, locally affine, optical flow and regularization with transparency. In Proceeding of the IEEE Conference onComputer Vision and Pattern Recognition (pp. 307-314). Piscataway, NJ: IEEE.
49. Kastner, S., Weerd, P. D., Desimone, R., & Ungerleider, L. (1998). Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI. Science, 282, 108-111.
50. Kim, J., & Wilson, H. (1996). Direction repulsion between components in motion transparency. Vision Research, 36, 1177-1187.
51. Langley, K., Fleet, D., & Atherton, T. (1992). On transparent motion computation. In Proceedings of BritishMachine Vision Conference (pp. 247-257). New York: Springer.
52. Macmillan, N.,&Creelman, C. (2001). Detection theory A user's guide (ed.). Mahwah, NJ: Erlbaum, and London: Taylor & Francis.
53. Maunsell, J., & van Essen, D. (1983). The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey. Journal of Neuroscience, 3, 2563-2586.
54. Maunsell, J.,&Newsome,W. (1987). Visual processing in monkey extrastriate cortex. Annual Review of Neuroscience, 10, 363-402.
55. McOwan, P., & Johnston, A. (1996). Motion transparency arises from perceptual grouping: Evidence from luminance and contrast modulation motion displays. Current Biology, 6, 1343-1346.
56. Mechler, F., Reich, D., & Victor, J. (2002). Detection and discrimination of relative spatial phase by V1 neurons. Journal of Neuroscience, 22, 6129-6157.
57. Meso, A., & Zanker, J. (2009). Perceiving motion transparency in the absence of component direction differences. Vision Research, 49, 2187-2200.
58. Mestre, D., Masson, G., & Stone, L. (2001). Spatial scale of motion segmentation from speed cues. Vision Research, 41, 2697-2713.
59. Moran, J., & Desimone, R. (1985). Selective attention gates visual processing in the extrastriate cortex. Science, 229, 782-784.
60. Mota, C., Dorr, M., Stuke, I., & Barth, E. (2004). Categorization of transparentmotion patterns using the projective plane. Journal of Computer and Information Science, 5, 129-140.
61. Movshon, J. A., Adelson, E.H., Gizzi,M. S.,&Newsome,W. T. (1986). The analysis of moving visual patterns. In C. Chagas, R. Gattass, & C. Gross (Eds.), Experimental brain research supplement II: Pattern recognition mechanisms (pp. 117-151). New York: Springer.
62. Muckli, L., Singer,W., Zanella, F.,&Goebel, R. (2002). Integration of multiple motion vectors over space: An fMRI study of transparentmotion perception. NeuroImage, 16, 848-856.
63. Mulligan, J. (1992). Motion transparency is restricted to two planes. Investigation Ophthalmology Visual Science (Suppl.), 33, 1049.
64. Myung, I. (2003). Tutorial onmaximum likelihood estimation. Journal of Mathematical Psychology, 47, 90-100.
65. Nover, H., Anderson, C., & DeAngelis, G. (2005). A logarithmic, scale-invariant representation of speed in macaque middle temporal area accounts for speed discrimination performance. Journal of Neuroscience, 25, 10049-10060.
66. Nyquist, H. (1924). Certain factors affecting telegraph speed. Bell System Technical Journal, 3, 324-346.
67. Pack,C., Hunter, J.,&Born, R. (2005).Contrast dependency of suppressive influences in cortical area MT of alert macaque. Journal of Neurophysiology, 93, 1809-1815.
68. Page, W., & Duffy, C. (2007). Cortical neuronal responses to optic flow are shaped by visual strategies for steering. Cerebral Cortex, 18, 727-739.
69. Poggio, G., Doty, R., & Talbot,W. (1977). Fovea1 striate cortex of behaving monkey: Single neuron responses to square-wave gratings during fixation of gaze. Journal of Neurophysiology, 40, 1369-1391.
70. Qian, N., Andersen, R., & Adelson, E. (1994a). Transparent motion perception as detection of unbalanced motion signals. I: Psychophysics. Journal of Neuroscience, 14, 7357-7366.
71. Qian, N., Andersen, R., & Adelson, E. (1994b). Transparent motion perception as detection of unbalanced motion signals. III: Modeling. Journal of Neuroscience, 14, 7381-7392.
72. Rauber, H.-J., & Treue, S. (1999). Revisiting motion repulsion: Evidence for a general phenomenon? Vision Research, 39, 3187-3196.
73. Ringach, D. (2002). Spatial structure and symmetry of simple-cell receptive fields in macaque primary visual cortex. Journal of Neurophysiology, 88, 455-463.
74. Rodman, H. R., & Albright, T. D. (1987). Coding of visual stimulus velocity in area MT of the macaque. Vision Research, 27, 2035-2048.
75. Roitman, J., & Shadlen, M. (2002). Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. Journal of Neuroscience, 22, 9475-9489.
76. Rothenstein, A., & Tsotsos, J. (2008). Attention links sensing to recognition. Image and Vision Computing, 26, 114-126.
77. Saalmann, Y., Pigarev, I., & Vidyasagar, T. (2007). Neural mechanisms of visual attention: How top-down feedback highlights relevant locations. Science, 316, 1612-1615.
78. Saito, H., Yukie, M., Tanaka, K., Hikosaka, K., Fukada, Y., & Iwai, E. (1986). Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey. Journal of Neuroscience, 6, 145-157.
79. Schiller, P., Finlay, B., & Volman, S. (1976a). Quantitative studies of single cell properties in monkey striate cortex. II: Orientation specificity and ocular dominance. Journal of Neurophysiology, 39, 1320-1333.
80. Schiller, P., Finlay, B., & Volman, S. (1976b). Quantitative studies of single-cell properties in monkey striate cortex. III: Spatial frequency. Journal of Neurophysiology, 39, 1334-1351.
81. Seitz, A., Pilly, P., & Pack, C. (2008). Interactions between contrast and spatial displacement in visual motion processing. Current Biology, 18, R904-R906.
82. Simoncelli, E. P., & Heeger, D. J. (1998). A model of neuronal responses in visual area MT. Vision Research, 38, 743-761.
83. Snowden, R. J., Treue, S., Erikson, R. G., & Andersen, R. A. (1991). The response of area MT and V1 neurons to transparent motion. Journal of Neuroscience, 11, 2768-2785.
84. Stafstrom, C. E., Schwindt, P. C., & Crill, W. E. (1984). Receptive firing in layer V neurons from cat neocortex in vitro. Journal of Neurophysiology, 2, 264-277.
85. Stettler, D., Das, A., Bennett, J., & Gilbert, D. (2002). Lateral connectivity and contextual interactions in macaque primary visual cortex. Neuron, 36, 739-750.
86. Stone, J., Dreher, B., & Leventhal, A. (1979). Hierarchical and parallel mechanisms in the organization of visual cortex. Brain Research Review, 1, 345-394.
87. Stoner, G., Albright, T., & Ramachadran, V. (1990). Transparency and coherence in human motion perception. Nature, 344, 153-155.
88. Tanaka, K., Hikosaka, K., Saito, H., Yukie, M., Fukada, Y., & Iwai, E. (1986). Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey. Journal of Neuroscience, 6, 134-144.
89. Treue, S., Hol, K., & Rauber, H.-J. (2000). Seeing multiple directions of motion: Physiology and psychophysics. Nature Neuroscience, 3, 270-276.
90. Treue, S., & Maunsell, J. (1996). Attentional modulation of visual motion processing in cortical areas MT and MST. Nature, 382, 539-541.
91. Ungerleider, L., & Desimone, R. (1986). Cortical connections of visual areaMT in the macaque. Journal of Comparative Neurology, 248, 190-222.
92. Ungerleider, L., & Haxby, J. (1994). What and where in the human brain. Current Opinion in Neurobiology, 4, 157-165.
93. van Essen, D., Anderson, C., & Felleman, D. (1992). Information processing in the primate visual system: An integrated systems perspective. Science, 255, 419-423.
94. van Essen, D.,&Gallant, J. (1994). Neuralmechanisms of form andmotion processing in the primate visual cortex. Neuron, 13, 1-10.
95. van Santen, J., & Sperling, G. (1985). Elaborated Reichardt detectors. Journal of the Optical Society of America, Series A, 2, 300-321.
96. Wallace, J., & Mamassian, P. (2003). The efficiency of speed discrimination for coherent and transparent motion. Vision Research, 43, 2795-2810.
97. Wallach, H. (1935). Ü ber visuell wahrgenommene Bewegungsrichtung. Psychologische Forschung, 30, 325-380.
98. Watanabe, O., & Kikuchi,M. (2005). Nonlinearity of the population activity to transparent motion. Neural Networks, 18, 15-22.
99. Weiss, Y., Simoncelli, E. P., & Adelson, E. H. (2002). Motion illusions as optimal percepts. Nature Neuroscience, 5, 598-604.
100. Wichmann, F., & Hill, N. (2001). The psychometric function. I: Bootstrap-based confidence intervals and sampling. Perception and Psychophysics, 63, 1314-1329.
101. Zanker, J. (2005). A computational analysis of separatingmotion signals in transparent random dot kinematograms. Spatial Vision, 18, 431-445.
102. Zeki, S. (1978a). Functional specialization in the visual cortex of rhesus monkey. Nature, 274, 423-428.
103. Zeki, S. (1978b). Uniformity & diversity of structure and function in rhesus monkey prestriate visual cortex. Journal of Physiology, London, 277, 273-290.
104. Zipser, K., Lamme, V., & Schiller, P. (1996). Contextual modulation in primary visual cortex. Journal of Neuroscience, 16, 7376-7389.