Modelling the dynamics of motion integration with a new luminance-gated diffusion mechanism

Vision Research

Volumn 50, Issue 17, 2010, Pages 1676-1692

  Tlapale, Émilien ^a   Masson, Guillaume S ^b   Kornprobst, Pierre ^a  

^a INRIA   (France)

^b CNRS and Université de la Méditerranée   (France)

Author keywords

2D motion integration; Luminance; Motion perception; Recurrent cortical model; Temporal dynamics

Indexed keywords

ARTICLE; BRAIN FUNCTION; DIFFUSION; DYNAMICS; LUMINANCE; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; MOVEMENT PERCEPTION; PRIORITY JOURNAL; RECEPTIVE FIELD; VISUAL STIMULATION;

EYE MOVEMENTS; HUMANS; LIGHTING; MODELS, BIOLOGICAL; MOTION PERCEPTION; PATTERN RECOGNITION, VISUAL;

EID: 77955088800     PISSN: 00426989     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.visres.2010.05.022     Document Type: Article

References (119)

1. Adelson E., Bergen J. Spatiotemporal energy models for the perception of motion. Journal of the Optical Society of America A 1985, 2:284-299.
2. Adelson E., Movshon J. Phenomenal coherence of moving visual patterns. Nature 1982, 300:523-525.
3. Aggarwal J., Nandhakumar N. On the computation of motion from sequences of images - A review. Proceedings of the IEEE 1988, 76:917-935.
4. Alexiadis D., Sergiadis G. Narrow directional steerable filters in motion estimation. Computer Vision and Image Understanding 2008, 110:192-211.
5. Alvarez L., Deriche R., Papadopoulo T., Sánchez J. Symmetrical dense optical flow estimation with occlusions detection. International Journal of Computer Vision 2007, 75:371-385.
6. Angelucci A., Bullier J. Reaching beyond the classical receptive field of V1 neurons: Horizontal or feedback axons?. Journal de Physiologie - Paris 2003, 97:141-154.
7. Anstis, S. (1990). Imperceptible intersections: The chopstick illusion. In AI and the eye (p. 105).
8. Aubert G., Kornprobst P. A mathematical study of the relaxed optical flow problem in the space BV. SIAM Journal on Mathematical Analysis 1999, 30:1282-1308.
9. Bair W., Cavanaugh J., Movshon A. Time course and time-distance relationships for surround suppression in macaque V1 neurons. Journal of Neuroscience 2003, 23:7690-7701.
10. Baker, S., Scharstein, D., Lewis, J., Roth, S., Black, M., & Szeliski, R. (2007). A database and evaluation methodology for optical flow. In International conference on computer vision, ICCV'07 (pp. 1-8).
11. Barraza J., Grzywacz N. Measurement of angular velocity in the perception of rotation. Vision Research 2002, 42:2457-2462.
12. Barron J., Fleet D., Beauchemin S. Performance of optical flow techniques. International Journal of Computer Vision 1994, 12:43-77.
13. Barthélemy F.V., Fleuriet J., Masson G.S. Temporal dynamics of 2D motion integration for ocular following in macaque monkeys. Journal of Neurophysiology 2010, 103:1275-1282.
14. Barthélemy F., Perrinet L., Castet E., Masson G.S. Dynamics of distributed 1d and 2d motion representations for short-latency ocular following. Vision Research 2008, 48:501-522.
15. Bayerl P., Neumann H. Disambiguating visual motion through contextual feedback modulation. Neural Computation 2004, 16:2041-2066.
16. Bayerl P., Neumann H. Attention and figure-ground segregation in a model of motion perception. Journal of Vision 2005, 5:659.
17. Bayerl P., Neumann H. Disambiguating visual motion by form-motion interaction - A computational model. International Journal of Computer Vision 2007, 72:27-45.
18. Beck C., Neumann H. Interactions of motion and form in visual cortex - A neural model. Journal of Physiology - Paris 2010, 104:61-70.
19. Berzhanskaya J., Grossberg S., Mingolla E. Laminar cortical dynamics of visual form and motion interactions during coherent object motion perception. Spatial Vision 2007, 20:337-395.
20. Born R., Bradley D. Structure and function of visual area MT. Annual Review of Neuroscience 2005, 28:157-189.
21. Born R., Pack C., Ponce C., Yi S. Temporal evolution of 2-dimensional direction signals used to guide eye movements. Journal of Neurophysiology 2006, 95:284-300.
22. Bosking W., Zhang Y., Schofield B., Fitzpatrick D. Orientation selectivity and the arrangement of horizontal connections in tree shrew striate cortex. Journal of Neuroscience 1997, 17:2112-2127.
23. Bowns L. Evidence for a feature tracking explanation of why type II plaids move in the vector sum direction at short durations. Vision Research 1996, 36:3685-3694.
24. Bradley D., Goyal M. Velocity computation in the primate visual system. Nature Reviews Neuroscience 2008, 9:686-695.
25. Bullier J. Integrated model of visual processing. Brain Research Reviews 2001, 36:96-107.
26. Castet E., Charton V., Dufour A. The extrinsic/intrinsic classification of two-dimensional motion signals with barber-pole stimuli. Vision Research 1999, 39:915-932.
27. Castet E., Lorenceau J., Shiffrar M., Bonnet C. Perceived speed of moving lines depends on orientation, length, speed and luminance. Vision Research 1993, 33:1921.
28. Chey J., Grossberg S., Mingolla E. Neural dynamics of motion processing and speed discrimination. Vision Research 1997, 38:2769-2786.
29. Dayan P., Abbott L. Theoretical neuroscience: Computational and mathematical modeling of neural systems 2001, MIT Press.
30. Derpanis, K., & Gryn, J. (2005). Three-dimensional nth derivative of gaussian separable steerable filters. In IEEE international conference on image processing (Vol. 3, pp. 553-556).
31. Escobar, M.-J. (2009). Bio-inspired models for motion estimation and analysis: Human action recognition and motion integration. PhD thesis Université de Nice Sophia-Antipolis.
32. Fennema C., Thompson W. Velocity determination in scenes containing several moving objects. Computer Graphics and Image Processing 1979, 9:301-315.
33. Ferrera V., Wilson H. Perceived direction of moving two-dimensional patterns. Vision Research 1990, 30:273-287.
34. Field D., Hayes A., Hess R. Contour integration by the human visual system: Evidence for a local association field. Vision Research 1993, 33:173-193.
35. Fine I., MacLeod D., Boynton G. Surface segmentation based on the luminance and color statistics of natural scenes. Journal of the Optical Society of America A 2003, 20:1283-1291.
36. Frazor R., Geisler W. Local luminance and contrast in natural images. Vision Research 2006, 46:1585-1598.
37. Freeman W., Adelson E. The design and use of steerable filters. IEEE Transactions on Pattern Analysis and Machine Intelligence 1991, 13:891-906.
38. Geisler W. Visual perception and the statistical properties of natural scenes. Annual Review of Psychology 2008, 59:167-192.
39. Geisler W., Albrecht D., Crane A. Responses of neurons in primary visual cortex to transient changes in local contrast and luminance. Journal of Neuroscience 2007, 27:5063.
40. Georges S., Seriès P., Frégnac Y., Lorenceau J. Orientation dependent modulation of apparent speed: Psychophysical evidence. Vision Research 2002, 42:2757-2772.
41. Gorea A., Lorenceau J. Directional performances with moving plaids: Component-related and plaid-related processing modes coexist. Spatial Vision 1991, 5:231-252.
42. Grossberg S., Mingolla E. Neural dynamics of form perception: Boundary completion, illusory figures, and neon color spreading. Psychological Review 1985, 92:173-211.
43. Grossberg S., Mingolla E., Viswanathan L. Neural dynamics of motion integration and segmentation within and across apertures. Vision Research 2001, 41:2521-2553.
44. Grzywacz N., Yuille A. Theories for the visual perception of local velocity and coherent motion. Computational models of visual processing Bradford books chapter 16 1991, 231-252. The MIT Press. M. Landy, J. Movshon (Eds.).
45. Heeger D. Optical flow using spatiotemporal filters. International Journal of Computer Vision 1988, 1:279-302.
46. Hess R., Field D. Integration of contours: New insights. Trends in Cognitive Sciences 1999, 3:480-486.
47. Hess R., Hayes A., Field D. Contour integration and cortical processing. Journal of Physiology - Paris 2003, 97:105-119.
48. Hildreth E. The detection of intensity changes by computer and biological vision systems. Computer Vision, Graphics, and Image Processing 1983, 22:1-27.
49. Hildreth, E. (1983b). The measurement of visual motion. PhD thesis MIT.
50. Horn B., Schunk B. Determining optical flow. Artificial Intelligence 1981, 17:185-203.
51. Huang X., Albright T., Stoner G. Adaptive surround modulation in cortical area MT. Neuron 2007, 53:761-770.
52. Hubel D., Wiesel T. Receptive fields, binocular interaction and functional architecture in the cat visual cortex. Journal of Physiology - Paris 1962, 160:106-154.
53. Hubel D., Wiesel T. Receptive fields and functional architecture of monkey striate cortex. Journal of Physiology 1968, 195:215.
54. Kapadia M., Ito M., Gilbert C., Westheimer G. Improvement in visual sensitivity by changes in local context: Parallel studies in human observers and in V1 of alert monkeys. Neuron 1995, 50:35-41.
55. Kinoshita M., Komatsu H. Neural representation of the luminance and brightness of a uniform surface in the macaque primary visual cortex. Journal of Neurophysiology 2001, 86:2559-2570.
56. Kooi T. Local direction of edge motion causes and abolishes the barberpole illusion. Vision Research 1993, 33:2347-2351.
57. Lamme V.A.F., Roelfsema P.R. The distinct modes of vision offered by feedforward and recurrent processing. Trends in Neurosciences 2000, 23:571-579.
58. Lee T., Mumford D. Hierarchical bayesian inference in the visual cortex. Journal of the Optical Society of America A 2003, 20.
59. Lee T., Nguyen M. Dynamics of subjective contour formation in the early visual cortex. Proceedings of the National Academy of Sciences 2001, 98:1907.
60. Lennie P., Movshon J.A. Coding of color and form in the geniculostriate pathway. Journal of the Optical Society of America A 2005, 22:2013-2033.
61. Löffler G., Orbach H. Computing feature motion without feature detectors: A model for terminator motion without end-stopped cells. Vision Research 1998, 39:859-871.
62. Lorenceau, J. (2010). From moving contours to object motion: Functional networks for visual form/motion processing. In Masson and Ilg (2010).
63. Lorenceau J., Alais D. Form constraints in motion binding. Nature Neuroscience 2001, 4:745-751.
64. Lorenceau J., Shiffrar M. The influence of terminators on motion integration across space. Vision Research 1992, 32:263-273.
65. Lorenceau J., Shiffrar M., Wells N., Castet E. Different motion sensitive units are involved in recovering the direction of moving lines. Vision Research 1993, 33:1207.
66. Mante V., Frazor R., Bonin V., Geisler W., Carandini M. Independence of luminance and contrast in natural scenes and in the early visual system. Nature Neuroscience 2005, 8:1690-1697.
67. Masson G., Castet E. Parallel motion processing for the initiation of short-latency ocular following in humans. Journal of Neuroscience 2002, 22:5147-5163.
68. Dynamics of visual motion processing. Neuronal, behavioral, and computational approaches 2010, Springer Verlag. 1st ed. G. Masson, U. Ilg (Eds.).
69. Masson G., Rybarczyk Y., Castet E., Mestre D. Temporal dynamics of motion integration for the initiation of tracking eye movements at ultra-short latencies. Visual Neuroscience 2000, 17:753-767.
70. Masson G., Rybarzcyk Y., Castet E., Mestre D. Temporal dynamics of motion integration for the initiation of tracking responses at ultra-short latencies. Visual Neuroscience 2000, 17:754-767.
71. Masson G., Stone L. From following edges to pursuing objects. Journal of Neurophysiology 2002, 88:2869-2873.
72. Montagnini A., Spering M., Masson G. Predicting 2D target velocity cannot help 2D motion integration for smooth pursuit initiation. Journal of Neurophysiology 2006, 96:3545-3550.
73. Movshon, J., Adelson, E., Gizzi, M., & Newsome, W. (1985). The analysis of visual moving patterns. Pattern recognition mechanisms (pp. 117-151).
74. Nagel H., Enkelmann W. An investigation of smoothness constraint for the estimation of displacement vector fields from image sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence 1986, 8:565-593.
75. Nakayama K., Silverman G. The aperture problem. II. Spatial integration of velocity information along contours. Vision Research 1988, 28:747-753.
76. Nelson J., Frost B. Intracortical facilitation among co-oriented, co-axially aligned simple cells in cat striate cortex. Experimental Brain Research 1985, 61:54-61.
77. Nowlan S., Sejnowski T. Filter selection model for motion segmentation and velocity integration. Journal of the Optical Society of America A 1994, 11:3177-3199.
78. Otte M., Nagel H. Optical flow estimation: Advances and comparisons. Volume 800 of lecture notes in computer science 1994, 51-70. Springer-Verlag. J.-O. Eklundh (Ed.).
79. Pack C., Born R. Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain. Nature 2001, 409:1040-1042.
80. Pack C., Born R. Integration of motion signals over regions of uniform luminance by mt neurons in the alert macaque. Journal of Vision 2002, 2:412a. Abstract.
81. Pack C., Gartland A., Born R. Integration of contour and terminator signals in visual area MT of alert macaque. Journal of Neuroscience 2004, 24:3268-3280.
82. Pack C., Hunter J., Born R. Contrast dependence of suppressive influences in cortical area MT of alert macaque. Journal of Neurophysiology 2005, 93:1809-1815.
83. Pack C., Livingstone M., Duffy K., Born R. End-stopping and the aperture problem: Two-dimensional motion signals in macaque v1. Neuron 2003, 39:671-680.
84. Paradiso M., Blau S., Huang X., MacEvoy S., Rossi A., Shalev G. Lightness, filling-in, and the fundamental role of context in visual perception. Progress in Brain Research 2006, 155:109-123.
85. Peng X., Van Essen D. Peaked encoding of relative luminance in macaque areas V1 and V2. Journal of Neurophysiology 2005, 93:1620-1632.
86. Polat U., Sagi D. Lateral interactions between spatial channels: Suppression and facilitation revealed by lateral masking experiments. Vision Research 1993, 33:993.
87. Polat U., Sagi D. The architecture of perceptual spatial interactions. Vision Research 1994, 34:73-78.
88. Power R., Moulden B. Spatial gating effects on judged motion of gratings in apertures. Perception 1992, 21:449.
89. Priebe N., Lisberger S., Movshon A. Tuning for spatiotemporal frequency and speed in directionally selective neurons of macaque striate cortex. Journal of Neuroscience 2006, 26:2941-2950.
90. Reichardt W. Autokorrelationsauswertung als funktionsprinzip des zentralnervensystems. Zeitschrift fur Naturforschung 1957, 12:447-457.
91. Rodman H., Albright T. Single-unit analysis of pattern-motion selective properties in the middle temporal visual area (MT). Experimental Brain Research 1989, 75:53-64.
92. Rossi A., Rittenhouse C., Paradiso M. The representation of brightness in primary visual cortex. Science 1996, 273:1104.
93. Rust N., Mante V., Simoncelli E., Movshon J. How MT cells analyze the motion of visual patterns. Nature Neuroscience 2006, 9:1421-1431.
94. Sceniak M.P., Ringach D.L., Hawken M.J., Shapley R. Contrast's effect on spatial summation by macaque V1 neurons. Nature Neuroscience 1999, 2:733-739.
95. Seriès P., Georges S., Lorenceau J., Frégnac Y. Orientation dependent modulation of apparent speed: A model based on the dynamics of feedforward and horizontal connectivity in V1 cortex. Vision Research 2002, 42:2781-2798.
96. Shiffrar M., Li X., Lorenceau J. Motion integration across differing image features. Vision Research 1995, 35:2137-2146.
97. Shiffrar M., Lorenceau J. Increased motion linking across edges with decreased luminance contrast, edge width and duration. Vision Research 1996, 36:2061-2067.
98. Shimojo S., Silverman G., Nakayama K. Occlusion and the solution to the aperture problem for motion. Vision Research 1989, 29:619-626.
99. Sillito A., Cudeiro J., Jones H. Always returning: Feedback and sensory processing in visual cortex and thalamus. Trends in Neurosciences 2006, 29:307-316.
100. Simoncelli E., Heeger D. A model of neuronal responses in visual area MT. Vision Research 1998, 38:743-761.
101. Simoncelli E., Olshausen B. Natural image statistics and neural representation. Annual Review of Neuroscience 2001, 24:1193-1216.
102. Smith M., Majaj N., Movshon A. Dynamics of motion signaling by neurons in macaque area MT. Nature Neuroscience 2005, 8:220-228.
103. Stettler D., Das A., Bennett J., Gilbert C. Lateral connectivity and contextual interactions in macaque primary visual cortex. Neuron 2002, 36:739-750.
104. Stiller C., Konrad J. Estimating motion in image sequences. Signal Processing Magazine, IEEE 1999, 16:70-91.
105. Tani T., Yokoi I., Ito M., Tanaka S., Komatsu H. Functional organization of the cat visual cortex in relation to the representation of a uniform surface. Journal of Neurophysiology 2003, 89:1112-1125.
106. Van Santen J., Sperling G. Elaborated Reichardt detectors. Journal of the Optical Society of America A 1985, 2:300-320.
107. Wallace J., Stone L., Masson G. Object motion computation for the initiation of smooth pursuit eye movements in humans. Journal of Neurophysiology 2005, 93:2279-2293.
108. Wallach H. Über visuell wahrgenommene Bewegungsrichtung. Psychological Research 1935, 20:325-380.
109. Wallach H., Weisz A., Adams P. Circles and derived figures in rotation. American Journal of Psychology 1956, 69:48-59.
110. Wall K., Danielsson P. A fast sequential method for polygonal approximation of digitized curves. CVGIP 1984, 28:220-227.
111. Watson A., Ahumada A. Model of human visual-motion sensing. Journal of the Optical Society of America A 1985, 2:322-342.
112. Weickert, J. (1997). Coherence-enhancing diffusion of colour images. In 7th National symposium on pattern recognition and image analysis.
113. Weiss Y., Adelson E. Adventures with gelatinous ellipses - Constraints on models of human motion analysis. Perception 2000, 29:543-566.
114. Weiss Y., Fleet D. Velocity likelihoods in biological and machine vision. Perception and neural function 2001, 81-100. MIT Press.
115. Wilson H., Ferrera V., Yo C. A psychophysically motivated model for two-dimensional motion perception. Visual Neuroscience 1992, 9:79-97.
116. Xiao J., Cheng H., Sawhney H., Rao C., Isnardi M. Bilateral filtering-based optical flow estimation with occlusion detection. Proceedings of the 9th European conference on computer vision lecture notes in computer science 2001, Springer-Verlag.
117. Yo C., Wilson H. Perceived direction of moving two-dimensional patterns depends on duration, contrast and eccentricity. Vision Research 1992, 32:135-147.
118. Yuille A., Grzywacz N. A computational theory for the perception of coherent visual motion. Nature 1988, 333:71-74.
119. Yuille A., Grzywacz N. A winner-take-all mechanism based on presynaptic inhibition feedback. Neural Computation 1989, 1:334-347.