A novel role for visual perspective cues in the neural computation of depth

Nature Neuroscience

Volumn 18, Issue 1, 2015, Pages 129-137

  Kim, Hyunggoo R ^a   Angelaki, Dora E ^b   Deangelis, Gregory C ^a  

^a UNIVERSITY OF ROCHESTER   (United States)

^b BAYLOR COLLEGE OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL CELL; ANIMAL EXPERIMENT; ASSOCIATION; BRAIN CORTEX; CONTROLLED STUDY; DEPTH PERCEPTION; EYE MOVEMENT; MACACA; MOTION; NONHUMAN; PERCEPTION DISORDER; PRIORITY JOURNAL; RANDOMIZATION; RETINA IMAGE; REVIEW; SIMULATION; VELOCITY; VISION; VISUAL SYSTEM; ANIMAL; MALE; PATCH CLAMP TECHNIQUE; PHOTOSTIMULATION; PHYSIOLOGY; RHESUS MONKEY;

ANIMALS; CUES; DEPTH PERCEPTION; EYE MOVEMENTS; MACACA MULATTA; MALE; PATCH-CLAMP TECHNIQUES; PHOTIC STIMULATION; VISUAL PERCEPTION;

EID: 84961289546     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.3889     Document Type: Review

References (61)

1. Rogers, B. & Graham, M. Motion parallax as an independent cue for depth perception. Perception 8, 125-134 (1979).
2. Koenderink, J.J. & van Doorn, A.J. Local structure of movement parallax of the plane. J. Opt. Soc. Am. A 66, 717-723 (1976).
3. Wallach, H. Perceiving a stable environment when one moves. Annu. Rev. Psychol. 38, 1-27 (1987).
4. von Holst, E. Relations between the central nervous system and the peripheral organs. Br. J. Anim. Behav. 2, 89-94 (1954).
5. Welchman, A.E., Harris, J.M. & Brenner, E. Extra-retinal signals support the estimation of 3D motion. Vision Res. 49, 782-789 (2009).
6. Royden, C.S., Banks, M.S. & Crowell, J.A. The perception of heading during eye movements. Nature 360, 583-585 (1992).
7. Banks, M.S., Ehrlich, S.M., Backus, B.T. & Crowell, J.A. Estimating heading during real and simulated eye movements. Vision Res. 36, 431-443 (1996).
8. Helmholtz, H.v. & Southall, J.P.C. Helmholtz's Treatise on Physiological Optics (Optical Society of America, Rochester, New York, USA, 1924).
9. Longuet-Higgins, H.C. & Prazdny, K. The interpretation of a moving retinal image. Proc. R. Soc. Lond. B Biol. Sci. 208, 385-397 (1980).
10. Rieger, J.H. & Lawton, D.T. Processing differential image motion. J. Opt. Soc. Am. A 2, 354-360 (1985).
11. Rieger, J.H. & Toet, L. Human visual navigation in the presence of 3-D rotations. Biol. Cybern. 52, 377-381 (1985).
12. Warren, W.H. & Hannon, D.J. Direction of self-motion is perceived from optical fow. Nature 336, 162-163 (1988).
13. van den Berg, A.V. Robustness of perception of heading from optic fow. Vision Res. 32, 1285-1296 (1992).
14. Rushton, S.K. & Warren, P.A. Moving observers, relative retinal motion and the detection of object movement. Curr. Biol. 15, R542-R543 (2005).
15. Warren, P.A. & Rushton, S.K. Optic fow processing for the assessment of object movement during ego movement. Curr. Biol. 19, 1555-1560 (2009).
16. Braunstein, M.L. & Payne, J.W. Perspective and the rotating trapezoid. J. Opt. Soc. Am. 58, 399-403 (1968).
17. Rogers, S. & Rogers, B.J. Visual and nonvisual information disambiguate surfaces specifed by motion parallax. Percept. Psychophys. 52, 446-452 (1992).
18. Hayashibe, K. Reversals of visual depth caused by motion parallax. Perception 20, 17-28 (1991).
19. Nawrot, M. Eye movements provide the extra-retinal signal required for the perception of depth from motion parallax. Vision Res. 43, 1553-1562 (2003).
20. Nawrot, M. & Stroyan, K. The motion/pursuit law for visual depth perception from motion parallax. Vision Res. 49, 1969-1978 (2009).
21. Nawrot, M. & Joyce, L. The pursuit theory of motion parallax. Vision Res. 46, 4709-4725 (2006).
22. Nawrot, M. Depth from motion parallax scales with eye movement gain. J. Vis. 3, 841-851 (2003).
23. Naji, J.J. & Freeman, T.C. Perceiving depth order during pursuit eye movement. Vision Res. 44, 3025-3034 (2004).
24. Nadler, J.W., Nawrot, M., Angelaki, D.E. & DeAngelis, G.C. MT neurons combine visual motion with a smooth eye movement signal to code depth-sign from motion parallax. Neuron 63, 523-532 (2009).
25. Nadler, J.W., Angelaki, D.E. & DeAngelis, G.C. A neural representation of depth from motion parallax in macaque visual cortex. Nature 452, 642-645 (2008).
26. Nadler, J.W. et al. Joint representation of depth from motion parallax and binocular disparity cues in macaque area MT. J. Neurosci. 33, 14061-14074 (2013).
27. Maunsell, J.H. & Van Essen, D.C. Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. J. Neurophysiol. 49, 1148-1167 (1983).
28. DeAngelis, G.C. & Newsome, W.T. Organization of disparity-selective neurons in macaque area MT. J. Neurosci. 19, 1398-1415 (1999).
29. Britten, K.H., Shadlen, M.N., Newsome, W.T. & Movshon, J.A. The analysis of visual motion: a comparison of neuronal and psychophysical performance. J. Neurosci. 12, 4745-4765 (1992).
30. Warren, W.H. Jr. & Hannon, D.J. Eye movements and optical fow. J. Opt. Soc. Am. A 7, 160-169 (1990).
31. Crowell, J.A., Banks, M.S., Shenoy, K.V. & Andersen, R.A. Visual self-motion perception during head turns. Nat. Neurosci. 1, 732-737 (1998).
32. Mahar, M., DeAngelis, G.C. & Nawrot, M. Roles of perspective and pursuit cues in the disambiguation of depth from motion parallax. J. Vis. 13, 969 (2013).
33. Page, W.K. & Duffy, C.J. MST neuronal responses to heading direction during pursuit eye movements. J. Neurophysiol. 81, 596-610 (1999).
34. Bradley, D.C., Maxwell, M., Andersen, R.A., Banks, M.S. & Shenoy, K.V. Mechanisms of heading perception in primate visual cortex. Science 273, 1544-1547 (1996).
35. Shenoy, K.V., Bradley, D.C. & Andersen, R.A. Infuence of gaze rotation on the visual response of primate MSTd neurons. J. Neurophysiol. 81, 2764-2786 (1999).
36. Zhang, T., Heuer, H.W. & Britten, K.H. Parietal area VIP neuronal responses to heading stimuli are encoded in head-centered coordinates. Neuron 42, 993-1001 (2004).
37. Kaneko, H. & Howard, I.P. Spatial properties of shear disparity processing. Vision Res. 37, 315-323 (1997).
38. Chowdhury, S.A. & DeAngelis, G.C. Fine discrimination training alters the causal contribution of macaque area MT to depth perception. Neuron 60, 367-377 (2008).
39. Tsutsui, K., Sakata, H., Naganuma, T. & Taira, M. Neural correlates for perception of 3D surface orientation from texture gradient. Science 298, 409-412 (2002).
40. Colby, C.L., Duhamel, J.R. & Goldberg, M.E. Ventral intraparietal area of the macaque: anatomic location and visual response properties. J. Neurophysiol. 69, 902-914 (1993).
41. Bremmer, F., Duhamel, J.R., Ben Hamed, S. & Graf, W. Heading encoding in the macaque ventral intraparietal area (VIP). Eur. J. Neurosci. 16, 1554-1568 (2002).
42. Saito, H. et al. Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey. J. Neurosci. 6, 145-157 (1986).
43. Tanaka, K. & Saito, H. Analysis of motion of the visual feld by direction, expansion/contraction, and rotation cells clustered in the dorsal part of the medial superior temporal area of the macaque monkey. J. Neurophysiol. 62, 626-641 (1989).
44. Duffy, C.J. & Wurtz, R.H. Sensitivity of MST neurons to optic fow stimuli. I. A continuum of response selectivity to large-feld stimuli. J. Neurophysiol. 65, 1329-1345 (1991).
45. Maunsell, J.H. & van Essen, D.C. The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey. J. Neurosci. 3, 2563-2586 (1983).
46. Newsome, W.T., Wurtz, R.H. & Komatsu, H. Relation of cortical areas MT and MST to pursuit eye movements. II. Differentiation of retinal from extraretinal inputs. J. Neurophysiol. 60, 604-620 (1988).
47. Ono, S. & Mustari, M.J. Extraretinal signals in MSTd neurons related to volitional smooth pursuit. J. Neurophysiol. 96, 2819-2825 (2006).
48. Stanton, G.B., Bruce, C.J. & Goldberg, M.E. Topography of projections to posterior cortical areas from the macaque frontal eye felds. J. Comp. Neurol. 353, 291-305 (1995).
49. Schall, J.D., Morel, A., King, D.J. & Bullier, J. Topography of visual cortex connections with frontal eye feld in macaque: convergence and segregation of processing streams. J. Neurosci. 15, 4464-4487 (1995).
50. MacAvoy, M.G., Gottlieb, J.P. & Bruce, C.J. Smooth-pursuit eye movement representation in the primate frontal eye feld. Cereb. Cortex 1, 95-102 (1991).
51. Gu, Y., Watkins, P.V., Angelaki, D.E. & DeAngelis, G.C. Visual and nonvisual contributions to three-dimensional heading selectivity in the medial superior temporal area. J. Neurosci. 26, 73-85 (2006).
52. Van Essen, D.C. et al. An integrated software suite for surface-based analyses of cerebral cortex. J. Am. Med. Inform. Assoc. 8, 443-459 (2001).
53. Komatsu, H. & Wurtz, R.H. Relation of cortical areas MT and MST to pursuit eye movements. I. Localization and visual properties of neurons. J. Neurophysiol. 60, 580-603 (1988).
54. DeAngelis, G.C. & Uka, T. Coding of horizontal disparity and velocity by MT neurons in the alert macaque. J. Neurophysiol. 89, 1094-1111 (2003).
55. Albright, T.D., Desimone, R. & Gross, C.G. Columnar organization of directionally selective cells in visual area MT of the macaque. J. Neurophysiol. 51, 16-31 (1984).
56. Allman, J., Miezin, F. & McGuinness, E. Direction-and velocity-specifc responses from beyond the classical receptive feld in the middle temporal visual area (MT). Perception 14, 105-126 (1985).
57. Bradley, D.C. & Andersen, R.A. Center-surround antagonism based on disparity in primate area MT. J. Neurosci. 18, 7552-7565 (1998).
58. Koenderink, J.J. & van Doorn, A.J. Facts on optic fow. Biol. Cybern. 56, 247-254 (1987).
59. Royden, C.S., Crowell, J.A. & Banks, M.S. Estimating heading during eye movements. Vision Res. 34, 3197-3214 (1994).
60. Howard, I.P. & Rogers, B.J. Binocular Vision and Stereopsis (Oxford Univ. Press, New York, 1995).
61. Kaneko, H. & Howard, I.P. Spatial limitation of vertical-size disparity processing. Vision Res. 37, 2871-2878 (1997).