Depth estimation from retinal disparity requires eye and head orientation signals

Journal of Vision

Volumn 8, Issue 16, 2008, Pages

  Blohm, Gunnar ^a,b,c,d   Khan, Aarlenne Z ^a,b,e   Ren, Lei ^a,b   Schreiber, Kai M ^f   Crawford, J Douglas ^a,b  

^a YORK UNIVERSITY   (Canada)

^b CANADIAN INSTITUTES OF HEALTH RESEARCH   (Canada)

^c UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^d QUEEN S UNIVERSITY   (Canada)

^e SMITH KETTLEWELL EYE RESEARCH INSTITUTE   (United States)

^f RUTGERS UNIVERSITY   (United States)

Author keywords

Binocular vision; Computational modeling; Depth; Eye movements; Spatial vision

Indexed keywords

ADULT; ARTICLE; BINOCULAR CONVERGENCE; BINOCULAR VISION; BRAIN; DEPTH PERCEPTION; FEMALE; HEAD; HUMAN; MALE; ORIENTATION; PHYSIOLOGY; PSYCHOLOGICAL MODEL; PSYCHOMOTOR PERFORMANCE; REPRODUCIBILITY; VISION; VISUAL SYSTEM FUNCTION;

ADULT; BRAIN; CONVERGENCE, OCULAR; DEPTH PERCEPTION; FEMALE; HEAD; HUMANS; MALE; MODELS, PSYCHOLOGICAL; OCULAR PHYSIOLOGICAL PHENOMENA; ORIENTATION; PSYCHOMOTOR PERFORMANCE; REPRODUCIBILITY OF RESULTS; SPACE PERCEPTION; VISION DISPARITY; VISION, BINOCULAR; VISUAL PERCEPTION; YOUNG ADULT;

EID: 58049093103     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/8.16.3     Document Type: Article

References (90)

1. Aspragathos, N. A., & Dimitros, J. K. (1998). A comparative study of three methods for robot kinematics. IEEE Transactions on Systems, Man, and Cybernetics B: Cybernetics, 28, 135-145.
2. Backus, B. T., Banks, M. S., van Ee, R., & Crowell, J. A. (1999). Horizontal and vertical disparity, eye position, and stereoscopic slant perception. Vision Research, 39, 1143-1170.
3. Banks, M. S., Hooge, I. T., & Backus, B. T. (2001). Perceiving slant about a horizontal axis from stereopsis. Journal of Vision, 1(2):1, 55-79, http://journalofvision.org/1/2/1/, doi:10.1167/1.2.1.
4. Batista, A. P., Buneo, C. A., Snyder, L. H., & Andersen, R. A. (1999). Reach plans in eye-centered coordinates. Science, 285, 257-260.
5. Battaglia-Mayer, A., Caminiti, R., Lacquaniti, F., & Zago, M. (2003). Multiple levels of representation of reaching in the parieto-frontal network. Cerebral Cortex, 13, 1009-1022.
6. Bishop, P. O. (1989). Vertical disparity, egocentric distance and stereoscopic depth constancy: A new interpretation. Proceedings of the Royal Society of London B: Biological Sciences, 237, 445-469.
7. Blatt, G. J., Andersen, R. A., & Stoner, G. R. (1990). Visual receptive field organization and corticocortical connections of the lateral intraparietal area (area LIP) in the macaque. Journal of Comparative Neurology, 299, 421-445.
8. Blohm, G., & Crawford, J. D. (2007). Computations for geometrically accurate visually guided reaching in 3-D space. Journal of Vision, 7(5):4, 1-22, http://journalofvision.org/7/5/4/, doi:10.1167/7.5.4.
9. Bockisch, C. J., & Haslwanter, T. (2001). Three-dimensional eye position during static roll and pitch in humans. Vision Research, 41, 2127-2137.
10. Brand, L. (1947). Vector and tensor analysis (9th ed.). London: John Wiley and Sons.
11. Brenner, E., & van Damme, W. J. (1998). Judging distance from ocular convergence. Vision Research, 38, 493-498.
12. Brotchie, P. R., Andersen, R. A., Snyder, L. H., & Goodman, S. J. (1995). Head position signals used by parietal neurons to encode locations of visual stimuli. Nature, 375, 232-235.
13. Carey, D. P., Dijkerman, H. C., & Milner, A. D. (1998). Perception and action in depth. Consciousness and Cognition, 7, 438-453.
14. Clifford, W. (1873). Preliminary sketch of bi-quaternions. Proceedings of the London Mathematical Society, 4, 381-395.
15. Collewijn, H., & Erkelens, C. J. (1990). Binocular eye movements and the perception of depth. Reviews of Oculomotor Research, 4, 213-261.
16. Collewijn, H., Erkelens, C. J., & Steinman, R. M. (1997). Trajectories of the human binocular fixation point during conjugate and non-conjugate gaze-shifts. Vision Research, 37, 1049-1069.
17. Crawford, J. D., Medendorp, W. P., & Marotta, J. J. (2004). Spatial transformations for eye-hand coordination. Journal of Neurophysiology, 92, 10-19.
18. Crawford, J. D., & Vilis, T. (1991). Axes of eye rotation and Listing's law during rotations of the head. Journal of Neurophysiology, 65, 407-423.
19. Cumming, B. G., & DeAngelis, G. C. (2001). The physiology of stereopsis. Annual Review of Neuroscience, 24, 203-238.
20. DeAngelis, G. C., Cumming, B. G., & Newsome, W. T. (1998). Cortical area MT and the perception of stereoscopic depth. Nature, 394, 677-680.
21. DeSouza, J. F., Dukelow, S. P., & Vilis, T. (2002). Eye position signals modulate early dorsal and ventral visual areas. Cerebral Cortex, 12, 991-997.
22. Ding, J., & Sperling, G. (2006). A gain-control theory of binocular combination. Proceedings of the National Academy of Sciences of the United States of America, 103, 1141-1146.
23. Erkelens, C. J., & van Ee, R. (1998). A computational model of depth perception based on headcentric disparity. Vision Research, 38, 2999-3018.
24. Foley, J. M. (1980). Binocular distance perception. Psychological Review, 87, 411-434.
25. Genovesio, A., & Ferraina, S. (2004). Integration of retinal disparity and fixation-distance related signals toward an egocentric coding of distance in the posterior parietal cortex of primates. Journal of Neurophysiology, 91, 2670-2684.
26. Girshick, A. R., & Banks, M. S. (2005). Do people compensate for incorrect viewing position when looking at stereograms? Perception, 34, ECVP Abstract Supplement.
27. Gnadt, J. W., & Mays, L. E. (1995). Neurons in monkey parietal area LIP are tuned for eye-movement parameters in three-dimensional space. Journal of Neurophysiology, 73, 280-297.
28. Gogel, W. C. (1972). Scalar perceptions with binocular cues of distance. American Journal of Psychology, 85, 477-497.
29. Gonzalez, F., & Perez, R. (1998). Neural mechanisms underlying stereoscopic vision. Progress in Neurobiology, 55, 191-224.
30. Goodale, M. A. (2001). Different spaces and different times for perception and action. Progress in Brain Research, 134, 313-331.
31. Goodale, M. A., & Westwood, D. A. (2004). An evolving view of duplex vision: Separate but interacting cortical pathways for perception and action. Current Opinion in Neurobiology, 14, 203-211.
32. Goonetilleke, S. C., Mezey, L. E., Burgess, A. M., & Curthoys, I. S. (2008). On the relation between ocular torsion and visual perception of line orientation. Vision Research, 48, 1488-1496.
33. Hamilton, W. R. (1899). Elements of quaternions. Cambridge, UK: Cambridge University Press.
34. Harwerth, R. S., Smith, E. L., III, & Siderov, J. (1995). Behavioral studies of local stereopsis and disparity vergence inmonkeys. Vision Research, 35, 1755-1770.
35. Hasebe, H., Oyamada, H., Kinomura, S., Kawashima, R., Ouchi, Y., Nobezawa, S., et al. (1999). Human cortical areas activated in relation to vergence eye movements - A PET study. Neuroimage, 10, 200-208.
36. Haslwanter, T. (1995). Mathematics of three-dimensional eye rotations. Vision Research, 35, 1727-1739.
37. Haslwanter, T., Straumann, D., Hess, B. J., & Henn, V. (1992). Static roll and pitch in the monkey: Shift and rotation of Listing's plane. Vision Research, 32, 1341-1348.
38. Henriques, D. Y., & Crawford, J. D. (2000). Direction-dependent distortions of retinocentric space in the visuomotor transformation for pointing. Experimental Brain Research, 132, 179-194.
39. Hepp, K. (1990). On Listing's law. Communications in Mathematical Physics, 132, 285-292.
40. Hooge, I. T., & van den Berg, A. V. (2000). Visually evoked cyclovergence and extended Listing's law. Journal of Neurophysiology, 83, 2757-2775.
41. Horn, B. K. P. (1990). Relative orientation. International Journal of Computer Vision, 4, 59-78.
42. Howard, I. P., & Rogers, B. J. (1995). Binocular vision and stereopsis. Oxford, UK: Oxford University Press.
43. Howard, I. P., Sun, L., & Shen, X. (1994). Cycloversion and cyclovergence: The effects of the area and position of the visual display. Experimental Brain Research, 100, 509-514.
44. Johnston, E. B. (1991). Systematic distortions of shape from stereopsis. Vision Research, 31, 1351-1360.
45. Johnston, E. B., Cumming, B. G., & Parker, A. J. (1993). Integration of depth modules: Stereopsis and texture. Vision Research, 33, 813-826.
46. Khokhotva, M., Ono, H., & Mapp, A. P. (2005). The cyclopean eye is relevant for predicting visual direction. Vision Research, 45, 2339-2345.
47. Knill, D. C. (2005). Reaching for visual cues to depth: The brain combines depth cues differently for motor control and perception. Journal of Vision, 5(2):2, 103-115, http://journalofvision.org/ 5/2/2/, doi:10.1167/5.2.2.
48. Krug, K., Cumming, B. G., & Parker, A. J. (2004). Comparing perceptual signals of single V5/MT neurons in two binocular depth tasks. Journal of Neurophysiology, 92, 1586-1596.
49. Liu, B., Berends, E. M., & Schor, C. M. (2005). Adaptation to the induced effect stimulus normalizes surface slant perception and recalibrates eye position signals for azimuth. Journal of Vision, 5(10):5, 808-822, http://journalofvision.org/5/10/5/, doi:10.1167/ 5.10.5.
50. Martin, R. R. (1983). Rotation by quaternions. Mathematical Spectrum, 17, 42-48.
51. Mather, G. (1997). The use of image blur as a depth cue. Perception, 26, 1147-1158.
52. Mayhew, J. E., & Longuet-Higgins, H. C. (1982). A computational model of binocular depth perception. Nature, 297, 376-378.
53. Misslisch, H., Tweed, D., & Hess, B. J. (2001). Stereopsis outweighs gravity in the control of the eyes. Journal of Neuroscience, 21, RC126.
54. Mok, D., Ro, A., Cadera, W., Crawford, J. D., & Vilis, T. (1992). Rotation of Listing's plane during vergence. Vision Research, 32, 2055-2064.
55. Mon-Williams, M., & Tresilian, J. R. (1999). Some recent studies on the extraretinal contribution to distance perception. Perception, 28, 167-181.
56. Mon-Williams, M., & Tresilian, J. R. (2000). Ordinal depth information from accommodation? Ergonomics, 43, 391-404.
57. Mon-Williams, M., Tresilian, J. R., & Roberts, A. (2000). Vergence provides veridical depth perception from horizontal retinal image disparities. Experimental Brain Research, 133, 407-413.
58. Mueller, J. (1826). Zur vergleichenden physiologie des gesichtssinnes des menschen und der thiere. Leipzig, Germany: Cnobloch.
59. Neri, P. (2005). A stereoscopic look at visual cortex. Journal of Neurophysiology, 93, 1823-1826.
60. Ogle, K. N. (1938). Induced size effect: I. A new phenomenon in binocular space perception associated with the relative sizes of the images of the two eyes. Archives of Ophthalmology, 20, 604-623.
61. Ohzawa, I. (1998). Mechanisms of stereoscopic vision: The disparity energy model. Current Opinion in Neurobiology, 8, 509-515.
62. Ono, H., Mapp, A. P., & Howard, I. P. (2002). The cyclopean eye in vision: The new and old data continue to hit you right between the eyes. Vision Research, 42, 1307-1324.
63. O'Shea, R. P., Blackburn, S. G., & Ono, H. (1994). Contrast as a depth cue. Vision Research, 34, 1595-1604.
64. O'Shea, R. P., Govan, D. G., & Sekuler, R. (1997). Blur and contrast as pictorial depth cues. Perception, 26, 599-612.
65. Palanca, B. J., & DeAngelis, G. C. (2003). Macaque middle temporal neurons signal depth in the absence of motion. Journal of Neuroscience, 23, 7647-7658.
66. Parker, A. J., & Cumming, B. G. (2001). Cortical mechanisms of binocular stereoscopic vision. Progress in Brain Research, 134, 205-216.
67. Pouget, A., & Sejnowski, T. J. (1994). A neural model of the cortical representation of egocentric distance. Cerebral Cortex, 4, 314-329.
68. Qing, Y., & Kapoula, Z. (2004). Saccade-vergence dynamics and interaction in children and in adults. Experimental Brain Research, 156, 212-223.
69. Richard, W., & Miller, J. F. (1969). Convergence as a cue to depth. Perception & Psychophysics, 5, 317-320.
70. Ritter, M. (1977). Effect of disparity and viewing distance on perceived depth. Perception & Psychophysics, 22, 400-407.
71. Rogers, B. J., & Bradshaw, M. F. (1995). Disparity scaling and the perception of frontoparallel surfaces. Perception, 24, 155-179.
72. Rosenbluth, D., & Allman, J. M. (2002). The effect of gaze angle and fixation distance on the responses of neurons in V1, V2, and V4. Neuron, 33, 143-149.
73. Roy, J. P., Komatsu, H., & Wurtz, R. H. (1992). Disparity sensitivity of neurons in monkey extrastriate area MST. Journal of Neuroscience, 12, 2478-2492.
74. Schor, C. M., Maxwell, J. S., McCandless, J., & Graf, E. (2002). Adaptive control of vergence in humans. Annals of the New York Academy of Sciences, 956, 297-305.
75. Schreiber, K., Crawford, J. D., Fetter, M., & Tweed, D. (2001). The motor side of depth vision. Nature, 410, 819-822.
76. Schreiber, K. M., Tweed, D. B., & Schor, C. M. (2006). The extended horopter: Quantifying retinal correspondence across changes of 3D eye position. Journal of Vision, 6(1):6, 64-74, http://journalofvision.org/6/1/6/, doi:10.1167/6.1.6.
77. Snyder, L. H. (2000). Coordinate transformations for eye and arm movements in the brain. Current Opinion in Neurobiology, 10, 747-754.
78. Tait, P. G. (1890). An elementary treatise on quaternions (3rd ed.). Cambridge, UK: Cambridge University Press.
79. Tresilian, J. R., Mon-Williams, M., & Kelly, B. M. (1999). Increasing confidence in vergence as a cue to distance. Proceedings of the Royal Society B: Biological Sciences, 266, 39-44.
80. Tsutsui, K., Taira, M., & Sakata, H. (2005). Neural mechanisms of three-dimensional vision. Neuroscience Research, 51, 221-229.
81. Tweed, D. (1997a). Three-dimensional model of the human eye-head saccadic system. Journal of Neurophysiology, 77, 654-666.
82. Tweed, D. (1997b). Visual-motor optimization in binocular control. Vision Research, 37, 1939-1951.
83. Uka, T., & DeAngelis, G. C. (2002). Binocular vision: An orientation to disparity coding. Current Biology, 12, R764-R766.
84. van Ee, R., & van Dam, L. C. (2003). The influence of cyclovergence on unconstrained stereoscopic matching. Vision Research, 43, 307-319.
85. Van Gisbergen, J. A. M., & Minken, A. W. H. (1994). Conjugate and disconjugate contributions to bifoveal fixations studied from a 3-D perspective. In J. M. Delgado-Garcia, E. Godaux, & P. P. Vidal (Eds.), Information processing underlying gaze control. Oxford, UK: Pergamon Press.
86. Van Pelt, S., & Medendorp, W. P. (2008). Updating target distance across eye movements in depth. Journal of Neurophysiology, 99, 2281-2290.
87. Van Rijn, L. J., & Van den Berg, A. V. (1993). Binocular eye orientation during fixations: Listing's law extended to include eye vergence. Vision Research, 33, 691-708.
88. van Rijn, L. J., van der Steen, J., & Collewijn, H. (1992). Visually induced cycloversion and cyclovergence. Vision Research, 32, 1875-1883.
89. Vieth, G. U. A. (1818). Ueber die Richtung der Augen. Annalen der Physik, 58, 233-253.
90. Viguier, A., Clement, G., & Trotter, Y. (2001). Distance perception within near visual space. Perception, 30, 115-124.