Statistically optimal integration of biased sensory estimates

Journal of Vision

Volumn 11, Issue 7, 2011, Pages 1-17

  Scarfe, Peter ^a   Hibbard, Paul B ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF ST ANDREWS   (United Kingdom)

Author keywords

3D surface and shape perception; Binocular vision; Depth

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; BINOCULAR VISION; DEPTH PERCEPTION; EPIDEMIOLOGY; HUMAN; MALE; METHODOLOGY; MOVEMENT PERCEPTION; NORMAL DISTRIBUTION; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOLOGICAL MODEL;

ADULT; BIAS (EPIDEMIOLOGY); CUES; DEPTH PERCEPTION; FORM PERCEPTION; HUMANS; MALE; MODELS, PSYCHOLOGICAL; MOTION PERCEPTION; NORMAL DISTRIBUTION; PHOTIC STIMULATION; VISION, BINOCULAR;

EID: 80054025731     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/11.7.1     Document Type: Article

References (75)

1. Adams, W. J., Banks, M. S., & van Ee, R. (2001). Adaptation to three-dimensional distortions in human vision. Nature Neuroscience, 4, 1063-1064.
2. Akeley, K., Watt, S. J., Girshick, A. R., & Banks, M. S. (2004). A stereo display prototype with multiple focal distances. ACM Transactions on Graphics, 23, 804-813.
3. Berger, J. O. (1985). Statistical decision theory and Bayesian analysis. New York: Springer-Verlag.
4. Bradshaw, M. F., Parton, A. D., & Glennerster, A. (2000). The task-dependent use of binocular disparity and motion parallax information. Vision Research, 40, 3725-3734.
5. Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10, 433-436.
6. Brainard, D. H., & Freeman, W. T. (1997). Bayesian color constancy. [Research Support, U.S. Gov't, P.H.S. Review]. Journal of the Optical Society of America A: Optics, Image Science, and Vision, 14, 1393-1411.
7. Brenner, E., & Landy, M. S. (1999). Interaction between the perceived shape of two objects. Vision Research, 39, 3834-3848.
8. Brenner, E., & Smeets, J. B. J. (2000). Comparing extra- retinal information about distance and direction. Vision Research, 40, 1649-1651.
9. Brenner, E., & Smeets, J. B. J. (2001). We are better off without perfect perception. Behavioral and Brain Sciences, 24, 215-216.
10. Brenner, E., & van Damme, W. J. M. (1998). Judging distance from ocular convergence. Vision Research, 38, 493-498.
11. Brenner, E., & van Damme, W. J. M. (1999). Perceived distance, shape and size. Vision Research, 39, 975-986.
12. Brooks, R. A. (1991a). Intelligence without representa- tion. Artificial Intelligence, 47, 139-159.
13. Brooks, R. A. (1991b). New approaches to robotics. Science, 253, 1227-1232.
14. Burge, J., Girshick, A. R., & Banks, M. S. (2010). Visual- haptic adaptation is determined by relative reliability. Journal of Neuroscience, 30, 7714-7721.
15. Butler, J. S., Smith, S. T., Campos, J. L., & Bulthoff, H. H. (2010). Bayesian integration of visual and vestibular signals for heading. Journal of Vision, 10(11):23, 1-13, http://www.journalofvision.org/content/10/11/23, doi:10.1167/10.11.23.
16. Clark, J. J., & Yuille, A. L. (1990). Data fusion for sensory information processing systems. Boston, MA: Kluwer.
17. Cuijpers, R. H., Kappers, A. M. L., & Koenderink, J. J. (2000). Large systematic deviations in visual paral- lelism. Perception, 29, 1467-1482.
18. DeGroot, M. H. (1986). Probability and statistics (2nd ed.). Reading, MA: Addison-Wesley.
19. Domini, F., & Caudek, C. (2009). The intrinsic constraint model and Fechnerian sensory scaling. [Comparative Study Research Support, U.S. Gov't, Non-P.H.S.]. Journal of Vision, 9(2):25, 1-15, http:// www.journalofvision.org/content/9/2/25, doi:10.1167/ 9.2.25.
20. Domini, F., Caudek, C., & Tassinari, H. (2006). Stereo and motion information are not independently pro- cessed by the visual system. Vision Research, 46, 1707-1723.
21. Ernst, M. O. (2006). A Bayesian view on multimodal cue integration. In G. Knoblich, I. M. Thornton, M. Grosjean, & M. Shiffrar (Eds.), Human body perception from the inside out (pp. 105-131). New York: Oxford University Press.
22. Ernst, M. O. (2007). Learning to integrate arbitrary signals from vision and touch. Journal of Vision, 7(5):7, 1-14, http://www.journalofvision.org/content/7/5/7, doi:10.1167/7.5.7.
23. Ernst, M. O., & Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415, 429-433.
24. Ernst, M. O., & Bülthoff, H. H. (2004). Merging the senses into a robust percept. Trends in Cognitive Sciences, 8, 162-169.
25. Gepshtein, S., Burge, J., Ernst, M. O., & Banks, M. S.(2005). The combination of vision and touch depends on spatial proximity. Journal of Vision, 5(11):7, 1013-1023, http://www.journalofvision.org/content/ 5/11/7, doi:10.1167/5.11.7.
26. Girshick, A. R., & Banks, M. S. (2009). Probabilistic combination of slant information: Weighted averag- ing and robustness as optimal percepts. Journal of Vision, 9(9):8, 1-20, http://www.journalofvision.org/ content/9/9/8, doi:10.1167/9.9.8.
27. Glennerster, A., Rogers, B. J., & Bradshaw, M. F. (1996). Stereoscopic depth constancy depends on the subject's task. Vision Research, 36, 3441-3456.
28. Helbig, H. B., & Ernst, M. O. (2007). Optimal integration of shape information from vision and touch. Exper- imental Brain Research, 179, 595-606.
29. Hershenson, M. H. (1999). Visual space perception: A primer. London: MIT Press.
30. Hillis, J. M., Ernst, M. O., Banks, M. S., & Landy, M. S. (2002). Combining sensory information: Mandatory fusion within, but not between, senses. Science, 298, 1627-1630.
31. Hillis, J. M., Watt, S. J., Landy, M. S., & Banks, M. S. (2004). Slant from texture and disparity cues: Optimal cue combination. Journal of Vision, 4(12):1, 967-992, http://www.journalofvision.org/content/4/12/1, doi:10.1167/4.12.1.
32. Hoffman, D. M., Girshick, A. R., Akeley, K., & Banks, M. S. (2008). Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. Journal of Vision, 8(3):33, 1-30, http://www.journalofvision. org/content/8/3/33, doi:10.1167/8.3.33.
33. Hogervorst, M. A., & Eagle, R. A. (1998). Biases in three- dimensional structure-from-motion arise from noise in the early visual system. Proceedings of the Royal Society of London B: Biological Sciences, 265, 1587-1593.
34. Howard, I. P. (2002). Seeing in depth: Basic mechanisms (vol. 1). Toronto, ON, Canada: I Porteous.
35. Johnston, E. B. (1991). Systematic distortions of shape from stereopsis. Vision Research, 31, 1351-1360.
36. Johnston, E. B., Cumming, B. G., & Landy, M. S. (1994). Integration of stereopsis and motion shape cues. Vision Research, 34, 2259-2275.
37. Kleiner, M., Brainard, D., & Pelli, D. (2007). What's new in Psychtoolbox-3? [Meeting Abstract]. Perception, 36, 14.
38. Knill, D. C. (2007). Learning Bayesian priors for depth perception. Journal of Vision, 7(8):13, 1-20, http:// www.journalofvision.org/content/7/8/13, doi:10.1167/ 7.8.13.
39. Knill, D. C., & Richards, W. (1996). Perception as Bayesian inference. Cambridge, UK: Cambridge University Press.
40. Knill, D. C., & Saunders, J. A. (2003). Do humans optimally integrate stereo and texture information for judgments of surface slant? Vision Research, 43, 2539-2558.
41. Koenderink, J. J., van Doorn, A. J., Kappers, A. M. L., & Todd, J. T. (2002). Pappus in optical space. Percep- tion & Psychophysics, 64, 380-391.
42. Koenderink, J. J., van Doorn, A. J., & Lappin, J. S. (2000). Direct measurement of the curvature of visual space. Perception, 29, 69-79.
43. Landy, M. S., Maloney, L. T., Johnston, E. B., & Young, M. (1995). Measurement and modeling of depth cue combinationVIn defense of weak fusion. Vision Research, 35, 389-412.
44. MacKenzie, K. J., Murray, R. F., & Wilcox, L. M. (2008). The intrinsic constraint approach to cue combination: An empirical and theoretical evaluation. Journal of Vision, 8(8):5, 1-10, http://www.journalofvision.org/ content/8/8/5, doi:10.1167/8.8.5.
45. MacNeilage, P. R., Banks, M. S., Berger, D. R., & Bulthoff, H. H. (2007). A Bayesian model of the disambiguation of gravitoinertial force by visual cues. Experimental Brain Research, 179, 263-290.
46. Maloney, L. T. (2002). Statistical decision theory and biological vision. New York: Wiley.
47. Mamassian, P., Landy, M. S., & Maloney, L. T. (2002). Bayesian modelling of visual perception. In R. P. N. Rao, B. A. Olshausen, & M. S. Lewicki (Eds.), Probabilistic models of the brain: Perception and neural function (pp. 13-36). MIT Press.
48. Milner, A. D., & Goodale, M. A. (1995). The visual brain in action. Oxford, UK: Oxford University Press.
49. Milner, A. D., & Goodale, M. A. (2006). The visual brain in action (2nd ed.). Oxford, UK: Oxford University Press.
50. Muller, C. M., Brenner, E., & Smeets, J. B. (2009). Maybe they are all circles: Clues and cues. Journal of Vision, 9(9):10, 1-5, http://www.journalofvision.org/ content/9/9/10, doi:10.1167/9.9.10.
51. Oruc, I., Maloney, L. T., & Landy, M. S. (2003). Weighted linear cue combination with possibly correlated error. Vision Research, 43, 2451-2468.
52. Richards, W. (1985). Structure from stereo and motion. Journal of the Optical Society of America A, Optics, Image Science, and Vision, 2, 343-349.
53. Rosas, P., Wagemans, J., Ernst, M. O., & Wichmann, F. A. (2005). Texture and haptic cues in slant discrimina- tion: Reliability-based cue weighting without statisti- cally optimal cue combination. Journal of the Optical Society of America A, Optics, Image Science, and Vision, 22, 801-809.
54. Saunders, J. A., & Knill, D. C. (2003). Humans use continuous visual feedback from the hand to control fast reaching movements. Experimental Brain Research, 152, 341-352.
55. Saunders, J. A., & Knill, D. C. (2004). Visual feedback control of hand movements. Journal of Neuroscience, 24, 3223-3234.
56. Saunders, J. A., & Knill, D. C. (2005). Humans use continuous visual feedback from the hand to control both the direction and distance of pointing move- ments. Experimental Brain Research, 162, 458-473.
57. Scarfe, P., & Hibbard, P. B. (2004). Noise in horizontal- disparity and vergence signals predicts systematic distortions in the estimation of shape. Perception, 33, 95.
58. Scarfe, P., & Hibbard, P. B. (2006). Disparity-defined objects moving in depth do not elicit three-dimensional shape constancy. Vision Research, 46, 1599-1610.
59. Seydell, A., Knill, D. C., & Trommershauser, J. (2010). Adapting internal statistical models for interpreting visual cues to depth. [Research Support, N.I.H., Extra- mural Research Support, Non-U.S. Gov't]. Journal of Vision, 10(4):1, 1-27, http://www.journalofvision.org/ content/10/4/1, doi:10.1167/10.4.1.
60. Shams, L., & Beierholm, U. R. (2010). Causal inference in perception. [Research Support, Non-U.S. Gov't]. Trends in Cognitive Sciences, 14, 425-432.
61. Smeets, J. B., & Brenner, E. (2008). Why we don't mind to be inconsistent. In P. Cavo & T. Gomila (Eds.), Handbook of cognitive scienceVAn embodied approach (pp. 207-217). Amsterdam: Elsevier.
62. Tassinari, H., & Domini, F. (2008). The intrinsic constraint model for stereo-motion integration. Per- ception, 37, 79-95.
63. Tittle, J. S., Todd, J. T., Perotti, V. J., & Norman, J. F. (1995). Systematic distortion of perceived 3-dimensional structure-from-motion and binocular stereopsis. Jour- nal of Experimental Psychology: Human Perception and Performance, 21, 663-678.
64. Todd, J. T. (1998). Theoretical and biological limitations on the visual perception of three-dimensional struc- ture from motion. In T. Watanabe (Ed.), High-level motion processingVComputational, neurophysiolog- ical and psychophysical perspectives (pp. 359-380). Cambridge, MA: MIT Press.
65. Todd, J. T. (2004). The visual perception of 3D shape. Trends in Cognitive Sciences, 8, 115-121.
66. Todd, J. T., Chen, L., & Norman, J. F. (1998). On the relative salience of Euclidean, affine, and topological structure for 3-D form discrimination. Perception, 27, 273-282.
67. Todd, J. T., Christensen, J. T., & Guckes, K. C. (2010). Are discrimination thresholds a valid measure of variance for judgments of slant from texture? Journal of Vision, 10(2):20, 1-18, http://www.journalofvision.org/content/ 10/2/20, doi:10.1167/10.2.20.
68. Todd, J. T., & Norman, J. F. (2003). The visual perception of 3-D shape from multiple cues: Are observers capable of perceiving metric structure? Perception & Psychophysics, 65, 31-47.
69. Todd, J. T., Tittle, J. S., & Norman, J. F. (1995). Distortions of 3-dimensional space in the perceptual analysis of motion and stereo. Perception, 24, 75-86.
70. van Ee, R., van Dam, L. C., & Erkelens, C. J. (2002). Bi-stability in perceived slant when binocular disparity and monocular perspective specify different slants. [Research Support, Non-U.S. Gov't]. Journal of Vision, 2(9):2, 597-607, http://www.journalofvision. org/content/2/9/2, doi:10.1167/2.9.2.
71. Wagner, M. (1985). The metric of visual space. Percep- tion & Psychophysics, 38, 483-495.
72. Watt, S. J., Akeley, K., Ernst, M. O., & Banks, M. S. (2005). Focus cues affect perceived depth. Journal of Vision, 5(10):7, 834-862, http://www.journalofvision. org/content/5/10/7, doi:10.1167/5.10.7.
73. Watt, S. J., Akeley, K., Girshick, A. R., & Banks, M. S. (2005). Achieving near-correct focus cues in a 3-D display using multiple image planes. Proceedings of SPIE: Human Vision and Electronic Imaging, 5666, 393-401.
74. Wichmann, F. A., & Hill, N. J. (2001a). The psychometric function: I. Fitting, sampling, and goodness of fit. Perception & Psychophysics, 63, 1293-1313.
75. Wichmann, F. A., & Hill, N. J. (2001b). The psychometric function: II. Bootstrap-based confidence intervals and sampling. Perception & Psychophysics, 63, 1314-1329.