Perceptual Integration for Qualitatively Different 3-D Cues in the Human Brain

Journal of Cognitive Neuroscience

Volumn 25, Issue 9, 2013, Pages 1527-1541

  Dövencioǧlu, Dicle ^a   Ban, Hiroshi ^a,b   Schofield, Andrew J ^a   Welchman, Andrew E ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^b JAPAN SOCIETY FOR THE PROMOTION OF SCIENCE   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; BRAIN; DECISION MAKING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; MALE; NORMAL HUMAN; PERCEPTION; PREDICTION; PRIORITY JOURNAL; PSYCHOPHYSICS; QUALITATIVE ANALYSIS; VISUAL CORTEX; VISUAL SYSTEM;

ADULT; ALGORITHMS; BRAIN; BRAIN MAPPING; CUES; DEPTH PERCEPTION; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; OXYGEN; PHOTIC STIMULATION; PREDICTIVE VALUE OF TESTS; PROBABILITY; PSYCHOPHYSICS; YOUNG ADULT;

EID: 84880815447     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn_a_00417     Document Type: Article

References (66)

1. Anzai, A., Ohzawa, I., & Freeman, R. D. (2001). Joint-encoding of motion and depth by visual cortical neurons: Neural basis of the Pulfrich effect. Nature Neuroscience, 4, 513-518.
2. Atkins, J. E., Fiser, J., & Jacobs, R. A. (2001). Experiencedependent visual cue integration based on consistencies between visual and haptic percepts. Vision Research, 41, 449-461.
3. Ban, H., Preston, T. J., Meeson, A., & Welchman, A. E. (2012). The integration of motion and disparity cues to depth in dorsal visual cortex. Nature Neuroscience, 15, 636-643.
4. Belhumeur, P. N., Kriegman, D. J., & Yuille, A. L. (1999). The bas-relief ambiguity. International Journal of Computer Vision, 35, 33-44.
5. Blake, A., Zisserman, A., & Knowles, G. (1985). Surface descriptions from stereo and shading. Image and Vision Computing, 3, 183-191.
6. Bradley, D. C., Qian, N., & Andersen, R. A. (1995). Integration of motion and stereopsis in middle temporal cortical area of macaques. Nature, 373, 609-611.
7. Buelthoff, H. H., & Mallot, H. A. (1988). Integration of depth modules - Stereo and shading. Journal of the Optical Society of America: A, 5, 1749-1758.
8. Burge, J., Fowlkes, C. C., & Banks, M. S. (2010). Natural-scene statistics predict how the figure-ground cue of convexity affects human depth perception. Journal of Neuroscience, 30, 7269-7280.
9. Curran, W., & Johnston, A. (1996). The effect of illuminant position on perceived curvature. Vision Research, 36, 1399-1410.
10. De Martino, F., Valente, G., Staeren, N., Ashburner, J., Goebel, R., & Formisano, E. (2008). Combining multivariate voxel selection and support vector machines for mapping and classification of fMRI spatial patterns. Neuroimage, 43, 44-58.
11. DeAngelis, G. C., & Uka, T. (2003). Coding of horizontal disparity and velocity by MT neurons in the alert macaque. Journal of Neurophysiology, 89, 1094-1111.
12. DeYoe, E. A., Carman, G. J., Bandettini, P., Glickman, S., Wieser, J., Cox, R., et al. (1996). Mapping striate and extrastriate visual areas in human cerebral cortex. Proceedings of the National Academy of Sciences, U.S.A., 93, 2382-2386.
13. Doorschot, P. C. A., Kappers, A. M. L., & Koenderink, J. J. (2001). The combined influence of binocular disparity and shading on pictorial shape. Perception & Psychophysics, 63, 1038-1047.
14. Dosher, B. A., Sperling, G., & Wurst, S. A. (1986). Tradeoffs between stereopsis and proximity luminance covariance as determinants of perceived 3-D structure. Vision Research, 26, 973-990.
15. Dupont, P., De Bruyn, B., Vandenberghe, R., Rosier, A. M., Michiels, J., Marchal, G., et al. (1997). The kinetic occipital region in human visual cortex. Cerebral Cortex, 7, 283-292.
16. Ernst, M. O. (2007). Learning to integrate arbitrary signals from vision and touch. Journal of Vision, 7, 1-14.
17. Fleming, R. W., Dror, R. O., & Adelson, E. H. (2003). Real-world illumination and the perception of surface reflectance properties. Journal of Vision, 3, 347-368.
18. Georgieva, S. S., Todd, J. T., Peeters, R., & Orban, G. A. (2008). The extraction of 3-D shape from texture and shading in the human brain. Cerebral Cortex, 18, 2416-2438.
19. Gerardin, P., Kourtzi, Z., & Mamassian, P. (2010). Prior knowledge of illumination for 3-D perception in the human brain. Proceedings of the National Academy of Sciences, U.S.A., 107, 16309-16314.
20. Gori, M., Del Viva, M., Sandini, G., & Burr, D. C. (2008). Young children do not integrate visual and haptic form information. Current Biology, 18, 694-698.
21. Grill-Spector, K., Kushnir, T., Hendler, T., & Malach, R. (2000). The dynamics of object-selective activation correlate with recognition performance in humans. Nature Neuroscience, 3, 837-843.
22. Hillis, J. M., Ernst, M. O., Banks, M. S., & Landy, M. S. (2002). Combining sensory information: Mandatory fusion within, but not between, senses. Science, 298, 1627-1630.
23. Horn, B. K. P. (1975). Obtaining shape from shading information. In P. H. Winston (Ed.), The psychology of computer vision (pp. 115-155). New York: McGraw Hill.
24. Janssen, P., Vogels, R., & Orban, G. A. (2000). Threedimensional shape coding in inferior temporal cortex. Neuron, 27, 385-397.
25. Kersten, D., Mamassian, P., & Yuille, A. (2004). Object perception as Bayesian inference. Annual Review of Psychology, 55, 271-304.
26. Kingdom, F. A. A. (2003). Color brings relief to human vision. Nature Neuroscience, 6, 641-644.
27. Knill, D. C., & Saunders, J. A. (2003). Do humans optimally integrate stereo and texture information for judgments of surface slant? Vision Research, 43, 2539-2558.
28. Koenderink, J. J., & van Doorn, A. J. (2003). Shape and shading. In L. M. Chalupa & J. S. Werner (Eds.), The visual neurosciences (pp. 1090-1105). Cambridge, MA: MIT Press.
29. Kourtzi, Z., & Kanwisher, N. (2001). Representation of perceived object shape by the human lateral occipital complex. Science, 293, 1506-1509.
30. Kriegeskorte, N., Goebel, R., & Bandettini, P. (2006). Information-based functional brain mapping. Proceedings of the National Academy of Sciences, U.S.A., 103, 3863-3868.
31. Landy, M. S., Maloney, L. T., Johnston, E. B., & Young, M. (1995). Measurement and modeling of depth cue combination - In defense of weak fusion. Vision Research, 35, 389-412.
32. Larsson, J., Heeger, D. J., & Landy, M. S. (2010). Orientation selectivity of motion-boundary responses in human visual cortex. Journal of Neurophysiology, 104, 2940-2950.
33. Lee, Y. L., & Saunders, J. A. (2011). Stereo improves 3-D shape discrimination even when rich monocular shape cues are available. Journal of Vision, 11, Article 2.
34. Liu, B., & Todd, J. T. (2004). Perceptual biases in the interpretation of 3-D shape from shading. Vision Research, 44, 2135-2145.
35. Lovell, P. G., Bloj, M., & Harris, J. M. (2012). Optimal integration of shading and binocular disparity for depth perception. Journal of Vision, 12, 1-18.
36. Mamassian, P., & Goutcher, R. (2001). Prior knowledge on the illumination position. Cognition, 81, B1-B9.
37. Mingolla, E., & Todd, J. T. (1986). Perception of solid shape from shading. Biological Cybernetics, 53, 137-151.
38. Nandy, A. S., & Tjan, B. S. (2008). Efficient integration across spatial frequencies for letter identification in foveal and peripheral vision. Journal of Vision, 8, 1-20.
39. Nardini, M., Bedford, R., & Mareschal, D. (2010). Fusion of visual cues is not mandatory in children. Proceedings of the National Academy of Sciences, U.S.A., 107, 17041-17046.
40. Nardini, M., Jones, P., Bedford, R., & Braddick, O. (2008). Development of cue integration in human navigation. Current Biology, 18, 689-693.
41. Nelissen, K., Joly, O., Durand, J. B., Todd, J. T., Vanduffel, W., & Orban, G. A. (2009). The extraction of depth structure from shading and texture in the macaque brain. Plos One, 4, e8306.
42. Pentland, A. P. (1982). Finding the illuminant direction. Journal of the Optical Society of America, 72, 448-455.
43. Popple, A. V., Smallman, H. S., & Findlay, J. M. (1998). The area of spatial integration for initial horizontal disparity vergence. Vision Research, 38, 319-326.
44. Preston, T. J., Kourtzi, Z., & Welchman, A. E. (2009). Adaptive estimation of three-dimensional structure in the human brain. Journal of Neuroscience, 29, 1688-1698.
45. Preston, T. J., Li, S., Kourtzi, Z., & Welchman, A. E. (2008). Multivoxel pattern selectivity for perceptually relevant binocular disparities in the human brain. Journal of Neuroscience, 28, 11315-11327.
46. Ramachandran, V. S. (1988). Perception of shape from shading. Nature, 331, 163-166.
47. Richards, W. (1985). Structure from stereo and motion. Journal of the Optical Society of America: A, 2, 343-349.
48. Schiller, P. H., Slocum, W. M., Jao, B., & Weiner, V. S. (2011). The integration of disparity, shading and motion parallax cues for depth perception in humans and monkeys. Brain Research, 1377, 67-77.
49. Schofield, A. J., Rock, P. B., & Georgeson, M. A. (2011). Sun and sky: Does human vision assume a mixture of point and diffuse illumination when interpreting shape-from-shading? Vision Research, 51, 2317-2330.
50. Schofield, A. J., Rock, P. B., Sun, P., Jiang, X. Y., & Georgeson, M. A. (2010). What is second-order vision for? Discriminating illumination versus material changes. Journal of Vision, 10.
51. Serences, J. T., & Boynton, G. M. (2007). The representation of behavioral choice for motion in human visual cortex. Journal of Neuroscience, 27, 12893-12899.
52. Sereno, M. E., Trinath, T., Augath, M., & Logothetis, N. K. (2002). Three-dimensional shape representation in monkey cortex. Neuron, 33, 635-652.
53. Sereno, M. I., Dale, A. M., Reppas, J. B., Kwong, K. K., Belliveau, J. W., Brady, T. J., et al. (1995). Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. Science, 268, 889-893.
54. Srivastava, S., Orban, G. A., De Maziere, P. A., & Janssen, P. (2009). A distinct representation of three-dimensional shape in macaque anterior intraparietal area: Fast, metric, and coarse. Journal of Neuroscience, 29, 10613-10626.
55. Sun, J., & Perona, P. (1998). Where is the sun? Nature Neuroscience, 1, 183-184.
56. Taira, M., Nose, I., Inoue, K., & Tsutsui, K. (2001). Cortical areas related to attention to 3-D surface structures based on shading: An fMRI study. Neuroimage, 14, 959-966.
57. Thomas, R., Nardini, M., & Mareschal, D. (2010). Interactions between "light-from-above" and convexity priors in visual development. Journal of Vision, 10, 6.
58. Thompson, W. B., Fleming, R. W., Creem-Regehr, S. H., & Stefanucci, J. K. (2011). Illumination, shading and shadows. Chapter 9 of Visual perception from a computer graphics perspective. Boca Raton, FL: Taylor and Francis.
59. Tootell, R. B. H., & Hadjikhani, N. (2001). Where is "dorsal V4" in human visual cortex? Retinotopic, topographic and functional evidence. Cerebral Cortex, 11, 298-311.
60. Tootell, R. B., Hadjikhani, N., Hall, E. K., Marrett, S., Vanduffel, W., Vaughan, J. T., et al. (1998). The retinotopy of visual spatial attention. Neuron, 21, 1409-1422.
61. Tyler, C. W., Likova, L. T., Chen, C.-C., Kontsevich, L. L., & Wade, A. R. (2005). Extended concepts of occipital retinotopy. Current Medical Imaging Reviews, 1, 319-329.
62. Tyler, C. W., Likova, L. T., Kontsevich, L. L., & Wade, A. R. (2006). The specificity of cortical region KO to depth structure. Neuroimage, 30, 228-238.
63. Vuong, Q. C., Domini, F., & Caudek, C. (2006). Disparity and shading cues cooperate for surface interpolation. Perception, 35, 145-155.
64. Wagemans, J., van Doorn, A. J., & Koenderink, J. J. (2010). The shading cue in context. i-Perception, 1, 159-177.
65. Zeki, S., Perry, R. J., & Bartels, A. (2003). The processing of kinetic contours in the brain. Cerebral Cortex, 13, 189-202.
66. Zeki, S., Watson, J. D., Lueck, C. J., Friston, K. J., Kennard, C., & Frackowiak, R. S. (1991). A direct demonstration of functional specialization in human visual cortex. Journal of Neuroscience, 11, 641-649.