Decoding conjunctions of direction-of-motion and binocular disparity from human visual cortex

Journal of Neurophysiology

Volumn 107, Issue 9, 2012, Pages 2335-2341

  Seymour, Kiley J ^a,b   Clifford, Colin W G ^a  

^a UNIVERSITY OF SYDNEY   (Australia)

^b CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

Author keywords

Correspondence; Feature binding; Functional magnetic resonance imaging; Stereopsis

Indexed keywords

ARTICLE; BINOCULAR VISION; CLINICAL ARTICLE; DEPTH PERCEPTION; DIRECTIONAL VISION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HAPLORHINI; HUMAN; MALE; MOTION; MULTIVARIATE ANALYSIS; NORMAL HUMAN; PRIORITY JOURNAL; STEREOSCOPIC VISION; VISUAL CORTEX; VISUAL STIMULATION;

FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MOTION PERCEPTION; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; VISION DISPARITY; VISUAL CORTEX;

EID: 84860534261     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.01103.2011     Document Type: Article

References (67)

1. Anstis SM, Harris JP. Movement aftereffects contingent on binocular disparity. Perception 3: 153-168, 1974.
2. Anzai A, Chowdhury SA, DeAngelis GC. Coding of stereoscopic depth information in visual areas V3 and V3A. J Neurosci 31: 10270-10282, 2011.
3. Anzai A, Ohzawa I, Freeman RD. Joint-encoding of motion and depth by visual cortical neurons: neural basis of the Pulfrich effect. Nat Neurosci 4: 513-518, 2001.
4. Backus BT, Fleet DJ, Parker AJ, Heeger DJ. Human cortical activity correlates with stereoscopic depth perception. J Neurophysiol 86: 2054-2068, 2001.
5. Bakin JS, Nakayama K, Gilbert CD. Visual responses in monkey areas V1 and V2 to three-dimensional surface configurations. J Neurosci 20: 8188-8198, 2000.
6. Bradley DC, Qian N, Andersen RA. Integration of motion and stereopsis in middle temporal cortical area of macaques. Nature 373: 609-611, 1995.
7. Bradshaw MF, Cumming BG. The direction of retinal motion facilitates binocular stereopsis. Proc Biol Sci 264: 1421-1427, 1997.
8. Bradshaw MF, Rogers BJ. The interaction of binocular disparity and motion parallax in the computation of depth. Vision Res 36: 3457-3468, 1996.
9. Brooks KR, Gillam BJ. The swinging doors of perception: stereomotion without binocular matching. J Vis 6: 685-695, 2006.
10. Brouwer GJ, van Ee R. Visual cortex allows prediction of perceptual states during ambiguous structure-from-motion. J Neurosci 27: 1015-1023, 2007.
11. Chen G, Lu HD, Roe AW. A map for horizontal disparity in monkey V2. Neuron 58: 442-450, 2008.
12. Chukoskie L, Movshon JA. Modulation of visual signals in macaque MT and MST neurons during pursuit eye movement. J Neurophysiol 102: 3225-3233, 2009.
13. Cumming BG, Parker AJ. Responses of primary visual cortical neurons to binocular disparity without depth perception. Nature 389: 280-283, 1997.
14. DeAngelis GC, Newsome WT. Organization of disparity-selective neurons in macaque area MT. J Neurosci 19: 1398-1415, 1999.
15. DeAngelis GC, Newsome WT. Perceptual "read-out" of conjoined direction and disparity maps in extrastriate area MT. PLoS Biol 2: E77, 2004.
16. DeAngelis GC, Uka T. Coding of horizontal disparity and velocity by MT neurons in the alert macaque. J Neurophysiol 89: 1094-1111, 2003.
17. den Ouden HE, van Ee R, de Haan EH. Colour helps to solve the binocular matching problem. J Physiol 567: 665-671, 2005.
18. Dodd JV, Krug K, Cumming BG, Parker AJ. Perceptually bistable threedimensional figures evoke high choice probabilities in cortical area MT. J Neurosci 21: 4809-4821, 2001.
19. Dumoulin SO, Bittar RG, Kabani NJ, Baker CL Jr, Le Goualher G, Bruce Pike G, Evans AC. A new anatomical landmark for reliable identification of human area V5/MT: a quantitative analysis of sulcal patterning. Cereb Cortex 10: 454-463, 2000.
20. Edwards M, Badcock DR. Motion distorts perceived depth. Vision Res 43: 1799-1804, 2003.
21. Engel SA, Glover GH, Wandell BA. Retinotopic organization in human visual cortex and the spatial precision of functional MRI. Cereb Cortex 7: 181-192, 1997.
22. Felleman DJ, Kaas JH. Receptive-field properties of neurons in middle temporal visual area (MT) of owl monkeys. J Neurophysiol 52: 488-513, 1984.
23. Georgieva S, Peeters R, Kolster H, Todd JT, Orban GA. The processing of three-dimensional shape from disparity in the human brain. J Neurosci 29: 727-742, 2009.
24. Goodale MA, Milner AD. Separate visual pathways for perception and action. Trends Neurosci 15: 20-25, 1992.
25. Graham ME, Rogers BJ. Interactions between monocular and binocular depth aftereffects. Invest Ophthal Vis Sci Suppl 22: 272, 1982.
26. Grunewald A, Skoumbourdis EK. The integration of multiple stimulus features by V1 neurons. J Neurosci 24: 9185-9194, 2004.
27. Howard IP, Simpson WA. Human optokinetic nystagmus is linked to the stereoscopic system. Exp Brain Res 78: 309-314, 1989.
28. Hubel DH, Wiesel TN. Receptive fields and functional architecture of monkey striate cortex. J Physiol 195: 215-243, 1968.
29. Joachims T. Making large-scale support vector machine learning practical. In: Advances in Kernel Methods: Support Vector Machines, edited by Scholkopf B, Burges C, and Smola A. Cambridge, MA: MIT Press, 1998.
30. Johnston EB, Cumming BG, Landy MS. Integration of stereopsis and motion shape cues. Vision Res 34: 2259-2275, 1994.
31. Kamitani Y, Tong F. Decoding seen and attended motion directions from activity in the human visual cortex. Curr Biol 16: 1096-1102, 2006.
32. Lappe M. Functional consequences of an integration of motion and stereopsis in area MT of monkey extrastriate visual cortex. Neural Comput 8: 1449-1461, 1996.
33. Lennie P. Single units and visual cortical organization. Perception 27: 889-935, 1998.
34. Logothetis NK. What we can do and what we cannot do with fMRI. Nature 453: 869-878, 2008.
35. Maunsell JH, van Essen DC. Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. J Neurophysiol 49: 1148-1167, 1983.
36. Minini L, Parker AJ, Bridge H. Neural modulation by binocular disparity greatest in human dorsal visual stream. J Neurophysiol 104: 169-178, 2010.
37. Mitchell TM, Hutchinson R, Niculescu RS, Pereira F, Wang X, Just M, Newman S. Learning to decode cognitive states from brain images. Mach Learn 57: 145-175, 2004.
38. Nawrot M, Blake R. A neural network model of kinetic depth. Vis Neurosci 6: 219-227, 1991.
39. Nawrot M, Blake R. Neural integration of information specifying structure from stereopsis and motion. Science 244: 716-718, 1989.
40. Neri P. A stereoscopic look at visual cortex. J Neurophysiol 93: 1823-1826, 2005.
41. Neri P, Levi DM. Evidence for joint encoding of motion and disparity in human visual perception. J Neurophysiol 100: 3117-3133, 2008.
42. Neri P, Bridge H, Heeger DJ. Stereoscopic processing of absolute and relative disparity in human visual cortex. J Neurophysiol 92: 1880-1891, 2004.
43. Nienborg H, Cumming BG. Macaque V2 neurons, but not V1 neurons, show choice-related activity. J Neurosci 26: 9567-9578, 2006.
44. Pack CC, Born RT, Livingstone MS. Two-dimensional substructure of stereo and motion interactions in macaque visual cortex. Neuron 37: 525-535, 2003.
45. Pelli DG. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat Vis 10: 437-442, 1997.
46. Peterhans E, von der Heydt R. Functional organization of area V2 in the alert macaque. Eur J Neurosci 5: 509-524, 1993.
47. Poggio GF, Talbot WH. Mechanisms of static and dynamic stereopsis in foveal cortex of the rhesus monkey. J Physiol 315: 469-492, 1981.
48. Ponce CR, Lomber SG, Born RT. Integrating motion and depth via parallel pathways. Nat Neurosci 11: 216-223, 2008.
49. Preston TJ, Li S, Kourtzi Z, Welchman AE. Multivoxel pattern selectivity for perceptually relevant binocular disparities in the human brain. J Neurosci 28: 11315-11327, 2008.
50. Qian N. Computing stereo disparity and motion with known binocular cell properties. Neural Comput 6: 390-404, 1994.
51. Qiu FT, von der Heydt R. Figure and ground in the visual cortex: v2 combines stereoscopic cues with gestalt rules. Neuron 47: 155-166, 2005.
52. Rogers BJ, Graham ME. Aftereffects from motion parallax and stereoscopic depth: similarities and interactions. In: Sensory Experience, Adaptation and Perception: Festschrift for Ivo Kohler, edited by Spillman L and Wooten BR. Hillsdale, NJ: Lawrence Erlbaum, 1984, p. 603-619.
53. Roy JP, Komatsu H, Wurtz RH. Disparity sensitivity of neurons in monkey extrastriate area MST. J Neurosci 12: 2478-2492, 1992.
54. Schurger A. A very inexpensive MRI-compatible method for dichoptic visual stimulation. J Neurosci Methods 177: 199-202, 2009.
55. Seymour K, Clifford CW, Logothetis NK, Bartels A. Coding and binding of color and form in visual cortex. Cereb Cortex 20: 1946-1954, 2010.
56. Seymour K, Clifford CW, Logothetis NK, Bartels A. The coding of color, motion, and their conjunction in the human visual cortex. Curr Biol 19: 177-183, 2009.
57. Smith AT, Wall MB. Sensitivity of human visual cortical areas to the stereoscopic depth of a moving stimulus. J Vis 8: 1.1-12, 2008.
58. Smith RA Jr. The motion/disparity aftereffect: a preliminary study. Vision Res 16: 1507-1509, 1976.
59. Sunaert S, van Hecke P, Marchal G, Orban GA. Motion-responsive regions of the human brain. Exp Brain Res 127: 355-370, 1999.
60. Tanabe S, Cumming BG. Mechanisms underlying the transformation of disparity signals from V1 to V2 in the macaque. J Neurosci 28: 11304-11314, 2008.
61. Tootell RB, Mendola JD, Hadjikhani NK, Ledden PJ, Liu AK, Reppas JB, Sereno MI, Dale AM. Functional analysis of V3A and related areas in human visual cortex. J Neurosci 17: 7060-7078, 1997.
62. Tsao DY, Vanduffel W, Sasaki Y, Fize D, Knutsen TA, Mandeville JB, Wald LL, Dale AM, Rosen BR, Van Essen DC, Livingstone MS, Orban GA, Tootell RB. Stereopsis activates V3A and caudal intraparietal areas in macaques and humans. Neuron 39: 555-568, 2003.
63. Tyler CW. A stereoscopic view of visual processing streams. Vision Res 30: 1877-1895, 1990.
64. van Ee R, Anderson BL. Motion direction, speed and orientation in binocular matching. Nature 410: 690-694, 2001.
65. Vapnik VN. Statistical Learning Theory. New York: Wiley Press, 1998.
66. Verstraten FA, Verlinde R, Fredericksen RE, van de Grind WA. A transparent motion aftereffect contingent on binocular disparity. Perception 23: 1181-1188, 1994.
67. von der Heydt R, Zhou H, Friedman HS. Representation of stereoscopic edges in monkey visual cortex. Vision Res 40: 1955-1967, 2000.