Shape from sound: Evidence for a shape operator in the lateral occipital cortex

Neuropsychologia

Volumn 49, Issue 7, 2011, Pages 1807-1815

  James, Thomas W ^a   Stevenson, Ryan A ^a,b   Kim, Sunah ^a,c   VanDerKlok, Ross M ^a   James, Karin Harman ^a  

^a INDIANA UNIVERSITY   (United States)

^b VANDERBILT UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

FMRI; Metamodal; Multisensory; Object recognition; Visual cortex

Indexed keywords

ACCURACY; ADULT; ARTICLE; AUDITORY DISCRIMINATION; AUDITORY SHAPE PROCESSING; AUDITORY STIMULATION; BEHAVIOR; BRAIN FUNCTION; CONTROLLED STUDY; FEMALE; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; LATERAL OCCIPITOTEMPORAL CORTEX; MALE; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; OCCIPITAL CORTEX; SOUND; TASK PERFORMANCE;

ACOUSTIC STIMULATION; AUDITORY PERCEPTION; BRAIN MAPPING; FEMALE; FORM PERCEPTION; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; METALS; OCCIPITAL LOBE; PSYCHOMOTOR PERFORMANCE; RECOGNITION (PSYCHOLOGY); VISUAL PERCEPTION; WOOD; YOUNG ADULT;

EID: 79956154943     PISSN: 00283932     EISSN: 18733514     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2011.03.004     Document Type: Article

References (42)

1. Amedi A., Jacobson G., Hendler T., Malach R., Zohary E. Convergence of visual and tactile shape processing in the human lateral occipital complex. Cerebral Cortex 2002, 12:1202-1212.
2. Amedi A., Malach R., Hendler T., Peled S., Zohary E. Visuo-haptic object-related activation in the ventral visual pathway. Nature Neuroscience 2001, 4(3):324-330.
3. Amedi A., Stern W.M., Camprodon J.A., Bermpohl F., Merabet L., Rotman S., et al. Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex. Nature Neuroscience 2007, 10(6):687-689.
4. Beauchamp M.S., Lee K.E., Argall B.D., Martin A. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 2004, 41(5):809-823.
5. Brainard D.H. The psychophysics toolbox. Spatial Vision 1997, 10(4):433-436.
6. Cant J.S., Goodale M.A. Attention to form or surface properties modulates different regions of human occipitotemporal cortex. Cerebral Cortex 2007, 17(3):713-731.
7. Corbetta M., Miezin F.M., Dobmeyer S., Shulman G.L., Petersen S.E. Selective and divided attention during visual discriminations of shape, color, and speed: Functional anatomy by positron emission tomography. The Journal of Neuroscience 1991, 11(8):2383-2402.
8. Doehrmann O., Naumer M.J., Volz S., Kaiser J., Altmann C.F. Probing category selectivity for environmental sounds in the human auditory brain. Neuropsychologia 2008, 46(11):2776-2786.
9. Forman S.D., Cohen J.D., Fitzgerald M., Eddy W.F., Mintun M.A., Noll D.C. Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): Use of a cluster-size threshold. Magnetic Resonance Medicine 1995, 33(5):636-647.
10. Foxe J.J., Schroeder C.E. The case for feedforward multisensory convergence during early cortical processing. NeuroReport 2005, 16(5):419-423.
11. Frackowiak R.S.J., Friston K.J., Frith C.D., Dolan R., Price C.J., Zeki S., et al. Human brain function 2004, Elsevier Academic Press, Amsterdam. Second ed.
12. Freed D.J. Auditory correlates of perceived mallet hardness for a set of recorded percussive sound events. Journal of the Acoustical Society of America 1990, 87(1):311-322.
13. Gaver W.W. How do we hear in the world?: Explorations in ecological acoustics. Ecological Psychology 1993, 5(4):285-313.
14. Gaver W.W. What in the world do we hear?: An ecological approach to auditory event perception. Ecological Psychology 1993, 5(1):1-29.
15. Goebel R., Esposito F., Formisano E. Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: From single-subject to cortically aligned group general linear model analysis and self-organizing group independent component analysis. Human Brain Mapping 2006, 27(5):392-401.
16. Grassi M. Do we hear size or sound? Balls dropped on plates. Perception and Psychophysics 2005, 67(2):274-284.
17. Ho T.C., Brown S., Serences J.T. Domain general mechanisms of perceptual decision making in human cortex. Journal of Neuroscience 2009, 29(27):8675-8687.
18. James T.W., Culham J.C., Humphrey G.K., Milner A.D., Goodale M.A. Ventral occipital lesions impair object recognition but not object-directed grasping: An fMRI study. Brain 2003, 126:2463-2475.
19. James T.W., Gauthier I. Repetition-induced changes in BOLD response reflect accumulation of neural activity. Human Brain Mapping 2006, 27:37-46.
20. James T.W., Humphrey G.K., Gati J.S., Servos P., Menon R.S., Goodale M.A. Haptic study of three-dimensional objects activates extrastriate visual areas. Neuropsychologia 2002, 40:1706-1714.
21. James T.W., James K.H., Humphrey G.K., Goodale M.A. Do visual and tactile object representations share the same neural substrate?. Touch and blindness: Psychology and neuroscience 2005, Lawrence Erlbaum, Mahwah, NJ. M.A. Heller, S. Ballesteros (Eds.).
22. James T.W., Kim S., Fisher J.S. The neural basis of haptic object processing. Canadian Journal of Experimental Psychology 2007, 61(3):219-229.
23. James T.W., VanDerKlok R.M., Stevenson R.A., James K.H. Multisensory perception of action in posterior temporal and parietal cortices. Neuropsychologia 2011, 49(1):108-114.
24. Kim S., James T.W. Enhanced effectiveness in visuo-haptic object-selective brain regions with increasing stimulus salience. Human Brain Mapping 2010, 31:678-693.
25. Kolb B., Whishaw I.Q. Fundamentals of human neuropsychology 2003, W.H. Freeman and Company, New York. 5th ed.
26. Lacey S., Tal N., Amedi A., Sathian K. A putative model of multisensory object representation. Brain Topography 2009, 21(3-4):269-274.
27. Lazar N.A. The statistical analysis of functional MRI data 2010, Springer, New York.
28. Lewis J.W., Brefczynski J.A., Phinney R.E., Janik J.J., DeYoe E.A. Distinct cortical pathways for processing tool versus animal sounds. Journal of Neuroscience 2005, 25(21):5148-5158.
29. Lewis J.W., Wightman F.L., Brefczynski J.A., Phinney R.E., Binder J.R., DeYoe E.A. Human brain regions involved in recognizing environmental sounds. Cerebral Cortex 2004, 14(9):1008-1021.
30. Malach R., Reppas J.B., Benson R.R., Kwong K.K., Jiang H., Kennedy W.A., et al. Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proceedings of the National Academy of Sciences of the United States of America 1995, 92(18):8135-8139.
31. Pascual-Leone A., Hamilton R. The metamodal organization of the brain. Progress in Brain Research 2001, 134:427-445.
32. Pelli D.G. The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision 1997, 10(4):437-442.
33. Sathian K., Zangaladze A. Feeling with the mind's eye: Contribution of visual cortex to tactile perception. Behavioural Brain Research 2002, 135(1-2):127-132.
34. Stevenson R.A., Altieri N.A., Kim S., Pisoni D.B., James T.W. Neural processing of asynchronous audiovisual speech perception. NeuroImage 2010, 49:3308.
35. Stevenson R.A., James T.W. Audiovisual integration in human superior temporal sulcus: Inverse effectiveness and the neural processing of speech and object recognition. NeuroImage 2009, 44(3):1210-1223.
36. Stilla R., Sathian K. Selective visuo-haptic processing of shape and texture. Human Brain Mapping 2008, 29(10):1123-1138.
37. Tal N., Amedi A. Multisensory visual-tactile object related network in humans: Insights gained using a novel crossmodal adaptation approach. Experimental Brain Research 2009, 198(2-3):165-182.
38. Thirion B., Pinel P., MEriaux S., Roche A., Dehaene S., Poline J.-B. Analysis of a large fMRI cohort: Statistical and methodological issues for group analyses. NeuroImage 2007, 35(1):105-120.
39. Van Essen D.C., Casagrande V.A., Guillery R.W., Sherman S.M. Corticocortical and thalamocortical information flow in the primate visual system. Progress in Brain Research 2005, (149):173-185. [Elsevier].
40. von Kriegstein K., Smith D.R., Patterson R.D., Ives D.T., Griffiths T.D. Neural representation of auditory size in the human voice and in sounds from other resonant sources. Current Biology 2007, 17(13):1123-1128.
41. Warren W.H., Verbrugge R.R. Auditory perception of breaking and bouncing events: A case study in ecological acoustics. Journal of Experimental Psychology: Human Perception and Performance 1984, 10(5):704-712.
42. Wilkinson F., James T.W., Wilson H.R., Gati J.S., Menon R.S., Goodale M.A. An fMRI study of the selective activation of human extrastriate form vision areas by radial and concentric gratings. Current Biology 2000, 10(22):1455-1458.