Crossmodal integration of object features: Voxel-based correlations in brain-damaged patients

Brain

Volumn 132, Issue 3, 2009, Pages 671-683

  Taylor, Kirsten I ^a,b   Stamatakis, Emmanuel A ^a,c   Tyler, Lorraine K ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b Centre for Speech Language and the Brain   (United Kingdom)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Audiovisual crossmodal integration; Brain damaged patients; Perirhinal cortex; Posterior superior temporal sulcus; Ventral temporal object processing stream

Indexed keywords

ADULT; ANATOMICAL VARIATION; ARTICLE; AUDIOVISUAL EQUIPMENT; AUDITORY STIMULATION; BEHAVIOR; BRAIN DAMAGE; BRAIN REGION; CLINICAL ARTICLE; COGNITION; CONTROLLED STUDY; FEMALE; HUMAN; INTEGRATION; INTERMETHOD COMPARISON; MALE; PRIORITY JOURNAL; SIGNAL PROCESSING; TASK PERFORMANCE; TEMPORAL CORTEX; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; AGE OF ONSET; AGED; AUDITORY PERCEPTION; BRAIN DAMAGE, CHRONIC; BRAIN MAPPING; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; NEUROPSYCHOLOGICAL TESTS; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; TEMPORAL LOBE; YOUNG ADULT;

EID: 64849094448     PISSN: 00068950     EISSN: 14602156     Source Type: Journal    
DOI: 10.1093/brain/awn361     Document Type: Article

References (76)

1. Amedi A, von Kriegstein K, van Atteveldt NM, Beauchamp MS, Naumer MJ. Functional imaging of human crossomodal identification and object recognition. Exp Brain Res 2005; 166: 559-71.
2. Amici S, Brambati SM, Wilkins DP, Ogar J, Dronkers NL, Miller BL, et al. Anatomical corelates of sentence comprehension and verbal working memory in neurodegenerative disease. J Neurosci 2007; 27: 6282-90.
3. Avillac M, Deneve S, Olivier E, Pouget A, Duhamel J-R. Reference frames for representing visual and tactile locations in parietal cortex. Nat Neurosci 2005; 8: 941-9.
4. Baayen R, Piepenbrock R, Gulikers L. The CELEX Lexical Database (Release 2) (CD-ROM). Philadelphia: Linguistic Data Consortium, University of Pennsylvania; 1995.
5. Barraclough NE, Xiao D, Baker CI, Oram MW, Perrett DI. Integration of visual and auditory information by superior tmeporal sulcus neurons responseive to the sight of actions. J Cogn Neurosci 2005; 17: 377-91.
6. Barsalou LW. Perceptual symbol systems. Behav Brain Sci 1999; 22: 577-660.
7. Beauchamp MS. See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex. Curr Opin Neurobiol 2005; 15: 1-9.
8. Beauchamp MS, Argall BD, Bodurka J, Duyn JH, Martin A. Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat Neurosci 2004a; 7: 1190-2.
9. Beauchamp MS, Lee KE, Argall BD, Martin A. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 2004b; 41: 809-23.
10. Benevento LA, Fallon J, Davis BJ, Rezak M. Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Exp Neurol 1977; 57: 849-72.
11. Bright P, Moss HE, Longe O, Stamatakis EA, Tyler LK. Conceptual structure modulates anteromedial temporal involvement in processing verbally presented object properties. Cereb Cortex 2007; 17: 1066-73.
12. Bruce C, Desimone R, Gross CG. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J Neurophysiol 1981; 46: 369-84.
13. Bussey TJ, Saksida LM, Murray EA. The perceptual-mnemonic/feature conjunction model of perirhinal cortex function. Q J Exp Psychol 2005; 58B: 269-82.
14. Calvert GA. Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex 2001; 11: 1110-23.
15. Caplan D, Hildebrant N. Disorders of syntactic comprehension. Cambridge, MA: MIT Press; 1988.
16. Caplan D, Hildebrant N, Makris N. Location of lesions in stroke patients with deficits in syntactic processing in sentence comprehension. Brain 1996; 119: 933-49.
17. Catani M, Jones DK, Donato R, ffytche DH. Occipito-temporal connections in the human brain. Brain 2003; 126: 2093-107.
18. Cree GS, McRae K. Analyzing the factors underlying the structure and computation of the meaning of Chipmunk, Cherry, Chisel, Cheese, and Cello (and many other such concrete nouns). J Exp Psychol Gen 2003; 132: 163-201.
19. Damasio AR. Time-locked multiregional retroactivation: a systems-level proposal for the neural substrates of recall and recognition. Cognition 1989; 33: 25-62.
20. Damasio AR. Category-related recognition defects as a clue to the neural substrates of knowledge. Trends Neurosci 1990; 13: 95-98.
21. Davachi L. Item, context and relational episodic encoding in humans. Curr Opin Neurobiol 2006; 16: 693-700.
22. Desimone R, Ungerleider LG. Neural mechanisms of visual perception in monkeys. In: Boller F, Grafman J, editors. Handbook of neuropsychology. Vol. 2. Amsterdam: Elsevier; 1989. p. 267-99.
23. Driver J, Noesselt T. Multisensory interplay reveals crossmodal influences in 'sensory-specific' brain regions, neural responses and judgments. Neuron 2008; 57: 11-23.
24. Ettlinger G, Wilson WA. Cross-modal performance: behavioural processes, phylogenetic consentions and neural mechanisms. Behav Brain Res 1990; 40: 169-92.
25. Falchier A, Clavagnier S, Barone P, Kennedy H. Anatomical evidence of multimodal integration in primate striate cortex. J Neurosci 2002; 22: 5749-59.
26. Felleman DJ, Van Essen DC. Distributed hierarchical processing in the primate cerebral cortex. Cereb Cortex 1991; 1: 1-47.
27. Forster KI, Forster JC. A windows display program with millisecond accuracy. Behav Res Meth Instrum Comput 2003; 35: 116-24.
28. Foxe JJ, Schroeder CE. The case for feedforward multisensory convergence during early cortical processing. Neuroreport 2005; 16: 419-23.
29. Friston KJ, Jezzard P, Turner R. Analysis of functional MRI time series. Hum Brain Mapp 1994; 1: 153-71.
30. Fristen KJ, Holmes AP, Worsley KJ, Poline J-B, Frith CD, Frackowiak RSJ. Statistical parametric maps in functional imaging: A general linear approach. Hum Brain Mapp 1995; 2: 189-210.
31. Ghazanfar AA, Schroeder CE. Is neocortex essentially multisensory? Trends Cogn Sci 2006; 10: 278-85.
32. Giard MH, Peronnet F. Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. J Cogn Neurosci 1999; 11: 473-90.
33. Hart J, Gordon B. Delineation of single-word semantic comprehension deficits in aphasia, with anatomical correlation. Ann Neurol 1990; 27: 226-31.
34. Hikosaka K, Iwai E, Saito H-A, Tanaka K. Polysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. J Neurophysiol 1988; 60: 1615-37.
35. Insausti R, Juottonen K, Soininen H, Insausti AM, Partanen K, Vainio P, et al. MR volumetric analysis of the human entorhinal, perirhinal, and temporopolar cortices. Am J Neuroradiol 1998; 19: 659-71.
36. Lakatos P, Chen C-M, O'Connell MN, Mills A, Schroeder CE. Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 2007; 53: 279-92.
37. Lavenex P, Amaral DG. Hippocampal-neocortical interaction: a hierarchy of associativity. Hippocampus 2000; 10: 420-30.
38. Lerner Y, Hendler T, Ben-Bashat D, Harel M, Malach R. A hierarchical axis of object processing stages in the human visual cortex. Cereb Cortex 2001 ; 11: 287-97.
39. Lewis JW, Wightman FL, Brefczynski JA, Phinney RE, Binder JR, DeYoe EA. Human brain regions involved in recognizing environmental sounds. Cereb Cortex 2004; 14: 1008-21.
40. Macaluso E. Multisensory processing in sensory-specific cortical areas. Neuroscientist 2006; 12: 327-38.
41. McRae K, de Sa VR, Seidenberg MS. On the nature and scope of featural representations of word meaning. J Exp Psych Gen 1997; 126: 99-130.
42. McRae K, Cree GS. Factors underlying category-specific semantic deficits. In: Forde EME, Humphreys G, editors. Category-specificity in mind and brain. Sussex: Psychology Press; 2002. p. 211-50.
43. Molholm S, Ritter W, Javitt DC, Foxe JJ. Multisensory visual-a7uditory object recognition in humans: a high-density electrical mapping study. Cereb Cortex 2004; 14: 452-65.
44. Moss HE, Rodd JM, Stamatakis EA, Bright P, Tyler LK. Anteromedial temporal cortex supports fine-grained differentiation among objects. Cereb Cortex 2005; 15: 616-27.
45. Moss HE, Tyler LK, Devlin J. The emergence of category specific deficits in a distributed semantic system. In: Forde E, Humphreys GW, editors. Category-specificity in brain and mind. Sussex: Psychology Press; 2002. p. 115-48.
46. Murray EA, Bussey TJ. Perceptual-mnemonic functions of the perirhinal cortex. Trends Cogn Sci 1999; 3: 142-51.
47. Murray EA, Málkova L, Goulet S. Crossmodal associations, intramodal associations, and object identification in macaque monkeys. In: Milner AD, editor. Comparative neuropsychology. Oxford: Oxford University Press; 1998. p. 51-69.
48. Murray EA, Richmond BJ. Role of perirhinal cortex in object perception, memory, and associations. Curr Opin Neurobiol 2001; 11: 188-93.
49. Parker A, Gaffan D. Lesions of the primate rhinal cortex cause deficits in flavour-visual associative memory. Beh Brain Res 1998; 93: 99-105.
50. Pouget A, Deneve S, Duhamel J-R. A computational perspective on the neural basis of multisensory spatial representations. Nat Rev Neurosci 2002; 3: 741-7.
51. Powell HWR, Guye M, Parker GJM, Symms MR, Boulby P, Koepp MJ, et al. Noninvasive in vivo demonstration of the connections of the human parahippocampal gyrus. Neuroimage 2004; 22: 740-7.
52. Rauschecker JP, Tian B. Mechanisms and streams for processing of "what" and "where" in auditory cortex. Proc Natl Acad Sci USA 2000; 97: 11800-6.
53. Randall B, Moss HE, Rodd JM, Greer M, Tyler LK. Distinctiveness and correlation in conceptual structure: Behavioral and computational studies. J Exp Psychol Learn Mem Cogn 2004; 30: 393-406.
54. Rockland KS, Ojlma H. Multisensory convergence in calcarine visual areas in macaque monkey. Int J Psychophysiol 2003; 50: 19-26.
55. Rogers TT, McClelland JL. Semantic cognition: a parallel distributed processing approach. Cambridge, MA: MIT Press; 2004.
56. Schroeder CE, Smiley J, Fu KG, McGinnis T, O'Connell MN, Hackett TA. Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing. Int J Psychophysiol 2003; 50: 5-17.
57. Semple MN, Scott BH. Cortical mechanisms in hearing. Curr Opin Neurobiol 2003; 13: 167-73.
58. Shams L, Iwaki S, CHawla A, Bhattacharya J. Early modulation of visual cortex by sound: an MEG study. Neurosci Lett 2005; 378: 76-81.
59. Simmons WK, Barsalou LW. The simllarity-in-topography principle: reconciling theories of conceptual deficits. Cognit Neuropsychol 2003; 20: 451-86.
60. Stamatakis EA, Tyler LK. Identifying lesions on structural brain images: validation of the method and application to neuropsychological patients. Brain Lang 2005; 94: 167-77.
61. Suzuki WA, Amaral DG. Perirhinal and parahippocampal cortices of the macaque monkey: cortical afferents. J Comp Neurol 1994; 350: 497-533.
62. Suzuki WA, Amaral DG. Where are the perirhinal and parahippocampal cortices? A historical overview of the nomenclature and boundaries applied to the primate medial temporal lobe. Neuroscience 2003; 120: 893-906.
63. Talairach J, Tournoux P. Coplanar stereotactic atlas of the human brain. Stuttgart: George Thieme Verlag; 1988.
64. Taylor KI, Moss HE, Stamatakis EA, Tyler LK. Binding crossmodal object features in perirhinal cortex. Proc Natl Acad Sci USA 2006; 103: 8239-44.
65. Taylor KI, Moss HE, Tyler LK. The conceptual structure account: a cognitive model of semantic memory and its neural instantiation. In: Hart J, Kraut M, editors. The neural basis of semantic memory. Cambridge, UK: Cambridge University Press; 2007. p. 265-301.
66. Taylor KI, Probst A. Anatomic localization of the transentorhinal region of the perirhinal cortex. Neurobiol Aging 2008; 29: 1591-6.
67. Tranel D, Grabowski TJ, Lyon J, Damasio H. Naming the same entities from visual or from auditory stimulation engages similar regions of left inferotemporal cortices. J Cogn Neurosci 2005; 17: 1293-1305.
68. Tyler LK, deMornay-Davies P, Anokhina R, Longworth C, Randall B, Marslen-Wilson WD. Dissociations in processing past tense morphology: neuropathology and behavioral studies. J Cogn Neurosci 2002; 14: 79-94.
69. Tyler LK, Marslen-Wilson W. Fronte-temporal brain systems supporting spoken language comprehension. Philos Transact R Soc 2008; 363: 1037-54.
70. Tyler LK, Marslen-Wilson W, Stamatakis EA. Dissociating neuro-cognitive component processes: voxel based correlational methodology. Neuropsychologia 2005a; 43: 771-8.
71. Tyler LK, Marslen-Wilson WD, Stamatakis EA. Differentiating lexical form, meaning and structure in the neural language system. Proc Natl Acad Sci USA 2005b; 102: 8375-80.
72. Tyler LK, Moss HE. Towards a distributed account of conceptual knowledge. Trends Cogn Sci 2001; 5: 244-52.
73. Tyler LK, Moss HE, Durrant-Peatfield MR, Levy JP. Conceptual structure and the structure of concepts: a distributed account of categoryspecific deficits. Brain Lang 2000; 75: 195-231.
74. Tyler LK, Stamatakis EA, Bright P, Acres K, Abdallah S, Rodd JM, et al. Processing objects at different levels of specificity. J Cogn Neurosci 2004; 16: 351-62.
75. von Monakow C. Die Lokalisatlon im Grosshirn und der Abbau der Funktion durch kortikale Herde. Wiesbaden, Germany: JF Bergmann; 1914.
76. Wise R, Chollet F, Hadar U, Friston K, Hoffner E, Frackowiak R. Distribution of cortical neural networks involved in word comprehension and word retrieval. Brain 1991; 114: 1803-17.