Audiovisual integration of speech is disturbed in schizophrenia: An fMRI study

Schizophrenia Research

Volumn 110, Issue 1-3, 2009, Pages 111-118

  Szycik, G R ^a,b   Munte T F ^b,c,d   Dillo, W ^a   Mohammadi, B ^b,c   Samii, A ^c   Emrich, H M ^a   Dietrich, D E ^a  

^a HANNOVER MEDICAL SCHOOL   (Germany)

^b OTTO VON GUERICKE UNIVERSITY   (Germany)

^c INTERNATIONAL NEUROSCIENCE INSTITUTE   (Germany)

^d Center for Behavioral Brain Sciences   (Germany)

Author keywords

Audiovisual integration; fMRI; Multimodal processing; Right hemisphere; Schizophrenia; Speech

Indexed keywords

CHLORPROMAZINE;

ADULT; AGE DETERMINATION; ARTICLE; AUDIOVISUAL INTEGRATION; CINGULATE GYRUS; CLINICAL ARTICLE; COMPARATIVE STUDY; CONTROL GROUP; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; FEMALE; FRONTAL LOBE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEMISPHERIC DOMINANCE; HUMAN; HYPOPHYSIS PARS TUBERALIS; INTEGRATION; MALE; MOTOR SYSTEM; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; RIGHT HEMISPHERE; SCHIZOPHRENIA; SPEECH PERCEPTION; SUBICULUM;

ACOUSTIC STIMULATION; ADULT; BRAIN; BRAIN MAPPING; CASE-CONTROL STUDIES; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; OXYGEN; PHOTIC STIMULATION; SCHIZOPHRENIA; SPEECH; SPEECH PERCEPTION;

EID: 64749083616     PISSN: 09209964     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.schres.2009.03.003     Document Type: Article

References (67)

1. Aglioti S., Beltramello A., Girardi F., and Fabbro F. Neurolinguistic and follow-up study of an unusual pattern of recovery from bilingual subcortical aphasia. Brain 119 Pt 5 (1996) 1551-1564
2. Baayen R.H., Piepenbrock R., and Gulikers L. The CELEX Lexical Database [CD-ROM] (1995), University of Pennsylvania, Philadelphia Linguistic Data Consortium
3. Blumstein S.E., Alexander M.P., Ryalls J.H., Katz W., and Dworetzky B. On the nature of the foreign accent syndrome: a case study. Brain Lang. 31 (1987) 215-244
4. Bookheimer S. Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. Annu. Rev. Neurosci. 25 (2002) 151-188
5. Boynton G.M., Engel S.A., Glover G.H., and Heeger D.J. Linear systems analysis of functional magnetic resonance imaging in human V1. J. Neurosci. 16 (1996) 4207-4221
6. Braus D.F., Weber-Fahr W., Tost H., Ruf M., and Henn F.A. Sensory information processing in neuroleptic-naive first-episode schizophrenic patients: a functional magnetic resonance imaging study. Arch. Gen. Psychiatry 59 (2002) 696-701
7. Callan D.E., Callan A.M., Kroos C., and Vatikiotis-Bateson E. Multimodal contribution to speech perception revealed by independent component analysis: a single-sweep EEG case study. Brain Res. Cogn. Brain Res. 10 (2001) 349-353
8. Callicott J.H., Bertolino A., Mattay V.S., Langheim F.J.P., Duyn J., Coppola R., et al. Physiological dysfunction of the dorsolateral prefrontal cortex in schizophrenia revisited. Cereb. Cortex 10 (2000) 1078-1092
9. Callicott J.H., Mattay V.S., Verchinski B.A., Marenco S., Egan M.F., and Weinberger D.R. Complexity of prefrontal cortical dysfunction in schizophrenia: more than up or down. Am. J. Psychiatry 160 (2003) 2209-2215
10. Calvert G.A., and Thesen T. Multisensory integration: methodological approaches and emerging principles in the human brain. J. Physiol. Paris 98 (2004) 191-205
11. Calvert G.A., Brammer M.J., Bullmore E.T., Campbell R., Iversen S.D., and David A.S. Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport 10 (1999) 2619-2623
12. Calvert G.A., Campbell R., and Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 10 (2000) 649-657
13. Campanella S., and Belin P. Integrating face and voice in person perception. Trends Cogn. Sci. 11 (2007) 535-543
14. Covington M.A., He C., Brown C., Naci L., McClain J.T., Fjordbak B.S., et al. Schizophrenia and the structure of language: the linguist's view. Schizophr. Res. 77 (2005) 85-98
15. De Gelder B., Vroomen J., Annen L., Masthof E., and Hodiamont P. Audio-visual integration in schizophrenia. Schizophr. Res. 59 (2003) 211-218
16. Dekle D.J., Fowler C.A., and Funnell M.G. Audiovisual integration in perception of real words. Percept. Psychophys. 51 (1992) 355-362
17. DeLisi L.E. Speech disorder in schizophrenia: review of the literature and exploration of its relation to the uniquely human capacity for language. Schizophr. Bull. 27 (2001) 481-496
18. Erber N.P. Interaction of audition and vision in the recognition of oral speech stimuli. J. Speech Hear. Res. 12 (1969) 423-425
19. Forman S.D., Cohen J.D., Fitzgerald M., Eddy W.F., Mintun M.A., and Noll D.C. Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold. Magn. Reson. Med. 33 (1995) 636-647
20. Genovese C.R., Lazar N.A., and Nichols T. Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuroimage 15 (2002) 870-878
21. Golestani N., and Zatorre R.J. Learning new sounds of speech: reallocation of neural substrates. Neuroimage 21 (2004) 494-506
22. Grant K.W., and Seitz P.F. The use of visible speech cues for improving auditory detection of spoken sentences. J. Acoust. Soc. Am. 108 (2000) 1197-1208
23. Hagoort P. On Broca, brain, and binding: a new framework. Trends Cogn. Sci. 9 (2005) 416-423
24. Heiser M., Iacoboni M., Maeda F., Marcus J., and Mazziotta J.C. The essential role of Broca's area in imitation. Eur. J. Neurosci. 17 (2003) 1123-1128
25. Hertrich I., Mathiak K., Lutzenberger W., Menning H., and Ackermann H. Sequential audiovisual interactions during speech perception: a whole-head MEG study. Neuropsychologia 45 (2007) 1342-1354
26. Iacoboni M., and Dapretto M. The mirror neuron system and the consequences of its dysfunction. Nat. Rev. Neurosci. 7 (2006) 942-951
27. Joassin F., Maurage P., Bruyer R., Crommelinck M., and Campanella S. When audition alters vision: an event-related potential study of the cross-modal interactions between faces and voices. Neurosci. Lett. 369 (2004) 132-137
28. Kanwisher N., and Yovel G. The fusiform face area: a cortical region specialized for the perception of faces. Philos. Trans. R. Soc. Lond. B Biol. Sci. 361 (2006) 2109-2128
29. Kim J., Doop M.L., Blake R., and Park S. Impaired visual recognition of biological motion in schizophrenia. Schizophr. Res. 77 (2005) 299-307
30. Klein D., Zatorre R.J., Milner B., Meyer E., and Evans A.C. Left putaminal activation when speaking a second language: evidence from PET. Neuroreport 5 (1994) 2295-2297
31. Lahti A.C., Holcomb H.H., Weiler M.A., Medoff D.R., and Tamminga C.A. Functional effects of antipsychotic drugs: comparing clozapine with haloperidol. Biol. Psychiatry 53 (2003) 601-608
32. Lahti A.C., Weiler M.A., Medoff D.R., Tamminga C.A., and Holcomb H.H. Functional effects of single dose first- and second-generation antipsychotic administration in subjects with schizophrenia. Psychiatry Res. 139 (2005) 19-30
33. Lancaster J.L., Woldorff M.G., Parsons L.M., Liotti M., Freitas C.S., Rainey L., et al. Automated Talairach atlas labels for functional brain mapping. Hum. Brain Mapp. 10 (2000) 120-131
34. Lee C.U., Shenton M.E., Salisbury D.F., Kasai K., Onitsuka T., Dickey C.C., et al. Fusiform gyrus volume reduction in first-episode schizophrenia: a magnetic resonance imaging study. Arch. Gen. Psychiatry 59 (2002) 775-781
35. Liberman A.M., and Mattingly I.G. The motor theory of speech perception revised. Cognition 21 (1985) 1-36
36. Manoach D.S., Gollub R.L., Benson E.S., Searl M.M., Goff D.C., Halpern E., et al. Schizophrenic subjects show aberrant fMRI activation of dorsolateral prefrontal cortex and basal ganglia during working memory performance. Biol. Psychiatry 48 (2000) 99-109
37. McGurk H., and MacDonald J. Hearing lips and seeing voices. Nature 264 (1976) 746-748
38. Miller D.D., Andreasen N.C., O'Leary D.S., Watkins G.L., Boles Ponto L.L., and Hichwa R.D. Comparison of the effects of risperidone and haloperidol on regional cerebral blood flow in schizophrenia. Biol. Psychiatry 49 (2001) 704-715
39. Mitchell R.L., and Crow T.J. Right hemisphere language functions and schizophrenia: the forgotten hemisphere?. Brain 128 (2005) 963-978
40. Molina V., Reig S., Pascau J., Sanz J., Sarramea F., Gispert J.D., et al. Anatomical and functional cerebral variables associated with basal symptoms but not risperidone response in minimally treated schizophrenia. Psychiatry Res. 124 (2003) 163-175
41. Möttönen R., Schurmann M., and Sams M. Time course of multisensory interactions during audiovisual speech perception in humans: a magnetoencephalographic study. Neurosci. Lett. 363 (2004) 112-115
42. Munhall K.G., Jones J.A., Callan D.E., Kuratate T., and Vatikiotis-Bateson E. Visual prosody and speech intelligibility: head movement improves auditory speech perception. Psychol. Sci. 15 (2004) 133-137
43. Myslobodsky M.S., Goldberg T., Johnson F., Hicks L., and Weinberger D.R. Lipreading in patients with schizophrenia. J. Nerv. Ment. Dis. 180 (1992) 168-171
44. Nestor P.G., Onitsuka T., Gurrera R.J., Niznikiewicz M., Frumin M., Shenton M.E., et al. Dissociable contributions of MRI volume reductions of superior temporal and fusiform gyri to symptoms and neuropsychology in schizophrenia. Schizophr. Res. 91 (2007) 103-106
45. Nishitani N., Schurmann M., Amunts K., and Hari R. Broca's region: from action to language. Physiology (Bethesda) 20 (2005) 60-69
46. Noesselt T., Driver J., Heinze H.J., and Dolan R. Asymmetrical activation in the human brain during processing of fearful faces. Curr. Biol. 15 (2005) 424-429
47. O'Neill J.J. Contributions of the visual components of oral symbols to speech comprehension. J. Speech Hear. Disord. 19 (1954) 429-439
48. Ojanen V., Mottonen R., Pekkola J., Jaaskelainen I.P., Joensuu R., Autti T., et al. Processing of audiovisual speech in Broca's area. Neuroimage 25 (2005) 333-338
49. Onitsuka T., Shenton M.E., Kasai K., Nestor P.G., Toner S.K., Kikinis R., et al. Fusiform gyrus volume reduction and facial recognition in chronic schizophrenia. Arch. Gen. Psychiatry 60 (2003) 349-355
50. Onitsuka T., Niznikiewicz M.A., Spencer K.M., Frumin M., Kuroki N., Lucia L.C., et al. Functional and structural deficits in brain regions subserving face perception in schizophrenia. Am. J. Psychiatry 163 (2006) 455-462
51. Pekkola J., Laasonen M., Ojanen V., Autti T., Jaaskelainen I.P., Kujala T., et al. Perception of matching and conflicting audiovisual speech in dyslexic and fluent readers: an fMRI study at 3 T. Neuroimage 29 (2006) 797-807
52. Ross L.A., Saint-Amour D., Leavitt V.M., Javitt D.C., and Foxe J.J. Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb. Cortex 17 (2007) 1147-1153
53. Schlagenhauf F., Wustenberg T., Schmack K., Dinges M., Wrase J., Koslowski M., et al. Switching schizophrenia patients from typical neuroleptics to olanzapine: effects on BOLD response during attention and working memory. Eur. Neuropsychopharmacol. 18 (2008) 589-599
54. Schonauer K., Achtergarde D., and Reker T. Lipreading in prelingually deaf and hearing patients with schizophrenia. J. Nerv. Ment. Dis. 186 (1998) 247-249
55. Scott S.K., and Johnsrude I.S. The neuroanatomical and functional organization of speech perception. Trends Neurosci. 26 (2003) 100-107
56. Sekiyama K., Kanno I., Miura S., and Sugita Y. Auditory-visual speech perception examined by fMRI and PET. Neurosci. Res. 47 (2003) 277-287
57. Skipper J.I., Nusbaum H.C., and Small S.L. Listening to talking faces: motor cortical activation during speech perception. Neuroimage 25 (2005) 76-89
58. Skipper J.I., Goldin-Meadow S., Nusbaum H.C., and Small S.L. Speech-associated gestures, Broca's area, and the human mirror system. Brain Lang. 101 (2007) 260-277
59. Slutsky D.A., and Recanzone G.H. Temporal and spatial dependency of the ventriloquism effect. Neuroreport 12 (2001) 7-10
60. Speedie L.J., Wertman E., Ta'ir J., and Heilman K.M. Disruption of automatic speech following a right basal ganglia lesion. Neurology 43 (1993) 1768-1774
61. Sumby W.H., and Pollack I. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26 (1954) 212 215
62. Surguladze S.A., Calvert G.A., Brammer M.J., Campbell R., Bullmore E.T., Giampietro V., et al. Audio-visual speech perception in schizophrenia: an fMRI study. Psychiatry Res. 106 (2001) 1-14
63. Szycik G.R., Jansma H., and Munte T.F. Audiovisual integration during speech comprehension: an fMRI study comparing ROI-based and whole brain analyses. Hum. Brain Mapp. (2008) 10.1002/hbm.20640
64. Szycik G.R., Tausche P., and Munte T.F. A novel approach to study audiovisual integration in speech perception: localizer fMRI and sparse sampling. Brain Res. 1220 (2008) 142-149
65. Talairach J., and Tornoux P. Co-Planar Stereotactic Atlas of the Human Brain (1988), Thieme, Stuttgart
66. Wise R.J., Greene J., Buchel C., and Scott S.K. Brain regions involved in articulation. Lancet 353 (1999) 1057-1061
67. Wright T.M., Pelphrey K.A., Allison T., McKeown M.J., and McCarthy G. Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cereb. Cortex 13 (2003) 1034-1043