Reorganization of functional and effective connectivity during real-time fMRI-BCI modulation of prosody processing

Brain and Language

Volumn 117, Issue 3, 2011, Pages 123-132

  Rota, Giuseppina ^a   Handjaras, Giacomo ^a   Sitaram, Ranganatha ^b   Birbaumer, Niels ^b,c   Dogil, Grzegorz ^d  

^a UNIVERSITY OF PISA   (Italy)

^b UNIVERSITY OF TÜBINGEN   (Germany)

^c SAN CAMILLO FORLANINI HOSPITAL   (Italy)

^d UNIVERSITY OF STUTTGART   (Germany)

Author keywords

Brain computer interface; Effective connectivity; Functional connectivity; Learning; Mental imagery; Prosody; Real time functional magnetic resonance imaging; Right inferior frontal gyrus

Indexed keywords

ADULT; AMYGDALOID NUCLEUS; ARTICLE; BEHAVIOR; BRAIN COMPUTER INTERFACE; BRAIN FUNCTION; CINGULATE GYRUS; EMOTIONALITY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GLOBUS PALLIDUS; HUMAN; HUMAN EXPERIMENT; IMAGERY; INFERIOR FRONTAL GYRUS; INSULA; LANGUAGE PROCESSING; LEARNING; MALE; MIDDLE FRONTAL GYRUS; MIDDLE TEMPORAL GYRUS; PARAHIPPOCAMPAL GYRUS; PARIETAL GYRUS; PREFRONTAL CORTEX; PRIMARY MOTOR CORTEX; PROSODY PROCESSING; PUTAMEN; RIGHT HEMISPHERE; SPEECH; SUPERIOR TEMPORAL GYRUS; TEMPORAL CORTEX;

ADULT; BRAIN MAPPING; EMOTIONS; FEEDBACK, PHYSIOLOGICAL; FRONTAL LOBE; FUNCTIONAL LATERALITY; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; NEUROPSYCHOLOGICAL TESTS; SIGNAL PROCESSING, COMPUTER-ASSISTED; SPEECH PERCEPTION; TEMPORAL LOBE; USER-COMPUTER INTERFACE;

EID: 79955471561     PISSN: 0093934X     EISSN: 10902155     Source Type: Journal    
DOI: 10.1016/j.bandl.2010.07.008     Document Type: Article

References (71)

1. Baum S., Pell M. The neural bases of prosody: Insights from lesion studies and neuroimaging. Aphasiology 1999, 13:581-608.
2. Birbaumer N., Murguialday A.R., Cohen L. Brain-Computer Interface in paralysis. Current Opinion in Neurology 2008, 21:634-638.
3. Birbaumer N. Breaking the silence: Brain-Computer Interfaces (BCI) for communication and motor control. Psychophysiology 2006, 43:517-532.
4. Birn R.M., Diamone J.B., Smith M.A., Bandettini P.A. Separating respiratory-variation-related fluctuations from neuronal-activity-related fluctuations in fMRI. Neuroimage 2006, 31:1536-1548.
5. Bolinger D. Accent is predictable (if you're a mind-reader). Language 1972, 48:633-644.
6. Bowers D., Coslett H.B., Bauer R.M., Speedie L.J., Heilman K.M. Comprehension of emotional prosody following unilateral hemispheric lesions: Processing defect versus distraction defect. Neuropsychologia 1987, 25:317-328.
7. Breitenstein C., Daum I., Ackermann H., Lütgehetmann R., Müller E. Erfassung der Emotionswahrnehmung bei zentralnervösen Läsionen und Erkrankungen: Psychometrische Gütekriterien der ''Tübinger Affekt Batterie''. Neurologische Rehabilitation 1996, 2:93-101.
8. Buchanan T.W., Lutz K., Mirzazade S., Specht K., Shah N.J., Zilles K., et al. Recognition of emotional prosody and verbal components of spoken language: An fMRI study. Brain Research. Cognitive Brain Research 2000, 9:227-238.
9. Cancelliere A., Kertesz A. Lesion localization in acquired deficits of emotional expression and comprehension. Brain and Cognition 1990, 13:133-147.
10. Caria A., Veit R., Sitaram R., Lotze M., Weiskopf N., Grodd W., et al. Regulation of anterior insular cortex activity using real-time fMRI. Neuroimage 2007, 35:1238-1246.
11. Cordes D., Haughton V.M., Arfanakis K., Carew J.D., Turski P.A., Moritz C.H., et al. Frequencies contributing to functional connectivity in the cerebral cortex in " resting-state" data. American Journal of Neuroradiology (AJNR) 2001, 22(7):1326-1333.
12. Cox R.W. AFNI©: Software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical Research 1996, 29:162-173.
13. D'Ausilio A., Pulvermüller F., Salmas P., Bufalari I., Begliuomini C., Fadiga L. The motor somatotopy of speech perception. Current Biology 2009, 19:381-385.
14. Damasio A.R., Geschwind N. The neural basis of language. Annual Reviews Neuroscience 1984, 7:127-147.
15. Dogil G., Frese I., Haider H., Rohm D., Wokurek W. Where and how does grammatically geared processing take place and why is Broca's area often involved? A coordinated fMRI/ERBP study of language processing. Brain and Language 2004, 89:337-345.
16. Dogil G., Riecker A., Ackermann H., Wildgruber D., Mayer J., Haider H., et al. The Speaking Brain: A tutorial introduction to fMRI experiments in the production of speech, prosody and syntax. Journal of Neurolinguistics 2002, 15:59-90.
17. Dogil G. The phonetic manifestation of word stress. Word prosodic systems in the languages of Europe 1999, 273-334. de Gruyter, Berlin. H. van der Hulst (Ed.).
18. Doyon J., Owen A.M., Petrides M., Sziklas V., Evans A.C. Functional anatomy of visuomotor skill learning in human subjects examined with positron emission tomography. European Journal of Neuroscience 1996, 8:637-648.
19. Ethofer T., Kreifelts B., Wiethoff S., Wolf J., Grodd W., Vuilleumier P., et al. Differential influences of emotion, task, and novelty on brain regions underlying the processing of speech melody. Journal of Cognitive Neuroscience 2009, 21:1255-1268.
20. Ethofer T., Anders S., Erb M., Herbert C., Wiethoff S., Kissler J., et al. Cerebral pathways in processing of affective prosody: A dynamic causal modeling study. Neuroimage 2006, 30:580-587.
21. Kan Y., Mimura M., Kamijima K., Kawamura M. Recognition of emotion from moving facial and prosodic stimuli in depressed patients. Journal of Neurology, Neurosurgery, and Psychiatry 2004, 75:1667-1671.
22. Kelly A.M., Garavan H. Human functional neuroimaging of brain changes associated with practice. Cerebral Cortex 2005, 15:1089-1102.
23. Friston K.J., Price C.J., Fletcher P., Moore C., Frackowiak R.S., Dolan R.J. The trouble with cognitive subtraction. Neuroimage 1996, 4:97-104.
24. Friston K.J., Holmes A., Worsley K.J., Pline J.P., Frith C.D., Frackowiak R.S. Statistical parametric map in functional imaging: A general linear approach. Human Brain Mapping 1995, 2:189-210.
25. Friston K.J. Functional and effective connectivity in neuroimaging: A synthesis. Human Brain Mapping 1994, 2:56-78.
26. Grafton S.T., Hazeltine E., Ivry R.B. Functional anatomy of sequence learning in normal humans. Journal of Cognitive Neuroscience 1995, 7:497-510.
27. Gandour J., Wong D., van Lancker D., Hutchings D. A PET investigation of speech prosody in tone languages. Brain and Language 1997, 60:192-194.
28. Holmes E.A., Geddes J.R., Colom F., Goodwin G.M. Mental imagery as an emotional amplifier: Application to bipolar disorder. Behaviour Research and Therapy 2008, 46:1251-1258.
29. Hornak J., Bramham J., Rolls E.T., Morris R.G., O'Doherty J., Bullock P.R., et al. Changes in emotion after circumscribed surgical lesions of the orbitofrontal and cingulate cortices. Brain 2003, 126:1691-1712.
30. Horwitz B. Data analysis paradigms for metabolic-flow data: Combining neural modeling and functional neuroimaging. Human Brain Mapping 1994, 2:112-122.
31. Lancaster J.L., Woldorff M.G., Parsons L.M., Liotti M., Freitas C.S., Rainey L., et al. Automated Talairach Atlas labels for functional brain mapping. Human Brain Mapping 2000, 10:120-131.
32. Lancaster J.L., Rainey L.H., Summerlin J.L., Freitas C.S., Fox P.T., Evans A.C., et al. Automated labeling of the human brain: A preliminary report on the development and evaluation of a forward-transform method. Human Brain Mapping 1997, 5:238-242.
33. Lee, S., Sitaram, R., Ruiz, S., & Birbaumer, N. (2008). Measure of neurofeedback effects in an fMRI Brain-Computer Interface with support vector machine and Granger causality model. In Frontiers in human neuroscience. Conference abstract: 10th international conference on cognitive neuroscience. doi: doi:10.3389/conf.neuro.09.2009.01.172.
34. Levelt W.J.M. Speaking: From intention to articulation 1989, MIT Press, Cambridge, MA.
35. Londei A., D'Ausilio A., Basso D., Sestieri C., Gratta C.D., Romani G.L., et al. Sensory-motor brain network connectivity for speech comprehension. Human Brain Mapping 2010, 31:567-580.
36. Lovenbruck H., Baciu M., Segebarth C., Abry C. The left interior frontal gyrus under focus: An fMRI study of the production of deixis via syntactic extraction and prosodic focus. Journal of Neurolinguistics 2005, 18:237-258.
37. Mayer, J., Dogil, G., Wildgruber, D., Riecker, A., Ackermann, H., Grodd, W. (1999). Prosody in speech production: A fMRI study. In Proceedings of the 14th international congress of phonetic sciences (ICPhS) (pp. 635-638), San Francisco.
38. Mohr B., Pulvermüller F., Schleichert H. Learned changes of brain states alter cognitive processing in humans. Neuroscience Letters 1998, 253:159-162.
39. Nair D.G., Purcott K.L., Fuchs A., Steinberg F., Kelso J.A. Cortical and cerebellar activity of the human brain during imagined and executed unimanual and bimanual action sequences: A functional MRI study. Brain Research. Cognitive Brain Research 2003, 15:250-260.
40. Ochsner K.N., Gross J.J. The cognitive control of emotion. Trends in Cognitive Sciences 2005, 9:242-249.
41. Oldfield R.C. The assessment and analysis of handedness: The Edinburgh Inventory. Neuropsychologia 1971, 9:97-113.
42. Pell M., Baum S. The ability to perceive and comprehend intonation in linguistic and affective contexts by brain damaged adults. Brain and Language 1997, 57:80-99.
43. Ploog D. Neuroethnological foundations of human speech. From neuron to action 1990, 365-374. Springer, Berlin. J. Deecke, J. Eccles, V. Mountcastle (Eds.).
44. Pulvermüller F., Huss M., Kherif F., Moscoso del Prado Martin F., Hauk O., Shtyrov Y. Motor cortex maps articulatory features of speech sounds. Proceedings of the National Academy of Sciences of the United States of America 2006, 103:7865-7870.
45. Pulvermüller F., Mohr B., Schleichert H., Veit R. Operant conditioning of left-hemispheric slow cortical potentials and its effect on word processing. Biological Psychology 2000, 53:177-215.
46. Quadflieg S., Wendt B., Mohr A., Miltner W.H., Straube T. Recognition and evaluation of emotional prosody in individuals with generalized social phobia: A pilot study. Behaviour Research and Therapy 2007, 45:3096-3103.
47. Roebroeck A., Formisano E., Goebel R. Mapping directed influence over the brain using granger causality mapping. Neuroimage 2005, 25:230-242.
48. Rooth M. Second occurrence focus and relativized stress F. Information structure: Theoretical, typological, and experimental perspectives 2009, Oxford University. C. Fery, M. Zimmermann (Eds.).
49. Ross E.D. The Aprosodias: Functional-anatomic organization of the affective components of language in the right hemisphere. Archives of Neurology 1981, 38:561-569.
50. Rota G., Veit R., Nardo D., Weiskopf N., Birbaumer N., Dogil G. Processing of inconsistent emotional information: An fMRI study. Experimental Brain Research 2008, 186:401-407.
51. Rota G., Sitaram R., Veit R., Erb M., Weiskopf N., Dogil G., et al. Self-regulation of regional cortical activity using real-time fMRI: The right inferior frontal gyrus and linguistic processing. Human Brain Mapping 2009, 30:1605-1614.
52. Rymarczyk K., Grabowska A. Sex differences in brain control of prosody. Neuropsychologia 2007, 45:921-930.
53. Sack A.T., Jacobs C., De Martino F., Staeren N., Goebel R., Formisano E. Dynamic premotor-to-parietal interactions during spatial imagery. Journal of Neuroscience 2008, 20:8417-8429.
54. Sakai K.L. Language acquisition and brain development. Science 2005, 310:815-819.
55. Schirmer A., Kotz S.A. Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing. Trends in Cognitive Sciences 2006, 10:24-30.
56. Schirmer A., Kotz S.A., Friederici A.D. Sex differentiates the role of emotional prosody during word processing. Brain Research. Cognitive Brain Research 2002, 14:228-233.
57. Schmitz T.W., Kawahara-Baccus T.N., Johnson S.C. Metacognitive evaluation, self-relevance, and the right prefrontal cortex. Neuroimage 2004, 22:941-947.
58. Schneider W., Eschman A., Zuccolotto A. E-Prime user's guide 2002, Psychology Software Tools Inc., Pittsburgh, PA.
59. Selkirk E. Sentence prosody: Intonation, stress, and phrasing. The handbook of phonological theory 1995, 550-569. Blackwell, Cambridge, MA, and Oxford, UK. G.A. Goldsmith (Ed.).
60. Shergill S.S., Bullmore E.T., Brammer M.J., Williams S.C.R., Murray R.M., McGuire P.K. A functional study of auditory verbal imagery. Psychological Medicine 2001, 31:241-253.
61. Sitaram R., Weiskopf N., Caria A., Veit R., Erb M., Birbaumer N. fMRI brain-computer interfaces. A tutorial on methods and applications. IEEE Signal Processing Magazine 2008, 25:95-106.
62. Talairach J., Tournoux P. Coplanar stereotaxic atlas of the human brain 1988, Thieme Medical, New York.
63. Thompson W.L., Slotnick S.D., Burrage M.S., Kosslyn S.M. Two forms of spatial imagery: Neuroimaging evidence. Psychological Science. A Journal of the American Psychological Society/APS 2009, 20:1245-1253.
64. van Lancker D., Sidtis J. The identification of affective-prosodic stimuli by left- and right-hemisphere-damaged subjects: All errors are not created equal. Journal of Speech and Hearing Research 1992, 35:963-970.
65. van Lancker D. Cerebral lateralization of pitch cues in the linguistic signal. International Journal of Human Communication 1980, 13:227-277.
66. Weiskopf N., Sitaram R., Josephs O., Veit R., Scharnowski F., Goebel R., et al. Real-time functional magnetic resonance imaging: methods and applications. Magnetic Resonance Imaging 2007, 25:989-1003.
67. Weiskopf N., Veit R., Erb M., Mathiak K., Grodd W., Goebel R., et al. Physiological self-regulation of regional brain activity using real-time functional magnetic resonance imaging (fMRI) methodology and exemplary data. Neuroimage 2003, 19:577-586.
68. Wildgruber D., Riecker A., Hertrich I., Erb M., Grodd W., Ethofer T., et al. Identification of emotional intonation evaluated by fMRI. Neuroimage 2005, 24:1233-1241.
69. Wildgruber D., Hertrich I., Riecker A., Erb M., Anders S., Grodd W., et al. Distinct frontal regions subserve evaluation of linguistic and emotional aspects of speech intonation. Cerebral Cortex 2004, 14:1384-1389.
70. Wildgruber D., Pihan H., Ackermann H., Erb M., Grodd W. Dynamic brain activation during processing of emotional intonation: Influence of acoustic parameters, emotional valence, and sex. Neuroimage 2002, 15:856-869.
71. Wilson S.M., Saygin A.P., Sereno M.I., Iacoboni M. Listening to speech activates motor areas involved in speech production. Nature Neuroscience 2004, 7:701-702.