The integration of large-scale neural network modeling and functional brain imaging in speech motor control

NeuroImage

Volumn 52, Issue 3, 2010, Pages 862-874

  Golfinopoulos, E ^a   Tourville, J A ^a   Guenther, F H ^a,b,c,d  

^a BOSTON UNIVERSITY   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c HARVARD UNIVERSITY   (United States)

^d MASSACHUSETTS GENERAL HOSPITAL   (United States)

Author keywords

Computational model; DIVA model; Functional magnetic resonance imaging; Speech production; Structural equation modeling

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; BRAIN FUNCTION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; LANGUAGE PROCESSING; MOTOR CONTROL; NERVE CELL NETWORK; NEUROPHYSIOLOGY; PRIORITY JOURNAL; SENSORIMOTOR FUNCTION; SPEECH; STATISTICAL MODEL; BIOLOGICAL MODEL; BRAIN MAPPING; HUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PROCEDURES; SPEECH ANALYSIS;

BRAIN MAPPING; HUMANS; MAGNETIC RESONANCE IMAGING; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); SPEECH; SPEECH PRODUCTION MEASUREMENT;

EID: 77954387390     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2009.10.023     Document Type: Article

References (99)

1. Abbs J.H., Gracco V.L. Control of complex motor gestures: orofacial muscle responses to load perturbation of lip during speech. J. Neurophysiol. 1984, 51(4):705-723.
2. Aboitiz F., García V. The evolutionary origin of the language areas in the human brain. A neuroanatomical perspective. Brain Res. Rev. 1997, 25:381-396.
3. Ackermann H., Vogel M., Peterson D., Poremba M. Speech deficits in ischaemic cerebellar lesions. Neurology 1992, 239:223-227.
4. Baciu M., Abry C., Segebarth C. Equivalence motrice et dominance hémisphérique. Le cas de la voyelle u. Étude IRMf. Actes XXIIIème Journées d'Etude sur la Parole 2000, 213-216.
5. Ballard K.J., Granier J.P., Robin D.A. Understanding the nature of apraxia of speech: theory, analysis, and treatment. Aphasiology 2000, 14(10):969-995.
6. Bauer J.J., Mittal J., Larson C.R., Hain T.C. Vocal responses to unanticipated perturbations in voice loudness feedback: an automatic mechanism for stabilizing voice amplitude. J. Acoust. Soc. Am. 2006, 119:2363-2371.
7. Baum S., Pell M. The neural bases of prosody: insights from lesion studies and neuroimaging. Aphasiology 1999, 13:581-608.
8. Belin P., Zatorre R., Hoge R., Evans A., Pike B. Event-related fMRI of the auditory cortex. NeuroImage 1999, 10:417-429.
9. Binder J.R., Frost J.A., Hammeke T.A., Bellgowan P.S., Springer J.A., Kaufman J.N., Possing E.T. Human temporal lobe activation by speech and nonspeech sounds. Cereb. Cortex 2000, 10:512-528.
10. Bohland J.W., Guenther F.H. An fMRI investigation of syllable sequence production. NeuroImage 2006, 32:821-841.
11. Bohland, J.W., Guenther, F.H., Bullock, D., 2010. Neural representations and mechanisms for the performance of simple speech sequences. J. Cognitive Neurosci. 7, 1504-1529.
12. Boling W., Reutens D.C., Olivier A. Functional topography of the low postcentral area. J. Neurosurg. 2002, 97(2):388-395.
13. Broca P. Remarques sur la siège de la faculté de la parole articulée, suivies d'une observation d'aphémie perte de parole. Bull. Soc. Anat. 1861, 36:330-357.
14. Browman C.P., Goldstein L. Articulatory gestures as phonological units. Phonology 1989, 6:201-251.
15. Brown S., Ngan E., Liotti M. A larynx area in the human motor cortex. Cereb. Cortex 2008, 18(4):837-845.
16. Buccino G., Binkofski F., Fink G.R., Fadiga L., Fogassi L., Gallese V., Seitz R.J., Zilles K., Rizzolatti G., Freund H.-J. Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Eur. J. Neurosci. 2001, 13:400-404.
17. Buchsbaum B.R., Hickok G., Humphries C. Role of left posterior superior temporal gyrus in phonological processing for speech perception and production. Cogn. Sci. 2001, 25(5):663-678.
18. Callan D.E., Kent R.D., Guenther F.H., Vorperian H.K. An auditory-feedback-based neural network model of speech production that is robust to developmental changes in the size and shape of the articulatory system. J. Speech Lang. Hear. R 2000, 43:721-736.
19. Caviness V.S., Meyer J., Makris N., Kennedy D. MRI-based topographic parcellation of human neocortex: an anatomically specified method with estimate of reliability. J. Cogn. Neurosci. 1996, 8:566-587.
20. Christoffels I.K., Formisano E., Schiller N.O. Neural correlates of verbal feedback processing: an fMRI study employing overt speech. Hum. Brain Mapp. 2007, 28:868-879.
21. Civier, O., Tasko, S., Guenther, F.H., submitted. Overreliance on auditory feedback may lead to sound/syllable repetitions: simulations of stuttering and fluency-inducing conditions with a neural model of speech production. J. Fluency Disord.
22. Damasio H., Damasio A.R. The anatomical basis of conduction aphasia. Brain 1980, 103(2):337-350.
23. Della-Maggiore V., Sekuler A.B., Grady C.L., Bennett P.J., Sekuler R., McIntosh A.R. Corticolimbic interactions associated with performance on a short-term memory task are modified by age. J. Neurosci. 2000, 20(22):8410-8416.
24. Fesl G., Moriggl B., Schmid U.D., Naidich T.P., Herholz K., Yousry T.A. Inferior central sulcus: variations of anatomy and function on the example of the motor tongue area. NeuroImage 2003, 20:601-610.
25. Fink G.R., Corfield D.R., Murphy K., Kobayashi I., Dettmers C., Adams L., Frackowiak R.S., Guz A. Human cerebral activity with increasing inspiratory force: a study using positron emission tomography. J. Appl. Physiol. 1996, 81(3):1295-1305.
26. Friederici A.D., Alter K. Lateralization of auditory language functions: a dynamic dual pathway model. Brain Lang. 2004, 89:267-276.
27. Friston K.J., Frith C.D., Liddle P.F., Frackowiak R.S.J. Functional connectivity: the principal-component analysis of large (PET) data sets. J. Cereb. Blood. Flow. Metab. 1993, 13:5-14.
28. Friston K.J., Holmes A.P., Poline J.-B., Grasby P.J., Williams S.C.R., Frackowiak R.S.J., Turner R. Analysis of fMRI time series revisited. NeuroImage 1995, 2:45-53.
29. Friston K.J., Büchel C., Fink G.R., Morris J., Rolls E., Dolan R.J. Psychophysiological and modulatory interactions in neuroimaging. NeuroImage 1997, 6:218-229.
30. Friston K.J., Harrison L., Penny W. Dynamic causal modeling. NeuroImage 2003, 19:1273-1302.
31. Fu C.H., Vythelingum G.N., Brammer M.J., Williams S.C., Amaro E., Andrew C.M., Yaguez L., van Haren N.E., Matsumoto K., McGuire P.K. An fMRI study of verbal self-monitoring: neural correlates of auditory verbal feedback. Cereb. Cortex 2006, 16:969-977.
32. Gay T., Lindblom B., Lubker J. Production of bite-block vowels: acoustic equivalence by selective compensation. J. Acoust. Soc. Am. 1981, 69(3):802-810.
33. Ghosh, S.S., 2005. Understanding cortical and cerebellar contributions to speech production through modeling and functional imaging. PhD thesis, Boston University, Boston, MA.
34. Ghosh S.S., Tourville J.A., Guenther F.H. A neuroimaging study of premotor lateralization and cerebellar involvement in the production of phonemes and syllables. J. Speech Lang. Hear. Res. 2008, 51:1183-1202.
35. Goense J.B.M., Logothetis N.K. Neurophysiology of the BOLD fMRI signal in awake monkeys. Curr. Biol. 2008, 18:631-640.
36. Golfinopoulos, E., Tourville, J.A., Bohland, J.W., Ghosh, S.S., Guenther, F.H., in preparation. Neural circuitry underlying somatosensory feedback control in speech production.
37. Goodglass H. Understanding Aphasia 1993, Academic Press, New York.
38. Gracco V.L. Sensorimotor mechanisms in speech motor control. Speech Motor Control and Stuttering 1991, 53-78. Elsevier, North Holland. H. Peters, W. Hultsijn, C.W. Starkweather (Eds.).
39. Gracco V.L., Abbs J.H. Dynamic control of the perioral system during speech: kinematic analyses of autogenic and nonautogenic sensorimotor processes. J. Neurophysiol. 1985, 54(2):418-432.
40. Grafton S.T., Schmitt P., Van Horn J., Diedrichsen J. Neural substrates of visuomotor learning based on improved feedback and prediction. NeuroImage 2008, 39:1383-1395.
41. Guenther F.H. A neural network model of speech acquisition and motor equivalent speech production. Biol. Cybern. 1994, 72:43-53.
42. Guenther F.H. Speech sound acquisition, coarticulation, and rate effects in a neural network model of speech production. Psychol. Rev. 1995, 102:594-621.
43. Guenther F.H., Hampson M., Johnson D. A theoretical investigation of reference frames for the planning of speech movements. Psychol. Rev. 1998, 105(4):611-633.
44. Guenther F.H., Nieto-Castanon A., Ghosh S.S., Tourville J.A. Representation of sound categories in auditory cortical maps. J. Speech Lang. Hear. R 2004, 47(1):46-57.
45. Guenther F.H., Ghosh S.S., Tourville J.A. Neural modeling and imaging of the cortical interactions underlying syllable production. Brain Lang. 2006, 96:280-301.
46. Hashimoto Y., Sakai K.L. Brain activations during conscious self-monitoring of speech production with delayed auditory feedback: an fMRI study. Hum. Brain Mapp. 2003, 20:22-28.
47. Heeger D.J., Huk A.C., Geisler W.S., Albrecht D.G. Spikes versus BOLD: what does neuroimaging tell us about neuronal activity. Nat. Neurosci. 2000, 3(7):631-633.
48. Hickok G., Poeppel D. Towards a functional neuroanatomy of speech perception. Trends Cogn. Sci. 2000, 4:131-138.
49. Hickok G., Poeppel D. Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language. Cognition 2004, 92:67-99.
50. Houde J.F., Jordan M.I. Sensorimotor adaptation in speech production. Science 1998, 279(5354):1213-1216.
51. Houde J.F., Nagarajan S.S. How is auditory feedback processed during speaking?. Program of the 154th Meeting of the Acoustical Society of America, Journal of the Acoustical Society of America 2007, vol. 122(5, Pt. 2):3087. New Orleans, Louisiana.
52. Indefrey P., Levelt W.J. The spatial and temporal signatures of word production components. Cognition 2004, 92(1-2):101-144.
53. Johnson M.D., Ojemann G.A. The role of the human thalamus in language and memory: evidence from electrophysiological studies. Brain Cogn. 2000, 42(2):218-230.
54. Jones J.A., Munhall K.G. Remapping auditory-motor representations in voice production. Curr. Biol. 2005, 15(19):1768-1772.
55. Kelso J.A.S., Tuller B. 'Compensatory articulation' under conditions of reduced afferent information: a dynamic formulation. J. Speech Lang. Hear. Res. 1983, 26:217-224.
56. Levelt W.J., Wheeldon L. Do speakers have access to a mental syllabary. Cognition 1994, 50:239-269.
57. Levelt W.J., Roelofs A., Meyer A.S. A theory of lexical access in speech production. Behav. Brain Sci. 1999, 22(1):1-38.
58. Lichtheim L. On aphasia. Brain 1885, 7:433-484.
59. Lindblom B., Lubker J., Gay T. Formant frequencies of some fixed-mandible vowels and a model of speech motor programming by predictive simulation. J. Phonetics 1979, 7:147-161.
60. Logothetis N.K., Pauls J., Augath M., Trinath T., Oeltermann A. Neurophysiological investigation of the basis of the fMRI signal. Nature 2001, 412:150-157.
61. Lotze M., Erb M., Flor H., Huelsmann E., Godde B., Grodd W. fMRI evaluation of somatotopic representation in human primary motor cortex. NeuroImage 2000, 11(5 Pt. 1):473-581.
62. Lotze M., Seggewies G., Erb M., Grodd W., Birbaumer N. The representation of articulation in the primary sensorimotor cortex. Neuroreport 2000, 11(13):2985-2989.
63. MacNeilage P.F., Rootes T.P., Chase R.A. Speech Production and perception in a patient with severe impairment of somesthetic perception and motor control. J. Speech Lang. Hear. Res. 1967, 10(3):440-467.
64. Maeda S. Compensatory articulation during speech: evidence from the analysis and synthesis of vocal tract shapes using an articulatory model. Speech Production and Speech Modeling 1990, 131-149. Kluwer Academic Publishers, Boston. W.J. Hardcastle, A. Marchal (Eds.).
65. Mathiesen C., Caesar K., Akgoren N., Lauritzen M. Modification of activity-dependent increases of cerebral blood flow in rat cerebellum. J. Physiol. 1998, 560:181-189.
66. Max L., Guenther F.H., Gracco V.L., Ghosh S.S., Wallace M.E. Unstable or insufficiently activated internal models and feedback-biased motor control as sources of dysfluency: a theoretical model of stuttering. CICSD 2004, 31:105-122.
67. Mazziotta J., Toga A., Evans A., Fox P., Lancaster J., Zilles K., Woods R., Paus T., Simpson G., Pike B., Holmes C., Collins L., Thompson P., MacDonald D., Iacoboni M., Schormann T., Amunts K., Palomero-Gallagher N., Geyer S., Parsons L., Narr K., Kabani N., Le Goualher G., Feidler J., Smith K., Boomsma D., Hulshoff Pol H., Cannon T., Kawashima R., Mazoyer B. A four-dimensional probabilistic atlas of the human brain. J. Am. Med. Inform. Assoc. 2001, 8:401-430.
68. McCarthy G., Allison T., Spencer D.D. Localization of the face area of human sensorimotor cortex by intracranial recording of somatosensory evoked potentials. J. Neurosurg. 1993, 79(6):874-884.
69. McIntosh A.R., Gonzalez-Lima F. Structural equation modeling and its application to network analysis in functional imaging. Hum. Brain Mapp. 1994, 2:2-22.
70. McKeown M.J., Makeig S., Brown G.G., Jung T.P., Kindermann S.S., Bell A.J., Sejnowski T.J. Analysis of fMRI data by blind separation into independent spatial components. Hum. Brain Mapp. 1998, 6:160-188.
71. McNeil M.R., Robin D.A., Schmidt R.A. Apraxia of speech: Definition and differential diagnosis 2007, Thieme, New York. 2nd ed.
72. Morosan P., Rademacher J., Schleicher A., Amunts K., Schormann T., Zilles K. Human primary auditory cortex: cytoarchitectonic subdivisions and mapping into a spatial reference system. NeuroImage 2001, 13(4):684-701.
73. Mukamel R., Gelbard H., Arieli A., Hasson U., Fried I., Malach R. Coupling between neuronal firing, field potentials, and fMRI in human auditory cortex. Science 2005, 309:951-954.
74. Nasir S.M., Ostry D.J. Somatosensory precision in speech production. Curr. Biol. 2006, 16:1918-1923.
75. Nieto-Castanon A., Ghosh S.S., Tourville J.A., Guenther F.H. Region of interest based analysis of functional imaging data. NeuroImage 2003, 19:1303-1316.
76. Nieto-Castanon A., Guenther F.H., Perkell J.S., Curtin H.D. A modeling investigation of articulatory variability and acoustic stability during American English /r/ production. J. Acoust. Soc. Am. 2005, 117(5):3196-3212.
77. Olthoff A., Baudewig J., Kruse E., Dechent P. Cortical sensorimotor control in vocalization: a functional magnetic resonance imaging study. Laryngoscope 2008, 118(11):2091-2096.
78. Penfield W., Rasmussen T. The Cerebral Cortex of Man. A Clinical Study of Localization of Function 1950, Macmillan, New York.
79. Penfield W., Roberts L. Speech and Brain Mechanisms 1959, Princeton University Press, Princeton.
80. Penny W.D., Stephan K.E., Mechelli A., Friston K.J. Modelling functional integration: a comparison of structural equation and dynamic causal models. NeuroImage 2004, 23:S264-S274.
81. Pulvermüller F. Brain mechanisms linking language and action. Nat. Rev., Neurosci. 2005, 6(7):576-582.
82. Purcell D.W., Munhall K.G. Adaptive control of vowel formant frequency: evidence from real-time formant manipulation. J. Acoust. Soc. Am. 2006, 120:966-977.
83. Raichle M.E., Mintun M.A. Brain work and brain imaging. Annu. Rev. Neurosci. 2006, 3:716-723.
84. Rees G., Friston K., Koch C. A direct quantitative relationship between the functional properties of human and macaque V5. Nat. Neurosci. 2000, 3(7):716-723.
85. Riecker A., Mathiak K., Wildgruber D., Erb M., Hertrich I., Grodd W., Ackermann H. fMRI reveals two distinct cerebral networks subserving speech motor control. Neurology 2005, 64:700-706.
86. Rivier F., Clarke S. Cytochrome oxidase, acetylcholinesterase, and NADPHdiaphorase staining in human supratemporal and insular cortex: evidence for multiple auditory areas. NeuroImage 1997, 6(4):288-304.
87. Rizzolatti G., Fadiga L., Gallese V., Fogassi L. Premotor cortex and the recognition of motor actions. Cogn. Brain Res. 1996, 3:131-141.
88. Robin D.A., Guenther F.H., Narayana S., Jacks A., Tourville J.A., Ramage A.E., Lancaster J.L., Franklin C., Ghosh S.Fox A transcranial magnetic stimulation virtual lesion study of speech. Proceedings of the Conference on Motor Speech, Monterey, California P.T., 2008.
89. Scott S.K., Blank C.C., Rosen S., Wise R.J. Identification of a pathway for intelligible speech in the left temporal lobe. Brain 2000, 123:2400-2406.
90. Sidtis J.J., Van Lancker-Sidtis D. A neurobehavioral approach to dysprosody. Semin. Speech Lang. 2003, 24:93-105.
91. Terband, H., Maassen, B, Guenther, F.H., Brumberg, J., 2009. Computational neural modeling of speech motor control in childhood apraxia of speech. J. Speech Lang. Hear. R. 52, 1595-1609.
92. Tourville, J.A., Guenther, F.H., 2003. A cortical and cerebellar parcellation system for speech studies. Tech Rep CAS/CNS-03-022, Boston University, Boston, MA.
93. Tourville J.A., Reilly K.J., Guenther F.H. Neural mechanisms underlying auditory feedback control of speech. NeuroImage 2008, 39:1429-1443.
94. Toyomura A., Koyama S., Miyamaoto T., Terao A., Omori T., Murohashi H., Kuriki S. Neural correlates of auditory feedback control in human. Neuroscience 2007, 146:499-503.
95. Tremblay S., Shiller D.M., Ostry D.J. Somatosensory basis of speech production. Nature 2003, 423:866-869.
96. Van Buren J.M. Confusion and disturbance of speech from stimulation in the vicinity of the head of the caudate nucleus. J. Neurosurg. 1963, 20:148-157.
97. Viswanathan A., Freeman R.D. Neurometabolic coupling in cerebral cortex reflects synaptic more than spiking activity. Nat. Neurosci. 2007, 10:1308-1312.
98. Wernicke C. Der aphasische Symptomencomplex: Eine psychologische Studie auf anatomischer Basis 1874, Kohn und Weigert, Breslau.
99. Yang Y., Engelien A., Engelien W., Xu S., Stern E., Silbersweig D.A. A silent event-related functional MRI technique for brain activation studies without interference of scanner acoustic noise. Magn. Reson. Med. 2000, 43:185-190.