Interplay between acoustic/phonetic and semantic processes during spoken sentence comprehension: An ERP study

Brain and Language

Volumn 116, Issue 2, 2011, Pages 51-63

  Boulenger, Véronique ^a   Hoen, Michel ^b   Jacquier, Caroline ^a   Meunier, Fanny ^a  

^a Institut des Sciences de l'Homme   (France)

^b UNIVERSITÉ LYON 1   (France)

Author keywords

Connected speech; Degraded speech; Event related potentials; Mismatch Negativity (MMN); N400; Sentence comprehension

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; COMPREHENSION; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; EVENT RELATED POTENTIAL; HUMAN; HUMAN EXPERIMENT; MISMATCH NEGATIVITY; NORMAL HUMAN; PHONETICS; SEMANTIC MEMORY; SEMANTICS; SPEECH; STIMULUS RESPONSE; TASK PERFORMANCE;

EID: 79251596601     PISSN: 0093934X     EISSN: 10902155     Source Type: Journal    
DOI: 10.1016/j.bandl.2010.09.011     Document Type: Article

References (86)

1. Aaltonen O., Niemi P., Nyrke T., Tuhkanen J.M. Event related brain potentials and the perception of a phonetic continuum. Biological Psychology 1987, 24:197-207.
2. Agus T.R., Thorpe S.J., Pressnitzer D. Rapid formation of robust auditory memories: Insights from noise. Neuron 2010, 66:610-618.
3. Alho K. Cerebral generators of mismatch negativity (MMN) and its magnetic counterpart (MMNm) elicited by sound changes. Ear and Hearing 1995, 16(1):38-51.
4. Alho K., Paavilainen P., Reinikainen K., Sams M., Näätänen R. Separability of different negative components of the event-related potential associated with auditory stimulus processing. Psychophysiology 1986, 23:613-623.
5. Allen M., Badecker W., Osterhout L. Morphological analysis in sentence processing: An ERP study. Language and Cognitive Processes 2003, 18:405-430.
6. Amenedo E., Escera C. The accuracy of sound duration representation in the human brain determines the accuracy of behavioural perception. European Journal of Neuroscience 2000, 12:2570-2574.
7. Aydelott J., Dick F., Mills D.L. Effects of acoustic distortion and semantic context on event-related potentials to spoken words. Psychophysiology 2006, 43(5):454-464.
8. Besson M., Faita F., Czternasty C., Kutas M. What's in a pause: Event-related potential analysis of temporal disruptions in written and spoken sentences. Biological Psychology 1997, 46:3-23.
9. Brown C., Hagoort P. The processing nature of the N400: Evidence from masked priming. Journal of Cognitive Neuroscience 1993, 5:34-44.
10. Corbetta M., Patel G., Shulman G.L. The reorienting system of the human brain: From environment to theory of mind. Neuron 2008, 58:306-324.
11. Davis M.H., Johnsrude I.S. Hearing speech sounds: Top-down influences on the interface between audition and speech perception. Hearing Research 2007, 229(1-2):132-147.
12. Dehaene-Lambertz G. Electrophysiological correlates of categorical phoneme perception in adults. NeuroReport 1997, 8:919-924.
13. DeLong K.A., Urbach T.P., Kutas M. Probabilistic word pre-activation during language comprehension inferred from electrical brain activity. Nature Neuroscience 2005, 8(8):1117-1121.
14. Desimone R., Duncan J. Neural mechanisms of selective visual attention. Annual Review of Neuroscience 1995, 18:193-222.
15. DiGiovanni J.J., Schlauch R.S. Mechanisms responsible for differences in perceived duration for rising-intensity and falling-intensity sounds. Ecological Psychology 2007, 19(3):239-264.
16. Federmeier K.D. Thinking ahead: The role and roots of prediction in language comprehension. Psychophysiology 2007, 44:491-505.
17. Federmeier K.D., Wlotko E.W., De Ochoa-Dewald E., Kutas M. Multiple effects of sentential constraint on word processing. Brain Research 2007, 1146:75-84.
18. Friederici A.D. Towards a neural basis of auditory sentence processing. Trends in Cognitive Sciences 2002, 6(2):78-84.
19. Friederici A.D., Rüschemeyer S.A., Hahne A., Fiebach C.J. The role of left inferior frontal and superior temporal cortex in sentence comprehension: Localizing syntactic and semantic processes. Cerebral Cortex 2003, 13:170-177.
20. Garrido M.I., Kikner J.M., Stephan K.E., Friston K.J. The mismatch negativity: A review of underlying mechanisms. Clinical Neurophysiology 2009, 120:453-463.
21. Giard M., Lavikainen J., Reinikainen K., Perrin F., Bertrand O., Pernier J., et al. Separate representation of stimulus frequency, intensity, and duration in auditory sensory memory: An event-related potential and dipole-model analysis. Journal of Cognitive Neuroscience 1995, 7:133-143.
22. Giard M.H., Perrin F., Pernier J., Bouchet P. Brain generators implicated in the processing of auditory stimulus deviance: A topographic event-related potential study. Psychophysiology 1990, 27:627-640.
23. Greenhouse S.W., Geisser S. On methods in the analysis of profile data. Psychometrika 1959, 24:95-111.
24. Hahne A., Schroger E., Friederici A.D. Segregating early physical and syntactic processes in auditory sentence comprehension. Neuroreport 2002, 13:305-309.
25. Horvath J., Czigler I., Jacobsen T., Maess B., Schröger E., Winkler I. MMN or no MMN: No magnitude of deviance effect on the MMN amplitude. Psychophysiology 2008, 45(1):60-69.
26. Kiss M., Cristescu T., Fink M., Wittmann M. Auditory language comprehension of temporally reversed speech signals in native and non-native speakers. Acta Neurobiologicae Experimentalis 2008, 68:204-213.
27. Korpilahti P., Krause C.M., Holopainen I., Lang A.H. Early and late mismatch negativity elicited by words and speech-like stimuli in children. Brain and Language 2001, 76:332-339.
28. Kotz S.A., Schwartze M., Schmidt-Kassow M. Non-motor basal ganglia functions: A review and proposal for a model of sensory predictability in auditory language perception. Cortex 2009.
29. Kozou H., Kujala T., Shtyrov Y., Toppila E., Starck J., Alku P., et al. The effect of different noise types on the speech and non-speech elicited mismatch negativity. Hearing Research 2005, 199:31-39.
30. Kraus N., McGee T., Sharma A., Carrell T., Nicol T. Mismatch negativity event-related potential elicited by speech stimuli. Ear and Hearing 1992, 13:158-164.
31. Kujala A., Alho K., Valle S., Sivonen P., Ilmoniemi R.J., Alku P., et al. Context modulates processing of speech sounds in the right auditory cortex of human subjects. Neuroscience Letters 2002, 331:91-94.
32. Kujala T., Kallio J., Tervaniemi M., Näätänen R. The mismatch negativity as an index of temporal processing in audition. Clinical Neurophysiology 2001, 112(9):1712-1719.
33. Kujala T., Tervaniemi M., Schroger E. The mismatch negativity in cognitive and clinical neuroscience: Theoretical and methodological cnosiderations. Biological Psychology 2007, 74:1-19.
34. Kutas M., Federmeier K.D. Electrophysiology reveals semantic memory use in language comprehension. Trends in Cognitive Sciences 2000, 4(12):463-470.
35. Kutas M., Federmeier K.D. Event-related brain potential (ERP) studies of sentence processing. Oxford handbook of psycholinguistics 2007, 385-406. Oxford University Press, Oxford. G. Gaskell (Ed.).
36. Kutas M., Hillyard S.A. Brain potentials during reading reflect word expectancy and semantic association. Nature 1984, 307:161-163.
37. Lau E.F., Phillips C., Poeppel D. A cortical network for semantic: (De)constructing the N400. Nature Reviews Neuroscience 2008, 9(12):920-933.
38. Lau E., Stroud C., Plesch S., Phillips C. The role of structural prediction in rapid syntactic analysis. Brain and Language 2006, 98:74-88.
39. McCarthy G., Nobre A.C., Bentin S., Spencer D.D. Language-related field potentials in the anterior medial temporal lobe: I. Intracranial distribution and neural generators. Journal of Neuroscience 1995, 15(2):1080-1089.
40. Menning H., Zwitserlood P., Schoning S., Hihn H., Bolte J., Dobel C., et al. Pre-attentive detection of syntactic and semantic errors. NeuroReport 2005, 16:77-80.
41. Muller-Gass A., Marcoux A., Logan J., Campbell K. The intensity of masking noise affects the mismatch negativity to speech sounds in human subjects. Neuroscience Letters 2001, 299:197-200.
42. Näätänen R. The perception of speech sounds by the human brain as reflected by the mismatch negativity (MMN) and its magnetic equivalent (MMNm). Psychophysiology 2001, 38:1-21.
43. Näätänen R., Alho K. Mismatch negativity - A unique measure of sensory processing in audition. International Journal of Neuroscience 1995, 80:317-337.
44. Näätänen R., Astikainen P., Ruusuvirta T., Huotilainen M. Automatic auditory intelligence: An expression of the sensory-cognitive core of cognitive processes. Brain Research Review 2010, 64(1):123-136.
45. Näätänen R., Gaillard A.W.K., Mäntysalo S. Early selective attention effect on evoked potential reinterpreted. Acta Psychologica 1978, 42:313-329.
46. New B., Pallier C., Brysbaert M., Ferrand L. Lexique 2: A new French lexical database. Behavior Research Methods, Instruments and Computers 2004, 36(3):516-524.
47. Nobre A.C., McCarthy G. Language-related field potentials in the anterior-medial temporal lobe. 2. Effects of word type and semantic priming. Journal of Neuroscience 1995, 15(2):1090-1098.
48. Obleser J., Kotz S.A. Expectancy constraints in degraded speech modulate the language comprehension network. Cerebral Cortex 2010, 20(3):633-640.
49. Obleser J., Wise R.J., Dresner M.A., Scott S.K. Functional integration across brain regions improves speech perception under adverse listening conditions. Journal of Neuroscience 2007, 27:2283-2289.
50. Oldfield R.C. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 1971, 9:97-113.
51. Opitz B., Friederici A.D. Interactions of the hippocamapl system and the prefrontal cortex in learning language-like rules. Neuroimage 2003, 19:1730-1737.
52. Paavilainen P., Jaramillo M., Näätänen R., Winkler I. Neuronal populations in the human brain extracting invariant relationships from acoustic variance. Neuroscience Letters 1999, 265(3):179-182.
53. Paavilainen P., Simola J., Jaramillo M., Näätänen R., Winkler I. Preattentive extraction of abstract feature conjunctions from auditory stimulation as reflected by the mismatch negativity (MMN). Psychophysiology 2001, 38:359-365.
54. Pakarinen S., Huotilainen M., Näätänen R. The mismatch negativity (MMN) with no standard stimulus. Clinical Neurophysiology 2010, 121:1043-1050.
55. Pakarinen S., Takegata R., Rinne T., Huotilainen M., Näätänen R. Measurement of extensive auditory discrimination profiles using the mismatch negativity (MMN) of the auditory event-related potential (ERP). Clinical Neurophysiology 2007, 118(1):177-185.
56. Pellegrino, F., Ferragne, E., & Meunier, F. (2010). A speech oddity: Phonetic transcription of reversed speech. In Proceedings of Interspeech.
57. Pulvermüller F., Shtyrov Y. Automatic processing of grammar in the human brain as revealed by the mismatch negativity. Neuroimage 2003, 20:159-172.
58. Pulvermüller F., Shtyrov Y. Language outside the focus of attention: The mismatch negativity as a tool for studying higher cognitive processes. Progress in Neurobiology 2006, 79(1):49-71.
59. Rinne T., Alho K., Ilmoniemi R.J., Virtanen J., Näätänen R. Separate time behaviors of the temporal and frontal mismatch negativity sources. Neuroimage 2000, 12:14-19.
60. Ritter W., Gomes H., Cowan N., Sussman E., Vaughan H.G. Reactivation of a dormant representation of an auditory stimulus feature. Journal of Cognitive Neuroscience 1998, 10:605-614.
61. Rothermich K., Schmidt-Kassow M., Schwartze M., Kotz S.A. Event-related potential responses to metric violations: Rules versus meaning. NeuroReport 2010, 21(8):580-584.
62. Rugg M.D., Coles M.G.H. Electrophysiology of mind-event-related brain potentials and cognition 1995, Oxford University Press, Oxford.
63. Saarinen J., Paavilainen P., Schröger E., Tervaniemi M., Näätänen R. Representation of abstract attributes of auditory stimuli in the human brain. NeuroReport 1992, 3:1149-1151.
64. Saberi K., Perrott D.R. Cognitive restoration of reversed speech. Nature 1999, 398:760.
65. Scherg M., Vajsar J., Picton T. A source analysis of the late human auditory evoked potentials. Journal of Cognitive Neuroscience 1989, 1:336-355.
66. Schmidt-Kassow M., Kotz S.A. Attention and perceptual regularity in speech. NeuroReport 2009, 20:1643-1647.
67. Shahin A.J., Bishop C.W., Miller L.M. Neural mechanisms for illusory filling-in of degraded speech. Neuroimage 2009, 44:1133-1143.
68. Sharp, D. J., Turkheimer, F. E., Bose, S. K., Scott, S. K., & Wise, R. J. (2010). Increased frontoparietal integration after stroke and cognitive recovery. Annals of Neurology, PMID: 20687116.
69. Shestakova A., Brattico E., Huotilainen M., Galunov V., Soloviev A., Sams M., et al. Abstract phoneme representations in the left temporal cortex: Magnetic mismatch negativity study. NeuroReport 2002, 13(14):1813-1816.
70. Shtyrov Y., Hauk O., Pulvermüller F. Distributed neuronal networks for encoding category-specific semantic information: The mismatch negativity to action words. European Journal of Neuroscience 2004, 19:1083-1092.
71. Shtyrov Y., Kujala T., Ahveninen J., Tervaniemi M., Alku P., Ilmoniemi R.J., et al. Background acoustic noise and the hemispheric lateralization of speech processing in the human brain: Magnetic mismatch negativity study. Neuroscience Letters 1998, 251(2):141-144.
72. Shtyrov Y., Kujala T., Ilmoniemi R.J., Näätänen R. Noise affects speech-signal processing differently in the cerebral hemispheres. NeuroReport 1999, 10(10):2189-2192.
73. Shtyrov Y., Pulvermuller F. Neurophysiological evidence of memory traces for words in the human brain. NeuroReport 2002, 13:521-525.
74. Shtyrov Y., Pulvermüller F., Näätänen R., Ilmoniemi R.J. Grammar processing outside the focus of attention: An MEG study. Journal of Cognitive Neuroscience 2003, 15:1195-1206.
75. Sivonen P., Maess B., Lattner S., Friederici A.D. Phonemic restoration in a sentence context: Evidence from early and late ERP effects. Brain Research 2006, 1121:177-189.
76. Stecker G.C., Hafter E.R. An effect of temporal asymmetry on loudness. Journal of the Acoustical Society of America 2000, 107(6):3358-3368.
77. Sussman E., Ritter W., Vaughan H.G. Predictability of stimulus deviance and the mismatch negativity. NeuroReport 1998, 9:4167-4170.
78. Takegata R., Paavilainen P., Näätänen R., Winkler I. Independent processing of changes in auditory single features and feature conjunctions in humans as indexed by the mismatch negativity. Neuroscience Letter 1999, 26:109-112.
79. Taylor W.L. " Cloze" procedure: A new tool for measuring readability. Journalism Quarterly 1953, 30:415-433.
80. Van Berkum J.J.A., Brown C.M., Zwitserlood P., Kooijman V., Hagoort P. Anticipating upcoming words: Evidence from ERPs and reading times. Journal of Experimental Psychology: Learning, Memory and Cognition 2005, 31(3):443-467.
81. Van Petten C., Coulson S., Rubin S., Plante E., Parks M. Time course of word identification and semantic integration in spoken language. Journal of Experimental Psychology: Learning, Memory and Cognition 1999, 25(2):394-417.
82. Van Petten C., Kutas M. Interactions between sentence context and word frequency in event-related brain potentials. Memory and Cognition 1990, 18:380-393.
83. Van Petten C., Luka B.J. Neural localization of semantic context effects in electromagnetic and hemodynamic studies. Brain and Language 2006, 97(3):279-293.
84. Winkler I. Interpreting the mismatch negativity. Journal of Psychophysiology 2007, 21(3-4):147-163.
85. Winkler I., Cowan N., Csépe V., Czigler I., Näätänen R. Interactions between transient and long-term auditory memory as reflected by the mismatch negativity. Journal of Cognitive Neuroscience 1996, 8:403-415.
86. Ylinen S., Uther M., Latvala A., Vepsalainen S., Iverson P., Akahane-Yamada R., Naatanen R. Training the brain to weight speech cues differently: a study of finnish second-language users of english. Journal of Cognitive Neuroscience 2009, 22(6):1319-1332.