Prediction in the service of comprehension: Modulated early brain responses to omitted speech segments

Cortex

Volumn 53, Issue 1, 2014, Pages 9-26

  Bendixen, Alexandra ^a,b   Scharinger, Mathias ^c   Strauß, Antje ^c   Obleser, Jonas ^c  

^a UNIVERSITY OF LEIPZIG   (Germany)

^b UNIVERSITY OF OLDENBURG   (Germany)

^c MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

Author keywords

Auditory processing; Omission mismatch negativity (MMN); Predictive coding; Semantic expectation; Source localization

Indexed keywords

ADULT; ANGULAR GYRUS; ARTICLE; AUDITORY CORTEX; BRAIN ELECTROPHYSIOLOGY; BRAIN FUNCTION; COMPREHENSION; CONSONANT; ELECTROENCEPHALOGRAPHY; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MISMATCH NEGATIVITY; NORMAL HUMAN; OMISSION MISMATCH NEGATIVITY; OMITTED SPEECH SEGMENT PREDICTION; PREDICTION; SPEECH ANALYSIS; SUPERIOR TEMPORAL GYRUS; WORD RECOGNITION;

AUDITORY PROCESSING; OMISSION MISMATCH NEGATIVITY (MMN); PREDICTIVE CODING; SEMANTIC EXPECTATION; SOURCE LOCALIZATION;

ACOUSTIC STIMULATION; ADULT; ATTENTION; BRAIN; COMPREHENSION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; PSYCHOMOTOR PERFORMANCE; SEMANTICS; SPEECH PERCEPTION; YOUNG ADULT;

EID: 84896285538     PISSN: 00109452     EISSN: 19738102     Source Type: Journal    
DOI: 10.1016/j.cortex.2014.01.001     Document Type: Article

References (115)

1. Arnal L.H., Giraud A.-L. Cortical oscillations and sensory predictions. Trends in Cognitive Sciences 2012, 16(7):390-398.
2. Baldeweg T. Repetition effects to sounds: evidence for predictive coding in the auditory system. Trends in Cognitive Sciences 2006, 10(3):93-94.
3. Baldeweg T. ERP repetition effects and mismatch negativity generation: a predictive coding perspective. Journal of Psychophysiology 2007, 21(3-4):204-213.
4. Bendixen A., Roeber U., Schröger E. Regularity extraction and application in dynamic auditory stimulus sequences. Journal of Cognitive Neuroscience 2007, 19(10):1664-1677.
5. Bendixen A., SanMiguel I., Schröger E. Early electrophysiological indicators for predictive processing in audition: a review. International Journal of Psychophysiology 2012, 83(2):120-131.
6. Bendixen A., Schröger E., Winkler I. I heard that coming: event-related potential evidence for stimulus-driven prediction in the auditory system. Journal of Neuroscience 2009, 29(26):8447-8451.
7. Besson M., Faita F., Czternasty C., Kutas M. What's in a pause: event-related potential analysis of temporal disruptions in written and spoken sentences. Biological Psychology 1997, 46(1):3-23.
8. Bosch-Bayard J., Valdés-Sosa P., Virues-Alba T., Aubert-Vázquez E., John E.R., Harmony T., et al. 3D statistical parametric mapping of EEG source spectra by means of variable resolution electromagnetic tomography (VARETA). Clinical Electroencephalography 2001, 32(2):47-61.
9. Boulenger V., Hoen M., Jacquier C., Meunier F. Interplay between acoustic/phonetic and semantic processes during spoken sentence comprehension: an ERP study. Brain and Language 2011, 116(2):51-63.
10. van den Brink D., Brown C.M., Hagoort P. Electrophysiological evidence for early contextual influences during spoken-word recognition: N200 versus N400 effects. Journal of Cognitive Neuroscience 2001, 13(7):967-985.
11. Chatrian G.E., Lettich E., Nelson P.L. Ten percent electrode system for topographic studies of spontaneous and evoked EEG activities. American Journal of EEG Technology 1985, 25:83-92.
12. Connolly J.F., Phillips N.A. Event-related potential components reflect phonological and semantic processing of the terminal word of spoken sentences. Journal of Cognitive Neuroscience 1994, 6(3):256-266.
13. Cornell S.A., Lahiri A., Eulitz C. "What you encode is not necessarily what you store": evidence for sparse feature representations from mismatch negativity. Brain Research 2011, 1394:79-89.
14. Cowan N. On short and long auditory stores. Psychological Bulletin 1984, 96(2):341-370.
15. Cowan N., Winkler I., Teder W., Näätänen R. Memory prerequisites of mismatch negativity in the auditory event-related potential (ERP). Journal of Experimental Psychology: Learning, Memory, and Cognition 1993, 19(4):909-921.
16. Davenport T., Coulson S. Predictability and novelty in literal language comprehension: an ERP study. Brain Research 2011, 1418:70-82.
17. DeLong K.A., Urbach T.P., Groppe D.M., Kutas M. Overlapping dual ERP responses to low cloze probability sentence continuations. Psychophysiology 2011, 48(9):1203-1207.
18. Delorme A., Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods 2004, 134(1):9-21.
19. Eulitz C., Lahiri A. Neurobiological evidence for abstract phonological representations in the mental lexicon during speech recognition. Journal of Cognitive Neuroscience 2004, 16(4):577-583.
20. Evans A.C., Collins D.L., Mills S.R., Brown E.D., Kelly R.L., Peters T.M. 3D statistical neuroanatomical models from 305 MRI volumes. Nuclear science symposium and medical imaging conference, 1993 IEEE conference record 1993, Vol. 3:1813-1817.
21. Federmeier K.D. Thinking ahead: the role and roots of prediction in language comprehension. Psychophysiology 2007, 44(4):491-505.
22. Federmeier K.D., Wlotko E.W., De Ochoa-Dewald E., Kutas M. Multiple effects of sentential constraint on word processing. Brain Research 2007, 1146:75-84.
23. Folstein J.R., Van Petten C. Influence of cognitive control and mismatch on the N2 component of the ERP: a review. Psychophysiology 2008, 45(1):152-170.
24. Friston K. A theory of cortical responses. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 2005, 360(1456):815-836.
25. Gagnepain P., Henson R.N., Davis M.H. Temporal predictive codes for spoken words in auditory cortex. Current Biology 2012, 22(7):615-621.
26. Garrido M.I., Friston K.J., Kiebel S.J., Stephan K.E., Baldeweg T., Kilner J.M. The functional anatomy of the MMN: a DCM study of the roving paradigm. NeuroImage 2008, 42(2):936-944.
27. Garrido M.I., Kilner J.M., Stephan K.E., Friston K.J. The mismatch negativity: a review of underlying mechanisms. Clinical Neurophysiology 2009, 120(3):453-463.
28. Grimm S., Schröger E. The processing of frequency deviations within sounds: evidence for the predictive nature of the mismatch negativity (MMN) system. Restorative Neurology and Neuroscience 2007, 25(3-4):241-249.
29. Groppe D.M., Choi M., Huang T., Schilz J., Topkins B., Urbach T.P., et al. The phonemic restoration effect reveals pre-N400 effect of supportive sentence context in speech perception. Brain Research 2010, 1361:54-66.
30. Haenschel C., Vernon D.J., Dwivedi P., Gruzelier J.H., Baldeweg T. Event-related brain potential correlates of human auditory sensory memory-trace formation. Journal of Neuroscience 2005, 25(45):10494-10501.
31. Hasting A.S., Kotz S.A., Friederici A.D. Setting the stage for automatic syntax processing: the mismatch negativity as an indicator of syntactic priming. Journal of Cognitive Neuroscience 2007, 19(3):386-400.
32. Hasting A.S., Winkler I., Kotz S.A. Early differential processing of verbs and nouns in the human brain as indexed by event-related brain potentials. European Journal of Neuroscience 2008, 27(6):1561-1565.
33. Herrmann B., Maess B., Hasting A.S., Friederici A.D. Localization of the syntactic mismatch negativity in the temporal cortex: an MEG study. NeuroImage 2009, 48(3):590-600.
34. Horváth J., Czigler I., Winkler I., Teder-Salejärvi W.A. The temporal window of integration in elderly and young adults. Neurobiology of Aging 2007, 28(6):964-975.
35. Horváth J., Müller D., Weise A., Schröger E. Omission mismatch negativity builds up late. NeuroReport 2010, 21(7):537-541.
36. Hughes H.C., Darcey T.M., Barkan H.I., Williamson P.D., Roberts D.W., Aslin C.H. Responses of human auditory association cortex to the omission of an expected acoustic event. NeuroImage 2001, 13(6):1073-1089.
37. Jääskeläinen I.P., Ahveninen J., Bonmassar G., Dale A.M., Ilmoniemi R.J., Levänen S., et al. Human posterior auditory cortex gates novel sounds to consciousness. Proceedings of the National Academy of Sciences of the United States of America 2004, 101(17):6809-6814.
38. Jacobsen T., Horenkamp T., Schröger E. Preattentive memory-based comparison of sound intensity. Audiology and Neurotology 2003, 8(6):338-346.
39. Jacobsen T., Schröger E. Is there pre-attentive memory-based comparison of pitch?. Psychophysiology 2001, 38(4):723-727.
40. Janata P. Brain electrical activity evoked by mental formation of auditory expectations and images. Brain Topography 2001, 13(3):169-193.
41. Jomori I., Hoshiyama M. Auditory brain response modified by temporal deviation of language rhythm: an auditory event-related potential study. Neuroscience Research 2009, 65(2):187-193.
42. Kappenman E.S., Luck S.J. The effects of electrode impedance on data quality and statistical significance in ERP recordings. Psychophysiology 2010, 47(5):888-904.
43. Kraemer D.J.M., Macrae C.N., Green A.E., Kelley W.M. Musical imagery: sound of silence activates auditory cortex. Nature 2005, 434(7030):158.
44. Kujala T., Tervaniemi M., Schröger E. The mismatch negativity in cognitive and clinical neuroscience: theoretical and methodological considerations. Biological Psychology 2007, 74(1):1-19.
45. Kutas M., Federmeier K.D. Electrophysiology reveals semantic memory use in language comprehension. Trends in Cognitive Sciences 2000, 4(12):463-470.
46. Kutas M., Federmeier K.D. Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). Annual Review of Psychology 2011, 62:621-647.
47. Lau E.F., Phillips C., Poeppel D. A cortical network for semantics: (de)constructing the N400. Nature Reviews Neuroscience 2008, 9(12):920-933.
48. Lau E., Stroud C., Plesch S., Phillips C. The role of structural prediction in rapid syntactic analysis. Brain and Language 2006, 98(1):74-88.
49. Laufer I., Negishi M., Constable R.T. Comparator and non-comparator mechanisms of change detection in the context of speech - an ERP study. NeuroImage 2009, 44(2):546-562.
50. Leaver A.M., Van Lare J., Zielinski B., Halpern A.R., Rauschecker J.P. Brain activation during anticipation of sound sequences. Journal of Neuroscience 2009, 29(8):2477-2485.
51. MacGregor L.J., Corley M., Donaldson D.I. Listening to the sound of silence: disfluent silent pauses in speech have consequences for listeners. Neuropsychologia 2010, 48(14):3982-3992.
52. Mattys S.L., Pleydell-Pearce C.W., Melhorn J.F., Whitecross S.E. Detecting silent pauses in speech - a new tool for measuring on-line lexical and semantic processing. Psychological Science 2005, 16(12):958-964.
53. May P.J.C., Tiitinen H. Mismatch negativity (MMN), the deviance-elicited auditory deflection, explained. Psychophysiology 2010, 47(1):66-122.
54. McGettigan C., Scott S.K. Cortical asymmetries in speech perception: what's wrong, what's right and what's left?. Trends in Cognitive Sciences 2012, 16(5):269-276.
55. Michel C.M., Murray M.M., Lantz G., Gonzalez S., Spinelli L., Grave de Peralta R. EEG source imaging. Clinical Neurophysiology 2004, 115(10):2195-2222.
56. Muller-Gass A., Campbell K. Event-related potential measures of the inhibition of information processing: I. Selective attention in the waking state. International Journal of Psychophysiology 2002, 46(3):177-195.
57. Näätänen R., Alho K. Higher-order processes in auditory-change detection. Trends in Cognitive Sciences 1997, 1(2):44-45.
58. Näätänen R., Gaillard A.W.K., Mäntysalo S. Early selective-attention effect on evoked potential reinterpreted. Acta Psychologica 1978, 42(4):313-329.
59. Näätänen R., Jacobsen T., Winkler I. Memory-based or afferent processes in mismatch negativity (MMN): a review of the evidence. Psychophysiology 2005, 42(1):25-32.
60. Näätänen R., Lehtokoski A., Lennes M., Cheour M., Huotilainen M., Iivonen A., et al. Language-specific phoneme representations revealed by electric and magnetic brain responses. Nature 1997, 385(6615):432-434.
61. Näätänen R., Paavilainen P., Alho K., Reinikainen K., Sams M. Do event-related potentials reveal the mechanism of the auditory sensory memory in the human brain?. Neuroscience Letters 1989, 98(2):217-221.
62. Näätänen R., Paavilainen P., Rinne T., Alho K. The mismatch negativity (MMN) in basic research of central auditory processing: a review. Clinical Neurophysiology 2007, 118(12):2544-2590.
63. Näätänen R., Pakarinen S., Rinne T., Takegata R. The mismatch negativity (MMN): towards the optimal paradigm. Clinical Neurophysiology 2004, 115(1):140-144.
64. Nousak J.M.K., Deacon D., Ritter W., Vaughan H.G. Storage of information in transient auditory memory. Cognitive Brain Research 1996, 4(4):305-317.
65. Novak G.P., Ritter W., Vaughan H.G., Wiznitzer M.L. Differentiation of negative event-related potentials in an auditory discrimination task. Electroencephalography and Clinical Neurophysiology 1990, 75(4):255-275.
66. Obleser J., Kotz S.A. Expectancy constraints in degraded speech modulate the language comprehension network. Cerebral Cortex 2010, 20(3):633-640.
67. Obleser J., Wise R.J., Dresner M.A., Scott S.K. Functional integration across brain regions improves speech perception under adverse listening conditions. Journal of Neuroscience 2007, 27(9):2283-2289.
68. Oostenveld R., Praamstra P. The five percent electrode system for high-resolution EEG and ERP measurements. Clinical Neurophysiology 2001, 112(4):713-719.
69. Otten M., Nieuwland M.S., van Berkum J.J.A. Great expectations: specific lexical anticipation influences the processing of spoken language. BMC Neuroscience 2007, 8.
70. Perrin F., Pernier J., Bertrand O., Echallier J.F. Spherical splines for scalp potential and current density mapping. Electroencephalography and Clinical Neurophysiology 1989, 72(2):184-187.
71. Pihko E., Leppäsaari T., Leppänen P., Richardson U., Lyytinen H. Auditory event-related potentials (ERP) reflect temporal changes in speech stimuli. NeuroReport 1997, 8(4):911-914.
72. Pulvermüller F., Assadollahi R. Grammar or serial order? Discrete combinatorial brain mechanisms reflected by the syntactic mismatch negativity. Journal of Cognitive Neuroscience 2007, 19(6):971-980.
73. Pulvermüller F., Shtyrov Y. Language outside the focus of attention: the mismatch negativity as a tool for studying higher cognitive processes. Progress in Neurobiology 2006, 79(1):49-71.
74. Raij T., McEvoy L., Mäkelä J.P., Hari R. Human auditory cortex is activated by omissions of auditory stimuli. Brain Research 1997, 745(1-2):134-143.
75. Renoult L., Wang X., Mortimer J., Debruille J.B. Explicit semantic tasks are necessary to study semantic priming effects with high rates of repetition. Clinical Neurophysiology 2012, 123(4):741-754.
76. Rüsseler J., Altenmüller E., Nager W., Kohlmetz C., Münte T. Event-related brain potentials to sound omissions differ in musicians and non-musicians. Neuroscience Letters 2001, 308(1):33-36.
77. Sabri M., Campbell K.B. Effects of sequential and temporal probability of deviant occurrence on mismatch negativity. Cognitive Brain Research 2001, 12(1):171-180.
78. Sams M., Alho K., Näätänen R. Short-term habituation and dishabituation of the mismatch negativity of the ERP. Psychophysiology 1984, 21(4):434-441.
79. Samuel A.G. Phoneme restoration. Language and Cognitive Processes 1996, 11(6):647-653.
80. SanMiguel I., Widmann A., Bendixen A., Trujillo-Barreto N.J., Schröger E. Hearing silences: human auditory processing relies on pre-activation of sound-specific brain activity patterns. Journal of Neuroscience 2013, 33(20):8633-8639.
81. Scharinger M., Bendixen A., Trujillo-Barreto N.J., Obleser J. A sparse neural code for some speech sounds but not for others. PLoS ONE 2012, 7(7):e40953.
82. Schröger E. Higher-order processes in auditory-change detection: a response to Näätänen and Alho. Trends in Cognitive Sciences 1997, 1(2):45-46.
83. Schröger E. The mismatch negativity as a tool to study auditory processing. Acta Acustica United with Acustica 2005, 91(3):490-501.
84. Schröger E. Mismatch negativity: a microphone into auditory memory. Journal of Psychophysiology 2007, 21(3-4):138-146.
85. Schröger E., Wolff C. Mismatch response of the human brain to changes in sound location. NeuroReport 1996, 7(18):3005-3008.
86. Seghier M.L. The angular gyrus: multiple functions and multiple subdivisions. Neuroscientist 2013, 19(1):43-61.
87. Shtyrov Y., Hauk O., Pulvermüller F. Distributed neuronal networks for encoding category-specific semantic information: the mismatch negativity to action words. European Journal of Neuroscience 2004, 19(4):1083-1092.
88. Sivonen P., Maess B., Friederici A.D. Semantic retrieval of spoken words with an obliterated initial phoneme in a sentence context. Neuroscience Letters 2006, 408(3):220-225.
89. Sivonen P., Maess B., Lattner S., Friederici A.D. Phonemic restoration in a sentence context: evidence from early and late ERP effects. Brain Research 2006, 1121:177-189.
90. Srinivasan R. High-resolution EEG: theory and practice. Event-related potentials: A methods handbook 2005, 167-188. MIT Press, Cambridge. T.C. Handy (Ed.).
91. Steinberg J., Truckenbrodt H., Jacobsen T. Preattentive phonotactic processing as indexed by the mismatch negativity. Journal of Cognitive Neuroscience 2010, 22(10):2174-2185.
92. Stickney G.S., Assmann P.F. Acoustic and linguistic factors in the perception of passband-filtered speech. Journal of the Acoustical Society of America 2001, 109(3):1157-1165.
93. Strauß A., Kotz S.A., Obleser J. Narrowed expectancies under degraded speech: revisiting the N400. Journal of Cognitive Neuroscience 2013, 25(8):1383-1395.
94. Tavano A., Grimm S., Costa-Faidella J., Slabu L., Schröger E., Escera C. Spectrotemporal processing drives fast access to memory traces for spoken words. NeuroImage 2012, 60(4):2300-2308.
95. Tervaniemi M., Saarinen J., Paavilainen P., Danilova N., Näätänen R. Temporal integration of auditory information in sensory memory as reflected by the mismatch negativity. Biological Psychology 1994, 38(2-3):157-167.
96. Todorovic A., van Ede F., Maris E., de Lange F.P. Prior expectation mediates neural adaptation to repeated sounds in the auditory cortex: an MEG study. Journal of Neuroscience 2011, 31(25):9118-9123.
97. Trujillo-Barreto N.J., Aubert-Vázquez E., Valdés-Sosa P.A. Bayesian model averaging in EEG/MEG imaging. NeuroImage 2004, 21(4):1300-1319.
98. Tse C.Y., Tien K.-R., Penney T.B. Event-related optical imaging reveals the temporal dynamics of right temporal and frontal cortex activation in pre-attentive change detection. NeuroImage 2006, 29(1):314-320.
99. Valdés-Sosa P., Marti F., García F., Casanova R. Variable resolution electric-magnetic tomography. Proceedings of the tenth international conference on biomagnetism 2000, Vol. 2:373-376.
100. Van Petten C., Luka B.J. Prediction during language comprehension: benefits, costs, and ERP components. International Journal of Psychophysiology 2012, 83(2):176-190.
101. Vespignani F., Canal P., Molinaro N., Fonda S., Cacciari C. Predictive mechanisms in idiom comprehension. Journal of Cognitive Neuroscience 2010, 22(8):1682-1700.
102. Wacongne C., Changeux J.P., Dehaene S. A neuronal model of predictive coding accounting for the mismatch negativity. Journal of Neuroscience 2012, 32(11):3665-3678.
103. Wacongne C., Labyt E., van Wassenhove V., Bekinschtein T., Naccache L., Dehaene S. Evidence for a hierarchy of predictions and prediction errors in human cortex. Proceedings of the National Academy of Sciences of the United States of America 2011, 108(51):20754-20759.
104. Walker L.J., Carpenter M., Downs C.R., Cranford J.L., Stuart A., Pravica D. Possible neuronal refractory or recovery artifacts associated with recording the mismatch negativity response. Journal of the American Academy of Audiology 2001, 12:348-356.
105. Wang L., Zhu Z., Bastiaansen M. Integration or predictability? A further specification of the functional role of gamma oscillations in language comprehension. Frontiers in Psychology 2012, 3:187.
106. Winkler I. Interpreting the mismatch negativity. Journal of Psychophysiology 2007, 21(3-4):147-163.
107. Winkler I., Cowan N., Csépe V., Czigler I., Näätänen R. Interactions between transient and long-term auditory memory as reflected by the mismatch negativity. Journal of Cognitive Neuroscience 1996, 8(5):403-415.
108. Winkler I., Czigler I. Mismatch negativity: deviance detection or the maintenance of the 'standard'. NeuroReport 1998, 9(17):3809-3813.
109. Winkler I., Czigler I., Jaramillo M., Paavilainen P., Näätänen R. Temporal constraints of auditory event synthesis: evidence from ERPs. NeuroReport 1998, 9(3):495-499.
110. Winkler I., Karmos G., Näätänen R. Adaptive modeling of the unattended acoustic environment reflected in the mismatch negativity event-related potential. Brain Research 1996, 742(1-2):239-252.
111. Worsley K.J., Marrett S., Neelin P., Evans A.C. Searching scale space for activation in PET images. Human Brain Mapping 1996, 4(1):74-90.
112. Yabe H., Koyama S., Kakigi R., Gunji A., Tervaniemi M., Sato Y., et al. Automatic discriminative sensitivity inside temporal window of sensory memory as a function of time. Cognitive Brain Research 2001, 12(1):39-48.
113. Yabe H., Tervaniemi M., Reinikainen K., Näätänen R. Temporal window of integration revealed by MMN to sound omission. NeuroReport 1997, 8(8):1971-1974.
114. Yabe H., Tervaniemi M., Sinkkonen J., Huotilainen M., Ilmoniemi R.J., Näätänen R. Temporal window of integration of auditory information in the human brain. Psychophysiology 1998, 35(5):615-619.
115. Zwislocki J.J. Temporal summation of loudness: an analysis. Journal of the Acoustical Society of America 1969, 46:431-440.