Language in the mismatch negativity design: Motivations, benefits, and prospects

Journal of Psychophysiology

Volumn 21, Issue 3-4, 2007, Pages 176-187

  Shtyrov, Yury ^a   Pulvermüller, Friedmann ^a  

^a MRC COGNITION AND BRAIN SCIENCES UNIT   (United Kingdom)

Author keywords

Cell assembly; Cortex; EEG; Language; MEG; Memory trace; MMN; Speech

Indexed keywords

ARTICLE; BRAIN FUNCTION; COGNITION; EVOKED RESPONSE; HUMAN; INFORMATION PROCESSING; LANGUAGE PROCESSING; LINGUISTICS; LONG TERM MEMORY; MISMATCH NEGATIVITY; NEUROPHYSIOLOGY; PHONETICS; SEMANTICS; VERBAL MEMORY;

EID: 42049121111     PISSN: 02698803     EISSN: None     Source Type: Journal    
DOI: 10.1027/0269-8803.21.34.176     Document Type: Article

References (114)

1. Alho, K. (1992). Selective attention in auditory processing as reflected by event-related brain potentials. Psychophysiology, 29, 247-263.
2. Bentin, S., Mouchetant-Rostaing, Y., Giard, M.H., Echallier, J.F., & Pernier, J. (1999). ERP manifestations of processing printed words at different psycholinguistic levels: Time course and scalp distribution. Journal of Cognitive Neuroscience, 11, 235-260.
3. Bonte, M.L., Mitterer, H., Zellagui, N., Poelmans, H., & Blomert, L. (2005). Auditory cortical tuning to statistical regularities in phonology. Clinical Neurophysiology, 116, 2765-2774.
4. Bonte, M.L., Poelmans, H., & Blomert, L. (2007). Deviant neurophysiological responses to phonological regularities in speech in dyslexic children. Neuropsychologia, 45, 1427-1437.
5. Bornkessel, I., Zysset, S., Friederici, A.D., von Cramon, D.Y., & Schlesewsky, M. (2005). Who did what to whom? The neural basis of argument hierarchies during language comprehension. Neuroimage, 26, 221-233.
6. Carlyon, R.P. (2004). How the brain separates sounds. Trends in Cognitive Sciences, 8, 465-471.
7. Cheour, M., Alho, K., Ceponiene, R., Reinikainen, K., Sainio, K., Pohjavuori, M. et al. (1998). Maturation of mismatch negativity in infants. International Journal of Psychophysiology, 29, 217-226.
8. Colin, C., Radeau, M., Soquet, A., & Deltenre, P. (2004). Generalization of the generation of an MMN by illusory McGurk percepts: Voiceless consonants. Clinical Neurophysiology, 115, 1989-2000.
9. Colin, C., Radeau, M., Soquet, A., Demolin, D., Colin, F., & Deltenre, P. (2002). Mismatch negativity evoked by the McGurk-MacDonald effect: A phonetic representation within short-term memory. Clinical Neurophysiology, 113, 495-506.
10. Connolly, J.F., Byrne, J.M., & Dywan, C.A. (1995). Assessing adult receptive vocabulary with event-related potentials: An investigation of cross-modal and cross-form priming. Journal of Clinical and Experimental Neuropsychology, 17, 548-565.
11. Czigler, I. (2007). Visual mismatch negativity: Violation of non-attended environmental regularities. Journal of Psychophysiology, 21, 224-230.
12. Czigler, I., Weisz, J., & Winkler, I. (2006). ERPs and deviance detection: Visual mismatch negativity to repeated visual stimuli, Neuroscience Letters, 401, 178-182.
13. D'Arcy, R.C., Connolly, J.F., Service, E., Hawco, C.S., & Houlihan, M.E. (2004). Separating phonological and semantic processing in auditory sentence processing: A high-resolution event-related brain potential study. Human Brain Mapping, 22, 40-51.
14. Dehaene-Lambertz, G. (1997). Electrophysiological correlates of categorical phoneme perception in adults. NeuroReport, 8, 919-924.
15. Dehaene-Lambertz, G., Dupoux, E., & Gout, A. (2000). Electrophysiological correlates of phonological processing: A cross-linguistic study. Journal of Cognitive Neuroscience" 12, 635-647.
16. Dell, G.S. (1986). A spreading-activation theory of retrieval in sentence production. Psychological Review, 93, 293-321.
17. Diesch, E., Biermann, S., & Luce, T. (1998). The magnetic mismatch field elicited by words and phonological nonwords. NeuroReport, 9, 455-460.
18. Embick, D., Hackl, M., Schaeffer, J., Kelepir, M., & Marantz, A. (2001). A magnetoencephalographic component whose latency reflects lexical frequency. Brain Research: Cognitive Brain Research, 10, 345-348.
19. Endrass, T., Mohr, B., & Pulvermüller, F. (2004). Enhanced mismatch negativity brain response after binaural word presentation. European Journal of Neuroscience, 19, 1653-1660.
20. Escera, C., Alho, K., Winkler, I., & Näätänen, R. (1998). Neural mechanisms of involuntary attention to acoustic novelty and change. Journal of Cognitive Neuroscience, 10, 590-604.
21. Frege, G. (1980). Über Sinn und Bedeutung [On sense and meaning] (first published in 1892). In G. Patzig (Ed.), Funktion, Begriff Bedeutung [Function, concept, meaning] (pp. 25-50). Bern: Huber.
22. Friederici, A. (2002). Toward a neural basis of auditory sentence processing. Trends in Cognitive Sciences, 6, 78-84.
23. Friederici, A.D., Pfeifer, E., & Hahne, A. (1993). Event-related brain potentials during natural speech processing: Effects of semantic, morphological, and syntactic violations. Cognitive Brain Research, 1, 183-192.
24. Friederici, A.D., Wang, Y., Herrmann, C.S., Maess, B., & Oertel, U. (2000). Localization of early syntactic processes in frontal and temporal cortical areas: A magnetoencephalographic study. Human Brain Mapping, 11, 1-11.
25. Fromkin, V.A. (1973). Introduction. In V.A. Fromkin (Ed.), Speech errors as linguistic evidence (pp. 11-45). The Hague, Paris: Mouton.
26. Garrett, M. (1980). Levels of processing in sentence production. In B. Butterworth (Ed.), Language production I (pp. 177-220). London: Academic Press.
27. Gunter, T.C., Friederici, A.D., & Schriefers, H. (2000). Syntactic gender and semantic expectancy: ERPs reveal early autonomy and late interaction. Journal of Cognitive Neuroscience" 12, 556-568.
28. Hasting, A., Kotz, S.A., & Friederici, A. (2006). Syntax in a blink: MMN modulations in response to agreement and word category violations in German. In Y. Shtyrov & F. Pulvermüller (Eds.), Fourth conference on mismatch negativity (MMN) and its clinical and scientific applications. Cambridge, UK: MRC CBU.
29. Hauk, O., Johnsrude, I., & Pulvermüller, F. (2004). Somatotopic representation of action words in human motor and premotor cortex. Neuron, 41, 301-307.
30. Hauk, O., & Pulvermüller, E (2004). Neurophysiological distinction of action words in the fronto-central cortex. Human Brain Mapping, 21, 191-201.
31. Hebb, D.O. (1949). The organization of behavior. A neuropsychological theory. New York: Wiley.
32. Honbolygo, F., Csepe, V., & Rago, A. (2004). Suprasegmental speech cues are automatically processed by the human brain: A mismatch negativity study. Neuroscience Letters, 363, 84-88.
33. Jacobsen, T., Horvath, J., Schröger, E., Lattner, S., Widmann, A., & Winkler, I. (2004). Preattentive auditory processing of lexicality. Brain and Language, 88, 54-67.
34. Kaan, E., & Swaab, T.Y. (2002). The brain circuitry of syntactic comprehension. Trends in Cognitive Sciences, 6, 350-356.
35. Kircher, T.T., Oh, T.M., Brammer, M.J., & McGuire, P.K. (2005). Neural correlates of syntax production in schizophrenia. British Journal of Psychiatry, 186, 209-214.
36. Korpilahti, P., Krause, C.M., Holopainen, I., & Lang, A.H. (2001). Early and late mismatch negativity elicited by words and speech-like stimuli in children. Brain and Language, 76, 332-339.
37. Korth M., & Nguyen, N.X. (1997). The effect of stimulus size on human cortical potentials evoked by chromatic patterns. Vision Research, 37, 649-657.
38. Krumbholz, K., Patterson, R.D., Seither-Preisler, A., Lammertmann, C., & Lutkenhoner, B. (2003). Neuromagnetic evidence for a pitch processing center in Heschl's gyrus. Cerebral Cortex, 13, 765-772.
39. Kujala, A., Alho, K., Valle, S., Sivonen, P., Ilmoniemi, R.J., Alku, P. et al. (2002). Context modulates processing of speech sounds in the right auditory cortex of human subjects. Neuroscience Letters, 331, 91-94.
40. Kutas, M., & Hillyard, S.A. (1980). Reading senseless sentences: Brain potentials reflect semantic incongruity. Science, 207, 203-205.
41. Levelt, W.J.M., Roelofs, A., & Meyer, A.S. (1999). A theory of lexical access in speech production. Behavioral and Brain Sciences, 22, 1-75.
42. Lutkenhoner, B., Krumbholz, K., Lammertmann, C., Seither-Preisler, A., Steinstrater, O., & Patterson, R.D. (2003). Localization of primary auditory cortex in humans by magnetoencephalography. Neuroimage, 18, 58-66.
43. MacKay, D.G. (1987). The organization of perception and action. A theory of language and other cognitive skills. New York: Springer-Verlag.
44. Marslen-Wilson, W. (1973). Linguistic structure and speech shadowing at very short latencies. Nature, 244, 522-523.
45. Marslen-Wilson, W., & Tyler, L.K. (1975). Processing structure of sentence perception. Nature, 257, 784-786.
46. Marslen-Wilson, W.D. (1985). Speech shadowing and speech comprehension. Speech Communication, 4, 55-74.
47. Marslen-Wilson, W.D. (1987). Functional parallelism in spoken word-recognition. Cognition, 25, 71-102.
48. Menning, H., Zwitserlood, P., Schoning, S., Hihn, H., Bolte, J., Dobel, C. et al. (2005). Preattentive detection of syntactic and semantic errors. NeuroReport, 16, 77-80.
49. Mohr, B., & Pulvermüller, F. (2002). Redundancy gains and costs in cognitive processing: Effects of short stimulus onset asynchromes. Journal of Experimental Psychology: Learning, Memory, and Cognition, 28, 1200-1223.
50. Morton, J. (1969). The interaction of information in word recognition. Psychological Review, 76, 165-178.
51. Moss, H.E., McCormick, S.F., & Tyler, L. (1997). The time course of activation of semantic information during spoken word recognition. Language and Cognitive Processes, 12, 695-731.
52. Münte, T.F., Schiltz, K., & Kutas, M. (1998). When temporal terms belie conceptual order. Nature, 395, 71-73.
53. Näätänen, R. (1995). The mismatch negativity: A powerful tool for cognitive neuroscience. Ear and Hearing, 16, 6-18.
54. Näätänen, R. (2000). Mismatch negativity (MMN): Perspectives for application. International Journal of Psychophysiology, 37, 3-10.
55. Näätänen, R. (2001). The perception of speech sounds by the human brain as reflected by the mismatch negativity (MMN). and its magnetic equivalent (MMNm). Psychophysiology, 38, 1-21.
56. Näätänen, R., & Alho, K. (1995). Mismatch negativity - A unique measure of sensory processing in audition. International Journal of Neuroscience, 80, 317-337.
57. Näätänen, R., Gaillard, A.W., & Mäntysalo, S. (1978). Early selective-attention effect on evoked potential reinterpreted. Acta Psychologica (Amsterdam), 42, 313-329.
58. Näätänen, R., Lehtokoski, A., Lennes, M., Cheour, M., Huotilainen, M., Iivonen, A. et al. (1997). Language-specific phoneme representations revealed by electric and magnetic brain responses. Nature, 385, 432-434.
59. Näätänen, R., & Picton, T. (1987). The N1 wave of the human electric and magnetic response to sound: A review and an analysis of the component structure. Psychophysiology, 24, 375-425.
60. Näätänen, R., Tervaniemi, M., Sussman, E., Paavilainen, P., & Winkler, I. (2001). 'Primitive intelligencein the auditory cortex. Trends in Neurosciences, 24, 283-288.
61. Näätänen, R., & Winkler, I. (1999). The concept of auditory stimulus representation in cognitive neuroscience. Psychological Bulletin, 12, 826-859.
62. Neville, H., Nicol, J.L., Barss, A., Forster, K.I., & Garrett, M.F. (1991). Syntactically based sentence processing classes: Evidence from event-related brain potentials. Journal of Cognitive Neuroscience, 3, 151-165.
63. Norris, D., McQueen, J.M., & Cutter, A. (2000). Merging information in speech recognition: Feedback is never necessary. Behavioral and Brain Sciences, 23, 299-370.
64. Obleser, J., Lahiri, A., & Eulitz, C. (2004). Magnetic brain response mirrors extraction of phonological features from spoken vowels. Journal of Cognitive Neuroscience,, 16, 31-39.
65. Osterhout, L. (1997). On the brain response to syntactic anomalies: Manipulations of word position and word class reveal individual differences. Brain and Language, 59, 494-522.
66. Osterhout, L., & Hagoort, P. (1999). A superficial resemblance does not necessarily mean you are part of the family: Counterarguments to Coulson, King, and Kutas (1998) in the P600/SPS-P300 debate. Language and Cognitive Processes, 14, 1-14.
67. Osterhout, L., & Holcomb, P.J. (1992). Event-related brain potentials elicited by syntactic anomaly. Journal of Memory and Language, 31, 785-806.
68. Osterhout, L., McLaughlin, J., & Bersick, M. (1997). Event-related brain potentials and human language. Trends in Cognitive Sciences, 1, 203-209.
69. Osterhout, L., & Swinney, D.A. (1993). On the temporal course of gap-filling during comprehension of verbal passives. Journal of Psycholinguistic Research, 22, 273-286.
70. Paavilainen, P., Alho, K., Reinikainen, K., Sams, M., & Näätänen, R. (1991). Right hemisphere dominance of different mismatch negativities. Electroencephalography and Clinical Neurophysiology, 78, 466-479.
71. Penfield, W., & Rasmussen, T. (1950). The cerebral cortex of man. New York: Macmillan.
72. Penolazzi, B., Hauk, O., & Pulvermüller, F. (2007). Early semantic context integration and lexical access as revealed by event-related brain potentials. Biological Psychology, 74, 374-388.
73. Pettigrew, C.M., Murdoch, B.E., Ponton, C.W., Finnigan, S., Alku, P., Kei, J. et al. (2004). Automatic auditory processing of English words as indexed by the mismatch negativity, using a multiple d eviant paradigm. Ear and Hearing, 25, 284-301.
74. Picton, T., & Hillyard, S. (1974). Human auditory evoked potentials: II. Effects of attention. Electroencephalography and Clinical Neurophysiology, 36, 191-200.
75. Poeppel, D., Yellin, E., Phillips, C., Roberts, T.P., Rowley, H.A., Wexler, K. et al. (1996). Task-induced asymmetry of the auditory evoked M100 neuromagnetic field elicited by speech sounds. Brain Research: Cognitive Brain Research, 4, 231-242.
76. Pulvermüller, F. (1999). Words in the brain's language. Behavioral and Brain Sciences, 22, 253-336.
77. Pulvermüller, F. (2001). Brain reflections of words and their meaning. Trends in Cognitive Sciences, 5, 517-524.
78. Pulvermüller, F. (2005). Brain mechanisms linking language and action. Nature Reviews Neuroscience, 6, 576-582.
79. Pulvermüller, F., & Assadollahi, R. (2007). Grammar or serial order?: Discrete combinatorial brain mechanisms reflected by the syntactic mismatch negativity. Journal of Cognitive Neuroscience, 19, 971-980.
80. Pulvermüller, F., Kujala, T., Shtyrov, Y., Simola, J., Tiitinen, H., Alku, P. et al. (2001). Memory traces for words as revealed by the mismatch negativity. Neuroimage, 14, 607-616.
81. Pulvermüller, F., & Shtyrov, Y. (2003). Automatic processing of grammar in the human brain as revealed by the mismatch negativity. Neuroimage, 20, 159-172.
82. Pulvermüller, F., & Shtyrov, Y. (2006). Language outside the focus of attention: The mismatch negativity as a tool for studying higher cognitive processes. Progress in Neurobiology, 79, 49-71.
83. Pulvermüller, F., Shtyrov, Y., & Ilmoniemi, R. (2003). Spatiotemporal dynamics of neural language processing: An MEG study using minimum-norm current estimates. Neuroimage, 20, 1020-1025.
84. Pulvermüller, F., Shtyrov, Y., & Ilmoniemi, R. (2005). Brain signatures of meaning access in action word recognition. Journal of Cognitive Neuroscience, 17, 884-892.
85. Pulvermüller, F., Shtyrov Y., Ilmoniemi, R.J., & Marslen-Wilson, W.D. (2006). Tracking speech comprehension in space and time. Neuroimage, 31, 1297-1305.
86. Pulvermüller, F., Shtyrov, Y., Kujala, T., & Näätänen, R. (2004). Word-specific cortical activity as revealed by the mismatch negativity. Psychophysiology, 41, 106-112.
87. Pylkkanen, L., Stringfellow, A., & Marantz, A. (2002). Neuromagnetic evidence for the timing of lexical activation: An MEG component sensitive to phonotactic probability but not to neighborhood density. Brain and Language, 81, 666-678.
88. Rastle, K., Davis, M.H., Marslen-Wilson, W.D., & Tyler, L.K. (2000). Morphological and semantic effects in visual word recognition: A time-course study. Language and Cognitive Processes, 15, 507-537.
89. Rinne, T., Alho, K., Alku, P., Holi, M., Sinkkonen, J., Virtanen, J. et al. (1999). Analysis of speech sounds is left-hemisphere predominant at 100-150 ms after sound onset. NeuroReport, 10, 1113-1117.
90. Sereno, S.C., Brewer, C.C., & O'Donnell, P.J. (2003). Context effects in word recognition: Evidence for early interactive processing. Psychological Science, 14, 328-333.
91. Sereno, S.C., & Rayner, K. (2003). Measuring word recognition in reading: Eye movements and event-related potentials. Trends in Cognitive Sciences, 7, 489-493.
92. Shestakova, A., Brattico, E., Soloviev, A., Klucharev, V., & Huotilainen, M. (2004). Orderly cortical representation of vowel categories presented by multiple exemplars. Brain Research: Cognitive Brain Research, 21, 342-350.
93. Shtyrov, Y., Hauk, O., & Pulvermüller, F. (2004). Distributed neuronal networks for encoding category-specific semantic information: The mismatch negativity to action words. European Journal of Neuroscience, 19, 1083-1092.
94. Shtyrov, Y., Kujala, T., Ahveninen, J., Tervaniemi, M., Alku, P., Ilmoniemi, R.J. et al. (1998). Background acoustic noise and the hemispheric lateralization of speech processing in the human brain: Magnetic mismatch negativity study. Neuroscience Letters, 251, 141-144.
95. Shtyrov, Y., Kujala, T., Palva, S., Ilmoniemi, R.J., & Näätänen, R. (2000). Discrimination of speech and of complex nonspeech sounds of different temporal structure in the left and right cerebral hemispheres. Neuroimage, 12, 657-663.
96. Shtyrov, Y., Pihko, E., & Pulvermüller, F. (2005). Determinants of dominance: Is language laterality explained by physical or linguistic features of speech? Neuroimage, 27, 37-47.
97. Shtyrov, Y., & Pulvermüller, F. (2002a). Memory traces for inflectional affixes as shown by mismatch negativity. European Journal of Neuroscience, 15, 1085-1091.
98. Shtyrov, Y., & Pulvermüller, F. (2002b). Neurophysiological evidence of memory traces for words in the human brain. Neuro-Report, 13, 521-525.
99. Shtyrov, Y., & Pulvermüller, F. (2007). Early MEG activation dynamics in the left temporal and inferior-frontal cortex reflect semantic context integration. Journal of Cognitive Neuroscience, 19, 1633-1642.
100. Shtyrov, Y., Pulvermüller, F., Näätänen, R., & Ilmoniemi, R.J. (2003). Grammar processing outside the focus of attention: An MEG study. Journal of Cognitive Neuroscience,, 15, 1195-1206.
101. Sittiprapaporn, W., Chindaduangram, C., Tervaniemi, M., & Khotchabhakdi, N. (2003). Preattentive processing of lexical tone perception by the human brain as indexed by the mismatch negativity paradigm. Ann N Y Acad Sci, 999, 199-203.
102. Stockall, L., Stringfellow, A., & Marantz, A. (2004). The precise time course of lexical activation: MEG measurements of the effects of frequency, probability, and density in lexical decision. Brain and Language, 90, 89-94.
103. Sussman, E.S. (2007). A new view on the MMN and attention debate: The role of context in processing auditory events. Journal of Psychophysiology 21, 164-175.
104. Tiitinen, H., May, P., & Näätänen, R. (1997). The transient 40-Hz response, mismatch negativity, and attentional processes in humans. Progress in Neuropsychopharmacology and Biological Psychiatry, 21, 751-771.
105. Tyler, L., Moss, H.E., Galpin, A., & Voice, J.K. (2002). Activating meaning in time: The role of imageability and form-class. Language and Cognitive Processes, 17, 471-502.
106. Weber, C., Hahne, A., Friedrich, M., & Friederici, A.D. (2004). Discrimination of word stress in early infant perception: Electrophysiological evidence. Brain Research: Cognitive Brain Research, 18, 149-161.
107. Winkler, I. (2007). Interpreting the mismatch negativity. Journal of Psychophysiology, 21, 147-163.
108. Winkler, I., Kujala, T., Tiitinen, H., Sivonen, P., Alku, P., Lehtokoski, A. et al. (1999). Brain responses reveal the learning of foreign language phonemes. Psychophysiology, 36, 638-642.
109. Woods, D.L., Alho, K., & Algazi, A. (1993). Intermodal selective attention: Evidence for processing in tonotopic auditory fields. Psychophysiology, 30, 287-295.
110. Woods, D.L., Knight, R.T., & Scabini, D. (1993). Anatomical substrates of auditory selective attention: Behavioral and electrophysiological effects of posterior association cortex lesions. Brain Research: Cognitive Brain Research, 1, 227-240.
111. Wunderlich, J.L., & Cone-Wesson, B.K. (2001). Effects of stimulus frequency and complexity on the mismatch negativity and other components of the cortical auditory-evoked potential. Journal of the Acoustical Society of America, 109, 1526-1537.
112. Yamasaki, H., LaBar, K.S., & McCarthy, G. (2002). Dissociable prefrontal brain systems for attention and emotion. Proceedings of the National Academy of Sciences USA, 99, 11447-11451.
113. Yantis, S., Schwarzbach, J., Serences, J.T., Carlson, R.L., Steinmetz, M.A., Pekar, J.J. et al. (2002). Transient neural activity in human parictal cortex during spatial attention shifts. Nature Neuroscience, 5, 995-1002.
114. Zwitserlood, P. (1989). The locus of the effects of sentential-semantic context in spoken-word processing. Cognition, 32, 25-64.