Change and novelty detection in speech and non-speech sound streams

Brain Research

Volumn 1327, Issue , 2010, Pages 77-90

  Sorokin, Alexander ^a,b,d   Alku, Paavo ^c   Kujala, Teija ^a  

^a UNIVERSITY OF HELSINKI   (Finland)

^b MENTAL HEALTH RESEARCH CENTER   (Russian Federation)

^c AALTO UNIVERSITY   (Finland)

^d MOSCOW STATE UNIVERSITY OF PSYCHOLOGY AND EDUCATION   (Russian Federation)

Author keywords

Event related potential (ERP); Mismatch negativity (MMN); Novelty detection; P3; Sound discrimination; Speech perception

Indexed keywords

ACOUSTICS; ADULT; ALGORITHM; ARTICLE; AUDITORY STIMULATION; CONSONANT; EVENT RELATED POTENTIAL; FEMALE; HUMAN; HUMAN EXPERIMENT; LANGUAGE; LEFT HEMISPHERE; LINGUISTICS; MALE; NORMAL HUMAN; PRIORITY JOURNAL; RIGHT HEMISPHERE; SOUND; SPEECH PERCEPTION; VOWEL;

ACOUSTIC STIMULATION; ADULT; ALGORITHMS; BRAIN MAPPING; CONTINGENT NEGATIVE VARIATION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, AUDITORY; FUNCTIONAL LATERALITY; HUMANS; MIDDLE AGED; PHONETICS; REACTION TIME; SIGNAL DETECTION, PSYCHOLOGICAL; SPEECH PERCEPTION; YOUNG ADULT;

EID: 77950368290     PISSN: 00068993     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.brainres.2010.02.052     Document Type: Article

References (79)

1. Alho K., Connolly J.F., Cheour M., Lehtokoski A., Huotilainen M., Virtanen J., Aulanko R., and Ilmoniemi R.J. Hemispheric lateralization in preattentive processing of speech sounds. Neurosci. Lett. 258 (1998) 9-12
2. Alku P., Tiitinen H., and Näätänen R. A method for generating natural-sounding speech stimuli for cognitive brain research. Clin. Neurophysiol. 110 (1999) 1329-1333
3. Alonso-Bua B., Diaz F., and Ferraces M.J. The contribution of AERPs (MMN and LDN) to studying temporal vs. linguistic processing deficits in children with reading difficulties. Int. J. Psychophysiol. 59 (2006) 159-167
4. Becker F., and Reinvang I. Mismatch negativity elicited by tones and speech sounds: changed topographical distribution in aphasia. Brain Lang. 100 (2007) 69-78
5. Belin P., Zatorre R.J., Lafaille P., Ahad P., and Pike B. Voice-selective areas in human auditory cortex. Nature 403 (2000) 309-312
6. Belin P., Fecteau S., and Bedard C. Thinking the voice: neural correlates of voice perception. Trends Cogn. Sci. 8 (2004) 129-135
7. Bradley M., and Lang P. International Affective Digitized Sounds (IADS): Stimuli, Instruction Manual and AFFECTIVE ratings (Tech. Rep. No. B-2) (1999), The Center for Research in Psychophysiology, University of Florida, Gainesville, FL
8. Brunellière A., Dufour S., Nguyen N., and Frauenfelder U.H. Behavioral and electrophysiological evidence for the impact of regional variation on phoneme perception. Cognition 111 (2009) 390-396
9. Dehaene-Lambertz G., Pallier C., Serniclaes W., Sprenger-Charolles L., Jobert A., and Dehaene S. Neural correlates of switching from auditory to speech perception. Neuroimage 24 (2005) 21-33
10. Desai R., Liebenthal E., Waldron E., and Binder J.R. Left posterior temporal regions are sensitive to auditory categorization. J. Cogn. Neurosci. 20 (2008) 1174-1188
11. Escera C., and Corral M.J. Role of mismatch negativity and novelty-P3 in involuntary auditory attention. J. Psychophysiol. 21 (2007) 251-264
12. Escera C., Alho K., Schröger E., and Winkler I. Involuntary attention and distractibility as evaluated with event-related brain potentials. Audiol. Neurootol. 5 (2000) 151-166
13. Eulitz C., and Lahiri A. Neurobiological evidence for abstract phonological representations in the mental lexicon during speech recognition. J. Cogn. Neurosci. 16 (2004) 577-583
14. Eulitz C., Diesch E., Pantev C., Hampson S., and Elbert T. Magnetic and electric brain activity evoked by the processing of tone and vowel stimuli. J. Neurosci. 15 (1995) 2748-2755
15. Fisher D.J., Labelle A., and Knott V.J. Auditory hallucinations and the mismatch negativity: processing speech and non-speech sounds in schizophrenia. Int. J. Psychophysiol. 70 (2008) 3-15
16. Fitch R.H., Miller S., and Tallal P. Neurobiology of speech perception. Annu. Rev. Neurosci. 20 (1997) 331-353
17. Friedman D., Cycowicz Y.M., and Gaeta H. The novelty P3: an event-related brain potential (ERP) sign of the brain's evaluation of novelty. Neurosci. Biobehav. Rev. 25 (2001) 355-373
18. Fry D.B. The Physics of Speech. Cambridge Textbooks in Linguistics (1979), Cambridge University Press, Cambridge Eng.
19. Garrido M.I., Kilner J.M., Stephan K.E., and Friston K.J. The mismatch negativity: a review of underlying mechanisms. Clin. Neurophysiol. 120 (2009) 453-463
20. Greenberg S. A multi-tier framework for understanding spoken language. In: Greenberg S., and Ainsworth W.A. (Eds). Listening to Speech: An Auditory Perspective (2006), Lawrence Erlbaum Associates, Mahwah, N.J. 458
21. Hacquard V., Walter M.A., and Marantz A. The effects of inventory on vowel perception in French and Spanish: an MEG study. Brain Lang. 100 (2007) 295-300
22. Hämäläinen M.S., and Ilmoniemi R.J. Interpreting magnetic fields of the brain: minimum norm estimates. Med. Biol. Eng. Comput. 32 (1994) 35-42
23. Hirvonen P. Finnish and English Communicative Intonation. Publications of the Phonetics Department of the University of Turku Vol. 8 (1970) Turku
24. Horváth J., Winkler I., and Bendixen A. Do N1/MMN, P3a, and RON form a strongly coupled chain reflecting the three stages of auditory distraction?. Biol. Psychol. 79 (2008) 139-147
25. Iivonen A., and Harnud H. Acoustical comparison of the monophthong systems in Finnish, Mongolian and Udmurt. J. Int. Phon. Assoc. 35 (2005) 59-71
26. Jacobsen T., Horváth J., Schroger E., Lattner S., Widmann A., and Winkler I. Pre-attentive auditory processing of lexicality. Brain Lang. 88 (2004) 54-67
27. Jacobsen T., Schröger E., and Alter K. Pre-attentive perception of vowel phonemes from variable speech stimuli. Psychophysiology 41 (2004) 654-659
28. Jacobsen T., Schröger E., Winkler I., and Horváth J. Familiarity affects the processing of task-irrelevant auditory deviance. J. Cogn. Neurosci. 17 (2005) 1704-1713
29. Jaramillo M., Ilvonen T., Kujala T., Alku P., Tervaniemi M., and Alho K. Are different kinds of acoustic features processed differently for speech and non-speech sounds?. Cogn. Brain Res. 12 (2001) 459-466
30. Kayser J., Tenke C.E., and Bruder G.E. Dissociation of brain ERP topographies for tonal and phonetic oddball tasks. Psychophysiology 35 (1998) 576-590
31. Kent R.D., and Read C. The Acoustic Analysis of Speech (2002), Singular/Thomson Learning, Australia
32. Kirmse U., Ylinen S., Tervaniemi M., Vainio M., Schröger E., and Jacobsen T. Modulation of the mismatch negativity (MMN) to vowel duration changes in native speakers of Finnish and German as a result of language experience. Int. J. Psychophysiol. 67 (2008) 131-143
33. Kujala T., Tervaniemi M., and Schröger E. The mismatch negativity in cognitive and clinical neuroscience: theoretical and methodological considerations. Biol. Psychol. 74 (2007) 1-19
34. Levy D.A., Granot R., and Bentin S. Processing specificity for human voice stimuli: electrophysiological evidence. NeuroReport 12 (2001) 2653-2657
35. Levy D.A., Granot R., and Bentin S. Neural sensitivity to human voices: ERP evidence of task and attentional influences. Psychophysiology 40 (2003) 291-305
36. Liberman A.M., and Whalen D.H. On the relation of speech to language. Trends Cogn. Sci. 4 (2000) 187-196
37. McArthur G.M., and Bishop D.V. Speech and non-speech processing in people with specific language impairment: a behavioural and electrophysiological study. Brain Lang. 94 (2005) 260-273
38. Molfese D.L., Fonaryova Key A.P., Maguire M.J., Dove G.O., and Molfese V.J. Event-related evoked potentials (ERPs) in speech perception. In: Pisoni D.B., and Remez R.E. (Eds). The Handbook of Speech Perception (2005), Blackwell Publishing 99
39. Näätänen R. Phoneme representations of the human brain as reflected by event-related potentials. Electroencephalogr. Clin. Neurophysiol. Suppl. 49 (1999) 170-173
40. Näätänen R., and Escera C. Mismatch negativity: clinical and other applications. Audiol. Neurootol. 5 (2000) 105-110
41. Näätänen R., Lehtokoski A., Lennes M., Cheour M., Huotilainen M., Iivonen A., Vainio M., Alku P., Ilmoniemi R.J., Luuk A., Allik J., Sinkkonen J., and Alho K. Language-specific phoneme representations revealed by electric and magnetic brain responses. Nature 385 (1997) 432-434
42. Näätänen R., Pakarinen S., Rinne T., and Takegata R. The mismatch negativity (MMN): towards the optimal paradigm. Clin. Neurophysiol. 115 (2004) 140-144
43. Näätänen R., Jacobsen T., and Winkler I. Memory-based or afferent processes in mismatch negativity (MMN): a review of the evidence. Psychophysiology 42 (2005) 25-32
44. Näätänen R., Paavilainen P., Rinne T., and Alho K. The mismatch negativity (MMN) in basic research of central auditory processing: a review. Clin. Neurophysiol. 118 (2007) 2544-2590
45. Nenonen S., Shestakova A., Huotilainen M., and Näätänen R. Linguistic relevance of duration within the native language determines the accuracy of speech-sound duration processing. Brain Res. Cogn. Brain Res. 16 (2003) 492-495
46. Paavilainen P., Alho K., Reinikainen K., Sams M., and Näätänen R. Right hemisphere dominance of different mismatch negativities. Electroencephalogr. Clin. Neurophysiol. 78 (1991) 466-479
47. Pakarinen S., Takegata R., Rinne T., Huotilainen M., and Näätänen R. Measurement of extensive auditory discrimination profiles using the mismatch negativity (MMN) of the auditory event-related potential (ERP). Clin. Neurophysiol. 118 (2007) 177-185
48. Pakarinen S., Lovio R., Huotilainen M., Alku P., Näätänen R., and Kujala T. Fast multi-feature paradigm for recording several mismatch negativities (MMNs) to phonetic and acoustic changes in speech sounds. Biol. Psychol. 82 (2009) 219-226
49. Patterson R.D., and Johnsrude I.S. Functional imaging of the auditory processing applied to speech sounds. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363 (2008) 1023-1035
50. Paulmann S., and Kotz S.A. Early emotional prosody perception based on different speaker voices. NeuroReport 19 (2008) 209-213
51. Pierrehumbert J. The perception of fundamental frequency declination. J. Acoust. Soc. Am. 66 (1979) 363-369
52. Poeppel D., Idsardi W.J., and van Wassenhove V. Speech perception at the interface of neurobiology and linguistics. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363 (2008) 1071-1086
53. Polich J. Updating P300: an integrative theory of P3a and P3b. Clin. Neurophysiol. 118 (2007) 2128-2148
54. Polich J., and Criado J.R. Neuropsychology and neuropharmacology of P3a and P3b. Int. J. Psychophysiol. 60 (2006) 172-185
55. Pulvermüller F., and Shtyrov Y. Language outside the focus of attention: the mismatch negativity as a tool for studying higher cognitive processes. Prog. Neurobiol. 79 (2006) 49-71
56. Rabiner L.R., and Schafer R.W. Digital Processing of Speech Signals. Prentice-Hall Signal Processing Series (1978), Prentice-Hall, Englewood Cliffs, N.J.
57. Ranganath C., and Rainer G. Neural mechanisms for detecting and remembering novel events. Nat. Rev. Neurosci. 4 (2003) 193-202
58. Rinne T., Alho K., Alku P., Holi M., Sinkkonen J., Virtanen J., Bertrand O., and Näätänen R. Analysis of speech sounds is left-hemisphere predominant at 100-150 ms after sound onset. NeuroReport 10 (1999) 1113-1117
59. Samson F., Mottron L., Jemel B., Belin P., and Ciocca V. Can spectro-temporal complexity explain the autistic pattern of performance on auditory tasks?. J. Autism Dev. Disord. 36 (2006) 65-76
60. Scott S.K. Voice processing in monkey and human brains. Trends Cogn. Sci. 12 (2008) 323-325
61. Sebastian C., and Yasin I. Speech versus tone processing in compensated dyslexia: discrimination and lateralization with a dichotic mismatch negativity (MMN) paradigm. Int. J. Psychophysiol. 70 (2008) 115-126
62. Shtyrov Y., Kujala T., Ilmoniemi R.J., and Näätänen R. Noise affects speech-signal processing differently in the cerebral hemispheres. NeuroReport 10 (1999) 2189-2192
63. Shtyrov Y., Kujala T., Palva S., Ilmoniemi R.J., and Näätänen R. Discrimination of speech and of complex nonspeech sounds of different temporal structure in the left and right cerebral hemispheres. Neuroimage 12 (2000) 657-663
64. Shtyrov Y., Pihko E., and Pulvermüller F. Determinants of dominance: is language laterality explained by physical or linguistic features of speech?. Neuroimage 27 (2005) 37-47
65. Simons R.F., Graham F.K., Miles M.A., and Chen X. On the relationship of P3a and the novelty-P3. Biol. Psychol. 56 (2001) 207-218
66. Suomi K., Toinanen J., and Ylitalo R. Finnish sound structure: phonetics, phonology, phonotactics and prosody. Studia Humaniora Ouluensia 9 (2008), Studia humaniora ouluensia, Oulu
67. Takegata R., Nakagawa S., Tonoike M., and Näätänen R. Hemispheric processing of duration changes in speech and non-speech sounds. NeuroReport 15 (2004) 1683-1686
68. Tallal P., Miller S., and Fitch R.H. Neurobiological basis of speech: a case for the preeminence of temporal processing. Ann. N. Y. Acad. Sci. 682 (1993) 27-47
69. Tampas J.W., Harkrider A.W., and Hedrick M.S. Neurophysiological indices of speech and nonspeech stimulus processing. J. Speech Lang. Hear. Res. 48 (2005) 1147-1164
70. Tervaniemi M., and Hugdahl K. Lateralization of auditory-cortex functions. Brain Res. Brain Res. Rev. 43 (2003) 231-246
71. Tervaniemi M., Jacobsen T., Rottger S., Kujala T., Widmann A., Vainio M., Näätänen R., and Schröger E. Selective tuning of cortical sound-feature processing by language experience. Eur. J. NeuroSci. 23 (2006) 2538-2541
72. Uppenkamp S., Johnsrude I.S., Norris D., Marslen-Wilson W., and Patterson R.D. Locating the initial stages of speech-sound processing in human temporal cortex. Neuroimage 31 (2006) 1284-1296
73. Vainio M., and Järvikivi J. Focus in production: tonal shape, intensity and word order. J. Acoust. Soc. Am. 121 (2007) EL55-EL61
74. Whalen D.H., Benson R.R., Richardson M., Swainson B., Clark V.P., Lai S., Mencl W.E., Fulbright R.K., Constable R.T., and Liberman A.M. Differentiation of speech and nonspeech processing within primary auditory cortex. J. Acoust. Soc. Am. 119 (2006) 575-581
75. Winkler I., Kujala T., Tiitinen H., Sivonen P., Alku P., Lehtokoski A., Czigler I., Csepe V., Ilmoniemi R.J., and Näätänen R. Brain responses reveal the learning of foreign language phonemes. Psychophysiology 36 (1999) 638-642
76. Wong P.C. Hemispheric specialization of linguistic pitch patterns. Brain Res. Bull. 59 (2002) 83-95
77. Ylinen S., Shestakova A., Huotilainen M., Alku P., and Näätänen R. Mismatch negativity (MMN) elicited by changes in phoneme length: a cross-linguistic study. Brain Res. 1072 (2006) 175-185
78. Young E.D. Neural representation of spectral and temporal information in speech. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363 (2008) 923-945
79. Zatorre R.J., and Gandour J.T. Neural specializations for speech and pitch: moving beyond the dichotomies. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363 (2008) 1087-1104