Words and melody are intertwined in perception of sung words: EEG and behavioral evidence

PLoS ONE

Volumn 5, Issue 3, 2010, Pages

  Gordon, Reyna L ^a,b   Schön, Daniele ^b   Magne, Cyrille ^c   Astésano, Corine ^b,d   Besson, Mireille ^b  

^a FLORIDA ATLANTIC UNIVERSITY   (United States)

^b AIX MARSEILLE UNIVERSITY   (France)

^c MIDDLE TENNESSEE STATE UNIVERSITY   (United States)

^d Université de Toulouse II Le Mirail   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; AUDITORY STIMULATION; BEHAVIOR; BRAIN; ELECTROENCEPHALOGRAPHY; FEMALE; HEARING; HUMAN; MALE; METHODOLOGY; MUSIC; NERVE TRACT; PHYSIOLOGY; SPEECH; SPEECH PERCEPTION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; AUDITORY PERCEPTION; BEHAVIOR; BRAIN; ELECTROENCEPHALOGRAPHY; FEMALE; HUMANS; MALE; MUSIC; NEURAL PATHWAYS; SPEECH; SPEECH PERCEPTION; YOUNG ADULT;

EID: 79251522100     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0009889     Document Type: Article

References (103)

1. Besson M, Schön D (2001) Comparison between language and music. Annals of the New York Academy of Sciences 930: 232-258.
2. Patel AD, Peretz I (1997) Is music autonomous from language? A neuropsychological appraisal. In: Deliege I, Sloboda J, eds. Perception and cognition of music. London: Erlbaum Psychology Press. pp 191-215.
3. Peretz I, Coltheart M (2003) Modularity of music processing. Nature Neuroscience 6: 688-691.
4. Koelsch S (2005) Neural substrates of processing syntax and semantics in music. Current Opinion in Neurobiology 15: 207-212.
5. Patel AD (2008) Music, Language, and the Brain. New York: Oxford University Press.
6. Peretz I, Kolinsky R, Tramo M, Labrecque R, Hublet C, et al. (1994) Functional dissociations following bilateral lesions of auditory cortex. Brain 117 (Pt 6): 1283-1301.
7. Hébert S, Peretz I (2001) Are text and tune of familiar songs separable by brain damage? Brain and Cognition 46: 169-175.
8. Racette A, Bard C, Peretz I (2006) Making non-fluent aphasics speak: sing along! Brain 129: 2571-2584.
9. Schmithorst VJ (2005) Separate cortical networks involved in music perception: preliminary functional MRI evidence for modularity of music processing. NeuroImage 25: 444-451.
10. Patel AD, Gibson E, Ratner J, Besson M, Holcomb PJ (1998) Processing syntactic relations in language and music: an event-related potential study. Journal of Cognitive Neuroscience 10: 717-733.
11. Maess B, Koelsch S, Gunter TC, Friederici AD (2001) Musical syntax is processed in Broca's area: an MEG study. Nature Neuroscience 4: 540-545.
12. Levitin DJ, Menon V (2003) Musical structure is processed in ''language'' areas of the brain: a possible role for Brodmann Area 47 in temporal coherence. NeuroImage 20: 2142-2152.
13. Koelsch S, Friederici AD (2003) Toward the neural basis of processing structure in music. Comparative results of different neurophysiological investigation methods. Annals of the New York Academy of Sciences 999: 15-28.
14. Gelfand JR, Bookheimer SY (2003) Dissociating neural mechanisms of temporal sequencing and processing phonemes. Neuron 38: 831-842.
15. Hickok G, Buchsbaum B, Humphries C, Muftuler T (2003) Auditory-motor interaction revealed by fMRI: speech, music, and working memory in area Spt. Journal of Cognitive Neuroscience 15: 673-682.
16. Koelsch S, Kasper E, Sammler D, Schulze K, Gunter T, et al. (2004) Music, language and meaning: brain signatures of semantic processing. Nature Neuroscience 7: 302-307.
17. Steinbeis N, Koelsch S (2008) Shared neural resources between music and language indicate semantic processing of musical tension-resolution patterns. Cerebral Cortex 18: 1169-1178.
18. Steinbeis N, Koelsch S (2008) Comparing the processing of music and language meaning using EEG and FMRI provides evidence for similar and distinct neural representations. PLoS One 3: e2226.
19. Frey A, Marie C, Prod'Homme L, Timsit-Berthier M, Schön D, et al. (2009) Temporal Semiotic Units as Minimal Meaningful Units in Music? An Electrophysiological Approach. Music Perception. pp 247-256.
20. Schön D, Ystad S, Kronland-Martinet R, Besson M (in press) The evocative power of sounds: EEG study of conceptual priming between words and nonverbal sounds. Journal of Cognitive Neuroscience.
21. Daltrozzo J, Schön D (2009) Is conceptual processing in music automatic? An electrophysiological approach. Brain Res 1270: 88-94.
22. Gordon RL, Racette A, Schön D (2006) Sensory-Motor Networks in Singing and Speaking: a comparative approach. In: Altenmü ller E, ed. Music, Motor Control and the Brain. New York: Oxford University Press.
23. Brown S (2000) The ''musilanguage'' model of music evolution In: Wallin N, Merker B, Brown S, eds. The Origins of Music. CambridgeMA: MIT Press. pp 271-300.
24. Mithen SJ (2005) The Singing Neanderthals: the origins of music, language, mind and body. London: Weidenfeld & Nicolson.
25. Patel A (2006) Musical Rhythm, Linguistic Rhythm, and Human Evolution. Music Perception 24: 99-104.
26. Nakata T, Trehub SE (2004) Infants' responsiveness to maternal speech and singing. Infant Behavior & Development 27: 455-464.
27. de l'Etoile SK (2006) Infant behavioral responses to infant-directed singing and other maternal interactions. Infant Behavior & Development 29: 456-470.
28. Bartholomeus B (1974) Effects of task requirements on ear superiority for sung speech. Cortex 10: 215-223.
29. Goodglass H, Calderon M (1977) Parallel processing of verbal and musical stimuli in right and left hemispheres. Neuropsychologia 15: 397-407.
30. Serafine ML, Crowder RG, Repp BH (1984) Integration of melody and text in memory for songs. Cognition 16: 285-303.
31. Peretz I, Radeau M, Arguin M (2004) Two-way interactions between music and language: evidence from priming recognition of tune and lyrics in familiar songs. Memory & Cognition 32: 142-152.
32. Wallace WT (1994) Memory for music: Effect of melody recall on text. Journal of Experimental Psychology 20: 1471-1485.
33. Rainey DW, Larsen JD (2002) The Effect of Familiar Melodies on Initial Learning and Long-term Memory for Unconnected Text. Music Perception 20: 173-186.
34. Kilgour AR, Jakobson LS, Cuddy LL (2000) Music training and rate of presentation as mediators of text and song recall. Memory & Cognition 28: 700-710.
35. Schön D, Boyer M, Moreno S, Besson M, Peretz I, et al. (2008) Songs as an aid for language acquisition. Cognition 106: 975-983.
36. Thiessen ED, Saffran JR (2009) How the melody facilitates the message and vice versa in infant learning and memory. Ann N Y Acad Sci 1169: 225-233.
37. Konečni VJ (1984) Elusive effects of artists' ''messages''. In: Crozier WR, Chapman AJ, eds. Cognitive Processes in the Perception of Art. Amsterdam: North Holland. pp 71-93.
38. Stratton VN, Zalanowski AH (1994) Affective impact of music vs. lyrics. Empirical Studies of the Arts 12: 173-184.
39. Ali SO, Peynircioǧlu ZF (2006) Songs and emotions: are lyrics and melodies equal partners? Psychology of Music 34: 511-534.
40. Besson M, Fai{dotless}̈ta F, Peretz I, Bonnel A-M, Requin J (1998) Singing in the brain: Independence of Lyrics and Tunes. Psychological Science 9: 494-498.
41. Bonnel AM, Fai{dotless}̈ta F, Peretz I, Besson M (2001) Divided attention between lyrics and tunes of operatic songs: evidence for independent processing. Perception and Psychophysics 63: 1201-1213.
42. van Besouw RM, Howard DM, Ternstrom S (2005) Towards an understanding of speech and song perception. Logopedics Phoniatrics Vocology 30: 129-135.
43. Kolinsky R, Lidji P, Peretz I, Besson M, Morais J (2009) Processing interactions between phonology and melody: Vowels sing but consonants speak. Cognition 112: 1-20.
44. Bigand E, Tillmann B, Poulin B, D'Adamo DA, Madurell F (2001) The effect of harmonic context on phoneme monitoring in vocal music. Cognition 81: 11-20.
45. Thompson WF, Russo FA (2004) The attribution of emotion and meaning to song lyrics. Polskie Forum Psychologiczne 9: 51-62.
46. Poulin-Charronnat B, Bigand E, Madurell F, Peereman R (2005) Musical structure modulates semantic priming in vocal music. Cognition 94: 67-78.
47. Fedorenko E, Patel A, Casasanto D, Winawer J, Gibson E (2009) Structural integration in language and music: evidence for a shared system. Memory & Cognition 37: 1-9.
48. Garner WR, Felfoldy GL (1970) Integrality of stimulus dimensions in various types of information processing. Cognitive Psychology 1: 225-241.
49. Lidji P, Jolicoeur P, Moreau P, Kolinsky R, Peretz I (2009) Integrated preattentive processing of vowel and pitch: a mismatch negativity study. Ann N Y Acad Sci 1169: 481-484.
50. Levy DA, Granot R, Bentin S (2001) Processing specificity for human voice stimuli: electrophysiological evidence. Neuroreport 12: 2653-2657.
51. Levy DA, Granot R, Bentin S (2003) Neural sensitivity to human voices: ERP evidence of task and attentional influences. Psychophysiology 40: 291-305.
52. Bigand E, Poulin-Charronnat B (2006) Are we ''experienced listeners''? A review of the musical capacities that do not depend on formal musical training. Cognition 100: 100-130.
53. Bentin S, Kutas M, Hillyard SA (1993) Electrophysiological evidence for task effects on semantic priming in auditory word processing. Psychophysiology 30: 161-169.
54. Holcomb PJ, Neville HJ (1990) Auditory and Visual Semantic Priming in Lexical Decision: A Comparison Using Event-Related Brain Potentials. Language and Cognitive Processes 5: 281-312.
55. Kutas M, Hillyard SA (1980) Reading senseless sentences: brain potentials reflect semantic incongruity. Science 207: 203-205.
56. Kutas M, Hillyard SA (1984) Brain potentials during reading reflect word expectancy and semantic association. Nature 307: 161-163.
57. McCallum WC, Farmer SF, Pocock PV (1984) The effects of physical and semantic incongruities on auditory event-related potentials. Electroencephalography and Clinical Neurophysiology 59: 477-488.
58. Besson M, van Petten CV, Kutas M (1992) An Event-Related Potential (ERP) Analysis of Semantic Congruity and Repetition Effects in Sentences. Journal of Cognitive Neuroscience 4: 132-149.
59. Meyer DE, Schvaneveldt RW (1971) Facilitation in recognizing pairs of words: evidence of a dependence between retrieval operations. Journal of Experimental Psychology 90: 227-234.
60. Neely JH (1977) Semantic Priming and Retrieval from Lexical Memory: Roles of Inhibitionless Spreading Activation and Limited-Capacity Attention. Journal of Experimental Psychology: General 106: 226-254.
61. Besson M, Macar F (1987) An event-related potential analysis of incongruity in music and other non-linguistic contexts. Psychophysiology 24: 14-25.
62. Besson M, Fai{dotless}̈ta F (1995) An Event-Related Potential study of musical expectancy: Comparison of musicians with non-musicians. Journal of Experimental Psychology: Human Performance & Perception 21: 1278-1296.
63. Paller KA, McCarthy G, Wood CC (1992) Event-related potentials elicited by deviant endings to melodies. Psychophysiology 29: 202-206.
64. Verleger R (1990) P3-evoking wrong notes: unexpected, awaited, or arousing? The International Journal of Neuroscience 55: 171-179.
65. Tillmann B, Janata P, Bharucha JJ (2003) Activation of the inferior frontal cortex in musical priming. Brain Research Cognitive Brain Research 16: 145-161.
66. Miranda RA, Ullman MT (2007) Double dissociation between rules and memory in music: an Event-Related Potential study. NeuroImage 38: 331-345.
67. Pachella RG, Miller JO (1976) Stimulus probability and same-different classification. Perception and Psychophysics 19: 29-34.
68. Gregg MK, Samuel AG (2009) The importance of semantics in auditory representations. Atten Percept Psychophys 71: 607-619.
69. Thomas RD (1996) Processing time predictions of current models of perception in the classic additive factors paradigm. Journal of Mathematical Psychology 50: 441-455.
70. Astésano C (2001) Rythme et accentuation en français. Invariance et variabilité stylistique. Paris: L'Harmattan.
71. Nguyen N (2005) La perception de la parole. In: Nguyen N, Wauquier-Gravelines S, Durand J, eds. Phonologie et Phonétique. Paris: Hermes. pp 425-447.
72. McCarthy G, Wood CC (1985) Scalp distributions of event-related potentials: an ambiguity associated with analysis of variance models. Electroencephalogr Clin Neurophysiol 62: 203-208.
73. Urbach TP, Kutas M (2002) The intractability of scaling scalp distributions to infer neuroelectric sources. Psychophysiology 39: 791-808.
74. Perrin F, Garci{dotless}́a-Larrea L (2003) Modulation of the N400 potential during auditory phonological/semantic interaction. Brain Res Cogn Brain Res 17: 36-47.
75. Relander K, Rämä P, Kujala T (2009) Word Semantics Is Processed Even without Attentional Effort. J Cogn Neurosci 21: 1511-1522.
76. Astésano C, Besson M, Alter K (2004) Brain potentials during semantic and prosodic processing in French. Brain Research Cognitive Brain Research 18: 172-184.
77. Hohlfeld A, Sommer W (2005) Semantic processing of unattended meaning is modulated by additional task load: evidence from electrophysiology. Brain Res Cogn Brain Res 24: 500-512.
78. Magne C, Astésano C, Aramaki M, Ystad S, Kronland-Martinet R, et al. (2007) Influence of syllabic lengthening on semantic processing in spoken French: behavioral and electrophysiological evidence. Cerebral Cortex 17: 2659-2668.
79. Ibáñez A, López V, Cornejo C (2006) ERPs and contextual semantic discrimination: degrees of congruence in wakefulness and sleep. Brain Lang 98: 264-275.
80. Digeser FM, Wohlberedt T, Hoppe U (2009) Contribution of spectrotemporal features on auditory event-related potentials elicited by consonant-vowel syllables. Ear Hear 30: 704-712.
81. Nguyen N, Fagyal Z (2008) Acoustic aspects of vowel harmony in French. Journal of Phonetics 36: 1-27.
82. Hagoort P, Brown CM (2000) ERP effects of listening to speech: semantic ERP effects. Neuropsychologia 38: 1518-1530.
83. Van Petten C, Coulson S, Rubin S, Plante E, Parks M (1999) Time course of word identification and semantic integration in spoken language. J Exp Psychol Learn Mem Cogn 25: 394-417.
84. Janata P (1995) ERP Measures Assay the Degree of Expectancy Violation of Harmonic Contexts in Music. J Cogn Neurosci 7: 153-164.
85. Kutas M, McCarthy G, Donchin E (1977) Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. Science 197: 792-795.
86. Johnson R, Jr., Donchin E (1978) On how P300 amplitude varies with the utility of the eliciting stimuli. Electroencephalography and Clinical Neurophysiology 44: 424-437.
87. Donchin E (1981) Presidential address, 1980. Surprise! Surprise? Psychophysiology 18: 493-513.
88. Polich J (2007) Updating P300: an integrative theory of P3a and P3b. Clin Neurophysiol 118: 2128-2148.
89. Carrion RE, Bly BM (2008) The effects of learning on event-related potential correlates of musical expectancy. Psychophysiology 45: 759-775.
90. Cunningham WA, Espinet SD, DeYoung CG, Zelazo PD (2005) Attitudes to the right-and left: frontal ERP asymmetries associated with stimulus valence and processing goals. NeuroImage 28: 827-834.
91. Pastor MC, Bradley MM, Low A, Versace F, Molto J, et al. (2008) Affective picture perception: emotion, context, and the late positive potential. Brain Res 1189: 145-151.
92. Spreckelmeyer KN, Kutas M, Urbach TP, Altenmüller E, Münte TF (2006) Combined perception of emotion in pictures and musical sounds. Brain Res 1070: 160-170.
93. Serafine ML, Davidson J, Crowder RG, Repp BH (1986) On the Nature of Melody-Text Integration in Memory for Songs. Journal of Memory and Language 25: 123-135.
94. Mietz A, Toepel U, Ischebeck A, Alter K (2008) Inadequate and infrequent are not alike: ERPs to deviant prosodic patterns in spoken sentence comprehension. Brain Lang 104: 159-169.
95. Schmidt-Kassow M, Kotz SA (2009) Event-related brain potentials suggest a late interaction of meter and syntax in the P600. J Cogn Neurosci 21: 1693-1708.
96. Lau E, Almeida D, Hines PC, Poeppel D (2009) A lexical basis for N400 context effects: evidence from MEG. Brain Lang 111: 161-172.
97. Kutas M, Federmeier KD (2000) Electrophysiology reveals semantic memory use in language comprehension. Trends Cogn Sci 4: 463-470.
98. Aramaki M, Marie C, Kronland-Martinet R, Ystad S, Besson M (in press) Sound Categorization and Conceptual Priming for Nonlinguistic and Linguistic Sounds. Journal of Cognitive Neuroscience.
99. Slevc LR, Rosenberg JC, Patel AD (2009) Making psycholinguistics musical: self-paced reading time evidence for shared processing of linguistic and musical syntax. Psychon Bull Rev 16: 374-381.
100. Schön D, Gordon R, Campagne A, Magne C, Astésano C, et al. (in press) Similar cerebral networks in language, music, and song perception. Neuro-Image.
101. Dissanayake E (2008) If music is the food of love, what about survival and reproductive success. Musicae Scientiae Special Issue. pp 169-195.
102. Bergeson TR, Trehub SE (1999) Mothers' Singing to Infants and Preschool Children. Infant Behavior & Development 22: 51-64.
103. Norton A, Zipse L, Marchina S, Schlaug G (2009) Melodic Intonation Therapy: shared insights on how it is done and why it might help. Ann N Y Acad Sci 1169: 431-436.