EEG correlates of song prosody: A new look at the relationship between linguistic and musical rhythm

Frontiers in Psychology

Volumn 2, Issue NOV, 2011, Pages

  Gordon, Reyna L ^a,b   Magne, Cyrille L ^c   Large, Edward W ^a  

^a FLORIDA ATLANTIC UNIVERSITY   (United States)

^b VANDERBILT UNIVERSITY MEDICAL CENTER   (United States)

^c MIDDLE TENNESSEE STATE UNIVERSITY   (United States)

Author keywords

Beta gamma oscillations; EEG; Language; Music; Prosody; Rhythm; Song perception; Textsetting

Indexed keywords

EID: 84867052870     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2011.00352     Document Type: Article

References (76)

1. Bastiaansen, M., and Hagoort, P. (2006). "Oscillatory neuronal dynamics during language comprehension," in Progress in Brain Research, eds C. Neuper and W. Klimesch (Amsterdam: Elsevier), 179-196.
2. Bastiaansen, M., Magyari, L., and Hagoort, P. (2010). Syntactic unification operations are reflected in oscillatory dynamics during on-line sentence comprehension. J. Cogn. Neurosci. 22, 1333-1347.
3. Boersma, P., and Weenink, D. (2007). Praat: Doing Phonetics by Computer. Available at http://www.praat.org [accessed February 6, 2007].
4. Brown, G. D. A. (1984). A frequency count of 190, 000 words in the London-Lund Corpus of English Conversation. Behav. Res. Methods Instrum. Comput. 16, 502-532.
5. Cutler, A., and Norris, D. (1988). The role of strong syllables in segmentation for lexical access. J. Exp. Psychol. Hum. Percept. Perform. 14, 113-121.
6. Dell, F., and Halle, J. (2005). "Comparing musical textsetting in French and in English songs," in Conference Proceedings from Typology of Poetic Forms, ed. J. L. Aroui, Paris.
7. Dilley, L. C., Mattys, S. L., and Vinke, L. (2010). Potent prosody: comparing the effects of distal prosody, proximal prosody, and semantic context on word segmentation. J. Mem. Lang. 63, 274-294.
8. Dilley, L. C., and McAuley, J. D. (2008). Distal prosodic context affects word segmentation and lexical processing. J. Mem. Lang. 59, 294-311.
9. Doppelmayr, M., Klimesch, W., Hodlmoser, K., Sauseng, P., and Gruber, W. (2005). Intelligence related upper alpha desynchronization in a semantic memory task. Brain Res. Bull. 66, 171-177.
10. Eerola, T., and Toiviainen, P. (2004). MIDI Toolbox: MATLAB Tools for Music Research. Available at http://www.jyu.fi/musica/miditoolbox/ [accessed June 30, 2005].
11. Fan, J., Byrne, J., Worden, M. S., Guise, K. G., Mccandliss, B. D., Fossella, J., and Posner, M. I. (2007). The relation of brain oscillations to attentional networks. J. Neurosci. 27, 6197-6206.
12. Field, J. (2005). Intelligibility and the listener: the role of lexical stress. TESOL Q. 39, 399-423.
13. Fujioka, T., Trainor, L. J., Large, E. W., and Ross, B. (2009). Beta and gamma rhythms in human auditory cortex during musical beat processing. Ann. N. Y. Acad. Sci. 1169, 89-92.
14. Geiser, E., Sandmann, P., Jancke, L., and Meyer, M. (2010). Refinement of metre perception training increases hierarchical metre processing. Eur. J. Neurosci. 32, 1979-1985.
15. Geiser, E., Ziegler, E., Jancke, L., and Meyer, M. (2009). Early electrophysiological correlates of meter and rhythm processing in music perception. Cortex 45, 93-102.
16. Gingold, H., and Abravanel, E. (1987). Music as a mnemonic: the effects of goodand bad-music setting on verbatim recall of short passages by young children. Psychomusicology 7, 25-39.
17. Glasser, M. F., and Rilling, J. K. (2008). DTI tractography of the human brain's language pathways. Cereb. Cortex 18, 2471-2482.
18. Gordon, R. L., Schön, D., Magne, C., Astésano, C., and Besson, M. (2010). Words and melody are intertwined in perception of sung words: EEG and behavioral evidence. PLoS ONE 5, e9889. doi:10.1371/journal.pone.0009889.
19. Grabner, R. H., Brunner, C., Leeb, R., Neuper, C., and Pfurtscheller, G. (2007). Event-related EEG theta and alpha band oscillatory responses during language translation. Brain Res. Bull. 72, 57-65.
20. Halle, J., and Lerdahl, F. (1993). A generative textsetting model. Curr. Musicol. 55, 3-23.
21. Hannon, E. E., Snyder, J. S., Eerola, T., and Krumhansl, C. L. (2004). The role of melodic and temporal cues in perceiving musical meter. J. Exp. Psychol. Hum. Percept. Perform. 30, 956-974.
22. Hayes, B., and Kaun, A. (1996). The role of phonological phrasing in sung and chanted verse. Linguist. Rev. 13, 243-303.
23. Herrmann, C. S., Grigutsch, M., and Busch, N. A. (2005). "EEG oscillations and wavelet analysis," in EventRelated Potentials: A Methods Handbook, ed. T. C. Handy (Cambridge, MA: MIT Press), 229-259.
24. Iversen, J. R., Repp, B. H., and Patel, A. D. (2009). Top-down control of rhythm perception modulates early auditory responses. Ann. N. Y. Acad. Sci. 1169, 58-73.
25. Jantzen, K. J., Fuchs, A., Mayville, J. M., Deecke, L., and Kelso, J. A. (2001). Neuromagnetic activity in alpha and beta bands reflect learning-induced increases in coordinative stability. Clin. Neurophysiol. 112, 1685-1697.
26. Jones, M. R. (2009). "Musical time," in Oxford Handbook of Music Psychology, eds S. Hallam, I. Cross, and M. Thaut (New York: Oxford University Press), 81-92.
27. Jones, M. R. (2010). "Attending to sound patterns and the role of entrainment," in Attention and Time, eds A. C. Nobre and J. T. Coull (New York: Oxford University Press), 317-330.
28. Jusczyk, P. W., Cutler, A., and Redanz, N. J. (1993). Infants' preference for the predominant stress patterns of English words. Child Dev. 64, 675-687.
29. Kelly, M. H., and Bock, J. K. (1988). Stress in time. J. Exp. Psychol. Hum. Percept. Perform. 14, 389-403.
30. Kelso, J. A. S., Tuller, B., and Harris, K. S. (1983). "A 'dynamic pattern' perspective on the control and coordination of movement," in The Production of Speech, ed. P. F. Macneilage (New York: Springer-Verlag), 138-173.
31. Kimball, C. (1996). Song: A Guide to Style and Literature. Washington: Pst Inc.
32. Klimesch, W., Doppelmayr, M., Schwaiger, J., Auinger, P., and Winkler, T. (1999). 'Paradoxical' alpha synchronization in a memory task. Brain Res. Cogn. Brain Res. 7, 493-501.
33. Klimesch, W., Sauseng, P., and Hanslmayr, S. (2007). EEG alpha oscillations: the inhibition-timing hypothesis. Brain Res. Rev. 53, 63-88.
34. Krause, C. M., Gronholm, P., Leinonen, A., Laine, M., Sakkinen, A. L., and Soderholm, C. (2006). Modality matters: the effects of stimulus modality on the 4to 30-Hz brain electric oscillations during a lexical decision task. Brain Res. 1110, 182-192.
35. Lakatos, P., Karmos, G., Mehta, A. D., Ulbert, I., and Schroeder, C. E. (2008). Entrainment of neuronal oscillations as a mechanism of attentional selection. Science 320, 110-113.
36. Large, E. W., and Jones, M. R. (1999). The dynamics of attending: how we track time varying events. Psychol. Rev. 106, 119-159.
37. Lidji, P., Jolicoeur, P., Moreau, P., Kolinsky, R., and Peretz, I. (2009). Integrated preattentive processing of vowel and pitch: a mismatch negativity study. Ann. N. Y. Acad. Sci. 1169, 481-484.
38. Lidji, P., Palmer, C., Peretz, I., and Morningstar, M. (2011). Listeners feel the beat: entrainment to English and French speech rhythms. Psychon. Bull. Rev. doi:10.3758/s13423011-0163-0.
39. Magne, C., Astésano, C., Aramaki, M., Ystad, S., Kronland-Martinet, R., and Besson, M. (2007). Influence of syllabic lengthening on semantic processing in spoken French: behavioral and electrophysiological evidence. Cereb. Cortex 17, 2659-2668.
40. Marie, C., Magne, C., and Besson, M. (2011). Musicians and the metric structure of words. J. Cogn. Neurosci. 23, 294-305.
41. Maris, E., and Oostenveld, R. (2007). Nonparametric statistical testing of.
42. EEGand MEG-data. J. Neurosci. Methods 164, 177-190.
43. Mattys, S. L., White, L., and Melhorn, J. F. (2005). Integration of multiple speech segmentation cues: a hierarchical framework. J. Exp. Psychol. Gen. 134, 477-500.
44. Mayville, J. M., Fuchs, A., Ding, M., Cheyne, D., Deecke, L., and Kelso, J. A. (2001). Event-related changes in neuromagnetic activity associated with syncopation and synchronization timing tasks. Hum. Brain Mapp. 14, 65-80.
45. Nozaradan, S., Peretz, I., Missal, M., and Mouraux, A. (2011). Tagging the neuronal entrainment to beat and meter. J. Neurosci. 31, 10234-10240.
46. Oostenveld, R., Fries, P., Maris, E., and Schoffelen, J. M. (2011). FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Comput. Intell. Neurosci. 2011, 156869.
47. Palmer, C., and Hutchins, S. (2006). "What is musical prosody?" in Psychology of Learning and Motivation, ed. B. H. Ross (Amsterdam: Elsevier Press), 245-278.
48. Palmer, C., and Kelly, M. (1992). Linguistic prosody and musical meter in song. J. Mem. Lang. 31, 525-542.
49. Palva, S., Palva, J. M., Shtyrov, Y., Kujala, T., Ilmoniemi, R. J., Kaila, K., and Naatanen, R. (2002). Distinct gamma-band evoked responses to speech and non-speech sounds in humans. J. Neurosci. 22, RC211.
50. Patel, A. D. (2008). Music, Language, and the Brain. New York: Oxford University Press.
51. Patel, A. D., Iversen, J. R., and Rosenberg, J. C. (2006). Comparing the rhythm and melody of speech and music: the case of British English and French. J. Acoust. Soc. Am. 119, 3034-3047.
52. Pitt, M. A., and Samuel, A. G. (1990). The use of rhythm in attending to speech. J. Exp. Psychol. Hum. Percept. Perform. 16, 564-573.
53. Port, R. (2003). Meter and speech. J. Phon. 31, 599-611.
54. Purnell-Webb, P., and Speelman, C. P. (2008). Effects of music on memory for text. Percept. Mot. Skills 106, 927-957.
55. Quené, H., and Port, R. F. (2005). Effects of timing regularity and metrical expectancy on spoken-word perception. Phonetica 62, 1-13.
56. Ramus, F., Nespor, M., and Mehler, J. (1999). Correlates of linguistic rhythm in the speech signal. Cognition 73, 265-292.
57. Rastle, K., Harrington, J., and Coltheart, M. (2002). 358, 534 nonwords: the ARC nonword database. Q. J. Exp. Psychol. 55A, 1339-1362.
58. Rodríguez-Vázquez, R. (2006). The metrics of folk song: a comparative study of text-setting in Spanish and English. Rhythmica Revista Española de Métrica Comparada 3-4, 253-281.
59. Sammler, D., Baird, A., Valabregue, R., Clement, S., Dupont, S., Belin, P., and Samson, S. (2010). The relationship of lyrics and tunes in the processing of unfamiliar songs: a functional magnetic resonance adaptation study. J. Neurosci. 30, 3572-3578.
60. Schirmer, A., Kotz, S. A., and Friederici, A. D. (2002). Sex differentiates the role of emotional prosody during word processing. Brain Res. Cogn. Brain Res. 14, 228-233.
61. Schmidt-Kassow, M., Schubotz, R. I., and Kotz, S. A. (2009). Attention and entrainment: P3b varies as a function of temporal predictability. Neuroreport 20, 31-36.
62. Schön, D., Gordon, R., Campagne, A., Magne, C., Astesano, C., Anton, J. L., and Besson, M. (2010). Similar cerebral networks in language, music and song perception. Neuroimage 51, 450-461.
63. Shahin, A. J., Picton, T. W., and Miller, L. M. (2009). Brain oscillations during semantic evaluation of speech. Brain Cogn. 70, 259-266.
64. Shields, J. L., Mchugh, A., and Martin, J. G. (1974). Reaction time to phoneme targets as a function of rhythmic cues in continuous speech. J. Exp. Psychol. 102, 250-255.
65. Smith, M. R., Cutler, A., Butterfield, S., and Nimmo-Smith, I. (1989). The perception of rhythm and word boundaries in noise-masked speech. J. Speech Hear. Res. 32, 912-920.
66. Snyder, J. S., and Large, E. W. (2005). Gamma-band activity reflects the metric structure of rhythmic tone sequences. Cogn. Brain Res. 24, 117-126.
67. Stefanics, G., Hangya, B., Hernadi, I., Winkler, I., Lakatos, P., and Ulbert, I. (2010). Phase entrainment of human delta oscillations can mediate the effects of expectation on reaction speed. J. Neurosci. 30, 13578-13585.
68. Tajima, K., Port, R., and Dalby, J. (1997). Effects of temporal correction on intelligibility of foreignaccented English. J. Phon. 25, 1-24.
69. Tallon-Baudry, C., and Bertrand, O. (1999). Oscillatory gamma activity in humans and its role in object representation. Trends Cogn. Sci. (Regul. Ed.) 3, 151-162.
70. Tallon-Baudry, C., Bertrand, O., Delpuech, C., and Pernier, J. (1996). Stimulus specificity of phase-locked and non-phase-locked 40 Hz visual responses in human. J. Neurosci. 16, 4240-4249.
71. Van Elk, M., Van Schie, H. T., Zwaan, R. A., and Bekkering, H. (2010). The functional role of motor activation in language processing: motor cortical oscillations support lexicalsemantic retrieval. Neuroimage 50, 665-677.
72. Vlek, R. J., Schaefer, R. S., Gielen, C. C., Farquhar, J. D., and Desain, P. (2011). Sequenced subjective accents for brain-computer interfaces. J. Neural Eng. 8, 036002.
73. Wallace, W. T. (1994). Memory for music: effect of melody recall on text. J. Exp. Psychol. 20, 1471-1485.
74. Wallace, W. T., and Rubin, D. C. (1988). "'The Wreck of the Old 97': a real event remembered in song," in Remembering Reconsidering: Ecological and Traditional Approaches to the Study of Memory, edsU. Niesser and E. Winograd (Cambridge:Cambridge University Press), 283-310.
75. Wang, J., Friedman, D., Ritter, W., and Bersick, M. (2005). ERP correlates of involuntary attention capture by prosodic salience in speech. Psychophysiology 42, 43-55.
76. Zanto, T. P., Large, E. W., Fuchs, A., and Kelso, J. A. S. (2005). Gamma-band responses to perturbed auditory sequences: evidence for synchronization of perceptual processes. Music Percept. 22, 535-552.