Perception of words and pitch patterns in song and speech

Frontiers in Psychology

Volumn 3, Issue MAR, 2012, Pages

  Merrill, Julia ^a   Sammler, Daniela ^a   Bangert, Marc ^a,b   Goldhahn, Dirk ^a   Lohmann, Gabriele ^a   Turner, Robert ^a   Friederici, Angela D ^a  

^a MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

^b DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

FMRI; Melody; MVPA; Pitch; Prosody; Song; Speech; Words

Indexed keywords

EID: 84867058148     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2012.00076     Document Type: Article

References (80)

1. Abrams, D. A., Bhatara, A., Ryali, S., Balaban, E., Levitin, D. J., and Menon, V. (2011). Decoding temporal structure in music and speech relies on shared brain resources but elicits different fine-scale spatial patterns. Cereb. Cortex 21, 1507-1518.
2. Bode, S., Bogler, C., Soon, C. S., and Haynes, J. D. (2012). The neural encoding of guesses in the human brain. Neuroimage 59, 1924-1931.
3. Boemio, A., Fromm, S., Braun, A., and Poeppel, D. (2005). Hierarchical and asymmetric temporal sensitivity in human auditory cortex. Nat. Neurosci. 3, 389-395.
4. Bogler, C., Bode, S., and Haynes, J. D. (2011). Decoding successive computational stages of saliency processing. Curr. Biol. 21, 1667-1671.
5. Bookheimer, S. (2002). Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. Annu. Rev. Neurosci. 25, 151-188.
6. Brown, S., and Martinez, M. J. (2007). Activation of premotor vocal areas during musical discrimination. Brain Cogn. 63, 59-69.
7. Brown, S., Martinez, M. J., and Parsons, L. M. (2006). Music and language side by side in the brain: a PET study of the generation of melodies and sentences. Eur. J. Neurosci. 23, 2791-2803.
8. Brown, S., Ngan, E., and Liotti, M. (2008). A larynx area in the human motor cortex. Cereb. Cortex 18, 837-845.
9. Brown, S., and Weishaar, K. (2010). Speech is heterometric: the changing rhythms of speech. Speech Prosody 100074, 1-4.
10. Callan, D. E., Kawato, M., Parsons, L., and Turner, R. (2007). Speech and song: the role of the cerebellum. Cerebellum 6, 321-327.
11. Callan, D. E., Tsytsarev, V., Hanakawa, T., Callan, A. M., Katsuhara, M., Fukuyama, H., and Turner, R. (2006). Song and speech: brain regions involved with perception and covert production. Neuroimage 31, 1327-1342.
12. Chang, E. F., Rieger, J. W., Johnson, K., Berger, M. S., Barbaro, N. M., and Knight, R. T. (2010). Categorical speech representation in human superior temporal gyrus. Nat. Neurosci. 13, 1428-1433.
13. Eickhoff, S., Stephan, K. E., Mohlberg, H., Grefkes, C., Fink, G. R., Amunts, K., and Zilles, K. (2005). A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. Neuroimage 25, 1325-1335.
14. Fitch, W. T. (2006). The biology and evolution of music: a comparative perspective. Cognition 100, 173-215.
15. Foster, N., and Zatorre, R. (2010). A role for the intraparietal sulcus in transforming musical pitch information. Cereb. Cortex 20, 1350-1359.
16. Friederici, A. D. (2002). Towards a neural basis of auditory sentence processing. Trends Cogn. Sci. (Regul. Ed.) 6, 78-84.
17. Friederici, A. D. (2011). The brain basis of language: from structure to function. Physiol. Rev. 9, 1357-1392.
18. Gandour, J., Dzemidzic, M., Wong, D., Lowe, M., Tong, Y., Hsieh, L., Satthamnuwong, N., and Lurito, J. (2003). Temporal integration of speech prosody is shaped by language experience: an fMRI study. Brain Lang. 84, 318-336.
19. Gandour, J., Tong, Y., Wong, D., Talavage, T., Dzemidzic, M., Xu, Y., Li, X., and Lowew, M. (2004). Hemispheric roles in the perception of speech prosody. Neuroimage 23, 344-357.
20. Gandour, J., Wong, D., Hsieh, L., Weinzapfel, B., Van Lancker, D., and Hutchins, G. D. (2000). A crosslinguistic PET study of tone perception. J. Cogn. Neurosci. 12, 207-222.
21. Giraud, A. L., Kell, C., Thierfelder, C., Sterzer, P., Russ, M. O., Preibisch, C., and Kleinschmidt, A. (2004). Contributions of sensory input, auditory search and verbal comprehension to cortical activity during speech processing. Cereb. Cortex 14, 247-255.
22. Grefkes, C., and Fink, G. R. (2005). The functional organization of the intraparietal sulcus in humans and monkeys. J. Anat. 207, 3-17.
23. Griffiths, T., and Warren, J. D. (2002). The planum temporale as a computational hub. Trends Neurosci. 25, 348-353.
24. Gunji, A., Ishii, R., Chau, W., Kakigi, R., and Pantev, C. (2007). Rhythmic brain activities related to singing in humans. Neuroimage 34, 426-434.
25. Halpern, A. R., and Zatorre, R. J. (1999). When that tune runs through your head: a PET investigation of auditory imagery for familiar melodies. Cereb. Cortex 9, 697-704.
26. Hanke, M., Halchenko, Y. O., Sederberg, P. B., Hanson, S. J., Haxby, J. V., and Pollmann, S. (2009). PyMVPA: a python toolbox for multivariate pattern analysis of f(mri) data. Neuroinformatics 7, 37-53.
27. Haxby, J., Gobbini, M., Furey, M., Ishai, A., Schouten, J., and Pietrini, P. (2001). Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293, 2425-2430.
28. Haynes, J. D., and Rees, G. (2005). Predicting the orientation of invisible stimuli from activity in human primary visual cortex. Nat. Neurosci. 8, 686-691.
29. Haynes, J. D., and Rees, G. (2006). Decoding mental states from brain sensitivity in humans. Nat. Rev. Neurosci. 7, 523-534.
30. Hickok, G., Buchsbaum, B., Humphries, C., and Muftuler, T. (2003). Auditory-motor interaction revealed by f(mri): speech, music, and working memory in area Spt. J. Cogn. Neurosci. 15, 673-682.
31. Hsieh, L., Gandour, J., Wong, D., and Hutchins, G. D. (2001). Functional heterogeneity of inferior frontal gyrus is shaped by linguistic experience. Brain Lang. 76, 227-252.
32. Husain, M., and Nachev, P. (2007). Space and the parietal cortex. Trends Cogn. Sci. (Regul. Ed.) 11, 30-36.
33. Jamison, H. L., Watkins, K. E., Bishop, D. V. M., and Matthews, P. M. (2006). Hemispheric specialization for processing auditory nonspeech stimuli. Cereb. Cortex 16, 1266-1275.
34. Jeffries, K. J., Fritz, J. B., and Braun, A. R. (2003). Words in melody: an H2 15O PET study of brain activation during singing and speaking. Neuroreport 14, 749-754.
35. Kahnt, T., Grueschow, O., Speck, O., and Haynes, J. D. (2011). Perceptual learning and decision-making in human medial frontal cortex. Neuron 70, 549-559.
36. Kleber, B., Birbaumer, N., Veit, R., Trevorrow, T., and Lotze, M. (2007). Overt and imagined singing of an italian aria. Neuroimage 36, 889-900.
37. Kleber, B., Veit, R., Birbaumer, N., Gruzelier, J., and Lotze, M. (2010). The brain of opera singers: experience-dependent changes in functional activation. Cereb. Cortex 20, 1144-1152.
38. Klein, J. C., and Zatorre, R. (2011). A role for the right superior temporal sulcus in categorical perception of musical chords. Neuropsychologia 49, 878-887.
39. Klein, J. C., Zatorre, R., Milner, B., and Zhao, V. (2001). A crosslinguistic PET study of tone perception in mandarin chinese and english speakers. Neuroimage 13, 646-653.
40. Koelsch, S., and Siebel, W. A. (2005). Towards a neural basis of music perception. Trends Cogn. Sci. (Regul. Ed.) 9, 578-584.
41. Kotz, S. A., Meyer, M., Alter, K., Besson, M., and von Cramon, Y. D. (2003). On the lateralization of emotional prosody: an event-related functional MR investigation. Brain Lang. 86, 366-376.
42. Kriegeskorte, N., Goebel, R., and Bandettini, P. (2006). Informationbased functional brain mapping. Proc. Natl. Acad. Sci. U.S.A. 103, 3863-3868.
43. Lerdahl, F., and Jackendoff, R. (1983). A Generative Theory of Tonal Music. Cambridge, MA: MIT Press.
44. Meyer, M., Alter, K., Friederici, A. D., Lohmann, G., and von Cramon, D.Y. (2002). FMRI reveals brain regions mediating slow prosodic modulationsinspokensentences.Hum. Brain Mapp. 17, 73-88.
45. Meyer, M., Steinhauer, K., Alter, K., Friederici, A. D., and von Cramon, D. Y. (2004). Brain activity varies with modulation of dynamic pitch varianceinsentencemelody.Brain Lang. 89, 277-289.
46. Nichols, T., Brett, M., Andersson, J., Wager, T., and Poline, J.-B. (2005). Valid conjunction inference with the minimum statistic. Neuroimage 25, 653-660.
47. Norman, K. A., Polyn, S. M., Detre, G. J., and Haxby, J. V. (2006). Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. (Regul. Ed.) 10, 424-430.
48. Obleser, J., Eisner, F., and Kotz, S. (2008). Bilateral speech comprehension reflects differential sensitivity to spectral and temporal features. J. Neurosci. 28, 8116-8124.
49. Okada, K., Rong, F., Venezia, J., Matchin, W., Hsieh, I., Saberi, K., Serences, J. T., and Hickok, G. (2010). Hierarchical organization of human auditory cortex: evidence from acoustic invariance in the response to intelligible speech. Cereb. Cortex 20, 2486-2495.
50. Özdemir, E., Norton, A., and Schlaug, G. (2006). Shared and distinct neural correlates of singing and speaking. Neuroimage 33, 628-635.
51. Patel, A. D. (2008). Language, Music, Syntax, and the Brain. NewYork: Oxford University Press.
52. Patterson, R. D., Uppenkamp, S., Johnsrude, I. S., and Griffiths, T. D. (2002). The processing of temporal and melody information in auditory cortex. Neuron 36, 767-776.
53. Perry, D.W., Zatorre, Robert, J., Petrides, M., Alivisatos, B., Meyer, E., and Evans, A. C. (1999). Localization of cerebral activity during simple singing. Neuroreport 10, 3979-3984.
54. Petacchi, A., Laird, A. R., Fox, P. T., and Bower, J. M. (2005). Cerebellum and auditory function: anALE metaanalysis of functional neuroimaging studies. Hum. Brain Mapp. 25, 118-128.
55. Plante, E., Creusere, M., and Sabin, C. (2002). Dissociating sentential prosody from sentence processing: activation interacts with task demands. Neuroimage 17, 401-410.
56. Poeppel, D., Guillemin, A., Thompson, J., Fritz, J., Bavelier, D., and Braun, A. R. (2004). Auditory lexical decision, categorical perception, and FM direction discriminates differentially engage left and right auditory cortex. Neuropsychologia 42, 183-200.
57. Riecker, A., Wildgruber, D., Dogil, G., Grodd, W., and Ackermann, H. (2002). Hemispheric lateralization effects of rhythm implementation during syllable repetitions: an fMRI study. Neuroimage 16, 169-176.
58. Saito, Y., Ishii, K., Yagi, K., Tatsumi, I. F., and Mizusawa, H. (2006). Cerebral networks for spontaneous and synchronized singing and speaking. Neuroreport 17, 1893-1897.
59. Sammler, D., Baird, A., Valabreque, R., Clement, S., Dupont, S., Belin, P., and Samson, S. (2010). The relationship of lyrics and tunes in the processing of unfamiliar songs: a functional magnetic resonance adaptation study. J. Neurosci. 30, 3572-3578.
60. Samson, F., Zeffiero, T. A., Toussaint, A., and Belin, P. (2011). Stimulus complexity and categorical effects in human auditory cortex: an activation likelihood estimation meta-analysis. Front. Psychol. 1:241. doi:10.3389/fpsyg.2010.00241.1-23
61. Schmahmann, J. D., Doyon, J., Toga, A. W., Petrides, M., and Evans, A. C. (2000). MRI Atlas of the Human Cerebellum. San Diego, CA: Academic Press.
62. Schmithorst, V. J. (2005). Separate cortical networks involved in music perception: preliminary functional MRI evidence for modularity of music processing. Neuroimage 25, 444-451.
63. Schön, D., Gordon, R., Campagne, A., Magne, C., Astesano, C. J.-L. A., and Besson, M. (2010). Similar cerebral networks in language, music and song perception. Neuroimage 51, 450-461.
64. Schönwiesner, M., and Zatorre, R. J. (2008). Depth electrode recording show double dissociation between
65. Seidner, W., and Wendler, J. (1978). Die Sängerstimme. Berlin: Henschel Verlag.
66. Stoodley, C. J., and Schmahmann, J. D. (2009). Functional topography in the human cerebellum: a metaanalysis of neurimaging studies. Neuroimage 44, 489-501.
67. Sundberg, J. (1970). Formant structure and articulation of spoken and sung vowels. Folia Phoniatr. (Basel) 22, 28-48.
68. Tillmann, B., Koelsch, S., Escoffier, N., Bigand, E., Lalitte, P., Friederici, A. D., and von Cramon, D. Y. (2006). Cognitive priming in sung and instrumental music: activation of inferior frontal cortex. Neuroimage 31, 1771-1782.
69. Tusche, A., Bode, S., and Haynes, J. D. (2010). Neural responses to unattended products predict later consumer choices. J. Neurosci. 30, 8024-8031.
70. Warren, J. D., Jennings, A. R., and Griffiths, T. D. (2005). Analysis of the spectral envelope of sounds by the human brain. Neuroimage 24, 1052-1057.
71. Westbury, C. F., Zatorre, R. J., and Evans, A. C. (1999). Quantitative variability in the planum temporale: a probability map. Cereb. Cortex 9, 392-405.
72. Wildgruber, D., Ackermann, H., Klose, U., Kardatzki, B., and Grodd, W. (1996). Functional lateralization of speech production at primary motor cortex: a fMRI study. Neuroreport 7, 2791-2795.
73. Wildgruber, D., Pihan, H., Ackermann, M., Erb, M., and Grodd, W. (2002). Dynamic brain activation during processing of emotional intonation: influence of acoustic parameters, emotional valence, and sex. Neuroimage 15, 856-869.
74. Wilson, S. M., Saygin, A. P., Sereno, M., and Iacoboni, M. (2004). Listening to speech activates motor areas involved in speech production. Nature 7, 701-702.
75. Zatorre, R., Evans, A. C., Meyer, E., and Gjedde, A. (1992). Lateralization of phonetic and pitch discrimination in speech processing. Science 256, 846-849.
76. Zatorre, R., Halpern, A. R., and Bouffard, M. (2009). Mental reversal of imagined melodies: a role for the posterior parietal cortex. J. Cogn. Neurosci. 22, 775-789.
77. Zatorre, R. J. (2001). Neural specializations for tonal processing. Ann. N. Y. Acad. Sci. 930, 193-210.
78. Zatorre, R. J., and Belin, P. (2001). Spectral and temporal processing in human auditory cortex. Cereb. Cortex 11, 946-953.
79. Zatorre, R. J., Belin, P., and Penhune, V. B. (2002). Structure and function of auditory cortex: music and speech. Trends Cogn. Sci. (Regul. Ed.) 6, 37-46.
80. Zatorre, R. J., Evans, A. C., and Meyer, E. (1994). Neural mechanisms underlying melodic perception and memory for pitch. J. Neurosci. 14, 1908-1919.