A multimodal neural network recruited by expertise with musical notation

Journal of Cognitive Neuroscience

Volumn 22, Issue 4, 2010, Pages 695-713

  Wong, Yetta Kwailing ^a   Gauthier, Isabel ^a  

^a VANDERBILT UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BEHAVIORAL RESEARCH; CONTROLLED STUDY; CORRELATION ANALYSIS; ELECTROENCEPHALOGRAM; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MATHEMATICS; MUSIC; NERVE CELL NETWORK; NEUROIMAGING; PERCEPTION; PRIORITY JOURNAL; READING; VISION; VISUAL SYSTEM;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; BRAIN; BRAIN MAPPING; COHORT STUDIES; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MATHEMATICS; MUSIC; NEURAL NETWORKS (COMPUTER); OXYGEN; PHOTIC STIMULATION; REACTION TIME; READING; YOUNG ADULT;

EID: 77649207396     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn.2009.21229     Document Type: Article

References (83)

1. Aramaki, Y., Honda, M., Okada, T., & Sadato, N. (2006). Neural correlates of the spontaneous phase transition during bimanual coordination. Cerebral Cortex, 16, 1338-1348.
2. Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617-645.
3. Beauchamp, M. S. (2005). See me, hear me, touch me: Multisensory integration in lateral occipital-temporal cortex. Current Opinion in Neurobiology, 15, 145-153.
4. Bengtsson, S. L., Nagy, Z., Skare, S., Forsman, L., Forssberg, H., & Ullen, F. (2005). Extensive piano practicing has regionally specific effects on white matter development. Nature Neuroscience, 8, 1148-1150.
5. Bookheimer, S. Y. (2002). Functional MRI of language: New approaches to understanding the cortical organization of semantic processing. Annual Review of Neuroscience, 25, 151-188.
6. Booth, J. R., Burman, D. D., Meyer, J. R., Gitelman, D. R., Parrish, T. B., & Mesulam, M. M. (2004). Development of brain mechanisms for processing orthographic and phonologic representations. Journal of Cognitive Neuroscience, 16, 1234-1249.
7. Boynton, G. M., Engel, S. A., Glover, G. H., & Heeger, D. J. (1996). Linear systems analysis of functional magnetic resonance imaging in human V1. Journal of Neuroscience, 16, 4207-4221.
8. Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10, 433-436.
9. Brochard, R., Dufour, A., & Després, O. (2004). Effect of musical experience on visuospatial abilities: Evidence from reaction times and mental imagery. Brain and Cognition, 54, 103-109.
10. Brodsky, W., Kessler, Y., Rubinstein, B.-S., Ginsborg, J., & Henik, A. (2008). The mental representation ofmusic notation: Notational audiation. Journal of Experimental Psychology: Human Perception and Performance, 34, 427-445.
11. Buxton, R. B., Uludag, K., Dubowitz, D. J., & Liu, T. T. (2004). Modeling the hemodynamic response to brain activation. Neuroimage, 23(Suppl. 1), S220-S233.
12. Callan, D. E., Tsytsarev, V., Hanakawa, T., Callan, A. M., Katsuhara, M., Fukuyama, H., et al. (2006). Song and speech: Brain regions involved with perception and covert production. Neuroimage, 31, 1327-1342.
13. Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C. R., McGuire, P. K., et al. (1997). Activation of auditory cortex during silent lipreading. Science, 276, 593-596.
14. Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998). Anterior cingulate cortex, error detection, and the online monitoring of performance. Science, 280, 747-749.
15. Chao, L. L., Haxby, J. V., & Martin, A. (1999). Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nature Neuroscience, 2, 913-919.
16. Chase, W. G., & Simon, H. A. (1973). Perception in chess. Cognitive Psychology, 4, 55-81.
17. Cohen, L., Dehaene, S., Naccache, L., Lehericy, S., Dehaene-Lambertz, G., Henaff, M. A., et al. (2000). The visual word form area: Spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients. Brain, 123, 291-307.
18. Deutsch, D. (1998). The psychology of music (2nd ed.). London: Academic Press.
19. Downing, P. (2001). A cortical area selective for visual processing of the human body. Science, 293, 2470-2473.
20. Elbert, T., Pantev, C., Wienbruch, C., Rockstroh, B., & Taub, E. (1995). Increased cortical representation of the fingers of the left hand in string players. Science, 270, 305-307.
21. Epstein, R., Harris, A., Stanley, D., & Kanwisher, N. (1999). The parahippocampal place area: Recognition, navigation, or encoding? Neuron, 23, 115-125.
22. Epstein, R., & Kanwisher, N. (1998). A cortical representation of the local visual environment. Nature, 392, 598-601.
23. Gauthier, I. (2000). What constrains the organization of the ventral temporal cortex? Trends in Cognitive Sciences, 4, 1-2.
24. Gauthier, I., Curran, T., Curby, K. M., & Collins, D. (2003). Perceptual interference supports a non-modular account of face processing. Nature Neuroscience, 6, 428-432.
25. Gauthier, I., James, T. W., Curby, K. M., & Tarr, M. J. (2003). The influence of conceptual knowledge on visual discrimination. Cognitive Neuropsychology, 20, 507-523.
26. Gauthier, I., Skudlarski, P., Gore, J. C., & Anderson, A. W. (2000). Expertise for cars and birds recruits brain areas involved in face recognition. Nature Neuroscience, 3, 191-197.
27. Gauthier, I., Tarr, M. J., Anderson, A. W., Skudlarski, P., & Gore, J. C. (1999). Activation of the middle fusiform "face area" increases with expertise in recognizing novel objects. Nature Neuroscience, 2, 568-573.
28. Gauthier, I., Wong, A. C.-N., Hayward, W. G., & Cheung, O. S. (2006). Font tuning associated with expertise in letter perception. Perception, 35, 541-559.
29. Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2002). Human neural systems for face recognition and social communication. Biological Psychiatry, 51, 59-67.
30. Hickok, G., Buchsbauum, B., Humphries, C., & Muftuler, T. (2003). Auditory-motor interaction revealed by fMRI: Speech, music, and working memory in area Spt. Journal of Cognitive Neuroscience, 15, 673-682.
31. Hund-Georgiadis, M., & von Cramon, D. Y. (1999). Motor-learning- related changes in piano players and non-musicians revealed by functional magnetic-resonance signals. Experimental Brain Research, 125, 417-425.
32. Ito, S., Stuphorn, V., Brown, J. W., & Shall, J. D. (2003). Performance monitoring by the anterior cingulate cortex during saccade countermanding. Science, 302, 120-122.
33. James, K. H., & Gauthier, I. (2006). Letter processing automatically recruits a sensory-motor brain network. Neuropsychologia, 44, 2937-2949.
34. James, K. H., James, T. W., Jobard, G., Wong, A. C., & Gauthier, I. (2005). Letter processing in the visual system: Different activation patterns for single letters and strings. Cognitive, Affective & Behavioral Neuroscience, 5, 452-466.
35. James, T. W., & Gauthier, I. (2003). Auditory and action semantic features activate sensory-specific perceptual brain regions. Current Biology, 13, 1792-1796.
36. Janata, P., Birk, J. K., van Horn, J. D., Leman, M., Tillmann, B., & Bharucha, J. J. (2002). The cortical topography of tonal structures underlying western music. Science, 298, 2167-2170.
37. Jiang, X., Bradley, E., Rini, R. A., Zeffiro, T., Vanmeter, J., & Riesenhuber, M. (2007). Categorization training results in shape- and category-selective human neural plasticity. Neuron, 53, 891-903.
38. Kanwisher, N., McDermott, J., & Chun, M. M. (1997). The fusiform face area: A module in human extrastriate cortex specialized for face perception. Journal of Neuroscience, 17, 4302-4311.
39. Katanoda, K., Yoshikawa, K., & Sugishita, M. (2001). A functional MRI study on the neural substrates for writing. Human Brain Mapping, 13, 34-42.
40. Levine, L. R., Morsella, E., & Barge, J. A. (2007). The perversity of inanimate objects: Stimulus control by incidental musical notation. Social Cognition, 25, 267-283.
41. Levitin, D. J., & Menon, V. (2003). Musical structure is processed in "language" areas of the brain: A possible role for Brodmann area 47 in temporal coherence. Neuroimage, 20, 2142-2152.
42. Longcamp, M., Anton, J. L., Roth, M., & Velay, J. L. (2005). Premotor activations in response to visually presented single letters depend on the hand used to write: A study on left-handers. Neuropsychologia, 43, 1801-1809.
43. Longcamp, M., Tanskanen, T., & Hari, R. (2006). The imprint of action: Motor cortex involvement in visual perception of handwritten letters. Neuroimage, 33, 681-688.
44. Mahon, B. Z., & Caramazza, A. (2008). A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content. Journal of Physiology (Paris), 102, 59-70.
45. Martin, A., Wiggs, C. L., Ungerleider, L. G., & Haxby, J. V. (1996). Neural correlates of category-specific knowledge. Nature, 379, 649-652.
46. Moore, C. D., Cohen, M. X., & Ranganath, C. (2006). Neural mechanisms of expert skills in visual working memory. Journal of Neuroscience, 26, 11187-11196.
47. Mukai, I., Kim, D., Fukunaga, M., Japee, S., Marrett, S., & Ungerleider, L. G. (2007). Activations in visual and attention-related areas predict and correlate with the degree of perceptual learning. Journal of Neuroscience, 27, 11401-11411.
48. Nakada, T., Fujii, Y., Suzuki, K., & Kwee, I. L. (1998). "Musical brain" revealed by high-field (3 Tesla) functional MRI. NeuroReport, 9, 3853-3856.
49. Op de Beeck, H. P., Baker, C. I., DiCarlo, J. J., & Kanwisher, N. G. (2006). Discrimination training alters object representations in human extrastriate cortex. Journal of Neuroscience, 26, 13025-13036.
50. Pantev, C., Oostenveld, R., Engelien, A., Ross, B., Roberts, L. E., & Hoke, M. (1998). Increased auditory cortical representation in musicians. Nature, 392, 811-814.
51. Patel, A. D. (2003). Language, music, syntax and the brain. Nature Neuroscience, 6, 674-681.
52. Peelen, M. V., & Downing, P. E. (2007). The neural basis of visual body perception. Nature Reviews Neuroscience, 8, 636-648.
53. Pelli, D. G. (1997). The videotoolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10, 437-442.
54. Peretz, I., & Zatorre, R. J. (2003). The cognitive neuroscience of music. New York: Oxford University Press.
55. Polk, T. A., Stallcup,M., Aguirre,G. K., Alsop,D. C.,D'Esposito,M., Detre, J. A., et al. (2002). Neural specialization for letter recognition. Journal of Cognitive Neuroscience, 14, 145-159.
56. Puce, A., Allison, T., Asgari, M., Gore, J. C., & McCarthy, G. (1996). Differential sensitivity of human visual cortex to faces, letterstrings, and textures: A functional magnetic resonance imaging study. Journal of Neuroscience, 16, 5205-5215.
57. Ramnani, N., Toni, I., Passingham, R. E., & Haggard, P. (2001). The cerebellum and parietal cortex play a specific role in coordination: A PET study. Neuroimage, 14, 899-911.
58. Reddy, L., & Kanwisher, N. (2006). Coding of visual objects in the ventral stream. Current Opinion in Neurobiology, 16, 408-414.
59. Rogers, B. P., Morgan, V. L., Newton, A. T., & Gore, J. C. (2007). Assessing functional connectivity in the human brain by fMRI. Magnetic Resonance Imaging, 25, 1347-1357.
60. Roland, P. E., & Zilles, K. (1996). Functions and structures of the motor cortices in humans. Current Opinion in Neurobiology, 6, 773-781.
61. Rosenblum, L. D. (2008). Speech perception as a multimodal phenomenon. Current Directions in Psychological Science, 17, 405-409.
62. Sakai, K., Hikosaka, O., & Nakamura, K. (2004). Emergence of rhythm during motor learning. Trends in Cognitive Sciences, 8, 547-553.
63. Schiltz, C., Bodart, J. M., Dubois, S., Dejardin, S., Michel, C., Roucoux, A., et al. (1999). Neuronal mechanisms of perceptual learning: Changes in human brain activity with training in orientation discrimination. Neuroimage, 9, 46-62.
64. Schlaug, G., Jäncke, L., Huang, Y., & Steinmetz, H. (1995). In vivo evidence of structural brain asymmetry in musicians. Science, 267, 699-701.
65. Schön, D., Anton, J. L., Roth, M., & Besson, M. (2002). An fMRI study of music sight-reading. NeuroReport, 13, 2285-2289.
66. Seitz, A. R., Kim, R., & Shams, L. (2006). Sound facilitates visual learning. Current Biology, 16, 1422-1427.
67. Sergent, J., Zuck, E., Terriah, S., & MacDonald, B. (1992). Distributed neural network underlying musical sight-reading and keyboard performance. Science, 257, 106-109.
68. Sigman, M., Pan, H., Yang, Y., Stern, E., Silbersweig, D., & Gilbert, C. D. (2005). Top-down reorganization of activity in the visual pathway after learning a shape identification task. Neuron, 46, 823-835.
69. Simmons, W. K., Martin, A., & Barsalou, L. W. (2005). Pictures of appetizing foods activate gustatory cortices for taste and reward. Cerebral Cortex, 15, 1602-1608.
70. Sloboda, J. (1981). The uses of space in music notation. Visible Language, 25, 86-110.
71. Stewart, L., Henson, R., Kampe, K., Walsh, V., Turner, R., & Frith, U. (2003). Brain changes after learning to read and play music. Neuroimage, 20, 71-83.
72. Sugihara, G., Kaminaga, T., & Sugishita, M. (2006). Interindividual uniformity and variety of the "writing center" a functional MRI study. Neuroimage, 32, 1837-1849.
73. Tettamanti, M., Paulesu, E., Scifo, P., Maravita, A., Fazio, F., Perani, D., et al. (2002). Interhemispheric transmission of visuomotor information in humans: fMRI evidence. Journal of Neurophysiology, 88, 1051-1058.
74. Van Atteveldt, N., Formisano, E., Goebel, R., & Blomert, L. (2004). Integration of letters and speech sounds in the human brain. Neuron, 43, 271-282.
75. Watson, A. B., & Pelli, D. G. (1983). QUEST: A Bayesian adaptive psychometric method. Perception & Psychophysics, 33, 113-120.
76. Weber, B., Treyer, V., Oberholzer, N., Jaermann, T., Boesiger, P., Brugger, P., et al. (2005). Attention and interhemispheric transfer: A behavioral and fMRI study. Journal of Cognitive Neuroscience, 17, 113-123.
77. Wong, A. C.-N., Jobard, G., James, K. H., James, T. W., & Gauthier, I. (in press). Expertise with characters in alphabetic and nonalphabetic writing systems engage overlapping occipito-temporal areas. Cognitive Neuropsychology.
78. Wong, C.-N., & Gauthier, I. (2006). An analysis of letter expertise in a levels-of-categorization framework. Visual Cognition, 15, 854-879.
79. Xu, Y. (2005). Revisiting the role of the fusiform face area in visual expertise. Cerebral Cortex, 15, 1234-1242.
80. Xue, G., & Poldrack, R. A. (2007). The neural substrates of visual perceptual learning of words: Implications for the visual word form area hypothesis. Journal of Cognitive Neuroscience, 19, 1643-1655.
81. Zatorre, R. J., Belin, P., & Penhune, V. B. (2002). Structure and function of auditory cortex: Music and speech. Trends in Cognitive Sciences, 6, 37-46.
82. Zatorre, R. J., Chen, J. L., & Penhune, V. B. (2007). When the brain plays music: Auditory-motor interactions in music perception and production. Nature Reviews Neuroscience, 8, 547-558.
83. Zatorre, R. J., & Peretz, I. (2001). The biological foundations of music ( Vol. 930). New York: New York Academy of Sciences.