Using spatial manipulation to examine interactions between visual and auditory encoding of pitch and time

Frontiers in Psychology

Volumn 1, Issue DEC, 2010, Pages

  McLachlan, Neil M ^a   Greco, Loretta J ^a   Toner, Emily C ^a   Wilson, Sarah J ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Auditory; Encoding; Music; Notation; Pitch; Spatial manipulation; Time; Visual

Indexed keywords

EID: 84867062054     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2010.00233     Document Type: Article

References (68)

1. Arnott, S. R., Binns, M. A., Grady, C. L., and Alain, C. (2004). Assessing the auditory dual-pathway model in humans. Neuroimage 22, 401-408.
2. Bauer, M. I., and Johnson-Laird, P. N. (1993). How diagrams can improve reasoning. Psychol. Sci. 4, 372-378.
3. Beecham, R., Reeve, R. A., and Wilson, S. J. (2009). Spatial representations are specific to different domains of knowledge. PLoS ONE 4, e5543. doi: 10.1371/journal.pone.0005543.
4. Bendor, D., and Wang, X. (2005). The neuronal representation of pitch in primate auditory cortex. Nature 436, 1161-1165.
5. Bermudez, P., and Zatorre, R. J. (2005). Conditional associative memory for musical stimuli in nonmusicians: implications for absolute pitch. J. Neurosci. 25, 7718-7723.
6. Bitterman, Y., Mukamel, R., Malach, R., Fried, I., and Nelken, I. (2008). Ultrafine frequency tuning revealed in single neurons of human auditory cortex. Nature 451, 197-202.
7. Bor, D., Duncan, J., Wiseman, R. J., and Owen, A. M. (2003). Encoding strategies dissociate prefrontal activity from working memory demand. Neuron 37, 361-367.
8. Cowan, N. (1988). Evolving conceptions of memory storage, selective attention, and their mutual constraints within the human information-processing system. Psychol. Bull. 104, 163-191.
9. Cuddy, L. L., and Badertscher, B. (1987). Recovery of the tonal hierarchy: some comparisons across age and levels of musical experience. Percept. Psychophysics 41, 609-620.
10. Cupchik, G. C., Phillips, K., and Hill, D. S. (2001). Shared processes in spatial rotation and music permutation. Brain Cogn. 46, 373-382.
11. Dessain, P. (1992). A (de)composable theory of rhythm perception. Music Percept. 9, 439-454.
12. Deutsch, D. (1999). "The processing of pitch combinations," in The Psychology of Music, ed. D. Deutsch (San Diego: Academic Press), 349-404.
13. Douglas, K. M., and Bilkey, D. K. (2007). Amusia is associated with deficits in spatial processing. Nat. Neurosci. 10, 915-921.
14. Foster, N. E. V., and Zattore, R. J. (2009). A role for the intraparietal sulcus in transforming musical pitch information. Cereb. Cortex 20, 1350-1359.
15. Frassinetti, F., Magnani, B., and Oliveri, M. (2009). Prismatic lenses shift time perception. Psychol. Sci. 20, 949-954.
16. Frey, S., Campbell, J. S. W., Pike, G. B., and Petrides, M. (2008). Dissociating the human language pathways with high angular resolution diffusionfiber tractography. J. Neurosci. 28, 11435-11444.
17. Gaare, M. (1997). Alternatives to traditional notation. Music Educ. J. 83, 17-23.
18. Gomes, H., Ritter, W., and Vaughan, H. G. Jr. (1995). The nature of preattentive storage in the auditory system. J. Cogn. Neurosci. 7, 81-94.
19. Grau, J. W., and Kemler-Nelson, D. G. (1988). The distinction between integral and separable dimensions: evidence for integrality of pitch and loudness. J. Exp. Psychol. Gen. 117, 347-370.
20. Griffiths, T. D., and Warren, J. D. (2002). The planum temporale as a computational hub. Trends Neurosci. 25, 348-353.
21. Hall, D. A., and Plack, C. J. (2009). Pitch processing sites in the human auditory brain. Cereb. Cortex 19, 576-585.
22. Hannon, E. E., and Trainor, L. J. (2007). Music acquisition: effects of enculturation and formal training on development. Trends Cogn. Sci. 11, 451-498.
23. Hasegawa, T., Matsuki, K., Ueno, T., Maeda, Y., Matsue, Y., Konishi, Y., and Sadato, N. (2004). Learned audiovisual cross-modal associations in observed piano playing activate the left planum temporale. An fMRI study. Cogn. Brain Res. 20, 510-518.
24. Henry, M. J., and McAuley, J. D. (2009). Evaluation of an imputed pitchvelocity model of the auditory kappa effect. J. Exp. Psychol. Hum. Percept. Perform. 35, 551-564.
25. Hooven, C. K., Chabris, C. F., Ellison, P. T., and Kosslyn, S. M. (2004). The relationship of male testosterone to components of mental rotation. Neuropsychologia 42, 782-790.
26. Hughes, H. C., Darcey, T. M., Barkan, H. I., Williamson, P. D., Roberts, D. W., and Aslin, C. H. (2001). Responses of human auditory association cortex to the omission of an expected acoustic event. Neuroimage 13, 1073-1089.
27. Ioannides, A. A., Popescu, M., Otsuka, A., Bezerianos, A., and Liu, L. (2003). Magnetoencephalographic evidence of the interhemispheric asymmetry in echoic memory lifetime and its dependence on handedness and gender. Neuroimage 19, 1061-1075.
28. Koedinger, K. R., and Anderson, J. R. (1990). Abstract planning and perceptual chunks: elements of expertise in geometry. Cogn. Sci. 14, 511-550.
29. Krumhansl, C. L. (2000). Rhythm and pitch in music cognition. Psychol. Bull. 126, 160-179.
30. Larkin, J. H., and Simon, H. A. (1987). Why a diagram is (sometimes) worth ten thousand words. Cogn. Sci. 11, 65-99.
31. Levitin, D. J., and Rogers, S. E. (2005). Absolute pitch: perception codingand controversies. Trends Cogn. Sci. 9, 26-33.
32. Lomber, S. G., and Malhotra, S. (2008). Double dissociation of "what" and"where" processing in auditory cortex. Nat. Neurosci. 11, 609-616.
33. Luria, A. R. (1980). Higher Cortical Functions in Man. New York: Basic Books.
34. Maeder, P. P., Meuli, R. A., Adriani, M., Bellmann, A., Fornari, E., Thiran, J. P., Pittet, A., and Clarke, S. (2001). Distinct pathways involved in sound recognition and localization: a human fMRI study. Neuroimage 14, 802-816.
35. McGurk, H., and MacDonald, J. (1976). Hearing lips and seeing voices. Nature 264, 746-748.
36. McLachlan, N. M. (2000). A spatial theory of rhythmic resolution. Leonardo Music J. 10, 61-67.
37. McLachlan, N. M., and Wilson, S. J. (2010). The central role of recognition in auditoryperception: a neurobiological model. Psychol. Rev. 117, 175-196.
38. Melara, R. D., and Marks, L. E. (1990). Processes underlying dimensional interactions - correspondences between linguistic and nonlinguistic dimensions. Mem. Cognit. 18, 477-495.
39. Milner, B. (1972). Disorders of learning and memory after temporal lobe lesions in man. Clin. Neurosurg. 19, 421-446.
40. Molholm, S., Sehatpour, P., Mehta, A. D., Shpaner, M., Gomez-Ramirez, M., Ortigue, S., Dyke, J. P., Schwartz, T. H., and Foxe, J. J. (2006). Audio-visual multisensory integration in superior parietal lobule revealed by human intracranial recordings. J. Neurophysiol. 96, 721-729.
41. Mudd, S. A. (1963). Spatial stereotypes of four dimensions of pure tone. J. Exp. Child. Psychol. 66, 347-352.
42. Näätänen, R., and Winkler, I. (1999). The concept of auditory stimulus representation in cognitive science. Psychol. Bull. 125, 826-859.
43. Nelson, S. G. (2008). "Court and religious music (1): history of gagaku and shõmyõ," in The Ashgate Research Companion to Japanese Music, eds A. McQueen Tokita and D. W. Hughes (Hampshire: Ashgate), 35-48.
44. O'Leary, A., and Rhodes, G. (1984). Crossmodal effects on visual and auditory object perception. Percept. Psychophys. 35, 565-569.
45. Pandya, D. N., and Yeterian, E. H. (1985). Architecture and connections of cortical association areas. Cereb. Cortex 4, 3-61.
46. Petrides, M., and Milner, B. (1982). Deficits on subject-ordered tasks after frontal and temporal-lobe lesions in man. Neuropsychologia 20, 149-202.
47. Pratt, C. C. (1930). The spatial character of high and low tones. J. Exp. Psychol. 13, 278-285.
48. Pressing, J. (1983). Cognitive isomorphisms between pitch and rhythm in world musics: west africa, the balkans and western tonality. Stud. Music 17, 38-61.
49. Rauschecker, J. P., and Scott, S. K. (2009). Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nat. Neurosci. 12, 718-724.
50. Rauschecker, J. P., and Tian, B. (2000). Mechanisms and streams for processing "what" and "where" in the auditory cortex. Proc. Natl. Acad. Sci. U.S.A. 97, 11800-11806.
51. Roffler, S. K., and Butler, R. A. (1968). Localization of tonal stimuli in the vertical plane. J. Acoust. Soc. Am. 43, 1260-1266.
52. Rolls, E. T., and Deco, G. (2002). Computational Neuroscience of Vision. Oxford: Oxford University Press.
53. Rusconi, E., Kwan, B., Giordano, B., Umiltà, C., and Butterworth, B. (2005). The mental space of pitch height. Ann. N. Y. Acad. Sci. 1060, 195-197.
54. Rusconi, E., Kwan, B., Giordano, B. L., Umiltà, C., and Butterworth, B.(2006). Spatial representation of pitch height: the SMARC effect. Cognition 19, 113-129.
55. Scaife, M., and Rogers, Y. (1996). External cognition: how do graphical representations work? Int. J. Hum. Comput. Stud. 45, 185-213.
56. Schönwiesner, M., Novitski, N., Pakarinen, S., Carlson, S., Tervaniemi, M., and Näätänen, R. (2007). Heschl's gyrus, posterior superior temporal gyrus, and mid-ventrolateral prefrontal cortex have different roles in the detection of acoustic changes. J. Neurophysiol. 97, 2075-2082.
57. Shamsa, L., Kamitanib, Y., and Shimojoa, S. (2002). Visual illusion induced by sound. Cogn. Brain Res. 14, 147-152.
58. Shepard, R. N., and Jordan, D. S. (1984). Auditory illusions demonstrating that tones are assimilated to an internalized musical scale. Science 226, 1333-1334.
59. Sherman, S. M. (2007). The thalamus is more than just a relay. Curr. Opin. Neurobiol. 17, 417-422.
60. Sloboda, J. A. (2005). Exploring the Musical Mind: Cognition, Emotion, Ability, Function. Oxford: Oxford University Press.
61. Trimble, O. C. (1934). Localization of sound in the anterior, posterior and vertical dimensions of auditory space. Br. J. Psychol. 24, 320-334.
62. Vandenberg, S. G., and Kuse, A. R. (1972). Mental Rotations: A New Spatial Test. Boulder: Institute for Behavioral Genetics, University of Colorado.
63. Virsu, V., Oksanen-Hennah, H., Vedenpää, A., Jaatinen, P., and Lahti-Nuuttila, P. (2008). Simultaneity learning in vision, audition, tactile sense and their cross-modal combinations. Exp. Brain Res. 186, 525-537.
64. Wilson, S. J., Pressing, J. L., and Wales, R. J. (2002). Modelling rhythmicfunction in a musician post-stroke. Neuropsychologia 40, 1494-1505.
65. Wilson, S. J., Pressing, J. L., Wales, R. J., and Pattison, P. (1999). Cognitive models of music psychology and the lateralisation of musical function within the brain. Aust. J. Psychol. 51, 125-139.
66. Wilson, S. J., Wales, R. J., and Pattison, P. (1997). The representation of tonality and meter in children aged 7 and 9. J. Exp. Child. Psychol. 64, 42-66.
67. Zatorre, R. J., Bouffard, M., Ahad, P., and Belin, P. (2002). Where is "where" in the human auditory cortex? Nat. Neurosci. 5, 905-909.
68. Zatorre, R. J., Halpern, A. R., and Bouffard, M. (2009). Mental reversal of imagined melodies: a role for the posterior parietal cortex. J. Cogn. Neurosci. 22, 775-789.