Crossmodal correspondences: A tutorial review

Attention, Perception, and Psychophysics

Volumn 73, Issue 4, 2011, Pages 971-995

  Spence, Charles ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Bayesian integration theory; Crossmodal binding problem; Crossmodal correspondence; Multisensory integration; Synaesthesia

Indexed keywords

ASSOCIATION; ATTENTION; BAYES THEOREM; HEARING; HUMAN; PERCEPTIVE DISCRIMINATION; PSYCHOPHYSICS; RESEARCH; REVIEW; SYMBOLISM; TIME PERCEPTION; VISION;

ASSOCIATION; ATTENTION; AUDITORY PERCEPTION; BAYES THEOREM; DISCRIMINATION (PSYCHOLOGY); HUMANS; PSYCHOPHYSICS; RESEARCH; SYMBOLISM; TIME PERCEPTION; VISUAL PERCEPTION;

EID: 79955876295     PISSN: 19433921     EISSN: 1943393X     Source Type: Journal    
DOI: 10.3758/s13414-010-0073-7     Document Type: Review

References (246)

1. Alais, D., & Burr, D. (2004). The ventriloquist effect results from near-optimal bimodal integration. Current Biology, 14, 257-262.
2. Aslin, R. N., Saffran, J. R., & Newport, E. L. (1998). Computation of conditional probability statistics by 8-month-old infants. Psychological Science, 9, 321-324.
3. Baier, B., Kleinschmidt, A., & Müller, N. (2006). Cross-modal processing in early visual and auditory cortices depends on the statistical relation of multisensory information. The Journal of Neuroscience, 26, 12260-12265.
4. Baron-Cohen, S., Harrison, J., Goldstein, L. H., & Wyke, M. (1993). Coloured speech perception: Is synaesthesia what happens when modularity breaks down? Perception, 22, 419-426.
5. Beauchamp, M. S., Argall, B. D., Bodurka, J., Duyn, J. H., & Martin, A. (2004). Unraveling multisensory integration: Patchy organization within human STS multisensory cortex. Nature Neuroscience, 7, 1190-1192.
6. Beauchamp, M. S., Lee, K. E., Argall, B. D., & Martin, A. (2004). Integration of auditory and visual information about objects in superior temporal sulcus. Neuron, 41, 809-823.
7. Bedford, F. L. (2001). Towards a general law of numerical/object identity. Cahiers de Psychologie Cognitive, 20, 113-175.
8. Bee, M. A., Perrill, S. A., & Owen, P. C. (2000). Male green frogs lower the pitch of acoustic signals in defense of territories: A possible dishonest signal of size? Behavioral Ecology, 11, 169-177.
9. Belkin, K., Martin, R., Kemp, S. E., & Gilbert, A. N. (1997). Auditory pitch as a perceptual analogue to odor quality. Psychological Science, 8, 340-342.
10. Belli, F., & Sagrillo, F. (2001). Qual è Takete? Qual è Maluma? La psicolinguistica applicata alla comunicazione pubblicitaria [What is Takete? What is Maluma? Psycholinguistics applied to advertising] (2nd ed.). Milan: Franco Angeli.
11. Ben-Artzi, E., & Marks, L. E. (1995). Visual-auditory interaction in speeded classification: Role of stimulus difference. Perception & Psychophysics, 57, 1151-1162.
12. Berlin, B. (1994). Evidence for pervasive synthetic sound symbolism in ethnozoological nomenclature. In L. Hinton, J. Nicholls, & J. J. Ohala (Eds.), Sound symbolism (pp. 76-93). New York: Cambridge University Press.
13. Bernstein, I. H., Eason, T. R., & Schurman, D. L. (1971). Hue-tone interaction: A negative result. Perceptual and Motor Skills, 33, 1327-1330.
14. Bernstein, I. H., & Edelstein, B. A. (1971). Effects of some variations in auditory input upon visual choice reaction time. Journal of Experimental Psychology, 87, 241-247.
15. Bertelson, P., Vroomen, J., Wiegeraad, G., & de Gelder, B. (1994). Exploring the relation between McGurk interference and ventriloquism. Proceedings of the 1994 International Conference on Spoken Language Processing, 2, 559-562.
16. Boernstein, W. S. (1936). On the functional relations of the sense organs to one another and to the organism as a whole. The Journal of General Psychology, 15, 117-131.
17. Boernstein, W. S. (1970). Perceiving and thinking: Their interrelationship and organismic organization. Annals of the New York Academy of Sciences, 169, 673-682.
18. Bond, B., & Stevens, S. S. (1969). Cross-modality matching of brightness to loudness by 5-year-olds. Perception & Psychophysics, 6, 337-339.
19. Boyle, M. W., & Tarte, R. D. (1980). Implications for phonetic symbolism: The relationship between pure tones and geometric figures. Journal of Psycholinguistic Research, 9, 535-544.
20. Bozzi, P., & Flores D'Arcais, G. (1967). Ricerca sperimentale sui rapporti intermodali fra qualità espressive [Experimental research on the intermodal relationships between expressive qualities]. Archivio di Psicologia, Neurologia e Psichiatria, 28, 377-420.
21. Braaten, R. (1993). Synesthetic correspondence between visual location and auditory pitch in infants. Paper presented at the 34th Annual Meeting of the Psychonomic Society.
22. Bresciani, J.-P., Dammeier, F., & Ernst, M. O. (2006). Vision and touch are automatically integrated for the perception of sequences of events. Journal of Vision, 6(5), 2: 554-564.
23. Bronner, K. (2011). What is the sound of citrus? Research on the correspondences between the perception of sound and taste/flavour.
24. Bronner, K., Bruhn, H., Hirt, R., & Piper, D. (2008). Research on the interaction between the perception of music and flavour. Poster presented at the 9th Annual Meeting of the International Multisensory Research Forum (IMRF), Hamburg, Germany, July.
25. Calvert, G. A., Spence, C., & Stein, B. E. (Eds.). (2004). The handbook of multisensory processes. Cambridge, MA: MIT Press.
26. Carello, C., Anderson, K. L., & Kunkler-Peck, A. J. (1998). Perception of object length by sound. Psychological Science, 9, 211-214.
27. Chen, L., & Zhou, X. (2010). Audiovisual synesthetic correspondence modulates visual apparent motion. Poster presented at the 11th International Multisensory Research Forum meeting, Liverpool, U. K., June.
28. Chen, Y.-C., & Spence, C. (2010). When hearing the bark helps to identify the dog: Semantically-congruent sounds modulate the identification of masked pictures. Cognition, 114, 389-404.
29. Chen, Y.-C., & Spence, C. (2011). Multiple levels of modulation by naturalistic sounds and spoken words on visual picture categorization. Manuscript submitted for publication.
30. Clark, H. H., & Brownell, H. H. (1976). Position, direction, and their perceptual integrality. Perception & Psychophysics, 19, 328-334.
31. Cohen, N. E. (1934). Equivalence of brightness across modalities. The American Journal of Psychology, 46, 117-119.
32. Cohen Kadosh, R., & Henik, A. (2007). Can synaesthesia research inform cognitive science? Trends in Cognitive Sciences, 11, 177-184.
33. Cohen Kadosh, R., Henik, A., & Walsh, V. (2009). Synaesthesia: Learned or lost? Developmental Science, 12, 484-491.
34. Collier, G. L. (1996). Affective synaesthesia: Extracting emotion space from simple perceptual stimuli. Motivation and Emotion, 20, 1-32.
35. Conway, C. M., & Christiansen, M. H. (2006). Statistical learning within and between modalities: Pitting abstract against stimulus-specific representations. Psychological Science, 17, 905-912.
36. Cowan, N., & Barron, A. (1987). Cross-modal, auditory-visual Stroop interference and possible implications for speech memory. Perception & Psychophysics, 41, 393-401.
37. Coward, S. W., & Stevens, C. J. (2004). Extracting meaning from sound: Nomic mappings, everyday listening, and perceiving object size from frequency. Psychological Record, 54, 349-364.
38. Cowles, J. T. (1935). An experimental study of the pairing of certain auditory and visual stimuli. Journal of Experimental Psychology, 18, 461-469.
39. Crisinel, A.-S., & Spence, C. (2009). Implicit association between basic tastes and pitch. Neuroscience Letters, 464, 39-42.
40. Crisinel, A.-S., & Spence, C. (2010a). As bitter as a trombone: Synesthetic correspondences in nonsynesthetes between tastes/flavors and musical notes. Attention, Perception, & Psychophysics, 72, 1994-2002.
41. Crisinel, A.-S., & Spence, C. (2010b). A sweet sound? Exploring implicit associations between basic tastes and pitch. Perception, 39, 417-425.
42. Cytowic, R. E. (1993). The man who tasted shapes. New York: G. P. Putnam's Sons.
43. Cytowic, R. E., & Eagleman, D. M. (2009). Wednesday is indigo blue: Discovering the brain of synesthesia. Cambridge, MA: MIT Press.
44. Cytowic, R. E., & Wood, F. B. (1982). Synaesthesia II: Psychophysical relations in the synaesthesia of geometrically shaped taste and colored hearing. Brain and Cognition, 1, 36-49.
45. Davies, N. B., & Halliday, T. L. (1978). Deep croaks and fighting assessment in toads Bufo bufo. Nature, 274, 683-685.
46. Davis, R. (1961). The fitness of names to drawings: A cross-cultural study in Tanganyika. British Journal of Psychology, 52, 259-268.
47. Day, S. (2005). Some demographic and socio-cultural aspects of synesthesia. In L. C. Robertson & N. Sagiv (Eds.), Synesthesia: Perspectives from cognitive neuroscience (pp. 11-33). New York: Oxford University Press.
48. Doehrmann, O., & Naumer, M. J. (2008). Semantics and the multisensory brain: How meaning modulates processes of audio-visual integration. Brain Research, 1242, 136-150.
49. Easton, R. D., & Basala, M. (1982). Perceptual dominance during lipreading. Perception & Psychophysics, 32, 562-570.
50. Elias, L. J., Saucier, D. M., Hardie, C., & Sarty, G. E. (2003). Dissociating semantic and perceptual components of synaesthesia: Behavioural and functional neuroanatomical investigations. Cognitive Brain Research, 16, 232-237.
51. Ernst, M. O. (2006). A Bayesian view on multimodal cue integration. In G. Knoblich, I. M. Thornton, M. Grosjean, & M. Shiffrar (Eds.), Human body perception from the inside out (pp. 105-131). Oxford: Oxford University Press.
52. Ernst, M. O. (2007). Learning to integrate arbitrary signals from vision and touch. Journal of Vision, 7(5), 7: 1-14.
53. Ernst, M. O., & Bülthoff, H. H. (2004). Merging the senses into a robust percept. Trends in Cognitive Sciences, 8, 162-169.
54. Evans, K. K., & Treisman, A. (2010). Natural cross-modal mappings between visual and auditory features. Journal of Vision, 10(1), 6: 1-12.
55. Fiebelkorn, I. C., Foxe, J. J., & Molholm, S. (2010). Dual mechanisms for the cross-sensory spread of attention: How much do learned associations matter? Cerebral Cortex, 20, 109-120.
56. Fitch, W. T., & Reby, D. (2001). The descended larynx is not uniquely human. Proceedings of the Royal Society B, 268, 1669-1675.
57. Fox, C. W. (1935). An experimental study of naming. The American Journal of Psychology, 47, 545-579.
58. Frens, M. A., van Opstal, A. J., & van der Willigen, R. F. (1995). Spatial and temporal factors determine audio-visual interactions in human saccadic eye movements. Perception & Psychophysics, 57, 802-816.
59. Frings, C., & Spence, C. (2010). Crossmodal congruency effects based on stimulus identity. Brain Research, 1354, 113-122.
60. Gal, D., Wheeler, S. C., & Shiv, B. (2011). Cross-modal influences on gustatory perception. Manuscript submitted for publication. Available at http://ssrn. com/abstract=1030197.
61. Gallace, A., Boschin, E., & Spence, C. (in press). On the taste of Bouba and Kiki: An exploration of word-food associations in neurologically normal participants. Cognitive Neuroscience.
62. Gallace, A., & Spence, C. (2006). Multisensory synesthetic interactions in the speeded classification of visual size. Perception & Psychophysics, 68, 1191-1203.
63. Gebels, G. (1969). An investigation of phonetic symbolism in different cultures. Journal of Verbal Learning and Verbal Behavior, 8, 310-312.
64. Gibson, J. J. (1966). The senses considered as perceptual systems. Boston: Houghton Mifflin.
65. Gilbert, A. N., Martin, R., & Kemp, S. E. (1996). Cross-modal correspondence between vision and olfaction: The color of smells. The American Journal of Psychology, 109, 335-351.
66. Grassi, M. (2005). Do we hear size or sound: Balls dropped on plates. Perception & Psychophysics, 67, 274-284.
67. Grassi, M., & Casco, C. (2010). Audiovisual bounce-inducing effect: When sound congruence affects grouping in vision. Attention, Perception, & Psychophysics, 72, 378-386.
68. Green, K., Kuhl, P., Meltzoff, A., & Stevens, E. (1991). Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect. Perception & Psychophysics, 50, 524-536.
69. Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998). Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology, 74, 1464-1480.
70. Guest, S., Catmur, C., Lloyd, D., & Spence, C. (2002). Audiotactile interactions in roughness perception. Experimental Brain Research, 146, 161-171.
71. Guttman, S. E., Gilroy, L. A., & Blake, R. (2005). Hearing what the eyes see: Auditory encoding of visual temporal sequences. Psychological Science, 16, 228-235.
72. Hancock, P. J. B., Baddeley, R. J., & Smith, L. S. (1992). The principal components of natural images. Network, 3, 61-70.
73. Harrington, F. H. (1987). Aggressive howling in wolves. Animal Behaviour, 35, 7-12.
74. Hartshorne, C. (1934). The philosophy and psychology of sensation. Chicago: University of Chicago Press.
75. Hein, G., Doehrmann, O., Müller, N. G., Kaiser, J., Muckli, L., & Naumer, M. J. (2007). Object familiarity and semantic congruency modulate responses in cortical audiovisual integration areas. The Journal of Neuroscience, 27, 7881-7887.
76. Helbig, H. B., & Ernst, M. O. (2007). Knowledge about a common source can promote visual-haptic integration. Perception, 36, 1523-1533.
77. Hinton, L., Nichols, J., & Ohala, J. J. (Eds.). (1994). Sound symbolism. Cambridge: Cambridge University Press.
78. Holland, M. K., & Wertheimer, M. (1964). Some physiognomic aspects of naming, or maluma, and takete revisited. Perceptual and Motor Skills, 19, 111-117.
79. Holt-Hansen, K. (1968). Taste and pitch. Perceptual and Motor Skills, 27, 59-68.
80. Holt-Hansen, K. (1976). Extraordinary experiences during cross-modal perception. Perceptual and Motor Skills, 43, 1023-1027.
81. Howells, T. (1944). The experimental development of color-tone synesthesia. Journal of Experimental Psychology, 34, 87-103.
82. Hubbard, T. L. (1996). Synesthesia-like mappings of lightness, pitch, and melodic interval. The American Journal of Psychology, 109, 219-238.
83. Imai, M., Kita, S., Nagumo, M., & Okada, H. (2008). Sound symbolism facilitates early verb learning. Cognition, 109, 54-65.
84. Innes-Brown, H., & Crewther, D. (2009). The impact of spatial incongruence on an auditory-visual illusion. PLoS ONE, 4, e6450.
85. Irwin, F. W., & Newland, E. (1940). A genetic study of the naming of visual figures. The Journal of Psychology, 9, 3-16.
86. Jackson, C. V. (1953). Visual factors in auditory localization. The Quarterly Journal of Experimental Psychology, 5, 52-65.
87. Jankovic, D. (2010). Evaluative processing is not sensory modality specific. Poster presented at the 11th International Multsensory Research Forum meeting, Liverpool, U. K., June.
88. Jespersen, O. (1922). The symbolic value of the vowel i. Philologica, 1, 1-19.
89. Jones, J. A., & Jarick, M. (2006). Multisensory integration of speech signals: The relationship between space and time. Experimental Brain Research, 174, 588-594.
90. Jones, J. A., & Munhall, K. G. (1997). The effects of separating auditory and visual sources on audiovisual integration of speech. Canadian Acoustics, 25, 13-19.
91. Kadosh, R. C., Henik, A., & Walsh, V. (2007). Small is bright and big is dark in synaesthesia. Current Biology, 17, R834-R835.
92. Karwoski, T. F., & Odbert, H. S. (1938). Color-music. Psychological Monographs, 50(2, Whole No. 22).
93. Karwoski, T. F., Odbert, H. S., & Osgood, C. E. (1942). Studies in synesthetic thinking: II. The rôle of form in visual responses to music. Journal of General Psychology, 26, 199-222.
94. Keetels, M., & Vroomen, J. (in press). No effect of synesthetic congruency on temporal ventriloquism. Attention, Perception, & Psychophysics.
95. Kelly, E. L. (1934). An experimental attempt to produce artificial chromaesthesia by the technique of the conditioned response. Journal of Experimental Psychology, 17, 315-341.
96. Kemp, S. E., & Gilbert, A. N. (1997). Odor intensity and color lightness are correlated sensory dimensions. The American Journal of Psychology, 110, 35-46.
97. Kitagawa, N., & Ichihara, S. (2002). Hearing visual motion in depth. Nature, 416, 172-174.
98. Köhler, W. (1929). Gestalt psychology. New York: Liveright.
99. Köhler, W. (1947). Gestalt psychology: An introduction to new concepts in modern psychology. New York: Liveright.
100. Körding, K. P., Beierholm, U., Ma, W. J., Tenenbaum, J. B., Quartz, S., & Shams, L. (2007). Causal inference in multisensory perception. PLoS ONE, 2, e943.
101. Kornblum, S., Hasbroucq, T., & Osman, A. (1990). Dimensional overlap: Cognitive basis for stimulus-response compatibility-a model and taxonomy. Psychological Review, 97, 253-270.
102. Kovic, V., Plunkett, K., & Westermann, G. (2009). The shape of words in the brain. Cognition, 114, 19-28.
103. Krantz, D. H. (1972). A theory of magnitude estimation and cross-modality matching. Journal of Mathematical Psychology, 9, 168-199.
104. Külpe, O. (1893). Grundriss der Psychologie [Fundamentals of psychology]. Leipzig: Englemann.
105. Kusnir, F., & Thut, G. (2010, June). When letters evoke colours: Probing for induction of synaesthetic behaviour in non-synaesthetes through explicit versus implicit grapheme-colour associations. Poster presented at the 11th International Multisensory Research Forum meeting, Liverpool, U. K.
106. Kuze, J. (1995). The effect of tone frequency on successive comparison of brightness. Psychologia, 38, 50-57.
107. Laurienti, P. J., Kraft, R. A., Maldjian, J. A., Burdette, J. H., & Wallace, M. T. (2004). Semantic congruence is a critical factor in multisensory behavioral performance. Experimental Brain Research, 158, 405-414.
108. Lewkowicz, D. J., & Turkewitz, G. (1980). Cross-modal equivalence in early infancy: Auditory-visual intensity matching. Developmental Psychology, 16, 597-607.
109. Lindauer, M. S. (1990). The meanings of the physiognomic stimuli taketa and maluma. Bulletin of the Psychonomic Society, 28, 47-50.
110. Lippert, M., Logothetis, N. K., & Kayser, C. (2007). Improvement of visual contrast detection by a simultaneous sound. Brain Research, 1173, 102-109.
111. Long, J. (1977). Contextual assimilation and its effect on the division of attention between nonverbal signals. The Quarterly Journal of Experimental Psychology, 29, 397-414.
112. Lyman, B. (1979). Representation of complex emotional and abstract meanings by simple forms. Perceptual and Motor Skills, 49, 839-842.
113. MacLeod, C. M. (1991). Half a century of research on the Stroop effect: An integrative review. Psychological Bulletin, 109, 163-203.
114. Maeda, F., Kanai, R., & Shimojo, S. (2004). Changing pitch induced visual motion illusion. Current Biology, 14, R990-R991.
115. Makovac, E., & Gerbino, W. (2010). Sound-shape congruency affects the multisensory response enhancement. Visual Cognition, 18, 133-137.
116. Marks, L. E. (1974). On associations of light and sound: The mediation of brightness, pitch, and loudness. The American Journal of Psychology, 87, 173-188.
117. Marks, L. E. (1975). On colored-hearing synesthesia: Cross-modal translations of sensory dimensions. Psychological Bulletin, 82, 303-331.
118. Marks, L. (1978). The unity of the senses: Interrelations among the modalities. New York: Academic Press.
119. Marks, L. E. (1984). Synaesthesia and the arts. In W. R. Crozier & A. J. Chapman (Eds.), Cognitive processes in the perception of art (pp. 427-447). Amsterdam: Elsevier.
120. Marks, L. E. (1987a). On cross-modal similarity: Auditory-visual interactions in speeded discrimination. Journal of Experimental Psychology: Human Perception and Performance, 13, 384-394.
121. Marks, L. E. (1987b). On cross-modal similarity: Perceiving temporal patterns by hearing, touch, and vision. Perception & Psychophysics, 42, 250-256.
122. Marks, L. E. (1989a). For hedgehogs and foxes: Individual differences in the perception of cross-modal similarity. In G. Ljunggren & S. Dornic (Eds.), Psychophysics in action (pp. 55-65). Berlin: Springer.
123. Marks, L. E. (1989b). On cross-modal similarity: The perceptual structure of pitch, loudness, and brightness. Journal of Experimental Psychology: Human Perception and Performance, 15, 586-602.
124. Marks, L. E. (2000). Synesthesia. In E. Cardeña, S. J. Lynn, & S. C. Krippner (Eds.), Varieties of anomalous experience: Examining the scientific evidence (pp. 121-149). Washington: American Psychological Association.
125. Marks, L. E. (2004). Cross-modal interactions in speeded classification. In G. A. Calvert, C. Spence, & B. E. Stein (Eds.), Handbook of multisensory processes (pp. 85-105). Cambridge: MIT Press.
126. Marks, L. E., Ben-Artzi, E., & Lakatos, S. (2003). Cross-modal interactions in auditory and visual discrimination. International Journal of Psychophysiology, 50, 125-145.
127. Marks, L. E., Hammeal, R. J., & Bornstein, M. H. (1987). Perceiving similarity and comprehending metaphor. Monographs of the Society for Research in Child Development, 52(1, Whole No. 215), 1-102.
128. Marks, L. E., Szczesiul, R., & Ohlott, P. (1986). On the cross-modal perception of intensity. Journal of Experimental Psychology: Human Perception and Performance, 12, 517-534.
129. Martino, G., & Marks, L. E. (1999). Perceptual and linguistic interactions in speeded classification: Tests of the semantic coding hypothesis. Perception, 28, 903-923.
130. Martino, G., & Marks, L. E. (2000). Cross-modal interaction between vision and touch: The role of synesthetic correspondence. Perception, 29, 745-754.
131. Martino, G., & Marks, L. E. (2001). Synesthesia: Strong and weak. Current Directions in Psychological Science, 10, 61-65.
132. Maurer, D. (1997). Neonatal synaesthesia: Implications for the processing of speech and faces. In S. Baron-Cohen & J. E. Harrison (Eds.), Synaesthesia: Classic and contemporary readings (pp. 224-242). Oxford: Blackwell.
133. Maurer, D., & Mondloch, C. J. (2005). Neonatal synaesthesia: A reevaluation. In L. C. Robertson & N. Sagiv (Eds.), Synaesthesia: Perspectives from cognitive neuroscience (pp. 193-213). Oxford: Oxford University Press.
134. Maurer, D., Pathman, T., & Mondloch, C. J. (2006). The shape of boubas: Sound-shape correspondences in toddlers and adults. Developmental Science, 9, 316-322.
135. McMahon, T. A., & Bonner, J. T. (1983). On size and life. New York: Scientific American.
136. Melara, R. D. (1989a). Dimensional interaction between color and pitch. Journal of Experimental Psychology: Human Perception and Performance, 15, 69-79.
137. Melara, R. D. (1989b). Similarity relations among synesthetic stimuli and their attributes. Journal of Experimental Psychology: Human Perception and Performance, 15, 212-231.
138. Melara, R. D., & O'Brien, T. P. (1987). Interaction between synesthetically corresponding dimensions. Journal of Experimental Psychology: General, 116, 323-336.
139. Meltzoff, A. N., & Borton, R. W. (1979). Intermodal matching by human neonates. Nature, 282, 403-404.
140. Mesz, B., Trevisan, M., & Sigman, M. (2011). The taste of music. Manuscript submitted for publication.
141. Miller, A., Werner, H., & Wapner, S. (1958). Studies in physiognomic perception: V. Effect of ascending and descending gliding tones on autokinetic motion. Journal of Psychology, 46, 101-105.
142. Miller, E. A. (1972). Interaction of vision and touch in conflict and nonconflict form perception tasks. Journal of Experimental Psychology, 96, 114-123.
143. Miller, J. O. (1991). Channel interaction and the redundant targets effect in bimodal divided attention. Journal of Experimental Psychology: Human Perception and Performance, 17, 160-169.
144. Molholm, S., Ritter, W., Javitt, D. C., & Foxe, J. J. (2004). Multisensory visual-auditory object recognition in humans: A high-density electrical mapping study. Cerebral Cortex, 14, 452-465.
145. Mondloch, C. J., & Maurer, D. (2004). Do small white balls squeak? Pitch-object correspondences in your children. Cognitive, Affective & Behavioral Neuroscience, 4, 133-136.
146. Morein-Zamir, S., Soto-Faraco, S., & Kingstone, A. (2003). Auditory capture of vision: Examining temporal ventriloquism. Cognitive Brain Research, 17, 154-163.
147. Morgan, G. A., Goodson, F. E., & Jones, T. (1975). Age differences in the associations between felt temperatures and color choices. The American Journal of Psychology, 88, 125-130.
148. Morgan, M. L., DeAngelis, G. C., & Angelaki, D. E. (2008). Multisensory integration in macaque visual cortex depends on cue reliability. Neuron, 59, 662-673.
149. Morton, E. S. (1994). Sound symbolism and its role in non-human vertebrate communication. In L. Hinton, J. Nicholls, & J. J. Ohala (Eds.), Sound symbolism (pp. 348-365). Cambridge: Cambridge University Press.
150. Mudd, S. A. (1963). Spatial stereotypes of four dimensions of pure tone. Journal of Experimental Psychology, 66, 347-352.
151. Murray, M. M., Michel, C. M., Grave de Peralta, R., Ortigue, S., Brunet, D., Gonzalez Andino, S., & Schnider, A. (2004). Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging. Neuroimage, 21, 125-135.
152. Nahm, F. K. D., Tranel, D., Damasio, H., & Damasio, A. R. (1993). Cross-modal associations and the human amygdale. Neuropsychologia, 31, 727-744.
153. Naumer, M. J., & Kaiser, J. (Eds.). (2010). Multisensory object perception in the primate brain. New York: Springer.
154. Newman, S. S. (1933). Further experiments in phonetic symbolism. The American Journal of Psychology, 45, 53-75.
155. Nuckolls, J. (2003). The case for sound symbolism. Annual Review of Anthropology, 28, 225-252.
156. Oberman, L. M., & Ramachandran, V. S. (2008). Preliminary evidence for deficits in multisensory integration in autism spectrum disorders: The mirror neuron hypothesis. Social Neuroscience, 3, 348-355.
157. O'Leary, A., & Rhodes, G. (1984). Cross-modal effects on visual and auditory object perception. Perception & Psychophysics, 35, 565-569.
158. O'Mahony, M. (1983). Gustatory responses to nongustatory stimuli. Perception, 12, 627-633.
159. Osgood, C. E. (1960). The cross-cultural generality of visual-verbal synesthetic tendencies. Behavioral Science, 5, 146-169.
160. Osgood, C., Suci, G., & Tannenbaum, P. (1957). The measurement of meaning. Urbana: University of Illinois Press.
161. Pan, J.-Y., Yang, H.-J., Faloutsos, C., & Duygulu, P. (2004). Automatic multimedia crossmodal correlation discovery. In Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 653-658). Seattle: ACM Press.
162. Parise, C. V., & Pavani, F. (2011). I see it large, I say it louder. Evidence of sound symbolism in simple vocalizations. Manuscript submitted for publication.
163. Parise, C., & Spence, C. (2008a). Synesthetic congruency modulates the temporal ventriloquism effect. Neuroscience Letters, 442, 257-261.
164. Parise, C., & Spence, C. (2008b). Synesthetic correspondence modulates audiovisual temporal integration. Poster presented at the 9th IMRF meeting, Hamburg, Germany, July.
165. Parise, C., & Spence, C. (2009). "When birds of a feather flock together": Synesthetic correspondences modulate audiovisual integration in non-synesthetes. PLoS ONE, 4, e5664.
166. Patching, G. R., & Quinlan, P. T. (2002). Garner and congruence effects in the speeded classification of bimodal signals. Journal of Experimental Psychology: Human Perception and Performance, 28, 755-775.
167. Piesse, C. H. (1891). Piesse's art of perfumery (5th ed.). London: Piesse and Lubin.
168. Plato. (1961). In E. Hamilton & H. Cairns (Eds.), The collected dialogues. New York: Pantheon.
169. Poffenberger, A. T., & Barrows, B. E. (1924). The feeling value of lines. The Journal of Applied Psychology, 8, 187-205.
170. Pratt, C. C. (1930). The spatial character of high and low tones. Journal of Experimental Psychology, 13, 278-285.
171. Radeau, M., & Bertelson, P. (1987). Auditory-visual interaction and the timing of inputs. Thomas (1941) revisited. Psychological Research, 49, 17-22.
172. Rader, C. M., & Tellegen, A. (1987). An investigation of synaesthesia. Journal of Personality and Social Psychology, 52, 981-987.
173. Ramachandran, V. S., & Hubbard, E. M. (2001). Synaesthesia-A window into perception, thought and language. Journal of Consciousness Studies, 8, 3-34.
174. Ramachandran, V. S., & Hubbard, E. M. (2003, May). Hearing colors, tasting shapes. Scientific American, 288, 43-49.
175. Ramachandran, V. S., & Oberman, L. M. (2006, May 12). Broken mirrors. Scientific American, 295, 62-69.
176. Recanzone, G. H. (2003). Auditory influences on visual temporal rate perception. Journal of Neurophysiology, 89, 1078-1093.
177. Roach, N. W., Heron, J., & McGraw, P. V. (2006). Resolving multisensory conflict: A strategy for balancing the costs and benefits of audio-visual integration. Proceedings of the Royal Society B, 273, 2159-2168.
178. Roffler, S. K., & Butler, R. A. (1968). Factors that influence the localization of sound in the vertical plane. The Journal of the Acoustical Society of America, 43, 1255-1259.
179. Rogers, S. K., & Ross, A. S. (1975). A cross-cultural test of the Maluma-Takete phenomenon. Perception, 4, 105-106.
180. Root, R. T., & Ross, S. (1965). Further validation of subjective scales for loudness and brightness by means of cross-modality matching. The American Journal of Psychology, 78, 285-289.
181. Rouw, R., & Scholte, H. S. (2007). Increased structural connectivity in grapheme-color synesthesia. Nature Neuroscience, 10, 792-797.
182. Rudmin, F., & Cappelli, M. (1983). Tone-taste synesthesia: A replication. Perceptual and Motor Skills, 56, 118.
183. Sagiv, N., & Ward, J. (2006). Cross-modal interactions: Lessons from synesthesia. Progress in Brain Research, 155, 263-275.
184. Sapir, E. (1929). A study in phonetic symbolism. Journal of Experimental Psychology, 12, 225-239.
185. Seo, H.-S., Arshamian, A., Schemmer, K., Scheer, I., Sander, T., Ritter, G., et al. (2010). Cross-modal integration between odors and abstract symbols. Neuroscience Letters, 478, 175-178.
186. Shams, L., & Beierholm, U. R. (2010). Causal inference in perception. Trends in Cognitive Sciences, 14, 425-432.
187. Shams, L., Ma, W. J., & Beierholm, U. (2005). Sound-induced flash illusion as an optimal percept. NeuroReport, 16, 1923-1927.
188. Shepard, R. N. (1994). Perceptual-cognitive universals as reflections of the world. Psychonomic Bulletin & Review, 1, 2-28.
189. Shore, D. I., Barnes, M. E., & Spence, C. (2006). The temporal evolution of the crossmodal congruency effect. Neuroscience Letters, 392, 96-100.
190. Simner, J., Cuskley, C., & Kirby, S. (2010). What sound does that taste? Cross-modal mapping across gustation and audition. Perception, 39, 553-569.
191. Simner, J., & Ludwig, V. (2009). What colour does that feel? Cross-modal correspondences from touch to colour. Paper presented at the Third International Conference of Synaesthesia and Art, Granada, Spain, April.
192. Simner, J., Ward, J., Lanz, M., Jansari, A., Noonan, K., Glover, L., Oakley, D. A. (2005). Nonrandom associations of graphemes to colours in synaesthetic and non-synaesthetic populations. Cognitive Neuropsychology, 22, 1069-1085.
193. Simpson, R. H., Quinn, M., & Ausubel, D. P. (1956). Synaesthesia in children: Association of colors with pure tone frequencies. The Journal of Genetic Psychology, 89, 95-103.
194. Slutsky, D. A., & Recanzone, G. H. (2001). Temporal and spatial dependency of the ventriloquism effect. NeuroReport, 12, 7-10.
195. Smith, D. R. R., Patterson, R. D., Turner, R., Kawahara, H., & Irino, T. (2005). The processing and perception of size information in speech sounds. The Journal of the Acoustical Society of America, 117, 305-318.
196. Smith, E. L., Grabowecky, M., & Suzuki, S. (2007). Auditory-visual crossmodal integration in perception of face gender. Current Biology, 17, 1680-1685.
197. Smith, L. B., & Sera, M. D. (1992). A developmental analysis of the polar structure of dimensions. Cognitive Psychology, 24, 99-142.
198. Spence, C. (2007). Audiovisual multisensory integration. Acoustical Science & Technology, 28, 61-70.
199. Spence, C. (2010). The color of wine-Part 1. The World of Fine Wine, 28, 122-129.
200. Spence, C., & Driver, J. (Eds.). (2004). Crossmodal space and crossmodal attention. Oxford: Oxford University Press.
201. Spence, C., & Gallace, A. (in press). Tasting shapes and words. Food Quality and Preference.
202. Spence, C., Levitan, C. A., Shankar, M. U., & Zampini, M. (2010). Does food color influence taste and flavor perception in humans? Chemosensory Perception, 3, 68-84.
203. Spence, C., & Ngo, M. (in press). Does attention or multisensory integration explain the crossmodal facilitation of masked visual target identification? In B. E. Stein et al. (Eds.), The new handbook of multisensory processing. Cambridge, MA: MIT Press.
204. Spence, C., Ngo, M. K., Lee, J.-H., & Tan, H. (2010). Solving the correspondence problem in haptic/multisensory interface design. In M. H. Zadeh (Ed.), Advances in haptics (pp. 47-74). InTech. Available at www. sciyo. com/articles/show/title/solving-the-correspondence-problem-in-haptic-multisensory-interface-design.
205. Spence, C., & Zampini, M. (2006). Auditory contributions to multisensory product perception. Acta Acustica united with Acustica, 92, 1009-1025.
206. Stevens, J. C., & Marks, L. E. (1965). Cross-modality matching of brightness and loudness. Proceedings of the National Academy of Sciences, 54, 407-411.
207. Stevens, S. S. (1957). On the psychophysical law. Psychological Review, 64, 153-181.
208. Stevens, S. S. (1971). Issues in psychophysical measurement. Psychological Review, 78, 426-450.
209. Stoffregen, T. A., & Bardy, B. G. (2001). On specification and the senses. The Behavioral and Brain Sciences, 24, 195-261.
210. Stroop, J. R. (1935). Studies of interference in serial-verbal reaction. Journal of Experimental Psychology, 18, 643-662.
211. Stumpf, K. (1883). Tonpsychologie I [Psychology of the tone]. Leipzig: Hirzel.
212. Taylor, I. K. (1963). Phonetic symbolism re-examined. Psychological Bulletin, 60, 200-209.
213. Taylor, I. K., & Taylor, M. M. (1962). Phonetic symbolism in four unrelated languages. Canadian Journal of Psychology, 16, 344-356.
214. Teramoto, W., Hidaka, S., & Sugita, Y. (2010). Sounds move a static visual object. PLoS ONE, 5, e12255.
215. Thomas, G. J. (1941). Experimental study of the influence of vision on sound localization. Journal of Experimental Psychology, 28, 163-177.
216. Uznadze, D. (1924). Ein experimenteller Beitrag zum Problem der psychologischen Grundlagen der Namengebung [An experimental contribution to the problem of the psychological bases of naming]. Psychologische Forschung, 5, 25-43.
217. van Atteveldt, N., Formisano, E., Goebel, R., & Blomert, L. (2004). Integration of letters and speech sounds in the human brain. Neuron, 43, 271-282.
218. van Wassenhove, V., Grant, K. W., & Poeppel, D. (2007). Temporal window of integration in auditory-visual speech perception. Neuropsychologia, 45, 598-607.
219. Vatakis, A., Ghazanfar, A., & Spence, C. (2008). Facilitation of multisensory integration by the unity assumption: Is speech special? Journal of Vision, 8(9), 14: 1-11.
220. Vatakis, A., & Spence, C. (2007). Crossmodal binding: Evaluating the "unity assumption" using audiovisual speech stimuli. Perception & Psychophysics, 69, 744-756.
221. Vatakis, A., & Spence, C. (2008). Evaluating the influence of the "unity assumption" on the temporal perception of realistic audiovisual stimuli. Acta Psychologica, 127, 12-23.
222. von Békésy, G. (1959). Similarities between hearing and skin sensations. Psychological Review, 66, 1-22.
223. Von Hornbostel, E. M. (1931). Über Geruchshelligkeit [On odour/smell brightness]. Pflügers Archiv für Gesamte Physiologie, 227, 517-538.
224. Von Hornbostel, E. M. (1927/1950). The unity of the senses. In W. D. Ellis (Ed.), A source book of Gestalt psychology (pp. 210-216). London: Routledge and Kegan Paul.
225. von Kriegstein, K., & Giraud, A.-L. (2006). Implicit multisensory associations influence voice recognition. PLoS Biology, 4, e326.
226. von Kriegstein, K., Kleinschmidt, A., Sterzer, P., & Giraud, A.-L. (2005). Interaction of face and voice areas during speaker recognition. Journal of Cognitive Neuroscience, 17, 367-376.
227. Vroomen, J., & Keetels, M. (2006). The spatial constraint in intersensory pairing: No role in temporal ventriloquism. Journal of Experimental Psychology: Human Perception and Performance, 32, 1063-1071.
228. Wagner, K., & Dobkins, K. (2009). Shape-color synaesthesia in the first year of life: A normal stage of visual development? [Abstract]. Journal of Vision, 9(8), 699a.
229. Wagner, S., Winner, E., Cicchetti, D., & Gardner, H. (1981). "Metaphorical" mapping in human infants. Child Development, 52, 728-731.
230. Walker, P., Bremner, J. G., Mason, U., Spring, J., Mattock, K., Slater, A., Johnson, S. P. (2010). Preverbal infants' sensitivity to synesthetic cross-modality correspondences. Psychological Science, 21, 21-25.
231. Walker, P., Francis, B. J., & Walker, L. (in press). The brightness-weight illusion: Darker objects look heavier but feel lighter. Experimental Psychology.
232. Walker, P., & Smith, S. (1984). Stroop interference based on the synaesthetic qualities of auditory pitch. Perception, 13, 75-81.
233. Walker, P., & Smith, S. (1985). Stroop interference based on the multimodal correlates of haptic size and auditory pitch. Perception, 14, 729-736.
234. Walker, R. (1987). The effects of culture, environment, age, and musical training on choices of visual metaphors for sound. Perception & Psychophysics, 42, 491-502.
235. Walker, S., Bruce, V., & O'Malley, C. (1995). Facial identity and facial speech processing: Familiar faces and voices in the McGurk effect. Perception & Psychophysics, 57, 1124-1133.
236. Wallace, M. T., Roberson, G. E., Hairston, W. D., Stein, B. E., Vaughan, J. W., & Schirillo, J. A. (2004). Unifying multisensory signals across time and space. Experimental Brain Research, 158, 252-258.
237. Walsh, V. (2003). A theory of magnitude: Common cortical metrices of time, space and quality. Trends in Cognitive Sciences, 7, 483-488.
238. Ward, J., Huckstep, B., & Tsakanikos, E. (2006). Sound-colour synaesthesia: To what extent does it use cross-modal mechanisms common to us all? Cortex, 42, 264-280.
239. Welch, R. B. (1972). The effect of experienced limb identity upon adaptation to simulated displacement of the visual field. Perception & Psychophysics, 12, 453-456.
240. Welch, R. B., & Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychological Bulletin, 3, 638-667.
241. Wertheimer, M. (1958). The relation between the sound of a word and its meaning. The American Journal of Psychology, 71, 412-415.
242. Westbury, C. (2005). Implicit sound symbolism in lexical access: Evidence from an interference task. Brain and Language, 93, 10-19.
243. Wicker, F. W. (1968). Mapping the intersensory regions of perceptual space. The American Journal of Psychology, 81, 178-188.
244. Widmann, A., Kujala, T., Tervaniemi, M., Kujala, A., & Schröger, E. (2004). From symbols to sounds: Visual symbolic information activates sound representations. Psychophysiology, 41, 709-715.
245. Yau, J. M., Olenczak, J. B., Dammann, J. F., & Bensmaia, S. J. (2009). Temporal frequency channels are linked across audition and touch. Current Biology, 19, 561-566.
246. Zangenehpour, S., & Zatorre, R. J. (2010). Cross-modal recruitment of primary visual cortex following brief exposure to bimodal audiovisual stimuli. Neuropsychologia, 48, 591-600.