Crossmodal correspondences between sounds and tastes

Psychonomic Bulletin and Review

Volumn 19, Issue 6, 2012, Pages 992-1006

  Knöferle, Klemens ^a   Spence, Charles ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Crossmodal correspondences; Flavor; Music; Sound; Taste

Indexed keywords

EID: 84870227659     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/s13423-012-0321-z     Document Type: Review

References (126)

1. Baudelaire, C. (1857). Les fleurs du mal [Flowers of evil]. Paris: Poulet-Malassis.
2. Beeli, G., Esslen, M., & Jäncke, L. (2005). Synaesthesia: When coloured sounds taste sweet. Nature, 434(7029), 38-38.
3. Berlioz, H. (1856). A treatise upon modern instrumentation and orchestration, dedicated to Frederick William IV, King of Prussia (Vol. 7). London: J. Alfred Novello.
4. Bien, N., ten Oever, S., Goebel, R., & Sack, A. T. (2012). The sound of size: Crossmodal binding in pitch-size synesthesia: A combined TMS, EEG and psychophysics study. Neuroimage, 59(1), 663-672.
5. Bigand, E., & Parncutt, R. (1999). Perceiving musical tension in long chord sequences. Psychological Research, 62(4), 237-254.
6. Bowling, D. L., Gill, K., Choi, J. D., Prinz, J., & Purves, D. (2009). Major and minor music compared to excited and subdued speech. Journal of the Acoustical Society of America, 127(1), 491-503.
7. Brang, D., Williams, L. E., & Ramachandran, V. S. (2012). Grapheme-color synesthetes show enhanced crossmodal processing between auditory and visual modalities. Cortex, 48(5), 630-637.
8. Bremner, A. J., Caparos, S., Davidoff, J., de Fockert, J., Linnell, K., & Spence, C. (2012). "Bouba" and "Kiki" in Namibia? Western shape-symbolism does not extend to taste in a remote population. Manuscript submitted for publication.
9. Bronner, K. (2012). What is the sound of citrus? Research on the correspondences between the perception of sound and taste/flavour. Manuscript submitted for publication.
10. Bronner, K., Bruhn, H., Hirt, R., & Piper, D. (2008, 15-19 July). Research on the interaction between the perception of music and flavour. Paper presented at the 9th Annual Meeting of the International Multisensory Research Forum (IMRF), Hamburg, Germany.
11. Caclin, A., McAdams, S., Smith, B. K., & Winsberg, S. (2005). Acoustic correlates of timbre space dimensions: A confirmatory study using synthetic tones. Journal of the Acoustical Society of America, 118(1), 471-482.
12. Chen, Y.-C., & Spence, C. (2010). When hearing the bark helps to identify the dog: Semantically-congruent sounds modulate the identification of masked pictures. Cognition, 114(3), 389-404.
13. Chiou, R., & Rich, A. N. (2012). Cross-modality correspondence between pitch and spatial location modulates attentional orienting. Perception, 41(3), 339-353.
14. Cohen, N. E. (1934). Equivalence of brightnesses across modalities. The American Journal of Psychology, 46(1), 117-119.
15. Collier, G. L. (1996). Affective synesthesia: Extracting emotion space from simple perceptual stimuli. Motivation and Emotion, 20(1), 1-32.
16. Cook, N. D. (2007). The sound symbolism of major and minor harmonies. Music Perception, 24(3), 315-319.
17. Crisinel, A.-S., Cosser, S., King, S., Jones, R., Petrie, J., & Spence, C. (2012). A bittersweet symphony: Systematically modulating the taste of food by changing the sonic properties of the soundtrack playing in the background. Food Quality and Preference, 24(1), 201-204.
18. Crisinel, A.-S., & Spence, C. (2009). Implicit association between basic tastes and pitch. Neuroscience Letters, 464(1), 39-42.
19. Crisinel, A.-S., & Spence, C. (2010a). As bitter as a trombone: Synesthetic correspondences in nonsynesthetes between tastes/flavors and musical notes. Attention, Perception, & Psychophysics, 72(7), 1994-2002.
20. Crisinel, A.-S., & Spence, C. (2010b). A sweet sound? Food names reveal implicit associations between taste and pitch. Perception, 39(3), 417-425.
21. Crisinel, A.-S., & Spence, C. (2011). Crossmodal associations between flavoured milk solutions and musical notes. Acta Psychologica, 138(1), 155-161.
22. Crisinel, A.-S., & Spence, C. (2012). The impact of pleasantness ratings on crossmodal associations between food samples and musical notes. Food Quality and Preference, 24(1), 136-140.
23. Day, S. A. (2011). The human sensoria and synaesthetic approach to cooking. Collapse, VII, 378-409.
24. Delwiche, J. (1996). Are there "basic" tastes? Trends in Food Science & Technology, 7(12), 411-415.
25. Deroy, O., & Spence, C. (2012). Synaesthesia reclassified: Borderline cases of crossmodally-induced experiences. Manuscript submitted for publication.
26. Elder, R. S., & Krishna, A. (2010). The effects of advertising copy on sensory thoughts and perceived taste. Journal of Consumer Research, 36(5), 748-756.
27. Erickson, R. P. (2008). A study of the science of taste: On the origins and influence of the core ideas. Behavioral and Brain Sciences, 31(1), 59-75.
28. Evans, K. K., & Treisman, A. (2010). Natural cross-modal mappings between visual and auditory features. Journal of Vision, 10(1), 1-12.
29. Fallows, D. (s. a.). "Dolce (i)". Grove Music Online. Oxford Music Online. Retrieved from http://www. oxfordmusiconline. com/subscriber/article/grove/music/07936.
30. Fastl, H., & Zwicker, E. (2007). Psychoacoustics (3rd ed.). Berlin: Springer.
31. Fónagy, I. (1963). Die Metaphern in der Phonetik [The metaphors in phonetics]. The Hague: Mouton.
32. Fónagy, I. (2001). A research instrument. In I. Fónagy (Ed.), Languages within language: An evolutive approach (pp. 337-357). Amsterdam: John Benjamins.
33. Friston, K., & Kiebel, S. (2009). Predictive coding under the free-energy principle. Philosophical Transactions of the Royal Society B: Biological Sciences, 364(1521), 1211-1221.
34. Fritz, T., Jentschke, S., Gosselin, N., Sammler, D., Peretz, I., Turner, R., et al. (2009). Universal recognition of three basic emotions in music. Current Biology, 19(7), 573-576.
35. Gagnon, L., & Peretz, I. (2003). Mode and tempo relative contributions to "happy-sad" judgements in equitone melodies. Cognition & Emotion, 17(1), 25-40.
36. Gallace, A., Boschin, E., & Spence, C. (2011). On the taste of "Bouba" and "Kiki": An exploration of word-food associations in neurologically normal participants. Cognitive Neuroscience, 2(1), 34-46.
37. Henrich, J., Heine, S. J., & Norenzayan, A. (2010). The weirdest people in the world. Behavioral and Brain Sciences, 33(2-3), 61-83.
38. Hevner, K. (1935). The affective character of the major and minor modes in music. The American Journal of Psychology, 47(1), 103-118.
39. Hinton, L., Nichols, J., & Ohala, J. J. (Eds.). (2006). Sound symbolism. Cambridge: Cambridge University Press.
40. Hoegg, J., & Alba, J. W. (2007). Taste perception: More than meets the tongue. Journal of Consumer Research, 33(4), 490-498.
41. Holt-Hansen, K. (1968). Taste and pitch. Perceptual and Motor Skills, 27(1), 59-68.
42. Holt-Hansen, K. (1976). Extraordinary experiences during cross-modal perception. Perceptual and Motor Skills, 43(3), 1023-1027.
43. Hornbostel, E. M. (1931). Über Geruchshelligkeit [On smell brightness]. Pflügers Archiv European Journal of Physiology, 227(1), 517-538.
44. Huysmans, J.-K. (1926). À rebours [Against the grain]. London: Fortune Press (Original work published 1884).
45. Johnson, D. M. (s. a.). "Round". Grove Music Online. Oxford Music Online. Retrieved from http://www. oxfordmusiconline. com/subscriber/article/grove/music/23960.
46. Kawamura, Y., & Kare, M. R. (1987). Umani: A basic taste: Physiology, biochemistry, nutrition, food science. New York: Marcel Dekker.
47. Kilner, J. M., Friston, K. J., & Frith, C. D. (2007). Predictive coding: An account of the mirror neuron system. Cognitive Processing, 8(3), 159-166.
48. Knöferle, K., & Spence, C. (2012). Crossmodal correspondences between basic tastes and auditory parameters. Manuscript submitted for publication.
49. Kobayakawa, T., & Gotow, N. (2011). Interaction between olfaction and gustation by using synchrony perception task. i-Perception, 2(8), 964-964.
50. Köhler, W. (1929). Gestalt psychology. New York: Liveright.
51. Köhler, W. (1947). Gestalt psychology: An introduction to new concepts in modern psychology. New York: Liveright.
52. Krishna, A., Elder, R. S., & Caldara, C. (2010). Feminine to smell but masculine to touch? Multisensory congruence and its effect on the aesthetic experience. Journal of Consumer Psychology, 20(4), 410-418.
53. Ladefoged, P., & Johnson, K. (2011). A course in phonetics (6th ed.). Boston: Wadsworth Pub Co.
54. Laurienti, P. J., Kraft, R. A., Maldjian, J. A., Burdette, J. H., & Wallace, M. T. (2004). Semantic congruence is a critical factor in multisensory behavioral performance. Experimental Brain Research, 158(4), 405-414.
55. Maga, J. A. (1974). Influence of color on taste thresholds. Chemical Senses, 1(1), 115-119.
56. Marks, L. E. (1982). Synesthetic perception and poetic metaphor. Journal of Experimental Psychology: Human Perception and Performance, 8(1), 15-23.
57. Marks, L. E. (1987). On cross-modal similarity: Auditory-visual interactions in speeded discrimination. Journal of Experimental Psychology: Human Perception and Performance, 13(3), 384-394.
58. Marks, L. E. (1991). Metaphor and the unity of the senses. In H. T. Lawless & B. P. Klein (Eds.), Sensory science: Theory and applications in foods (pp. 185-205). New York: Marcel Dekker.
59. Martino, G., & Marks, L. E. (1999). Perceptual and linguistic interactions in speeded classification: Tests of the semantic coding hypothesis. Perception, 28(7), 903-924.
60. Martino, G., & Marks, L. E. (2000). Cross-modal interaction between vision and touch: The role of synesthetic correspondence. Perception, 29(6), 745-754.
61. Martino, G., & Marks, L. E. (2001). Synesthesia: Strong and weak. Current Directions in Psychological Science, 10(2), 61-65.
62. McAdams, S., Winsberg, S., Donnadieu, S., De Soete, G., & Krimphoff, J. (1995). Perceptual scaling of synthesized musical timbres: Common dimensions, specificities, and latent subject classes. Psychological Research, 58(3), 177-192.
63. Melara, R. D., & O'Brien, T. P. (1987). Interaction between synesthetically corresponding dimensions. Journal of Experimental Psychology: General, 116(4), 323-336.
64. Mesz, B., Sigman, M., & Trevisan, M. (2012). A composition algorithm based on crossmodal taste-music correspondences. Frontiers in Human Neuroscience, 6(71), 1-6.
65. Mesz, B., Trevisan, M., & Sigman, M. (2011). The taste of music. Perception, 40(2), 209-219.
66. Mondloch, C. J., & Maurer, D. (2004). Do small white balls squeak? pitch-object correspondences in young children. Cognitive, Affective, & Behavioral Neuroscience, 4(2), 133-136.
67. Moskowitz, H. R., Kluter, R. A., Westerling, J., & Jacobs, H. L. (1974). Sugar sweetness and pleasantness: Evidence for different psychological laws. Science, 184(4136), 583-585.
68. Muggleton, N., Tsakanikos, E., Walsh, V., & Ward, J. (2007). Disruption of synaesthesia following TMS of the right posterior parietal cortex. Neuropsychologia, 45(7), 1582-1585.
69. Nelson, M. R., & Hitchon, J. C. (1995). Theory of synesthesia applied to persuasion in print advertising headlines. Journalism and Mass Communication Quarterly, 72(2), 346-360.
70. Nelson, M. R., & Hitchon, J. C. (1999). Loud tastes, colored fragrances, and scented sounds: How and when to mix the senses in persuasive communications. Journalism and Mass Communication Quarterly, 76(2), 354-372.
71. Ngo, M. K., Misra, R., & Spence, C. (2011). Assessing the shapes and speech sounds that people associate with chocolate samples varying in cocoa content. Food Quality and Preference, 22(6), 567-572.
72. Nuckolls, J. B. (1999). The case for sound symbolism. Annual Review of Anthropology, 28, 225-252.
73. Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957). The measurement of meaning. Urbana: University of Illinois Press.
74. Parise, C. V., & Spence, C. (2008). Synesthetic congruency modulates the temporal ventriloquism effect. Neuroscience Letters, 442(3), 257-261.
75. Parise, C. V., & Spence, C. (2009). "When birds of a feather flock together": Synesthetic correspondences modulate audiovisual integration in non-synesthetes. Plos One, 4(5), e5664.
76. Parise, C. V., & Spence, C. (in press). Audiovisual crossmodal correspondences. In J. Simner & E. Hubbard (Eds.), Oxford handbook of synaesthesia. Oxford, UK: Oxford University Press.
77. Patching, G. R., & Quinlan, P. T. (2002). Garner and congruence effects in the speeded classification of bimodal signals. Journal of Experimental Psychology: Human Perception and Performance, 28(4), 755-775.
78. Pedley, P. E., & Harper, R. S. (1959). Pitch and the vertical localization of sound. The American Journal of Psychology, 72(3), 447-449.
79. Pomerantz, J. R., & Garner, W. R. (1973). Stimulus configuration in selective attention tasks. Attention, Perception, & Psychophysics, 14(3), 565-569.
80. Pratt, C. C. (1930). The spatial character of high and low tones. Journal of Experimental Psychology, 13(3), 278-285.
81. Reber, R., Winkielman, P., & Schwarz, N. (1998). Effects of perceptual fluency on affective judgments. Psychological Science, 9(1), 45-48.
82. Robinson, D. W., & Dadson, R. S. (1957). Threshold of hearing and equal-loudness relations for pure tones, and the loudness function. Journal of the Acoustical Society of America, 29(12), 1284-1288.
83. Rudmin, F., & Cappelli, M. (1983). Tone-taste synesthesia: A replication. Perceptual and Motor Skills, 56(1), 118.
84. Rusconi, E., Kwan, B., Giordano, B. L., Umiltà, C., & Butterworth, B. (2006). Spatial representation of pitch height: The SMARC effect. Cognition, 99(2), 113-129.
85. Schenker, H. (1979). Free composition (E. Oster, Trans.). New York: Longman (Original work published 1935).
86. Schifferstein, H. N. J. (2001). Effects of product beliefs on product perception and liking. In L. J. Frewer, E. Risvik, & H. N. J. Schifferstein (Eds.), Food, people and society. a european perspective of consumers' food choices (pp. 73-96). Berlin: Springer.
87. Schifferstein, H. N. J., & Tanudjaja, I. (2004). Visualising fragrances through colours: The mediating role of emotions. Perception, 33(10), 1249-1266.
88. Schifferstein, H. N. J., & Verlegh, P. W. J. (1996). The role of congruency and pleasantness in odor-induced taste enhancement. Acta Psychologica, 94(1), 87-105.
89. Schiller, P. (1935). Interrelation of different senses in perception. British Journal of Psychology. General Section, 25(4), 465-469.
90. Schwarz, N. (2004). Metacognitive experiences in consumer judgment and decision making. Journal of Consumer Psychology, 14(4), 332-348.
91. Schwarz, N., & Clore, G. L. (1983). Mood, misattribution, and judgments of well-being: Informative and directive functions of affective states. Journal of Personality & Social Psychology, 45(3), 513-523.
92. Schwarz, N., & Clore, G. L. (2003). Mood as information: 20 years later. Psychological Inquiry, 14(3/4), 296-303.
93. Seo, H.-S., & Hummel, T. (2011). Auditory-olfactory integration: Congruent or pleasant sounds amplify odor pleasantness. Chemical Senses, 36(3), 301-309.
94. Shalev, L., & Algom, D. (2000). Stroop and Garner effects in and out of Posner's beam: Reconciling two conceptions of selective attention. Journal of Experimental Psychology: Human Perception and Performance, 26(3), 997-1017.
95. Shankar, M. U., Levitan, C. A., & Spence, C. (2009). Grape expectations: The role of cognitive influences in color-flavor interactions. Consciousness and Cognition, 19(1), 380-390.
96. Simner, J., Cuskley, C., & Kirby, S. (2010). What sound does that taste? Cross-modal mappings across gustation and audition. Perception, 39(4), 553-569.
97. Smith, B. C. (2012). Lemons are fast. Edge. Retrieved February 27, 2012, from http://www. edge. org/responses/what-is-your-favorite-deep-elegant-or-beautiful-explanation.
98. Smith, L. B., & Sera, M. D. (1992). A developmental analysis of the polar structure of dimensions. Cognitive Psychology, 24(1), 99-142.
99. Spence, C. (2011a). Crossmodal correspondences: A tutorial review. Attention, Perception, & Psychophysics, 73(4), 971-995.
100. Spence, C. (2011b). Sound design: Using brain science to enhance auditory and multisensory product and brand development. In K. Bronner, R. Hirt, & C. Ringe (Eds.), ABA Audio Branding Academy Yearbook 2010/2011 (pp. 35-52). Baden-Baden: Nomos Publishers.
101. Spence, C. (2011c). Wine and music. The World of Fine Wine, 31, 96-103.
102. Spence, C. (2012a). Managing sensory expectations concerning products and brands: Capitalizing on the potential of sound and shape symbolism. Journal of Consumer Psychology, 22(1), 37-54.
103. Spence, C. (2012b). Multisensory perception, cognition, and behavior: Evaluating the factors modulating multisensory integration. In B. E. Stein (Ed.), The new handbook of multisensory processing (pp. 241-267). Cambridge: MIT Press.
104. Spence, C., & Driver, J. (Eds.). (2004). Crossmodal space and crossmodal attention. Oxford: Oxford University Press.
105. Spence, C., Levitan, C. A., Shankar, M. U., & Zampini, M. (2010). Does food color influence taste and flavor perception in humans? Chemosensory Perception, 3(1), 68-84.
106. Spence, C., & Parise, C. V. (2012). The cognitive neuroscience of crossmodal correspondences. i-Perception, 3(7), 410-412.
107. Spence, C., & Shankar, M. U. (2010). The influence of auditory cues on the perception of, and responses to, food and drink. Journal of Sensory Studies, 25(3), 406-430.
108. Steiner, J. E., Glaser, D., Hawilo, M. E., & Berridge, K. C. (2001). Comparative expression of hedonic impact: Affective reactions to taste by human infants and other primates. Neuroscience & Biobehavioral Reviews, 25(1), 53-74.
109. Stevens, S. S. (1936). A scale for the measurement of a psychological magnitude: Loudness. Psychological Review, 43(5), 405-416.
110. Stevens, S. S. (1957). On the psychophysical law. Psychological Review, 64(3), 153.
111. Stevenson, R. J., & Boakes, R. A. (2004). Sweet and sour smells: Learned synesthesia between the senses of taste and smell. In G. A. Calvert, C. Spence, & B. E. Stein (Eds.), The handbook of multisensory processes (pp. 69-83). Cambridge: MIT Press.
112. Stevenson, R. J., & Oaten, M. (2008). The effect of appropriate and inappropriate stimulus color on odor discrimination. Attention, Perception, & Psychophysics, 70(4), 640-646.
113. Suzuki, Y., & Takeshima, H. (2004). Equal-loudness-level contours for pure tones. Journal of the Acoustical Society of America, 116(2), 918-933.
114. Synaesthesia: Smells like Beethoven. (2012, February 4). The Economist, p. 66.
115. Terhardt, E. (1974). On the perception of periodic sound fluctuations (roughness). Acustica, 30, 201-213.
116. Terhardt, E. (1984). The concept of musical consonance: A link between music and psychoacoustics. Music Perception, 1(3), 276-295.
117. Walker, R. (1987). The effects of culture, environment, age, and musical training on choices of visual metaphors for sound. Attention, Perception, & Psychophysics, 42(5), 491-502.
118. Walsh, V. (2003). A theory of magnitude: Common cortical metrics of time, space and quantity. Trends in Cognitive Sciences, 7(11), 483-488.
119. Ward, J., Huckstep, B., & Tsakanikos, E. (2006). Sound-colour synaesthesia: To what extent does it use cross-modal mechanisms common to us all? Cortex, 42(2), 264-280.
120. Watt, R., & Quinn, S. (2007). Some robust higher-level percepts for music. Perception, 36(12), 1834-1848.
121. White, T. L., & Prescott, J. (2007). Chemosensory cross-modal stroop effects: Congruent odors facilitate taste identification. Chemical Senses, 32(4), 337-341.
122. Williams, J. M. (1976). Synaesthetic adjectives: A possible law of semantic change. Language, 52(2), 461-478.
123. Woods, A. T., Poliakoff, E., Lloyd, D. M., Kuenzel, J., Hodson, R., Gonda, H., et al. (2011). Effect of background noise on food perception. Food Quality and Preference, 22(1), 42-47.
124. Yamaguchi, S., & Ninomiya, K. (1999). Umami and food palatability. In R. Teranishi, E. L. Wick, & I. Hornstein (Eds.), Flavor chemistry: Thirty years of progress (pp. 423-432). New York: Kluwer Academic.
125. Yeomans, M. R., Chambers, L., Blumenthal, H., & Blake, A. (2008). The role of expectancy in sensory and hedonic evaluation: The case of smoked salmon ice-cream. Food Quality and Preference, 19(6), 565-573.
126. Yorkston, E., & Menon, G. (2004). A sound idea: Phonetic effects of brand names on consumer judgments. Journal of Consumer Research, 31(1), 43-51.