Assessing the role of visual and auditory cues in multisensory perception of flavor

The Neural Bases of Multisensory Processes

Volumn , Issue , 2011, Pages 739-757

  Zampini, Massimiliano ^a   Spence, Charles ^b  

^a UNIVERSITY OF TRENTO   (Italy)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85059481323     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (129)

1. Alais, D., and D. Burr. 2004. The ventriloquist effect results from near-optimal bimodal integration. Current Biology 14: 257-262.
2. Alley, R. L., and T. R. Alley. 1998. The influence of physical state and color on perceived sweetness. Journal of Psychology: Interdisciplinary and Applied 132: 561-568.
3. Ashkenazi, A., and L. E. Marks. 2004. Effect of endogenous attention on detection of weak gustatory and olfac-tory flavors. Perception & Psychophysics 66: 596-608.
4. Auvray, M., and C. Spence. 2008. The multisensory perception of flavor. Consciousness & Cognition 17: 1016-1031.
5. Bartoshuk, L. M., V. B. Duffy, and I. J. Miller. 1994. PTC/PROP tasting: Anatomy, psychophysics, and sex effects. Physiology & Behavior 56: 1165-1171.
6. Bartoshuk, L. M., K. Fast, T. A. Karrer, S. Marino, R. A. Price, and D. A. Reed. 1992. PROP supertasters and the perception of sweetness and bitterness. Chemical Senses 17: 594.
7. Battaglia, P. W., R. A. Jacobs, and R. N. Aslin. 2003. Bayesian integration of visual and auditory signals for spatial localization. Journal of the Optical Society of America A 20: 1391-1397.
8. Bertelson, P., and G. Aschersleben. 1998. Automatic visual bias of perceived auditory location. Psychonomic Bulletin & Review 5: 482-489.
9. Blackwell, L. 1995. Visual clues and their effects on odour assessment. Nutrition and Food Science 5: 24-28.
10. Bourne, M. C. 1982. Food texture and viscosity. New York: Academic Press.
11. Bufe, B., P. A. Breslin, C. Kuhn et al. 2005. The molecular basis of individual differences in phenylthiocarbam-ide and propylthiouracil bitterness perception. Current Biology 15: 322-327.
12. Bult, J. H. F., R. A. de Wijk, and T. Hummel. 2007. Investigations on multimodal sensory integration: Texture, taste, and ortho- and retronasal olfactory stimuli in concert. Neuroscience Letters 411: 6-10.
13. Cain, W. S. 1977. History of research on smell. In Handbook of perception: Vol. 6a: Tasting and smelling, ed. E. C. Carterette and M. P. Friedman, 197-229. New York: Academic Press.
14. Calvert, G., C. Spence, and B. E. Stein. 2004. The handbook of multisensory processing. Cambridge, MA: MIT Press.
15. Cardello, A. V. 1994. Consumer expectations and their role in food acceptance. In Measurement of food preferences, ed. H. J. H. MacFie, and D. M. H. Thomson, 253-297. London: Blackie Academic & Professional.
16. Chan, M. M., and C. Kane-Martinelli. 1997. The effect of color on perceived flavour intensity and acceptance of foods by young adults and elderly adults. Journal of the American Dietetic Association 97: 657-659.
17. Chandrashekar, J., D. Yarmolinsky, L. von Buchholtz et al. 2009. The taste of carbonation. Science 326: 443-445.
18. Chen, H., C. Karlsson, and M. Povey. 2005. Acoustic envelope detector for crispness assessment of biscuits. Journal of Texture Studies 36: 139-156.
19. Christensen, C. M. 1980a. Effects of taste quality and intensity on oral perception of viscosity. Perception & Psychophysics 28: 315-320.
20. Christensen, C. M. 1980b. Effects of solution viscosity on perceived saltiness and sweetness. Perception & Psychophysics 28: 347-353.
21. Christensen, C. M., and Z. M. Vickers. 1981. Relationship of chewing sounds to judgments of food crispness. Journal of Food Science 46: 574-578.
22. Clydesdale, F. M. 1993. Color as a factor in food choice. Critical Reviews in Food Science and Nutrition 33: 83-101.
23. Dalton, P., N. Doolittle, H. Nagata, and P. A. S. Breslin. 2000. The merging of the senses: Integration of sub-threshold taste and smell. Nature Neuroscience 3: 431-432.
24. Davis, R. 1981. The role of nonolfactory context cues in odor identification. Perception & Psychophysics 30: 83-89.
25. De Araujo, I. E. T, E. T. Rolls, M. L. Kringelbach, F. McGlone, and N. Phillips. 2003. Taste-olfectory con-vergence, and the representation of the pleasantness of flavour, in the human brain. European Journal of Neuroscience 18: 2059-2068.
26. de Craen, A. J. M., P. J. Roos, A. L. de Vries, and J. Kleijnen. 1996. Effect of colour of drugs: Systematic review of perceived effect of drugs and their effectiveness. British Medical Journal 313: 1624-1626.
27. Deliza, R., and H. MacFie. 1996. The generation of sensory expectation by external cues and its effect on sen-sory perception and hedonic ratings: A review. Journal of Sensory Studies 11: 103-128.
28. Delwiche, J. 2004. The impact of perceptual interactions on perceived flavour. Food Quality and Preference 15: 137-146.
29. Demattè, M. L., D. Sanabria, and C. Spence. 2006. Crossmodal associations and interactions between olfaction and vision. Chemical Senses 31: E50-E51.
30. Demattè, M. L., D. Sanabria, and C. Spence. 2009. Olfactory identification: When vision matters? Chemical Senses 34: 103-109.
31. Drake, B. K. 1963. Food crunching sounds. An introductory study. Journal of Food Science 28: 233-241.
32. Drake, B. K. 1970. Relationships of sounds and other vibrations to food acceptability. Proceedings of the 3rd International Congress of Food Science and Technology, pp. 437-445. August 9-14, Washington, DC.
33. Drewnowski, A. 2003. Genetics of human taste perception. In Human olfaction and gustation, 2nd ed., ed. R. L. Doty, 847-860. New York: Marcel Dekker, Inc.
34. DuBose, C. N., A. V. Cardello, and O. Maller. 1980. Effects of colourants and flavourants on identification, perceived flavour intensity, and hedonic quality of fruit-flavoured beverages and cake. Journal of Food Science 45: 1393-1399, 1415.
35. Duffy, V. B. 2007. Variation in oral sensation: Implications for diet and health. Current Opinion in Gastroenterology 23: 171-177.
36. Duncker, K. 1939. The influence of past experience upon perceptual properties. American Journal of Psychology 52: 255-265.
37. Engen, T. 1972. The effect of expectation on judgments of odour. Acta Psychologica 36: 450-458.
38. Ernst, M. O., and M. S. Banks. 2002. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415: 429-433.
39. Essick, G. K., A. Chopra, S. Guest, and F. McGlone. 2003. Lingual tactile acuity, taste perception, and the den-sity and diameter of fungiform papillae in female subjects. Physiology & Behavior 80: 289-302.
40. Frank, R. A., K. Ducheny, and S. J. S. Mize. 1989. Strawberry odor, but not red color, enhances the sweetness of sucrose solutions. Chemical Senses 14: 371-377.
41. Garber Jr., L. L., E. M. Hyatt, and Ü. Ö. Boya. 2008. The mediating effects of the appearance of nondu-nondu-rable consumer goods and their packaging on consumer behavior. In Product experience, ed. H. N. J. Schifferstein and P. Hekkert, 581-602. London: Elsevier.
42. Garber Jr., L. L., E. M. Hyatt, and R. G. Starr Jr. 2000. The effects of food colour on perceived flavour. Journal of Marketing Theory and Practice 8: 59-72.
43. Garber Jr., L. L., E. M. Hyatt, and R. G. Starr Jr. 2001. Placing food color experimentation into a valid con-con-sumer context. Journal of Food Products Marketing 7: 3-24.
44. Gifford, S. R., and F. M. Clydesdale. 1986. The psychophysical relationship between colour and sodium chlo-ride concentrations in model systems. Journal of Food Protection 49: 977-982.
45. Gifford, S. R., F. M. Clydesdale, and R. A. Damon Jr. 1987. The psychophysical relationship between colour and salt concentration in chicken flavoured broths. Journal of Sensory Studies 2: 137-147.
46. Gobbelé, R., M. Schürrmann, N. Forss, K. Juottonen, H. Buchner, and R. Hari. 2003. Activation of the human posterior and tempoparietal cortices during audiotactile interaction. Neuroimage 20: 503-511.
47. Green, B. G., G. S. Shaffer, and M. M. Gilmore. 1993. Derivation and evaluation of a semantic scale of oral sensation with apparent ratio properties. Chemical Senses 18: 683-702.
48. Hollowood, T. A., R. S. T. Linforth, and A. J. Taylor. 2002. The effect of viscosity on the perception of flavour. Chemical Senses 27: 583-591.
49. Hutchings, J. B. 1977. The importance of visual appearance of foods to the food processor and the consumer. In Sensory properties of foods, ed. G. G. Birch, J. G. Brennan, and K. J. Parker, 45-57. London: Applied Science Publishers.
50. Johnson, J. L., and F. M. Clydesdale. 1982. Perceived sweetness and redness in coloured sucrose solutions. Journal of Food Science 47: 747-752.
51. Johnson, J. L., E. Dzendolet, and F. M. Clydesdale. 1983. Psychophysical relationships between sweetness and redness in strawberry-drinks. Journal of Food Protection 46: 21-25.
52. Kim, U. K., P. A. Breslin, D. Reed, and D. Drayna. 2004. Genetics of human taste perception. Journal of Dental Research 83: 448-453.
53. Kitagawa, N., and C. Spence. 2006. Audiotactile multisensory interactions in information processing. Japanese Psychological Research 48: 158-173.
54. Koshi, E. B., and C. A. Short. 2007. Placebo theory and its implications for research and clinical practice: A review of the recent literature. Pain Practice 7: 4-20.
55. Koza, B., A. Cilmi, M. Dolese, and D. Zellner. 2005. Color enhances orthonasal olfactory intensity and reduces retronasal olfactory intensity. Chemical Senses 30: 643-649.
56. Lavin, J., and H. T. Lawless. 1998. Effects of colour and odor on judgments of sweetness among children and adults. Food Quality and Preference 9: 283-289.
57. Lawless, H., P. Rozin, and J. Shenker. 1985. Effects of oral capsaicin on gustatory, olfactory and irritant sensa-tions and flavor identification in humans who regularly or rarely consume chili pepper. Chemical Senses 10: 579-89.
58. Lee, L., S. Frederick, and D. Ariely. 2006. Try it, you'll like it. Psychological Science 17: 1054-1058.
59. Levänen, S., V. Jousmäki, and R. Hari. 1998. Vibration-induced auditory-cortex activation in a congenitally deaf adult. Current Biology 8: 869-872.
60. Levitan, C. A., M. Zampini, R. Li, and C. Spence. 2008. Assessing the role of colour cues and people's beliefs about colour-flavour associations on the discrimination of the flavour of sugar-coated chocolates. Chemical Senses 33: 415-423.
61. Lucchelli, P. E., A. D. Cattaneo, and J. Zattoni. 1978. Effect of capsule colour and order of administration of hypnotic treatments. European Journal of Clinical Pharmacology 13: 153-155.
62. Maga, J. A. 1974. Influence of colour on taste thresholds. Chemical Senses and Flavour 1: 115-119.
63. Marks, L. E., and M. E. Wheeler. 1998. Attention and the detectability of weak-taste stimuli. Chemical Senses 23: 19-29.
64. Masuda, M., Y. Yamaguchi, K. Arai, and K. Okajima. 2008. Effect of auditory information on food recognition. IEICE Technical Report 108(356): 123-126.
65. Moir, H. C. 1936. Some observations on the appreciation of flavour in food stuffs. Chemistry and Industry 55: 145-148.
66. Morrot, G., F. Brochet, and D. Dubourdieu. 2001. The colour of odors. Brain and Language 79: 309-320.
67. Murphy, C., and W. S. Cain. 1980. Taste and olfaction: Independence vs. interaction. Physiology and Behavior 24: 601-605.
68. Oram, N., D. G. Laing, I. Hutchinson et al. 1995. The influence of flavour and colour on drink identification by children and adults. Developmental Psychobiology 28: 239-246.
69. Osterbauer, R. A., P. M. Matthews, M. Jenkinson, C. F. Beckmann, P. C. Hansen, and G. A. Calvert. 2005. Color of scents: Chromatic stimuli modulate odor responses in the human brain. Journal of Neurophysiology 93: 3434-3441.
70. Pangborn, R. M. 1960. Influence of colour on the discrimination of sweetness. American Journal of Psychology 73: 229-238.
71. Pangborn, R. M., and B. Hansen. 1963. The influence of colour on discrimination of sweetness and sourness in pear-nectar. American Journal of Psychology 76: 315-317.
72. Philipsen, D. H., F. M. Clydesdale, R. W. Griffin, and P. Stern. 1995. Consumer age affects response sensory characteristics of a cherry flavoured beverage. Journal of Food Science 60: 364-368.
73. Prescott, J. 1999. Flavour as a psychological construct: Implications for perceiving and measuring the sensory qualities of foods. Food Quality and Preference 10: 349-356.
74. Prescott, J. 2004. Psychological processes in flavour perception. In Flavour perception, ed. A. J. Taylor and D. Roberts, 256-278. London: Blackwell Publishing.
75. Prescott, J., N. Ripandelli, and I. Wakeling. 2001. Binary taste mixture interactions in PROP non-tasters, medium-tasters and super-tasters. Chemical Senses 26: 993-1003.
76. Prescott, J., J. Soo, H. Campbell, and C. Roberts. 2004. Response of PROP taster groups to variations in sen-sory qualities within foods and beverages. Chemical Senses 26: 993-1003.
77. Reed, D. R. 2008. Birth of a new breed of supertaster. Chemical Senses 33: 489-491.
78. Rolls, E. T. 2004. Smell, taste, texture, and temperature multimodal representations in the brain, and their rel-evance to the control of appetite. Nutrition Reiews 62: S193-S204.
79. Rolls, E. T., and L. L. Baylis. 1994. Gustatory, olfactory, and visual convergence within the primate orbitofron-tal cortex. Journal of Neuroscience 14: 5437-5452.
80. Roth, H. A., L. J. Radle, S. R. Gifford, and F. M. Clydesdale. 1988. Psychophysical relationships between perceived sweetness and colour in lemon- and lime-flavoured drinks. Journal of Food Science 53: 1116-1119, 1162.
81. Rozin, P. 1982. "Taste-smell confusions" and the duality of the olfactory sense. Perception & Psychophysics 31: 397-401.
82. Schroeder, C. E., R. W. Lindsley, C. Specht, A. Marcovici, J. F. Smiley, and D. C. Javitt. 2001. Somatosensory in-put to auditory association cortex in the macaque monkey. Journal of Neurophysiology 85: 1322-1327.
83. Seymour, S. K., and D. D. Hamann. 1988. Crispness and crunchiness of selected low moisture foods. Journal of Texture Studies 19: 79-95.
84. Shankar, M. U., C. A. Levitan, J. Prescott, and C. Spence. 2009. The influence of color and label information on flavor perception. Chemosensory Perception 2: 53-58.
85. Shankar, M. U., C. Levitan, and C. Spence. 2010. "Grape expectations": Does higher level knowledge mediates the interpretation of multisensory cues? Consciousness & Cognition 19: 380-390.
86. Shimojo, S., and L. Shams. 2001. Sensory modalities are not separate modalities: Plasticity and interactions. Current Opinion in Neurobiology 11: 505-509.
87. Skrandies, W., and N. Reuther. 2008. Match and mismatch of taste, odor, and color is reflected by electrical activity in the human brain. Journal of Psychophysiology 22: 175-184.
88. Small, D. M. 2004. Crossmodal integration-insights from the chemical senses. Trends in Neurosciences 27: 120-123.
89. Small, D. M., J. C. Gerber, Y. E. Mak, and T. Hummel. 2005. Differential neural responses evoked by orthona-sal versus retronasal odorant perception in humans. Neuron 47: 593-605.
90. Small, D. M., and J. Prescott 2005. Odor/taste integration and the perception of flavour. Experimental Brain Research 166: 345-357.
91. Small, D. M., M. G. Veldhuizen, J. Felsted, Y. E. Mak, and F. McGlone. 2008. Separable substrates for anticipa-tory and consummatory food chemosensation. Neuron 57: 786-797.
92. Spence, C. 2002. The ICI report on the secret of the senses. London: The Communication Group.
93. Spence, C., C. Levitan, M. U. Shankar, and M. Zampini. 2010. Does food colour influence flavour identification in humans? Chemosensory Perception 3: 68-84.
94. Spence, C., and M. U. Shankar. 2010. The influence of auditory cues on the perception of, and responses to, food and drink. Journal of Sensory Studies 25: 406-430.
95. Spence, C., M. U. Shankar, and H. Blumenthal. In press. 'Sound bites': Auditory contributions to the percep-tion and consumption of food and drink. To appear in Art and the senses, ed. F. Bacci and D. Melcher. Oxford: Oxford Univ. Press.
96. Spence, C., and M. Zampini. 2006. Auditory contributions to multisensory product perception. Acta Acustica united with Acustica 92: 1009-1025.
97. Stevenson, R. J., and R. A. Boakes. 2004. Sweet and sour smells: Learned synesthesia between the senses of taste and smell. In The handbook of multisensory processes, ed. G.A. Calvert, C. Spence, and B. E. Stein, 69-83. Cambridge, MA: MIT Press.
98. Stevenson, R. J., R. A. Boakes, and J. Prescott. 1998. Changes in odor sweetness resulting from implicit learn-ing of a simultaneous odor-sweetness association: An example of learned synesthesia. Learning and Motivation 29: 113-132.
99. Stevenson, R. J. 2009. The psychology of flavour. Oxford: Oxford Univ. Press.
100. Stevenson, R. J., and M. Oaten. 2008. The effect of appropriate and inappropriate stimulus color on odor dis-crimination. Perception & Psychophysics 70: 640-646.
101. Stevenson, R. J., and C. Tomiczek. 2007. Olfactory-induced synesthesias: A review and model. Psychological Bulletin 133: 294-309.
102. Stillman, J. 1993. Colour influences flavour identification in fruit-flavoured beverages. Journal of Food Science 58: 810-812.
103. Stillman, J. A. 2002. Gustation: Intersensory experience par excellence. Perception 31: 1491-1500.
104. Strugnell, C. 1997. Colour and its role in sweetness perception. Appetite 28: 85.
105. Tyle, P. 1993. Effect of size, shape and hardness of particles in suspension on oral texture and palatability. Acta Psychologica 84: 111-118.
106. Varela, P., J. Chen, C. Karlsson, and M. Povey. 2006. Crispness assessment of roasted almonds by an integrated approach to texture description: Texture, acoustics, sensory and structure. Journal of Chemometrics 20: 311-320.
107. Verhagen, J. V., and L. Engelen. 2006. The neurocognitive bases of human multimodal food perception: Sensory integration. Neuroscience and Biobehavioral Reviews 30: 613-650.
108. Vickers, Z. M. 1979. Crispness and crunchiness in foods. In Food texture and rheology, ed. P. Sherman, 145-166. London: Academic Press.
109. Vickers, Z. M. 1981. Relationships of chewing sounds to judgments of crispness, crunchiness and hardness. Journal of Food Science 47: 121-124.
110. Vickers, Z. M. 1983. Pleasantness of food sounds. Journal of Food Science 48: 783-786.
111. Vickers, Z. M. 1984. Crispness and crunchiness-A difference in pitch? Journal of Texture Studies 15: 157-163.
112. Vickers, Z. M. 1987. Crispness and crunchiness-Textural attributes with auditory components. In Food tex-ture: Instrumental and sensory measurement, ed. H. R. Moskowitz, 45-66. New York: Marcel Dekker.
113. Vickers, Z. M. 1991. Sound perception and food quality. Journal of Food Quality 14: 87-96.
114. Vickers, Z. M., and M. C. Bourne. 1976. A psychoacoustical theory of crispness. Journal of Food Science 41: 1158-1164.
115. Vickers, Z. M., and S. S. Wasserman. 1979. Sensory qualities of food sounds based on individual perceptions. Journal of Texture Studies 10: 319-332.
116. von Békésy, G. 1957. Neural volleys and the similarity between some sensations produced by tones and by skin vibrations. Journal of the Acoustical Society of America 29: 1059-1069.
117. Welch, R. B., and D. H. Warren. 1980. Immediate perceptual response to intersensory discrepancy. Psychological Bulletin 3: 638-667.
118. Wheatley, J. 1973. Putting colour into marketing. Marketing 67: 24-29.
119. White, T. L., and J. Prescott. 2007. Chemosensory cross-modal Stroop effects: Congruent odors facilitate taste identification. Chemical Senses 32: 337-341
120. Yau, N. J. N., and M. R. McDaniel. 1992. The effect of temperature on carbonation perception. Chemical Senses 14: 337-348.
121. Yeomans, M., L. Chambers, H. Blumenthal, and A. Blake. 2008. The role of expectancy in sensory and hedonic evaluation: The case of smoked salmon ice-cream. Food Quality and Preference 19: 565-573.
122. Zampini, M., D. Sanabria, N. Phillips, and C. Spence. 2007. The multisensory perception of flavour: Assessing the influence of colour cues on flavour discrimination responses. Food Quality & Preference 18: 975-984.
123. Zampini, M., and C. Spence. 2004. The role of auditory cues in modulating the perceived crispness and stale-ness of potato chips. Journal of Sensory Studies 19: 347-363.
124. Zampini, M., and C. Spence. 2005. Modifying the multisensory perception of a carbonated beverage using auditory cues. Food Quality and Preference 16: 632-641.
125. Zampini, M., E. Wantling, N. Phillips, and C. Spence. 2008. Multisensory flavour perception: Assessing the influence of fruit acids and colour cues on the perception of fruit-flavoured beverages. Food Quality & Preference 18: 335-343.
126. Zellner, D. A., A. M. Bartoli, and R. Eckard. 1991. Influence of colour on odor identification and liking ratings. American Journal of Psychology 104: 547-561.
127. Zellner, D. A., and P. Durlach. 2003. Effect of colour on expected and experienced refreshment, intensity, and liking of beverages. American Journal of Psychology 116: 633-647.
128. Zellner, D. A., and M. A. Kautz. 1990. Colour affects perceived odor intensity. Journal of Experimental Psychology: Human Perception and Performance 16: 391-397.
129. Zellner, D. A., and L. A. Whitten. 1999. The effect of colour intensity and appropriateness on color-induced odor enhancement. American Journal of Psychology 112: 585-604.