Do natural pictures mean natural tastes? Assessing visual semantics experimentally

Cognitive Semiotics

Volumn 8, Issue 1, 2015, Pages 53-86

  Smith, Viktor ^a   Barratt, Daniel ^a,b   Selsøe Sørensen, Henrik ^a  

^a Copenhagen Business School ^*  (Denmark)

^b LUND UNIVERSITY   (Sweden)

Author keywords

conceptual combination; consumer law; food labelling; pictures; propositional indeterminacy; relevance theory; visual semantics; words

Indexed keywords

EID: 84965117442     PISSN: None     EISSN: 22352066     Source Type: Journal    
DOI: 10.1515/cogsem-2015-0001     Document Type: Article

References (100)

1. Andersson, Richard,. 2012. Language and vision: Using visual information in real world language situations. Lund University Cognitive Studies 152. Lund: Lund University Press.
2. Austin, John L,. 1962. How to do things with words. Oxford: Oxford University Press.
3. Barrett, Deirdre,. 2010. Supernormal stimuli: How primal urges overran their evolutionary purpose. New York: W. W. Norton & Company.
4. Barsalou, Lawrence W,. 1987. The instability of graded structure: Implications for the nature of concepts. In Ulric Neisser, (ed.), Concepts and conceptual development: Ecological and intellectual factors in categorization, 101-39. Cambridge: Cambridge University Press.
5. Barsalou, Lawrence W,. 1999. Perceptual symbol systems. Behavioral & Brain Sciences 22. 577-660.
6. Bartes, Roland,. 1968. Elements of semiology. New York: Hill and Wang.
7. Beauchamp, Michael S., Kathryn E Lee, James V Haxby, & Alex Martin,. 2002. Parallel visual motion processing streams for manipulable objects and human movements. Neuron 34. 149-59.
8. Benczes, Réka,. 2006. Creative compounding in English. Amsterdam: John Benjamins.
9. Bone Paula, F., & Karen R France,. 2001. Package graphics and consumer product beliefs. Journal of Business and Psychology 15. 467-89.
10. Bundgaard, Peer F., Svend Ostergaard, & Frederik Stjernfelt,. 2006. Waterproof fire stations? Conceptual schemata and cognitive operations involved in compound constructions. Semiotica 161 (1/4). 363-93.
11. Chandon, Pierre, & Brian Wansink,. 2011. Is food marketing making us fat? A multi-disciplinary review. Foundations and Trends in Marketing 5. 113-96.
12. Chen, Yi-Chuan, & Charles Spence,. 2010. When hearing the bark helps to identify the dog: Semantically-congruent sounds modulate the identification of masked pictures. Cognition 114. 389-404.
13. Chun, Marvin M., & Jeremy M Wolfe,. 2001. Visual attention. In E. Bruce Goldstein, (ed.), Blackwell handbook of perception, 272-310. Oxford: Blackwell.
14. Cohen, Henry, and Claire Lefebvre, (eds.). 2005. Handbook of categorization in cognitive science. Amsterdam: Elsevier.
15. Connell, Louise, & Dermot Lynott,. 2012. When does perception facilitate or interfere with conceptual processing? The effect of attentional modulation. Frontiers in Psychology 3. 474.
16. Cummings, Louise,. 2005. Pragmatics: A multidisciplinary perspective. Edinburgh: Edinburgh University Press.
17. Currie, Gregory,. 1991. Photography, painting and perception. Journal of Aesthetics and Art Criticism 49 (1). 23-29.
18. Damasio, Antonio R., & Hanna Damasio,. 1994. Cortical systems for retrieval of concrete knowledge: The convergence zone framework. In Christof Koch, and Joel L. Davis, (eds.), Large-scale neuronal theories of the brain, 61-74. Cambridge: MIT Press.
19. Debes, John L,. 1969. The loom of visual literacy. Audiovisual Instruction 14. 25-27.
20. Estes, Zachary, & Sam Glucksberg,. 2000. Interactive property attribution in concept combination. Memory & Cognition 28. 28-34.
21. Estes, Zachary, & Lara L. Jones,. 2006. Priming via relational similarity: A copper horse is faster when seen through a glass eye. Journal of Memory and Language 55. 89-101.
22. Fauconnier, Gilles, & Mark Turner,. 2002. The way we think: Conceptual blending and the mind's hidden complexities. New York: Basic Books.
23. Fernbach, Philip M., Adam Darlow, & Steven A. Sloman,. 2011. When good evidence goes bad: The weak evidence effect in judgment and decision-making. Cognition 119. 459-67.
24. Forceville, Charles J,. 1996. Pictorial metaphor in advertising. London: Routledge.
25. Forceville, Charles J., & Eduardo Urios-Aparisi,. 2008. Multimodal metaphor. Berlin: Walter de Gruyter.
26. Frewer, Lynn, and Hans van Trijp, (eds.). 2007. Understanding consumers of food products. Cambridge: Woodhead.
27. Gagné, Christina L., & Edward J. Shoben,. 1997. Influence of thematic relations on the comprehension of modifier-noun combinations. Journal of Experimental Psychology: Learning, Memory, and Cognition 23. 71-87.
28. Gagné, Christina L., & Thomas L. Spalding,. 2006. Using conceptual combination research to Better understand novel compound words. SKASE Journal of Theoretical Linguistics 3. 9-16.
29. Gagné, Christina L., Thomas L. Spalding, & Melissa C. Gorrie,. 2005. Sentential context and the interpretation of familiar open-compounds and novel modifier-noun phrases. Language and Speech 48. 203-21.
30. Gidlöf, Kerstin, Annika Wallin, Peter Møgelvang-Hansen, & Kenneth Holmqvist,. 2013. Material distortion of economic behaviour and everyday decision quality. Journal of Consumer Policy 36 (4). 389-402.
31. Gill, Tripat, & Laurette Dubé. 2007. What is a leather iron or a bird phone? Using conceptual combinations to generate and understand new product concepts. Journal of Consumer Psychology 17. 202-17.
32. Grice, H. Paul,. 1975. Logic in conversation. In Peter Cole, and Jerry L. Morgan, (eds.), Syntax and semantics, vol. 3: Speech acts, 41-58. New York: Academic Press.
33. Hansen, Torben,. 2005. Perspectives on consumer decision making: An integrated approach. Journal of Consumer Behaviour 4. 420-37.
34. Hartsuiker, Robert J., Clara. M. Catchpole, Nivja H. de Jong, & Martin J. Pickering,. 2008. Concurrent processing of words and their replacements during speech. Cognition 108. 601-7.
35. Howells, Geraint, Hans-Wolfgang Micklitz, & Thomas Wilhelmsson,. 2006. European fair trading law. Burlington: Ashgate.
36. Hoyer, Wayne D,. 1984. An examination of consumer decision making for a common repeat purchase product. Journal of Consumer Research 11. 822-29.
37. Incardona, Rossella, & Cristina Poncibò. 2007. The average consumer, the unfair commercial practices directive, and the cognitive revolution. Journal of Consumer Policy 30. 21-38.
38. Iyengar, Sheena S., & Lepper Mark R,. 2000. When choice is demotivating: Can one desire too much of a good thing?. Journal of Personality and Social Psychology 79. 995-1006.
39. Jaszczolt, Katarzyna M,. 2005. Default semantics: Foundations of a compositional theory of acts of communication. Oxford: Oxford University Press.
40. Jespersen, Otto,. 1942. A modern English grammar on historical principles. Vol. VI. Copenhagen: Munksgaard.
41. Jones, Phil,. 2007. Constructing meaning from letterforms: Reflections on the development of a practice-based research proposal. Journal of Research Practice 3. Article M9.
42. Kauppinen, Hannele,. 2004. Colours as non-verbal signs on packages. Doctoral Thesis. Economics and Society 139. Helsinki: Swedish School of Economics and Business Administration.
43. Khan, Uzma, Ravi Dhar, & Klaus Wertenbroch,. 2005. A behavioral decision theory perspective on hedonic and utilitarian choice. In S. Ratneshwar, and David G. Mick, (eds.), Inside consumption: Frontiers of research on consumer motives, goals, and desires, 144-65. New York: Routledge.
44. Kircher, Tilo, Katharina Sass, Olga Sachs, & Sören Krach,. 2009. Priming words with pictures: Neural correlates of semantic associations in a cross-modal priming task using fMRI. Human Brain Mapping 30. 4116-28.
45. Kress, Gunther, & Theo van Leeuwen,. 2006. Reading images: The grammar of visual design, 2nd edn. London: Routledge.
46. Krott, Andrea,. 2009. The role of analogy for compound words. In James P. Blevins, and J. Juliette Blevins, (eds.), Analogy in grammar: Form and acquisition, 118-36. Oxford: Oxford University Press.
47. Kuramori, Mihoko, Tatsuya Iwaki, & Takashi Kusumi,. 2009. Emergence of form and function in a visual image combination. Psychologia 52. 50-66.
48. Legrand, Pierre,. 1996. How to compare now?. Legal Studies 16. 232-42.
49. Libben, Gary, & Jarema, Gonia, (eds.). 2006. The representation and processing of compound words. Oxford: Oxford University Press.
50. Lorenz, Konrad,. 1970. Studies in animal and human behaviour. Vol. I. Translated by R. Martin. London: Methuen.
51. Lynott, Dermot, & Louise Connell,. 2010. Embodied conceptual combination. Frontiers in Psychology 1. 212.
52. MacMaoláin, Caoimhin,. 2007. EU food law: Protecting consumers and health in a common market. Oxford: Hart Publishing.
53. Marcus, Gary F,. 2001. The algebraic mind: Integrating connectionism and cognitive science (learning, development, and conceptual change). Cambridge: MIT Press.
54. Messaris, Paul,. 1994. Visual literacy: Image, mind, and reality. Boulder: Westview Press.
55. Messaris, Paul,. 1997. Visual persuasion: The role of images in advertising. Thousand Oaks, CA: Sage Publications.
56. Micklitz, Hans-Wolfgang, Viktor Smith, and Mette Ohm Rørdam, (eds.). 2010. New challenges for the assessment of fairness in a common market. EUI Working papers LAW (21). Florence: European University Institute.
57. Moskowitz, Howard R., Michele Reisner, Barbara Itty, Rachel Katz, & Bert Krieger,. 2006. Steps towards a consumer-driven 'concept innovation machine' for food and drink. Food Quality and Preference 17 (7-8). 536-51.
58. Murphy, Gregory L,. 1988. Comprehending complex concepts. Cognitive Science 12. 529-62.
59. Murphy, Gregory L,. 1990. Noun phrase interpretation and conceptual combination. Journal of Memory and Language 29. 259-88.
60. Møgelvang-Hansen, Peter,. 2010. Methods of legal regulation and real-life case scenarios. In Hans-Wolfgang Micklitz, Viktor Smith, and Mette Ohm Rørdam, eds., New challenges for the assessment of fairness in a common market. EUI Working papers LAW(21), 49-57. Florence: European University Institute.
61. Peirce, Charles S,. 1867-1893/1992. The essential Peirce: Selected philosophical writings, volume 1 (1867-1893). Peirce Edition Project, ed. Bloomington: Indiana University Press.
62. Pieters, Rik, & Luk Warlop,. 1999. Visual attention during brand choice: The impact of time pressure and task motivation. International Journal of Research in Marketing 16. 1-16.
63. Pilditch, James,. 1973. The silent salesman, 2nd edn. London: Business Books Limited.
64. Plantinga, Carl R,. 1997. Rhetoric and representation in the nonfiction film. Cambridge: Cambridge University Press.
65. Ran, Bing, & P. Robert Duimering,. 2010. Conceptual combination: Models, theories and controversies. International Journal of Cognitive Linguistics 1. 65-90.
66. Roe, Brian, Alan S. Levy, & Brenda M. Derby,. 1999. The impact of health claims on consumer search and product evaluation outcomes: Results from FDA experimental data. Journal of Public Policy & Marketing 18. 89-105.
67. Rosch, Eleanor,. 1975. Cognitive representations of semantic categories. Journal of Experimental Psychology: General 104. 192-233.
68. Ross, Brian H., & Gregory L. Murphy,. 1999. Food for thought: Cross-classification and category organization in a complex real-world domain. Cognitive Psychology 38. 495-553.
69. Rumelhart, David E,., James L. McClelland, and the PDP Research Group (eds.). 1986. Parallel distributed processing: Explorations in the microstructure of cognition. Vol. 1: foundations. Vol. 2: psychological and biological models. Cambridge: MIT Press.
70. Ryder, Mary E,. 1994. Ordered chaos: The interpretation of English noun-noun compounds. Berkeley: University of California Press.
71. Scott, Linda,. 1994. Images in advertising: The need for a theory of visual rhetoric. Journal of Consumer Research 21. 252-73.
72. Selsøe Sørensen, Henrik, Jesper Clement, & Gorm Gabrielsen,. 2012. Food labels: An explorative study into label information and what consumers see and understand. The International Review of Retail, Distribution and Consumer Research 22. 101-14.
73. Selsøe Sørensen, Henrik, Lotte Holm, Peter Møgelvang-Hansen, Daniel Barratt, Françoise Qvistgaard, & Viktor Smith,. 2013. Consumer understanding of food labels: Towards a generic tool for identifying the average consumer. Report from a Danish exploration. International Review of Retail, Distribution and Consumer Research 23 (3). 291-304.
74. Sheehan, Brendan,. 2010. The economics of abundance: Affluent consumption and the global economy. Cheltenham: Edward Elgar.
75. Simmons, W. Kyle, Alex Martin, & Lawrence W Barsalou,. 2005. Pictures of appetizing foods activate gustatory cortices for taste and reward. Cerebral Cortex 15. 1602-8.
76. Smith, Viktor, Daniel Barratt, & Jordan Zlatev,. 2014. Unpacking noun-noun compounds: Interpreting novel and conventional food names in isolation and on food labels. Cognitive Linguistics 25. 1.
77. Smith, Viktor, Jesper Clement, Peter Møgelvang-Hansen, & Henrik Selsøe Sørensen,. 2011. Assessing in-store food-to-consumer communication from a fairness perspective: An integrated approach. Fachsprache-International Journal of Specialized Communication 33 (1-2). 84-106.
78. Smith, Viktor, Ditte Green-Petersen, Peter Møgelvang-Hansen, Rune H. B. Christensen, Françoise Qvistgaard, & Grethe Hyldig,. 2013. What's (in) a real smoothie: A division of linguistic labour in consumers' acceptance of name-product combinations? Appetite 63. 129-40.
79. Smith, Viktor, Peter Møgelvang-Hansen, & Grethe Hyldig,. 2010. Spin versus fair speak in food labelling: A matter of taste? Food Quality and Preference 21. 1016-25.
80. Smith, Edward E., Daniel N. Osherson, Lance J. Rips, & Margaret Keane,. 1988. Combining prototypes: A selective modification model. Cognitive Science 12. 485-527.
81. Smith, Viktor, Mette Ohm Søndergaard, Jesper Clement, Peter Møgelvang-Hansen, Henrik Selsøe Sørensen, & Gorm Gabrielsen,. 2009. Fair speak: Scenarier for vildledning på det danske fødevaremarked [fair speak: scenarios of misleading practices on the Danish food market). Copenhagen: Ex Tuto Publishing.
82. Sonesson, Göran,. 1989. Pictorial concepts: Inquiries into the semiotic heritage and its relevance for the analysis of the visual world. Lund: Lund University Press.
83. Sperber, Dan, & Deirdre Wilson,. 1987. Précis of relevance: Communication and cognition. Behavioral and Brain Sciences 10. 697-710.
84. Sperber, Dan, & Deirdre Wilson,. 1995. Relevance: Communication and cognition, 2nd edn. Malden: Blackwell Publishing.
85. Tagalakis, Georgios, & Mark T. Keane,. 2005. How understanding novel compounds is facilitated by priming from similar, known compounds. In Proceedings of the 27th Annual Conference of the Cognitive Science Society.
86. Taylor, John R,. 1989. Linguistic categorization: Prototypes in linguistic theory. Oxford: Clarendon Press.
87. Tinbergen, Niko,. 1951. The study of instinct. Oxford: Clarendon Press.
88. Trzaskowski, Jan,. 2011. Behavioural economics, neuroscience, and the unfair commercial practices directive. Journal of Consumer Policy 34. 377-92.
89. Tylén, Kristian, Mikkel Wallentin, & Andreas Roepstorff,. 2009. Say it with flowers! An fMRI study of object mediated communication. Brain & Language 108. 159-66.
90. Underwood, Robert L., & Noreen M. Klein,. 2002. Packaging as brand communication: Effects of product pictures on consumer responses to the package and brand. Journal of Marketing Theory and Practice 10. 58-68.
91. van Jaarsveld, Henk J., Riet Coolen, & Robert Schreuder,. 1994. The role of analogy in the interpretation of novel compounds. Journal of Psycholinguistic Research 23. 111-37.
92. Veale, Tony, & Yanfen Hao,. 2008. Generating and understanding creative comparisons. In Creative intelligent systems. Papers from the 2008 AAAI spring symposium, 123-127. Stanford, CA: Stanford University.
93. Vermeulen, Nicolas, Olivier Corneille, & Paula M. Niedenthal,. 2008. Sensory load incurs conceptual processing costs. Cognition 109. 287-94.
94. Wansink, Brian, & Pierre Chandon,. 2006. Can "low fat" nutrition labels lead to obesity?. Journal of Marketing Research 43. 605-17.
95. Williams, Peter,. 2005. Consumer understanding and use of health claims for foods. Nutrition Reviews 63. 256-64.
96. Wisniewski, Edward J,. 1996. Construal and similarity in conceptual combination. Journal of Memory and Language 35. 434-53.
97. Wolfe, Jeremy M,. 1999. Inattentional amnesia. In Veronika Coltheart, (ed.), Fleeting memories, cognition of brief visual stimuli, 71-94. Cambridge: MIT Press.
98. Woodruff, Guy, & David Premack,. 1979. Intentional communication in the chimpanzee: The development of deception. Cognition 7. 333-62.
99. Zlatev, Jordan,. 2009. The semiotic hierarchy: Life, consciousness, signs and language. Cognitive Semiotics 4. 169-200.
100. Zlatev, Jordan, Viktor Smith, Joost van de Weijer, & Kristina Skydsgaard,. 2010. Noun-noun compounds for fictive food products: Experimenting in the borderzone of semantics and pragmatics. Journal of Pragmatics 42 (10). 2799-813.