Linguistic synaesthesia, perceptual synaesthesia, and the interaction between multiple sensory modalities

Pragmatics and Cognition

Volumn 20, Issue 1, 2012, Pages 135-167

  Ronga, Irene ^a,b   Bazzanella, Carla ^b   Rossi, Ferdinando ^b   Iannetti, Giandomenico ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF TURIN   (Italy)

Author keywords

Corpus linguistics; Perception; Sensory domains; Synaesthesia; Universality; Williams' hierarchy

Indexed keywords

EID: 84862100569     PISSN: 09290907     EISSN: 15699943     Source Type: Journal    
DOI: 10.1075/pc.20.1.06ron     Document Type: Article

References (121)

1. Akman, V. and Bazzanella, C. (eds). 2003. Special issue, "On Context". Journal of Pragmatics 35(3): 321-504.
2. Arieh, Y. and Marks L.E. 2008. "Cross-modal interaction between vision and hearing: A speedaccuracy analysis". Perception & Psychophysics 70: 412-421.
3. Albertazzi, L. 2009. "Tropi di luce e colore". In C. Bazzanella (ed), Special issue, La forza cognitiva della metafora. Paradigmi XXVII(1): 119-136.
4. Asher, J.E., Lamb, J.A., Brocklebank, D., Cazier, J.B., Maestrini, E., Addis, L., Sen, M., Baron- Cohen, S., and Monaco, A.P. 2009. [PLEASE CORRECT] "A whole-genome scan and fine-mapping linkage study of auditory-visual synesthesia reveals evidence of linkage to chromosomes 2q24, 5q33, 6p12, and 12p12". The American Journal of Human Genetics 84: 279-285.
5. Banati, R.B, Goerresb, G.W., Tjoaa, C., Aggletonc, J.P., and Grasbya, P. 2000. "The functional anatomy of visual-tactile integration in man: a study using positron emission tomography". Neuropsychologia 38: 115-124.
6. Barsalou, L.W. 2003. "Abstraction in perceptual symbol systems". Philosophical Transaction of the Royal Society of London 358: 1177-1187. (Pubitemid 36901171)
7. Barsalou, L.W. 2008. "Grounding cognition". Annual Review of Psychology 59:617-645.
8. Bazzanella, C. 2001. "Metaphor and context: some issues". In H. Kronning et al. (eds), Langage et reference. Upsala: Acta Universitatis Upsaliensis, 39-49.
9. Bazzanella, C. (ed) 2009. Special Issue, "La forza cognitiva della metafora". Paradigmi XXVII(1).
10. Bazzanella C. Forthcoming. "Using corpora in pragmatic research: data and theory". In Pusch, C.D. (ed), Corpora and Pragmatics. Tubingen: Narr.
11. Beauchamp, M.S., Lee, K.E., Argall, B.D., and Martin, A. 2004. "Integration of auditory and visual information about objects in superior temporal sulcus". Neuron 41: 809-823. (Pubitemid 38326842)
12. Beeli, G., Esslen, M., and Jancke L. 2007. "Frequency correlates in grapheme-color synaesthesia". Psychological Science 18: 788-792.
13. Berlin, B. and Kay, P. 1969. Basic Color Terms: Their Universality and Evolution. Berkeley, CA: University of California Press.
14. Biber, D., Conrad, S., and Reppen R. 1998. Corpus Linguistics. Cambridge: Cambridge University Press.
15. Bizley, J.K., Nodal, F.R., Bajo, V.M., Nelken, I., and King, A.J. 2007. "Physiological and anatomical evidence for multisensory interactions in auditory cortex". Cerebral Cortex 17: 2172-2189. (Pubitemid 47283692)
16. Brang, D. and Ramachandran, V.S. 2011. "Survival of the synesthesia gene: Why do people hear colors and taste words?". PloS Biology 9, doi: 10.1371/journal.pbio.1001205.
17. Bresciani, J.P., Ernst, M.O., Drewing, K., Bouyer, G., Maury, V., and Kheddar, A. 2005. "Feeling what you hear: auditory signals can modulate tactile tap perception". Experimental Brain Research 162: 172-180. (Pubitemid 40543828)
18. Burr, D., Banks, M.S., and Morrone, M.C. 2009. "Auditory dominance over vision in the perception of interval duration". Experimental Brain Research 198(1): 49-57.
19. Bybee, J. and Hopper, P. (eds). 2001. Frequency and the Emergence of Linguistic Structure. Amsterdam: Benjamins.
20. Cacciari, C. 1999. "La metafora fra linguaggio ed esperienza percettiva". Special issue on "Prospettive sulla metafora". Lingua e stile XXXIV(2): 159-166.
21. Caclin, A., Soto-Faraco, S., Kingstone, A., and Spence, C. 2002. "Tactile 'capture' of audition". Perception & Psychophysics 64(4): 616-630.
22. Calvert, G., Spence, C., and Stein, B.E. (eds) 2004. The Handbook of Multisensory Processes, Cambridge, MA: The MIT Press
23. van Campen, C. 2008. The Hidden Sense: Synesthesia in Art and Science. Cambridge, MA: The MIT Press.
24. Cappe, C. and Barone, P. 2005. "Heteromodal connections supporting multisensory integration at low level of cortical processing in the monkey". European Journal of Neuroscience 22: 2886-2902. (Pubitemid 41818860)
25. Clark, J.A., Brown, C.A., Jones, A.K., and El-Deredy, W. 2008. "Dissociating nociceptive modulation by the duration of pain anticipation from unpredictability in the timing of pain". Clinical Neurophysiology 119: 2870-2878.
26. Cohen Kadosh, R. and Henik, A. 2007. "Can synaesthesia research inform cognitive science?". Trends in Cognitive Sciences 11: 177-184. (Pubitemid 46467490)
27. Cohen Kadosh, R., Henik, A., and Walsh, V. 2009. "Synaesthesia: learned or lost?". Developmental Science 12(3): 484-491.
28. Cohen Kadosh, R., Gertner, L., and Terhune, D.B. 2011. "Exceptional abilities in the spatial representation of number and time: Insights from synaesthesia". The Neuroscientist doi: 10.1177/1073858411402835.
29. Cole, J. and Dascal, M. (eds) 2010. Special issue on "The Emergence of Consciousness: A topdown, social phenomenon?". Pragmatics & Cognition 18(3).
30. Cytowic, R.E. 2002 [1989]. Synesthesia: A Union of The Senses. Cambridge, MA: The MIT Press.
31. Cytowic, R.E. and Eagleman, D.M. 2009. Wednesday is Indigo Blue: Discovering the Brain of Synesthesia. Cambridge, MA: The MIT Press.
32. Day, S. 1996. "Synaesthesia and synaesthetic metaphors". Psyche 2(32), http://home.comcast.net/-sean.day/html/bibliography.html.
33. Dirven, R., 1985. "Metaphor as a means for extending the lexicon". In W. Paprotte and R. Dirven (eds), The Ubiquity of Metaphor: Metaphor in Language and Thought. Amsterdam: Benjamins, 85-120.
34. Dixon, M.J., Smilek, D., Wagar, B., and Merikle, P.M. 2004. "Grapheme-color synaesthesia: When 7 is yellow and D is blue". In G. Calvert, C. Spence, and B.E. Stein (eds), The Handbook of Multisensory Processes. Cambridge, MA: The MIT Press, 837-850.
35. Driver, J. and Noesselt, T. 2008. "Multisensory interplay reveals crossmodal influences on 'sensory- specific' brain regions, neural responses, and judgements". Neuron 57: 11-23.
36. Dryer, M.S. 2005. "Order of adjective and noun". In M. Haspelmath, M.S Dryer, D. Gil, and B. Comrie (eds), The World Atlas of Language Structures. Oxford: Oxford University Press, map 87, 354-355.
37. Evans, V., Bergen, B.K., and Zinken, J. (eds). 2007. The Cognitive Linguistic Reader. London: Equinox.
38. Falchier, A., Clavagnier, S., Barone, P., and Kennedy, H. 2002. "Anatomical evidence of multimodal integration in primate striate cortex". Journal of Neuroscience 22: 5749-5759. (Pubitemid 35386498)
39. Formigari, L. 2009. "Modelli del pensare metaforico". Special issue on "La forza cognitiva della metafora". Paradigmi XXVII(1): 15-25.
40. Frassinetti, F., Bolognini, N., and Ladavas, E. 2002. "Enhancement of visual perception by crossmodal visuo-auditory interaction". Experimental Brain Research 147: 332-343. (Pubitemid 35341007)
41. Ghazanfar, A.A. and Schroeder, C.E. 2006. "Is neocortex essentially multisensory?". Trends in Cognitive Sciences 10(6): 278-285. (Pubitemid 43870163)
42. Galton, F. 1880. "Visualised numerals". Nature 22: 494-495.
43. Gentner, D., Bowdle, B., Wolff, P., and Boronat, C. 2001. "Metaphor is like analogy". In D. Gentner, K.J. Holyoak, and B.N. Kokinov (eds), The Analogical Mind. Cambridge, MA: The MIT Press, 199-254.
44. Gibbs, R.W. 2005. Embodiment and Cognitive Science. New York: Cambridge University Press.
45. Gillmeister, H. and Eimer, M. 2007. "Tactile enhancement of auditory detection and perceived loudness". Brain Research 1160: 58-68. (Pubitemid 47058033)
46. Goethe, J.W. 1810 [1840]. Theory of Colours. London: John Murray.
47. Guest, S. and Spence, C. 2002. "What role does multisensory integration play in the visuotactile perception of texture?". International Journal of Psychophysiology 50: 63-80.
48. Hancock, P.J.B. 2006. "Monozygotic twins' colour-number association, a case study". Cortex 42(2): 147-150.
49. Hampe, B. (ed). 2005, in cooperation with Grady, J.E. From Perception to Meaning: Image Schemas in Cognitive Linguistics. Berlin: Mouton De Gruyter.
50. Heller, E. 2004. Psicologia del color. Barcelona: Editorial Gustavo Gili.
51. Holz, P. 2007. "Cognition, olfaction and linguistic creativity". In M. Plumacher and P. Holz (eds), Speaking of Colors and Odors. Amsterdam: John Benjamins, 185-202.
52. Hopper, P. 1987. Emergent Grammar. Berkeley Linguistics Conference (BLS) 13: 139-157.
53. Hubbard, E.M. and Ramachandran, V.S. 2005. "Neurocognitive mechanisms of synaesthesia". Neuron 48: 509-520.
54. Hubbard, E.M. 2007. "Neurophysiology of synesthesia". Current Psychiatry Report 9: 193-199. (Pubitemid 46895096)
55. Iannetti G.D., Hughes, N.P., Lee, M.C., and Mouraux, A. 2008. "Determinants of laser-evoked EEG responses: Pain perception or stimulus saliency?". Journal of Neurophysiology 100: 815-828.
56. Iannetti, G.D. and Mouraux, A. 2010. "From the neuromatrix to the pain matrix (and back)". Experimental Brain Research 205: 1-12.
57. Iannetti, G.D., Lee, M.C., and Mouraux, A. 2010. "A multisensory investigation of the functional significance of the 'pain matrix' ". 13th World Congress on Pain, Montreal, Canada.
58. Iannetti, G.D. and Mouraux, A. 2011. "Can the functional MRI responses to physical pain really tell us why social rejection 'hurts'?". Proceedings of the National Academy of Sciences 108: E343. This publication is an electronic (E) commentary on PNAS.
59. Jaekl, P.M. and Harris, L.R. 2007. "Auditory-visual temporal integration measured by shifts in perceived temporal location". Neuroscience Letters 417: 219-224. (Pubitemid 46589776)
60. Johnson, M. 1987. The Body in the Mind. Chicago: Longman.
61. Jones, E.G. 1998. "Viewpoint: The core and matrix of thalamic organization". Neuroscience 85: 331-345. (Pubitemid 28218656)
62. Kandel, E.R., Schwartz, J.H., and Jessel, T.M. 2000. Principles of Neural Science, 4th ed. New York: McGraw-Hill.
63. Kelso, J.A.S. 1997. Dynamic Patterns: The Self Organization of Brain and Behavior. Cambridge, MA: The MIT Press.
64. Kousta, S.T., Vigliocco, G., Vinson, D.P., Andrews, M., and Del Campo, E. 2010. "The representation of abstract words: Why emotion matters". Journal of Experiment Psychology: General, on line first publication, 2010, Dec 20.
65. Lakoff, G. and Johnson, M. 1980. Metaphors We Live By. Chicago: The University of Chicago Press.
66. Lederman, S.J. and Klatzky, R.L. 2004: "Multisensory texture perception". In G. Calvert et al., 107-122.
67. Leezenberg, M. 2001. Contexts of Metaphor. Amsterdam: Elsevier.
68. Leo, F., Bertini, C., Pellegrino, G., and Ladavas, E. 2008. "Multisensory integration for orienting responses in humans requires the activation of the superior colliculus". Experimental Brain Research 186: 67-77.
69. Lovelace, C.T., Stein, B.E., and Wallace, M.T. 2003. "An irrelevant light enhances auditory detection in humans: a psychophysical analysis of multisensory integration in stimulus detection". Cognitive Brain Research 17: 447-453. (Pubitemid 36860069)
70. Ludwig, V., Adachi, I., and Masuzawa, T. 2011. "Visuoauditory mappings between high luminance and high pitch are shared by chimpanzees (Pan troglodytes) and humans". Proceedings of the National Academy of Science of the United States of America, doi: 10.1073/pnas.1112605108.
71. Marks, L.E. 2004. "Cross-Modal Interactions in Speeded Classification". In G. Calvert et al. (eds), 107-122.
72. Mattingley, J.B. 2009. "Attention, automaticity, and awareness in synesthesia". Annals of New York Academy of Science, The Year in Cognitive Neuroscience 2009, 1156: 141-167.
73. Maurer, D. and Mondloch, C. 2005. "Neonatal synesthesia: A re-evaluation". In C.L Robertson and N. Sagiv (eds), Synesthesia: Perspectives From Cognitive Neuroscience. Oxford: Oxford University Press, 193-213.
74. Mazzone, M. 2011. "Schemata and associative processes in pragmatics". Journal of Pragmatics 43: 2148-2159.
75. Mazzone, M. and Campisi, E., 2010. "Metafore ed embodiment: il linguaggio viene dopo?". Atti del XVI Congresso della Societa Italiana di Filosofia del Linguaggio. Cagliari: CUEC, 122-133.
76. Monopoli, D. and Cacciari, C. 2009. "Olfatto: un senso 'senza parole'?". Special issue on "La forza cognitiva della metafora". Paradigmi XXVII(1): 147-162.
77. Mouraux, A., Diukova, A., Lee, M.C., Wise, R.G., and Iannetti, G.D. 2011. "A multisensory investigation of the functional significance of the 'pain matrix' ". Neuroimage, avalaible on line from the 6th October 2010.
78. Muggleton, N., Tsakanikos, E., Walsh, V., and Ward, J. 2007. "Disruption of synaesthesia following TMS of the right posterior parietal cortex". Neuropsychologia 45: 1582-1585. (Pubitemid 46097014)
79. Nikolić, D. 2009. "Is synaesthesia actually ideaestesia? An inquiry into the nature of the phenomenon". Proceedings of the Third International Congress on Synaesthesia, Science & Art. Granada, Spain, April 26-29, 2009.
80. Novich, S., Cheng, S., Eagleman, D.M. 2011. "Is synaesthesia one condition or many? A largescale analysis reveals subgroups". Journal of Neuropsychology 5: 353-371.
81. Odgaard, E.C., Arieh, Y., and Marks, L. 2004a. "Brighter noise: Sensory enhancement of perceived loudness by concurrent visual stimulation". Cognitive, Affective, & Behavioral Neuroscience 4(2): 127-132. (Pubitemid 39167155)
82. Oruc, I., Sinnett, S., Bischof, W.F., Soto-Faraco, S., Lock, K., and Kingstone, A. 2008. "The effect of attention on the illusory capture of motion in bimodal stimuli". Brain Research 1242: 200-208.
83. Pastoureau, M. 2001. Blue: The History of a Color. Princeton, NJ: Princeton University Press.
84. Popova, Y. 2005. "Image schemas and verbal synaesthesia". In B. Hampe (ed), From Perception to Meaning: Image Schemas in Cognitive Linguistics. Berlin: Mouton De Gruyter, 395-419.
85. Ramachandran, V.S. and Hubbard, E.M. 2003. "The phenomenology of synaesthesia". Journal of Consciousness Studies 10(8): 49-57. (Pubitemid 37180561)
86. Ramachandran, V.S., Hubbard, E.M., and Butcher P.A. 2004. "Synethesia, cross-activation, and the foundations of neuroepistemology". In G. Calvert et al. (eds), 867-884.
87. Regier, T. and Kay, P. 2009. "Language, thought, and color: Whorf was half right". Trends in Cognitive Sciences 13(10): 439-446.
88. Richter, M., Eck, J., Straube, T., Miltner, W.H., and Weiss, T. 2010. "Do words hurt? Brain activation during the processing of pain-related words". Pain 148: 198-205.
89. Ronga, I. 2009. "L'eccezione dell'azzurro". Cuadernos de Filologia Italiana 16: 57-79.
90. Sagiv, N. and Ward, J. 2006. "Crossmodal interactions: lessons from synaesthesia". Progress in Brain Research 155: 259-271.
91. Sagiv, N., Heer, J., and Robertson, L. 2006. "Does binding of synaesthetic color to the evoking grapheme require attention?". Cortex 42: 232-242.
92. Schurmann, M., Caetano, G., Jousmaki, V., and Hari, R. 2004. "Hands help hearing: Facilitatory audiotactile interaction at low sound-intensity levels". Journal of Acustical Society of America 115(2): 830-832. (Pubitemid 38200669)
93. Shen, Y. and Cohen, M. 1998. "How come silence is sweet but sweetness is not silent: a cognitive account of directionality in poetic synaesthesia". Language and Literature 7: 123-140.
94. Shen, Y. and Gil, D. 2008. "Sweet fragrances from Indonesia: A universal principle governing directionality in synaesthetic metaphors". In W. van Peer and J. Auracher (eds), New Beginning or the Study of Literature. Cambridge: Cambridge Scholars Publishing, 49-72.
95. Shibuya, Y., Nozawa, H., and Kanamaru, T. 2007: "Understanding synaesthetic expressions". In M. Plumacher and P. Holz (eds), Speaking of Colors and Odors. Amsterdam: John Bejamins, 203-226.
96. Simner, J. 2006. "Beyond perception: synaesthesia as a psycholinguistic phenomenon". Trends in Cognitive Sciences 11: 23-29.
97. Simner, J. 2011. "Defining synaesthesia". British Journal of Psychology doi: 10.1348/000712610X528305.
98. Simner, J., Gartner, O., Taylor, M.D. 2011. "Cross-modal personality attributions in synaesthetes and non-synaesthetes". Journal of Neuropsychology 5: 283-301.
99. Simner, J., Harrold, J., Creed, H., Monro, L., Foulkes, L. 2009. "Early detection of markers for synaesthesia in childhood populations". Brain 132: 57-64.
100. Simner, J. and Ludwig, V.U. 2011. "The color of touch: A case of tactile-visual synaesthesia". Neurocase, doi: 10.1080/13554794.2011.568503.
101. Simner, J., Mulvenna, C, Sagiv, N., Tsakanikos, E., Whiterby, S.A., Fraser, C., Scott, K., and Ward, J. 2006. "Synaesthesia: The prevalence of atypical cross-modal experiences". Perception 35: 1024-1033. (Pubitemid 44619140)
102. Simner, J., Ward, J., Lanz, M., Jansari, A., Noonan, K., Glover, L., and Oakley, D.A. 2005. "Nonrandom associations of graphemes to colours in synaesthetic and non-synaesthetic population". Cognitive Neuorpsychology 22(8): 1069-1085. (Pubitemid 43123564)
103. Soto-Faraco, S., Lyons, J., Gazzaniga, M., Spence, C., and Kingstone, A. 2002. "The ventriloquist in motion: Illusory capture of dynamic information across sensory modalities". Cognitive Brain Research 14: 139-146. (Pubitemid 34626804)
104. Soto-Faraco, S., Spence, C., and Kingstone, A. 2004. "Congruency effects between auditory and tactile motion: Extending the phenomenon of cross-modal dynamic capture". Cognitive, Affective, & Behavioral Neuroscience 4(2): 208-217. (Pubitemid 39167163)
105. Soto-Faraco, S. and Deco, G. 2009. "Multisensory contributions to the perception of vibrotactile events". Behavioural Brain Research 196: 145-154.
106. Spector, F. and Maurer, D. 2008. "The colour of Os: Naturally biased associations between shape and colour". Perception 37: 841-847.
107. Spector, F. and Maurer, D. 2009. "Synaesthesia: a new approach to understanding the development of perception". Developmental Psychology 45: 175-189.
108. Stein, B.E. and Stanford, T.R. 2008. "Multisensory integration: current issues from the perspective of the single neuron". Nature Neuroscience 9: 255-266. (Pubitemid 351430829)
109. Stern, J. 2000. Metaphor in Context. Cambridge, MA: The MIT Press.
110. Taylor, J. R. 1995. Linguistic Categorization. Oxford: Clarendon Press.
111. Tracey, I. 2005. "Nociceptive processing in the human brain". Current Opinion in Neurobiology 15(4): 478-487. (Pubitemid 41074770)
112. Ullmann, S. 1957. The Principles of Semantics. Oxford: Blackwell.
113. Valentini, E., Torta, D.M., Mouraux, A., and Iannetti, G.D. 2011. "Dishabituation of laser evoked EEG responses: dissecting the effect of certain and uncertain changes in stimulus modality". Journal of Cognitive Neuroscience 23(10): 2822-2837.
114. Vogt, B.A. 2005. "Pain and emotion interactions in subregions of the cingulate gyrus". Nature Reviews Neuroscience 6(7): 533-544. (Pubitemid 40942820)
115. Wang, A., Mouraux, A., Liang, M., and Iannetti, G.D. 2010. "Stimulus novelty and not neural refractoriness explains the repetition suppression of laser-evoked potentials (LEPs)". Journal of Neurophysiology 104: 2116-2124.
116. Ward, J. and Simner, J. 2005. "Is synaesthesia an X-linked dominant trait with lethality in males?". Perception 34: 611-623. (Pubitemid 40882418)
117. Ward, J., Huckstep, B., and Tsakanikos, E. 2006. "Sound-colour synaesthesia: To what extent does it use cross-modal mechanisms common to us all?". Cognition 42: 264-280.
118. Weiss, P.H. and Fink, G.R. 2009. "Grapheme-colour synaesthetes show increased grey matter volumes of parietal and fusiform cortex". Brain 132(1): 65-70.
119. Williams, J.M. 1976. "Synaesthetic adjectives: A possible law of semantic change". Language 52: 461-478.
120. Wise, H. 1997. The Vocabulary of Modern French. London: Routledge.
121. Yu, N. 2003. "Synaesthetic metaphor: A cognitive perspective". Journal of Literary Semantics 32: 19-34.