Chapter 15 Crossmodal interactions: lessons from synesthesia

Progress in Brain Research

Volumn 155 B, Issue , 2006, Pages 259-271

  Sagiv, Noam ^a   Ward, Jamie ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

anomalous experience; crossmodal perception; multisensory integration; number forms; synaesthesia; synesthesia

Indexed keywords

BEHAVIOR; BRAIN CORTEX; BRAIN FUNCTION; COLOR; COLOR VISION; DEPTH PERCEPTION; EVOKED VISUAL RESPONSE; HEARING; HUMAN; NEUROIMAGING; PERCEPTION; PRIORITY JOURNAL; REVIEW; TOUCH; VISION; ANIMAL; ATTENTION; BRAIN; CLASSIFICATION; PATHOLOGY; PATHOPHYSIOLOGY; PERCEPTION DISORDER; PHYSIOLOGY; PSYCHOPHYSICS; REINFORCEMENT; TIME;

ANIMALS; ATTENTION; BRAIN; HUMANS; KNOWLEDGE OF RESULTS (PSYCHOLOGY); PERCEPTION; PERCEPTUAL DISORDERS; PSYCHOPHYSICS; TIME FACTORS;

EID: 33749266864     PISSN: 00796123     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0079-6123(06)55015-0     Document Type: Review

References (95)

1. Aleman A., Rutten G.J., Sitskoorn M.M., Dautzenberg G., and Ramsey N.F. Activation of striate cortex in the absence of visual stimulation: an fMRI study of synesthesia. Neuroreport 12 (2001) 2827-2830
2. Armel K.C., and Ramachandran V.S. Acquired synesthesia in retinitis pigmentosa. Neurocase 5 (1999) 293-296
3. Baron-Cohen, S. (1996) Is there a normal phase of synaesthesia in development? Psyche, 2. See http://psyche.cs.monash.edu.au/ [This is an online-ONLY journal; no page numbers are available].
4. Baron-Cohen S., Burt L., Smith-Laittan F., Harrison J., and Bolton P. Synaesthesia: prevalence and familiality. Perception 25 (1996) 1073-1079
5. Baron-Cohen S., Harrison J., Goldstein L.H., and Wyke M. Coloured speech perception: is synaesthesia what happens when modularity breaks down?. Perception 22 (1993) 419-426
6. Bentin S., Mouchetant-Rostaing Y., Giard M.H., Echallier J.F., and Pernier J. ERP manifestations of processing printed words at different psycholinguistic levels: time course and scalp distribution. J. Cogn. Neurosci. 11 (1999) 235-260
7. Blake R., Palmeri T., Marois R., and Kim C.-Y. On the perceptual reality of synesthesia. In: Robertson L.C., and Sagiv N. (Eds). Synesthesia: Perspectives from Cognitive Neuroscience (2004), Oxford University Press, New York 47-73
8. Blakemore S.-J., Bristow D., Bird G., Frith C., and Ward J. Somatosensory activations during the observation of touch and a case of vision-touch synesthesia. Brain 128 (2005) 1571-1583
9. Calkins M.W. Synaesthesia. Am. J. Psychol. 7 (1895) 90-107
10. Calvert G.A., Bullmore E.T., Brammer M.J., Campbell R., Williams S.C.R., McGuire P.K., Woodruff P.W.R., Iverson S.D., and David A.S. Activation of auditory cortex during silent lipreading. Science 276 (1997) 593-596
11. Cohen-Kadosh R., Sagiv N., Linden D.E.J., Robertson L.C., Elinger G., and Henik A. When blue is larger than red: Colors influence numerical cognition in synesthesia. J. Cogn. Neurosci. 17 (2005) 1766-1773
12. Cytowic R. Synaesthesia: phenomenology and neuropsychology?. In: Baron-Cohen S., and Harrison J.E. (Eds). Synaesthesia: Classic and Contemporary Readings (1997), Blackwell, Oxford 17-39
13. Cytowic R.E. Synaesthesia: A Union of the Senses. 2nd Edition (2002), MIT Press, Cambridge
14. Day S. Some demographic and socio-cultural aspects of synesthesia. In: Robertson L.C., and Sagiv N. (Eds). Synesthesia: Perspectives from Cognitive Neuroscience (2004), Oxford University Press, New York 11-33
15. Dehaene S., Bossini S., and Giraux P. The mental representation of parity and numerical magnitude. J. Exp. Psychol. Gen. 122 (1993) 371-396
16. Dehay C., Kennedy H., and Bullier J. Characterization of transient cortical projections from auditory, somatosensory and motor cortices to visual areas 17, 18, and 19 in the kitten. J. Comp. Neurol. 272 (1987) 68-89
17. Dixon M.J., and Smilek D. The importance of individual differences in grapheme-color synesthesia. Neuron 45 (2005) 821-823
18. Dixon M.J., Smilek D., and Merikle P.M. Not all synaesthetes are created equal: projector vs. associator synaesthetes. Cogn. Affect. Behav. Neurosci. 4 (2004) 335-343
19. Duffy, P.L. (2001). Blue Cats and Chartreuse Kittens: How Synaesthetes Color Their World. Times Books, New York, pp. 84-85.
20. Edquist, J., Rich, A.N., Brinkman, C. and Mattingley, J.B. (2006) Do synaesthetic colors act as unique features in visual search? Cortex, 42: 222-231.
21. Esterman, M., Verstynen, T., Ivry, R. and Robertson, L.C. (2004) Attenuating the synesthetic experience with rTMS. Presented at the Fourth Annual American Synesthesia Association meeting, Berkeley, CA, November 5-7.
22. Falchier A., Clavagnier S., Barone P., and Kennedy H. Anatomical evidence of multimodal integration in primate striate cortex. J. Neurosci. 22 (2002) 5749-5759
23. Farrer C., and Frith C.D. Experiencing oneself vs another person as being the cause of an action: the neural correlates of the experience of agency. Neuroimage 15 (2002) 596-603
24. Fink G.R., Markowitsch H.J., Reinkemeier M., Bruckbauer T., Kessler J., and Heiss W.D. Cerebral representation of one's own past: neural networks involved in autobiographical memory. J. Neurosci. 16 (1996) 4275-4282
25. Fischer M.H., Castel A.D., Dodd M.D., and Pratt J. Perceiving numbers causes spatial shifts of attention. Nat. Neurosci. 6 (2003) 555-556
26. Friedman-Hill S.R., Robertson L.C., and Treisman A. Parietal contributions to visual feature binding: evidence from a patient with bilateral lesions. Science 269 (1995) 853-855
27. Galton F. Visualised numerals. Nature 21 (1880) 252-256
28. Galton F. Visualised numerals. J. Anthropol. Inst. 10 (1880) 85-102
29. Gevers W., Reynvoet B., and Fias W. The mental representation of ordinal sequences is spatially organized. Cognition 87 (2003) B87-B95
30. Ginsberg L. A case of synaesthesia. Am. J. Psychol. 34 (1923) 582-589
31. Giraud A.L., Price C.J., Graham J.M., Truy E., and Frackowiak R.S.J. Cross-modal plasticity underpins language recovery after cochlear implantation. Neuron 30 (2001) 657-663
32. Goldenberg G., Mullbacher W., and Nowak A. Imagery without perception: a case study of anosognosia for cortical blindness. Neuropsychologia 33 (1995) 1373-1382
33. Graziano M.S. Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position. Proc. Natl. Acad. Sci. USA 96 (1999) 10418-10421
34. Halligan P.W., Hunt M., Marshall J.C., and Wade D.T. When seeing is feeling: acquired synaesthesia or phantom touch?. Neurocase 2 (1996) 21-29
35. Hartman A.M., and Hollister L.E. Effect of mescaline, lysergic acid diethylamide and psilocybin on color perception. Psychopharmacolgia 4 (1963) 441-451
36. Hubbard T.L. Synesthesia-like mappings of lightness, pitch and melodic interval. Am. J. Psychol. 109 (1996) 219-238
37. Hubbard E.M., Arman A.C., Ramachandran V.S., and Boynton G.M. Individual differences among grapheme-color synaesthetes: brain-behavior correlations. Neuron 45 (2005) 975-985
38. Hubbard E.M., Piazza M., Pinel P., and Dehaene S. Interactions between number and space in the parietal lobe. Nat. Rev. Neurosci. 6 (2005) 435-448
39. Innocenti G.M., Berbel P., and Clarke S. Development of projections from auditory to visual areas in the cat. J. Comp. Neurol. 272 (1988) 242-259
40. Jacobs L., Karpik A., Bozian D., and Gothgen S. Auditory-visual synesthesia. Sound-induced photisms. Arch. Neurol. 38 (1981) 211-216
41. Kennedy H., Batardiere A., Dehay C., and Barone P. Synaesthesia: implications for developmental neurobiology. In: Baron-Cohen S., and Harrison J.E. (Eds). Synaesthesia: Classic and Contemporary Readings (1997), Blackwell, Oxford 243-256
42. Kennett S., Taylor-Clarke M., and Haggard P. Noninformative vision improves the spatial resolution of touch in humans. Curr. Biol. 11 (2001) 1188-1191
43. Keysers C., Wicker B., Gazzola V., Anton J.L., Fogassi L., and Gallese V. A touching sight: SII/PV activation during the observation and experience of touch. Neuron 42 (2004) 335-346
44. King A.J., and Calvert G.A. Multisensory integration: perceptual grouping by eye and ear. Curr. Biol. 11 (2001) R322-R325
45. Knoch D., Gianotti L.R., Mohr C., and Brugger P. Synesthesia: when colors count. Cogn. Brain Res. 25 (2005) 372-374
46. Laeng B., Svartdal F., and Oelmann H. Does color synesthesia pose a paradox for early selection theories of attention?. Psychol. Sci. 15 (2004) 277-281
47. Macaluso E., and Driver J. Multisensory spatial interactions: a window onto functional integration in the human brain. Trends Neurosci. 28 (2005) 264-271
48. Marks L.E. On associations of light and sound: the mediation of brightness, pitch, and loudness. Am. J. Psychol. 87 (1974) 173-188
49. Marks L.E. On coloured-hearing synaesthesia: cross-modal translations of sensory dimensions. Psychol. Bull. 82 (1975) 303-331
50. Marks L.E. On cross-modal similarity: auditory-visual interactions in speeded discrimination. J. Exp. Psychol. Hum. Percept. Perform. 13 (1987) 384-394
51. Martino G., and Marks L.E. Synesthesia: strong and weak. Curr. Dir. Psychol. Sci. 10 (2001) 61-65
52. Maurer D. Neonatal synaesthesia: implications for the processing of speech and faces. In: Baron-Cohen S., and Harrison J.E. (Eds). Synaesthesia: Classic and Contemporary Readings (1997), Blackwell, Oxford 224-242
53. Merabet L.B., Maguire D., Warde A., Alterescu K., Stickgold R., and Pascual-Leone A. Visual hallucinations during prolonged blindfolding in sighted subjects. J. Neuroopthalmol. 24 (2004) 109-113
54. Mills C.B., Howell Boteler E., and Oliver G.K. Digit synaesthesia: a case study using a stroop-type test. Cogn. Neuropsychol. 16 (1999) 181-191
55. Mon-Williams M., Wann J.P., Jenkinson M., and Rushton K. Synaesthesia in the normal limb. Proc. Biol. Sci. 264 (1997) 1007-1010
56. Myles K.M., Dixon M.J., Smilek D., and Merikle P.M. Seeing double: the role of meaning in alphanumeric-color synaesthesia. Brain Cogn. 53 (2003) 342-345
57. Neville H.J. Developmental specificity in neurocognitive development in humans. In: Gazzaniga M. (Ed). The Cognitive Neurosciences (1995), MIT Press, Cambridge
58. Nunn J.A., Gregory L.J., Brammer M., Williams S.C.R., Parslow D.M., Morgan M.J., Morris R.G., Bullmore E.T., Baron-Cohen S., and Gray J.A. Functional magnetic resonance imaging of synesthesia: activation of V4/V8 by spoken words. Nat. Neurosci. 5 (2002) 371-375
59. Palmeri T.J., Blake R., Marois R., Flanery M.A., and Whetsell Jr. W. The perceptual reality of synesthetic colors. Proc. Natl. Acad. Sci. U S A 99 (2002) 4127-4131
60. Paulesu E., Harrison J., Baron-Cohen S., Watson J.D.G., Goldstein L., Heather J., Frackowiak R.S.J., and Frith C.D. The physiology of coloured hearing: a PET activation study of color-word synaesthesia. Brain 118 (1995) 661-676
61. Ramachandran V.S., and Hubbard E.M. Psychophysical investigations into the neural basis of synaesthesia. Proc. Biol. Sci. 268 (2001) 979-983
62. Ramachandran V.S., and Hubbard E.M. Synaesthesia - a window into perception, thought and language. J. Conscious. Stud. 8 (2001) 3-34
63. Ramachandran V.S., and Rogers-Ramachandran D. Synaesthesia in phantom limbs induced with mirrors. Proc. Biol. Sci. 263 (1996) 377-386
64. Rich, A.N., Bradshaw, J.L. and Mattingley J.B. (2005). A systematic, large-scale study of synaesthesia: implications for the role of early experience in lexical-color associations. Cognition, 98: 53-84.
65. Robertson L.C. What can spatial deficits teach us about feature binding and spatial maps?. Vis. Cogn. 6 (1999) 409-430
66. Robertson L.C. Binding, spatial attention and perceptual awareness. Nat. Rev. Neurosci. 4 (2003) 93-102
67. Robertson L.C. Space, Objects, Minds and Brains (2004), Psychology Press, Hove
68. Sagiv N. Synesthesia in perspective. In: Robertson L.C., and Sagiv N. (Eds). Synesthesia: Perspectives from Cognitive Neuroscience (2004), Oxford University Press, New York 3-10
69. Sagiv, N. and Ben-Tal, O. (in preparation) Nocturnal synesthesia.
70. Sagiv, N., Heer, J. and Robertson, L.C. (2006a) Does binding of synesthetic color to the evoking grapheme require attention? Cortex, 42: 232-242.
71. Sagiv N., and Robertson L.C. Synesthesia and the binding problem. In: Robertson L.C., and Sagiv N. (Eds). Synesthesia: Perspectives from Cognitive Neuroscience (2004), Oxford University Press, New York 90-107
72. Sagiv, N., Simner, J., Collins, J., Butterworth, B. and Ward, J. (2006b) What is the relationship between synaesthesia and visuo-spatial Number Forms? Cognition, 101: 114-128.
73. Schiltz K., Trocha K., Wieringa B.M., Emrich H.M., Johannes S., and Munte T.F. Neurophysiological aspects of synesthetic experience. J. Neuropsych. Clin. Neurosci. 11 (1999) 58-65
74. Seron X., Pesenti M., Noel M.-P., Deloche G., and Cornet J.A. Images of numbers, or "when 98 is upper left and 6 sky blue". Cognition 44 (1992) 159-196
75. Shanon B. Color associates to semantic linear orders. Psychol. Res. 44 (1982) 75-83
76. Shanon, B., 2002. The Antipodes of the Mind: Charting the Phenomenology of the Ayahuasca Experience. Oxford University Press, Oxford, pp. 189-190, 337-338.
77. Shanon B. Three stories concerning synesthesia. A reply to Ramachandran and Hubbard. J. Consc. Stud. 10 (2003) 69-74
78. Simner, J., Mulvenna, C., Sagiv, N., Tsakanikos, E., Witherby, S.A., Fraser, C., Scott, K. and Ward, J. (in press) Synaesthesia: the prevalence of atypical cross-modal experiences. Perception.
79. Simner J., Ward J., Lanz M., Jansari A., Noonan K., Glover L., and Oakley D.A. Non-random associations of graphemes to colours in synaesthetic and non-synaesthetic populations. Cogn. Neuropsychol. 22 (2005) 1069-1085
80. Smilek D., Dixon M.J., Cudahy C., and Merikle P.M. Synaesthetic photisms influence visual perception. J. Cogn. Neurosci. 13 (2001) 930-936
81. Spence C. Multisensory attention and tactile information-processing. Behav. Brain Res. 135 (2002) 57-64
82. Sperling, J.M., Prvulovic, D., Linden, D.E.J., Singer, W. and Stirn, A. (2006) Neuronal correlates of graphemic color synaesthesia: a fMRI study. Cortex, 42: 295-303.
83. Steven M.S., and Blakemore C. Visual synesthesia in the blind. Perception 33 (2004) 855-868
84. Tarkiainen A., Helenius P., Hansen P.C., Cornelissen P.L., and Salmelin R. Dynamics of letter string perception in the human occipitotemporal cortex. Brain 122 (1999) 2119-2132
85. Treisman A., and Gelade G. A feature integration theory of attention. Cogn. Psychol. 12 (1980) 97-136
86. Treisman A., and Schmidt H. Illusory conjunctions in the perception of objects. Cogn. Psychol. 14 (1982) 107-141
87. Uhlich E. Synesthesia in the two sexes. Z. Exp. Angew. Psychol. 4 (1957) 31-57
88. Vike J., Jabbari B., and Maitland C.G. Auditory-visual synesthesia: report of a case with intact visual pathways. Arch. Neurol. 41 (1984) 680-681
89. Vuilleumier P., Ortigue S., and Brugger P. The number space and neglect. Cortex 40 (2004) 399-410
90. Walsh R. Can synesthesia be cultivated? Indications from surveys of meditators. J. Consc. Stud. 12 (2005) 5-17
91. Walsh V. A theory of magnitude: common cortical metrics of time, space and quantity. Trends Cogn. Sci. 7 (2003) 483-488
92. Ward J. Emotionally mediated synaesthesia. Cogn. Neuropsychol. 21 (2004) 761-772
93. Ward, J., Huckstep, B. and Tsakanikos, E. (2006) Sound-color synaesthesia: to what extent does it use cross-modal mechanisms common to us all? Cortex, 42: 264-280.
94. Ward J., and Simner J. Is synaesthesia an X-linked dominant trait with lethality in males?. Perception 34 (2005) 611-623
95. Wolfe J.M., and Cave K.R. The psychophysical evidence for a binding problem in human vision. Neuron 24 (1999) 11-17