Seeing sounds and hearing colors: An event-related potential study of auditory-visual synesthesia

Journal of Cognitive Neuroscience

Volumn 21, Issue 10, 2009, Pages 1869-1881

  Goller, Aviva I ^a   Otten, Leun J ^b   Ward, Jamie ^a  

^a UNIVERSITY OF SUSSEX   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AGED; ARTICLE; CLINICAL ARTICLE; COLOR; CONTROLLED STUDY; EVENT RELATED POTENTIAL; FEMALE; HEARING; HUMAN; HUMAN EXPERIMENT; ILLUSION; NORMAL HUMAN; PRIORITY JOURNAL; SENSATION; SOUND; SYNESTHESIA; VISION;

ACOUSTIC STIMULATION; ADULT; AGED; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; BRAIN MAPPING; COLOR PERCEPTION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; EVOKED POTENTIALS, AUDITORY; EVOKED POTENTIALS, VISUAL; FEMALE; HEARING; HUMANS; MALE; MIDDLE AGED; PHOTIC STIMULATION; REACTION TIME; TIME FACTORS; YOUNG ADULT;

EID: 67650768394     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn.2009.21134     Document Type: Article

References (52)

1. Banissy, M., Walsh, V., & Ward, J. (2008). "Mirror-touch" synaesthesia is associated with enhanced tactile discrimination. Journal of Cognitive Neuroscience Annual Meeting Program (Supplement). Abstract presented at 15th annual meeting of Cognitive Neuroscience Society, p. 52.
2. Baron-Cohen, S. (1996). Is there a normal phase of synaesthesia in development? Psyche, 2.
3. Baron-Cohen, S., Burt, L., Smith-Laittan, F., Harrison, J., & Bolton, P. (1996). Synaesthesia: Prevalence and familiality. Perception, 25, 1073-1079.
4. Baron-Cohen, S., Harrison, J., Goldstein, L. H., & Wyke, M. (1993). Colored speech perception: Is synaesthesia what happens when modularity breaks down? Perception, 22, 419-426.
5. Beeli, G., Esslen, M., & Jancke, L. (2008). Time course of neural activity correlated with colored-hearing synesthesia. Cerebral Cortex, 18, 375-381. (Pubitemid 351197796)
6. Brosch, M., Selezneva, E., & Scheich, H. (2005). Nonauditory events of a behavioral procedure activate auditory cortex of highly trained monkeys. Journal of Neuroscience, 25, 6797-6806. (Pubitemid 41023147)
7. Calvert, G. A. (2001). Crossmodal processing in the human brain: Insights from functional neuroimaging studies. Cerebral Cortex, 11, 1110-1123. (Pubitemid 33108238)
8. Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C. R., McGuire, P. K., et al. (1997). Activation of auditory cortex during silent lipreading. Science, 276, 593-596. (Pubitemid 27193683)
9. Calvert, G. A., Hansen, P. C., Iversen, S. D., & Brammer, M. J. (2001). Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. Neuroimage, 14, 427-438.
10. Cohen Kadosh, R., Cohen Kadosh, K., & Henik, A. (2007). The neuronal correlates of bi-directional synaesthesia: A combined ERP and fMRI study. Journal of Cognitive Neuroscience, 19, 2050-2059.
11. Cohen Kadosh, R., & Henik, A. (2006). When a line is a number: Color yields magnitude information in a digit-color synaesthete. Neuroscience, 137, 3-5. (Pubitemid 43031468)
12. Cohen Kadosh, R., Sagiv, N., Linden, D. E. J., Robertson, L. C., Elinger, G., & Henik, A. (2005). Do colors influence numerical cognition in synaesthesia? Journal of Cognitive Neuroscience, 17, 1766-1773.
13. Cohen Kadosh, R., & Walsh, V. (2006). Rewired or cross-wired brains? Current Biology, 16, R962-R963.
14. Colby, C. L., & Goldberg, M. E. (1999). Space and attention in parietal cortex. Annual Review of Neuroscience, 22, 319-349.
15. Crawford, J. R., & Howell, D. C. (1998). Comparing an individual's test score against norms derived from small samples. Clinical Neuropsychologist, 11, 482-486.
16. Day, S. (2005). Some demographic and socio-cultural aspects of synesthesia. In L. C. Robertson & N. Sagiv (Eds.), Synesthesia: Perspectives from cognitive neuroscience. Oxford: Oxford University Press.
17. Dixon, M. J., Smilek, D., & Merikle, P. M. (2004). Not all synaesthetes are created equal: Projector vs. associator synaesthetes. Cognitive, Affective, and Behavioral Neuroscience, 4, 335-343.
18. Driver, J., & Spence, C. (2000). Multisensory perception: Beyond modularity and convergence. Current Biology, 10, R731-R735. (Pubitemid 30811464)
19. Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002). Anatomical evidence of multimodal integration in primate striate cortex. Journal of Neuroscience, 22, 5749-5759. (Pubitemid 35386498)
20. Frith, C. D., & Paulesu, E. (1997). The physiological basis of synaesthesia. In S. Baron-Cohen & J. E. Harrison (Eds.), Synaesthesia: Classic and contemporary readings. Oxford: Blackwell.
21. Giraud, A. L., Price, C. J., Graham, J. M., Truy, E., & Frackowiak, R. S. J. (2001). Cross-modal plasticity underpins language recovery after cochlear implantation. Neuron, 30, 657-663. (Pubitemid 32607331)
22. Hubbard, E. M., & Ramachandran, V. S. (2005). Neurocognitive mechanisms of synesthesia. Neuron, 48, 509-520.
23. Innocenti, G. M., Berbel, P., & Clarke, S. (1988). Development of projections from auditory to visual areas in the cat. Journal of Comparative Neurology, 272, 242-259. (Pubitemid 18149538)
24. Keselman, H. J., & Rogan, J. C. (1980). Repeated measures F tests and psychophysiological research: Controlling the number of false positives. Psychophysiology, 17, 499-503.
25. Lewkowicz, D., & Turkewitz, G. (1980). Cross-modal equivalence in infancy: Auditory-visual intensity matching. Developmental Psychology, 16, 597-607.
26. Luck, S. J. (2005). An introduction to the event-related potential technique. Cambridge, MA: MIT Press.
27. Marks, L. E. (2004). Cross-modal interactions in speeded classification. In G. Calvert, C. Spence, & B. E. Stein (Eds.), The handbook of multisensory processes. Cambridge, MA: MIT Press.
28. Mattingley, J. B., Payne, J., & Rich, A. N. (2006). Attentional load attenuates synaesthetic priming effects in grapheme-color synaesthesia. Cortex, 42, 213-221.
29. Maurer, D. (1997). Neonatal synaesthesia: Implications for the processing of speech and faces. In S. Baron-Cohen & J. E. Harrison (Eds.), Synaesthesia: Classic and contemporary readings. Oxford: Blackwell.
30. Maurer, D., & Maurer, C. (1988). The world of the newborn. New York: Basic Books.
31. Maurer, D., & Mondloch, C. J. (2006). The infant as synesthete? Attention and performance XXI (pp. 449-471).
32. McCarthy, G., & Wood, C. C. (1985). Scalp distributions of event-related potentials: An ambiguity associated with analysis of variance models. Electroencephalography and Clinical Neurophysiology, 62, 203-208. (Pubitemid 15036868)
33. Mills, C. B., Boteler, E. H., & Larcombe, G. K. (2003). "Seeing things in my head": A synesthete's images for music and notes. Perception, 32, 1359-1376.
34. Neville, H. J. (1995). Developmental specificity in neurocognitive development in humans. In M. Gazzaniga (Ed.), The cognitive neurosciences. Cambridge, MA: MIT Press.
35. Nunn, J. A., Gregory, L. J., Brammer, M., Williams, S. C. R., Parslow, D. M., Morgan, M. J., et al. (2002). Functional magnetic resonance imaging of synesthesia: Activation of V4/V8 by spoken words. Nature Neuroscience, 5, 371-375. (Pubitemid 34279818)
36. Paulesu, E., Harrison, J., Baron-Cohen, S., Watson, J. D. G., Goldstein, L., Heather, J., et al. (1995). The physiology of colored hearing: A PET activation study of color-word synaesthesia. Brain, 118, 661-676.
37. Picton, T. W. (1990). Auditory evoked potentials. In D. D. Daly & T. A. Pedley (Eds.), Current practice of clinical electroencephalography (2nd ed.). New York: Raven Press.
38. Rao, A. L., Nobre, A. C., Alexander, I., & Cowey, A. (2007). Auditory evoked visual awareness following sudden ocular blindness: An EEG and TMS investigation. Experimental Brain Research, 176, 288-298. (Pubitemid 44837104)
39. Rizzo, M., & Eslinger, P. J. (1989). Colored hearing synesthesia: An investigation of neural factors. Neurology, 39, 781-784. (Pubitemid 19150151)
40. Rockland, K. S., & Ojima, H. (2003). Multisensory convergence in calcarine visual areas in macaque monkey. International Journal of Psychophysiology, 50, 19-26.
41. Rugg, M. D., Mark, R. E., Gilchrist, J., & Roberts, R. C. (1997). ERP repetition effects in indirect and direct tasks: Effects of age and interitem lag. Psychophysiology, 34, 572-586. (Pubitemid 27427643)
42. Sagiv, N., Heer, J., & Robertson, L. (2006). Does binding of synesthetic color to the evoking grapheme require attention? Cortex, 42, 232-242.
43. Schiltz, K., Trocha, K., Wieringa, B. M., Emrich, H. M., Johannes, S., & Munte, T. F. (1999). Neurophysiological aspects of synesthetic experience. Journal of Neuropsychiatry and Clinical Neuroscience, 11, 58-65.
44. Shams, L., Kamitani, Y., & Shimojo, S. (2000). Illusions. What you see is what you hear. Nature, 408, 788.
45. Shams, L., Kamitani, Y., Thompson, S., & Shimojo, S. (2001). Sound alters visual evoked potentials in humans. NeuroReport, 12, 3849-3852. (Pubitemid 33105184)
46. Simner, J., Glover, L., & Mowat, A. (2006). Linguistic determinants of word colouring in grapheme-colour synaesthesia. Cortex, 42, 281-289.
47. Simner, J., Mulvenna, C., Sagiv, N., Tsakanikos, E., Witherby, S. A., Fraser, C., et al. (2006). Synaesthesia: The prevalence of atypical cross-modal experiences. Perception, 35, 1024-1033. (Pubitemid 44619140)
48. Thornley Head, P. D. (2006). Synaesthesia: Pitch-color isomorphism in RGB-space? Cortex, 42, 164-174.
49. Ward, J., Huckstep, B., & Tsakanikos, E. (2006). Sound-color synaesthesia: To what extent does it use cross-modal mechanisms common to us all? Cortex, 42, 264-280.
50. Ward, J., Salih, S., Li, R., & Sagiv, N. (2007). Varieties of grapheme-color synaesthesia: A new theory of phenomenological and behavioural differences. Consciousness and Cognition. (Pubitemid 350101256)
51. Watkins, S., Shams, L., Tanaka, S., Haynes, J. D., & Rees, G. (2006). Sound alters activity in human V1 in association with illusory visual perception. Neuroimage, 31, 1247-1256. (Pubitemid 43870257)
52. Yaro, C., & Ward, J. (2007). Searching for Shereshevskii: What is superior about the memory of synaesthetes? Quarterly Journal of Experimental Psychology, 60, 682-696.