Multisensory constraints on awareness

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 369, Issue 1641, 2014, Pages

  Deroy, Ophelia ^a   Chen, Yi Chuan ^b   Spence, Charles ^c  

^a UNIVERSITY OF LONDON   (United Kingdom)

^b MCMASTER UNIVERSITY   (Canada)

^c UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Binding; Crossmodal; Integration; Multisensory; Perceptual awareness; Unity of consciousness

Indexed keywords

BRAIN; COGNITION; INFORMATION PROCESSING; NEUROLOGY; PERCEPTION; SENSORY SYSTEM; THEORETICAL STUDY; VISION;

ATTENTIONAL BLINK; AWARENESS; BINDING; CONSCIOUSNESS; CROSSMODAL; DEPTH PERCEPTION; HUMAN; INTEGRATION; MULTISENSORY; PERCEPTION; PERCEPTUAL AWARENESS; PHYSIOLOGY; PSYCHOLOGICAL MODEL; REVIEW; UNITY OF CONSCIOUSNESS;

BINDING; CROSSMODAL; INTEGRATION; MULTISENSORY; PERCEPTUAL AWARENESS; UNITY OF CONSCIOUSNESS;

ATTENTIONAL BLINK; AWARENESS; CONSCIOUSNESS; HUMANS; MODELS, PSYCHOLOGICAL; PERCEPTION; PERCEPTUAL MASKING; VISION DISPARITY;

EID: 84909635663     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2013.0207     Document Type: Review

References (117)

1. Marcel AJ. 2003 Introspective report. J. Conscious. Stud. 10, 167-186.
2. Angelaki DE, Gu Y, DeAngelis GC. 2009 Multisensory integration: psychophysics, neurophysiology, and computation. Curr. Opin. Neurobiol. 19, 452-458. (doi: 10. 1016/j. conb. 2009. 06. 008).
3. Fujisaki W, Kitazawa S, Nishida S. 2012 Multisensory timing. In The new handbook of multisensory processes (ed. BE Stein), pp. 301-317. Cambridge, MA: MIT Press.
4. Fetsch CR, DeAngelis GC, Angelaki DE. 2013 Bridging the gap between theories of sensory cue integration and the physiology of multisensory neurons. Nat. Rev. Neurosci. 14, 429-442. (doi: 10. 1038/nrn3503).
5. Baars B. 1997 In the theater of consciousness: the workspace of the mind. Oxford, UK: Oxford University Press.
6. Singer W. 1998 Consciousness and the structure of neuronal representations. Phil. Trans. R. Soc. Lond. B 353, 1829-1840. (doi: 10. 1098/rstb. 1998. 0335).
7. VanRullen R, Koch C. 2003 Is perception discrete or continuous? Trends Cogn. Sci. 7, 201-213. (doi: 10. 1016/S1364-6613(03)00095-0).
8. Gallace A, Spence C. 2010 Touch and the body: the role of the somatosensory cortex in tactile awareness. Psyche 16, 30-67 (http://www. theassc. org/journal_psyche/archive/vol_16_no_1_2010).
9. Gallace A, Spence C. 2014 In touch with the future: the sense of touch from cognitive neuroscience to virtual reality. Oxford, UK: Oxford University Press.
10. Snyder JS, Gregg MK, Weintraub DM, Alain C. 2012 Attention, awareness, and the perception of auditory scenes. Front. Psychol. 3, 15. (doi: 10. 3389/fpsyg. 2012. 00015).
11. Stevenson RJ. 2009 Phenomenal and access consciousness in olfaction. Conscious. Cogn. 18, 1004-1017. (doi: 10. 1016/j. concog. 2009. 09. 005).
12. Meredith MA. 2012 Commentary: multisensory convergence: where it all begins. In The handbook of multisensory processing (ed. BE Stein), pp. 3-11. Cambridge, MA: MIT Press.
13. Stein BE et al. 2010 Semantic confusion regarding the development of multisensory integration: a practical solution. Eur. J. Neurosci. 31, 1713-1720. (doi: 10. 1111/j. 1460-9568. 2010. 07206. x).
14. Holmes NP, Spence C. 2005 Multisensory integration: space, time, and superadditivity. Curr. Biol. 15, R762-R764. (doi: 10. 1016/j. cub. 2005. 08. 058).
15. Ernst MO, Bülthoff HH. 2004 Merging the senses into a robust percept. Trends Cogn. Sci. 8, 162-169. (doi: 10. 1016/j. tics. 2004. 02. 002).
16. Wallace MT, Robertson GE, Hairston WD, Stein BE, Vaughan JW, Schirillo JA. 2004 Unifying multisensory signals across time and space. Exp. Brain Res. 158, 252-258. (doi: 10. 1007/s00221-004-1899-9).
17. Bayne T. 2010 The unity of consciousness. Oxford, UK: Oxford University Press.
18. Spence C, Deroy O, Bremner A. 2013 Questioning the utility of the concept of amodality: towards a revised framework for understanding crossmodal relations. Multisens. Res. 26, 57. (doi: 10. 1163/22134808-000S0036).
19. Parise CV, Spence C, Ernst M. 2012 When correlation implies causation in multisensory integration. Curr. Biol. 22, 46-49. (doi: 10. 1016/j. cub. 2011. 11. 039).
20. Treisman A. 2003 Consciousness and perceptual binding. In The unity of consciousness: binding, integration, and dissociation (ed. A Cleeremans), pp. 95-113. Oxford, UK: Oxford University Press.
21. Crick F, Koch C. 1990 Towards a neurobiological theory of consciousness. Sem. Neurosci. 2, 263-275.
22. Engel AK, Singer W. 2001 Temporal binding and the neural correlates of sensory awareness. Trends Cogn. Sci. 5, 16-25. (doi: 10. 1016/S1364-6613(00)01568-0).
23. Treisman A. 1986 Features and objects in visual processing. Sci. Am. 255, 114-125. (doi: 10. 1038/scientificamerican1186-114B).
24. Treisman A. 1988 Features and objects: the fourteenth Bartlett memorial lecture. Q. J. Exp. Psychol. 40A, 201-237. (doi: 10. 1080/02724988843000104).
25. Treisman A. 1996 The binding problem. Curr. Opin. Neurobiol. 6, 171-178. (doi: 10. 1016/S0959-4388(96)80070-5).
26. Treisman A. 1998 Feature binding, attention and object perception. Phil. Trans. R. Soc. Lond. B 353, 1295-1306. (doi: 10. 1098/rstb. 1998. 0284).
27. van Leeuwen C. 2007 Synchrony, binding, and consciousness: how are they related? Theory Psychol. 17, 779-790. (doi: 10. 1177/0959354307083493).
28. Owen AM, Coleman MR, Davis MH, Boly M, Laureys S, Pickard JD. 2006 Detecting awareness in the vegetative state. Science 313, 1402. (doi: 10. 1126/science. 1130197).
29. Celesia GG. 2013 Conscious awareness in patients in vegetative states: myth or reality? Curr. Neurol. Neurosci. Rep. 13, 1-9. (doi: 10. 1007/s11910-013-0395-7).
30. Hupé JM, Joffoa LM, Pressnitzer D. 2008 Bistability for audiovisual stimuli: perceptual decision is modality specific. J. Vis. 8, 1-15. (doi: 10. 1167/8. 7. 1).
31. Schwartz JL, Grimault N, Hupé JM, Moore BC, Pressnitzer D. 2012 Multistability in perception: binding sensory modalities, an overview. Phil. Trans. R. Soc. B 367, 896-905. (doi: 10. 1098/rstb. 2011. 0254).
32. Spence C. In press. Cross-modal perceptual organization. In The Oxford handbook of perceptual organization (ed. J Wagemans). Oxford, UK: Oxford University Press.
33. Sato M, Basirat A, Schwartz J. 2007 Visual contribution to the multistable perception of speech. Percept. Psychophys. 69, 1360-1372. (doi: 10. 3758/BF03192952).
34. Warren RM, Gregory RL. 1958 An auditory analogue of the visual reversible figure. Am. J. Psychol. 71, 612-613. (doi: 10. 2307/1420267).
35. Kubovy M, Yu M. 2012 Multistability, cross-modal binding and the additivity of conjoint grouping principles. Phil. Trans. R. Soc. B 367, 954-964. (doi: 10. 1098/rstb. 2011. 0365).
36. Crick F. 1996 Visual perception: rivalry and consciousness. Nature 379, 485-486. (doi: 10. 1038/379485a0).
37. Alais D, Blake R (eds). 2005 Binocular rivalry. Cambridge, MA: MIT Press.
38. Helmholtz HV. 1962 Helmholtz's treatise on physiological optics (ed. JPC Southall). New York, NY: Dover Publications. (Original work published 1866).
39. Levelt WJM. 1965 On binocular rivalry. Assen, The Netherlands: Royal VanGorcum.
40. Leopold DA, Logothetis NK. 1996 Activity changes in early visual cortex reflect monkeys' percepts during binocular rivalry. Nature 379, 549-553. (doi: 10. 1038/379549a0).
41. Tong F, Meng M, Blake R. 2006 Neural bases of binocular rivalry. Trends Cogn. Sci. 10, 502-511. (doi: 10. 1016/j. tics. 2006. 09. 003).
42. Blake R, Logothetis NK. 2002 Visual competition. Nat. Rev. Neurosci. 3, 1-11. (doi: 10. 1038/nrn701).
43. Alais D, Blake R. 1999 Grouping visual features during binocular rivalry. Vis. Res. 39, 4341-4353. (doi: 10. 1016/S0042-6989(99)00146-7).
44. Chong SC, Tadin D, Blake R. 2005 Endogenous attention prolongs dominance durations in binocular rivalry. J. Vis. 5, 1004-1012. (doi: 10. 1167/5. 11. 6).
45. Meng M, Tong F. 2004 Can attention selectively bias bistable perception? Differences between binocular rivalry and ambiguous figures. J. Vis. 4, 539-551. (doi: 10. 1167/4. 7. 2).
46. van Ee R, van Dam LCJ, Brouwer GJ. 2005 Voluntary control and the dynamics of perceptual bi-stability. Vis. Res. 45, 41-55. (doi: 10. 1016/j. visres. 2004. 07. 030).
47. van Ee R, van Boxtel JJA, Parker AL, Alais D. 2009 Multimodal congruency as a mechanism for willful control over perceptual awareness. J. Neurosci. 29, 11 641-11 649. (doi: 10. 1523/JNEUROSCI. 0873-09. 2009).
48. Conrad V, Bartels A, Kleiner M, Noppeney U. 2010 Audiovisual interactions in binocular rivalry. J. Vis. 10, 1-15. (doi: 10. 1167/10. 10. 27).
49. Conrad V, Kleiner M, Bartels A, Hartcher-O'Brien J, Bülthoff HH, Noppeney U. 2013 Naturalistic stimulus structure determines the integration of audiovisual looming signals in binocular rivalry. PLoS ONE 8, e70710. (doi: 10. 1371/journal. pone. 0070710).
50. Chen Y-C, Yeh S-L, Spence C. 2011 Crossmodal constraints on human visual awareness: can auditory semantic context modulate binocular rivalry? Front. Percept. Sci. 2, 212. (doi: 10. 3389/fpsyg. 2011. 00212).
51. Lunghi C, Binda P, Morrone MC. 2010 Touch disambiguates rivalrous perception at early stages of visual analysis. Curr. Biol. 20, R143-R144. (doi: 10. 1016/j. cub. 2009. 12. 015).
52. Lunghi C, Alais D. 2013 Touch interacts with vision during binocular rivalry with a tight orientation tuning. PLoS ONE 8, e58754. (doi: 10. 1371/journal. pone. 0058754).
53. Zhou W, Jiang Y, He S, Chen D. 2010 Olfaction modulates visual perception in binocular rivalry. Curr. Biol. 20, 1356-1358. (doi: 10. 1016/j. cub. 2010. 05. 059).
54. Zhou W, Zhang X, Chen J, Wang L, Chen D. 2012 Nostril-specific olfactory modulation of visual perception in binocular rivalry. J. Neurosci. 32, 17 225-17 229. (doi: 10. 1523/JNEUROSCI. 2649-12. 2012).
55. Chen J, Zhou W, Chen D. 2012 Binaural rivalry in the presence of visual perceptual and semantic influences. PLoS ONE 7, e47317. (doi: 10. 1371/journal. pone. 0047317).
56. Spence C, Deroy O. 2013 Crossmodal mental imagery. In Multisensory imagery: theory and applications (eds S Lacey, R Lawson), pp. 157-183. New York, NY: Springer.
57. Pearson J, Clifford CWG, Tong F. 2008 The functional impact of mental imagery on conscious perception. Curr. Biol. 18, 982-986. (doi: 10. 1016/j. cub. 2008. 05. 048).
58. Munhall KG, ten Hove MW, Brammer M, Paré M. 2009 Audiovisual integration of speech in a bistable illusion. Curr. Biol. 19, 735-739. (doi: 10. 1016/j. cub. 2009. 03. 019).
59. Boring EG. 1930 A new ambiguous figure. Am. J. Psychol. 42, 444-445. (doi: 10. 2307/1415447).
60. Hsiao JY, Chen YC, Spence C, Yeh SL. 2012 Assessing the effects of audiovisual semantic congruency on the perception of a bistable figure. Conscious. Cogn. 21, 775-787. (doi: 10. 1016/j. concog. 2012. 02. 001).
61. Blake R, Sobel KV, James TW. 2004 Neural synergy between kinetic vision and touch. Psychol. Sci. 15, 397-402. (doi: 10. 1111/j. 0956-7976. 2004. 00691. x).
62. Fang F, He S. 2005 Cortical responses to invisible objects in the human dorsal and ventral pathways. Nat. Neurosci. 8, 1380-1385. (doi: 10. 1038/nn1537).
63. Tsuchiya N, Koch C. 2005 Continuous flash suppression reduces negative afterimages. Nat. Neurosci. 8, 1096-1101. (doi: 10. 1038/nn1500).
64. Alsius A, Munhall K. 2013 Detection of audiovisual speech correspondences without visual awareness. Psychol. Sci. 24, 423-431. (doi: 10. 1177/0956797 612457378).
65. Palmer TD, Ramsey AK. 2012 The function of consciousness in multisensory integration. Cognition 125, 353-364. (doi: 10. 1016/j. cognition. 2012. 08. 003).
66. Yang YH, Yeh SL. 2011 Semantic congruency in audiovisual integration as revealed by the continuous flash suppression paradigm. i-Perception, 2, 840.
67. Raymond JE, Shapiro KL, Arnell KM. 1992 Temporary suppression of visual processing in an RSVP task: an attentional blink? J. Exp. Psychol. Hum. Percept. Psychophys. 18, 849-860. (doi: 10. 1037/0096-1523. 18. 3. 849).
68. Shapiro K, Driver J, Ward R, Sorensen RE. 1997 Priming from the attentional blink: a failure to extract visual tokens but not visual types. Psychol. Sci. 8, 95-100. (doi: 10. 1111/j. 1467-9280. 1997. tb00689. x).
69. Olivers CNL, van der Burg E. 2008 Bleeping you out of the blink: sound saves vision from oblivion. Brain Res. 1242, 191-199. (doi: 10. 1016/j. brainres. 2008. 01. 070).
70. Spence C, Ngo MK. 2012 Does attention or multisensory integration explain the crossmodal facilitation of masked visual target identification? In The new handbook of multisensory processing (ed. BE Stein), pp. 345-358. Cambridge, MA: MIT Press.
71. Van der Burg E, Brederoo SG, Nieuwenstein MR, Theeuwes J, Olivers CN. 2010 Audiovisual semantic interference and attention: evidence from the attentional blink paradigm. Acta Psychol. 134, 198-205. (doi: 10. 1016/j. actpsy. 2010. 01. 010).
72. Kanwisher NG. 1987 Repetition blindness: type recognition without token individuation. Cognition 27, 117-143. (doi: 10. 1016/0010-0277(87)90016-3).
73. Soto-Faraco S, Spence C. 2002 Modality-specific auditory and visual temporal processing deficits. Q. J. Exp. Psychol. A 55, 23-40. (doi: 10. 1080/02724980143000136).
74. Kanwisher N. 2001 Neural events and perceptual awareness. Cognition 79, 89-113. (doi: 10. 1016/S0010-0277(00)00125-6).
75. Chen YC, Yeh SL. 2008 Visual events modulated by sound in repetition blindness. Psychon. Bull. Rev. 15, 404-408. (doi: 10. 3758/PBR. 15. 2. 404).
76. Chen Y-C, Yeh S-L. 2009 Catch the moment: multisensory enhancement of rapid visual events by sound. Exp. Brain Res. 198, 209-219. (doi: 10. 1007/s00221-009-1831-4).
77. Bolognini N, Frassinetti F, Serino A, Ladavas E. 2005 'Acoustical vision' of below threshold stimuli: interaction among spatially converging audiovisual inputs. Exp. Brain Res. 160, 273-282. (doi: 10. 1007/s00221-004-2005-z).
78. Frassinetti F, Bolognini N, Lavadas E. 2002 Enhancement of visual perception by crossmodal visuo-auditory interaction. Exp. Brain Res. 147, 332-343. (doi: 10. 1007/s00221-002-1262-y).
79. McDonald JJ, Teder-Salejarvi WA, Hillyard SA. 2000 Involuntary orienting to sound improves visual perception. Nature 407, 906-908. (doi: 10. 1038/35038085).
80. Chen Y-C, Spence C. 2011 The crossmodal facilitation of visual object representations by sound: evidence from the backward masking paradigm. J. Exp. Psychol. Hum. Percept. Perform. 37, 1784-1802. (doi: 10. 1037/a0025638).
81. O'Callaghan C. 2014 Perception and multimodality. In Oxford handbook to philosophy and cognitive science (eds E Margolis, R Samuels, S Stich), pp. 80-95. New York, NY: Oxford University Press.
82. Stein BE, Meredith MA. 1993 The merging of the senses. Cambridge, MA: MIT Press.
83. Bauer M. 2008 Multisensory integration: a functional role for inter-area synchronization? Curr. Biol. 18, R709-R710. (doi: 10. 1016/j. cub. 2008. 06. 051).
84. Senkowski D, Schneider TR, Foxe JJ, Engel AK. 2008 Crossmodal binding through neural coherence: implications for multisensory processing. Trends Neurosci. 31, 401-409. (doi: 10. 1016/j. tins. 2008. 05. 002).
85. Fairhall S, Macaluso E. 2009 Spatial attention can modulate audiovisual integration at multiple cortical and sub-cortical sites. Eur. J. Neurosci. 29, 1247-1257. (doi: 10. 1111/j. 1460-9568. 2009. 06688. x).
86. McGurk H, MacDonald J. 1976 Hearing lips and seeing voices. Nature 264, 746-748. (doi: 10. 1038/264746a0).
87. Shams L, Kamitani Y, Shimojo S. 2000 What you see is what you hear: sound induced visual flashing. Nature 408, 788. (doi: 10. 1038/35048669).
88. Beierholm UR, Quartz SR, Shams L. 2009 Bayesian priors are encoded independently from likelihoods in human multisensory perception. J. Vis. 9, 1-9. (doi: 10. 1167/9. 5. 23).
89. Spence C. 2013 Just how important is spatial coincidence to multisensory integration? Evaluating the spatial rule. Ann. NY Acad. Sci. 1296, 31-49. (doi: 10. 1111/nyas. 12121).
90. Holt-Hansen K. 1976 Extraordinary experiences during cross-modal perception. Percept. Mot. Skills 43, 1023-1027. (doi: 10. 2466/pms. 1976. 43. 3f. 1023).
91. Soto-Faraco S, Alsius A. 2009 Deconstructing the McGurk-MacDonald illusion. J. Exp. Psychol. Hum. Percept. Perform. 35, 580-587. (doi: 10. 1037/a0013483).
92. Navarra J. 2003 Visual speech interference in an auditory shadowing task: the dubbed movie effect. In Proc. 15th International Congress of Phonetic Sciences, Barcelona, Spain (ed. MJ Solé), pp. 1-4. Barcelona, Spain: ICPhS Organizing Committee.
93. Vatakis A, Spence C. 2007 Crossmodal binding: evaluating the 'unity assumption' using audiovisual speech stimuli. Percept. Psychophys. 69, 744-756. (doi: 10. 3758/BF03193776).
94. Jackson CV. 1953 Visual factors in auditory localization. Q. J. Exp. Psychol. 5, 52-65. (doi: 10. 1080/17470215308416626).
95. Zapparoli GC, Reatto LL. 1969 The apparent movement between visual and acoustic stimulus and the problem of intermodal relations. Acta Psychol. 29, 256-267. (doi: 10. 1016/0001-6918(69)90019-5).
96. Zmigrod S, Hommel B. 2011 The relationship between feature binding and consciousness: evidence from asynchronous multi-modal stimuli. Conscious. Cogn. 20, 586-593. (doi: 10. 1016/j. concog. 2011. 01. 011).
97. Spence C, Parise C, Chen Y-C. 2011 The Colavita visual dominance effect. In Frontiers in the neural bases of multisensory processes (eds MM Murray, M Wallace), pp. 523-550. Boca Raton, FL: CRC Press.
98. Miller J. 1982 Divided attention: evidence for coactivation with redundant signals. Cogn. Psychol. 14, 247-279. (doi: 10. 1016/0010-0285(82)90010-X).
99. Otto TU, Mamassian P. 2012 Noise and correlations in parallel perceptual decision making. Curr. Biol. 22, 1391-1396. (doi: 10. 1016/j. cub. 2012. 05. 031).
100. Harrar V, Tammam J, Pérez-Bellido A, Pitt A, Stein J, Spence C. In press. Multisensory integration and attention: differences in developmental dyslexia. Curr. Biol.
101. Chen Y-C, Spence C. 2011b Crossmodal semantic priming by naturalistic sounds and spoken words enhances visual sensitivity. J. Exp. Psychol. Hum. Percept. Perform. 37, 1554-1568. (doi: 10. 1037/a0024329).
102. Block N. 2011 Perceptual consciousness overflows cognitive access. Trends Cogn. Sci. 15, 567-575. (doi: 10. 1016/j. tics. 2011. 11. 001).
103. Nagel T. 1974 What is it like to be a bat? Phil. Rev. 83, 435-456. (doi: 10. 2307/2183914).
104. Spence C, Bayne T. In press. Is consciousness multisensory? In Perception and its modalities (eds M Matthen, S Biggs, D Stokes). Oxford, UK: Oxford University Press.
105. Deroy O. In press. Multisensory integration and the many unities of consciousness. In Multisensory integration and the unity of consciousness (eds D Bennett, C Hill). Cambridge, MA: MIT Press.
106. Spence C, Parise C. 2010 Prior entry. Conscious. Cogn. 19, 364-379. (doi: 10. 1016/j. concog. 2009. 12. 001).
107. Fulkerson M. 2011 The unity of haptic touch. Phil. Psychol. 24, 493-516. (doi: 10. 1080/09515089. 2011. 556610).
108. Auvray M, Spence C. 2008 The multisensory perception of flavor. Conscious. Cogn. 17, 1016-1031. (doi: 10. 1016/j. concog. 2007. 06. 005).
109. Spence C, Smith B, Auvray M. In press. Confusing tastes and flavours. In Perception and its modalities (eds M Matthen, S Biggs, D Stokes). Oxford, UK: Oxford University Press.
110. Botvinick M, Cohen J. 1998 Rubber hands 'feel' touch that eyes see. Nature 391, 756. (doi: 10. 1038/35784).
111. Liang M, Moraux A, Hu L, Iannetti GD. 2013 Primary sensory cortices contain distinguishable spatial patterns of activity for each sense. Nat. Commun. 4, 1979. (doi: 10. 1038/ncomms2979).
112. Wagemans J. (ed.) In press. The Oxford handbook of perceptual organization. Oxford, UK: Oxford University Press.
113. Spence C, Chen Y-C. 2012 Intramodal and crossmodal perceptual grouping. In The new handbook of multisensory processing (ed. BE Stein), pp. 265-282. Cambridge, MA: MIT Press.
114. Santangelo V, Macaluso E. 2012 Spatial attention and audiovisual processing. In The new handbook of multisensory processes (ed. BE Stein), pp. 359-370. Cambridge, MA: The MIT Press.
115. Talsma D, Senkowski D, Soto-Faraco S, Woldorff MG. 2010 The multifaceted interplay between attention and multisensory integration. Trends Cogn. Sci. 14, 400-410. (doi: 10. 1016/j. tics. 2010. 06. 008).
116. Sekuler R, Sekuler AB, Lau R. 1997 Sound alters visual motion perception. Nature 385, 308. (doi: 10. 1038/385308a0).
117. Calvert G, Spence C, Stein BE. (eds) 2004 The handbook of multisensory processing. Cambridge, MA: MIT Press.