Cross-sensory facilitation reveals neural interactions between visual and tactile motion in humans

Frontiers in Psychology

Volumn 2, Issue APR, 2011, Pages

  Gori, Monica ^a   Mazzilli, Giacomo ^b   Sandini, Giulio ^a   Burr, David ^c  

^a ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^b UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^c UNIVERSITY OF FLORENCE   (Italy)

Author keywords

Cross sensory; Facilitation; Interactions; Motion; Neural; Perception; Tactile; Visual

Indexed keywords

EID: 82955195536     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2011.00055     Document Type: Article

References (56)

1. Alais, D., and Burr, D. (2004a). No direction-specific bimodal facilitation for audiovisual motion detection. Brain Res. Cogn. Brain Res. 19, 185-194.
2. Alais, D., and Burr, D. (2004b). The ventriloquist effect results from nearoptimal bimodal integration. Curr. Biol. 14, 257-262.
3. Arabzadeh, E., Clifford, C. W. G., and Harris, J. A. (2008). Vision merges with touch in a purely tactile discrimination. Psychol. Sci. 19, 635-641.
4. Arrighi, R., Marini, F., and Burr, D. (2009). Meaningful auditory information enhances perception of visual biological motion. J. Vis. 9, 1-7.
5. Beauchamp, M. S., Pasalar, S., and Ro, T. (2010). Neural substrates of reliabilityweighted visual-tactile multisensory integration. Front. Syst. Neurosci. 4:25. doi: 10.3389/fnsys.2010.00025
6. Beauchamp, M. S., Yasar, N. E., Fryec, R. E., and Ro, T. (2007). Human MST but not MT responds to tactile stimulation. J. Neurosci. 27, 8261-8267.
7. Bedny, M., Konkle, T., Pelphrey, K., Saxe, R., and Pascual-Leone, A. (2010). Sensitive period for a multimodal response in human visual motion area MT/MST. Curr. Biol. 20, 1900-1906.
8. Bensmaia, S. J., Killebrew, J. H., and Craig, J. C. (2006). Influence of visual motion on tactile motion perception. J. Neurophysiol. 96, 1625-1637.
9. Bicchi, A., Scilingo, E. P., Ricciardi, E., and Pietrini, P. (2008). Tactile flow explains haptic counterparts of common visual illusions. Brain Res. Bull. 75, 737-741.
10. Blake, R., Sobel, K. V., and James, T. W. (2004). Neural synergy between kinetic vision and touch. Psychol. Sci. 15, 397-402.
11. Blakemore, S. J., Bristow, D., Bird, G., Frith, C., and Ward, J. (2005). Somatosensory activations during the observation of touch and a case of vision-touch synaesthesia. Brain 128(Pt 7), 1571-1583.
12. Bolognini, N., and Maravita, A. (2007). Proprioceptive alignment of visual and somatosensory maps in the posterior parietal cortex. Curr. Biol. 17, 1890-1895.
13. Burr, D., Silva, O., Cicchini, G. M., Banks, M. S., and Morrone, M. C. (2009). Temporal mechanisms of multimodal binding. Proc. Biol. Sci. 276, 1761-1769.
14. Burr, D. C., and Morgan, M. J. (1997). Motion deblurring in human vision. Proc. Biol. Sci. 264, 431-436.
15. Craig, J. C. (2006). Visual motion interferes with tactile motion perception. Perception 35, 351-367.
16. Efron, B. T., and Tibshirani, R. J. (1993). An Introduction to the Bootstrap, New York: Chapman and Hall.
17. Ernst, M. O., and Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429-433.
18. Ernst, M. O., and Bulthoff, H. H. (2004). Merging the senses into a robust percept. Trends Cogn. Sci. 8, 162-169.
19. Gori, M., Del Viva, M., Sandini, G., and Burr, D. C. (2008). Young children do not integrate visual and haptic form information. Curr. Biol. 18, 694-698.
20. Graham, N. V. S. (1989). Visual Pattern Analyzers. Oxford: Oxford University Press.
21. Hagen, M. C., Franzen, O., McGlone, F., Essick, G., Dancer, C., and Pardo, J. V. (2002). Tactile motion activates the human middle temporal/V5 (MT/V5) complex. Eur. J. Neurosci. 16, 957-964.
22. Harrar, V., and Harris, L. R. (2007). Multimodal ternus: visual, tactile, and visuo-tactile grouping in apparent motion. Perception 36, 1455-1464.
23. Harrar, V., Winter, R., and Harris, L. R. (2008). Visuotactile apparent motion. Percept. Psychophys. 70, 807-817.
24. Henning, G. B. W., and Wichmann, F. A. (2007). Some observations on the pedestal effect. J. Vis. 7, 1-15.
25. Kayser, C., Logothetis, N. K., and Panzeri, S. (2009). Visual enhancement of the information representation in auditory cortex. Curr. Biol. 20, 19-24.
26. Keysers, C., Wicker, B., Gazzola, V., Anton, J. L., Fogassi, L., and Gallese, V. (2004). A touching sight: SII/PV activation during the observation and experience of touch. Neuron 42, 335-346.
27. Kitagawa, N., and Ichihara, S. (2002). Hearing visual motion in depth. Nature 416, 172-174.
28. Konkle, T., Wang, Q., Hayward, V., and Moore, C. I. (2009). Motion aftereffects transfer between touch and vision. Curr. Biol. 19, 745-750.
29. Legge, G. E., and Foley, J. M. (1980). Contrast masking in human vision. J. Opt. Soc. Am. 70, 1458-1471.
30. Legge, G. E., Kersten, D., and Burges, A. E. (1987). Contrast discrimination in noise. J. Opt. Soc. Am. A 4, 391-404.
31. Lopez-Moliner, J., and Soto-Faraco, S. (2007). Vision affects how fast we hear sounds move. J. Vis. 7, 1-7.
32. Mays, A., and Schirillo, J. (2005). Lights can reverse illusory directional hearing. Neurosci. Lett. 384, 336-338.
33. Meyer, G. F., and Wuerger, S. M. (2001). Cross-modal integration of auditory and visual motion signals. Neuroreport 12, 2557-2560.
34. Nachmias, J., and Kocher, E. C. (1970). Visual detection and discrimination of luminance increments. J. Opt. Soc. Am. 60, 382-389.
35. Nakashita, S., Saito, D. N., Kochiyama, T., Honda, M., Tanabe, H. C., and Sadato, N. (2008). Tactile-visual integration in the posterior parietal cortex: a functional magnetic resonance imaging study. Brain Res. Bull. 75, 513-525.
36. Pei, Y. C., Hsiao, S. S., Craig, J. C., and Bensmaia, S. J. (2011). Neural mechanisms of tactile motion integration in somatosensory cortex. Neuron 69, 536-547.
37. Pelli, D. G. (1985). Uncertainty explains many aspects of visual contrast detection and discrimination. J. Opt. Soc. Am. A 2, 1508-1532.
38. Pelli, D. G. (1987). On the relation between summation and facilitation. Vision Res. 27, 119-123.
39. Rentschler, I., and Fiorentini, A. (1974). Meridional anisotrophy of psychophysical spatial interactions. Vision Res. 14, 1467-1475.
40. Ricciardi, E., Vanello, N., Dente, D., Sgambellini, N., Scillingo, E. P., Gentili, C., Sani, L., Positano, V., Santarelli, F. M., Guazzelli, M., Haxby, J. V., Landini, L., Bicchi, A., and Pietrin, P. (2004). "Perception of visual and tactile flow activitates common cortical areas in the human brain," in Proceedings of the EuroHaptics 2004 (Germany: Technische Universitat Munchen), 290-292.
41. Rowland, B. A., and Stein, B. E. (2007). Multisensory integration produces an initial response enhancement. Front. Integr. Neurosci. 1:4. doi: 10.3389/ neuro.07/004.2007
42. Saenz, M., Lewis, L. B., Huth, A. G., Fine, I., and Koch, C. (2008). Visual motion area MT+/V5 responds to auditory motion in human sight-recovery subjects. J. Neurosci. 28, 5141-5148.
43. Schaefer, M., Heinze, H. J., and Rotte, M. (2005). Seeing the hand being touched modulates the primary somatosensory cortex. Neuroreport 16, 1101-1105.
44. Simpson, W. A., and Finsten, B. A. (1995). Pedestal effect in visual motion discrimination. J. Opt. Soc. Am. A. Opt. Image Sci. Vis. 12, 2555-2563.
45. Solomon, J. A. (2009). The history of dipper functions. Atten. Percept. Psychophys. 71, 435-443.
46. Soto-Faraco, S., Spence, C., and Kingstone, A. (2004). Congruency effects between auditory and tactile motion: extending the phenomenon of cross-modal dynamic capture. Cogn. Affect. Behav. Neurosci. 4, 208-217.
47. Stein, B. E., Jiang, W., Wallace, M. T., and Stanford, T. R. (2001). Nonvisual influences on visual-information processing in the superior colliculus. Prog. Brain Res. 134, 143-156.
48. Stein, B. E., Meredith, M. A., and Wallace, M. T. (1993). The visually responsive neuron and beyond: multisensory integration in cat and monkey. Prog. Brain Res. 95, 79-90.
49. Strybel, T. Z., and Vatakis, A. (2004). A comparison of auditory and visual apparent motion presented individually and with crossmodal moving distractors. Perception 33, 1033-1048.
50. Ushioda, H., and Wada, Y. (2007). "Multisensory integration between visual and tactile motion information: evidence from redundantsignals effects on reaction time," in 23rd Annual Meeting of the ISP Proceedings of the 23rd Annual Meeting of the ISP, Tokyo.
51. Wang, Y., Celebrini, S., Trotter, Y., and Barone, P. (2008). Visuoauditory interactions in the primary visual cortex of the behaving monkey: electrophysiological evidence. BMC Neurosci. 9, 79. doi: 10.1186/1471-2202-9-79
52. Watanabe, J., Hayashi, S., Kajimoto, H., Tachi, S., and Nishida, S. (2007). Tactile motion aftereffects produced by appropriate presentation for mechanoreceptors. Exp. Brain Res. 180, 577-582.
53. Watson, A. B. (1979). Probability summation over time. Vision Res. 19, 515-522.
54. Watson, A. B., and Pelli, D. G. (1983). QUEST: a Bayesian adaptive psychometric method. Percept. Psychophys. 33, 113-120.
55. Watt, R. J., and Morgan, M. J. (1983). The recognition and representation of edge blur: evidence for spatial primitives in human vision. Vision Res. 23, 1465-1477.
56. Wuerger, S. M., Hofbauer, M., and Meyer, G. F. (2003). The integration of auditory and visual motion signals at threshold. Percept. Psychophys. 65, 1188-1196.