Cross-modal sensory integration of visual-tactile motion information: Instrument design and human psychophysics

Sensors (Switzerland)

Volumn 13, Issue 6, 2013, Pages 7212-7223

  Pei, Yu Cheng ^a,b,c   Chang, Ting Yu ^a   Lee, Tsung Chi ^a   Saha, Sudipta ^a   Lai, Hsin Yi ^a   Gomez Ramirez, Manuel ^d   Chou, Shih Wei ^a   Wong, Alice M K ^a  

^a CHANG GUNG MEMORIAL HOSPITAL   (Taiwan)

^b CHANG GUNG UNIVERSITY   (Taiwan)

^c CHANG GUNG UNIVERSITY   (Taiwan)

^d JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

Congruency; Direction of motion; Haptic approach; Tactile stimulator; Visual tactile integration

Indexed keywords

CONGRUENCY; DIRECTION OF MOTION; FUNDAMENTAL PROPERTIES; HAPTIC APPROACH; SENSORY INFORMATION; SENSORY INTEGRATION; TACTILE STIMULATOR; THREE DEGREES OF FREEDOM;

INTEGRATION;

EID: 84878889150     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s130607212     Document Type: Article

References (37)

1. Stein, B.E.; Stanford, T.R. Multisensory integration: current issues from the perspective of the single neuron. Nat. Rev. Neurosci. 2008, 9, 255-266.
2. Beauchamp, M.S. See me, hear me, touch me: Multisensory integration in lateral occipital-temporal cortex. Curr. Opin. Neurobiol. 2005, 15, 145-153.
3. Ernst, M.O.; Bulthoff, H.H. Merging the senses into a robust percept. Trends Cogn. Sci. 2004, 8, 162-169.
4. McGurk, H.; MacDonald, J. Hearing lips and seeing voices. Nature 1976, 264, 746-748.
5. Sekuler, R.; Sekuler, A.B.; Lau, R. Sound alters visual motion perception. Nature 1997, 385, 308.
6. Guest, S.; Catmur, C.; Lloyd, D.; Spence, C. Audiotactile interactions in roughness perception. Exp. Brain Res. 2002, 146, 161-171.
7. Ernst, M.O.; Banks, M.S.; Bulthoff, H.H. Touch can change visual slant perception. Nat. Neurosci. 2000, 3, 69-73.
8. Spence, C.; Pavani, F.; Driver, J. Spatial constraints on visual-tactile cross-modal distractor congruency effects. Cogn. Affect Behav. Neurosci. 2004, 4, 148-169.
9. Kennett, S.; Spence, C.; Driver, J. Visuo-tactile links in covert exogenous spatial attention remap across changes in unseen hand posture. Per. Psychophys. 2002, 64, 1083-1094.
10. Hyvärinen, J.; Shelepin, Y. Distribution of visual and somatic functions in the parietal associative area 7 of the monkey. Brain Res. 1979, 169, 561-564.
11. Hyvärinen, J. Regional distribution of functions in parietal association area 7 of the monkey. Brain Res. 1981, 206, 287-303.
12. Avillac, M.; Deneve, S.; Olivier, E.; Pouget, A.; Duhamel, J.R. Reference frames for representing visual and tactile locations in parietal cortex. Nat. Neurosci. 2005, 8, 941-949.
13. Carter, O.; Konkle, T.; Wang, Q.; Hayward, V.; Moore, C. Tactile rivalry demonstrated with an ambiguous apparent-motion quartet. Curr. Biol. 2008, 18, 1050-1054.
14. Konkle, T.; Wang, Q.; Hayward, V.; Moore, C.I. Motion aftereffects transfer between touch and vision. Curr. Biol. 2009, 19, 745-750.
15. Bensmaia, S.J.; Killebrew, J.H.; Craig, J.C. Influence of visual motion on tactile motion perception. J. Neurophysiol. 2006, 96, 1625-1637.
16. Blake, R.; Sobel, K.V.; James, T.W. Neural synergy between kinetic vision and touch. Psychol. Sci. 2004, 15, 397-402.
17. Shore, D.I.; Barnes, M.E.; Spence, C. Temporal aspects of the visuotactile congruency effect. Neurosci. Lett. 2006, 392, 96-100.
18. Pei, Y.C.; Hsiao, S.S.; Bensmaia, S.J. The tactile integration of local motion cues is analogous to its visual counterpart. Proc. Natl. Acad. Sci. USA 2008, 105, 8130-8135.
19. Pei, Y.C.; Hsiao, S.S.; Craig, J.C.; Bensmaia, S.J. Neural mechanisms of tactile motion integration in somatosensory cortex. Neuron 2011, 69, 536-547.
20. Killebrew, J.H.; Bensmaia, S.J.; Dammann, J.F.; Denchev, P.; Hsiao, S.S.; Craig, J.C.; Johnson, K.O. A dense array stimulator to generate arbitrary spatio-temporal tactile stimuli. J. Neurosci. Meth. 2007, 161, 62-74.
21. Gori, M.; Mazzilli, G.; Sandini, G.; Burr, D. Cross-sensory facilitation reveals neural interactions between visual and tactile motion in humans. Front Psychol. 2011, doi:10.3389/fpsyg.2011.00055.
22. Johnson, K.O.; Phillips, J.R. A rotating drum stimulator for scanning embossed patterns and textures across the skin. J. Neurosci. Meth. 1988, 22, 221-231.
23. Essick, G.K.; Whitsel, B.L. Factors influencing cutaneous directional sensitivity: A correlative psychophysical and neurophysiological investigation. Brain Res. 1985, 357, 213-230.
24. Meredith, M.A.; Nemitz, J.W.; Stein, B.E. Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J. Neurosci. 1987, 7, 3215-3229.
25. Holmes, N.P.; Spence, C. Multisensory integration: Space, time and superadditivity. Curr. Biol. 2005, 15, R762-R764.
26. Ernst, M.O.; Banks, M.S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 2002, 415, 429-433.
27. Meredith, M.A.; Stein, B.E. Interactions among converging sensory inputs in the superior colliculus. Science 1983, 221, 389-391.
28. Meredith, M.A.; Stein, B.E. Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Res. 1986, 365, 350-354.
29. Morgan, M.L.; DeAngelis, G.C.; Angelaki, D.E. Multisensory integration in macaque visual cortex depends on cue reliability. Neuron 2008, 59, 662-673.
30. Fetsch, C.R.; Pouget, A.; DeAngelis, G.C.; Angelaki, D.E. Neural correlates of reliability-based cue weighting during multisensory integration. Nat. Neurosci. 2012, 15, 146-154.
31. Hillis, J.M.; Watt, S.J.; Landy, M.S.; Banks, M.S. Slant from texture and disparity cues: Optimal cue combination. J. Vis. 2004, 4, 967-992.
32. Jacobs, R.A. Optimal integration of texture and motion cues to depth. Vis. Res. 1999, 39, 3621-3629.
33. Alais, D.; Burr, D. The ventriloquist effect results from near-optimal bimodal integration. Curr. Biol. 2004, 14, 257-262.
34. Butz, M.V.; Thomaschke, R.; Linhardt, M.J.; Herbort, O. Remapping motion across modalities: Tactile rotations influence visual motion judgments. Exp. Brain Res. 2010, 207, 1-11.
35. Hagen, M.C.; Franzen, O.; McGlone, F.; Essick, G.; Dancer, C.; Pardo, J.V. Tactile motion activates the human middle temporal/V5 (MT/V5) complex. Eur. J. Neurosci. 2002, 16, 957-964.
36. Beauchamp, M.S.; Yasar, N.E.; Kishan, N.; Ro, T. Human MST but not MT responds to tactile stimulation. J. Neurosci. 2007, 27, 8261-8267.
37. De Gelder, B.; Bertelson, P. Multisensory integration, perception and ecological validity. Trends Cogn. Sci. 2003, 7, 460-467.