Visuo-tactile integration and body ownership during self-generated action

European Journal of Neuroscience

Volumn 37, Issue 7, 2013, Pages 1120-1129

  Rognini, G ^a   Sengul A ^a   Aspell, J E ^a   Salomon, R ^a   Bleuler, H ^a   Blanke, O ^a,b  

^a EPFL   (Switzerland)

^b GENEVA UNIVERSITY HOSPITALS   (Switzerland)

Author keywords

Agency; Cross modal congruency effect; Internal model; Movement; Multisensory

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; EVOKED VISUAL RESPONSE; EYE FIXATION; FEMALE; HAND MOVEMENT; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PRIORITY JOURNAL; ROBOTICS; SENSORIMOTOR INTEGRATION; TACTILE FEEDBACK; TACTILE STIMULATION; VIRTUAL REALITY; VISUAL FEEDBACK; VISUAL INFORMATION; VISUAL STIMULATION; VISUOMOTOR COORDINATION;

ADULT; BODY IMAGE; FEEDBACK, SENSORY; FEMALE; HUMANS; MALE; MOTOR SKILLS; REACTION TIME; ROBOTICS; TOUCH PERCEPTION; VISUAL PERCEPTION;

EID: 84875667380     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/ejn.12128     Document Type: Article

References (85)

1. Angel, R.W. & Malenka, R.C. (1982) Velocity-dependent suppression of cutaneous sensitivity during movement. Exp. Neurol., 77, 266-274.
2. Aspell, J.E., Lenggenhager, B., Blanke, O. & Williams, M.A. (2009) Keeping in touch with one's self: multisensory mechanisms of self-consciousness. PLoS ONE, 4, e6488.
3. Austen, E.L., Soto-Faraco, S., Enns, J.T. & Kingstone, A. (2004) Mislocalizations of touch to a fake hand. Cogn. Affect. Behav. Neurosci., 4, 170-181.
4. Ayav, A., Bresler, L., Brunaud, L. & Boissel, P. (2004) Early results of one-year robotic surgery using the Da Vinci system to perform advanced laparoscopic procedures. J. Gastrointest. Surg., 8, 720-726.
5. Barfield, W. & Furness, T.A. (1995) Virtual Environments and Advanced Interface Design. Oxford University Press, USA.
6. Bays, P.M., Flanagan, J.R. & Wolpert, D.M. (2006) Attenuation of self-generated tactile sensations is predictive, not postdictive. PLoS Biol., 4, e28.
7. van Beers, R.J., Wolpert, D.M. & Haggard, P. (2002) When feeling is more important than seeing in sensorimotor adaptation. Curr. Biol., 12, 834-837.
8. Blakemore, S.J., Frith, C.D. & Wolpert, D.M. (1999) Spatio-temporal prediction modulates the perception of self-produced stimuli. J. Cogn. Neurosci., 11, 551-559.
9. Blanke, O. (2012) Multisensory brain mechanisms of bodily self-consciousness. Nat. Rev. Neurosci., 13, 556-571.
10. Blanke, O. & Gassert, R. (2009) Total control in virtual reality and robotics. Front. Neurosci., 3, 110-111.
11. Bohil, C.J., Alicea, B. & Biocca, F.A. (2011) Virtual reality in neuroscience research and therapy. Nat. Rev. Neurosci., 12, 752-762.
12. Brozzoli, C., Pavani, F., Urquizar, C., Cardinali, L. & Farnè, A. (2009) Grasping actions remap peripersonal space. NeuroReport, 20, 913-917.
13. Brozzoli, C., Cardinali, L., Pavani, F. & Farnè, A. (2010) Action-specific remapping of peripersonal space. Neuropsychologia, 48, 796-802.
14. Collins, D., Cameron, T., Gillard, D. & Prochazka, A. (1998) Muscular sense is attenuated when humans move. J. Physiol., 508, 635-643.
15. Das, H., Zak, H., Johnson, J., Crouch, J. & Frambach, D. (1999) Evaluation of a telerobotic system to assist surgeons in microsurgery. Comput. Aided Surg., 4, 15-25.
16. De Vignemont, F. (2010) Body schema and body image - pros and cons. Neuropsychologia, 48, 669-680.
17. Di Luca, M. (2010) New method to measure end-to-end delay of virtual reality. Presence-Teleop. Virt., 19, 569-584.
18. Ehrsson, H.H. (2007) The experimental induction of out-of-body experiences. Science, 317, 1048.
19. Ehrsson, H.H., Rosén, B., Stockselius, A., Ragnö, C., Köhler, P. & Lundborg, G. (2008) Upper limb amputees can be induced to experience a rubber hand as their own. Brain, 131, 3443-3452.
20. Ernst, M. & Bülthoff, H. (2004) Merging the senses into a robust percept. Trends Cogn. Sci., 8, 162-169.
21. Frith, C. (2005) The self in action:essons from delusions of control. Conscious. Cogn., 14, 752-770.
22. Haggard, P., Taylor-Clarke, M. & Kennett, S. (2003) Tactile perception, cortical representation and the bodily self. Curr. Biol. 13, R170-R173.
23. Held, R. (1992) Telepresence. J. Acoust. Soc. Am., 92, 2458.
24. Holmes, N.P. & Spence, C. (2006) Beyond the body schema: visual, prosthetic, and technological contributions to bodily perception and awareness. In Knoblich, G., Thornton, I., Grosjean, M. & Shiffrar, M. (Eds), Human Body Perception from the Inside Out. Oxford University Press, USA, pp. 15-64.
25. Holmes, N.P., Calvert, G. & Spence, C. (2004) Extending or projecting peripersonal space with tools? Multisensory interactions highlight only the distal and proximal ends of tools. Neurosci. Lett., 372, 62-67.
26. Holmes, N.P., Sanabria, D., Calvert, G.A. & Spence, C. (2007a) Tool-use: capturing multisensory spatial attention or extending multisensory peripersonal space? Cortex, 43, 469-489.
27. Holmes, N.P., Calvert, G.A. & Spence, C. (2007b) Tool use changes multisensory interactions in seconds: evidence from the crossmodal congruency task. Exp. Brain Res., 183, 465-476.
28. Ijsselsteijn, W.A., de Kort, Y.A.W. & Haans, A. (2006) Is this my hand I see before me? The rubber hand illusion in reality, virtual reality, and mixed reality. Presence-Teleop. Virt., 15, 455-464.
29. Ionta, S., Heydrich, L., Lenggenhager, B., Mouthon, M., Fornari, E., Chapuis, D., Gassert, R. & Blanke, O. (2011) Multisensory mechanisms in temporo-parietal cortex support self-location and first-person perspective. Neuron, 70, 363-374.
30. Iriki, A., Tanaka, M. & Iwamura, Y. (1996) Coding of modified body schema during tool use by macaque postcentral neurones. NeuroReport, 7, 2325-2330.
31. Jacobs, R.A. (2002) What determines visual cue reliability? Trends Cogn. Sci., 6, 345-350.
32. Jeannerod, M. (2007) Being oneself. J. Physiol. (Paris), 101, 161-168.
33. Juravle, G., Deubel, H., Tan, H.Z. & Spence, C. (2010) Changes in tactile sensitivity over the time-course of a goal-directed movement. Behav. Brain Res., 208, 391-401.
34. Kammers, M., De Vignemont, F., Verhagen, L. & Dijkerman, H. (2009) The rubber hand illusion in action. Neuropsychologia, 47, 204-211.
35. Kammers, M.P.M., Mulder, J., de Vignemont, F. & Dijkerman, H.C. (2010) The weight of representing the body: addressing the potentially indefinite number of body representations in healthy individuals. Exp. Brain Res., 204, 333-342.
36. Kenney, P.A., Wszolek, M.F., Gould, J.J., Libertino, J.A. & Moinzadeh, A. (2009) Face, content, and construct validity of dV-trainer, a novel virtual reality simulator for robotic surgery. Urology, 73, 1288-1292.
37. Klatzky, R.L., MacWhinney, B. & Behrmann, M. (2008) Embodiment, Ego-space, and Action. Psychology Press, USA.
38. Körding, K.P., Beierholm, U., Ma, W.J., Quartz, S., Tenenbaum, J.B. & Shams, L. (2007) Causal inference in multisensory perception. PLoS ONE, 2, e943.
39. Lanfranco, A.R., Castellanos, A.E., Desai, J.P. & Meyers, W.C. (2004) Robotic surgery: a current perspective. Ann. Surg., 239, 14-21.
40. Lee, E., Rafiq, A., Merrell, R., Ackerman, R. & Dennerlein, J. (2005) Ergonomics and human factors in endoscopic surgery: a comparison of manual vs telerobotic simulation systems. Surg. Endosc., 19, 1064-1070.
41. Lenggenhager, B., Tadi, T., Metzinger, T. & Blanke, O. (2007) Video ergo sum: manipulating bodily self-consciousness. Science, 317, 1096-1099.
42. ® surgical system? J. Endourol., 24, 467-472.
43. Loomis, J.M. & Knapp, J.M. (2003) Visual Perception of Egocentric Distance in Real and Virtual Environments. Lawrence Erlbaum, Mahwah, NJ, pp. 21-46.
44. Marasco, P.D., Kim, K., Colgate, J.E., Peshkin, M.A. & Kuiken, T.A. (2011) Robotic touch shifts perception of embodiment to a prosthesis in targeted reinnervation amputees. Brain, 134, 747-758.
45. Maravita, A. & Iriki, A. (2004) Tools for the body (schema). Trends Cogn. Sci., 8, 79-86.
46. Maravita, A., Spence, C., Kennett, S. & Driver, J. (2002) Tool-use changes multimodal spatial interactions between vision and touch in normal humans. Cognition, 83, B25-B34.
47. Marescaux, J., Leroy, J., Gagner, M., Rubino, F., Mutter, D., Vix, M., Butner, S.E. & Smith, M.K. (2001) Transatlantic robot-assisted telesurgery. Nature, 413, 379-380.
48. Marks, L.E. (2004) Cross-modal interactions in speeded classification. In Calvert, G.A., Spence, C. & Stein, B.E., (Eds), Handbook of Multisensory Processes. MIT press, USA, pp. 85-105.
49. Milne, R., Aniss, A., Kay, N. & Gandevia, S. (1988) Reduction in perceived intensity of cutaneous stimuli during movement: a quantitative study. Exp. Brain Res., 70, 569-576.
50. Mon-Williams, M. & Tresilian, J.R. (1998) A framework for considering the role of afference and efference in the control and perception of ocular position. Biol. Cybern., 79, 175-189.
51. Narazaki, K., Oleynikov, D. & Stergiou, N. (2006) Robotic surgery training and performance. Surg. Endosc., 20, 96-103.
52. Okamura, A.M. (2009) Haptic feedback in robot-assisted minimally invasive surgery. Curr. Opin. Urol., 19, 102-107.
53. Pavani, F., Spence, C. & Driver, J. (2000) Visual capture of touch: out-of-the-body experiences with rubber gloves. Psychol. Sci., 11, 353-359.
54. Prasad, S.M., Maniar, H.S., Soper, N.J. & Damiano, R.J. (2002) The effect of robotic assistance on learning curves for basic laparoscopic skills. Am. J. Surg., 183, 702-707.
55. Roach, N.W., Heron, J. & McGraw, P.V. (2006) Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration. Proc. R. Soc. B Biol. Sci., 273, 2159-2168.
56. Salomon, R., Malach, R. & Lamy, D. (2009) Involvement of the intrinsic/default system in movement-related self recognition. PLoS ONE, 4, e7527.
57. Salomon, R., Szpiro-Grinberg, S. & Lamy, D. (2011) Self-motion holds a special status in visual processing. PLoS ONE, 6, e24347.
58. Sanchez-Vives, M.V. & Slater, M. (2005) From presence to consciousness through virtual reality. Nat. Rev. Neurosci., 6, 332-339.
59. Sanchez-Vives, M.V., Spanlang, B., Frisoli, A., Bergamasco, M. & Slater, M. (2010) Virtual hand illusion induced by visuomotor correlations. PLoS ONE, 5, e10381.
60. Santangelo, V. & Spence, C. (2007) Multisensory cues capture spatial attention regardless of perceptual load. J. Exp. Psychol. Hum. Percept. Perform., 33, 1311-1321.
61. Santangelo, V. & Spence, C. (2008) Is the exogenous orienting of spatial attention truly automatic? Evidence from unimodal and multisensory studies. Conscious. Cogn. 17, 989-1015.
62. Santos-Carreras, L., Beira, R., Sengül, A., Gassert, R. & Bleuler, H. (2010) Influence of force and torque feedback on operator performance in a VR-based suturing task. Appl. Bionics Biomech., 7, 217-230.
63. Santos-Carreras, L., Hagen, M., Gassert, R. & Bleuler, H. (2011) Survey on surgical instrument handle design: ergonomics and acceptance. Surg. Innov., 19, 50-59.
64. Sheridan, T.B. (1992) Telerobotics, Automation, and Human Supervisory Control. MIT Press, USA.
65. Shore, D.I., Barnes, M.E. & Spence, C. (2006) Temporal aspects of the visuotactile congruency effect. Neurosci. Lett., 392, 96-100.
66. Slater, M., Perez-Marcos, D., Ehrsson, H.H. & Sanchez-Vives, M.V. (2009) Inducing illusory ownership of a virtual body. Front. Neurosci., 3, 214-220.
67. Slater, M., Spanlang, B., Sanchez-Vives, M.V. & Blanke, O. (2010) First person experience of body transfer in virtual reality. PLoS ONE, 5, e10564.
68. Spence, C. (2010) Crossmodal spatial attention. Ann. NY Acad. Sci., 1191, 182-200.
69. Spence, C., Pavani, F. & Driver, J. (2004a) Spatial constraints on visual-tactile cross-modal distractor congruency effects. Cogn. Affect. Behav. Neurosci., 4, 148-169.
70. Spence, C., Pavani, F., Maravita, A. & Holmes, N. (2004b) Multisensory contributions to the 3-D representation of visuotactile peripersonal space in humans: evidence from the crossmodal congruency task. J. Physiol. (Paris), 98, 171-189.
71. Suematsu, Y. & del Nido, P.J. (2004) Robotic pediatric cardiac surgery: present and future perspectives. Am. J. Surg., 188, 98-103.
72. Triesch, J., Ballard, D.H. & Jacobs, R.A. (2002) Fast temporal dynamics of visual cue integration. Perception (Lond.), 31, 421-434.
73. Tsakiris, M. & Haggard, P. (2005) The rubber hand illusion revisited: visuotactile integration and self-attribution. J. Exp. Psychol. Hum. Percept. Perform., 31, 80-91.
74. Tsakiris, M., Haggard, P., Franck, N., Mainy, N. & Sirigu, A. (2005) A specific role for efferent information in self-recognition. Cognition, 96, 215-231.
75. Tsakiris, M., Prabhu, G. & Haggard, P. (2006) Having a body versus moving your body: how agency structures body-ownership. Conscious. Cogn. 15, 423-432.
76. Van Beers, R.J., Wolpert, D.M. & Haggard, P. (2001) Sensorimotor integration compensates for visual localization errors during smooth pursuit eye movements. J. Neurophysiol., 85, 1914-1922.
77. Van Selst, M. & Jolicoeur, P. (1994) A solution to the effect of sample size on outlier elimination. Q. J. Exp. Psychol., 47, 631-650.
78. Verner, L.N. & Okamura, A.M. (2007) Effects of translational and gripping force feedback are decoupled in a 4-degree-of-freedom telemanipulator. In Proceeding WHC '07 Proceedings of the Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE Computer Society Washington, DC, USA, pp. 286-291.
79. Verner, L.N. & Okamura, A.M. (2009) Force & torque feedback vs force only feedback. In Proceeding WHC '09 Proceedings of the World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE Computer Society Washington, DC, USA, pp. 406-410.
80. Walton, M. & Spence, C. (2004) Cross-modal congruency and visual capture in a visual elevation-discrimination task. Exp. Brain Res., 154, 113-120.
81. Wei, L., Sourin, A. & Sourina, O. (2008) Function-based visualization and haptic rendering in shared virtual spaces. Visual Comput., 24, 871-880.
82. Welch, R. & Warren, D. (1986) Intersensory interactions. In Boff, K.R., Kaufmann, L. & Thomas, J.P. (Eds), Handbook of Perception and Human Performance. John Wiley, NY, pp. 1-36.
83. Wolpert, D.M., Ghahramani, Z. & Jordan, M.I. (1995) An internal model for sensorimotor integration. Science, 269, 1880-1882.
84. Wozny, D.R. & Shams, L. (2011) Computational characterization of visually induced auditory spatial adaptation. Front. Integrative Neurosci., 5, 75.
85. Zopf, R., Savage, G. & Williams, M.A. (2010) Crossmodal congruency measures of lateral distance effects on the rubber hand illusion. Neuropsychologia, 48, 713-725.