A fully immersive set-up for remote interaction and neurorehabilitation based on virtual body ownership

Frontiers in Neurology

Volumn JUL, Issue , 2012, Pages

  Perez Marcos, Daniel ^a,b   Solazzi, Massimiliano ^c   Steptoe, William ^d   Oyekoya, Oyewole ^d   Frisoli, Antonio ^c   Weyrich, Tim ^d   Steed, Anthony ^d   Tecchia, Franco ^c   Slater, Mel ^b,d,e   Sanchez Vives, Maria V ^a,b,e  

^a INSTITUT D INVESTIGACIONS BIOMÈDIQUES AUGUST PI I SUNYER IDIBAPS   (Spain)

^b UNIVERSITY OF BARCELONA   (Spain)

^c SCUOLA SUPERIORE SANT ANNA   (Italy)

^d UNIVERSITY COLLEGE LONDON   (United Kingdom)

^e INSTITUCIÓ CATALANA DE RECERCA I ESTUDIS AVANÇATS ICREA   (Spain)

Author keywords

Body ownership; Haptics; Multisensory correlations; Neurorehabilitation; Rubber hand illusion; Telemedicine; Teleneurology; Virtual reality

Indexed keywords

EID: 84865996210     PISSN: None     EISSN: 16642295     Source Type: Journal    
DOI: 10.3389/fneur.2012.00110     Document Type: Article

References (68)

1. Adamovich, S. V., Fluet, G. G., Meri-ans, A. S., Mathai, A., and Qiu, Q. (2009a). Incorporating haptic effects into three-dimensional virtual environments to train the hemiparetic upper extremity. IEEE Trans. Neural Syst. Rehabil Eng. 17, 512-520.
2. Adamovich, S. V., Fluet, G. G., Tunik, E., and Merians, A. S. (2009b). Sen-sorimotor training in virtual reality: a review. NeuroRehabilitation 25, 29-44.
3. August, K. G., Guidali, M., Sell-athurai, M., Jenu, S., Bleichen-bacher, D., Klamroth-Marganska, V., Adamovich, S. V., and Riener, R. (2011). "A system for sensory motor rehabilitation of the upper limb with virtual reality, exoskeleton robot, and real objects," in 2011 IEEE Conference on Technologies for Practical Robot Applications (TePRA), Woburn, MA.
4. Badler, N. I., Hollick, M. J., and Granieri, J. P. (1993). Real-time control of a virtual human using minimal sensors. Presence(Camb.) 2, 82-86.
5. Bergamasco, M.,Avizzano, C.A., Frisoli, A., Ruffaldi, E., and Marcheschi, S. (2006). Design and validation of a complete haptic system for manipulative tasks. Adv. Robot. 20, 367-389.
6. Botvinick, M., and Cohen, J. (1998). Rubber hands "feel" touch that eyes see. Nature 391, 756.
7. Brochard, S., Robertson, J., Medee, B., and Remy-Neris, O. (2010). What's new in new technologies for upper extremity rehabilitation? Curr. Opin. Neurol. 23, 683-687.
8. Buck, S. (2009). Nine human factors contributing to the user acceptance of telemedicine applications: a cognitive-emotional approach. J. Telemed. Telecare 15,55-58.
9. Burdea, G. C. (2003). Virtual rehabilitation - benefits and challenges. MethodsInf. Med. 42, 519-523.
10. Cameirao, M. S., Bermudez, I. B. S., Duarte Oller, E., and Verschure, P. F. (2009). The rehabilitation gaming system: a review. Stud. Health Technol. Inform. 145, 65-83.
11. Carignan, C. R., and Krebs, H. I. (2006). Telerehabilitation robotics: bright lights, big future? J. Rehabil. Res. Dev. 43, 695-710.
12. Carignan, C. R., and Olsson, P. A. (2004). "Cooperative control of virtual objects over the Internet using force-reflecting master arms," in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA '04), New Orleans, LA.
13. Coote, S., Murphy, B., Harwin, W., and Stokes, E. (2008). The effect of the GENTLE/s robot-mediated therapy system on arm function after stroke. Clin. Rehabil. 22, 395-405.
14. Cranen, K., Drossaert, C. H., Brinkman, E. S., Braakman-Jansen, A. L., Ijzer-man, M. J., and Vollenbroek-Hutten, M. M. (2011). An exploration of chronic pain patients' perceptions of home telerehabilitation services. Health Expect. doi: 10.1111/j.1369-7625.2011.00668.x. [Epub ahead of print].
15. Crosbie, J. H., Lennon, S., Basford, J. R., and Mcdonough, S. M. (2007). Virtual reality in stroke rehabilitation: still more virtual than real. Disabil. Rehabil. 29, 1139-1146.
16. Dimyan, M. A., Dobkin, B. H., and Cohen, L. G. (2008). Emerging subspecialties: neurorehabilitation: training neurologists to retrain the brain. Neurology 70, e52-e54.
17. Ehrsson, H. H. (2007). The experimental induction of out-of-body experiences. Science 317, 1048.
18. Ehrsson, H. H., Spence, C., and Pass-ingham, R. E. (2004). That's my hand! Activity in premotor cortex reflects feeling of ownership of a limb. Science 305, 875-877.
19. Ehrsson, H. H., Wiech, K., Weiskopf, N., Dolan, R. J., and Passingham, R. E. (2007). Threatening a rubber hand that you feel is yours elicits a cortical anxiety response. Proc. Natl. Acad. Sci. U.S.A. 104, 9828-9833.
20. Ellis, S. R. (1991). Nature and origins of virtual environments: a bibliographical essay. Comput. Syst. Eng. 2, 321.
21. Gillies, M., and Spanlang, B. (2010). Comparing and evaluating real time character engines for virtual environments. Presence (Camb.) 19, 95-117.
22. Golomb, M. R., Mcdonald, B. C., Warden, S. J., Yonkman, J., Saykin, A.J., Shirley, B., Huber, M., Rabin, B., Abdelbaky, M., Nwosu, M. E., Barkat-Masih, M., and Burdea, G.C. (2010). In-home virtual real ity videogame telerehabilitation in adolescents with hemiplegic cerebral palsy. Arch. Phys. Med. Rehabil. 91, 1-8 e1.
23. Gonzalez-Franco, M., Perez-Marcos, D., Spanlang, B., and Slater, M. (2010). "The contribution of real-time mirror reflections of motor actions on virtual body ownership in an immersive virtual environment," in IEEE Virtual Reality Conference, Waltham, MA.
24. Henderson, A., Korner-Bitensky, N., and Levin, M. (2007). Virtual reality in stroke rehabilitation: a systematic review of its effectiveness for upper limb motor recovery. Top. Stroke Rehabil. 14,52-61.
25. Hoffman, H. G., Doctor, J. N., Patterson, D. R., Carrougher, G. J., and Furness, T. A. III. (2000). Virtual reality as an adjunctive pain control during burn wound care in adolescent patients. Pain 85, 305-309.
26. Holden, M. K. (2005). Virtual environments for motor rehabilitation: review. Cyberpsychol. Behav. 8, 187-211; discussion 212-189.
27. Holden, M. K., Dyar, T. A., and Dayan-Cimadoro, L. (2007). Telerehabilitation using a virtual environment improves upper extremity function in patients with stroke. IEEE Trans. Neural Syst. Rehabil. Eng. 15, 36-42.
28. Huber, M., Rabin, B., Docan, C., Burdea, G. C., Abdelbaky, M., and Golomb, M.R. (2010). Feasibility of modified remotely monitored in-home gaming technology for improving hand function in adolescents with cerebral palsy. IEEE Trans. Inf. Technol. Biomed. 14, 526-534.
29. Jadhav, C., and Krovi, V (2004). A low-cost framework for individualized interactive telerehabilitation. Conf. Proc. IEEE Eng. Med. Biol. Soc. 5, 3297-3300.
30. Kapur, P., Jensen, M., Buxbaum, L. J., Jax, S. A., and Kuchenbecker, K. J. (2010). "Spatially distributed tactile feedback for kinesthetic motion guidance," in Haptics Symposium, 2010 IEEE, Waltham, MA.
31. Kenyon, R. V., Leigh, J., and Keshner, E. A. (2004). Considerations for the future development of virtual technology as a rehabilitation tool. J. Neuroeng. Rehabil. 1, 13.
32. Kurillo, G., Koritnik, T., Bajd, T., and Bajcsy, R. (2011). Real-time 3D avatars for tele-rehabilitation in virtual reality. Stud. Health Technol. Inform. 163,290-296.
33. Lange, B., Chang, C. Y., Suma, E., Newman, B., Rizzo, A. S., and Bolas, M. (2011). "Development and evaluation of low cost game-based balance rehabilitation tool using the Microsoft Kinect sensor," in Conference Proceedings IEEE Engineering in Medicine and Biology Society,Boston, 1831-1834.
34. Lange, B., Flynn, S., Proffitt, R., Chang, C. Y., and Rizzo, A. S. (2010). Development of an interactive game-based rehabilitation tool for dynamic balance training. Top. Stroke Rehabil. 17, 345-352.
35. Lange,B.,Flynn,S.,andRizzo,A. (2009). Initial usability assessment of off-the-shelf video game consoles for clinical game-based motor rehabilitation. Phys. Ther. Rev. 14, 355.
36. Lange, B., Koenig, S., Chang, C. Y., Mcconnell, E., Suma, E., Bolas, M., and Rizzo, A. (2012). Designing informed game-based rehabilitation tasks leveraging advances in virtual reality. Disabil. Rehabil. PMID: 22494437. [Epub ahead of print].
37. Laurence, P. (2012). Real-world beaming: the risk of avatar and robot crime [online]. BBC News. Available at: http://www.bbc.co.uk/news/world-europe-17905533 [accessed May 11,2012].
38. Lenggenhager, B., Tadi, T., Metzinger, T., and Blanke, O. (2007). Video ergo sum: manipulating bodily self-consciousness. Science 317, 1096-1099.
39. Leon, A., Caceres, C., Fernandez, E., Chausa, P., Martin, M., Codina, C., Rousaud, A., Blanch, J., Mal-lolas, J., Martinez, E., Blanco, J. L., Laguno, M., Larrousse, M., Milinkovic, A., Zamora, L., Canal, N., Miro, J. M., Gatell, J. M., Gomez, E. J., and Garcia, F. (2011). A new multidisciplinary home care telemedicine system to monitor stable chronic human immunodeficiency virus-infected patients: a randomized study. PLoS ONE 6, e14515. doi:10.1371/journal.pone.0014515
40. Levin, M. E (2011). Can virtual reality offer enriched environments for rehabilitation? Expert Rev. Neu-rother. 11,153-155.
41. Lo, A. C., Guarino, P. D., Richards, L. G., Haselkorn, J. K., Wittenberg, G. F., Federman, D. G., Ringer, R. J., Wagner, T. H., Krebs, H. I., Volpe, B. T., Bever, C. T. Jr., Bravata, D. M., Duncan, P. W., Corn, B. H., Maffucci, A. D., Nadeau, S. E., Conroy, S. S., Powell, J. M., Huang, G. D., and Peduzzi, P. (2010). Robot-assisted therapy for long-term upper-limb impairment after stroke. N. Engl J. Med. 362, 1772-1783.
42. Lucca, L. E (2009). Virtual reality and motor rehabilitation of the upper limb after stroke: a generation of progress? J. Rehabil Med. 41, 1003-1100.
43. Mario, G., Rrez, P. L., Daniel, T., Fr, D., and Ric, V. (2004). "Telerehabilitation: controlling haptic virtual environments through handheld interfaces," in Proceedings of the ACM Symposium on Virtual Reality Software and Technology (Hong Kong: ACM).
44. Merians, A. S., Jack, D., Boian, R., Tremaine, M., Burdea, G. C., Adamovich, S. V., Recce, M., and Poizner, H. (2002). Virtual reality-augmented rehabilitation for patients following stroke. Phys. Ther. 82,898-915.
45. Minsky, M. (1980). Telepresence. Omni 2,45-52.
46. Moseley, G. L., Olthof, N., Venema, A., Don, S., Wijers, M., Gallace, A., and Spence, C. (2008). Psychologically induced cooling of a specific body part caused by the illusory ownership of an artificial counterpart. Proc. Natl. Acad. Sci. U.S.A. 105, 13169-13173.
47. Normand, J. M., Giannopoulos, E., Spanlang, B., and Slater, M. (2011). Multisensory stimulation can induce an illusion of larger belly size in immersive virtual reality. PLoS ONE 6, e16128. doi:10.1371/journal.pone.0016128
48. Perpiñá, C., Botella, C., Banos, R., Marco, H., Alcaniz, M., and Quero, S. (1999). Body image and virtual reality in eating disorders: is exposure to virtual reality more effective than the classical body image treatment? Cyberpsychol. Behav. 2, 149-155.
49. Popescu, V G., Burdea, G. C., Bouzit, M., and Hentz, V R. (2000). A virtual-reality-based telerehabilitation system with force feedback. IEEE Trans. Inf. Technol. Biomed. 4, 45-51.
50. Rimmer, J. H., Wang, E., and Smith, D. (2008). Barriers associated with exercise and community access for individuals with stroke. J. Rehabil. Res. Dev. 45, 315-322.
51. Riva, G. (2008). From virtual to real body: virtual reality as embodied technology.J. Cyber Ther. Rehabil. 1, 7-22.
52. Robertson, J. V G., and Roby-Brami, A. (2010). "Augmented feedback, virtual reality and robotics for designing new rehabilitation methods," in Rethinking Physical and Rehabilitation Medicine: New Technologies Induce New Learning Strategies, eds J. P. Didier and E. Bigand (Paris: Springer), 222-245.
53. Sanchez-Vives, M. V., Spanlang, B., Frisoli, A., Bergamasco, M., and Slater, M. (2010). Virtual hand illusion induced by visuomotor correlations. PLoS ONE 5, e10381. doi:10.1371/journal.pone.0010381
54. Saposnik, G., and Levin, M. (2011). Virtual reality in stroke rehabilitation: a meta-analysis and implications for clinicians. Stroke 42, 1380-1386.
55. Slater, M. (2009). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos. Trans. R. Soc. Lond. B Biol. Sci. 364, 3549-3557.
56. Slater, M., Perez-Marcos, D., Ehrsson, H. H.,andSanchez-Vives,M.V. (2008). Towards a digital body: the virtual arm illusion. Front. Hum. Neurosci. 2:6. doi:10.3389/neuro.09.006.2008
57. Slater, M., Perez-Marcos, D., Ehrsson, H. H., and Sanchez-Vives, M. V. (2009). Inducing illusory ownership of a virtual body. Front. Neurosci. 3:2. doi:10.3389/neuro.01.029.2009
58. Slater, M., Spanlang, B., Sanchez-Vives, M. V., and Blanke, O. (2010). First person experience of body transfer in virtual reality. PLoS ONE 5, e10564. doi:10.1371/jour-nal.pone.0010564
59. Steed, A., and Oliveira, M. E (2009). Networked Graphics: Building Networked Games and Virtual Environments. San Francisco: Morgan Kauf-mann Publishers Inc.
60. Steptoe, W., Normand, J.-M., Oyekoya, O., Pece, F., Giannopoulos, E., Tec-chia, F., Steed, A., and Slater, M. (2012). Acting rehearsal in collaborative multimodal mixed reality environments. Presence (Camb.). (in press).
61. Steuer, J. (1992). Defining virtual reality - dimensions determining telepresence. J. Commun. 42, 73-93.
62. Subramanian, S., Knaut, L. A., Beau-doin, C., Mcfadyen, B. J., Feldman, A. G., and Levin, M. E (2007). Virtual reality environments for post-stroke arm rehabilitation. J. Neuro-eng. Rehabil. 4, 20.
63. Tachi, S., Watanabe, K., Takeshita, K., Minamizawa, K., Yoshida, T., and Sato, K. (2011). "Mutual telexis-tence surrogate system: TELESAR4 - telexistence in real environments using autostereoscopic immersive display," in IEEE Intelligent Robotics and Systems (IROS), San Francisco, CA.
64. Tang, J., Carignan, C., and Gattewar, S. (2005). "Virtual environment for robotic tele-rehabilitation," in 9th International Conference on Rehabilitation Robotics (ICORR 2005), Chicago, IL.
65. Tecchia, F., Carrozzino, M., Bacinelli, S., Rossi, F., Vercelli, D., Marino, G., Gasparello, P., and Bergamasco, M. (2010). A flexible framework for wide-spectrum VR development. Presence (Camb.) 19, 302-312.
66. Vespa, P. M., Miller, C., Hu, X., Nenov, V., Buxey, F., and Martin, N. A.(2007). Intensive care unit robotic telepresence facilitates rapid physician response to unstable patients and decreased cost in neuroin-tensive care. Surg Neurol. 67, 331-337.
67. Wagner, T. H., Lo, A. C., Peduzzi, P., Bravata, D. M., Huang, G. D., Krebs, H. I., Ringer, R. J., Federman, D. G., Richards, L. G., Haselkorn, J. K., Wittenberg, G. F., Volpe, B. T., Bever, C. T., Duncan, P. W., Siroka, A., and Guarino, P. D. (2011). An economic analysis of robot-assisted therapy for long-term upper-limb impairment after stroke. Stroke 42, 2630-2632.
68. Wolbrecht, E. T., Chan, V., Reinkens-meyer,D.J.,andBobrow,J.E. (2008). Optimizing compliant, model-based robotic assistance to promote neu-rorehabilitation. IEEE Trans. Neural Syst. Rehabil. Eng. 16, 286-297.