Design of a modular and low-latency virtual-environment platform for applications in motor adaptation research, neurological disorders, and neurorehabilitation

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Volumn 16, Issue 3, 2008, Pages 298-309

  Myall, Daniel J ^a,b   MacAskill, Michael R ^a,b   Davidson, Paul R ^c   Anderson, Tim J ^a,b,d   Jones, Richard D ^a,b,d,e  

^a Van der Veer Institute New Zealand   (New Zealand)

^b UNIVERSITY OF OTAGO   (New Zealand)

^c SLI Systems   (New Zealand)

^d CANTERBURY DISTRICT HEALTH BOARD   (New Zealand)

^e UNIVERSITY OF CANTERBURY   (New Zealand)

Author keywords

Calibration; Motor adaptation; Neurological disorders; Parkinson's disease; Rehabilitation; Virtual reality

Indexed keywords

ARCHITECTURAL DESIGN; COMPUTER NETWORKS; COMPUTER PROGRAMMING LANGUAGES; COMPUTER SOFTWARE; EXPERIMENTS; GRAPHIC METHODS; MARKUP LANGUAGES; MOTORS; NEUROMUSCULAR REHABILITATION; PATIENT REHABILITATION; VIRTUAL REALITY; WIRELESS SENSOR NETWORKS;

ACCURATE CALIBRATION; CONFIGURATION FILES; ELECTROMAGNETIC TRACKERS; HEAD-MOUNTED DISPLAY (HMD); INPUT DEVICES; LOW LATENCY; MOTOR ADAPTATION; MOTOR CONTROLS; NETWORKED COMPUTERS; NEURO REHABILITATION; NEUROLOGICAL DISORDERS; OPEN SOURCE LIBRARIES; OPEN SOURCES; OPENSCENEGRAPH (OSG); POSITION TRACKER; POW ERFUL TOOL; REHABILITATION (CONSTRUCTION); SYSTEM SOFTWARES; VIRTUAL ENVIRONMENT (VE); VISUAL DISPLAYS;

DISPLAY DEVICES;

ARTICLE; COMPUTER PROGRAM; DISPLAY SYSTEM; MOTOR CONTROL; NEUROLOGIC DISEASE; PRIORITY JOURNAL; VIRTUAL REALITY;

BIOMEDICAL RESEARCH; ENVIRONMENT; EQUIPMENT DESIGN; EQUIPMENT FAILURE ANALYSIS; HUMANS; MOVEMENT; NERVOUS SYSTEM DISEASES; SYSTEMS INTEGRATION; USER-COMPUTER INTERFACE;

EID: 45149127795     PISSN: 15344320     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSRE.2008.922676     Document Type: Article

References (42)

1. C. Cruz-Neira, D. J. Sandin, and T. A. DeFanti, "Surround-screen projection-based virtual reality: The design and implementation of the CAVE," in Proc. ACM SIGGRAPH (Computer Graphics), New York, Jul. 1993, pp. 135-142.
2. G. Welch and E. Foxlin, "Motion tracking: No magic bullet, but a respectable arsenal," IEEE Comput. Graph., vol. 22, no. 6, pp. 24-38, Nov. 2002.
3. M. K. Holden, "Neurorehabilitation using 'learning by imitation' in virtual environments," in Usability Evaluation Interface Design: Cognitive Engineering, Intelligent Agents Virtual Reality: Proc. HCI Int. 2001, J. Smith, G. Salvendy, D. Harris, and R. Koubek, Eds. London, U.K.: Lawrence Erlbaum , 2001, vol. 1, pp. 624-628.
4. J. Groen and P. J. Werkhoven, "Visuomotor adaptation to virtual hand position in interactive virtual environments," Presense-Teleop. Virt., vol. 7, pp. 429-446, Oct. 1998.
5. H. Bergman and G. Deuschl, "Pathophysiology of Parkinson's disease: From clinical neurology to basic neuroscience and back," Movement Disorders, vol. 17, pp. S28-S40, Mar. 2002.
6. T. C. Rubinstein, N. Giladi, and J. M. Hausdorff, "The power of cueing to circumvent dopamine deficits: A review of physical therapy treatment of gait disturbances in Parkinson's disease," Movement Disorders, vol. 17, no. 6, pp. 1148-1160, Nov. 2002.
7. J. Prothero, "The treatment of akinesia using virtual images," M.S. thesis, Human Interface Technol. Lab., Univ. Washington, Seattle, 1993.
8. T. Riess and S. Weghorst, "Augmented reality in the treatment of parkinson's disease," in Proc. Medicine Meets Virtual Reality III, K. Morgan, R. M. Satava, H. B. Sieburg, R. Mattheus, and J. P. Christensen, Eds., Amsterdam, The Netherlands, 1995, pp. 298-302, IOS Press.
9. S. Weghorst, J. Prothero, and T. Furness, "Virtual images in the treatment of Parkinson's disease akinesia," in Proc. Medicine Meets Virtual Reality II, San Diego, CA, Jan. 1994, pp. 242-243.
10. J. Mulder and R. van Liere, "The personal space station: Bringing interaction within reach," in Proc. Virtual Reality Int. Conf., VRIC 2002, S. Richer, P. Richard, and B. Taravel, Eds., Jun. 2002, pp. 73-81 [Online]. Available: citeseer.ist.psu.edu/625639.html
11. C. Swindells, J. Dill, and K. Booth, "System lag tests for augmented and virtual environments," in Proc. 13th Ann. ACM Symp. User Interface Software Technol., New York, Nov. 2000, pp. 161-170.
12. M. Meehan, S. Razzaque, M. Whitton, and F. J. Brooks, "Effect of latency on presence in stressful virtual environments," in Proc. IEEE Virtual Reality, Los Angeles, CA, Mar. 2003, pp. 141-148.
13. R. Held, A. Efstathiou, and M. Greene, "Adaptation to displaced and delayed visual feedback from the hand," J. Exp. Psychol., vol. 72, pp. 887-891, Dec. 1966.
14. S. Kitazawa, T. Kohno, and T. Uka, "Effects of delayed visual information on the rate and amount of prism adaptation in the human," J. Neurosci., vol. 15, pp. 7644-7652, Nov. 1995.
15. R. Held and N. Durlach, "Telepresence, time delay and adaptation," in Pictorial Communication in Virtual and Real Environments, S. R. Ellis, M. K. Kaiser, and A. J. Grunwald, Eds. London, U.K.: Taylor Francis, 1991, pp. 232-246.
16. F. Brooks, "What's real about virtual reality," IEEE Comput. Graph., vol. 19, no. 6, pp. 16-27, Nov. 1999.
17. B. J. Bowerman and R. T. O'Connell, Forecasting and Time Series an Applied Approach. Belmont, CA: Wadsworth, 1993.
18. J. LaViola, "Double exponential smoothing: An alternative to Kalman filter-based predictive tracking," in Proc. Immersive Projection Technol. Virtual Environ., New York, May 2003, pp. 199-206, NY: ACM Press.
19. J. LaViola, "An experiment comparing double exponential smoothing and Kalman filter-based predictive tracking algorithms," in Proc. IEEE Virtual Reality, Los Alamitos, CA, Mar. 2003, pp. 283-284.
20. J. Wu and M. Ouhyoung, "On latency compensation and its effects on head-motion trajectories in virtual environments," Visual Comput., vol. 16, no. 2, pp. 79-90, Mar. 2000.
21. T. von Wiegand, D. Schloerb, and W. Sachtler, "Virtual workbench: Near-Field virtual environment system with applications," Presence-Teleop. Virt. Environ., vol. 8, no. 5, pp. 492-519, Oct. 1999.
22. A. Bierbaum, C. Just, P. Hartling, K. Meinert, A. Baker, and C. Cruz-Neira, "VR Juggler: A virtual platform for virtual reality application development," in Proc. IEEE Virtual Reality, Los Alamitos, CA, Mar. 2001, pp. 89-96.
23. R. Taylor, T. Hudson, A. Seeger, H. Weber, J. Juliano, and A. Helser, M. Green, C. Shaw, and W. Wang, Eds., "VRPN: A device-independent, network-transparent VR peripheral system," in Proc. ACM Symp. Virtual Reality Software Technol., New York, Nov. 2001, pp. 55-61.
24. Virtual reality peripheral network (VRPN) [Online]. Available: http://www.cs.unc.edu/Research/vrpn/
25. M. Folk, A. Cheng, and R. McGrath, D. Mehringer, R. Plante, and D. Roberts, Eds., "HDF5: A new file format and I/O library for scientific data management," in Proc. Astronomical Data Anal. Software Syst. VIII, San Francisco, CA, Nov. 1999, vol. 172.
26. M. Galassi, J. Davies, B. G. J. Theiler, G. Jungman, M. Booth, and F. Rossi, GNU Scientific Library Reference Manual, 2nd ed. Bristol, U.K.: Network Theory, 2005.
27. J. Smart et al., wxWidgets 2005 [Online]. Available: http://www.wxwidgets.org
28. Movement and virtual environment laboratory (MoVELab) [Online]. Available: http://www.movelab.org/
29. V. Kindratenko, "Calibration of electromagnetic tracking devices," Virtual Reality, vol. 4, pp. 139-150, Jun. 1999.
30. Y. Shirakura, M. MacAskill, N. McGrane, M. Khashram, and T. Anderson, "Predictive eye and arm movement in Parkinson's disease," in Proc. Australian Winter Conf. Brain Res., Aug. 2006 [Online]. Available: http://www.psy.otago.ac.nz/awcbr/Abstracts/Abstracts2006.htm#Shirakura
31. C. Schmandt, "Spatial input/display correspondence in a stereoscopic computer graphic work station," in SIGGRAPH Comput. Graph., New York, Jul. 1983, pp. 253-261.
32. H. A. Ingram, P. van Donkelaar, J. Cole, J. L. Vercher, G. M. Gauthier, and R. C. Miall, "The role of proprioception and attention in a visuomotor adaptation task," Exp. Brain Res., vol. 132, no. 1, pp. 114-126, May 2000.
33. J. A. Saunders and D. C. Knill, "Humans use continuous visual feedback from the hand to control fast reaching movements," Exp. Brain Res., vol. 152, no. 3, pp. 341-352, May 2003.
34. T. Poston and L. Serra, "Dextrous virtual work," Commun. ACM, vol. 39, no. 5, pp. 37-45, May 1996.
35. S. J. Goodbody and D. M. Wolpert, "Temporal and amplitude generalization in motor learning," J. Neurophysiol., vol. 79, no. 4, pp. 1825-1838, Apr. 1998.
36. V. Summers, K. Booth, T. Calvert, E. Graham, and C. MacKenzie, "Calibration for augmented reality experimental testbeds," in Proc. 1999 Symp. Interactive 3-D Graph., New York, Apr. 1999, pp. 155-162.
37. R. van Liere and J. Mulder, "Virtual reality on a Linux desktop," presented at the NLUUG, Ede, The Netherlands, Oct. 2002 [Online]. Available: citeseer.ist.psu.edu/562052.html
38. M. K. Holden, "Virtual environments for motor rehabilitation: Review," Cyberpsychol. Behav., vol. 8, no. 3, pp. 187-211, Jun. 2005, discussion 212-219.
39. M. K. Holden, T. A. Dyar, and L. Dayan-Cimadoro, "Telerehabilitation using a virtual environment improves upper extremity function in patients with stroke," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 15, no. 1, pp. 36-42, Mar. 2007.
40. A. S. Merians, D. Jack, R. Boian, M. Tremaine, G. C. Burdea, S. V. Adamovich, M. Recce, and H. Poizner, "Virtual reality-augmented rehabilitation for patients following stroke," Phys. Therapy, vol. 82, no. 9, pp. 898-915, Sep. 2002.
41. T. N. Chase, "Levodopa therapy: Consequences of nonphysiologic replacement of dopamine," Neurology, vol. 50, pp. S17-S25, May 1998.
42. Y. Baram, J. Aharon-Peretz, Y. Simionovici, and L. Ron, "Walking on virtual tiles," Neural Process. Lett., vol. 16, no. 3, pp. 227-233, Dec. 2002.