Exploring the bases for a mixed reality stroke rehabilitation system, Part I: A unified approach for representing action, quantitative evaluation, and interactive feedback

Journal of NeuroEngineering and Rehabilitation

Volumn 8, Issue 1, 2011, Pages

  Lehrer, Nicole ^a   Attygalle, Suneth ^a,b   Wolf, Steven L ^a,c   Rikakis, Thanassis ^a  

^a Arizona State University   (United States)

^b ARIZONA STATE UNIVERSITY   (United States)

^c EMORY UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COMPUTER INTERFACE; HUMAN; INSTRUMENTATION; LEARNING; METHODOLOGY; PHYSIOLOGY; PHYSIOTHERAPY; PRACTICE GUIDELINE; PSYCHOMOTOR PERFORMANCE; PSYCHOPHYSIOLOGY; STROKE;

BIOFEEDBACK, PSYCHOLOGY; GUIDELINES AS TOPIC; HUMANS; LEARNING; PHYSICAL THERAPY MODALITIES; PSYCHOMOTOR PERFORMANCE; STROKE; USER-COMPUTER INTERFACE;

EID: 80052134271     PISSN: None     EISSN: 17430003     Source Type: Journal    
DOI: 10.1186/1743-0003-8-51     Document Type: Review

References (82)

1. Motor learning: its relevance to stroke recovery and neurorehabilitation. Krakauer JW, Curr Opin Neurol 2006 19 84 90 10.1097/01.wco.0000200544.29915.cc 16415682 (Pubitemid 43172710)
2. Motor learning principles for physical therapy. Schmidt RA, Contemporary management of motor control problems: Proceedings of the II STEPConference: June 1991; Alexandria, Foundation for Physical Therapy, 1991 49 63
3. Therapeutic interventions to improve upper extremity recovery and function. Richards L, Pohl P, Clin Geriatr Med 1999 15 819 832 10499937 (Pubitemid 29521689)
4. Stroke rehabilitation: Strategies to enhance motor recovery. O'Dell MW, Lin CD, Harrison V, Annu Rev Med 2009 60 55 68 10.1146/annurev.med.60.042707. 104248 18928333
5. Mixed reality environments in stroke rehabilitation: interfaces across the real/virtual divide. Pridmore T, Green J, Hilton D, Eastgate R, Cobb S, Proceedings of the 5th International Conference on Disability, Virtual Reality & Associated Technology: 20-22 September 2004; Oxford 2004
6. Treatment interventions for the paretic upper limb of stroke survivors: a critical review. Barreca S, Wolf SL, Fasoli S, Bohannon R, Neurorehabil Neural Repair 2003 17 220 226 10.1177/0888439003259415 14677218 (Pubitemid 37421122)
7. Adapting an immersive virtual reality system for rehabilitation. Kizony R, Katz N, Weiss PL, J Visual Comput Animat 2003 14 261 268 10.1002/vis.323 (Pubitemid 40930251)
8. Training with computer-supported motor imagery in post-stroke rehabilitation. Gaggioli AMF, Walker R, Meneghini A, Alcaniz M, Lozano JA, Montesa J, Gil JA, Riva G, Cyberpsychol Behav 2004 7 327 332 10.1089/1094931041291312 15257833 (Pubitemid 38880147)
9. Motor rehabilitation using virtual reality. Sveistrup H, J Neuroeng Rehabil 2004 1 10 17 10.1186/1743-0003-1-10 15679945 (Pubitemid 40390053)
10. Virtual environments for motor rehabilitation: Review. Holden MK, Cyberpsychol Behav 2005 8 187 211 10.1089/cpb.2005.8.187 15971970 (Pubitemid 40847797)
11. Virtual environment training therapy for arm motor rehabilitation. Piron L, Tonin P, Piccione F, Iaia V, Trivello E, Dam M, Presence 2005 14 732 740 10.1162/105474605775196580
12. Tailoring virtual reality technology for stroke rehabilitation: a human factors design. Jung Y, Yeh S, Stewart J, Proceedings of ACM CHI 2006 Conference on Human Factors in Computing Systems 22-27 April 2006; Monteal, Mads Soegaard, 2006 929 934
13. The Rutgers Arm, a rehabilitation system in virtual reality: a pilot study. Kuttuva M, Boian R, Merians A, Burdea G, Bouzit M, Lewis J, Fensterheim D, Cyberpsychol Behav 2006 9 148 151 10.1089/cpb.2006.9.148 16640468
14. Virtual reality environments for post-stroke arm rehabilitation. Subramanian S, Knaut LA, Beaudoin C, McFadyen BJ, Feldman AG, Levin MF, J Neuroeng Rehabil 2007 4 20 24 10.1186/1743-0003-4-20 17587441 (Pubitemid 47074675)
15. Explicit information interferes with implicit motor learning of both continuous and discrete movement tasks after stroke. Boyd LA, Winstein CJ, J Neurol Phys Ther 2006 30 46 57 16796767
16. Technology-assisted training of arm-hand skills in stroke: Concepts on reacquisition of motor control and therapist guidelines for rehabilitation technology design. Timmermans AA, Seelen HA, Willmann RD, Kingma H, J Neuroeng Rehabil 2009 6 1 10.1186/1743-0003-6-1 19154570
17. Improvement of arm movement patterns and endpoint control depends on type of feedback during practice in stroke survivors. Cirstea MC, Levin MF, Neurorehabil Neural Repair 2007 21 398 411 10.1177/1545968306298414 17369514 (Pubitemid 47246436)
18. Paretic upper-limb strength best explains arm activity in people with stroke. Harris JE, Eng JJ, Phys Ther 2007 87 88 97 10.2522/ptj.20060065 17179441 (Pubitemid 46048014)
19. Where the Action Is: The Foundations of Embodied Interaction. Dourish P, Cambridge: The MIT Press 2004
20. Embodied Mind: Cognitive Science and Human Experience. Varela FI, Thompson E, Rosch E, Cambridge: The MIT Press 1992
21. On Phenomenology and Social Relations. Schutz A, Chicago: University of Chicago Press 1970
22. The emergence of repetitive task practice in upper extremity neurorehabilitation of patients with stroke: A critical review of constraint induced movement therapy and mechanisms related to TMS. Wolf SL, Blanton S, Baer H, Breshears J, Butler AJ, Neurologist 2002 8 325 38 10.1097/00127893- 200211000-00001 12801434
23. The cortical motor system. Rizzolatti G, Luppino G, Neuron 2001 31 889 901 10.1016/S0896-6273(01)00423-8 11580891 (Pubitemid 32925277)
24. What do motor "recovery" and "compensation" mean in patients following stroke? Levin MF, Kleim JA, Wolf SL, Neurorehabil Neural Repair 2009 23 313 319 19118128
25. Towards integrative neurorehabilitation science. Kwakkel G, Physiother Res Int 2009 14 137 146 10.1002/pri.446 19634129
26. Perception and action planning. Prinz W, Eur J Cogn Psychol 1997 9 129 154 10.1080/713752551 (Pubitemid 127440315)
27. Principles derived from the study of simple skills do not generalize to complex skill learning. Wulf G, Shea C, Psychon Bull Rev 2002 9 185 211 10.3758/BF03196276 12120783
28. A common coding approach to perception and action. Prinz W, Relationships between Perception and Action Berlin: Springer, Neumann O, Prinz W, 1990 167 201
29. Spatial control of arm movements. Morasso P, Exp Brain Res 1981 42 223 227 7262217 (Pubitemid 11147291)
30. Human arm trajectory formation. Abend W, Bizzi E, Morasso P, Brain 1982 105 331 348 10.1093/brain/105.2.331 7082993 (Pubitemid 12002848)
31. Hand orientation for grasping and arm joint rotation patterns in healthy subjects and hemiparetic stroke patients. Roby-Brami A, Jacobs S, Bennis N, Levin MF, Brain Res 2003 969 217 229 10.1016/S0006-8993(03)02334-5 12676382 (Pubitemid 36369629)
32. Compensatory strategies for reaching in stroke. Cirstea MC, Levin MF, Brain 2000 123 940 953 10.1093/brain/123.5.940 10775539 (Pubitemid 30224190)
33. Reaching and grasping strategies in hemiparetic patients. Roby-Brami A, Fuchs S, Mokhtari M, Bussel B, Motor Control 1997 1 72 91
34. Clinical interpretation and use of stroke scales. Kasner S, Lancet Neurol 2006 5 603 612 10.1016/S1474-4422(06)70495-1 16781990 (Pubitemid 43867434)
35. A Computational Framework for Quantitative Evaluation of Movement during Rehabilitation. Chen Y, Duff M, Lehrer N, Sundaram H, He J, Wolf SL, Rikakis T, International Symposium on Computational Models for Life Sciences Tokyo, Japan 2011 22 24
36. Adaptive Mixed Reality Stroke Rehabilitation: System Architecture and Evaluation Metrics. Chen Y, Lehrer N, Sundaram H, Rikakis T, Proceedings of the first annual ACM SIGMM conference on Multimedia systems (MMSys '10) 22-23 Feb 2010; Scottsdale 2010 293 304
37. What makes things fun to learn? A study of intrinsically motivating computer games. Malone TW, Ph.D. thesis Stanford University, Psychology Department 1980
38. Seriously considering play: Designing interactive learning environments based on the blending of microworlds, simulations, and games. Rieber LP, Educ Tech Res 1996 44 43 58
39. Literature review in learning with tangible technologies, Report 12. O'Malley C, Fraser DS, Literature Review Series Bristol: NESTA FutureLab Publications 2005
40. SMALLab: A mediated platform for education. Birchfield D, Ciufo T, Minyard G, Proceedings of SIGGRAPH Educators Program: 30 July-3 August 2006; Boston ACM Press 2006 rticle No 33
41. Interactive multimodal learning environments: Special issue on interactive learning environments: Contemporary issues and trends. Moreno R, Mayer R, Educ Psychol Rev 2007 19 309 326 10.1007/s10648-007-9047-2
42. Virtual reality, disability and rehabilitation. Wilson PN, Foreman N, Stanton D, Disabil Rehabil 1997 19 213 220 10.3109/09638289709166530 9195138 (Pubitemid 27254861)
43. Pragmatism and Art: Tools for Change. White JH, Studies in Art Education 1998 39 215 229 10.2307/1320365
44. Constraint-induced movement therapy. A new family of techniques with broad application to physical rehabilitation-A clinical review. Taub E, Uswatte G, Pidikiti RD, J Rehab Res Dev 1999 36 237 251
45. From presence to consciousness through virtual reality. Sanchez-Vives MV, Slater M, Nat Rev Neurosci 2005 6 332 339 10.1038/nrn1651 15803164 (Pubitemid 40476099)
46. An investigation of presence response across variations in visual realism. Vinayagamoorthy V, Brogni A, Gillies M, Slater M, Steed A, Proceedings of the 7th International Conference on Presence: 13-15 October 2004; Valencia 2004 148 155
47. Motor rehabilitation and brain plasticity after hemiparetic stroke. Schaechter JD, Prog Neurobiol 2004 73 61 72 10.1016/j.pneurobio.2004.04.001 15193779 (Pubitemid 38749091)
48. Principles of experience-dependent neural plasticity: Implications for rehabilitation after brain damage. Kleim JA, Jones TA, J Speech Lang Hear Res 2008 51 225 239 10.1044/1092-4388(2008/018) 18230848 (Pubitemid 351206588)
49. Explicit information interferes with implicit motor learning of both continuous and discrete movement tasks after stroke. Boyd L, Winstein C, J Neurol Phys Ther 2006 30 46 57 16796767
50. Learning implicitly: effects of task and severity after stroke. Boyd LA, Quaney BM, Pohl PS, Winstein CJ, Neurorehabil Neural Repair 2007 21 444 454 10.1177/1545968307300438 17416874 (Pubitemid 47246431)
51. Rhythmic movement is attracted more strongly to auditory than to visual rhythms. Repp BH, Penel A, Psychol Res 2004 68 252 270 12955504 (Pubitemid 40549799)
52. Thaut M, Rhythm, Music, and the Brain: Scientific Foundations and Clinical Applications New York: Routledge 2007
53. Levitin DJ, This Is Your Brain on Music: The Science of a Human Obsession New York: Dutton Adult 2006
54. Motor task variation induces structural learning. Braun DA, Aertsen A, Wolpert DM, Mehring C, Curr Biol 2009 19 352 357 10.1016/j.cub.2009.01.036 19217296
55. Schmidt RA, Wrisberg CA, Motor Learning and Performance: A Problem Based Learning Approach Champaign Human Kinetics Second 2008
56. Immediate perceptual response to intersensory discrepancy. Welch RB, Warren DH, Psychol Bull 1980 88 638 667 7003641
57. Multisensory integration: Maintaining the perception of synchrony. Spence C, Squire SB, Curr Biol 2003 13 519 R521 10.1016/S0960-9822(03)00445-7 12842029 (Pubitemid 36815250)
58. The roles of vision and proprioception in the planning of reaching movements. Sarlegna FR, Sainburg RL, Progress in motor control: A multidisciplinary approach New York: Springer 2008 317 335
59. Learning Bayesian priors for depth perception. Knill DC, J Vis 2007 7 1 20 18254179
60. 3-D Depth Reconstruction from a Single Still Image. Saxena A, Chung SH, Ng AY, Int J Comput Vis 2008 76 53 69 (Pubitemid 350234087)
61. Art and Visual Perception. Arnheim R, Berkeley: University of California Press 1974
62. Goal-directed and stimulus-driven determinants of attentional control. Yantis S, Attention and Performance XVIII Cambridge: MIT Press, Driver SMJ, 2000 73 103
63. Listening to musical rhythms recruits motor regions of the brain. Chen JL, Penhune VB, Zatorre RJ, Cereb Cortex 2008 18 2844 2854 10.1093/cercor/bhn042 18388350
64. Conventional rhythms enhance infants' and adults' perception of musical patterns. Trehub SE, Hannon EE, Cortex 2009 45 110 118 10.1016/j.cortex.2008.05. 012 19058799
65. Rhythmic facilitation of gait training in hemiparetic stroke rehabilitation. Thaut MH, McIntosh GC, Rice RR, J Neurol Sci 1997 151 207 212 10.1016/S0022-510X(97)00146-9 9349677 (Pubitemid 27421853)
66. Siegmeister E, Harmony and Melody Belmont: Wadsworth 1965
67. Ratner LG, Music: The Listener's Art New York: McGraw Hill 2 1966 21835531
68. Piston W, Harmony Revised and expanded by De Voto M. New York: Norton 4 1978
69. Music as a source of emotion in film. Cohen AJ, Music and emotion: Theory and research Oxford: Oxford University Press, Juslin PN, Sloboda JA, 2001 249 272
70. Expectation in music: investigation of melodic and harmonic processes. Schmuckler MA, Music Percept 1989 7 109 150
71. Grasping at 'thin air': multimodal contact cues for reaching and grasping. Zahariev MA, MacKenzie CL, Exp Brain Res 2007 180 69 84 10.1007/s00221-006-0845-4 17242914 (Pubitemid 46870493)
72. Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects. Johansson RS, Westling G, Exp Brain Res 1984 56 550 564 6499981 (Pubitemid 14022783)
73. Media Adaptation Framework in Biofeedback System for Stroke Patient Rehabilitation. Chen Y, Xu W, Sundaram H, Rikakis T, Liu SM, Proceedings of the ACM 15th international conference on Multimedia: 23-29 September 2007; Augsburg 2007 47 57
74. The interaction of explicit and implicit learning: An integrated model. Slusarz P, Sun R, Proceedings of the 23rd Annual Conference of the Cognitive Science Society: 1-4 August 2001; Edinburgh, Erlbaum Associates, 2001 952 957
75. Directing attention to movement effects enhances learning: A review. Wulf G, Prinz W, Psychon Bull Rev 2001 8 648 660 10.3758/BF03196201 11848583 (Pubitemid 33604216)
76. Multimodal archiving, real-time annotation and information visualization in a biofeedback system for stroke patient rehabilitation. Xu W, Chen Y, Sundaram H, Rikakis T, Proceedings of CARPE 2006: The Third Workshop on Continuous Archival and Retrieval of Personal Experiences: 23- 27 October 2006; Santa Barbara., Kenji Mase: Nagoya University, 2006 3 12 (Pubitemid 47154839)
77. Feedforward and feedback processes in motor control. Seidler RD, Noll DC, Thiers G, Neuroimage 2004 22 1775 1783 10.1016/j.neuroimage.2004.05.003 15275933 (Pubitemid 38962665)
78. McAdams S, Bigand E, Thinking in Sound: The Cognitive Psychology of Human Audition Oxford: Clarendon Press 1993
79. Jaques-Dalcroze E, The Eurhythmics of Jaques-Dalcroze Rockville: Wildside Press 2007
80. Chion M, Gorbman C, Murch W, Audio-Vision New York: Columbia University Press 1994
81. Exploring the bases for a mixed reality stroke rehabilitation system, Part II: Design of interactive feedback for upper limb rehabilitation. Lehrer N, Chen Y, Duff M, Wolf SL, Rikakis T, J Neuroeng Rehabil 2011 8 54 21899779
82. Mixed Reality for Rehabilitation Group Website. http://ame2.asu.edu/ projects/mrrehab/