Iterative learning control in health care: Electrical stimulation and robotic-assisted upper-limb stroke rehabilitation

IEEE Control Systems

Volumn 32, Issue 1, 2012, Pages 18-43

  Freeman, Chris T ^a   Rogers, Eric ^a   Hughes, Ann Marie ^a   Burridge, Jane H ^a   Meadmore, Katie L ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CLINICAL TRIAL; ELECTRICAL STIMULATIONS; IMPROVE PERFORMANCE; ITERATIVE CONTROL; ITERATIVE LEARNING CONTROL; MODEL BASED APPROACH; STROKE REHABILITATION; VOLUNTARY CONTRIBUTIONS; BLOOD CLOTS; LEARNING TO PLAY; SPARE CAPACITY; UPPER LIMBS; VESSEL RUPTURE;

HEALTH CARE; NEUROMUSCULAR REHABILITATION; NEURONS; SENSORY FEEDBACK;

TWO TERM CONTROL SYSTEMS; BLOOD;

EID: 84865387285     PISSN: 1066033X     EISSN: None     Source Type: Journal    
DOI: 10.1109/MCS.2011.2173261     Document Type: Review

References (73)

1. J. J. M. F. van der Putten, J. C. Hobart, J. A. Freeman, and A. J. Thompson, "Measuring change in disability after inpatient rehabilitation: Comparison of the responsiveness of the Barthel index and the functional independence measure," J Neurol. Neurosurg. Psychiatry, vol. 66, no. 4, pp. 480-484, 1999.
2. H. T. Hendricks, J. van Limbeek, A. C. Geurts, and M. J. Zwarts, "Motor recovery after stroke: A systematic review of the literature," Arch. Phys. Med. Rehab., vol. 83, no. 11, pp. 1629-1637, 2002.
3. National Audit Office. (2004). Reducing brain damage: Faster access to better stroke care. HC 452 [Online]. Available: http://www.nao.org.uk/ publications/0506/reducing-brain-damage.aspx
4. C. J. Winstein, D. K. Rose, S. M. Tan, R. Lewthwaite, H. C. Chui, and S. P. Azen, "A randomized controlled comparison of upper-extremity rehabilitation strategies in acute stroke: A pilot study of immediate and long-term outcomes," Arch. Phys. Med. Rehab., vol. 85, no. 4, pp. 620-628, 2004. (Pubitemid 38881052)
5. R. A. McGill, Motor Learning - Concepts and Applications. New York: McGraw-Hill, 1998.
6. J. R. De Kroon, M. J. Ijzerman, J. J. Chae, G. J. Lankhorst, and G. Zilvold, "Relation between stimulation characteristics and clinical outcome in studies using electrical stimulation to improve motor control of the upper extremity in stroke," J. Rehab. Med., vol. 37, no. 2, pp. 65-74, 2005. (Pubitemid 40439460)
7. V. M. Pomeroy, L. King, A. Pollack, A. Baily-Hallon, and P. Longhorne. (2006). Electrostimulation for promoting recovery of movement or functional ability after stroke. Cochrane Database Syst. Rev. [Online]. (2). Available: http://onlinelibrary.wiley.com/o/cochrane/clsysrev/articles/CD003241/frame.html
8. G. B. Prange, M. A. Jannick, C. G. M. Groothuis-Oudshoorn, H. Hermens, and M. J. Ijzerman, "Systematic review of the effect of robot-aided therapy on recovery of the hemiparetic arm after stroke," J. Rehab. Res. Dev., vol. 43, no. 2, pp. 171-184, 2006.
9. G. Kwakkel, B. J. Kollen, and H. I. Krebs, "Effects of robot-assisted therapy on upper limb recovery after stroke: A systematic review," Neurorehab. Neural Repair, vol. 22, no. 2, pp. 111-121, 2008. (Pubitemid 351287594)
10. Intercollegiate Working Party for Stroke, National Clinical Guidelines for Stroke. London: Royal College of Physicians, 2004.
11. J. R. de Kroon, J. H. van der Lee, M. J. Izerman, and G. J. Lankhorst, "Therapeutic electrical stimulation to improve motor control and functional abilities of the upper extremity after stroke: A systematic review," Clin. Rehab., vol. 16, no. 4, pp. 350-360, 2002.
12. J. H. Burridge and M. Ladouceur, "Clinical and therapeutic applications of neuromuscular stimulation: A review of current use and speculation into future developments," Neuromodulation, vol. 4, no. 4, pp. 147-154, 2001.
13. R. A. Schmidt and T. D. Lee, "Motor learning," in Motor Control and Learning: A Behavioral Emphasis, Part 3. Human Kinetics. Champaign, IL: Human Kinetics Publishers, 1999, pp. 261-285.
14. D. N. Rushton, "Functional electrical stimulation and rehabilitation - An hypothesis," Med. Eng. Phys., vol. 25, no. 1, pp. 75-78, 2003.
15. D. Zhang, T. H. Guan, F. Widjaja, and W. T. Ang, "Functional electrical stimulation in rehabilitation engineering: A survey," in Proc. Convention Rehabilitation Engineering and Assistive Technology, Singapore, 2007, pp. 221-226.
16. K. J. Hunt, M. Munih, and N. de Donaldson, "Feedback control of unsupported standing in paraplegia - Part I: Optimal control approach," IEEE Trans. Rehab. Eng., vol. 5, no. 4, pp. 331-340, 1997. (Pubitemid 28015663)
17. K. J. Hunt, R. P. Jaime, and H. Gollee, "Robust control of electrically-stimulated muscle using polynomial H∞ design," Control Eng. Pract., vol. 9, no. 3, pp. 313-328, 2001. (Pubitemid 32258778)
18. R. Davoodi and B. J. Andrews, "Computer simulation of FES standing up in paraplegia: A self-adaptive fuzzy controller with reinforcement learning," IEEE Trans. Rehab. Eng., vol. 6, no. 2, pp. 151-161, 1998. (Pubitemid 28268638)
19. S. Jezernik, R. G. V. Wassink, and T. Keller, "Sliding mode closed-loop control of FES: Controlling the shank movement," IEEE Trans. Biomed. Eng., vol. 51, no. 2, pp. 263-272, 2004. (Pubitemid 38133606)
20. F. Previdi, T. Schauer, S. M. Savaresi, and K. J. Hunt, "Data-driven control design for neuroprotheses: A virtual reference feedback tuning (VRFT) approach," IEEE Trans. Control Syst. Technol., vol. 12, no. 1, pp. 176-182, 2004.
21. T. Watanabe, K. Iibuchi, K. Kurosawa, and N. Hoshimiya, "A method of multichannel PID control of two-degree-of-freedom wrist joint movements by functional electrical stimulation," Syst. Comput. Jpn., vol. 34, no. 5, pp. 319-328, 2003.
22. N. Lan, H. Q. Feng, and P. E. Crago, "Neural network generation of muscle stimulation patterns for control of arm movements," IEEE Trans. Rehab. Eng., vol. 2, no. 4, pp. 213-224, 1994.
23. P. Tresadern, S. Thies, L. O. Kenney, D. Howard, and J. Y. Goulermas, "Artificial neural network prediction using accelerometers to control upper limb FES during reaching and grasping following stroke," in Proc. 28th Annu. Int. Conf. IEEE Engineering in Medicine and Biology Society, 2006, pp. 2916-2919.
24. G. Graupe and H. Kordylewski, "Neural network control of neuromuscular stimulation in paraplegics for independent ambulation," in Proc. 19th Annu. Int. Conf. IEEE Engineering in Medicine and Biology Society, 1997, pp. 1088-1091.
25. G. P. Bratz, R. M. Smith, and G. M. Davis, "Designing an FES control algorithm: Important considerations," in Proc. World Congr. Medical Physics and Biomedical Engineering, Seoul, Korea, 2006, pp. 2848-2851.
26. C. L. Lynch and M. R. Popovic, "Functional electrical stimulation: Closed-loop control of induced muscle contractions," IEEE Control Syst. Mag., vol. 28, no. 4, pp. 40-50, 2008.
27. J. R. de Kroon and M. J. Ijzerman, "Electrical stimulation of the upper extremity in stroke: Cyclic versus EMG-triggered stimulation," Clin. Rehab., vol. 22, no. 8, pp. 690-697, 2008.
28. R. Thorsen, R. Spadone, and M. Ferrarin, "A pilot study of myoelectrically controlled FES of upper extremity," IEEE Trans. Neural Syst. Rehab. Eng., vol. 9, no. 2, pp. 161-168, 2001. (Pubitemid 33035530)
29. L. L. Baker, D. R. McNeal, L. A. Benton, B. R. Bowman, and R. L. Waters, Neuromuscular Electrical Stimulation: A Practical Guide, 3rd ed. Rancho Los Amigos Medical Center, 1993.
30. C. T. Freeman, A.-M. Hughes, J. H. Burridge, P. H. Chappell, P. L. Lewin, and E. Rogers, "A model of the upper extremity using FES for stroke rehabilitation," J. Biomech., vol. 131, no. 3, pp. 031011-1-031011-12, 2009.
31. C. T. Freeman, A.-M. Hughes, J. H. Burridge, P. H. Chappell, P. L. Lewin, and E. Rogers, "Iterative learning control of FES applied to upper extremity for rehabilitation," Control Eng. Pract., vol. 17, no. 3, pp. 368-381, 2009.
32. A.-M. Hughes, C. T. Freeman, J. H. Burridge, P. H. Chappell, P. L. Lewin, and E. Rogers, "Feasibility of iterative learning control mediated by functional electrical stimulation for reaching after stroke," Neurorehab. Neural Repair, vol. 23, no. 6, pp. 559-568, 2009.
33. T. Seel, T. Schauer, and J. Raisch, "Iterative learning control for variable pass length systems," in Proc. 18th IFAC World Congr., Milan, Italy, 2011, pp. 4880-4885.
34. H. Nahrstaedt, T. Schauer, S. Hesse, and J. Raisch, "Iterative learning control of a gait neuroprosthesis," Automatisierungstechnik, vol. 56, no. 9, pp. 494-501, 2008.
35. J. Bae and M. Tomizuka, "A gait rehabilitation strategy inspired by an iterative learning algorithm," in Proc. 18th IFAC World Congr., Milan, Italy, 2011, pp. 2857-2864.
36. C. T. Freeman, A.-M. Hughes, J. H. Burridge, P. H. Chappell, P. L. Lewin, and E. Rogers, "A robotic workstation for stroke rehabilitation of the upper extremity using FES," Med. Eng. Phys., vol. 31, no. 3, pp. 364-373, 2009.
37. A.-M. Hughes, C. T. Freeman, J. H. Burridge, P. H. Chappell, P. L. Lewin, and E. Rogers, "Shoulder and elbow muscle activity during fully supported trajectory tracking in people who have had a stroke," J. Electromyogr. Kinesiol., vol. 20, no. 3, pp. 465-476, 2010.
38. F. Le, I. Markovsky, C. T. Freeman, and E. Rogers, "Identification of electrically stimulated muscle models of stroke patients," Control Eng. Pract., vol. 18, no. 4, pp. 396-407, 2010.
39. D. Popovic and M. Popovic, "Tuning of a nonanalytical hierarchical control system for reaching with FES," IEEE Trans. Bio-Med. Eng., vol. 45, no. 2, pp. 203-212, 1998. (Pubitemid 28128239)
40. P. E. Crago, R. J. Nakai, and H. J. Chizeck, "Feedback regulation of hand grasp opening and contact force during stimulation of paralysed muscle," IEEE Trans. Bio-Med. Eng., vol. 38, no. 1, pp. 17-28, 1991.
41. H. J. Chizeck, N. Lan, L. S. Palmieri, and P. E. Crago, "Feedback control of electrically stimulated muscle using simultaneous pulse width and stimulus period modulation," IEEE Trans. Bio-Med. Eng., vol. 38, no. 12, pp. 1224-1234, 1991.
42. M. S. Hatwell, B. J. Oderkerk, C. A. Sacher, and G. F. Inbar, "Patient-driven control of FES supported standing up: A simulation study," IEEE Trans. Rehab. Eng., vol. 36, no. 6, pp. 683-691, 1991.
43. A. V. Hill, "Then heat of shortening and the dynamic constants of a muscle," Proc. Roy. Soc. Lond., vol. 126, no. 843, pp. 136-195, 1938.
44. N. Lan, "Stability analysis for postural control in a two-joint limb system," IEEE Trans. Neural Syst. Rehab. Eng., vol. 10, no. 4, pp. 249-259, 2002. (Pubitemid 36207320)
45. R. Riener and T. Fuhr, "Patient-driven control of FES-supported standing up: A simulation study," IEEE Trans. Rehab. Eng., vol. 6, no. 2, pp. 113-124, 1998. (Pubitemid 28268635)
46. S. Jezernik, R. G. V. Wassink, and T. Keller, "Sliding mode closed-loop control of FES: Controlling the shank movement," IEEE Trans. Bio-Med. Eng., vol. 51, no. 2, pp. 263-272, 2004. (Pubitemid 38133606)
47. M. Ferrarin, F. Palazzo, R. Riener, and J. Quintern, "Model-based control of FES-induced single joint movements," IEEE Trans. Rehab. Eng., vol. 9, no. 3, pp. 245-257, 2001. (Pubitemid 32852061)
48. K. J. Hunt, M. Munih, N. N. Donaldson, and F. M. D. Barr, "Investigation of the Hammerstein hypothesis in the modeling of electrically stimulated muscle," IEEE Trans. Bio-Med. Eng., vol. 45, no. 8, pp. 998-1009, 1998. (Pubitemid 128751991)
49. R. Riener and J. Quintern, "A physiologically based model of muscle activation verified by electrical stimulation," Bioelectrochem. Bioenerg., vol. 43, no. 2, pp. 257-264, 1997. (Pubitemid 27465758)
50. F. Previdi and E. Carpanzano, "Design of a gain scheduling controller for knee-joint angle control by using functional electrical stimulation," IEEE Trans. Control Syst. Technol., vol. 11, no. 3, pp. 310-324, 2003.
51. R. Happee and F. C. Van der Helm, "The control of shoulder muscles during goal directed movements, an inverse dynamic analysis," J. Biomed. Eng., vol. 28, no. 10, pp. 1179-1191, 1995.
52. W. K. Durfee and K. E. MacLean, "Methods for estimating isometric recruitment curves of electrically stimulated muscle," IEEE Trans. Bio-Med. Eng., vol. 36, no. 7, pp. 654-667, 1997.
53. R. Baratta and M. Solomonow, "The dynamic response model of nine different skeletal muscles," IEEE Trans. Bio-Med. Eng., vol. 37, no. 3, pp. 243-251, 1990. (Pubitemid 20212144)
54. P. H. Veltink, H. J. Chizeck, P. E. Crago, and A. El-Bialy, "Nonlinear joint angle control for artificially stimulated muscle," IEEE Trans. Bio-Med. Eng., vol. 39, no. 4, pp. 368-380, 1992.
55. H. J. Chizeck, P. E. Crago, and L. S. Kofman, "Robust closed-loop control of isometric muscle force using pulsewidth modulation," IEEE Trans. Bio-Med. Eng., vol. 35,no. 7, pp. 510-517, 1988.
56. J. E. Colgate and N. Hogan, "Robust control of dynamically interacting systems," Int. J. Control, vol. 48, no. 1, pp. 65-88, 1988. (Pubitemid 18650549)
57. E. Langzam, Y. Nemirovsky, E. Isakov, and J. Mizrahi, "Partition between volitional and induced forces in electrically augmented dynamic isometric muscle contractions," IEEE Trans. Neural Syst. Rehab. Eng., vol. 13, no. 3, pp. 322-335, 2006. (Pubitemid 44543556)
58. J. D. Ratcliffe, J. J. Hatonen, P. L. Lewin, E. Rogers, T. J. Harte, and D. H. Owens, "P-type iterative learning control for systems that contain resonance," Int. J. Adapt. Control, vol. 19, no. 10, pp. 769-796, 2005. (Pubitemid 43035022)
59. World Health Organisation. (2001). International classification of functioning, disability and health. [Online]. Available: http://www.who.int/ classifications/icf/en/
60. S. Edwards, Neurological Physiotherapy: A Problem-Solving Approach. New York: Elsevier Health Sciences, 2002.
61. G. Francisco, J. Chae, H. Chawla, S. Kirshblum, R. Zorowitz, G. Lewis, and S. Pang, "Electromyogram-triggered neuromusclar stimulation for improving the arm function of acute stroke survivors: A randomized pilot study," Arch. Phys. Med. Rehab., vol. 79, no. 5, pp. 570-575, 1998. (Pubitemid 28222171)
62. V. S. Huang and J. W. Krakauer, "Robotic neurorehabilitation: A computational motor learning perspective," J. NeuroEng. Rehab., vol. 6, no. 5, pp. 1-13, 2009.
63. A.-M. Hughes, C. T. Freeman, P. H. Chappell, P. L. Lewin, E. Rogers, J. H. Burridge, M. Donovan-Hall, and B. Dibb, "Stroke participants' perceptions of robotic and electrical stimulation therapy: A new approach," Disabil. Rehab., vol. 6, no. 2, pp. 130-138, 2011.
64. S. Coote, B. Murphy, W. Harwin, and E. K. Stokes, "The effect of the GENTLE/s robot-mediated therapy system on arm function after stroke," Clin. Rehab., vol. 22, no. 5, pp. 395-405, 2008. (Pubitemid 351833329)
65. A. J. Doornebosch, H. J. M. Cools, M. E. C. Slee-Turkenburg, M. G. cvan Elk, and M. Schoone-Harmsen, "Robot-mediated ACtive REhabilitation (ACRE2) for the hemiplegic upper limb after a stroke: A pilot study," Technol. Disabil., vol. 19, no. 4, pp. 199-203, 2007.
66. H. I. Krebs, N. Hogan, M. L. Aisen, and B. T. Volpe, "Robot-aided neurorehabilitation," IEEE Trans. Rehab. Eng., vol. 6, no. 1, pp. 75-87, 1998.
67. C. T. Freeman, D. Tong, K. Meadmore, Z. Cai, E. Rogers, A.-M. Hughes, and J. H. Burridge, "Phase-lead iterative learning control algorithms for functional electrical stimulation based stroke rehabilitation," Proc. Inst. Mech. Eng. I., vol. 225, no. 6, pp. 850-859, 2011.
68. Z. Cai, C. T. Freeman, P. L. Lewin, and E. Rogers, "Iterative learning control for a non-minimum phase plant based on a reference shift algorithm," Control Eng. Pract., vol. 16, no. 6, pp. 633-643, 2008. (Pubitemid 351396305)
69. T. Lin, D. H. Owens, and J. J. Hatonen, "Newton method based iterative learning control for discrete non-linear systems," Int. J. Control, vol. 79, no. 10, pp. 1263-1276, 2006. (Pubitemid 44091781)
70. N. Amann, D. H. Owens, and E. Rogers, "Iterative learning control using optimal feedback and feedforward actions," Int. J. Control, vol. 65, no. 2, pp. 277-293, 1996. (Pubitemid 126519459)
71. K. L. Meadmore, A.-M. Hughes, C. T. Freeman, Z. Cai, D. Tong, J. H. Burridge, and E. Rogers, "Iterative learning mediated FES and 3D robotics reduces motor impairment in chronic stroke," J. NeuroEng. Rehab., to appear 2012. [Online]. Available: http://eprints.ecs.soton.ac.uk/
72. D. M. Wolpert, Z. Ghahramani, and J. Randall Flanagan, "Perspectives and problems in motor learning," Trends Cogn. Sci., vol. 11, no. 1, pp. 487-494, 2001.
73. C. T. Freeman, Z. Cai, E. Rogers, and P. L. Lewin, "Iterative learning control for multiple point-to-point tracking application," IEEE Trans. Control Syst. Technol., vol. 19, no. 3, pp. 590-600, 2011.