Electromyogram pattern recognition for control of powered upper-limb prostheses: State of the art and challenges for clinical use

Journal of Rehabilitation Research and Development

Volumn 48, Issue 6, 2011, Pages 643-660

  Scheme, Erik ^a   Englehart, Kevin ^a  

^a UNIVERSITY OF NEW BRUNSWICK   (Canada)

Author keywords

Amputee; Electromyogram; Emg; Linear discrimi nant analysis; Myoelectric control; Pattern recognition; Pros thetics; Rehabilitation; Signal processing; Upper limb

Indexed keywords

AMPUTEE; ELECTROMYOGRAM; EMG; LINEAR DISCRIMI-NANT ANALYSIS; MYOELECTRIC CONTROL; UPPER LIMBS;

MECHANICS; PATTERN RECOGNITION; ROBUST CONTROL; SIGNAL PROCESSING;

PROSTHETICS;

ARM AMPUTATION; ARM PROSTHESIS; ARTICLE; CLASSIFIER; COMPUTER PROGRAM; ELECTRODE; ELECTROMYOGRAM; FUNCTIONAL TRAINING; HUMAN; KINEMATICS; MOTOR CONTROL; MOTOR PERFORMANCE; MUSCLE FORCE; MUSCLE REINNERVATION; MYOELECTRIC CONTROL; NEUROTRANSMISSION; PATTERN RECOGNITION; PRIORITY JOURNAL; REHABILITATION; SIGNAL PROCESSING; FUNCTIONAL STATUS; NOTE;

AMPUTATION; ARM; ARTIFICIAL LIMBS; FORECASTING; HUMANS; NEUROFEEDBACK; PATTERN RECOGNITION, AUTOMATED;

EID: 79960791840     PISSN: 07487711     EISSN: 19381352     Source Type: Journal    
DOI: 10.1682/JRRD.2010.09.0177     Document Type: Article

References (83)

1. Parker P, Englehart K, Hudgins B. Myoelectric signal processing for control of powered limb prostheses. J Electromyogr Kinesiol. 2006;16(6):541-48. DOI:10.1016/j.jelekin.2006.08.006
2. Atkins DJ, Heard DCY, Donovan WH. Epidemiologic overview of individuals with upper-limb loss and their reported research priorities. J Prosthet Orthot. 1996;8(1):2-11. DOI:10.1097/00008526-199600810-00003
3. Finley FR, Wirta RW. Myocoder studies of multiple myopotential response. Arch Phys Med Rehabil. 1967;48(11): 598-601.
4. Lawrence P, Herberts P, Kadefors R. Experiences with a multifunctional hand prosthesis controlled by myoelectric patterns. In: Gavrilovic MM, Wilson AB Jr, editors. Advances in external control of human extremities. Belgrade (Yugoslavia): Etan; 1973. p. 47-65.
5. Lyman JH, Freedy A, Prior R. Fundamental and applied research related to the design and development of upper-limb externally powered prostheses. Bull Prosthet Res. 1976;13: 184-95.
6. Li G, Kuiken TA. EMG pattern recognition control of multifunctional prostheses by transradial amputees. Conf Proc IEEE Eng Med Biol Soc. 2009;2009:6914-17.
7. Li G, Schultz AE, Kuiken TA. Quantifying pattern recognition- based myoelectric control of multifunctional transradial prostheses. IEEE Trans Neural Syst Rehabil Eng. 2010;18(2):185-92.
8. Hijjawi JB, Kuiken TA, Lipschutz RD, Miller LA, Stubblefield KA, Dumanian GA. Improved myoelectric prosthesis control accomplished using multiple nerve transfers. Plast Reconstr Surg. 2006;118(7):1573-78. DOI:10.1097/01.prs.0000242487.62487.fb
9. Kuiken TA, Miller LA, Lipschutz RD, Lock BA, Stubblefield K, Marasco PD, Zhou P, Dumanian GA. Targeted reinnervation for enhanced prosthetic arm function in a woman with a proximal amputation: A case study. Lancet. 2007;369(9559):371-80. DOI:10.1016/S0140-6736(07)60193-7
10. Zhou P, Lowery MM, Englehart KB, Huang H, Li G, Hargrove L, Dewald JP, Kuiken TA. Decoding a new neural machine interface for control of artificial limbs. J Neurophysiol. 2007;98(5):2974-82. DOI:10.1152/jn.00178.2007
11. Kuiken TA, Dumanian GA, Lipschutz RD, Miller LA, Stubblefield KA. The use of targeted muscle reinnervation for improved myoelectric prosthesis control in a bilateral shoulder disarticulation amputee. Prosthet Orthot Int. 2004; 28(3):245-53.
12. Kuiken TA, Li G, Lock BA, Lipschutz RD, Miller LA, Stubblefield KA, Englehart KB. Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. JAMA. 2009;301(6):619-28. DOI:10.1001/jama.2009.116
13. Doerschuk PC, Gustafson DE, Willsky AS. Upper extremity limb function discrimination using EMG signal analysis. IEEE Trans Biomed Eng. 1983;30(1):18-29. DOI:10.1109/TBME.1983.325162
14. Kuruganti U, Hudgins B, Scott RN. Two-channel enhancement of a multifunction control system. IEEE Trans Biomed Eng. 1995;42(1):109-11. DOI:10.1109/10.362912
15. Englehart K, Hudgin B, Parker PA. A wavelet-based continuous classification scheme for multifunction myoelectric control. IEEE Trans Biomed Eng. 2001;48(3):302-11. DOI:10.1109/10.914793
16. Hargrove LJ, Englehart K, Hudgins B. A comparison of surface and intramuscular myoelectric signal classification. IEEE Trans Biomed Eng. 2007;54(5):847-53. DOI:10.1109/TBME.2006.889192
17. Losier Y, Englehart K, Hudgins B. Evaluation of shoulder complex motion-based input strategies for endpoint prosthetic- limb control using a dual-task paradigm. J Rehabil Res Dev. 2011;48(6):669-78. DOI:10.1682/JRRD.2010.08.0165
18. Lee S, Saridis G. The control of a prosthetic arm by EMG pattern recognition. IEEE Trans Auto Control. 1984;29(4): 290-302.
19. Hudgins B, Parker P, Scott RN. A new strategy for multifunction myoelectric control. IEEE Trans Biomed Eng. 1993; 40(1):82-94. DOI:10.1109/10.204774
20. Barniv Y, Aguilar M, Hasanbelliu E. Using EMG to anticipate head motion for virtual-environment applications. IEEE Trans Biomed Eng. 2005;52(6):1078-93. DOI:10.1109/TBME.2005.848378
21. Zardoshti-Kermani M, Wheeler BC, Badie K, Hashemi RM. EMG feature evaluation for movement control of upper extremity prostheses. IEEE Trans Rehabilitation Eng. 1995;3(4):324-33. DOI:10.1109/86.481972
22. Graupe D, Salahi J, Kohn KH. Multifunctional prosthesis and orthosis control via microcomputer identification of temporal pattern differences in single-site myoelectric signals. J Biomed Eng. 1982;4(1):17-22. DOI:10.1016/0141-5425(82)90021-8
23. Kang WJ, Shiu JR, Cheng CK, Lai JS, Tsao HW, Kuo TS. The application of cepstral coefficients and maximum likelihood method in EMG pattern recognition. IEEE Trans Biomed Eng. 1995;42(8):777-85. DOI:10.1109/10.398638
24. Huang Y, Englehart KB, Hudgins B, Chan AD. A Gaussian mixture model based classification scheme for myoelectric control of powered upper limb prostheses. IEEE Trans Biomed Eng. 2005;52(11):1801-11. DOI:10.1109/TBME.2005.856295
25. Englehart K, Hudgins B, Parker PA, Stevenson M. Classification of the myoelectric signal using time-frequency based representations. Med Eng Phys. 1999;21(6-7):431-38. DOI:10.1016/S1350-4533(99)00066-1
26. Lucas MF, Gaufriau A, Pascual S, Doncarli C, Farina D. Multi-channel surface EMG classification using support vector machines and signal-based wavelet optimization. Biomed Signal Process Control. 2008;3(2):169-74. DOI:10.1016/j.bspc.2007.09.002
27. Nazarpour K, Sharafat AR, Firoozabadi SMP. Surface EMG signal classification using a selective mix of higher order statistics. Conf Proc IEEE Eng Med Biol Soc. 2005; 4:4208-11.
28. Hargrove LJ, Li G, Englehart KB, Hudgins BS. Principal components analysis preprocessing for improved classification accuracies in pattern-recognition-based myoelectric control. IEEE Trans Biomed Eng. 2009;56(5):1407-14. DOI:10.1109/TBME.2008.2008171
29. Naik GR, Kumar DK, Palaniswami M. Surface EMG based hand gesture identification using semi blind ICA: Validation of ICA matrix analysis. Electromyogr Clin Neurophysiol. 2008;48(3-4):169-80.
30. Gallant PJ, Morin EL, Peppard LE. Feature-based classification of myoelectric signals using artificial neural networks. Med Biol Eng Comput. 1998;36(4):485-89. DOI:10.1007/BF02523219
31. Scheme E, Englehart K, Hudgins B. A one-versus-one classifier for improved robustness of myoelectric control. The 18th Congress of the International Society of Electrophysiology and Kinesiology; 2010 Jun 16-19; Aalborg, Denmark.
32. Zecca M, Micera S, Carrozza M, Dario P. Control of multifunctional prosthetic hands by processing the electromyographic signal. Crit Rev Biomed Eng. 2002;30(4-6):459-85. DOI:10.1615/CritRevBiomedEng.v30.i456.80
33. Englehart K, Hudgins B. A robust, real-time control scheme for multifunction myoelectric control. IEEE Trans Biomed Eng. 2003;50(7):848-54. DOI:10.1109/TBME.2003.813539
34. Winkler M, Boschmann A, Kaufmann P, Platzner M. Towards multi-movement hand prostheses: combining adaptive classification with high precision socket. Proceedings of the 2nd European Conference on Technically Assisted Rehabilitation; 2009 Jan 30-31; Berlin, Germany.
35. Kaufmann P, Englehart K, Platzner M. Fluctuating EMG signals: Investigating long-term effects of pattern matching algorithms. Conf Proc IEEE Eng Med Biol Soc. 2010; 2010:6357-60.
36. Oskoei MA, Hu H. Support vector machine-based classification scheme for myoelectric control applied to upper limb. IEEE Trans Biomed Eng. 2008;55(8):1956-65. DOI:10.1109/TBME.2008.919734
37. Yang D, Zhao J, Gu Y, Jiang L, Liu H. EMG pattern recognition and grasping force estimation: Improvement to the myocontrol of multi-DOF prosthetic hands. Proceedings of the 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems; 2009 Oct 11-15; St. Louis (MO); Piscataway (NJ): IEEE Press; 2009. p. 516-21.
38. Chan AD, Englehart KB. Continuous myoelectric control for powered prostheses using hidden Markov models. IEEE Trans Biomed Eng. 2005;52(1):121-24. DOI:10.1109/TBME.2004.836492
39. Li Y, Chen X, Tian J, Zhang X, Wang K, Yang J. Automatic recognition of sign language subwords based on portable accelerometer and EMG sensors. Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction; 2010 Nov 8-12; Beijing, China; New York (NY): ACM; 2009.
40. Farrell TR, Weir RF. The optimal controller delay for myoelectric prostheses. IEEE Trans Neural Syst Rehabil Eng. 2007;15(1):111-18. DOI:10.1109/TNSRE.2007.891391
41. Smith LH, Lock BA, Hargrove L. Effects of window length and classification accuracy on the real-time controllability of pattern recognition myoelectric control. Proceedings of the 18th Congress of the International Society for Electrophysiology and Kinesiology; 2010 Jun 16-19; Aalborg, Denmark.
42. Wright FV, Hubbard S, Jutai J, Naumann S. The Prosthetic Upper Extremity Index: Development and reliability testing of a new functional status questionnaire for children who use upper extremity prostheses. J Hand Ther. 2001; 14(2):91-104.
43. Hermansson LM, Fisher AG, Bernspång B, Eliasson AC. Assessment of capacity for myoelectric control: A new Rasch-built measure of prosthetic hand control. J Rehabil Med. 2005;37(3):166-71.
44. Sanderson ER, Scott RN. UNB Test of Prosthetic Function: A test for unilateral upper extremity amputees, ages 2-13; Fredericton (Canada): University of New Brunswick; 1985.
45. Kopp B, Kunkel A, Flor H, Platz T, Rose U, Mauritz KH, Gresser K, McCulloch KL, Taub E. The Arm Motor Ability Test: Reliability, validity, and sensitivity to change of an instrument for assessing disability in activities of daily living. Arch Phys Med Rehabil. 1997;78(6):615-20. DOI:10.1016/S0003-9993(97)90427-5
46. Wolf SL, Catlin PA, Ellis M, Archer AL, Morgan B, Piacentino A. Assessing Wolf motor function test as outcome measure for research in patients after stroke. Stroke. 2001; 32(7):1635-39.
47. Light CM, Chappell PH, Kyberd PJ. Establishing a standardized clinical assessment tool of pathologic and prosthetic hand function: Normative data, reliability, and validity. Arch Phys Med Rehabil. 2002;83(6):776-83.
48. Lock BA, Englehart K, Hudgins B. Real-time myoelectric control in a virtual environment to relate usability vs. accuracy. Proceedings of the 2005 MyoElectric Controls/Powered Prosthetics Symposium; 2005 Aug 17-19; Fredericton, Canada. Available from: http://dukespace.lib.duke.edu/dspace/bitstream/handle/10161/2721/Lock_01.pdf?sequence=3
49. Hargrove L, Losier Y, Lock B, Englehart K, Hudgins B. A real-time pattern recognition based myoelectric control usability study implemented in a virtual environment. Conf Proc IEEE Eng Med Biol Soc. 2007;2007:4842-45.
50. Kuiken TA, Li G, Lock BA, Lipschutz RD, Miller LA, Stubblefield KA, Englehart KB. Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. JAMA. 2009;301(6):619-28. DOI:10.1001/jama.2009.116
51. Simon AM, Hargrove LJ, Lock BA, Kuiken TA. A decision- based velocity ramp for minimizing the effect of misclassifications during real-time pattern recognition control, submitted to IEEE Trans Biomed Eng. Forthcoming 2011.
52. Montoya P, Ritter K, Huse E, Larbig W, Braun C, Töpfner S, Lutzenberger W, Grodd W, Flor H, Birbaumer N. The cortical somatotopic map and phantom phenomena in subjects with congenital limb atrophy and traumatic amputees with phantom limb pain. Eur J Neurosci. 1998;10(3):1095-1102. DOI:10.1046/j.1460-9568.1998.00122.x
53. Lock B, Englehart K, Hudgins B. VR tools for development and training of advanced prosthetics. Proceedings of the 11th Annual CyberTherapy Conference; 2006 Jun 12- 15; Ottawa, Canada.
54. Hargrove L, Englehart K, Hudgins B. The effect of electrode displacements on pattern recognition based myoelectric control. Conf Proc IEEE Eng Med Biol Soc. 2006; 1:2203-6. DOI:10.1109/IEMBS.2006.260681
55. Stubblefield KA, Miller LA, Lipschutz RD, Kuiken TA. Occupational therapy protocol for amputees with targeted muscle reinnervation. J Rehabil Res Dev. 2009;46(4):481-88. DOI:10.1682/JRRD.2008.10.0138
56. Nielsen JL, Holmgaard S, Jiang N, Englehart K, Farina D, Parker PA. A training strategy for simultaneous and proportional force control of multifunction myoelectric prostheses for unilateral upper-limb amputees. IEEE Trans Biomed Eng. 2010;99:1-8.
57. Armiger RS, Vogelstein RJ. Air-Guitar Hero: A real-time video game interface for training and evaluation of dexterous upper-extremity neuroprosthetic control algorithms. Proceedings of the IEEE Biomedical Circuits and Systems Conference;2008 Nov 20-24; Baltimore, MD. Los Alamitos (CA): IEEE; 2008. p. 121-24.
58. Momen K, Krishnan S, Chau T. Real-time classification of forearm electromyographic signals corresponding to userselected intentional movements for multifunction prosthesis control. IEEE Trans Neural Syst Rehabil Eng. 2007; 15(4):535-42. DOI:10.1109/TNSRE.2007.9
59. Burger H, Brezovar D, Marinek C. Comparison of clinical test and questionnaires for the evaluation of upper limb prosthetic use in children. Disabil Rehabil. 2004;26(14- 15):911-16. DOI:10.1080/09638280410001708931
60. Scheme E, Englehart K. A flexible user interface for rapid prototyping of advanced real-time myoelectric control schemes. Proceedings of the MyoElectric Controls/Powered Prosthetics Symposium; Fredericton, New Brunswick, Canada; 2008 Aug 13-15.
61. Bishop W, Armiger R, Burck J, Bridges M, Hauschild M, Englehart K, Scheme E, Vogelstein RJ, Beaty J, Harshbarger S. A real-time virtual integration environment for the design and development of neural prosthetic systems. Conf Proc IEEE Eng Med Biol Soc. 2008;2008:615-19.
62. Davoodi R, Urata C, Todorov E, Loeb GE. Development of clinician-friendly software for musculoskeletal modeling and control. Conf Proc IEEE Eng Med Biol Soc. 2004;6: 4622-25.
63. Hargrove L, Englehart K, Hudgins B. A training strategy to reduce classification degradation due to electrode displacements in pattern recognition based myoelectric control. Biomed Signal Process Control. 2008;3(2):175-80. DOI:10.1016/j.bspc.2007.11.005
64. Young A, Hargrove L. Strategies to reduce myoelectric pattern recognition sensitivity to electrode shift. Proceedings of the 18th Congress of the International Society for Elec trophysiology and Kinesiology; 2010 Jun 16-19. Aalborg, Denmark.
65. Scheme E, Fougner A, Stavdahl Ø, Chan AC, Englehart K. Examining the adverse effects of limb position on pattern recognition based myoelectric control. Conf Proc IEEE Eng Med Biol Soc. 2010;2010:6337-40.
66. Fougner A, Scheme E, Chan AD, Kyberd PJ, Englehart K, Stavdahl Ø. Adverse effects of limb position on myoelectric control of upper-limb prostheses. Proceedings of the 22nd International Conference of the Society for Medical Innovation and Technology; 2010 Sep 2-4; Trondheim, Norway.
67. Fukuda O, Tsuji T, Kaneko M, Otsuka A. A human-assisting manipulator teleoperated by EMG signals and arm motions. IEEE Trans Robotics Automation. 2003;19(2): 210-22. DOI:10.1109/TRA.2003.808873
68. Sensinger JW, Lock BA Kuiken TA. Adaptive pattern recognition of myoelectric signals: Exploration of conceptual framework and practical algorithms. IEEE Trans Neural Syst Rehabil Eng. 2009;17(3):271-78.
69. Kato R, Fujita T, Yokoi H, Arai T. Adaptable EMG prosthetic hand using on-line learning method: Investigation of mutual adaptation between human and adaptable machine. The 15th IEEE International Symposium on Robot and Human Interactive Communication, 2006. 2006 Sep 6-8; Los Alamitos (CA): IEEE. p. 599-604.
70. Biron KB, Englehart K. EMG pattern recognition adaptation. Proceedings of the 18th Congress of the International Society of Electrophysiology and Kinesiology; 2010 Jun 16-19; Aalborg, Denmark.
71. Farrell TR, Weir RF. A comparison of the effects of electrode implantation and targeting on pattern classification accuracy for prosthesis control. IEEE Trans Biomed Eng. 2008;55(9):2198-11. DOI:10.1109/TBME.2008.923917
72. Weir RF, Troyk P, Demichele G, Kerns D. Technical details of the implantable myoelectric sensor (IMES) system for multifunction prosthesis control. Conf Proc IEEE Eng Med Biol Soc. 2005;7:7377-40.
73. Weir RF, Troyk PR, Demichele G, Kerns D, Schorsch JF, Maas H. Implantable myoelectric sensors (IMES) for prosthesis control: Development and testing. IEEE Trans Biomed Eng. 2009;56(1):159-71. DOI:10.1109/TBME.2008.2005942
74. Baker JJ, Scheme E, Englehart K, Hutchinson DT, Greger B. Continuous detection and decoding of dexterous finger flexions with implantable myoelectric sensors. IEEE Trans Neural Syst Rehabil Eng. 2010;18(4):424-32.
75. Jiang N, Englehart KB, Parker PA. Extracting simultaneous and proportional neural control information for multiple- DOF prostheses from the surface electromyographic signal. IEEE Trans Biomed Eng. 2009;56(4):1070-80. DOI:10.1109/TBME.2008.2007967
76. Smith RJ, Tenore F, Huberdeau D, Etienne-Cummings R, Thakor NV. Continuous decoding of finger position from surface EMG signals for the control of powered prostheses. Conf Proc IEEE Eng Med Biol Soc. 2008;2008:197-200.
77. Yatsenko D, McDonnall D, Guillory KS. Simultaneous, proportional, multi-axis prosthesis control using multichannel surface EMG. Conf Proc IEEE Eng Med Biol Soc. 2007;2007:6134-37.
78. Ajiboye AB, Weir RF. Muscle synergies as a predictive framework for the EMG patterns of new hand postures. J Neural Eng. 2009;6(3):036004. DOI:10.1088/1741-2560/6/3/036004
79. Overduin SA, d'Avella A, Roh J, Bizzi E. Modulation of muscle synergy recruitment in primate grasping. J Neurosci. 2008;28(4):880-92. DOI:10.1523/JNEUROSCI.2869-07.2008
80. Lowery MM, Weir RF, Kuiken TA. Simulation of intramuscular EMG signals detected using implantable myoelectric sensors (IMES). IEEE Trans Biomed Eng. 2006; 53(10):1926-33. DOI:10.1109/TBME.2006.881774
81. Velliste M, Perel S, Spalding MC, Whitford AS, Schwartz AB. Cortical control of a prosthetic arm for self-feeding. Nature. 2008;453(7198):1098-1101. DOI:10.1038/nature06996
82. Micera S, Carpaneto J, Raspopovic S. Control of hand prostheses using peripheral information. IEEE Rev Biomed Eng. 2010;3:48-68.
83. JJ. Dexterous finger movements: Decoding neuroand myoelectric signals and properties of finger-related neurons in motor cortex [dissertation]. [Salt Lake City (UT)]: University of Utah; 2010.trophysiology and Kinesiology; 2010 Jun 16-19. Aalborg, Denmark.