Multichannel electrotactile feedback with spatial and mixed coding for closed-loop control of grasping force in hand prostheses

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Volumn 25, Issue 3, 2017, Pages 183-195

  Dosen, Strahinja ^a   Markovic, Marko ^b   Strbac, Matija ^c   Belic, Minja ^c   Kojic, Vladimir ^c   Bijelic, Goran ^c   Keller, Thierry ^c   Farina, Dario ^a  

^a UNIVERSITY MEDICAL CENTER GÖTTINGEN   (Germany)

^b Otto Bock HealthCare GmbH   (Germany)

^c TECNALIA RESEARCH AND INNOVATION   (Spain)

Author keywords

Array electrodes; electrotactile stimulation; force feedback; force tracking; myoelectric prostheses; routine grasping; sensory feedback

Indexed keywords

CODES (SYMBOLS); ELECTRODES; FEEDBACK; FEEDFORWARD CONTROL; FORCE CONTROL; PROSTHETICS; SENSORY FEEDBACK; VISUAL COMMUNICATION;

ARRAY-ELECTRODE; ELECTROTACTILE STIMULATION; FORCE FEEDBACK; FORCE TRACKING; MYOELECTRIC PROSTHESIS; ROUTINE GRASPING;

MYOELECTRICALLY CONTROLLED PROSTHETICS;

ARTICLE; ELECTRODE; ELECTROMYOGRAM; FREQUENCY MODULATION; HAND PROSTHESIS; HUMAN; HUMAN EXPERIMENT; MUSCLE ISOMETRIC CONTRACTION; MYOELECTRIC CONTROL; PSYCHOMETRY; REHABILITATION EQUIPMENT; SPATIAL DISCRIMINATION; TACTILE FEEDBACK; VISUAL FEEDBACK; DEVICE FAILURE ANALYSIS; DEVICES; ELECTROMYOGRAPHY; HAND; HAND STRENGTH; INFORMATION RETRIEVAL; LIMB PROSTHESIS; PHYSICAL STIMULATION; PHYSIOLOGY; PROCEDURES; PROSTHESIS DESIGN; SENSORY FEEDBACK; TASK PERFORMANCE; TOUCH;

ARTIFICIAL LIMBS; ELECTROMYOGRAPHY; EQUIPMENT FAILURE ANALYSIS; FEEDBACK, SENSORY; HAND; HAND STRENGTH; HUMANS; INFORMATION STORAGE AND RETRIEVAL; PHYSICAL STIMULATION; PROSTHESIS DESIGN; TASK PERFORMANCE AND ANALYSIS; TOUCH;

EID: 85016410481     PISSN: 15344320     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSRE.2016.2550864     Document Type: Article

References (43)

1. C. MacKenzie and T. Iberall, The Grasping Hand. Amsterdam,The Netherlands: Elsevier B.V., 2010.
2. P. Parker, K. Englehart, and B. Hudgins, "Myoelectric signal processing for control of powered limb prostheses," J. Electromyogr. Kinesiol., vol. 16, no. 6, pp. 541-548, Dec. 2006.
3. J. T. Belter, J. L. Segil, A. M. Dollar, and R. F. Weir, "Mechanical design and performance specifications of anthropomorphic prosthetic hands: a review," J. Rehabil. Res. Dev., vol. 50, no. 5, pp. 599-618, Jan. 2013.
4. Vincent Evolution 2 Hand. Oct. 09 2014, Online. Available: http://vincentsystems.de/en/prosthetics/vincent-evolution-2/.
5. D. S. Childress, "Closed-loop control in prosthetic systems: Historical perspective," Ann. Biomed. Eng., vol. 8, no. 4-6, pp. 293-303, Jul. 1980.
6. S. Raspopovic et al., "Restoring natural sensory feedback in realtime bidirectional hand prostheses," Sci. Transl. Med., vol. 6, no. 222, p. 222ra19, Feb. 2014.
7. G. A. Tabot et al., "Restoring the sense of touch with a prosthetic hand through a brain interface," Proc. Nat. Acad. Sci. USA, vol. 110, no. 45, pp. 18279-84, Nov. 2013.
8. A. Y. Szeto and F. A. Saunders, "Electrocutaneous stimulation for sensory communication in rehabilitation engineering," IEEE Trans. Biomed. Eng., vol. 29, no. 4, pp. 300-308, Apr. 1982.
9. K. A. Kaczmarek, J. G. Webster, P. Bach-y-Rita, and W. J. Tompkins, "Electrotactile and vibrotactile displays for sensory substitution systems," IEEE Trans. Biomed. Eng., vol. 38, no. 1, pp. 1-16, Jan. 1991.
10. J. S. Hebert et al., "Novel targeted sensory reinnervation technique to restore functional hand sensation after transhumeral amputation," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 22, no. 4, pp. 765-773, Apr. 2014.
11. T. A. Kuiken et al., "Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms," JAMA, vol. 301, no. 6, pp. 619-28, Feb. 2009.
12. T. A. Kuiken, G. A. Dumanian, R. D. Lipschutz, L. A. Miller, and K. A. Stubblefield, "The use of targeted muscle reinnervation for improved myoelectric prosthesis control in a bilateral shoulder disarticulation amputee," Prosthet. Orthot. Int., vol. 28, no. 3, pp. 245-53, Dec. 2004.
13. S. Dosen, M.-C. Schaeffer, and D. Farina, "Time-division multiplexing for myoelectric closed-loop control using electrotactile feedback," J. Neuroeng. Rehabil., vol. 11, no. 1, p. 138, Jan. 2014.
14. C. Hartmann, S. Dosen, S. Amsuess, and D. Farina, "Closed-loop control of myoelectric prostheses with electrotactile feedback: Influence of stimulation artifact and blanking," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 23, no. 5, pp. 807-816, Sep. 2015.
15. C. Frigo, M. Ferrarin, W. Frasson, E. Pavan, and R. Thorsen, "EMG signals detection and processing for on-line control of functional electrical stimulation," J. Electromyogr. Kinesiol., vol. 10, no. 5, pp. 351-60, Oct. 2000.
16. C. Antfolk, M. D'Alonzo, B. Rosen, G. Lundborg, F. Sebelius, and C. Cipriani, "Sensory feedback in upper limb prosthetics," Expert Rev. Med. Devices, vol. 10, no. 1, pp. 45-54, Jan. 2013.
17. C. Cipriani, F. Zaccone, S. Micera, and M. C. Carrozza, "On the shared control of an EMG-controlled prosthetic hand: Analysis of userprosthesis interaction," IEEE Trans. Robot., vol. 24, no. 1, pp. 170-184, Feb. 2008.
18. C. Pylatiuk, A. Kargov, and S. Schulz, "Design and evaluation of a low-cost force feedback system for myoelectric prosthetic hands," JPO J. Prosthetics Orthot., vol. 18, no. 2, pp. 57-61, Apr. 2006.
19. C. Cipriani, M. D'Alonzo, and M. C. Carrozza, "A miniature vibrotactile sensory substitution device for multifingered hand prosthetics," IEEE Trans. Biomed. Eng., vol. 59, no. 2, pp. 400-408, Feb. 2012.
20. M. Azadi and L. A. Jones, "Vibrotactile actuators: Effect of load and body site on performance," in Proc. IEEE Haptics Symp., 2014, pp. 351-356.
21. L. A. Jones and N. B. Sarter, "Tactile displays: Guidance for their design and application," Hum. Factors, vol. 50, no. 1, pp. 90-111, Feb. 2008.
22. A. Chatterjee, P. Chaubey, J. Martin, and N. Thakor, "Testing a prosthetic haptic feedback simulator with an interactive force matching task," JPO J. Prosthetics Orthot., vol. 20, no. 2, pp. 27-34, Apr. 2008.
23. H. J. Witteveen, H. S. Rietman, and P. H. Veltink, "Vibrotactile grasping force and hand aperture feedback for myoelectric forearm prosthesis users," Prosthet. Orthot. Int., vol. 39, no. 3, pp. 204-12, Jun. 2015.
24. R. E. Prior, J. Lyman, P. A. Case, and C. M. Scott, "Supplemental sensory feedback for the VA/NU myoelectric hand. Background and preliminary designs," Bull. Prosthet. Res., pp. 170-91, Jan. 1976.
25. N. Jorgovanovic, S. Dosen, D. J. Djozic, G. Krajoski, and D. Farina, "Virtual grasping: Closed-loop force control using electrotactile feedback," Comput. Math. Methods Med., vol. 2014, p. 120357, Jan. 2014.
26. I. Saunders and S. Vijayakumar, "The role of feed-forward and feedback processes for closed-loop prosthesis control," J. Neuroeng. Rehabil., vol. 8, no. 1, p. 60, Jan. 2011.
27. H. J. B. Witteveen, E. a. Droog, J. S. Rietman, and P. H. Veltink, "Vibroand electrotactile user feedback on hand opening for myoelectric forearm prostheses," IEEE Trans. Biomed. Eng., vol. 59, no. 8, pp. 2219-2226, Aug. 2012.
28. C. Antfolk and C. Balkenius, "A tactile display system for hand prostheses to discriminate pressure and individual finger localization," J. Med. Biol. Eng., vol. 30, no. 6, pp. 355-360, 2010.
29. C. Antfolk et al., "Artificial redirection of sensation from prosthetic fingers to the phantom hand map on transradial amputees: vibrotactile versus mechanotactile sensory feedback," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 21, no. 1, pp. 112-20, Jan. 2013.
30. M. Solomonow, J. Lyman, and A. Freedy, "Electrotactile two-point discrimination as a function of frequency, body site, laterality, and stimulation codes," Ann. Biomed. Eng., vol. 5, no. 1, pp. 47-60, Mar. 1977.
31. S. Dosen, M. Markovic, C. Hartmann, and D. Farina, "Sensory feedback in prosthetics: A standardized test bench for closed-loop control," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 23, no. 2, pp. 267-276, Mar. 2015.
32. F. A. A. Kingdom and N. Prins, Psychophysics: A Practical Introduction. New York: Academic, 2009.
33. A. Ninu et al., "Closed-loop control of grasping with a myoelectric hand prosthesis: Which are the relevant feedback variables for force control?," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 22, no. 5, pp. 1041-1052, Sep. 2014.
34. S. Dosen et al., "Building an internal model of a myoelectric prosthesis via closed-loop control for consistent and routine grasping," Exp. Brain Res., vol. 233, no. 6, pp. 1855-1865, Jun. 2015.
35. M. D'Alonzo, S. Dosen, C. Cipriani, and D. Farina, "HyVE: Hybrid vibro-electrotactile stimulation for sensory feedback and substitution in rehabilitation," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 22, no. 2, pp. 290-301, Mar. 2014.
36. R. E. Johnson, K. P. Kording, L. J. Hargrove, and J. W. Sensinger, "Does EMG control lead to distinct motor adaptation?," Front. Neurosci., vol. 8, p. 302, Jan. 2014.
37. K. Wei and K. Kording, "Uncertainty of feedback and state estimation determines the speed of motor adaptation," Front. Comput. Neurosci., vol. 4, p. 11, Jan. 2010.
38. D. W. Franklin and D. M. Wolpert, "Computational mechanisms of sensorimotor control," Neuron, vol. 72, no. 3, pp. 425-42, Nov. 2011.
39. E. Todorov, "Optimality principles in sensorimotor control," Nat. Neurosci., vol. 7, no. 9, pp. 907-15, Sep. 2004.
40. P. F. Pasquina et al., "First-in-man demonstration of a fully implanted myoelectric sensors system to control an advanced electromechanical prosthetic hand," J. Neurosci. Methods, pp. 1-9, Aug. 2014.
41. J. J. Baker, E. Scheme, K. Englehart, D. T. Hutchinson, and B. Greger, "Continuous detection and decoding of dexterous finger flexions with implantable myoelectric sensors," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 18, no. 4, pp. 424-432, Aug. 2010.
42. J. D. Brown et al., "An exploration of grip force regulation with a lowimpedance myoelectric prosthesis featuring referred haptic feedback," J. Neuroeng. Rehabil., vol. 12, p. 104, Jan. 2015.
43. H. Bouwsema, P. J. Kyberd, W. Hill, C. K. Van Der Sluis, and R. M. Bongers, "Determining skill level in myoelectric prosthesis use with multiple outcome measures," J. Rehabil. Res. Dev., vol. 49, no. 9, pp. 1331-1348, Jan. 2012.