GLIMPSE: Google Glass interface for sensory feedback in myoelectric hand prostheses

Journal of Neural Engineering

Volumn 14, Issue 3, 2017, Pages

  Markovic, Marko ^a   Karnal, Hemanth ^a   Graimann, Bernhard ^b   Farina, Dario ^c   Dosen, Strahinja ^a  

^a UNIVERSITY MEDICAL CENTER GÖTTINGEN   (Germany)

^b Otto Bock HealthCare GmbH   (Germany)

^c IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

augmented reality; closed loop; force control; grasping; sensory feedback; smart devices; upper limb prosthesis

Indexed keywords

AUGMENTED REALITY; CLOSED LOOP CONTROL SYSTEMS; FORCE CONTROL; GLASS; INTERFACE STATES; MUSCLE; MYOELECTRICALLY CONTROLLED PROSTHETICS; PROSTHETICS; SENSORY FEEDBACK; WEARABLE COMPUTERS;

CLOSED LOOPS; FEEDBACK INTERFACES; GRASPING; LIMITED INFORMATION; PRACTICAL SOLUTIONS; SMART DEVICES; TACTILE STIMULATION; UPPER LIMB PROSTHESIS;

FEEDBACK;

ADULT; ARTICLE; COMPUTER INTERFACE; ELECTROMYOGRAM; HUMAN; HUMAN EXPERIMENT; MOBILE APPLICATION; MYOELECTRICALLY CONTROLLED PROSTHESIS; NORMAL HUMAN; OUTCOME ASSESSMENT; PRIORITY JOURNAL; PROPRIOCEPTION; SENSORY FEEDBACK; SOUND; TASK PERFORMANCE; BIOFEEDBACK; DEVICE FAILURE ANALYSIS; DEVICES; ELECTROMYOGRAPHY; EQUIPMENT DESIGN; FEMALE; HAND; INNERVATION; LIMB PROSTHESIS; MALE; PHYSIOLOGY; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; TELEMETRY; VIRTUAL REALITY;

ADULT; ARTIFICIAL LIMBS; BIOFEEDBACK, PSYCHOLOGY; ELECTROMYOGRAPHY; EQUIPMENT DESIGN; EQUIPMENT FAILURE ANALYSIS; FEEDBACK, SENSORY; FEMALE; HAND; HUMANS; MALE; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; TELEMETRY; USER-COMPUTER INTERFACE; VIRTUAL REALITY;

EID: 85020383393     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2552/aa620a     Document Type: Article

References (56)

1. Peerdeman B et al 2011 Myoelectric forearm prostheses: state of the art from a user-centered perspective J. Rehabil. Res. Dev. 48 719-37
2. Pylatiuk C, Schulz S and Döderlein L 2007 Results of an internet survey of myoelectric prosthetic hand users Prosthet. Orthot. Int. 31 362-70
3. Biddiss E, Beaton D and Chau T 2007 Consumer design priorities for upper limb prosthetics Disabil. Rehabil. Assist. Technol. 2 346-57
4. Johansson R S and Cole K J 1992 Sensory-motor coordination during grasping and manipulative actions Curr. Opin. Neurobiol. 2 815-23
5. Callier T, Saal H P, Davis-Berg E C and Bensmaia S J 2015 Kinematics of unconstrained tactile texture exploration J. Neurophysiol. 113 3013-20
6. Vincent Systems GmbH, VINCENTevolution 2 (online). Available: http://vincentsystems.de/en/prosthetics/vincent-evolution-2/ (Accessed: 20 May 2015) - ref-separator -
7. Antfolk C, D'Alonzo M, Rosén B, Lundborg G, Sebelius F and Cipriani C 2013 Sensory feedback in upper limb prosthetics Expert Rev. Med. Devices 10 45-54
8. Szeto A Y and Saunders F A 1982 Electrocutaneous stimulation for sensory communication in rehabilitation engineering IEEE Trans. Biomed. Eng. 29 300-8
9. Dosen S, Markovic M, Strbac M, Perovic M, Kojic V, Bijelic G and Farina D 2016 Multichannel electrotactile feedback with spatial and mixed coding for closed-loop control of grasping force in hand prostheses IEEE Trans. Neural Syst. Rehabil. Eng. pp 1-1
10. Chatterjee A, Chaubey P, Martin J and Thakor N 2008 Testing a prosthetic haptic feedback simulator with an interactive force matching task JPO J. Prosthet. Orthot. 20 27-34
11. Ninu A, Dosen S, Muceli S, Rattay F, Dietl H and Farina D 2014 Closed-loop control of grasping with a myoelectric hand prosthesis: which are the relevant feedback variables for force control? IEEE Trans. Neural Syst. Rehabil. Eng. 22 1041-52
12. Jorgovanovic N, Dosen S, Djozic D J, Krajoski G and Farina D 2014 Virtual grasping: closed-loop force control using electrotactile feedback Comput. Math. Methods Med. 2014 120357
13. Witteveen H J B, Rietman J S and Veltink P H 2012 Grasping force and slip feedback through vibrotactile stimulation to be used in myoelectric forearm prostheses Proc. Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society, EMBS pp 2969-72
14. Mann R and Reimers S 1970 Kinesthetic sensing for the EMG controlled 'Boston Arm' IEEE Trans. Man-Mach. Syst. 11 110-5
15. Erwin A and Sup F C 2015 A haptic feedback scheme to accurately position a virtual wrist prosthesis using a three-node tactor array PLoS One 10
16. Witteveen H J B, Rietman H S and Veltink P H 2015 Vibrotactile grasping force and hand aperture feedback for myoelectric forearm prosthesis users Prosthet. Orthot. Int. 39 204-12
17. Blank A, Okamura A M and Kuchenbecker K J 2010 Identifying the role of proprioception in upper-limb prosthesis control ACM Trans. Appl. Percept. 7 1-23
18. Keehoon K, Colgate J E, Santos-Munne J J, Makhlin A and Peshkin M A 2010 On the design of miniature haptic devices for upper extremity prosthetics IEEE/ASME Trans. Mechatronics 15 27-39
19. Armiger R S, Tenore F V, Katyal K D, Johannes M S, Makhlin A, Natter M L, Colgate J E, Bensmaia S J and Vogelstein R J 2013 Enabling closed-loop control of the modular prosthetic limb through haptic feedback Johns Hopkins APL Tech. Dig. 31 345-53
20. Dosen S, Ninu A, Yakimovich T, Dietl H and Farina D 2016 A novel method to generate amplitude-frequency modulated vibrotactile stimulation IEEE Trans. Haptics 9 3-12
21. Raspopovic S et al 2014 Restoring natural sensory feedback in real-time bidirectional hand prostheses Sci. Transl. Med. 6 222ra19
22. Davis T S, Wark H A C, Hutchinson D T, Warren D J, O'Neill K, Scheinblum T, Clark G A, Normann R A and Greger B 2016 Restoring motor control and sensory feedback in people with upper extremity amputations using arrays of 96 microelectrodes implanted in the median and ulnar nerves J. Neural Eng. 13 36001
23. Dhillon G S and Horch K W 2005 Direct neural sensory feedback and control of a prosthetic arm IEEE Trans. Neural Syst. Rehabil. Eng. 13 468-72
24. London B M, Jordan L R, Jackson C R and Miller L E 2008 Electrical stimulation of the proprioceptive cortex (area 3a) used to instruct a behaving monkey IEEE Trans. Neural Syst. Rehabil. Eng. 16 32-6
25. Cronin J, Wu J, Collins K, Sarma D, Rao R, Ojemann J and Olson J 2016 Task-specific somatosensory feedback via cortical stimulation in humans IEEE Trans. Haptics 9 515-22
26. Darian-Smith I 1984 The sense of touch: performance and peripheral neural processes Handbook of Physiology ed I Darian-Smith (Bethesda, MD: American Physiological Society) 739-88
27. Vallbo A B and Johansson R S 1984 Properties of cutaneous mechanoreceptors in the human hand related to touch sensation Human Neurobiol. 3 3-14
28. Lemling S 2015 Somatosensory feedback in prosthetics: psychometry and closed-loop control using vibro- and electro-tactile stimulation Universität Bielefeld
29. Paredes L P, Dosen S, Rattay F, Graimann B and Farina D 2015 The impact of the stimulation frequency on closed-loop control with electrotactile feedback J. Neuroeng. Rehabil. 12 35
30. Prior R E, Lyman J, Case P A and Scott C M 1976 Supplemental sensory feedback for the VA/NU myoelectric hand. Background and preliminary designs Bull. Prosthet. Res. 101 170-91
31. Dosen S, Markovic M, Wille N, Henkel M, Koppe M, Ninu A, Frömmel C and Farina D 2015 Building an internal model of a myoelectric prosthesis via closed-loop control for consistent and routine grasping Exp. Brain Res. 233 1855-65
32. Xu H, Zhang D, Huegel J, Xu W and Zhu X 2015 Effects of different tactile feedback on myoelectric closed-loop control for grasping based on electrotactile stimulation IEEE Trans. Neural Syst. Rehabil. Eng. 24 827-36
33. Walker J, Blank A, Shewokis P and O'Malley M 2015 Tactile feedback of object slip facilitates virtual object manipulation IEEE Trans. Haptics 8 454-66
34. Stepp C E, An Q and Matsuoka Y 2012 Repeated training with augmentative vibrotactile feedback increases object manipulation performance PLoS One 7 e32743
35. Damian D D, Arita A H, Martinez H and Pfeifer R 2012 Slip speed feedback for grip force control IEEE Trans. Biomed. Eng. 59 2200-10
36. Gonzalez J, Soma H, Sekine M and Yu W 2012 Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: a preliminary study J. Neuroeng. Rehabil. 9 33
37. Brown J D, Paek A, Syed M, O'Malley M K, Shewokis P A, Contreras-Vidal J L, Davis A J and Gillespie R B 2015 An exploration of grip force regulation with a low-impedance myoelectric prosthesis featuring referred haptic feedback J. Neuroeng. Rehabil. 12 104
38. Witteveen H J B, de Rond L, Rietman J S and Veltink P H 2012 Hand-opening feedback for myoelectric forearm prostheses: performance in virtual grasping tasks influenced by different levels of distraction J. Rehabil. Res. Dev. 49 1517-26
39. Clemente F, D'Alonzo M, Controzzi M, Edin B and Cipriani C 2015 Non-invasive, temporally discrete feedback of object contact and release improves grasp control of closed-loop myoelectric transradial prostheses IEEE Trans. Neural Syst. Rehabil. Eng. 24 1314-22
40. Zafar M and Van Doren C L 2000 Effectiveness of supplemental grasp-force feedback in the presence of vision Med. Biol. Eng. Comput. 38 267-74
41. Otto Bock HealthCare GmbH, Michelangelo® (Online). Available: www.ottobock.com/cps/rde/xchg/ob-com-en/hs.xsl/49464.html (Accessed: 09 February 2015) - ref-separator -
42. Engeberg E D and Meek S 2012 Enhanced visual feedback for slip prevention with a prosthetic hand Prosthet. Orthot. Int. 36 423-9
43. Markovic M, Dosen S, Cipriani C, Popovic D and Farina D 2014 Stereovision and augmented reality for closed-loop control of grasping in hand prostheses J. Neural Eng. 11 46001
44. Dosen S, Markovic M, Somer K, Graimann B and Farina D 2015 EMG Biofeedback for online predictive control of grasping force in a myoelectric prosthesis J. Neuroeng. Rehabil. 12 55
45. Schweisfurth M A, Dosen S, Teich F and Farina D 2015 Electrotactile EMG feedback improves the control of prosthesis grasping force, in review J. Neural Eng. 13 1-15
46. Otto Bock HealthCare GmbH, Michelangelo®. (n.d.) http://www.ottobock.com/cps/rde/xchg/ob-com-en/hs.xsl/49464.html (Accessed: 9 February 2015) - ref-separator -
47. Google Glass, Google Inc. (Online). Available: https://developers.google.com/glass/distribute/glass-at-work (Accessed: 25 July 2016) - ref-separator -
48. Lewis S, Russold M F, Dietl H and Kaniusas E 2013 Satisfaction of prosthesis users with electrical hand prostheses and their sugggested improvements Biomed. Tech.
49. Gonzelman J, Ellis H and Clayton O 1953 Prosthetic device sensory attachment US Patent Specification US2656545A
50. Saunders I and Vijayakumar S 2011 The role of feed-forward and feedback processes for closed-loop prosthesis control J. Neuroeng. Rehabil. 8 60
51. Schweisfurth M A, Markovic M, Dosen S, Teich F, Graimann B and Farina D 2016 Electrotactile EMG feedback improves the control of prosthesis grasping force J. Neural Eng. 13 56010
52. Markovic M, Dosen S, Popovic D, Graimann B and Farina D 2015 Sensor fusion and computer vision for context-aware control of a multi degree-of-freedom prosthesis J. Neural Eng. 12 66022
53. Lum P S, Black I, Holley R J, Barth J and Dromerick A W 2014 Internal models of upper limb prosthesis users when grasping and lifting a fragile object with their prosthetic limb Exp. Brain Res.
54. Clemente F, Dosen S, Lonini L, Markovic M, Farina D and Cipriani C 2016 Humans can integrate augmented reality feedback in their sensorimotor control of a robotic hand IEEE Trans. Human-Mach. Syst. pp 1-7
55. The best smartglasses 2017: Snap, Vuzix, ODG, Sony and more (Online). Available: www.wareable.com/headgear/the-best-smartglasses-google-glass-and-the-rest (Accessed: 26 January 2017) - ref-separator -
56. Man embeds smartphone into prosthetic arm-CNET (Online). Available: www.cnet.com/news/man-embeds-smartphone-into-prosthetic-arm/ (Accessed: 26 January 2017) - ref-separator