Recognizing the grasp intention from human demonstration

Robotics and Autonomous Systems

Volumn 74, Issue , 2015, Pages 108-121

  De Souza, Ravin ^a,b   El Khoury, Sahar ^a   Santos Victor, José ^b   Billard, Aude ^a  

^a EPFL   (Switzerland)

^b INSTITUTO SUPERIOR TÉCNICO   (Portugal)

Author keywords

Grasp recognition; Grasp representation; Learning from demonstration; Tactile sensing

Indexed keywords

ROBOTICS;

FUNCTIONAL PROPERTIES; GRASP RECOGNITION; GRASP REPRESENTATION; HAND-FUNCTIONALITY; HUMAN DEMONSTRATIONS; INTERMEDIATE REPRESENTATIONS; LEARNING FROM DEMONSTRATION; TACTILE SENSING;

GESTURE RECOGNITION;

EID: 84942538092     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2015.07.006     Document Type: Article

References (33)

1. L. Biagiotti, F. Lotti, C. Melchiorri, G. Vassura How Far Is the Human Hand? A Review on Anthropomorphic Robotic Endeffectors 2015 University of Bologna Italy
2. J.T. Belter, A.M. Dollar Performance characteristics of anthropomorphic prosthetic hands IEEE International Conference on Rehabilitation Robotics 2011 Department of Mechanical Engineering and Materials Science, Yale University New Haven, CT 06511, USA, IEEE 1 7
3. M.R. Cutkosky On grasp choice, grasp models, and the design of hands for manufacturing tasks IEEE Trans. Robot. Autom. 5 3 1989 269 279
4. T. Iberall The nature of human prehension: three dexterous hands in one IEEE Int. Conf. on Robotics and Automation, vol. 4 1987 IEEE 396 401
5. S.B. Kang, K. Ikeuchi, Robot task programming by human demonstration: mapping human grasps to manipulator grasps, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 1, 1994.
6. M. Santello, M. Flanders, J.F. Soechting Postural hand synergies for tool use J. Neurosci. 18 23 1998 10105 10115
7. H. Ben Amor, O. Kroemer, U. Hillenbrand, G. Neumann, J. Peters Generalization of human grasping for multi-fingered robot hands IEEE/RSJ International Conference on Intelligent Robots and Systems 2012 IEEE 2043 2050 URL http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=6386072
8. U. Prieur, V. Perdereau, A. Bernardino, Modeling and planning high-level in-hand manipulation actions from human knowledge and active learning from demonstration, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, 2012, pp. 1330-1336.
9. R.S. Johansson, J.R. Flanagan Coding and use of tactile signals from the fingertips in object manipulation tasks Nat. Rev. Neurosci. 10 5 2009 345 359
10. N. Kamakura, M. Matsuo, H. Ishii, F. Mitsuboshi, Y. Miura Patterns of static prehension in normal hands Amer. J. Occup. Therapy 34 7 1980 437 445
11. H. Kjellstrom, J. Romero, D. Kragic, Visual recognition of grasps for human-to-robot mapping, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2008.
12. H. Friedrich, V. Grossmann, M. Ehrenmann, O. Rogalla, R. Zollner, R. Dillman, Towards cognitive elementary operators: grasp classification using neural network classifiers, in: International Conference on Intelligent Systems and Control, 1999.
13. S. Ekvall, D. Kragic, Grasp Recognition for Programming by Demonstration, in: IEEE International Conference on Robotics and Automation, 2005.
14. J. Aleotti, S. Caselli, Grasp recognition in virtual reality for robot pregrasp planning by demonstration, in: IEEE International Conference on Robotics and Automation, 2006.
15. K. Bernardin, K. Ogawara, K. Ikeuchi, R. Dillmann A sensor fusion approach for recognizing continuous human grasping sequences using hidden Markov models IEEE Trans. Robot. 21 1 2015
16. P.H. Thakur, A.J. Bastian, S.S. Hsiao Multidigit movement synergies of the human hand in an unconstrained haptic exploration task J. Neurosci. 28 6 2008 1271 1281
17. M.T. Ciocarlie, P.K. Allen Hand posture subspaces for dexterous robotic grasping Int. J. Robot. Res. 28 7 2009 851 867
18. A. Bernardino, M. Henriques, N. Hendrich, J. Zhang Precision grasp synergies for dexterous robot hands ROBIO 2013
19. K. Murakami, K. Matsuo, T. Hasegawa, R. Kurazume A decision method for placement of tactile elements on a sensor glove for the recognition of grasp types IEEE/ASME Trans. Mechatronics 15 1 2015
20. D.R. Faria, R. Martins, J. Lobo, J. Dias Extracting data from human manipulation of objects towards improving autonomous robotic grasping Robot. Auton. Syst. 60 3 2012 396 410
21. T. Iberall Human prehension and dexterous robot hands Int. J. Robot. Res. 16 3 1997 285 299
22. M.A. Arbib, T. Iberall, D. Lyons Coordinated control programs for movements of the hand Exp. Brain Res. 10 1985 111 129
23. T. Iberall, G. Bingham, M.A. Arbib Opposition space as a structuring concept for the analysis of skilled hand movements Exp. Brain Res. 15 1986 158 173
24. T. Iberall, J. Jackson, L. Labbe, R. Zampano, Knowledge-based prehension: Capturing human dexterity, in: IEEE International Conference on Robotics and Automation, Philadelphia, 1988, pp. 82-87.
25. T. Iberall, G. Sukhatme, D. Beattie, G. Bekey, On the development of EMG control for a prosthetic hand, in: IEEE Internation Conference on Robotics and Automation, 1994.
26. E. Oztop, N.S. Bradley, M.A. Arbib Infant grasp learning: a computational model Exp. Brain Res. 158 4 2004 480 503
27. E. Oztop, M.A. Arbib Schema design and implementation of the grasp-related mirror neuron system Biol. Cybernet. 87 2 2002 116 140
28. S.B. Kang, K. Ikeuchi Toward automatic robot instruction from perception-recognizing a grasp from observation IEEE Trans. Robot. Autom. 9 4 2015
29. Cyberglove, URL: www.cyberglovesystems.com.
30. TekScan, URL: www.tekscan.com.
31. R.L. De Souza, S. El Khoury, J. Santos-Victor, A. Billard, Towards comprehensive capture of human grasping and manipulation skills, in: 13th International Symposium on the 3-D Analysis of Human Movement, Lausanne, Switzerland, 2014.
32. T. Feix, R. Pawlik, H. Schmiedmayer, J. Romero, D. Kragic, A comprehensive grasp taxonomy, in: Robotics, Science and Systems: Workshop on Understanding the Human Hand for Advancing Robotic Manipulation, 2009. URL: http://grasp.xief.net.
33. R. Murray, S. Sastry, Z. Li A Mathematical Introduction To Robotic Manipulation, vol. 29 1994 CRC Press