Single-Grasp Object Classification and Feature Extraction with Simple Robot Hands and Tactile Sensors

IEEE Transactions on Haptics

Volumn 9, Issue 2, 2016, Pages 207-220

  Spiers, Adam J ^a   Liarokapis, Minas V ^a   Calli, Berk ^a   Dollar, Aaron M ^a  

^a Yale University   (United States)

Author keywords

adaptive grasping; haptics applications; machine learning; object classification; object feature extraction; robotics; Tactile sensing; underactuated robot hands

Indexed keywords

ARTIFICIAL INTELLIGENCE; ATMOSPHERIC PRESSURE; DECISION TREES; EXTRACTION; FEATURE EXTRACTION; LEARNING SYSTEMS; ROBOTIC ARMS; ROBOTICS; ROBOTS;

ADAPTIVE GRASPING; HAPTICS; OBJECT CLASSIFICATION; TACTILE SENSING; UNDERACTUATED ROBOT;

CLASSIFICATION (OF INFORMATION);

ANATOMY AND HISTOLOGY; ANIMAL; BIOMECHANICS; EQUIPMENT DESIGN; FINGER; HAND; HAND STRENGTH; HUMAN; PHYSIOLOGY; PROCEDURES; ROBOTICS; TOUCH;

ANIMALS; BIOMECHANICAL PHENOMENA; EQUIPMENT DESIGN; FINGERS; HAND; HAND STRENGTH; HUMANS; ROBOTICS; TOUCH;

EID: 84976421816     PISSN: 19391412     EISSN: None     Source Type: Journal    
DOI: 10.1109/TOH.2016.2521378     Document Type: Article

References (43)

1. S. J. Lederman and R. L. Klatzky, "Extracting object properties through haptic exploration," Acta Psychologica, vol. 84, pp. 29-40, 1993.
2. A. M. Okamura, M. L. Turner, and M. R. Cutkosky, "Haptic exploration of objects with rolling and sliding," in Proc. IEEE Int. Conf. Robot. Autom., vol. 3, 1997.
3. V. Chu, I. McMahon, L. Riano, C. G. McDonald, J. M. Perez-Tejada, M. Arrigo, N. Fitter, J. C. Nappo, T. Darrell, and K. J. Kuchenbecker, "Using robotic exploratory procedures to learn the meaning of haptic adjectives," in Proc. IEEE Int. Conf. Robot. Autom., 2013, pp. 3048-3055.
4. Z. Su, J. A. Fishel, T. Yamamoto, and G. E. Loeb, "Use of tactile feedback to control exploratory movements to characterize object compliance," Frontiers Neurorob., vol. 6, pp. 1-9, 2012.
5. A. Bierbaum, M. Rambow, T. Asfour, and R. Dillmann, "A potential field approach to dexterous tactile exploration of unknown objects," in Proc. 8th IEEE-RAS Int. Conf. Humanoid Robots, Humanoids, 2008, pp. 360-366.
6. J. A. Fishel and G. E. Loeb, "Bayesian exploration for intelligent identification of textures.," Frontiers Neurorob., vol. 6, p. 4, Jan. 2012.
7. P. Dario, P. Ferrante, G. Giacalone, L. Livaldi, B. Allotta, G. Buttazzo, and A. M. Sabatini, "Planning and executing tactile exploratory procedures," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., vol. 3, 1992, pp. 1896-1903.
8. R. L. Klatzky and S. J. Lederman, "Identifying objects from a haptic glance," Perception Psychophys., vol. 57, no. 8, pp. 1111-1123, 1995.
9. R. R. Ma, L. U. Odhner, and A. M. Dollar, "A modular, opensource 3D printed underactuated hand," in Proc. IEEE Int. Conf. Rob. Autom., 2013, pp. 2737-2743.
10. L. U. Odhner and A. M. Dollar, "Stable, open-loop precision manipulation with underactuated hands," Int. J. Robot. Res., vol. 34, no. 11, pp. 1347-1360, 2015.
11. M. Liarokapis, B. Calli, A. Spiers, and A. Dollar, "Unplanned, model-free, single grasp object classification with underactuated hands and force sensors," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2015, pp. 5073-5080.
12. Y. Tenzer, L. P. Jentoft, and R. D. Howe, "The feel of MEMS barometers: Inexpensive and easily customized tactile array sensors," IEEE Robot. Autom. Mag., vol. 21, no. 3, pp. 89-95, Sep. 2014.
13. R. S. Johansson and J. R. Flanagan, "Coding and use of tactile signals from the fingertips in object manipulation tasks," Nat. Rev. Neurosci., vol. 10, no. 5, pp. 345-59, May 2009.
14. S. J. Lederman and R. L. Klatzky, "Hand movements: A window into haptic object recognition," Cognitive Psychol., vol. 19, no. 3, pp. 342-368, Jul. 1987.
15. N. Wettels, J. A. Fishel, Z. Su, C. H. Lin, and G. E. Loeb, "Multimodal synergistic tactile sensing," in Proc. IEEE/RAS Int. Conf. Humanoid Robot., vol. 105, no. 2, 2009, pp. 2-4.
16. S. J. Lederman and R. L. Klatzky, "Haptic identification of common objects: Effects of constraining the manual exploration process.," Perception Psychophys., vol. 66, no. 4, pp. 618-628, 2004.
17. E. B. Vander Poorten, E. Demeester, and P. Lammertse, "Haptic feedback for medical applications, a survey," in Proc. Actuator, 2012, pp. 519-525.
18. A. Spiers, S. Baillie, T. Pipe, and R. Persad, "Experimentally driven design of a palpating gripper with minimally invasive surgery considerations," in Proc. IEEE Haptics Symp., Mar. 2012, pp. 261-266.
19. R. L. Klatzky, J. M. Loomis, S. J. Lederman, H. Wake, and N. Fujita, "Haptic identification of objects and their depictions," Perception Psychophys., vol. 54, no. 2, pp. 170-178, 1993.
20. L. Birglen, T. Laliberté, and C. M. Gosselin, "Underactuated robotic hands," in Springer Tracts in Advanced Robotics. Berlin, Germany: Springer Science & Business Media, 2008, p. 244.
21. L. P. Jentoft, Q. Wan, and R. D. Howe, "Limits to compliance and the role of tactile sensing in grasping," in Proc. IEEE Int. Conf. Robot. Autom.,May 31, 2014-Jun. 7, 2014, pp. 6394-6399.
22. A. M. D. Ravi Balasbramanian, "A framework for studying underactuation in the human hand," in Proc. Annu. Meet. Americal Soc. Biomechanics, 2010, pp. 5-6.
23. B. Belzile and L. Birglen, "A compliant self-adaptive gripper with proprioceptive haptic feedback," Auton. Robots, vol. 36, pp. 79-91, 2014.
24. H. Tsutsui, Y. Murashima, N. Honma, and K. Akazawa, "Robot hand with soft tactile sensors and underactuated control," in Proc. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., 2013, pp. 4148-4151.
25. A. M. Dollar, L. P. Jentoft, J. H. Gao, and R. D. Howe, "Contact sensing and grasping performance of compliant hands," Autonomous Robots, vol. 28, no. 1, pp. 65-75, 2010.
26. L. P. Jentoft and R. D. Howe, "Determining object geometry with compliance and simple sensors," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2011, pp. 3468-3473.
27. A. Drimus, M. Borlum Petersen, and A. Bilberg, "Object texture recognition by dynamic tactile sensing using active exploration," in Proc. 21st IEEE Int. Symp. Robot Human Interactive Commun., 2012, pp. 277-283.
28. S. Chitta, M. Piccoli, and J. Sturm, "Tactile object class and internal state recognition for mobile manipulation," in Proc. IEEE Int. Conf. Robot. Autom., 2010, pp. 2342-2348.
29. A. M. Okamura and M. R. Cutkosky, "Feature detection for haptic exploration with robotic fingers," Int. J. Robot. Res., vol. 20, no.12, pp. 925-938, 2001.
30. U. Martinez-Hernandez, G. Metta, T. J. Dodd, T. J. Prescott, L. Natale, and N. F. Lepora, "Active contour following to explore object shape with robot touch," in Proc. World Haptics Conf., Apr. 2013, pp. 341-346.
31. J. M. Romano, K. Hsiao, G. Niemeyer, S. Chitta, and K. J. Kuchenbecker, "Human-inspired robotic grasp control with tactile sensing," IEEE Trans. Robot., vol. 27, no. 6, pp. 1067-1079, Dec. 2011.
32. I. Bandyopadhyaya, D. Babu, A. Kumar, and J. Roychowdhury, "Tactile sensing based softness classification using machine learning," in Proc. IEEE Int. Adv. Comput. Conf., 2014, pp. 1231-1236.
33. H. K. Lam, U. Ekong, H. Liu, B. Xiao, H. Araujo, S. H. Ling, and K. Y. Chan, "A study of neural-network-based classifiers for material classification," Neurocomputing, vol. 144, pp. 367-377, Nov. 2014.
34. A. Schneider, J. Sturm, C. Stachniss, M. Reisert, H. Burkhardt, and W. Burgard, "Object identification with tactile sensors using bagof-features," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2009, pp. 243-248.
35. A. Drimus, G. Kootstra, A. Bilberg, and D. Kragic, "Design of a flexible tactile sensor for classification of rigid and deformable objects," Robot. Auton. Syst., vol. 62, no. 1, pp. 3-15, Jan. 2014.
36. H. Soh and Y. Demiris, "Incrementally learning objects by touch: Online discriminative and generative models for tactile-based recognition," IEEE Trans. Haptics, vol. 7, no. 4, pp. 512-25, Jan. 2014.
37. M. Madry, L. Bo, D. Kragic, and D. Fox, "ST-HMP: Unsupervised Spatio-Temporal feature learning for tactile data," in Proc. IEEE Int. Conf. Robot. Autom., 2014, pp. 2262-2269.
38. B. Calli, A. Walsman, A. Singh, S. Srinivasa, P. Abbeel, and A. M. Dollar, "Benchmarking in manipulation research: The YCB object and model set and benchmarking protocols," IEEE Robot. Autom. Mag., pp. 36-52, Sep. 2015.
39. Tin Kam Ho, "Random decision forests," in Proc. 3rd Int. Conf. Document Anal. Recog., vol. 1, 1995, pp. 278-282.
40. L. Breiman, "Random forests," Mach. Learning, vol. 45, no. 1, pp. 5-32, 2001.
41. L. U. Odhner and A. M. Dollar, "The smooth curvature model: An efficient representation of Euler-Bernoulli flexures as robot joints," IEEE Trans. Robot., vol. 28, no. 4, pp. 761-772, Aug. 2012.
42. R. Suárez, M. Roa, J. Cornella, and J. Cornell, "Grasp quality measures," Institut d'Organització i Control de Sistemes Ind., Universitat Politécnica de Catalunya, Barcelona, Spain, Tech. Rep. IOCDT-P 2006-10, 2006.
43. S. Theodoridis and K. Koutroumbas, Pattern Recognition, Academic Press, vol. 4, 2008.