Reaching in clutter with whole-arm tactile sensing

International Journal of Robotics Research

Volumn 32, Issue 4, 2013, Pages 458-482

  Jain, Advait ^a   Killpack, Marc D ^a   Edsinger, Aaron ^b   Kemp, Charles C ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b Meka Robotics   (United States)

Author keywords

design and control; force and tactile sensing; manipulation; mechanics

Indexed keywords

DESIGN AND CONTROL; EXPLICIT MODELS; MANIPULATION; MECHANICAL MODEL; MULTIPLE CONTACTS; REDUCED VISIBILITY; ROBOT MANIPULATION; TACTILE SENSING;

CONCRETE BLOCKS; MANIPULATORS; MECHANICS; MODEL PREDICTIVE CONTROL; PREDICTIVE CONTROL SYSTEMS; ROBOTS;

CLUTTER (INFORMATION THEORY);

EID: 84876582416     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364912471865     Document Type: Article

References (119)

1. Abbeel P, Coates A, Ng A. Autonomous helicopter aerobatics through apprenticeship learning. International Journal of Robotics Research. 2010 ; 29: 1608-1639
2. Albu-Schaffer A, Ott C, Frese U, Hirzinger G. Cartesian impedance control of redundant robots: Recent results with the DLR-light-weight-arms. IEEE international conference on robotics and automation (ICRA '03) ; 2003 ; 2003. 3704.
3. Alexander R. Three uses for springs in legged locomotion. International Journal of Robotics Research. 1990 ; 9: 53-61
4. Bellingham J, Richards A, How J. Receding horizon control of autonomous aerial vehicles. American control conference ; 2002 ; 2002. 3741.
5. Bianchi L. Mechanotransduction: Touch and feel at the molecular level as modeled in caenorhabditis elegans. Molecular Neurobiology. 2007 ; 36 (3). 254-271
6. Bicchi A. Force distribution in multiple whole-limb manipulation. IEEE international conference on robotics and automation (ICRA '93) ; 1993 ; 1993. 196.
7. Bicchi A, Kumar V. Robotic grasping and contact: A review. IEEE international conference on robotics and automation (ICRA '00) ; 2000 ; 2000. 238.
8. Bicchi A, Salisbury J, Brock D. Contact sensing from force measurements. International Journal of Robotics Research. 1993 ; 12: 249-262
9. Bierbaum A, Asfour T, Dillmann R. Dynamic potential fields for dexterous tactile exploration. Human Centered Robot Systems. 2009 ; 6: 23-31
10. Boyd S, Vandenberghe L Convex Optimization. Cambridge: Cambridge University Press ; 2004 :
11. Buerger S, Hogan N. Complementary stability and loop shaping for improved human-robot interaction. IEEE Transactions on Robotics. 2007 ; 23 (2). 232-244
12. Byl K, Tedrake R. Approximate optimal control of the compass gait on rough terrain. IEEE international conference on robotics and automation (ICRA'08) ; 2008 Pasadena, CA ; 2008. 1258.
13. Catania K. A nose that looks like a hand and acts like an eye: the unusual mechanosensory system of the star-nosed mole. Journal of Comparative Physiology A: Neuroethology, Sensory, Neural, and Behavioral Physiology. 1999 ; 185: 367-372
14. Chitta S, Sturm J, Piccoli M, Burgard W. Tactile sensing for mobile manipulation. IEEE Transactions on Robotics. 2011 ; 27 (99). 1-11
15. Cottle R, Dantzig G. Complementary pivot theory of mathematical programming. Linear Algebra and its Applications. 1968 ; 1: 103-125
16. Cottle R, Pang J, Stone R The Linear Complementarity Problem. Philadelphia, PA: Society for Industrial & Applied Mathematics ; 2009 :
17. Cutkosky MR, Ulmen JV The Human Hand: A Source of Inspiration for Robotic Hands. Santos V Balasubramanian R, ed. Berlin: Springer ; 2012 :
18. De Luca A, Albu-Schaffer A, Haddadin S, Hirzinger G. Collision detection and safe reaction with the DLR-III lightweight manipulator arm. IEEE/RSJ international conference on intelligent robots and systems (IROS '06) ; 2006 Beijing, China ; 2006. 1623.
19. De Luca A, Mattone R. An adapt-and-detect actuator FDI scheme for robot manipulators. IEEE international conference on robotics and automation (ICRA '04) ; 2004 ; 2004. 4975.
20. De Schutter J, Bruyninckx H, Dutré S, De Geeter J, Katupitiya J, Demey S, et al. Estimating first-order geometric parameters and monitoring contact transitions during force-controlled compliant motion. International Journal of Robotics Research. 1999 ; 18: 1161-1184
21. Diankov R, Kuffner J USA: Robotics Institute ; 2008 :
22. Dogar M, Hemrajani V, Leeds D, Kane B, Srinivasa S USA: Carnegie Mellon University ; 2010 :
23. Dogar M, Srinivasa S Robotics: science and systems. Cambridge, MA: The MIT Press ; 2011 :
24. Dominy N. Fruits, fingers, and fermentation: the sensory cues available to foraging primates. Integrative and Comparative Biology. 2004 ; 44: 295-303
25. Duchaine V, Bouchard S, Gosselin C. Computationally efficient predictive robot control. IEEE/ASME Transactions on Mechatronics. 2007 ; 12 (5). 570-578
26. Dupont P, Yamajako S. Jamming and wedging in constrained rigid-body dynamics. IEEE international conference on robotics and automation (ICRA '94) ; 1994 San Diego, CA, USA ; 1994. 2349.
27. EbermanB (1989) Whole-arm manipulation: kinematics and control. MSc Thesis, Massachusetts Institute of Technology, USA.
28. Eberman B, Salisbury J. Determination of manipulator contact information from joint torque measurements. 1st international symposium on experimental robotics ; 1990 ; 1990. 463.
29. Edsinger A, Kemp CC. Human-robot interaction for cooperative manipulation: Handing objects to one another. 16th IEEE international symposium on robot and human interactive communication (RO-MAN '07) ; 2007 a Jeju, Korea ; 2007 a. 1167.
30. Edsinger A, Kemp CC. Two arms are better than one: A behavior-based control system for assistive bimanual manipulation. 13th international conference on advanced robotics (ICAR '07) ; 2007 b ; 2007 b. 345.
31. Erez T, Tassa Y, Todorov E Robotics: science and systems. Cambridge, MA: The MIT Press ; 2011: 73-80.
32. Escande A, Kheddar A. Contact planning for acyclic motion with tasks constraints. IEEE/RSJ international conference on intelligent robots and systems (IROS '09) ; 2009 St Louis, MO, USA ; 2009. 435.
33. Featherstone R, Orin DE Handbook of Robotics. Siciliano B Khatib O, ed. New York: Springer ; 2008 :
34. Frank B, Stachniss C, Abdo N, Burgard W. Using Gaussian process regression for efficient motion planning in environments with deformable objects. Workshops at: 25th AAAI conference on artificial intelligence ; 2011 San Francisco, CA, USA ; 2011..
35. From P, Gravdahl J, Lillehagen T, Abbeel P. Motion planning and control of robotic manipulators on seaborne platforms. Control Engineering Practice. 2011 ; 19: 809-819
36. Ganesh G, Jarrasse N, Haddadin S, Albu-Schaeffer A, Burdet E. A versatile biomimetic controller for contact tooling and haptic exploration. IEEE international conference on robotics and automation (ICRA '12) ; 2012 Saint Paul, MN, USA ; 2012. 3329.
37. Garcia C, Prett D, Morari M. Model predictive control: Theory and practice-a survey. Automatica. 1989 ; 25: 335-348
38. Garcia M, Chatterjee A, Ruina A, Coleman M. The simplest walking model: Stability, complexity, and scaling. Journal of Biomechanical Engineering. 1998 ; 120: 281-288
39. Grosso M, Quach R, Badler N State-of-the Art in Computer Animation. Berlin: Springer ; 1989: 83.
40. Gu X, Ballard D. An equilibrium point based model unifying movement control in humanoids. Robotics: science and systems. 2006 ;:
41. Haddadin S, Albu-Schaffer A, De Luca A, Hirzinger G. Collision detection and reaction: A contribution to safe physical human-robot interaction. IEEE/RSJ international conference on intelligent robots and systems (IROS '08) ; 2008 Nice, Italy ; 2008. 3356.
42. Haddadin S, Belder R, Albu-Schäffer A IFAC world congress. Italy: Milan ; 2011: 6842-6850.
43. Hauser K, Bretl T, Latombe J. Non-gaited humanoid locomotion planning. IEEE conference on humanoid robots ; 2005 Tsukuba, Japan ; 2005. 7.
44. Hersch M, Billard A. A biologically-inspired controller for reaching movements. IEEE/RAS-EMBS international conference on biomedical robotics and biomechatronics (BIOROB '06) ; 2006 Pisa, Italy ; 2006. 1067.
45. Hogan N. Adaptive control of mechanical impedance by coactivation of antagonist muscles. IEEE Transactions on Automatic Control. 1984 ; 29: 681-690
46. Hogan N. On the stability of manipulators performing contact tasks. IEEE Journal of Robotics and Automation. 1988 ; 4 (6). 677-686
47. Hogan N, Buerger S Handbook of Robotics. Siciliano B Khatib O, ed. New York: Springer ; 2005 :
48. Hsiao K, Chitta S, Ciocarlie M, Jones E. Contact-reactive grasping of objects with partial shape information. IEEE/RSJ international conference on intelligent robots and systems (IROS '10) ; 2010 a Taipei, Taiwan ; 2010 a. 1228.
49. Hsiao K, Kaelbling L, Lozano-Pérez T. Task-driven tactile exploration. Robotics: science and systems. 2010 b ;:
50. Hsiao K, Lozano-Perez T. Imitation learning of whole-body grasps. IEEE/RSJ international conference on intelligent robots and systems (IROS '06) ; 2006 Beijing, China ; 2006. 5657.
51. Ivaldi S, Fumagalli M, Nori F, Baglietto M, Metta G, Sandini G. Approximate optimal control for reaching and trajectory planning in a humanoid robot. IEEE/RSJ international conference on intelligent robots and systems (IROS '10) ; 2010 Taipei, Taiwan ; 2010. 1290.
52. Iwaniuk A, Whishaw I. How skilled are the skilled limb movements of the raccoon (procyon lotor)?. Behavioural Brain Research. 1999 ; 99 (1). 35-44
53. Pratt JPD, Chew M, Pratt G. Virtual model control: An intuitive approach for bipedal locomotion. International Journal of Robotics Research. 2001 ; 20 (2). 129-143
54. Jain A, Kemp CC. Behavior-based door opening with equilibrium point control. RSS Workshop Mobile Manipulation in Human Environments at: Robotics: science and systems ; 2009 a ; 2009 a..
55. Jain A, Kemp CC. Pulling open novel doors and drawers with equilibrium point control. IEEE conference on humanoid robots ; 2009 b Paris, France ; 2009 b. 498.
56. Jain A, Kemp CC. EL-E: An assistive mobile manipulator that autonomously fetches objects from flat surfaces. Autonomous Robots. 2010 a ; 28: 45-64
57. Jain A, Kemp CC. Pulling open doors and drawers: coordinating an omni-directional base and a compliant arm with equilibrium point control. IEEE international conference on robotics and automation (ICRA '10) ; 2010 b Anchorage, AK, USA ; 2010 b. 1807.
58. Johnson KL Contact Mechanics. Cambridge: Cambridge University Press ; 1985 :
59. Kaneko M, Tanie K. Contact point detection for grasping an unknown object using self-posture changeability. IEEE Transactions on Robotics and Automation. 1994 ; 3: 355-367
60. Kao I, Lynch K, Burdick JW Handbook of Robotics. Siciliano B Khatib O, ed. New York: Springer ; 2008 :
61. Kavraki LE, LaValle SM Handbook of Robotics. Siciliano B Khatib O, ed. New York: Springer ; 2008 :
62. Khatib O. A unified approach for motion and force control of robot manipulators: The operational space formulation. IEEE Journal of Robotics and Automation. 1987 ; 3: 43-53
63. Killpack M, Deyle T, Anderson C, Kemp C. Visual odometry and control for an omnidirectional mobile robot with a downward-facing camera. IEEE/RSJ international conference on intelligent robots and systems (IROS '10) ; 2010 Taipei, Taiwan ; 2010. 139.
64. Kraft D, Bierbaum A, Kjaergaard M, Ratkevicius J, Kjaer-Nielsen A, Ryberg C, et al. Tactile object exploration using cursor navigation sensors. EuroHaptics symposium on haptic interfaces for virtual environment and teleoperator systems ; 2009 Salt Lake City, UT, USA ; 2009. 296.
65. Kulchenko P, Todorov E. First-exit model predictive control of fast discontinuous dynamics: Application to ball bouncing. IEEE international conference on robotics and automation (ICRA '11) ; 2011 Shanghai, China ; 2011. 2144.
66. LaValle S, Kuffner J. Randomized kinodynamic planning. International Journal of Robotics Research. 2001 ; 20 (5). 378-400
67. Lederman SJ, Klatzky RL. Haptic perception: A tutorial. Attention, Perception and Psychophysics. 2009 ; (71). 1439-1459
68. Leeper A, Hsiao K, Ciocarlie M, Takayama L, Gossow D. Strategies for human-in-the-loop robotic grasping. ACM/IEEE international conference on human robot interaction ; 2012 New York, NY, USA ; 2012. 1.
69. Legagne S, Kheddar A, Yoshida E. Generation of optimal dynamic multi-contact motions: Application to humanoid robots. IEEE Transactions on Robotics. 2011 ;:
70. Lozano-Perez T. A simple motion-planning algorithm for general robot manipulators. IEEE Transactions on Robotics and Automation. 1987 ; 3: 224-238
71. Lumpkin EA, Marshall KL, Nelson AM. The cell biology of touch. Journal of Cell Biology. 2010 ; 191 (2). 237-248
72. Maladen R, Ding Y, Umbanhowar P, Kamor A, Goldman D. Biophysically inspired development of a sand-swimming robot. Robotics: science and systems. 2010 ;:
73. Manchester I, Mettin U, Iida F, Tedrake R. Stable dynamic walking over uneven terrain. International Journal of Robotics Research. 2011 ; 3: 265-279
74. Mason M Mechanics of Robotic Manipulation. Cambridge: MIT Press ; 2001 :
75. Mason M, Rodriguez A, Srinivasa S, Vazquez A. Autonomous manipulation with a general-purpose simple hand. International Journal of Robotics Research. 2011 ; 31: 688-703
76. Mayne D, Rawlings J, Rao C, Scokaert P. Constrained model predictive control: Stability and optimality. Automatica. 2000 ; 36 (6). 789-814
77. McClave J, Benson P, Sincich T Statistics for Business and Economics. New Jersey: Pearson Education ; 2008 :
78. McKenna J, Anhalt D, Bronson F, Brown H, Schwerin M, Shammas E, et al. Toroidal skin drive for snake robot locomotion. IEEE international conference on robotics and automation (ICRA '08) ; 2008 Pasadena, CA, USA ; 2008. 1150.
79. Metta G, Natale L, Nori F, Sandini G. Force control and reaching movements on the ICUB humanoid robot. International symposium on robotics research ; 2011 ; 2011..
80. MiglioreS (2009) The role of passive joint stiffness and active knee control in robotic leg swinging: Applications to dynamic walking. PhD Thesis, Georgia Institute of Technology, USA.
81. Migliore S, Brown E, DeWeerth S. Biologically inspired joint stiffness control. IEEE international conference on robotics and automation (ICRA '05) ; 2005 ; 2005. 4508.
82. Morari M, Lee JH. Model predictive control: past, present and future. Computers & Chemical Engineering. 1999 ; 23 (-5). 667-682
83. Murray R, Li Z, Sastry S A Mathematical Introduction to Robotic Manipulation. New York: CRC Press ; 1994 :
84. Natale L, Torres-Jara E. A sensitive approach to grasping. International workshop on epigenetic robotics ; 2006 Paris, France ; 2006. 87.
85. Okamura A, Curkosky M. Feature-guided exploration with a robotic finger. IEEE international conference on robotics and automation (ICRA '01) ; 2001 ; 2001. 589.
86. Okamura A, Cutkosky M. Haptic exploration of fine surface features. IEEE international conference on robotics and automation (ICRA '99) ; 1999 Detroit, MI, USA ; 1999. 2930.
87. Park J, Khatib O. Robot multiple contact control. Robotica. 2008 ; 26 (5). 667-677
88. Pastor P, Righetti L, Kalakrishnan M, Schaal S. Online movement adaptation based on previous sensor experiences. IEEE/RSJ international conference on intelligent robots and systems (IROS '11) ; 2011 San Francisco, CA ; 2011. 365.
89. Patil S, van den Berg J, Alterovitz R Robotics: science and systems. Cambridge, MA: The MIT Press ; 2011: 242-248.
90. Petrovskaya A, Khatib O. Global localization of objects via touch. IEEE Transactions on Robotics. 2011 ; 27 (3). 569-585
91. Petrovskaya A, Park J, Khatib O. Probabilistic estimation of whole body contacts for multi-contact robot control. IEEE international conference on robotics and automation (ICRA '07) ; 2007 Rome, Italy ; 2007. 568.
92. Pezzementi Z, Plaku E, Reyda C, Hager G. Tactile-object recognition from appearance information. IEEE Transactions on Robotics. 2011 ; 27 (3). 473-487
93. Platt R, Fagg A, Grupen R. Extending fingertip grasping to whole body grasping. IEEE international conference on robotics and automation (ICRA '03) ; 2003 ; 2003. 2677.
94. Platt R, Permenter F, Pfeiffer J. Using Bayesian filtering to interpret tactile data during flexible materials manipulation. IEEE Transactions on Robotics. 2011 ; 27: 586-598
95. Pratt G. Low impedance walking robots 1. Integrative and Comparative Biology. 2002 ; 42 (1). 174-181
96. Pratt G, Williamson M. Series elastic actuators. IEEE/RSJ international conference on intelligent robots and systems (IROS '95) ; 1995 Pittsburgh, PA, USA ; 1995. 399.
97. Prescott T, Pearson M, Fox C, Evans M, Mitchinson B, Anderson S, et al. Towards biomimetic vibrissal tactile sensing for robot exploration, navigation, and object recognition in hazardous environments. 4th international workshop on robotics for risky interventions and environmental surveillance-maintenance (RISE '10) ; 2010 ; 2010..
98. Quigley M, Gerkey B, Conley K, Faust J, Foote T, Leibs J, et al. ROS: An open-source robot operating system. ICRA Open-Source Software workshop at: IEEE international conference on robotics and automation (ICRA '09) ; 2009 ; 2009..
99. Raibert M, Blankespoor K, Nelson G, Playter R, et al. Bigdog, the rough-terrain quadruped robot. 17th world congress. The International Federation of Automatic Control ; 2008 Seoul, South Korea ; 2008. 10822.
100. Raibert M, Craig J. Hybrid position/force control of manipulators. Journal of Dynamic Systems, Measurement, and Control. 1981 ; 102 (127). 126-133
101. Rodriguez S, Lien J, Amato N. Planning motion in completely deformable environments. IEEE international conference on robotics and automation (ICRA '06) ; 2006 Orlando, FL, USA ; 2006. 1067.
102. Romano J, Hsiao K, Niemeyer G, Chitta S, Kuchenbecker K. Human-inspired robotic grasp control with tactile sensing. IEEE Transactions on Robotics. 2011 ; 27: 1067-1079
103. Salisbury JJ. Interpretation of contact geometries from force measurements. IEEE international conference on robotics and automation (ICRA '84) ; 1984 ; 1984. 240.
104. Saranli U, Buehler M, Koditschek D. Rhex: A simple and highly mobile hexapod robot. International Journal of Robotics Research. 2001 ; 20: 616-631
105. Saxena A, Driemeyer J, Ng A. Robotic Grasping of Novel Objects using Vision. International Journal of Robotics Research. 2008 ; 27 (2). 157-173
106. Sentis L, Khatib O. Synthesis of whole-body behaviors through hierarchical control of behavioral primitives. International Journal of Humanoid Robotics. 2005 ; 2: 505-518
107. Sentis L, Park J, Khatib O. Compliant control of multicontact and center-of-mass behaviors in humanoid robots. IEEE Transactions on Robotics. 2010 ; 26 (3). 483-501
108. Shadmehr R. Control of equilibrium position and stiffness through postural modules. Journal of Motor Behavior. 1993 ; 25: 228-241
109. Srinivasa S, Ferguson C, Helfrich D, Berenson D, Collet A, Diankov R, et al. Herb: A home exploring robotic butler. Autonomous Robots. 2009 ; 28: 5-20
110. Stilman M, Nishiwaki K, Kagami S, Kuffner J. Planning and executing navigation among movable obstacles. Advanced Robotics. 2007 a ; 21 (14). 1617-1634
111. Stilman M, Schamburek J, Kuffner J, Asfour T. Manipulation planning among movable obstacles. IEEE international conference on robotics and automation (ICRA '07) ; 2007 b Rome, Italy ; 2007 b. 3327.
112. Stulp F, Kresse I, Maldonado A, Ruiz F, Fedrizzi A, Beetz M. Compact models of human reaching motions for robotic control in everyday manipulation tasks. IEEE international conference on development and learning ; 2009 Shanghai, China ; 2009. 1.
113. Tanaka H, Kushihama K, Ueda N, Hirai S. A vision-based haptic exploration. IEEE international conference on robotics and automation (ICRA '03) ; 2003 ; 2003. 3441.
114. Tilley A, Dreyfuss H The Measure of Man and Woman: Human Factors in Design. New York: Wiley ; 2001 :
115. Whitney D. Quasi-static assembly of compliantly supported rigid parts. Journal of Dynamic Systems, Measurement, and Control. 1982 ; 104: 65-77
116. Whitney D, Nevins J. What is the remote center compliance (RCC) and what can it do. 9th international symposium on industrial robots ; 1979 ; 1979. 135.
117. Wieber P. Trajectory free linear model predictive control for stable walking in the presence of strong perturbations. IEEE-RAS international conference on humanoid robots ; 2006 Genoa, Italy ; 2006. 137.
118. Williamson M. Postural primitives: Interactive behavior for a humanoid robot arm. 4th international conference on simulation of adaptive behavior ; 1996 ; 1996. 124.
119. WilliamsonM (1999) Robot arm control exploiting natural dynamics. PhD Thesis, Massachusetts Institute of Technology, USA.