Generality and legibility in mobile manipulation: Learning skills for routine tasks

Autonomous Robots

Volumn 28, Issue 1, 2010, Pages 21-44

  Beetz, Michael ^a   Stulp, Freek ^a   Esden Tempski, Piotr ^a   Fedrizzi, Andreas ^a   Klank, Ulrich ^a   Kresse, Ingo ^a   Maldonado, Alexis ^a   Ruiz, Federico ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Computer vision; Grasping; Human environments; Low level control; Manipulation; Planning; Reaching

Indexed keywords

AUTONOMOUS MANIPULATION; CONTROL MECHANISM; HUMAN ENVIRONMENT; HUMAN ENVIRONMENTS; LEARNING SKILLS; LIVING ENVIRONMENT; LOW LEVEL CONTROL; MOBILE MANIPULATION; MODEL-BASED; NOVEL TASK; VISUAL RECOGNITION;

COMPUTER VISION; LEVELING (MACHINERY);

LEVEL CONTROL;

EID: 73549125474     PISSN: 09295593     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10514-009-9152-9     Document Type: Article

References (57)

1. A. Albu-Schaffer S. Haddadin Ch. Ott A. Stemmer T. Wimbock G. Hirzinger 2007 The dlr lightweight robot: design and control concepts for robots in human environments Industrial Robot: An International Journal 34 5 376 385 10.1108/01439910710774386 (Pubitemid 47283169)
2. Asfour, T., Regenstein, K., Azad, P., Schroder, J., Bierbaum, A., Vahrenkamp, N., & Dillmann, R. (2006). Armar-iii: An integrated humanoid platform for sensory-motor control. In Proceedings of the IEEERAS/RSJ international conference on humanoid robots (Humanoids06) (pp. 169-175).
3. Beetz, M., Stulp, F., Radig, B., Bandouch, J., Blodow, N., Dolha, M., Fedrizzi, A., Jain, D., Klank, U., Kresse, I., Maldonado, A., Marton, Z., Mösenlechner, L., Ruiz, F., Rusu, R. B., & Tenorth, M. (2008). The assistive kitchen-a demonstration scenario for cognitive technical systems. In IEEE 17th international symposium on robot and human interactive communication (RO-MAN), Muenchen, Germany. Invited paper.
4. Belker, T. (2004). Plan projection, execution, and learning for mobile robot control. PhD thesis, Department of Applied Computer Science, University of Bonn.
5. Berenson, D., Diankov, R., Nishiwaki, K., Kagami, S., & Kuffner, J. (2007). Grasp planning in complex scenes. In IEEE-RAS international conference on humanoid robots.
6. Berenson, D., Srinivasa, S., Ferguson, D., Romea, A. C., & Kuffner, J. (2009). Manipulation planning with workspace goal regions. In Proceedings of the IEEE international conference on robotics and automation (ICRA).
7. Billard, A., Calinon, S., Dillmann, R., & Schaal, S. (2008). Robot programming by demonstration. In Springer handbook of robotics. Berlin: Springer. Chap. 59.
8. Borst, C., Fischer, M., Haidacher, S., Liu, H., & Hirzinger, G. (2003). Dlr hand ii: Experiments and experiences with an anthropomorphic hand. In 2003 IEEE international conference on robotics and automation (ICRA), Taipei, Taiwan, 14-19 September 2003.
9. S. Calinon F. Guenter A. Billard 2007 On learning, representing and generalizing a task in a humanoid robot IEEE Transactions on Systems, Man and Cybernetics 37 2 286 298 10.1109/TSMCB.2006.886952 Special issue on robot learning by observation, demonstration and imitation (Pubitemid 46523219)
10. G. Cheng S. Hyon J. Morimoto A. Ude J. G. Hale G. Colvin W. Scroggin S. C. Jacobsen 2007 Cb: A humanoid research platform for exploring neuroscience Journal of Advanced Robotics 21 10 1097 1114 10.1163/156855307781389356 (Pubitemid 47186901)
11. Dearden, A., & Demiris, Y. (2005). Learning forward models for robotics. In Proceedings of the nineteenth international joint conference on artificial Intelligence (IJCAI) (pp. 1440-1445).
12. Fedrizzi, A., Moesenlechner, L., Stulp, F., & Beetz, M. (2009). Transformational planning for mobile manipulation based on action-related places. In Proceedings of the international conference on advanced robotics (ICAR).
13. T. Flash B. Hochner 2005 Motor primitives in vertebrates and invertebrates Current Opinion in Neurobiology 15 660 666 10.1016/j.conb.2005.10. 011 (Pubitemid 41682306)
14. Fox, M., Gough, J., & Long, D. (2006). Using learned action models in execution monitoring. In Proceedings of UK planning and scheduling SIG.
15. Gerkey, B., Vaughan, R. T., & Howard, A. (2003). The Player/Stage Project: Tools for multi-robot and distributed sensor systems. In Proceedings of the 11th international conference on advanced robotics (ICAR) (pp. 317-323).
16. Haigh, K. Z. (1998). Situation-dependent learning for interleaved planning and robot execution. Ph.D. thesis, School of Computer Science, Carnegie Mellon University.
17. C. M. Harris D. M. Wolpert 1998 Signal-dependent noise determines motor planning Nature 394 20 780 784 10.1038/29528 (Pubitemid 28391641)
18. Hoffmann, H., Pastor, P., Park, D.-H., & Schaal, S. (2009). Biologically-inspired dynamical systems for movement generation: Automatic real-time goal adaptation and obstacle avoidance. In IEEE international conference on robotics and automation.
19. Hofhauser, A., Steger, C., & Navab, N. (2008). Harmonic deformation model for edge based template matching. In Third international conference on computer vision theory and applications (Vol. 2, pp. 75-82).
20. Horswill, I. (1996). Integrated systems and naturalistic tasks. In Strategic directions in computing research AI working group.
21. Ijspeert, A. J., Nakanishi, J., & Schaal, S. (2002). Movement imitation with nonlinear dynamical systems in humanoid robots. In International conference on robotics and automation (ICRA2002).
22. Jenkins, O., Bodenheimer, R., & Peters, R. (2006). Manipulation manifolds: Explorations into uncovering manifolds in sensory-motor spaces. In International conference on development and learning (ICDL).
23. Julier, S., & Uhlmann, J. K. (1996). A general method for approximating nonlinear transformations of probability distributions (Technical report). Dept. of Engineering Science, University of Oxford.
24. Katz, D., Horrell, E., Yang, Y., Burns, B., Buckley, T., Grishkan, A., Zhylkovskyy, V., Brock, O., & Miller, E. (2006). The UMass mobile manipulator UMan: an experimental platform for autonomous mobile manipulation. In Workshop on manipulation in human environments at robotics: science and systems.
25. C. Kemp A. Edsinger E. Torres-Jara 2007 Challenges for robot manipulation in human environments IEEE Robotics and Automation Magazine 14 1 20 29 10.1109/MRA.2007.339604 (Pubitemid 46566614)
26. Klank, U., Zia, M. Z., & Beetz, M. (2009). 3D model selection from an Internet database for robotic vision. In International conference on robotics and automation (ICRA).
27. D. Kragic M. Björkman H. I. Christensen J. O. Eklundh 2005 Vision for robotic object manipulation in domestic settings Robotics and Autonomous Systems 52 1 85 100 10.1016/j.robot.2005.03.007 (Pubitemid 40851846)
28. LaValle, S. M. (2006). Planning algorithms. Cambridge: Cambridge University Press.
29. V. Lepetit P. Fua 2006 Keypoint recognition using randomized trees IEEE Transactions on Pattern Analysis and Machine Intelligence 28 9 1465 1479 10.1109/TPAMI.2006.188 (Pubitemid 44132652)
30. A. A. Maciejewski C. A. Klein 1989 The singular value decomposition: Computation and applications to robotics International Journal of Robotics Research 8 6 63 79 10.1177/027836498900800605
31. McDermott, D. (1991). A reactive plan language (Research Report YALEU/DCS/RR-864). Yale University.
32. Metta, G., Fitzpatrick, P., & Natale, L. (2006). YARP: Yet Another Robot Platform. International Journal of Advanced Robotics Systems, 3(1). Special issue on Software Development and Integration in Robotics.
33. Okada, K., Kojima, M., Sagawa, Y., Ichino, T., Sato, K., & Inaba, M. (2006). Vision based behavior verification system of humanoid robot for daily environment tasks. In Proceedings of the 6th IEEE-RAS international conference on humanoid robots (humanoids) (pp. 7-12).
34. R. Osada T. Funkhouser B. Chazelle D. Dobkin 2002 Shape distributions ACM Transactions on Graphics (TOG) 21 4 807 832 10.1145/571647.571648
35. E. Oztop D. W. Franklin T. Chaminade G. Cheng 2005 Human-humanoid interaction: Is a humanoid robot perceived as a human? International Journal of Humanoid Robotics 2 4 537 559 10.1142/S0219843605000582
36. Park, D.-H., Hoffmann, H., & Schaal, S. (2008). Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields. In International conference on humanoid robots.
37. Petrovskaya, A., & Ng, A. Y. (2007). Probabilistic mobile manipulation in dynamic environments, with application to opening doors. In International joint conference on artificial intelligence (IJCAI-07).
38. Roduit, P., Martinoli, A., & Jacot, J. (2007). A quantitative method for comparing trajectories of mobile robots using point distribution models. In Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 2441-2448).
39. Rosenbaum, D. A., Cohen, R. G., Meulenbroek, R. G. J., & Vaughan, J. (2006). Plans for grasping objects. In M. L. Latash & F. Lestienne (Eds.), Motor control and learning (pp. 9-25). New York: Springer.
40. S. Roweis L. Saul 2000 Nonlinear dimensionality reduction by locally linear embedding Science 290 5500 2323 2326 10.1126/science.290.5500.2323 (Pubitemid 32041578)
41. Rusu, R. B., Marton, Z. C., Blodow, N., Dolha, M., & Beetz, M. (2008). Towards 3D point cloud based object maps for household environments. Robotics and Autonomous Systems Journal. (Special issue on Semantic Knowledge).
42. A. Saxena J. Driemeyer A. Y. Ng 2008 Robotic grasping of novel objects using vision The International Journal of Robotics Research 27 2 157 10.1177/0278364907087172 (Pubitemid 351169712)
43. S. Schaal 1999 Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences 3 6 233 242 10.1016/S1364-6613(99)01327-3 (Pubitemid 29261903)
44. Smits, R., De Laet, T., Claes, K., Soetens, P., De Schutter, J., & Bruyninckx, H. (2008). Orocos: A software framework for complex sensor-driven robot tasks. IEEE Robotics and Automation Magazine.
45. Srinivasa, S., Ferguson, D., Weghe, M. V., Diankov, R., Berenson, D., Helfrich, C., & Strasdat, H. (2008). The robotic busboy: Steps towards developing a mobile robotic home assistant. In International conference on intelligent autonomous systems.
46. Stulp, F., & Beetz, M. (2008). Refining the execution of abstract actions with learned action models. Journal of Artificial Intelligence Research (JAIR), 32, June 2008.
47. Stulp, F., Koska, W., Maldonado, A., & Beetz, M. (2007). Seamless execution of action sequences. In Proceedings of the IEEE international conference on robotics and automation (ICRA) (pp. 3687-3692).
48. Stulp, F., Kresse, I., Maldonado, A., Ruiz, F., Fedrizzi, A., & Beetz, M. (2009, to appear). Compact models of human reaching motions for robotic control in everyday manipulation tasks. In Proceedings of the 8th international conference on development and learning (ICDL).
49. Tenorth, M., Nyga, D., & Beetz, M. (2009). Understanding and executing instructions for everyday manipulation tasks from the world wide web (Technical report). IAS Group, Technische Universität München, Fakultät für Informatik.
50. E. Todorov 2004 Optimality principles in sensorimotor control Nature Neuroscience 7 9 907 915 10.1038/nn1309 (Pubitemid 39129496)
51. Wiedemann, C., Ulrich, M., & Steger, C. (2008). Recognition and tracking of 3d objects. In G. Rigoll (Ed.), Lecture notes in computer science : Vol. 5096. Pattern recognition (pp. 132-141). Berlin: Springer.
52. Wilhelm, A., Huissoon, J., Melek, W., Clark, C., Fuchs, M., & Hirzinger, G. (2007). Design of a wheeled mobile robotic platform with variable footprint. In IEEE/RSJ conference on intelligent robotics and systems.
53. PR2 Robot. (2008). www.willowgarage.com/pages/robots/pr2-overview.
54. M. Wimmer F. Stulp S. Pietzsch B. Radig 2008 Learning local objective functions for robust face model fitting IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 30 8 1357 1370 10.1109/TPAMI.2007.70793
55. D. Wolpert Z. Ghahramani 2000 Computational principles of movement neuroscience Nature Neuroscience Supplement 3 1212 1217 10.1038/81497
56. Zacharias, F., Borst, Ch., & Hirzinger, G. (2007). Capturing robot workspace structure: representing robot capabilities. In Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 3229-3236).
57. Zacharias, F., Borst, Ch., & Hirzinger, G. (2008). Positioning mobile manipulators to perform constrained linear trajectories. In Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 2578-2584).