The new robotics—towards human-centered machines

HFSP Journal

Volumn 1, Issue 2, 2007, Pages 115-126

  Schaal, Stefan ^a,b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 73549098121     PISSN: 19552068     EISSN: 1955205X     Source Type: Journal    
DOI: 10.2976/1.2748612     Document Type: Article

References (135)

1. Aggarwal, JK, and Cai, Q. 1999. “Human motion analysis:A review.”. Comput. Vis. Image Underst., 73:428–440.
2. Albu-Schäffer, A, Ott, C, and Hirzinger, G. 2007. “A unified passivity based control framework for position, torque and impedance control of flexible joint robots.”. Int. J. Robot. Res., 26:23–39.
3. An, CH, Atkeson, CG, and Hollerbach, JM. 1988. Model-Based Control of a Robot Manipulator, Cambridge, MA:MIT Press.
4. Arbib, M. 1995a. The Handbook of Brain Theory and Neural Networks, Cambridge, MA:MIT Press.
5. Arbib, MA. 1995b. “Schema theory.”. In The Handbook of Brain Theory and Neural Networks, Edited by:Arbib, MA. 830–834. Cambridge, MA:MIT Press.
6. Arbib, MA. 2006. Action to Language via the Mirror Neuron System, Cambridge, MA:Cambridge University Press.
7. Arimoto, S, Sekimoto, M, Hashiguchi, H, and Ozawa, R. 2005. “Natural resolution of ill-posedness of inverse kinematics for redundant robots:A challenge to Bernstein's degrees-of-freedom problem.”. Adv. Rob., 19:401–434.
8. Aryananda, L, and Weber, J. 2004. “MERTZ:a quest for a robust and scalable active vision humanoid head robot.”. 2:513–532.
9. Atkeson, CA, Aboaf, EW, McIntyre, J, and Reinkensmeyer, DJ. 1986. “Model-based robot learning.”. 2318–2330. Fourth International Symposium on Robotics Research.
10. Atkeson, CG, Hale, J, Kawato, M, Kotosaka, S, Pollick, F, Riley, M, Schaal, S, Shibata, S, Tevatia, G, and Ude, A. 2000. “Using humanoid robots to study human behaviour.”. IEEE Intell. Syst., 15:46–56.
11. Atkeson, CG, Moore, AW, and Schaal, S. 1997a. “Locally weighted learning.”. Artif. Intell. Rev., 11:11–73.
12. Atkeson, CG, Moore, AW, and Schaal, S. 1997b. “Locally weighted learning for control.”. Artif. Intell. Rev., 11:75–113.
13. Barto, AG, and Mahadevan, S. 2003. “Recent advances in hierarchical reinforcement learning.”. Discrete Event Dyn. Syst., 13:341–379.
14. Beek, PJ. 1989. Juggling Dynamics, Amsterdam:Free University Press.
15. Bellman, R. 1957. Dynamic Programming, Princeton, NJ:Princeton University Press.
16. Bentivegna, DC, Atkeson, CA, and Cheng, G. 2004a. “Learning tasks from observation and practice.”. Rob. Auton. Syst., 47:163–169.
17. Bentivegna, DC, Cheng, G, and Atkeson, CG. “Learning from observation and from practice using behavioral primitives.”. 11th International Symposium on Robotics Research (ISRR2003). Ciena, Italy:Springer.
18. Billard, A, Epars, Y, Calinon, S, Cheng, G, and Schaal, S. 2004. “Discovering optimal imitation strategies.”. Rob. Auton. Syst., 47:68–77.
19. Braun, J. 1994. “Visual search among items of different salience:Removal of visual attention mimics a lesion in extrastriate area V4.”. J. Neurosci., 14:554–567.
20. Breazeal, C, Edsinger, A, Fitzpatrick, P, and Scassellati, B. 2001. “Active vision for sociable robots.”. IEEE Trans. Syst. Man Cybern., 31:443–453.
21. Breazeal, C, and Scassellati, B. 2002. “Robots that imitate humans.”. Trends Cogn. Sci., 6:481–487.
22. Bredenfeld, A, Jacoff, A, Noda, I, and Takahashi, Y. 2006. Robocup 2005:Robot SoccerWorld Cup IX, New York:Springer.
23. Brock, O, Fagg, AH, Grupen, R, Platt, R, Rosenstein, M, and Sweeney, J. 2005. “A framework for learning and control in intelligent humanoid robots.”. Int. J. Humanoid Robotics, 2:301–336.
24. Brown, IE, Cheng, EJ, and Loeb, GE. 1999. “Measured and modeled properties of mammalian skeletal muscle. II. The effects of stimulus frequency on force-length and force-velocity relationships.”. J. Muscle Res. Cell Motil., 20:627–643.
25. Brown, IE, and Loeb, GE. 1999. “Measured and modeled properties of mammalian skeletal muscle. I. The effects of post-activation potentiation on the time course and velocity dependencies of force production.”. J. Muscle Res. Cell Motil., 20:443–456.
26. Bullock, D, and Grossberg, S. 1988. “Neural dynamics of planned arm movements:Emergent invariants and speed-accuracy properties during trajectory formation.”. Psychol. Rev., 95:49–90.
27. Burridge, RR, Rizzi, AA, and Koditschek, DE. 1999. “Sequential composition of dynamically dexterous robot behaviors.”. Int. J. Robot. Res., 18:534–555.
28. Byrne, RW, and Russon, AE. 1998. “Learning by Imitation:A hierarchical approach.”. Behav. Brain Sci., 21:667–684. discussion 684–721.
29. Carmi, R, and Itti, L. 2006. “Visual causes versus correlates of attentional selection in dynamic scenes.”. Vision Res., 46:4333–4345.
30. Collins, S, Ruina, A, Tedrake, R, and Wisse, M. 2005. “Efficient bipedal robots based on passive-dynamic walkers.”. Science, 307:1082–1085.
31. Coradeschi, S, Ishiguro, H, Asada, M, Shapiro, SC, Thielscher, M, Breazeal, C, Mataric, MJ, and Ishida, H. 2006. “Humaninspired robots.”. IEEE Intell. Syst., 21:74–85.
32. Dautenhahn, K, and Nehaniv, CL. eds) (2002. Imitation in Animals and Artifacts, Cambridge, MA:MIT Press.
33. Daw, ND, and Touretzky, DS. 2002. “Long-term reward prediction in T. D. models of the dopamine system.”. Neural Comput., 14:2567–2583.
34. Demiris, J, and Hayes, G. 2002. “Imitation as a dual-route process featuring predictive and learning components, A biologically plausible computational model.”. In Imitation in Animals and Artificats, Edited by:Dautenhahn, K, and Nehaniv, CL. 327–361. Cambridge, MA:MIT Press.
35. Demiris, J, Rougeaux, S, Hayes, GM, Berthouze, L, and Kuniyoshi, Y. “Deferred imitation of human head movements by an active stereo vision head.”. IEEE InternationalWorkshop on Robot Human Communication. Sendai, Japan.
36. Doya, K, Samejima, K, Katagiri, K, and Kawato, M. 2002. “Multiple model-based reinforcement learning.”. Neural Comput., 14:1347–1369.
37. Driscoll, J, Peters, R, and Cave, K. “A visual attention network for a humanoid robot.”. Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-98).
38. Dyer, P, and McReynolds, SR. 1970. The Computation and Theory of Optimal Control, Academic.
39. Featherstone, R, and Khatib, O. 1997. “Load-independence of the dynamically-consistent inverse of the Jacobian matrix.”. Int. J. Robot. Res., 16:168–170.
40. Flanagan, JR, Bowman, MC, and Johansson, RS. 2006. “Control strategies in object manipulation tasks.”. Curr. Opin. Neurobiol., 16:650–659.
41. Flanagan, JR, and Johansson, RS. 2003. “Action plans used in action observation.”. Nature (London), 424:769–771.
42. Franklin, DW, Osu, R, Burdet, E, Kawato, M, and Milner, TE. 2003. “Adaptation to stable and unstable dynamics achieved by combined impedance control and inverse dynamics model.”. J. Neurophysiol., 90:3270–3282.
43. Frith, CD, and Wolpert, DM. 2004. The Neuroscience of Social Interaction:Decoding, Imitating, and Influencing the Actions of Others, Oxford:The Royal Society, Oxford University Press.
44. Fujiwara, K, Kanehiro, F, Kajita, S, Kaneko, K, Yokoi, K, and Hirukawa, H. 2002. UKEMI:falling motion control to minimize damage to biped humanoid robot. 3:2521–2526.
45. Gallese, V, and Goldman, A. 1998. “Mirror neurons and the simulation theory of mind-reading.”. Trends Cogn. Sci., 2:493–501.
46. Gavrila, DM. 1997. “The visual analysis of human movements:A survey.”. Comput. Vis. Image Underst., 73:82–98.
47. Gomi, H, and Kawato, M. 1996. “Equilibrium-point control hypothesis examined by measured arm stiffness during multijoint movement.”. Science, 272:117–220.
48. Haruno, M, Wolpert, DM, and Kawato, M. 2001. “Mosaic model for sensorimotor learning and control.”. Neural Comput., 13:2201–2220.
49. Ijspeert, A, Nakanishi, J, and Schaal, S. 2003. “Learning attractor landscapes for learning motor primitives.”. In Advances in Neural Information Processing Systems 15, Edited by:Becker, S, Thrun, S, and Obermayer, K. 1547–1554. Cambridge, MA:MIT Press.
50. Inamura, T, Iwaki, T, Tanie, H, and Nakamura, Y. 2004. “Embodied symbol emergence based on mimesis theory.”. Int. J. Robot. Res., 23:363–377.
51. Itti, L, Dhavale, N, and Pighin, F. “Realistic avatar eye and head animation using a neurobiological model of visual attention.”. Proceedings of the SPIE 48th Annual International Symposium on Optical Science and Technology. pp. 64–78.
52. Itti, L, and Koch, C. “A comparison of feature combination strategies for saliency-based visual attention systems.”. Proceedings of the SPIE Human Vision and Electronic Imaging IV (HVEI99), 3644. pp. 473–482.
53. Itti, L, and Koch, C. 2000b. “A saliency-based search mechanism for overt and covert shifts of visual attention.”. Vision Res., 40:1489–1506.
54. Itti, L, and Koch, C. 2001. “Computational modeling of visual attention.”. Nat. Rev. Neurosci., 2:194–203.
55. Jenkins, OC. 2003. “Data-driven derivation of skills for autonomous humanoid agents.”. Los Angeles:Department of Computer Science, University of Southern California.
56. Johansson, G. 1973. “Visual perception of biological motion and a model for its analysis.”. Percept. Psychophys., 14:201–211.
57. Kajita, S, and Tani, K. 1996. “Experimental study of biped dynamic walking.”. IEEE Control Syst. Mag., 16:13–19.
58. Kanda, T, Ishiguro, H, Imai, M, and Ono, T. 2004. “Development and evaluation of interactive humanoid robots.”. Proc. IEEE, 92:1839–1850.
59. Kawato, M. 1999. “Internal models for motor control and trajectory planning.”. Curr. Opin. Neurobiol., 9:718–727.
60. Khatib, O. 1987. “A united approach to motion and force control of robot manipulators:The operational space formulation.”. Int. J. Robot. Res., 31:43–53.
61. Khatib, O, Brock, O, Chang, K, Conti, F, Ruspini, D, and Sentis, L. 2002. “Robotics and interactive simulation.”. Commun. ACM, X:46–51.
62. Khatib, O, Sentis, L, Park, J, and Warrent, J. 2004. “Whole-body dynamic behavior and control of human-like robots.”. Int. J. Humanoid Robot., 1:1–15.
63. Koch, C, and Ullman, S. 1985. “Shifts in selective visual attention:Towards the underlying neural circuitry.”. Hum. Neurobiol., 4:219–227.
64. Kozima, H, and Ito, A. 1998. An attention-based approach to symbol acquisition.:852–856.
65. Loeb, GE. 2001. “Learning from the spinal cord.”. J. Physiol., 533:111–117.
66. Mataric, M. 1998. “Behavior-based robotics as a tool for synthesis of artificial behavior and analysis of natural behavior.”. Trends Cogn. Sci., 2:82–86.
67. Mataric, M. 2000. “Getting humanoids to move and imitate.”. IEEE Intell. Syst., 15:18–24.
68. McGeer, T. 1990. “Passive dynamic walking.”. Int. J. Robot. Res., 9:633–643.
69. Meltzoff, AN, and Moore, MK. 1994. “Imitation, memory, and the representation of persons.”. Infant Behav. Dev., 17:83–99.
70. Menzel, P, and D'Alusio, F. 2000. Robosapiens:Evolution of a New Species, Cambridge, MA:MIT Press.
71. Miall, RC, and Wolpert, DM. 1996. “Forward models for physiological motor control.”. Neural Networks, 9:1265–1285.
72. Miyamoto, H, and Kawato, M. 1998. “A tennis serve and upswing learning robot based on bi-directional theory.”. Neural Networks, 11:1331–1344.
73. Miyamoto, H, Schaal, S, Gandolfo, F, Koike, Y, Osu, R, Nakano, E, Wada, Y, and Kawato, M. 1996. “A Kendama learning robot based on bi-directional theory.”. Neural Networks, 9:1281–1302.
74. Nakamura, Y. 1991. Advanced Robotics:Redundancy and Optimization, Reading, MA:Addison-Wesley.
75. Nakanishi, J, Mistry, M, and Schaal, S. “Inverse dynamics control with floating base and constraints.”. International Conference on Robotics and Automation (ICRA2007).
76. Narendra, KS, and Annaswamy, AM. 2005. Stable Adaptive Systems, Mineola, NY:Dover.
77. Navalpakkam, V, and Itti, L. 2005. “Modeling the influence of task on attention.”. Vision Res., 45:205–231.
78. Ng, AY, and Russell, S. “Algorithms for inverse reinforcement learning.”. Proceedings of the Seventeenth International Conference on Machine Learning (ICML 2000). Stanford, CA.
79. Osu, R, Kamimura, N, Iwasaki, H, Nakano, E, Harris, CM, Wada, Y, and Kawato, M. 2004. “Optimal impedance control for task achievement in the presence of signal-dependent noise.”. J. Neurophysiol., 92:1199
80. Panerai, F, Metta, G, and Sandini, G. 2003. “Learning visual stabilization reflexes in robots with moving eyes.”. Neurocomputing, 48:16
81. Parker, LE, Schneider, FE, and Schultz, AC. “Multi-robot systems:From swarms to intelligent automata.”. Proceedings from the 2005 International Workshop on Multi-Robot Systems. Vol. III, Dordrecht:Springer.
82. Peters, J, Mistry, M, Udwadia, FE, Cory, R, Nakanishi, J, and Schaal, S. “A unifying framework for the control of robotics systems.”. IEEE International Conference on Intelligent Robots and Systems (IROS 2005). Aug. 2–6. pp. 1824–1831. Alberta, Canada:Edmonton.
83. Peters, J, Mistry, M, Udwadia, FE, and Schaal, S. “A new methodology for robot control design.”. Fifth ASME International Conference on Multibody Systems, Nonlinear Dynamics, and Control (MSNDC 2005). Sept.24–28, Long Beach, CA.
84. Peters, J, and Schaal, S. 2006. “Learning operational space control.”. In Robotics:Science and Systems (RSS 2006), Edited by:Burgard, W, Sukhatme, GS, and Schaal, S. Cambridge, MA:MIT Press.
85. Peters, J, Vijayakumar, S, and Schaal, S. Sept. 2003a. “Reinforcement learning for humanoid robotics.”. In Humanoids 2003, Third IEEE-RAS International Conference on Humanoid Robots Sept., 29–30. Karlsruhe, Germany
86. th Joint Symposium on Neural Computation (JSNC 2003). May, Irvine, CA.
87. Peters, J, Vijayakumar, S, and Schaal, S. “Natural Actor-Critic.”. Proceedings of the 16th European Conference on Machine Learning (ECML 2005). Edited by:Gama, J, Camacho, R, Brazdil, P, Jorge, A, and Torgo, L. vol 3720, Oct. 3–7. pp. 280–291. Porto, Portugal:Springer.
88. Piaget, J. 1951. Play, dreams, and imitation in childhood, New York:Norton.
89. Righetti, L, and Ijspeert, A. “Design methodologies for central pattern generators:An application to crawling humanoids.”. Proceedings of Robotics:Science and Systems. Philadelphia:MIT Press.
90. Rizzolatti, G, and Arbib, MA. 1998. “LanguageWithin Our Grasp.”. Trends Neurosci., 21:188–194.
91. Robins, B, Dautenhahn, K, Boekhorst, R, and Billard, A. 2005. “Robotic assistants in therapy and education of children with autism:Can a small humanoid robot help encourage social interaction skills?”. Universal Access in the Information Society,:4
92. Russell, SJ, and Norvig, P. 1995. Artificial intelligence:A Modern Approach, Englewood Cliffs, NJ:Prentice-Hall.
93. Sabes, PN. 2000. “The planning and control of reaching movements.”. Curr. Opin. Neurobiol., 10:740–746.
94. Saltzman, EL. 1979. “Levels of sensorimotor representation.”. J. Math. Psychol., 20:91–163.
95. Scassellati, B. 1998. “Imitation and mechanisms of joint attention:A. developmental structure for building social skills in a humanoid robot.”. In Computation for Metaphors, Analogy and Agents, Edited by:Nehaniv, C. L. 176–195. New York:Springer.
96. Scassellati, B. 2002. “Theory of mind for a humanoid robot.”. Auton. Rob.,:12
97. Schaal, S. 1999. “Is imitation learning the route to humanoid robots?”. Trends Cogn. Sci., 3:233–242.
98. Schaal, S. 2002. “Learning robot control.”. In The Handbook of Brain Theory and Neural Networks, 2nd ed., Edited by:Arbib, M. A., 983–987. Cambridge, M.A.:MIT Press.
99. Schaal, S. “ Dynamic systems:Brain, body, and imitation ”. In Action toLanguage via the Mirror Neuron System (in press)
100. Schaal, S, and Atkeson, CG. “Robot learning by nonparametric regression.”. Proceedings of the International Conference on Intelligent Robots and Systems (IROS'94. Munich, Germany. pp. 478–485.
101. Schaal, S, Atkeson, CG, and Botros, S. “What should be learned?”. Proceedings of SeventhYaleWorkshop on Adaptive and Learning Systems. May20–22, New Haven, CT. pp. 199–204.
102. Schaal, S, Atkeson, CG, and Vijayakumar, S. 2002. “Scalable techniquesfrom nonparametric statistics for real-time robot learning.”. Appl. Intell., 17:49–60.
103. Schaal, S, Ijspeert, A, and Billard, A. 2003. “Computational approaches to motor learning by imitation.”. Philos. Trans. R. Soc. London, Ser. B, 358:537–547.
104. Schaal, S, Peters, J, Nakanishi, J, and Ijspeert, A., “Learning movement primitives.”. International Symposium on Robotics Research (ISRR2003). Ciena, Italy:Springer.
105. Schaal, S, and Schweighofer, N. 2005. “Computational motor control in humans and robots.”. Curr. Opin. Neurobiol., 15:675–682.
106. Schmidt, RA. 1988. “Motor control and learning.”. Champaign, II:Human Kinetics.
107. Scholz, JP, and Schoner, G. 1999. “The uncontrolled manifold concept:Identifying control variables for a functional task.”. Exp. Brain Res., 126:289–306.
108. Schweighofer, N, and Doya, K. 2003. “Meta-learning in reinforcement learning.”. Neural Networks, 16:5–9.
109. Schweighofer, N, Doya, K, and Kuroda, S. in press. “Cerebellar aminergic neuromodulation:towards a functional understanding.”. Brain Res. Rev.
110. Sciavicco, L, and Siciliano, B. 1996. Modeling and control of robot manipulators, NewYork:MacGraw-Hill.
111. Sciavicco, L, and Siciliano, B. 2000. Modelling and Control of Robot Manipulators, London:Springer.
112. Sentis, L, and Khatib, O. “Task-oriented control of humanoid robots through prioritization.”. IEEE-RAS/RSJ International Conference on Humanoid Robots. Nov.10–12, Santa Monica, CA.
113. Shadmehr, R, and Wise, SP. 2005. “The computational neurobiology of reaching and pointing:A foundation for motor learning.”. Cambridge, Mass:MIT Press.
114. Shibata, T, Vijayakumar, S, Conradt, J, and Schaal, S. 2001. “Biomimetic oculomotor control.”. Adaptive Behavior, 9:189–207.
115. Slotine, JJ. E, and Li, W. 1991. Applied Nonlinear Control, Englewood Cliffs, NJ:Prentice-Hall.
116. Strogatz, SH. 1994. “Nonlinear dynamics and chaos:With applications to physics, biology, chemistry, and engineering.”. Reading, MA:Addison-Wesley.
117. Sutton, RS, and Barto, AG. 1998. Reinforcement Learning. An introduction, Cambridge:MIT Press.
118. Taub, E, and Wolf, SL. 1997. “Constraint induced techniques to facilitate upper extremity use in stroke patients.”. Topics in Stroke Rehabilitation, 3:38–61.
119. Todorov, E. 2005. “Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system.”. Neural Comput., 17:1084–1108.
120. Todorov, E, and Jordan, MI. 2002. “Optimal feedback control as a theory of motor coordination.”. Nat. Neurosci., 5:1226–1235.
121. Tomasello, M, Savage-Rumbaugh, S, and Kruger, A C. 1993. “Imitative learning of actions on objects by children, chimpanzees, and enculturated chimpanzees.”. Chim. Oggi, 64:1688–1705.
122. van der Lee, JH, Wagenaar, RC, Lankhorst, GJ, Vogelaar, TW, Deville, WL, and Bouter, LM. 1999. “Forced-use of the upper extremity in chronic stoke patients:Results from a single-blind randomized clinical trial.”. Stroke, 30:2369–2375.
123. van Essen, DC, and Maunsell, JM. R. 1983. “Hierarchical organization and functional streams in the visual cortex.”. Trends Neurosci., 6:370–375.
124. Vijayakumar, S, Conradt, J, Shibata, T, and Schaal, S. “Overt visual attention for a humanoid robot.”. IEEE International Conference on Intelligent Robots and Systems (IROS 2001).
125. Vijayakumar, S, D'Souza, A, and Schaal, S. 2005. “Incremental online learning in high dimensions.”. Neural Comput., 17:1–33.
126. Vijayakumar, S, and Schaal, S. “Real time learning in humanoids:A challenge for scalability of online algorithms.”. Humanoids 2000, First IEEE-RAS International Conference on Humanoid Robots. CD-Proceedings. Cambridge, MA.
127. Viviani, P, Baud-Bovy, G, and Redolfi, M. 1997. “Perceiving and tracking kinesthetic stimuli:Further evidence of motor—perceptual interactions.”. J. Exp. Psychol. Hum. Percept. Perform., 23:1232–1252.
128. Viviani, P, and Schneider, R. 1991. “A developmental study of the relationship between geometry and kinematics in drawing movements.”. J. Exp. Psychol. Hum. Percept. Perform., 17:198–218.
129. Wada, Y, and Kawato, M. 1995. “A theory for cursive handwriting based on the minimization principle.”. Biol. Cybern., 73:3–13.
130. Wiener, N. 1948. Cybernetics, NewYork:Wiley.
131. Wolf, SL, and Blanton, S. 1999. “An application of upper-extremity constraint-induced movement therapy in a patient with subacute stroke.”. Phys. Ther., 79:847–953.
132. Wolpert, DM, Doya, K, and Kawato, M. 2003. “A unifying computational framework for motor control and social interaction.”. Philos. Trans. R. Soc. London, Ser. B, 358:593–602.
133. Wolpert, DM, Doya, K, and Kawato, M. (submitted) “A unifying computational framework for motor control and social interaction.”. Philos. Trans. R. Soc. London, Ser. B
134. Wolpert, DM, and Kawato, M. 1998. “Multiple paired forward and inverse models for motor control.”. Neural Networks, 11:1317–1329.
135. Zinn, M, Khatib, O, Roth, B, and Salisbury, JK. 2004. “Playing it safe [human-friendly robots].”. Robot. Autom. Mag., 11:12–21.