The eMOSAIC model for humanoid robot control

Neural Networks

Volumn 29-30, Issue , 2012, Pages 8-19

  Sugimoto, Norikazu ^a,b   Morimoto, Jun ^b   Hyon, Sang Ho ^b,c   Kawato, Mitsuo ^b  

^a National Institute of Communication Telecommunication   (Japan)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^c RITSUMEIKAN UNIVERSITY   (Japan)

Author keywords

Computational neuroscience; Humanoid robot; Modular architecture; Nonlinear and non stationary control problem

Indexed keywords

ADAPTIVE CONTROL; BODY DYNAMICS; CARRYING OBJECTS; COMPUTATIONAL NEUROSCIENCE; CONTROL FRAMEWORK; CONTROL PROBLEMS; CONTROL STRATEGIES; HUMAN ABILITIES; HUMANOID ROBOT; MODULAR ARCHITECTURES; MOTOR CONTROL; NON-STATIONARY DYNAMICS; NONSTATIONARY; OBSERVATION NOISE; PARTIALLY OBSERVABLE SYSTEMS; REAL ENVIRONMENTS; STATE ESTIMATORS;

COMPUTER SIMULATION;

ANTHROPOMORPHIC ROBOTS;

ACCURACY; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; EXPERIMENTAL DESIGN; LEARNING ALGORITHM; LINEAR SYSTEM; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; NONLINEAR SYSTEM; PREDICTION; PRIORITY JOURNAL; PROBABILITY; PROCESS MODEL; ROBOTICS; SIGNAL DETECTION; STIMULUS RESPONSE; STRATEGIC PLANNING; SYSTEMATIC ERROR; TASK PERFORMANCE;

ARTIFICIAL INTELLIGENCE; HUMANS; NEURAL NETWORKS (COMPUTER); PSYCHOMOTOR PERFORMANCE; ROBOTICS;

EID: 84860327685     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2012.01.002     Document Type: Article

References (33)

1. Astrom K.J., Wittenmark B. Adaptive control 1989, Addison Wesley.
2. Atkeson, C., & Stephens, B. (2007). Multiple balance strategies from one optimization criterion. In The IEEE-RAS 2007 international conference on humanoid robots (pp. 57-64).
3. Chesi G. LMI techniques for optimization over polynomials in control: a survey. IEEE Transactions on Automatic Control 2010, 55:2500-2510.
4. Cruz J.B., Perkins W.R. A new approach to the sensitivity problem in multivariable feedback system design. IEEE Transactions on Automatic Control 1964, 9:216-223.
5. Dietterich T.G. Hierarchical reinforcement learning with the MAXQ value function decomposition. Journal of Artificial Intelligence Research 2000, 13:227-303.
6. Doya K. Reinforcement learning in continuous time and space. Neural Computation 2000, 12:219-245.
7. Doya K., Samejima K., Katagiri K., Kawato M. Multiple model-based reinforcement learning. Neural Computation 2002, 14:1347-1369.
8. Fujii T., Narazaki M. A complete optimality condition in the inverse problem of optimal control. SIAM Journal on Control and Optimization 1984, 22(2):327-341.
9. Ghahramani Z., Hinton G.E. Variational learning for switching state-space models. Neural Computation 2000, 12(4):831-864.
10. Grimes D.B., Chalodhorn R., Rao R.P.N. Dynamic imitation in a humanoid robot through nonparametric probabilistic inference. Proceedings of robotics: science and systems 2006, MIT Press.
11. Haruno M., Wolpert D.M., Kawato M. Mosaic model for sensorimotor learning and control. Neural Computation 2001, 13.
12. Hauskrecht, M., Meuleau, N., Kaelbling, L. P., Dean, T., & Boutilier, C. (1998). Hierarchical solution of Markov decision processes using macro-actions. In Uncertainty in artificial intelligence (pp. 220-229).
13. Hyon, S., Osu, R., & Otaka, Y. (2009). Integration of multi-level postural balancing on humanoid robots. In IEEE international conference on robotics and automation (pp. 1549-1556).
14. Imamizu H., Kuroda T., Yoshioka T., Kawato M. Functional magnetic resonance imaging examination of two modular architectures for switching multiple internal models. Journal of Neuroscience 2004, 24(5):1173-1181.
15. Imamizu H., Sugimoto N., Osu R., Tsutsui K., Sugiyama K., Wada Y., et al. Explicit contextual information selectively contributes to predictive switching of internal models. Experimental Brain Research 2007, 181(3):395-408.
16. Kalman R.E., Bucy R.S. New results in linear filtering and prediction theory. Transactions of the ASME Series D-Journal of Basic Engineering 1961, 83(1):95-108.
17. Lewis F.L. Optimal estimation 1986, John Wiley & Sons, Inc.
18. Lim, S., & How, J. P. (1998). Control of LPV systems using a quasi-piecewise affine parameter-dependent Lyapunov function. In American control conference.
19. Morimoto J., Doya K. Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning. Robotics and Autonomous Systems 2001, 36(1):37-51.
20. Morse A.S. Control using logic-based switching. Lecture notes in control and information sciences 1996, Springer-Verlag Telos.
21. Nakaoka, S., Nakazawa, A., & Ikeuchi, K. (2004). An efficient method for composing while body motions of a humanoid robot. In Proceedings of international conference on virtual systems and multimedia. VSMM2004.
22. Perkins W.R., Cruz J.B. Feedback properties of linear regulators. IEEE Transactions on Automatic Control 1971, 16(6):659-664.
23. Rugh W.J. Analytical framework for gain scheduling. IEEE Control Systems Magazine 1991, 11:79-84.
24. Rugh W.J., Shamma J.S. Research on gain scheduling. Automatica 2000, 36:1401-1425.
25. Samejima K., Doya K., Kawato M. Inter-module credit assignment in modular reinforcement learning. Neural Networks 2003, 16:985-994.
26. Shamma J.S., Athans M. Gain scheduling: potential hazards and possible remedies. IEEE Control Systems Magazine 1992, 6:101-107.
27. Slotine J.-J.E., Li W. Applied nonlinear control 1991, Prentice Hall.
28. Stephens, B. (2007). Humanoid push recovery. In The IEEE-RAS 2007 international conference on humanoid robots (pp. 589-595).
29. Sutton R.S., Precup D., Singh S.P. Between MDPs and semi-MDPs: a framework for temporal abstraction in reinforcement learning. Artificial Intelligence 1999, 112(1-2):181-211.
30. Thrun S., Burgard W., Fox D. Probabilistic robotics 2005, The MIT Press.
31. Wiering M., Schmidhuber J. HQ-learning. Adaptive Behavior 1997, 6(2):219-246.
32. Wolpert D.M., Ghahramani Z., Jordan M.I. An internal model for sensorimotor integration. Science 1995, 269(5232):1880-1882.
33. Wolpert D.M., Kawato M. Multiple paired forward and inverse models for motor control. Neural Networks 1998, 11:1317-1329.