Biomimetic approach to tacit learning based on compound control

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 40, Issue 1, 2010, Pages 77-90

  Shimoda, Shingo ^a   Kimura, Hidenori ^a  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

Author keywords

Biological control; Compound control; Neural network

Indexed keywords

ACTIVITY RULES; BEHAVIORAL PATTERNS; BIOLOGICAL CONTROLS; BIPEDAL WALKING; CHANGING ENVIRONMENT; COMPOUND CONTROL; COMPUTATIONAL MEDIA; GLOBAL BEHAVIORS; GLOBAL NETWORKS; GLOBAL PERFORMANCE; INTRACELLULAR CONTROL; LEARNING MECHANISM; LIVING ORGANISMS; MACHINE-LEARNING; ROBOT MODEL; STATISTICAL APPROACH; TRAJECTORY PLANNING; UNKNOWN ENVIRONMENTS;

BIOLOGY; BIOMIMETICS; ROBOT PROGRAMMING;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; BIOMIMETICS; CLUSTER ANALYSIS; CYBERNETICS; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMIMETICS; CLUSTER ANALYSIS; CYBERNETICS; NEURAL NETWORKS (COMPUTER);

EID: 74049138729     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2009.2014470     Document Type: Article

References (35)

1. S. Shimoda and H. Kimura, "Neural computation scheme of compound control: Tacit learning for bipedal locomotion", SICE J. Control, Meas., Syst. Integr., vol. 1, no. 4, pp. 275-283, 2008.
2. M. L. Minsky and S. A. Papert, Perceptron. Cambridge, MA: MIT Press, 1969.
3. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning representations by back-propagating errors", Nature, vol. 323, no. 6088, pp. 533-536, Oct. 9, 1986.
4. Y. Kuniyoshi, Y. Yorozu, S. Suzuki, S. Sangawa, Y. Ohmura, K. Terada, and A. Nagakubo, "Emergence and development of embodied cognition: A constructivist approach using robots", Prog. Brain Res., vol. 164, pp. 425-445, 2007.
5. A. G. Barto, R. S. Sutton, and C. W. Anderson, "Neuronlike adaptive elements that can solve difficult learning control problems", IEEE Trans. Syst., Man, Cybern., vol. SMC-13, no. 5, pp. 834-846, Sep./Oct. 1983.
6. K. Doya, "Reinforcement learning in continuous time and space", Neural Comput., vol. 12, no. 1, pp. 219-245, Jan. 2000.
7. R. Tedrake, T. W. Zhang, and H. S. Seung, "Stochastic policy gradient reinforcement learning on a simple 3D biped", in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2004, pp. 2849-2854.
8. K. J. Astrom and B. Wittenmark, Adaptive Control. Reading, MA: Addison-Wesley, 1989.
9. J. E. Slotin and W. Li, Applied Nonlinear Control. Englewood Cliffs, NJ: Prentice-Hall, 1991.
10. L. A. Zadeh, "Outline of a new approach to the analysis of complex systems and decision processes", IEEE Trans. Syst., Man, Cybern., vol. SMC-3, no. 1, pp. 28-44, Jan. 1973.
11. J. G. Juang, "Fuzzy neural network control CMAC of a biped walking robot", IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 30, no. 4, pp. 594-601, Aug. 2000.
12. [Online]. Available: http://www.bmc.riken. jp/~biologic/e-works. contentwalking.html
13. T. Flash and N. Hogan, "The coordination of arm movements: An experimentally confirmed mathematical model", J. Neurosci., vol. 5, no. 7, pp. 1688-1703, Jul. 1985.
14. D. A. Rosenbaum, L. D. Loukopoulos, R. J. Meulenbroek, J. Vaughan, and S. E. Engelbrecht, "Planning reaches by evaluating stored postures", Psychol. Rev., vol. 102, no. 1, pp. 28-67, 1995.
15. R. M. Alexander, "A minimum energy cost hypothesis for human arm trajectories", Biol. Cybern., vol. 76, no. 2, pp. 97-105, Feb. 1997.
16. Y. Uno, M. Kawato, and R. Suzuki, "Formation and control of optimum trajectory in human multijoint arm movement: Minimum torque-change model", Biol. Cybern., vol. 61, no. 2, pp. 89-101, Jun. 1989.
17. J. P. Swazey, Reflexes and Motor Integration: Sherrington's Concept of Integrative Action. Cambridge, MA: Harvard Univ. Press, 1969.
18. R. J. Tanaka and H. Kimura, "Mathematical classification of regulatory logics for compound environmental changes", J. Theor. Biol., vol. 251, no. 2, pp. 363-379, Mar. 2008.
19. R. J. Tanaka, H. Okano, and H. Kimura, "Mathematical description of gene regulatory units", Biophys. J., vol. 91, no. 4, pp. 1235-1247, Aug. 2006.
20. H. Kimura, H. Okano, and R. J. Tanaka, "Stochastic approach to intracellular regulation and computational theory of biological control", J. Theor. Biol., vol. 248, no. 4, pp. 590-607, Oct. 2007.
21. G. Taga, "A model of the neuro-musculo-skeletal system for human locomotion. I Emergence of basic gait", Biol. Cybern., vol. 73, no. 2, pp. 97-111, Aug. 1995.
22. G. Taga, "A model of the neuro-musculo-skeletal system for human locomotion. II. Real-time adaptability under various constraints", Biol. Cybern., vol. 73, no. 2, pp. 113-121, Aug. 1995.
23. K. Suzuki, T. Tsukidate, T. Nakada, M. Shimizu, and A. Ishiguro, "Self-assembly through the local interaction between embodied nonlinear oscillators with simple motile function", in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2008, pp. 1319-1324.
24. J. Bishop, S. Burden, E. Klavin, R. Kreisberg, W. Malone, N. Napp, and T. Nguyen, "Programmable parts: A demonstration of the grammatical approach to self-organization", in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2005, pp. 3684-3691.
25. W. S. McCulloch and W. Pitts, "A logical calculus of the idea immanent in nervous activity", Bull. Math. Biophys., vol. 5, pp. 115-133, 1943.
26. D. O. Hebb, The Organization of Behavior. New York: Wiley, 1949.
27. B. Porr and F. Worgotter, "Learning with 'relevance': Using a third factor to stabilize Hebbian learning", Neural Comput., vol. 19, no. 10, pp. 2694-2719, Oct. 2007.
28. M. Ito and M. Kano, "Long-lasting depression of parallel fiber-Purkinje cell transmission induced by conjunctive stimulation of parallel fibers and climbing fibers in the cerebellar cortex", Neurosci. Lett., vol. 33, no. 3, pp. 253-258, Dec. 1982.
29. K. Horikawa, K. Ishimatsu, E. Yoshimoto, S. Kondo, and H. Takeda, "Noise-resistant and synchronized oscillation of the segmentation clock", Nature, vol. 441, no. 7094, pp. 719-723, Jun. 2006.
30. A. T. Winfree, The Geometry of Biological Time. New York: Springer-Verlag, 2000.
31. W. E. Skaggs, B. L. McNaughton, M. A. Wilson, and C. A. Barnes, "Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences", Hippocampus, vol. 6, no. 2, pp. 149-172, 1996.
32. H. Wagatsuma and Y. Yamaguchi, "Cognitive map formation through sequence encoding by theta phase precession", Neural Comput., vol. 16, no. 12, pp. 2665-2697, Dec. 2004.
33. H. Mizuhara and Y. Yamaguchi, "Human cortical circuits for central executive function emerge by theta phase synchronization", NeuroImage, vol. 36, no. 1, pp. 232-244, May 2007.
34. R. Pfeifer and C. Scheier, Understanding Intelligence. Cambridge, MA: Bradford Books, 2001.
35. R. A. Brooks, "Elephants don't play chess", Robot. Auton. Syst., vol. 6, pp. 3-15, 1990.