Cooperative behavior acquisition for mobile robots in dynamically changing real worlds via vision-based reinforcement learning and development

Artificial Intelligence

Volumn 110, Issue 2, 1999, Pages 275-292

  Asada, Minoru ^a   Uchibe, Eiji ^a   Hosoda, Koh ^a  

^a OSAKA UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; COMPUTER VISION; DATA ACQUISITION; GAME THEORY; INTELLIGENT ROBOTS; MATHEMATICAL MODELS; MOBILE ROBOTS; STATE ESTIMATION; VECTORS;

AKAIKE INFORMATION CRITERION; CANONICAL VARIATE ANALYSIS; COOPERATIVE BEHAVIOR; MULTIAGENT LEARNING; REINFORCEMENT LEARNING; ROBOT SOCCER GAME; VISION BASED LEARNING;

ROBOT LEARNING;

EID: 0033148990     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0004-3702(99)00026-0     Document Type: Article

References (27)

1. P.E. Agre, Computational research on interaction and agency, Artificial Intelligence 72 (1995) 1-52.
2. H. Akaike, A new look on the statistical model identification, IEEE Trans. Automat. Control AC-19 (1974) 716-723.
3. Y. Aloimonos, Introduction: Active vision revisited, in: Y. Aloimonos (Ed.), Active Perception, Lawrence Erlbaum Associate, Hillsdale, NJ, 1993, Chapter 0, pp. 1-18.
4. Y. Aloimonos, Reply: What I have learned, CVGIP: Image Understanding 60 (1) (1994) 74-85.
5. M. Asada, An agent and an environment: A view of "having bodies" - A case study on behavior learning for a vision-based mobile robot, in: Proc. 1996 IROS Workshop on Towards Real Autonomy, 1996, pp. 19-24.
6. M. Asada, S. Noda, S. Tawaratumida, K. Hosoda, Purposive behavior acquisition for a real robot by vision-based reinforcement learning, Machine Learning 23 (1996) 279-303.
7. M. Asada, S. Noda, K. Hosoda, Action-based sensor space categorization for robot learning, in: Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems 1996 (IRos-96), 1996, pp. 1502- 1509.
8. D.H. Ballard, M.M. Hayhoe, P.K. Pook, R.P.N. Rao, Deictic codes for the embodiment of cognition, Behavioral and Brain Sciences 20 (4) (1997) 723.
9. J.H. Connell, S. Mahadevan, Robot Learning, Kluwer Academic, Dordrecht, 1993.
10. S. Edelman, Reply: Representation without reconstruction, CVGIP: Image Understanding 60 (1) (1994) 92-94.
11. M. Inaba, Remote-brained Robotics: Interfacing AI with Real World Behaviors, In: Preprints ISRR-93, Pittsburgh, PA, 1993.
12. H. Kitano, M. Asada, Y. Kuniyoshi, I. Noda, E. Osawa, H. Matsubara, Robocup: A Challenge Problem Of AI, AI Magazine 18 (1997) 73-85.
13. W.E. Larimore, Canonical variate analysis in identification, filtering, and adaptive control, in: Proc. 29th IEEE Conference on Decision and Control, Honolulu, Hawaii, 1990, pp. 596-604.
14. L.-J. Lin, T.M. Mitchell, Reinforcement learning with hidden states, in: Proc. 2nd International Conference on Simulation of Adaptive Behavior: From Animals to Animats, 1992, pp. 271-280.
15. M.L. Littman, Markov games as a framework for multi-agent reinforcement learning, in: Proc. 11th International Conference on Machine Learning, New Brunswick, NJ, 1994, pp. 157-163.
16. T. Matsuyama, Cooperative distributed vision, in: Proc. 1st International Workshop on Cooperative Distributed Vision, 1997, pp. 1-28.
17. A.W. Moore, C.G. Atkeson, The parti-game algorithm for variable resolution reinforcement learning in multidimensional state-spaces, Machine Learning 21 (1995) 199-233.
18. T. Nakamura, M. Asada, Motion sketch: Acquisition of visual motion guided behaviors, in: Proc. IJCAI-95, Montreal, Quebec, Morgan Kaufmann, San Mateo, CA, 1995, pp. 126-132.
19. T. Nakamura, M. Asada, Stereo sketch: Stereo vision-based target reaching behavior acquisition with occlusion detection and avoidance, in: Proc. IEEE International Conference on Robotics and Automation, Minneapolis, MN, 1996, pp. 1314-1319.
20. G. Sandini, Vision during action, in: Y. Aloimonos (Ed.), Active Perception, Lawrence Erlbaum Associate, Hillsdale, NJ, 1993, Chapter 4, pp. 151-190.
21. G. Sandini, E. Grosso, Reply: Why purposive vision, CVGIP: Image Understanding 60 (1) (1994) 109-112.
22. P. Stone, M. Veloso, Using machine learning in the soccer server, in: Proc. IROS-96 Workshop on RoboCup, 1996.
23. Y. Takahashi, M. Asada, K. Hosoda, Reasonable performance in less learning time by real robot based on incremental state space segmentation, in: Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IRos-96), 1996, pp. 1518-1524.
24. E. Uchibe, M. Asada, K. Hosoda, Behavior coordination for a mobile robot using modular reinforcement learning, in: Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IRos-96), 1996, pp. 1329-1336.
25. E. Uchibe, M. Asada, K. Hosoda, State space construction for behavior acquisition in multi agent environments with vision and action, in: Proc. International Conference on Computer Vision, 1998 (to appear).
26. C.J.C.H. Watkins, P. Dayan, Technical note: Q-learning, Machine Learning (1992) 279-292.
27. S.D. Whitehead, D.H. Ballard, Active perception and reinforcement learning, in: Proc. 7th Workshop on Machine Learning, Austin, TX, Morgan Kaufmann, San Mateo, CA, 1990, pp. 179-188.