Measuring the effectiveness of reinforcement learning for behavior-based robots

Adaptive Behavior

Volumn 5, Issue 3-4, 1997, Pages 365-390

  Shackleton, John ^a,b   Gini, Maria ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

^b HONEYWELL TECHNOLOGY CENTER   (United States)

Author keywords

Behavior based architectures; Reinforcement learning; Robot learning

Indexed keywords

EID: 0031287710     PISSN: 10597123     EISSN: None     Source Type: Journal    
DOI: 10.1177/105971239700500307     Document Type: Article

References (19)

1. Brooks, R. (1986). A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation, RA-2(1), 14-23.
2. Comer, D. (1979). The ubiquitous B tree. ACM Computing Surveys, 11(2), 121-137.
3. Connell, J., & Mahadevan, S. (1993). Rapid task learning for real robots. In J. H. Connell & S. Mahadevan (Eds.), Robot learning. Norwell, MA: Kluwer Academic.
4. Dorigo, M. (1995). Alecsys and the autonomouse: Learning to control a real robot by distributed classifier systems. Machine Learning, 19(3), 209-240.
5. Dorigo, M., & Colombetti, M. (1994). Robot shaping: Developing autonomous agents through learning. Artificial Intelligence, 71(2), 321-370.
6. Hilgard, E. R., & Bower, G. H. (1975). Theories of learning (4th ed.). Englewood Cliffs, NJ: Prentice-Hall.
7. Hougen, D. F., Fischer, J., Gini, M., & Slagle, J. (1996). Fast connectionist learning for trailer backing using a real robot. In Proceedings of the IEEE International Conference on Robotics and Automation, Minneapolis, MN. Los Alamitos, CA: IEEE Press.
8. Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996). Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4, 237-285.
9. Koza, J. R., & Rice, J. P. (1992). Automatic programming of robots using genetic programming. In Proceedings of the National Conference on Artificial Intelligence, San José, CA. Menlo Park, CA: AAAI Press.
10. Mahadevan, S. (1994). To discount or not to discount in reinforcement learning: A case study comparing R-learning and Q-learning. In Proceedings of the Eleventh International Conference on Machine Learning, New Brunswick, NJ. San Mateo, CA: Morgan Kaufmann.
11. Mahadevan, S. (1996). Average reward reinforcement learning: Foundations, algorithms, and empirical results. Machine Learning, 22, 159-196.
12. Mahadevan, S., & Connell, J. (1992). Automatic programming of behavior-based robots using reinforcement learning. Artificial Intelligence, 55, 311-365.
13. Matarić, M. (1994). Reward functions for accelerated learning. In Proceedings of the Eleventh International Conference on Machine Learning, New Brunswick, NJ. San Mateo, CA: Morgan Kaufmann.
14. Schwartz, A. (1993). A reinforcement learning method for maximizing undiscounted rewards. In Proceedings of the Tenth International Conference on Machine Learning, San Mateo, CA: Morgan Kaufmann.
15. Singh, S. P. (1992). Transfer of learning by composing solutions of elemental sequential tasks. Machine Learning, 8(3-4), 323-339.
16. Watkins, C. J. (1989). Models of delayed reinforcement learning. Unpublished doctoral thesis, Cambridge University, Cambridge, UK.
17. Watkins, C. J., & Dayan, P. (1992). Q-learning. Machine Learning, 8(3), 279-292.
18. Whitehead, S. D. (1992). Reinforcement learning for the adaptive control of perception and action. Unpublished doctoral thesis, University of Rochester, Rochester, NY.
19. Whitehead, S. D., Karlsson, J., & Tenenberg, J. (1993). Learning multiple goal behavior via task decomposition and dynamic policy merging. In J. H. Connell and S. Mahadevan (Eds.), Robot learning. Norwell, MA: Kluwer Academic.