Accelerating autonomous learning by using heuristic selection of actions

Journal of Heuristics

Volumn 14, Issue 2, 2008, Pages 135-168

  Bianchi, Reinaldo A C ^a   Ribeiro, Carlos H C ^b   Costa, Anna H R ^c  

^a CENTRO UNIVERSITÁRIO DA FEI   (Brazil)

^b INSTITUTO TECNOLÓGICO DE AERONÁUTICA   (Brazil)

^c UNIVERSITY OF SÃO PAULO   (Brazil)

Author keywords

Action selection; Heuristic function; Reinforcement learning; Robot navigation

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; HEURISTIC METHODS; MOBILE ROBOTS; REINFORCEMENT LEARNING; ROBOTICS;

CONTROL POLICIES; HEURISTIC SELECTION; LEARNING PROCESSES; ROBOT NAVIGATION;

LEARNING ALGORITHMS;

EID: 41249102188     PISSN: 13811231     EISSN: 15729397     Source Type: Journal    
DOI: 10.1007/s10732-007-9031-5     Document Type: Article

References (29)

1. Albus, J.S.: Data storage in the cerebellar model articulation controller (CMAC). J. Dyn. Syst. Meas. Control 97, 228-233 (1975)
2. Bertsekas, D.P.: Dynamic Programming: Deterministic and Stochastic Models. Prentice-Hall, Upper Saddle River (1987)
3. Bertsekas, D.P.: Dynamic Programming and Optimal Control, vol. 1. Athena Scientific, Belmont (1995)
4. Bianchi, R.A.C.: Using heuristics to accelerate reinforcement learning algorithms (in Portuguese). Ph.D. thesis, University of São Paulo (2004)
5. Bonabeau, E., Dorigo, M., Theraulaz, G.: Inspiration for optimization from social insect behaviour. Nature 406 (2000)
6. Butz, M.V.: State value learning with an anticipatory learning classifier system in a Markov decision process. Technical report 2002018 at the Illinois Genetic Algorithms Laboratory (2002)
7. Drummond, C.: Accelerating reinforcement learning by composing solutions of automatically identified subtasks. J. Artif. Intell. Res. 16, 59-104 (2002)
8. Elfes, A.: Using occupancy grids for mobile robot perception and navigation. Computer 22, 46-57 (1989)
9. Foster, D., Dayan, P.: Structure in the space of value functions. Mach. Learn. 49, 325-346 (2002)
10. Fox, D., Burgard, W., Thrun, S.: Markov localization for mobile robots in dynamic environments. J. Artif. Intell. Res. 11, 391-427 (1999)
11. Hart, P.E., Nilsson, N.J., Raphael, B.: A formal basis for the heuristic determination of minimum cost paths. IEEE Trans. Syst. Sci. Cybern. 4, 100-107 (1968)
12. Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: a survey. J. Artif. Intell. Res. 4, 237-285 (1996)
13. Konolige, K., Myers, K.: The Saphira architecture for autonomous mobile robots. In: AI-based Mobile Robots: Case Studies of Successful Robot Systems. MIT, Cambridge (1996)
14. Millan, J.R., Posenato, D., Dedieu, E.: Continuous-action Q-learning. Mach. Learn. 49, 247-266 (2002)
15. Mitchell, T.: Machine Learning. McGraw-Hill, New York (1997)
16. Moore, A.W., Atkeson, C.G.: Prioritized sweeping: reinforcement learning with less data and less time. Mach. Learn. 13, 103-130 (1993)
17. Munos, R., Moore, A.W.: Variable resolution discretization in optimal control. Mach. Learn. 49, 291-323 (2002)
18. Peng, J., Williams, R.J.: Efficient learning and planning within the dyna framework. Adapt. Behav. 1, 437-454 (1993)
19. Puterman, M.L.: Markovian Decision Problems. Wiley, New York (1994)
20. Rummery, G., Niranjan, M.: On-line Q-learning using connectionist systems. Technical report CUED/F-INFENG/TR 166, Cambridge University Engineering Department (1994)
21. Russell, S., Norvig, P.: Artificial Intelligence: a Modern Approach, 2nd edn. Prentice-Hall, Englewood Cliffs (2002)
22. Spiegel, M.R.: Probability and Statistics. McGraw-Hill, New York (1975)
23. Sutton, R.S.: Learning to predict by the methods of temporal differences. Mach. Learn. 3, 9-44 (1988)
24. Sutton, R.S.: Integrated architectures for learning, planning and reacting based on approximating dynamic programming. In: Proceedings of the 7th International Conference on Machine Learning. Morgan Kaufmann, Austin (1990)
25. Sutton, R.S.: Generalization in reinforcement learning: successful examples using sparse coarse coding. Adv. Neural. Inf. Process. Syst. 8, 1038-1044 (1996)
26. Szepesvári, C.: Static and dynamic aspects of optimal sequential decision making. Ph.D. thesis, Jozsef Attila University, Szeged, Hungary (1997)
27. Szepesvári, C., Littman, M.: Generalized Markov decision processes: dynamic-programming and reinforcement-learning algorithms. CS-96-11, Brown University, Department of Computer Science, Providence, RI (1996)
28. Thrun, S., Fox, W., Burgard, D., Dellaert, F.: Robust Monte Carlo localization for mobile robots. Artif. Intell. 128, 99-141 (2001)
29. Watkins, C.J.C.H.: Learning from delayed rewards. Ph.D. thesis, University of Cambridge (1989)