Value-difference based exploration: Adaptive control between epsilon-greedy and softmax

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7006 LNAI, Issue , 2011, Pages 335-346

  Tokic, Michel ^a,b   Palm, Günther ^a  

^a UNIVERSITY OF ULM   (Germany)

^b UNIVERSITY OF APPLIED SCIENCES RAVENSBURG WEINGARTEN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION SELECTION; ADAPTIVE CONTROL; Q-LEARNING; TEMPORAL DIFFERENCE LEARNING;

INTELLIGENT AGENTS; LEARNING ALGORITHMS; MULTI AGENT SYSTEMS; POTASSIUM IODIDE;

ADAPTIVE CONTROL SYSTEMS;

EID: 80054004135     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-24455-1_33     Document Type: Conference Paper

References (14)

1. Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
2. Watkins, C.: Learning from Delayed Rewards. PhD thesis, University of Cambridge, Cambridge, England (1989)
3. Thrun, S.B.: Efficient exploration in reinforcement learning. Technical Report CMU-CS-92-102, Carnegie Mellon University, Pittsburgh, PA, USA (1992)
4. Kaelbling, L.P.: Learning in embedded systems. MIT Press, Cambridge (1993)
5. Auer, P.: Using confidence bounds for exploitation-exploration trade-offs. Journal of Machine Learning Research 3, 397-422 (2002)
6. Vermorel, J., Mohri, M.: Multi-armed bandit algorithms and empirical evaluation. In: Gama, J., Camacho, R., Brazdil, P., Jorge, A., Torgo, L. (eds.) ECML 2005. LNCS (LNAI), vol. 3720, pp. 437-448. Springer, Heidelberg (2005)
7. Heidrich-Meisner, V.: Interview with Richard S. Sutton. In: Künstliche Intelligenz, vol. 3, pp. 41-43 (2009)
8. Tokic, M.: Adaptive ε-greedy exploration in reinforcement learning based on value differences. In: Dillmann, R., Beyerer, J., Hanebeck, U.D., Schultz, T. (eds.) KI 2010. LNCS, vol. 6359, pp. 203-210. Springer, Heidelberg (2010)
9. Robbins, H.: Some aspects of the sequential design of experiments. Bulletin of the American Mathematical Society 58, 527-535 (1952)
10. Wiering, M.: Explorations in Efficient Reinforcement Learning. PhD thesis, University of Amserdam, Amsterdam (1999)
11. Rummery, G.A., Niranjan, M.: On-line Q-learning using connectionist systems. Technical Report CUED/F-INFENG/TR 166, Cambridge University (1994)
12. George, A.P., Powell, W.B.: Adaptive stepsizes for recursive estimation with applications in approximate dynamic programming. Machine Learning 65(1), 167-198 (2006)
13. Watkins, C., Dayan, P.: Technical note: Q-learning. Machine Learning 8(3), 279-292 (1992)
14. Daw, N.D., O'Doherty, J.P., Dayan, P., Seymour, B., Dolan, R.J.: Cortical substrates for exploratory decisions in humans. Nature 441, 876-879 (2006)