Recursive adaptation of stepsize parameter for non-stationary environments

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5925 LNAI, Issue , 2009, Pages 525-533

  Noda, Itsuki ^a,b,c  

^a NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

^b JAPAN ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^c UNIVERSITY OF TOKYO   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTATION METHODS; CONTINUOUS LEARNING; EXPONENTIAL MOVING AVERAGES; HIGHER ORDER; LEARNING AGENTS; LEARNING PARAMETERS; NON-STATIONARY ENVIRONMENT; NONSTATIONARY; RECURSIVE ADAPTATION; REINFORCEMENT LEARNING METHOD; STEPSIZE;

REINFORCEMENT; REINFORCEMENT LEARNING;

MULTI AGENT SYSTEMS;

EID: 76649105482     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-11161-7_38     Document Type: Conference Paper

References (7)

1. Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
2. Even-dar, E., Mansour, Y.: Learning rates for q-learning. Journal of Machine Learning Research 5 (December 2003)
3. George, A.P., Powell, W.B.: Adaptive stepsizes for recursive estimation with applications in approximate dynamic programming. Machine learning 65(1), 167-198 (2006)
4. Sato, M., Kimura, H., Kobayashi, S.: TD algorithm for the variance of return and mean-variance reinforcement learning (in japanese). Transactions of the Japanese Society for Artificial Intelligence 16(No. 3F), 353-362 (2001)
5. Douglas, S.C., Mathews, V.J.: Stochastic gradient adaptive step size algorithms for adaptive filtering. In: Proc. International Conference on Digital Signal Processing, pp. 142-147 (1995)
6. Ahmadi, M., Taylor, M.E., Stone, P.: IFSA: Incremental feature-set augmentation for reinforcement learning tasks. In: The Sixth International Joint Conference on Autonomous Agents and Multiagent Systems (May 2007)
7. Schoknecht, R., Riedmiller, M.: Speeding-up reinforcement learning with multi-step actions. In: Dorronsoro, J.R. (ed.) ICANN 2002. LNCS, vol. 2415, pp. 813-818. Springer, Heidelberg (2002)