A reinforcement learning model using deterministic state-action sequences

International Journal of Innovative Computing, Information and Control

Volumn 6, Issue 2, 2010, Pages 577-590

  Murata, Makoto ^a   Ozawa, Seiichi ^a  

^a KOBE UNIVERSITY   (Japan)

Author keywords

Inductive bias; Macro action; Radial basis function; Reinforcement learning

Indexed keywords

ACTION SELECTION; ACTION SEQUENCES; ACTOR CRITIC; EXPLICIT FORM; EXPLORATION AND EXPLOITATION; INDUCTIVE BIAS; LONG TERM MEMORY; LOW TEMPERATURES; NEURAL MODELS; NEW APPROACHES; OPTIMAL ACTION POLICIES; PRIMITIVE ACTIONS; RADIAL BASIS FUNCTIONS; RADIAL-BASIS FUNCTION; REINFORCEMENT LEARNING MODELS; TEMPERATURE PARAMETERS;

REINFORCEMENT LEARNING;

REINFORCEMENT;

EID: 77649312856     PISSN: 13494198     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (17)

1. S. Elfwing, E. Uchibe, K. Doya, and H. I. Christensen, Multi-agent reinforcement learning: Using macro actions to learn a mating task, Proc. of Int. Conf. on Intel. Robots and Sys., vol.4, pp.3164-3169, 2004.
2. Y. Hirashima, A Q-learning system for container transfer scheduling based on shipping order at container terminals, Int. J. of Innovative Computing, Information and Control, vol.4, no.3, pp.547-558, 2008.
3. G. A. Iba, A heuristic approach to the discovery of macro-operators, Machine Learning, vol.3, pp.285-317, 1989.
4. J. Leng, L. Jain, and C. Fyfe, Convergence analysis on temporal difference learning, Int. J. of Innovative Computing, Information and Control, vol.5, no.4, pp.913-922, 2009.
5. A. McGovern and A. G. Barto, Automatic discovery of subgoals in reinforcement learning using diverse density, Proc. of Int. Conf. on Machine Learning, 2001.
6. J. Morimoto and K. Doya, Reinforcement learning of dynamic motor sequence: learning to standup, Proc. of Int. Conf. on Intel. Robots and Sys., vol.3, pp.1721-1726, 1998.
7. M. Murata and S. Ozawa, A memory-based reinforcement learning model utilizing macro-actions, Proc. of 7th Int. Conf. on Adaptive and Natural Computing Algorithms, pp.78-81, 2005.
8. M. A. Muslim, M. Ishikawa, and T. Furukawa, Task segmentation in a mobile robot by mnSOM and clustering with spatio-temporal contiguity, Int. J. of Innovative Computing, Information and Control, vol.5, no.4, pp.865-875, 2009.
9. S. Ozawa and S. Abe, A memory-based reinforcement learning algorithm to prevent unlearning in neural networks, in Neural Information Processing: Research and Development, J. C. Rajapaks and L. Wang (ed.), Springer, pp.238-255, 2004.
10. S. Ozawa, S. L. Toh, S. Abe, S. Pang, and N. Kasabov, Incremental learning of feature space and classifier for face recognition, Neural Networks, vol.18, pp.575-584, 2005. (Pubitemid 43186577)
11. S. Ozawa, A. Roy, and D. Roussinov, A multitask learning model for online pattern recognition, IEEE Trans. on Neural Networks, vol.20, no.3, pp.430-445, 2009.
12. M. Pickett and A. G. Barto, PolicyBlocks: An algorithm for creating useful macro-actions in reinforcement learning, Proc. of Int. Conf. on Machine Learning, pp.506-513, 2002.
13. J. Platt, A resource allocating network for function interpolation, Neural Computation, vol.3, pp.213-225, 1991.
14. R. S. Sutton and A. G. Barto, Reinforcement Learning - An Introduction, The MIT Press, 1998.
15. R. S. Sutton, D. Precup, and S. Singh, Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning, Artificial Intelligence, vol.112, pp.181-211, 1999.
16. S. Thrun and A. Schwartz, Finding structure in reinforcement learning, Advances in Neural Info. Processing Systems 7, the MIT Press, 1995.
17. S. Thrun and L. Pratt, Learning to Learn, Kluwer Academic Pub., 1998.