A reinforcement learning adaptive fuzzy controller for robots

Fuzzy Sets and Systems

Volumn 137, Issue 3, 2003, Pages 339-352

  Lin, Chuan Kai ^a  

^a Chinese Naval Academy Kaohsiung   (Taiwan)

Author keywords

Adaptive fuzzy controller; Reinforcement learning

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; CONTROL EQUIPMENT; LYAPUNOV METHODS; MANIPULATORS; ROBOT LEARNING; ROBOTIC ARMS; SYSTEM STABILITY;

REINFORCEMENT LEARNING;

FUZZY CONTROL;

EID: 0041876271     PISSN: 01650114     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0165-0114(02)00299-3     Document Type: Article

References (18)

1. Barto A.G., Sutton R.S., Anderson C.W. Neuronlike elements that can solve difficult learning control problems. IEEE Trans. Systems Man Cybernet. 13:1983;835-846.
2. J. Campos, F.L. Lewis, Adaptive critic neural network for feedforward compensation, Proc. American Control Conf., 1999, pp. 2813-2818.
3. Crites R.H., Barto A.G. Improving elevator performance using reinforcement learning. Adv. Neural Inform. Process. Systems. 8:1996;1017-1023.
4. S.H.G. ten Hagen, Continuous state space Q-learning for control of nonlinear systems, Ph.D. Thesis, University of Amsterdam, The Netherlands, 2001.
5. Jouffe L. Fuzzy inference system learning by reinforcement methods. IEEE Trans. System Man Cybernet. 28:1998;338-355.
6. Kaelbling L.P., Littman M.L., Moore A.W. Reinforcement learning: a survey. J. Artif. Intell. Res. 4:1996;237-285.
7. Lee C.C. A self learning rule-based controller employing approximate reasoning and neural net concept. Internat. J. Intell. Systems. 6:1991;71-93.
8. Lewis F.L., Yesilidrek A., Liu K. Multilayer neural-net robot controller with guaranteed performance. IEEE Trans. Neural Networks. 7:1996;388-399.
9. Marbach P., Tsitsiklis J.N. Simulation-based optimization of Markov reward processes. IEEE Trans. Automat. Control. 46:2001;191-209.
10. Procyk T.J., Mamdani E.H. A linguistic self-organizing process control. Automatica. 15:1979;15-30.
11. Saad M., Dessaint L.A., Bigras P., Al-Haddad K. Adaptive versus neural adaptive control: application to robotics. Internat. J. Adaptive Control Signal Process. 8:1994;223-236.
12. Slotine J.-J.E., Li W. Adaptive manipulator control: a case study. IEEE Trans. Automat. Control. 33:1988;995-1003.
13. Sutton R.S. Generalization in reinforcement learning: successful examples using sparse coarse coding. Adv. Neural Inform. Process. Systems. 8:1996;1038-1044.
14. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction. 1998;MIT Press, Cambridge, MA.
15. Sutton R.S., McAllester D., Singh S., Mansour Y. Policy gradient methods for reinforcement learning with function approximation. Adv. Neural Inform. Process. Systems. 12:2000;1057-1063.
16. Tsitsiklis J.N., Van Roy B. An analysis of temporal-difference learning with function approximation. IEEE Trans. Automat. Control. 42:1997;674-690.
17. Wang L.-X., Mendel J.M. Fuzzy basis functions, universal approximation, and orthogonal least-squares learning. IEEE Trans. Neural Networks. 3:1992;807-814.
18. Zeng X.-J., Singh M.G. Approximation theory of fuzzy systems - MIMO case. IEEE Trans. Fuzzy System. 3:1995;219-235.