H∞ reinforcement learning control of robot manipulators using fuzzy wavelet networks

Fuzzy Sets and Systems

Volumn 160, Issue 12, 2009, Pages 1765-1786

  Lin, Chuan Kai ^a  

^a Naval Academy   (Taiwan)

Author keywords

Fuzzy wavelet network (FWN); H control; Reinforcement learning; Robot manipulators

Indexed keywords

ACTOR-CRITIC REINFORCEMENT LEARNING; ADAPTIVE CRITIC NETWORKS; APPROXIMATION ERRORS; ASSOCIATIVE SEARCHES; EXTERNAL DISTURBANCES; FUNCTION APPROXIMATIONS; FUZZY WAVELET NETWORK (FWN); NON-LINEAR FUNCTIONS; OFF-LINE LEARNING; PERFORMANCE MEASUREMENTS; PRIOR KNOWLEDGE; REINFORCEMENT LEARNING CONTROLS; ROBOT DYNAMICS; ROBOT MANIPULATORS; SCARA ROBOTS;

CONTROL THEORY; CONTROLLERS; DYNAMICS; EDUCATION; FLEXIBLE MANIPULATORS; INDUSTRIAL ROBOTS; LEARNING ALGORITHMS; MODULAR ROBOTS; REINFORCEMENT; REINFORCEMENT LEARNING; RICCATI EQUATIONS; ROBOT APPLICATIONS; ROBOTICS; TRACKING (POSITION); UNITS OF MEASUREMENT;

ADAPTIVE CONTROL SYSTEMS;

EID: 64949155101     PISSN: 01650114     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.fss.2008.09.010     Document Type: Article

References (35)

1. Barto A.G. Adaptive critics and the basal ganglia. In: Houk J.C., Davis J., and Beiser D. (Eds). Models of Information Processing in the Basal Ganglia (1995), MIT Press, Cambridge, MA 215-232
2. Barto A.G., Sutton R.S., and Anderson W. Neuron like adaptive elements can solve difficult learning control problems. IEEE Trans. Systems Man Cybernet. 13 5 (1983) 834-846
3. Bucak I.O., and Zohdy M.A. Reinforcement learning control of nonlinear multi-link system. Eng. Appl. Artif. Intell. 14 5 (2001) 563-575
4. Cannon M., and Slotine J.-J.E. Space-frequency localized basis function networks for nonlinear system estimation and control. Neurocomputing 9 3 (1995) 293-342
5. ∞ tracking control design in robotic systems via neural networks. IEEE Trans. Control Systems Technology 5 1 (1997) 13-29
6. Chen B.-S., Uang H.-J., and Tseng C.-S. Robust tracking enhancement of robot systems including motor dynamics: a fuzzy-based dynamic game approach. IEEE Trans. Fuzzy Systems 6 4 (1998) 538-552
7. Crites R.H., and Barto A.G. An actor/critic algorithm that is equivalent to Q-learning. Adv. Neural Inform. Process. 7 (1994) 401-408
8. Dai X., Li C.-K., and Rad A.B. An approach to tune fuzzy controllers based on reinforcement learning for autonomous vehicle control. IEEE Trans. Intell. Transport. Systems 6 3 (2005) 285-293
9. Delyon B., Juditsky A., and Benveniste A. Accuracy analysis for wavelet approximations. IEEE Trans. Neural Networks 6 2 (1995) 332-348
10. Hwang K.S., Tan S.W., and Tsai M.C. Reinforcement learning to adaptive control of nonlinear systems. IEEE Trans. Systems Man Cybernet. Part B 33 3 (2003) 514-521
11. Ilg W., and Berns K. A learning architecture based on reinforcement learning for adaptive control of the walking machine LAURON. Robotics and Autonomous Systems 15 4 (1995) 321-334
12. Jagannathan S., and Galan G. Adaptive critic neural network-based object grasping control using a three-finger gripper. IEEE Trans. Neural Networks 15 2 (2004) 395-407
13. Kim E. Output feedback tracking control of robot manipulators with model uncertainty via adaptive fuzzy logic. IEEE Trans. Fuzzy Systems 12 3 (2004) 368-378
14. Kim Y.H., and Lewis F.L. Optimal design of CMAC neural-network controller for robot manipulators. IEEE Trans. Systems Man Cybernet. Part C 30 1 (2000) 22-31
15. Kim Y.H., and Lewis F.L. Reinforcement adaptive learning neural-net-based friction compensation control for high speed and precision. IEEE Trans. Control Systems Technol. 8 1 (2000) 118-126
16. Kugarajah T., and Zhang Q. Multidimensional wavelet frames. IEEE Trans. Neural Networks 6 6 (1995) 1552-1556
17. Kuljaca O., and Lewis F.L. Adaptive critic design using nonlinear network structures. Internat. J. Adaptive Control Signal Process. 17 6 (2003) 431-445
18. Lee C.-C. A self-learning rule-based controller employing approximate reasoning and neural net concepts. Internat. J. Intell. Systems 6 1 (1991) 71-93
19. Lewis F.L., Jagannathan S., and Yesildirek A. Neural Network Control of Robot Manipulators and Nonlinear Systems (1999), Taylor & Francies, London, UK
20. Lewis F.L., Yegildirek A., and Liu K. Multilayer neural-net robot controller with guaranteed tracking performance. IEEE Trans. Neural Networks 7 2 (1996) 388-399
21. Lin C.-K. Adaptive tracking controller design for robotic systems using Gaussian wavelet networks. IEE Proc. D: Control Theory Appl. 149 4 (2002) 316-322
22. Lin C.-K. A reinforcement learning adaptive fuzzy controller for robots. Fuzzy Sets and Systems 137 3 (2003) 339-352
23. Lin C.-K. Adaptive critic autopilot design of bank-to-turn missiles using fuzzy basis function networks. IEEE Trans. Systems Man Cybernet. Part B 35 2 (2005) 197-207
24. Lin C.-K. Robust adaptive critic control of nonlinear systems using fuzzy basis function networks: an LMI approach. Inform. Sci. 177 22 (2007) 4934-4946
25. ∞ autopilot design of bank-to-turn missiles using fuzzy basis function networks. Fuzzy Sets and Systems 158 20 (2007) 2268-2287
26. Lin C.-K., and Wang S.-D. Fuzzy modelling using wavelet transforms. Electron. Lett. 32 24 (1996) 2255-2256
27. ∞ controller design for bank-to-turn missiles using ridge Gaussian neural networks. IEEE Trans. Neural Networks 15 6 (2004) 1507-1516
28. Lin C.-T., and Jou C.-P. Controlling chaos by GA-based reinforcement learning neural network. IEEE Trans. Neural Networks 10 4 (1999) 846-859
29. Lin C.-T., and Jou C.-P. GA-based fuzzy reinforcement learning for control of a magnetic bearing system. IEEE Trans. Systems Man Cybernet. Part B 30 2 (2000) 276-289
30. Preux P., Delepoulle S., and Darcheville J.C. A generic architecture for adaptive agents based on reinforcement learning. Inform. Sci. 161 1-2 (2004) 37-55
31. Song K.-T., and Chu T.-S. Reinforcement learning and its application to force control of an industrial robot. Control Eng. Practice 6 1 (1998) 37-44
32. Sutton R.S., Barto A.G., and Williams R.J. Reinforcement learning is direct adaptive optimal control. IEEE Control Systems Mag. 12 2 (1992) 19-22
33. Wang S.-D., and Lin C.-K. Adaptive tuning of fuzzy controller for robots. Fuzzy Sets and Systems 110 3 (2000) 351-363
34. Zhang Q., and Benveniste A. Wavelet networks. IEEE Trans. Neural Networks 3 6 (1992) 889-898
35. Zhou C., and Meng Q. Dynamic balance of a biped robot using fuzzy reinforcement learning agents. Fuzzy Sets and Systems 134 1 (2003) 169-187