Reinforcement group cooperation-based symbiotic evolution for recurrent wavelet-based neuro-fuzzy systems

Neurocomputing

Volumn 72, Issue 10-12, 2009, Pages 2418-2432

  Hsu, Yung Chi ^a   Lin, Sheng Fuu ^a  

^a NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

Author keywords

Control; Neuro fuzzy system; Recurrent network; Reinforcement learning; Symbiotic evolution

Indexed keywords

CONTROL PROBLEMS; CROSSOVER STRATEGIES; NEURO-FUZZY SYSTEM; NUMERICAL CONTROLS; RECURRENT NETWORK; SYMBIOTIC EVOLUTION;

CHROMOSOMES; EDUCATION; FUZZY SYSTEMS; REINFORCEMENT; REINFORCEMENT LEARNING;

FUZZY LOGIC;

ACCURACY; ARTICLE; ARTIFICIAL NEURAL NETWORK; CHROMOSOME; CLUSTER ANALYSIS; COMPUTER SIMULATION; CONTROL SYSTEM; CONTROLLED STUDY; FUZZY SYSTEM; GENETIC ALGORITHM; INFORMATION PROCESSING; INFORMATION SYSTEM; LEARNING ALGORITHM; ONLINE ANALYSIS; PRIORITY JOURNAL;

EID: 67349085163     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2008.12.027     Document Type: Article

References (53)

1. Lin C.T., and Lee C.S.G. Neural Fuzzy Systems: A Neuro-Fuzzy Synergism to Intelligent System (1996), Prentice-Hall, NJ
2. Towell G.G., and Shavlik J.W. Extracting refined rules from knowledge-based neural networks. Mach. Learn. 13 (1993) 71-101
3. Lin C.J., and Lin C.T. An ART-based fuzzy adaptive learning control network. IEEE Trans. Fuzzy Syst. 5 4 (1997) 477-496
4. Wang L.X., and Mendel J.M. Generating fuzzy rules by learning from examples. IEEE Trans. Syst. Man Cybern. 22 6 (1992) 1414-1427
5. Takagi T., and Sugeno M. Fuzzy identification of systems and its applications to modeling and control. IEEE Trans. Syst. Man Cybern. 15 (1985) 116-132
6. Juang C.F., and Lin C.T. An on-line self-constructing neural fuzzy inference network and its applications. IEEE Trans. Fuzzy Syst. 6 1 (1998) 12-31
7. Jang J.S.R. ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans. Syst. Man Cybern. 23 3 (1993) 665-685
8. Lin F.J., Lin C.H., and Shen P.H. Self-constructing fuzzy neural network speed controller for permanent-magnet synchronous motor drive. IEEE Trans. Fuzzy Syst. 9 5 (2001) 751-759
9. Takagi H., Suzuki N., Koda T., and Kojima Y. Neural networks designed on approximate reasoning architecture and their application. IEEE Trans. Neural Networks 3 5 (1992) 752-759
10. E. Mizutani, J.S.R. Jang, Coactive neural fuzzy modeling, in: Proceedings of International Conference on Neural Networks, 1995, pp. 760-765.
11. Lin C.J., and Chin C.C. Prediction and identification using wavelet-based recurrent fuzzy neural networks. IEEE Trans. Syst. Man Cybern. Part B 34 5 (2004) 2144-2154
12. Narendra K.S., and Parthasarathy K. Identification and control of dynamical systems using neural networks. IEEE Trans. Neural Networks 1 1 (1990) 4-27
13. Juang C.F., and Lin C.T. A recurrent self-organizing neural fuzzy inference network. IEEE Trans. Neural Networks 10 4 (1999) 828-845
14. Mastorocostas P.A., and Theocharis J.B. A recurrent fuzzy-neural model for dynamic system identification. IEEE Trans. Syst. Man Cybern. Part B 32 2 (2002) 176-190
15. X. Xu, H.G. He, Residual-gradient-based neural reinforcement learning for the optimal control of an acrobat, in: Proceedings of IEEE International Conference on Intelligent Control, 2002, pp. 27-30.
16. O. Grigore, Reinforcement learning neural network used in control of nonlinear systems, in: Proceedings of IEEE International Conference on Industrial Technology, vol. 1, 2000, pp. 19-22.
17. Barto A.G., Sutton R.S., and Anderson C.W. Neuron like adaptive elements that can solve difficult learning control problem. IEEE Trans. Syst. Man Cybern. 13 5 (1983) 834-847
18. Lin C.J. A GA-based neural network with supervised and reinforcement learning. J. Chin. Inst. Electr. Eng. 9 1 (2002) 11-25
19. X.W. Yan, Z.D. Deng, Z.Q. Sun, Competitive Takagi-Sugeno fuzzy reinforcement learning, in: Proceedings of IEEE International Conference on Control Applications, 2001, pp. 878-883.
20. Lin C.T., and Jou C.P. GA-based fuzzy reinforcement learning for control of a magnetic bearing system. IEEE Trans. Syst. Man Cybern. Part B 30 2 (2000) 276-289
21. Berenji H.R., and Khedkar P. Learning and tuning fuzzy logic controllers through reinforcements. IEEE Trans. Neural Networks 3 5 (1992) 724-740
22. Goldberg D.E. Genetic Algorithms in Search Optimization and Machine Learning (1989), Addison-Wesley, Reading, MA
23. Koza J.K. Genetic Programming: On the Programming of Computers by Means of Natural Selection (1992), MIT Press, Cambridge, MA
24. Fogel L.J. Evolutionary programming in perspective: the top-down view. In: Zurada J.M., Marks II R.J., and Goldberg C. (Eds). Computational Intelligence: Imitating Life (1994), IEEE Press, Piscataway, NJ
25. Rechenberg I. Evolution strategy. In: Zurada J.M., Marks II R.J., and Goldberg C. (Eds). Computational Intelligence: Imitating Life (1994), IEEE Press, Piscataway, NJ
26. C.L. Karr, Design of an adaptive fuzzy logic controller using a genetic algorithm, in: Proceedings of the Fourth International Conference on Genetic Algorithms, 1991, pp. 450-457.
27. M. Lee, H. Takagi, Integrating design stages of fuzzy systems using genetic algorithms, in: Proceedings of the Second IEEE International Conference on Fuzzy Systems, San Francisco, CA, 1993, pp. 612-617.
28. Belarbi K., and Titel F. Genetic algorithm for the design of a class of fuzzy controllers: an alternative approach. IEEE Trans. Fuzzy Syst. 8 4 (2000) 398-405
29. Juang C.F. A hybrid of genetic algorithm and particle swarm optimization for recurrent network design. IEEE Trans. Syst. Man Cybern. Part B 34 2 (2004) 997-1006
30. Lin C.T., and Jou C.P. GA-based fuzzy reinforcement learning for control of a magnetic bearing system. IEEE Trans. Syst. Man Cybern. Part B 30 2 (2000) 276-289
31. Juang C.F., Lin J.Y., and Lin C.T. Genetic reinforcement learning through symbiotic evolution for fuzzy controller design. IEEE Trans. Syst. Man Cybern. Part B 30 2 (2000) 290-302
32. K.S. Tang, Genetic algorithms in modeling and optimization, Ph.D. Dissertation, Department of Electronic Engineering, City University Hong Kong, Hong Kong, 1996.
33. Juang C.F. Combination of online clustering and Q-value based GA for reinforcement fuzzy system design. IEEE Trans. Fuzzy Syst. 13 3 (2005) 289-302
34. F.J. Gomez, Robust non-linear control through neuroevolution, Ph.D. Disseration, The University of Texas at Austin, 2003.
35. F. Gomez, J. Schmidhuber, Co-evolving recurrent neurons learn deep memory POMDPs, in: Proceedings of Conference on Genetic and Evolutionary Computation, 2005, pp. 491-498.
36. V. Kreinovich, O. Sirisaengtaksin, S. Cabrera, Wavelet neural networks are asymptotically optimal approximators for functions of one variable, in: Proceedings of IEEE Conference on Neural Networks, vol. 1, 1994, pp. 299-304.
37. Ho D.W.C., Zhang P.A., and Xu J. Fuzzy wavelet networks for function learning. IEEE Trans. Fuzzy Syst. 9 1 (2001) 200-211
38. Zhang J., and Morris A.J. Recurrent neuro-fuzzy networks for nonlinear process modeling. IEEE Trans. Neural Networks 10 2 (1999) 313-326
39. Su S.F., and Yang F.Y. On the dynamical modeling with neural fuzzy networks. IEEE Trans. Neural Networks 13 6 (2002) 1548-1553
40. Michalewicz Z. Genetic Algorithms+Data Structures=Evolution Programs (1999), Springer, New York
41. R. Tanese, Distributed genetic algorithm, in: Proceedings of International Conference on Genetic Algorithms, 1989, pp. 434-439.
42. J. Arabas, Z. Michalewicz, J. Mulawka, GAVaPS-A genetic algorithm with varying population size, in: Proceedings of IEEE International Conference on Evolutionary Computation, Orlando, 1994, pp. 73-78.
43. Moriarty D.E., and Miikkulainen R. Efficient reinforcement learning through symbiotic evolution. Mach. Learn. 22 (1996) 11-32
44. Smith R.E., Forrest S., and Perelson A.S. Searching for diverse, cooperative populations with genetic algorithms. Evol. Comput. 1 2 (1993) 127-149
45. Cordon O., Herrera F., Hoffmann F., and Magdalena L. Genetic fuzzy systems evolutionary tuning and learning of fuzzy knowledge bases. Advances in Fuzzy Systems-Applications and Theory vol. 19 (2001), World Scientific Publishing, NJ
46. Lin C.J., and Xu Y.J. The design of TSK-type fuzzy controllers using a new hybrid learning approach. Int. J. Adaptive Control Signal Process. 20 (2006) 1-25
47. Cheok K.C., and Loh N.K. A ball-balancing demonstration of optimal and disturbance-accommodating control. IEEE Control Syst. Mag. (1987) 54-57
48. Whitley D., Dominic S., Das R., and Anderson C.W. Genetic reinforcement learning for neuro control problems. Mach. Learn. 13 (1993) 259-284
49. Lin C.J., and Xu Y.J. Efficient reinforcement learning through dynamical symbiotic evolution for TSK-type fuzzy controller design. Int. J. Gen. Syst. 34 5 (2005) 559-578
50. Hauser J., Sastry S., and Kokotovic P. Nonlinear control via approximate input-output linearization: the ball and beam example. IEEE Trans. Autom. Control 37 3 (1992) 392-398
51. K.A. De Jong, Analysis of the behavior of a class of genetic adaptive systems, Ph.D. Disseration, The University of Michigan, Ann Arbor, MI, 1975.
52. Grefenstette J.J. Optimization of control parameters for genetic algorithms. IEEE Trans. Syst. Man Cybern. 6 1 (1986) 122-128
53. A. Wieland, Evolving neural network controllers for unstable systems, in: Proceedings of IEEE Conference on Neural Networks, vol. 2, 1991, pp. 667-673.