Controlling chaos by GA-based reinforcement learning neural network

IEEE Transactions on Neural Networks

Volumn 10, Issue 4, 1999, Pages 846-859

  Lin, Chin Teng ^a,b   Jou, Chong Ping ^b  

^a IEEE

^b NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

Author keywords

[No Author keywords available]

Indexed keywords

CHAOS THEORY; COMPUTER SIMULATION; GENETIC ALGORITHMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; OPTIMAL CONTROL SYSTEMS; PERTURBATION TECHNIQUES;

PERIODIC CONTROL; REINFORCEMENT LEARNING; TEMPORAL DIFFERENCE PREDICTION;

FEEDFORWARD NEURAL NETWORKS;

EID: 0032666024     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.774236     Document Type: Article

References (38)

1. F. C. Moon, Chaotic and Fractal Dynamics. New York: Wiley, 1992, pp. 1-46.
2. E. Ott, C. Grebogi, and J. A. Yorke, "Controlling chaos," Phys. Rev. Lett., vol. 64, pp. 1196-1199, 1990.
3. W. D. Ditto, S. N. Rauseo, and M. L. Spano, "Experimental control of chaos," Phys. Rev. Lett., vol. 65, pp. 3211-3214, 1990.
4. J. Singer, Y. Z. Wang, and H. H. Bau, "Controlling a chaotic system," Phys. Rev. Lett., vol. 66, pp. 1123-1125, 1991.
5. A. Garfinkl, M. L. Spano, W. L. Ditto, and J. N. Weiss, "Controlling cardiac chaos," Science, vol. 257, pp. 1230-1235, 1992.
6. U. Dressler and G. Nitsche, "Controlling chaos using time delay coordinates," Phys. Rev. Lett., vol. 68, pp. 1-4, 1992.
7. F. J. Romeiras, C. Grebogi, E. Ott, and W. P. Dayawansa, "Controlling chaotic dynamical system," Phys. D, vol. 58, pp. 165-192, 1992.
8. T. Shinbrot, E. Ott, C. Grebogi, and J. A. Yorke, "Using small perturbations to control chaos," Nature, vol. 363, pp. 411-417, 1993.
9. M. Lakshmanan and K. Murali, Chaos in Nonlinear Oscillators: Controlling and Synchronization. Singapore: World, 1996.
10. P. M. Alsing, A. Gavrielides, and V. Kovanis, "Using neural networks for controlling chaos," Phys. Rev. E., vol. 49, pp. 1225-1231, 1994.
11. K. Otawara and L. T. Fan, "Controlling chaos with an artificial neural networks," in Proc. IEEE Int. Joint Conf. Fuzzy Syst., 1995, vol. 4, pp. 1943-1948.
12. A. G. Barto and M. I. Jordan, "Gradient following without backpropagation in layered network," in Proc. Int. Joint Conf. Neural Networks, San Diego, CA, 1987, vol. II, pp. 629-636.
13. A. G. Barto, R. S. Sutton, and C. W. Anderson, "Neuronlike adaptive elements that can solve difficult learning control problem," IEEE Trans. Syst., Man, Cybern., vol. SMC-13, pp. 834-847, 1983.
14. R. S. Sutton, "Temporal credit assignment in reinforcement learning," Ph.D. dissertation, Univ. Massachusetts, Amherst, 1984.
15. A. G. Barto and P. Anandan, "Pattern recognizing stochastic learning automata," IEEE Trans. Syst. Man Cybern., vol. SMC-15, pp. 360-375, 1985.
16. R. J. Williams, "A class of gradient estimating algorithms for reinforcement learning in neural networks," in Proc. Int. Joint Conf. Neural Networks, San Diego, CA, 1987, vol. II, pp. 601-608.
17. C. W. Anderson, "Strategy learning with multilayer connectionist representations," in Proc. 4th Int. Workshop Mach. Learn., Irvine, CA, June 1987, pp. 103-114.
18. H. R. Berenji and P. Khedkar, "Learning and tuning fuzzy logic controllers through reinforcements," IEEE Trans. Neural Networks, vol. 3, pp. 724-740, 1992.
19. C. T. Lin and C. S. G. Lee, "Reinforcement structure/parameter learning for an integrated fuzzy neural network," IEEE Trans. Fuzzy Syst., vol. 2, pp. 46-63, Feb. 1994.
20. J. H. Holland, "Outline for a logical theory of adaptive systems," J. Assoc. Comput. Machinery, vol. 3, pp. 297-314, 1962.
21. _, Adaptation in Natural and Artificial System. Ann Arbor, MI: Univ. Michigan, 1975.
22. S. Harp, T. Samad, and A. Guha, "Designing application specific neural networks using the genetic algorithm," Neural Information Processing Systems, vol. 2. San Mateo, CA: Morgan Kaufmann, 1990.
23. J. D. Schaffer, R. A. Caruana, and L. J. Eshelman, "Using genetic search to exploit the emergent behavior of neural networks," Phys. D, vol. 42, pp. 244-248, 1990.
24. D. Whitley, S. Dominic, R. Das, and C. W. Anderson, "Genetic reinforcement learning for neurocontrol problems," Machine Learning, vol. 13, pp. 259-284, 1993.
25. D. E. Moriarty and R. Miikkulainen, "Efficient reinforcement learning through symbiotic evolution," Machine Learning, vol. 22, pp. 11-32, 1996.
26. R. Lima and M. Pettini, "Suppression of chaos by resonant parametric perturbations," Phys. Rev., vol. A41, pp. 726-733, 1990.
27. K. Murali, M. Lakshmanan, and L. O. Chua, "Controlling and synchronization of chaos in the simplest dissipative nonautonomous circuit," Int. J. Bifurcation and Chaos Appl. Sci. Eng., vol. 5, pp. 563-571, 1995.
28. D. E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning. Reading, MA: Addison-Wesley, 1989.
29. E. L. Lawler, Combinatorial Optimization: Networks and Matroids. New York: Holt, Rinehart and Winston, 1976.
30. L. Davis, Handbook of Genetic Algorithms. New York: Van Nostrand Reinhold, 1991.
31. D. Adler, "Genetic algorithms and simulated annealing: A marriage proposal," in Proc. IEEE Int. Conf. Neural Networks, San Francisco, CA, 1993, vol. II, pp. 1104-1109.
32. L. Tsinas and B. Dachwald, "A combined neural and genetic learning algorithm," in Proc. IEEE Int. Conf. Neural Networks, 1994, vol. I, pp. 770-774.
33. V. Petridis, S. Kazarlis, A. Papaikonomou, and A. Filelis, "A hybrid genetic algorithm for training neural networks," in Artificial Neural Networks 2, I. Aleksander and J. Taylor, Eds. Amsterdam, The Netherlands: North Holland, 1992, pp. 953-956.
34. R. S. Sutton, "Learning to predict by the methods of temporal difference," Machine Learning, vol. 3, pp. 9-44, 1988.
35. P. J. Werbos, "A menu of design for reinforcement learning over time," in Neural Networks for Control, W. T. Miller, III, R. S. Sutton, and P. J. Werbos, Eds. Cambridge, MA: MIT Press, 1990, ch. 3.
36. D. Rumelhart, G. Hinto, and R. J. Williams, "Learning internal representation by error propagation," in Parallel Distributed Processing, D. Rumelhart and J. McCelland, Eds. Cambridge, MA: MIT Press, 1986, pp. 318-362.
37. L. M. Pecora and T. L. Carroll, "Synchronization in chaotic systems," Phys. Rev. Lett., vol. 64, no. 8, pp. 821-824, 1990.
38. A. Hohl, A. Gavrielides, T. Erneux, and V. Kovanis, "Localized synchronization in two coupled nonidentical semiconductor laser," Phys. Rev. Lett., vol. 78, no. 25, pp. 63-66, 1997.