Control of unknown nonlinear systems with efficient transient performance using concurrent exploitation and exploration

IEEE Transactions on Neural Networks

Volumn 21, Issue 8, 2010, Pages 1245-1261

  Kosmatopoulos, Elias B ^a,b  

^a DEMOCRITUS UNIVERSITY OF THRACE   (Greece)

^b INFORMATION TECHNOLOGIES INSTITUTE   (Greece)

Author keywords

Control Lyapunov function (CLF); exploitation vs exploration; high order neural networks (HONN); persistence of excitation (PE); sum of squares (SoS)

Indexed keywords

ADAPTIVE CONTROL; ADAPTIVE OPTIMIZATION; CONCURRENT EXPLOITATION; CONTROL GOALS; CONTROL LYAPUNOV FUNCTION; CONTROL PROBLEMS; CONTROL STRATEGIES; HIGH-ORDER NEURAL NETWORK; LEARNING MECHANISM; NEW RESULTS; PERSISTENCE OF EXCITATION; SIMULATION RESULT; SUM OF SQUARES; TRANSIENT PERFORMANCE; UNKNOWN ENVIRONMENTS;

CONCURRENCY CONTROL; COUPLINGS; DIFFERENTIAL EQUATIONS; DYNAMICAL SYSTEMS; FEEDBACK; FUZZY CONTROL; LYAPUNOV FUNCTIONS; LYAPUNOV METHODS; NEURAL NETWORKS; NONLINEAR SYSTEMS; STATE FEEDBACK; SYSTEMS ENGINEERING;

ADAPTIVE CONTROL SYSTEMS;

ADAPTATION; ALGORITHM; ANIMAL; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; FEEDBACK SYSTEM; HUMAN; MATHEMATICAL COMPUTING; NONLINEAR SYSTEM; PHYSIOLOGY;

ADAPTATION, PHYSIOLOGICAL; ALGORITHMS; ANIMALS; ARTIFICIAL INTELLIGENCE; FEEDBACK; HUMANS; MATHEMATICAL COMPUTING; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS;

EID: 77955518498     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2010.2050211     Document Type: Article

References (28)

1. S. N. Balakrishnan, J. Ding, and F. L. Lewis, "Issues on stability of ADP feedback controllers for dynamical systems," IEEE Trans. Syst., Man, Cybern. B, vol.38, no.4, pp. 913-917, Aug. 2008.
2. C. Berg, J. P. R. Christensen, and P. Ressel, "Positive definite functions on Abelian groups," Math. Ann., vol.223, no.3, pp. 253-274, Oct. 1976.
3. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming. Belmont, MA: Athena Scientific, 1996.
4. J. D. Cohen, S. M. McClure, and A. J. Yu, "Should I stay or should I go? Exploration vs. exploitation," Philos. Trans. R. Soc. B: Biol. Sci., vol.362, no.1481, pp. 933-942, May 2007.
5. N. D. Daw, J. P. O'Doherty, B. Seymour, P. Dayan, and R. J. Dolan, "Cortical substrates for exploratory decisions in humans," Nature, vol.441, pp. 876-879, Jun. 2006.
6. M. Fu and B. R. Barmish, "Adaptive stabilization of linear systems via switching control," IEEE Trans. Autom. Control, vol.31, no.12, pp. 1097-1103, Dec. 1986. (Pubitemid 17500503)
7. T. Hamel and R. Mahony, "Image based visual servo-control for a class of aerial robotic systems," Automatica, vol.43, no.11, pp. 1975-1983, Nov. 2007. (Pubitemid 47577517)
8. S. Ishii, W. Yoshida, J. Yoshimoto, "Control of exploitation- exploration meta-parameter in reinforcement learning," Neural Netw., vol.15, nos. 4-6, pp. 665-687, Jun.-Jul. 2002.
9. P. A. Ioannou and J. Sun, Stable and Robust Adaptive Control. Englewood Cliffs, NJ: Prentice-Hall, 1995.
10. E. B. Kosmatopoulos, M. M. Polycarpou, M. A. Christodoulou, and P. A. Ioannou, "High-order neural network structures for identification of dynamical systems," IEEE Trans. Neural Netw., vol.6, no.2, pp. 422-431, Mar. 1995.
11. E. B. Kosmatopoulos and P. A. Ioannou, "Robust switching adaptive control of multi-input nonlinear systems," IEEE Trans. Autom. Control, vol.47, no.4, pp. 610-624, Apr. 2002.
12. E. B. Kosmatopoulos, "An adaptive optimization scheme with satisfactory transient performance," Automatica, vol.45, no.3, pp. 716-723, 2009.
13. E.B. Kosmatopoulos and A. Kouvelas, "Large-scale nonlinear control system fine-tuning through learning," IEEE Trans. Neural Netw., vol.20, no.6, pp. 1009-1023, Jun. 2009.
14. E. B. Kosmatopoulos, "Adaptive control design based on adaptive optimization principles," IEEE Trans. Autom. Control, vol.53, no.11, pp. 2680-2685, Dec. 2008.
15. E. B. Kosmatopoulos, "CLF-based control design with good transient performance for known and unknown multi-input nonlinear systems," in Proc. ECC, Aug. 23-26, 2009, Paper MoB12.5.
16. E. B. Kosmatopoulos, "CLF-based control design for unknown multiinput nonlinear systems with good transient performance," IEEE Trans. Autom. Control (provisionally accepted).
17. N. Krislock, J. Lang, J. Varah, D. K. Pai, and H.-P. Seidel, "Local compliance estimation via positive semidefinite constrained least squares," IEEE Trans. Robot., vol.20, no.6, pp. 1007-1011, Dec. 2004.
18. J. B. Lasserre, "A sum of squares approximation of nonnegative polynomials," SIAM Rev., vol.49, no.4, pp. 651-669, 2007.
19. S. P. Moustakidis, G. A. Rovithakis, and J. B. Theocharis, "An adaptive neuro-fuzzy tracking control for multi-input nonlinear dynamic systems," Automatica, vol.44, no.5, pp. 1418-1425, 2008.
20. J. Nocedal and S. J. Wright, Numerical Optimization. New York: Springer-Verlag, 2000.
21. J. D. Rubio and W. Yu, "Nonlinear system identification with recurrent neural networks and dead-zone Kalman filter algorithm," Neurocomputing, vol.70, nos. 13-15, pp. 2460-2466, Aug. 2007.
22. E. D. Sontag, "A universal construction of Arstein's theorem on nonlinear stabilization," Syst. Control Lett., vol.13, no.3, pp. 117-123, 1989.
23. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
24. J. Tsinias, "Sufficient Lyapunov-like conditions for stabilization," Math. Contr., Sign., Syst., vol.2, no.4, pp. 343-357, Dec. 1989.
25. M. Usher, J. D. Cohen, J. Rajkowski, and G. Aston-Jones, "The role of the locus coeruleus in the regulation of cognitive performance," Science, vol.283, pp. 549-554, Jan. 1999.
26. P. J. Werbos, "A menu of designs for reinforcement learning over time," in Neural Networks for Control, W. T. Miller, R. S. Sutton, and P. J. Werbos, Eds. Cambridge, MA: MIT Press, 1991, pp. 67-95.
27. P. J. Werbos, "Approximate dynamic programming for real-time control and neural modeling," in Handbook of Intelligent Control, D. A. White and D. A. Sofge, Eds. New York: Van Nostrand Reinhold, 1992, ch. 13.
28. A. Yu and P. Dayan, "Uncertainty, neuromodulation and attention," Neuron, vol.46, no.4, p. 681-692, May 2005.