Adaptive feedback control by constrained approximate dynamic programming

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 38, Issue 4, 2008, Pages 982-987

  Ferrari, Silvia ^a   Steck, James E ^b   Chandramohan, Rajeev ^b  

^a USA   (United States)

^b Wichita State University   (United States)

Author keywords

Approximate dynamic programming (ADP); Constrained optimization; Feedback control; Neural networks (NNs)

Indexed keywords

CONSTRAINED OPTIMIZATION; DYNAMIC PROGRAMMING; DYNAMICS; EQUATIONS OF MOTION; FEEDBACK CONTROL; LINEAR EQUATIONS; MATHEMATICAL PROGRAMMING; NEURAL NETWORKS; REINFORCEMENT; REINFORCEMENT LEARNING; SYSTEM STABILITY; SYSTEMS ENGINEERING;

ADAPTIVE FEEDBACK CONTROL; ADAPTIVE NEURAL NETWORKS; APPROXIMATE DYNAMIC PROGRAMMING; APPROXIMATE DYNAMIC PROGRAMMING (ADP); BASE-LINE PERFORMANCE; CLOSED-LOOP STABILITY; CLOSED-LOOP SYSTEMS; CONTROL FAILURES; LINEAR PARAMETER-VARYING; LINEARIZED EQUATIONS; NEURAL NETWORKS (NNS); PARAMETER VARIATIONS; PERFORMANCE GUARANTEES; PRIOR KNOWLEDGE; UNMODELED DYNAMICS;

ADAPTIVE CONTROL SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; FEEDBACK SYSTEM; SYSTEM ANALYSIS; SYSTEMS THEORY; THEORETICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; FEEDBACK; MODELS, THEORETICAL; NEURAL NETWORKS (COMPUTER); PROGRAMMING, LINEAR; SYSTEMS THEORY;

EID: 49049120808     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2008.924140     Document Type: Article

References (20)

1. S. Limanond and J. Si, "Neural-network-based control design: An LMI approach," IEEE Trans. Neural Netw., vol. 9, no. 6, pp. 1422-1429, Nov. 1998.
2. G. G. Lendaris and J. C. Neidhoefer, "Guidance in the use of adaptive critics for control," in Learning and Approximate Dynamic Programming, J. Si, A. Barto, and W. Powell, Eds. Hoboken, NJ: Wiley, 2004.
3. S. N. Balakrishnan and V. Biega, "Adaptive-critic-based neural networks for aircraft optimal control," J. Guid. Control Dyn., vol. 19, no. 4, pp. 893-898, 1996.
4. G. K. Venayagamoorthy, R. G. Harley, and D. C.Wunsch, "Comparison of heuristic dynamic programming and dual heuristic programming adaptive critics for neurocontrol of a turbogenerator," IEEE Trans. Neural Netw., vol. 13, no. 3, pp. 764-773, May 2002.
5. P. J. Werbos, "Advanced forecasting methods for global crisis warning and models of intelligence," in Gen. Syst. Yearbook, vol. 22, 1977, pp. 25-38.
6. M. Abu-Khalaf and F. L. Lewis, "Nearly optimal state feedback control of constrained nonlinear systems using a neural networks HJB approach," Annu. Rev. Control, vol. 28, no. 2, pp. 239-251, 2004.
7. S. Ferrari and R. F. Stengel, "On-line adaptive critic flight control," J. Guid. Control Dyn., vol. 27, no. 5, pp. 777-786, Sep./Oct. 2004.
8. Y. Wang, H. Wang, and J. Jiao, "Nonlinear one-step-ahead predictive mean control of bounded stochastic systems with guaranteed stability," Int. J. Syst. Sci., vol. 35, no. 2, pp. 97-107, Feb. 2004.
9. q theory: A neural control framework with global asymptotic stability criteria," Neural Netw., vol. 10, no. 4, pp. 615-637, Jun. 1997.
10. F. J. D'Amato, M. A. Rotea, A. V. Megretski, and U. T. Jönsson, "New results for analysis of systems with repeated nonlinearities," Automatica, vol. 37, no. 5, pp. 739-747, 2001.
11. A. Megretski and A. Rantzer, "System analysis via integral quadratic constraints," IEEE Trans. Autom. Control, vol. 42, no. 6, pp. 819-830, Jun. 1997.
12. ∞ controllers," IEEE Trans. Autom. Control, vol. 40, no. 5, pp. 853-864, May 1995.
13. [Online]. Available:http://fred.mems.duke.edu/silvia.ferrari/ SMCADPsupplement08.pdf
14. R. F. Stengel, Optimal Control and Estimation. New York: Dover, 1994.
15. R. Howard, Dynamic Programming and Markov Processes. Cambridge, MA: MIT Press, 1960.
16. S. Ferrari and R. F. Stengel, "Model-based adaptive critic designs," in Learning and Approximate Dynamic Programming, J. Si, A. Barto, and W. Powell, Eds. Hoboken, NJ: Wiley, 2004.
17. S. Ferrari and M. Jensenius, "A constrained optimization approach to preserving prior knowledge during incremental training," IEEE Trans. Neural Netw., vol. 19, no. 6, pp. 996-1009, 2008.
18. D. P. Bertsekas, Constrained Optimization and Lagrange Multiplier Methods. Belmont, MA: Athena Scientific, 1996.
19. S. Ferrari, "Algebraic and adaptive learning in neural control systems," Ph.D. dissertation, Princeton Univ., Princeton, NJ, Nov. 2002.
20. R. Chandramohan, "Adaptive critic flight control for a general aviation aircraft: Simulations for the beech bonanza fly-by-wire testbed," M.S. thesis, Whichita State Univ., Wichita, KS, May 2007.