Online adaptive critic flight control

Journal of Guidance, Control, and Dynamics

Volumn 27, Issue 5, 2004, Pages 777-786

  Ferrari, Silvia ^a   Stengel, Robert F ^b  

^a DUKE UNIVERSITY   (United States)

^b PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE ALGORITHMS; COMPUTER SIMULATION; FLIGHT DYNAMICS; FLIGHT SIMULATORS; HEURISTIC METHODS; NEURAL NETWORKS; OPTIMIZATION;

CONTROL FAILURES; CRITIC FLIGHT CONTROL; PARAMETER VARIATIONS; TWO-PHASE LEARNING; UNMODELED DYNAMICS;

NONLINEAR CONTROL SYSTEMS;

EID: 4944255184     PISSN: 07315090     EISSN: 15333884     Source Type: Journal    
DOI: 10.2514/1.12597     Document Type: Article

References (31)

1. Bellman, R. E., Dynamic Programming, Princeton Univ. Press, Princeton, NJ, 1957.
2. Kirk, D. E., Optimal Control Theory: An Introduction, Prentice-Hall, Englewood Cliffs, NJ, 1970, Chaps. 1-3.
3. Howard, R., Dynamic Programming and Markov Processes, MIT Press, Cambridge, MA, 1960, pp. 42, 43.
4. Venayagamoorthy, G. K., Harley, R. G., and Wunsch, D. C., "Comparison of Heuristic Dynamic Programming and Dual Heuristic Programming Adaptive Critics for Neurocontrol of a Turbogenerator," IEEE Transactions on Neural Networks, Vol. 13, No. 3, 2002, pp. 764-773.
5. Lendaris, G.G., Schultz, L., and Shannon, T. T., "Adaptive Critic Design for Intelligent Steering and Speed Control of a 2-Axle Vehicle," Proceedings of the International Joint Conference on Neural Networks, Inst. of Electrical and Electronics Engineers, Piscataway, NJ, 2000.
6. Han, D., and Balakrishnan, S. N., "Adaptive Critic Based Neural Networks for Control-Constrained Agile Missile Control," Proceedings of the American Control Conference, Inst. of Electrical and Electronics Engineers, Piscataway, NJ, 1999, pp. 2600-2604.
7. Saini, G., and Balakrishnan, S. N., "Adaptive Critic Based Neurocontroller for Autolanding of Aircraft," Proceedings of the American Control Conference, Inst. of Electrical and Electronics Engineers, Piscataway, NJ, 1997, pp. 1081-1085.
8. Balakrishnan, S. N., and Biega, V., "Adaptive-Critic-Based Neural Networks for Aircraft Optimal Control," Journal of Guidance, Control, and Dynamics, Vol. 19, No. 4, 1996, pp. 893-898.
9. KrishnaKumar, K., and Neidhoefer, J., "Immunized Adaptive Critics for Level-2 Intelligent Control," Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Vol. 1, IEEE Publications, Piscataway, NJ, 1997, pp. 856-861.
10. Werbos, P. J., "Approximate Dynamic Programming for Real-Time Control and Neural Modeling," Handbood of Intelligent Control, edited by D. A. White and D. Sofge, Van Nostrand Reinhold, New York, 1992, pp. 493-526.
11. Prokorov, D. V., and Wunsch, D. C., "Adaptive Critic Designs," IEEE Transactions on Neural Networks, Vol. 8, No. 5, 1997, pp. 997-1007.
12. Si, J., and Wang, Y. -T., "On-Line Learning Control by Association and Reinforcement," IEEE Transactions on Neural Networks, Vol. 12, No. 2, 2001, pp. 264-276.
13. Lendaris, G. G., and Shannon, T., "Application Considerations for the DHP Methodology," Proceedings of the International Joint Conference on Neural Networks, Inst. of Electrical and Electronics Engineers, Piscataway, NJ, 1998.
14. Stengel, R. F., Optimal Control and Estimation, Dover, New York, 1994.
15. Barron, A. R., "Universal Approximation Bounds for Superposition of a Sigmoidal Function," IEEE Transactions on Information Theory, Vol. 39, No. 3, 1993, pp. 930-945.
16. Shamma, J. S., and Athans, M., "Guaranteed Properties of Gain Scheduled Control for Linear Parameter-Varying Plants," Automatica, Vol. 27, No. 3, 1991, pp. 55-56.
17. Åström, K. J., and Stewart, G. W., "Solution of the Matrix Equation AX + XB = C," Communications of the ACM, Vol. 15, Feb. 1972, pp. 820-826.
18. Stengel, R. F., and Marrison, C., "Design of Robust Control Systems for Hypersonic Aircraft," Journal of Guidance, Control, and Dynamics, Vol. 21, No. 1, 1997, pp. 58-63.
19. Ferrari, S., and Stengel, R. F., "Classical/Neural Synthesis of Nonlinear Control Systems," Journal of Guidance, Control, and Dynamics, Vol. 25, No. 3, 2002, pp. 442-448.
20. Ferrari, S., and Stengel, R. F., "Model-Based Adaptive Critic Designs," Learning and Approximate Dynamic Programming, edited by J. Si, A. Barto, and W. Powell, Wiley (in press).
21. Werbos, P. J., "Backpropagation Through Time: What It Does and How to Do It," Proceedings of the IEEE, Vol. 78, No. 10, 1990, pp. 1550-1560.
22. Reidmiller, M., and Braun, H., "A Direct Adaptive Method for Faster Backpropagation Learning: The RPROP Algorithm," Proceedings of the IEEE International Conference on NN (ICNN), Inst. of Electrical and Electronics Engineers, Piscataway, NJ, 1993.
23. Narendra, K. S., and Parthasaranthy, K., "Identification and Control of Dynamical Systems Using Neural Networks," IEEE Transactions Neural Networks, Vol. 1, No. 1, 1990, pp. 4-27.
24. Huang, C., and Stengel, R. F., "Restructurable Control Using Proportional-Integral Model Following," Journal of Guidance, Control, and Dynamics, Vol. 13, No. 2, 1990, pp. 303-309.
25. Ferrari, S., "Algebraic and Adaptive Learning in Neural Control Systems," Ph.D. Thesis, Dept. of Mechanical and Aerospace Engineering, Princeton Univ., Princeton, NJ, 2002.
26. Stengel, R. F., Flight Dynamics, Princeton Univ. Press, Princeton (in press).
27. Kalviste, J., "Spherical Mapping and Analysis of Aircraft Angles for Maneuvering Flight," Journal of Aircraft, Vol. 24, No. 8, 1987, pp. 523-530.
28. Etkin, B., Dynamics of Atmospheric Flight, Wiley, Toronto, 1972.
29. Nelson, R. C., Flight Stability and Automatic Control, McGraw-Hill, New York, 1989.
30. Ferrari, S., and Stengel, R. F., "Algebraic Training of a Neural Network," Proceedings of the American Control Conference, Inst. of Electrical and Electronics Engineers, Piscataway, NJ, 2001, pp. 1605-1610.
31. Friedland, B., "Observers," The Control Handbook, edited by W. S. Levine, CRC Press, Boca Raton, FL, 1996, pp. 607-618.