Adaptive dynamic programming approach to experience-based systems identification and control

Neural Networks

Volumn 22, Issue 5-6, 2009, Pages 822-832

  Lendaris, George G ^a  

^a Department of Electrical and Computer Engineering   (United States)

Author keywords

Approximate Dynamic Programming (ADP); Context discernment; Experience based identification and control; Neural networks; Optimal control; Systems identification

Indexed keywords

APPROXIMATE DYNAMIC PROGRAMMING (ADP); CONTEXT DISCERNMENT; EXPERIENCE-BASED IDENTIFICATION AND CONTROL; OPTIMAL CONTROL; SYSTEMS IDENTIFICATION;

CONTROLLERS; DYNAMIC PROGRAMMING; IDENTIFICATION (CONTROL SYSTEMS); LEARNING ALGORITHMS; NEURAL NETWORKS; OPTIMAL CONTROL SYSTEMS; OPTIMIZATION; REINFORCEMENT; REINFORCEMENT LEARNING; SYSTEMS ENGINEERING;

ADAPTIVE CONTROL SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; EXPERIENCE; LEARNING; ONLINE SYSTEM; PRIORITY JOURNAL; REINFORCEMENT; TASK PERFORMANCE;

AIRCRAFT; ALGORITHMS; ARTIFICIAL INTELLIGENCE; AUTOMOBILE DRIVING; HUMANS; LEARNING; NEURAL NETWORKS (COMPUTER); REINFORCEMENT (PSYCHOLOGY); ROBOTICS; SOFTWARE;

EID: 68249144754     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2009.06.021     Document Type: Article

References (22)

1. Astrom K.J., and Wittenmark B. Computer controlled systems, theory and design (1984), Prentice-Hall, Englewood Cliffs, NJ
2. Bertsekas D.P., and Shreve S.E. Stochastic optimal control: The discrete-time case (1996), Athena Scientific, Belmont, MA
3. Dorf R.C., and Bishop R.H. Modern control systems. 9th ed. (2001), Prentice-Hall, Englewood Cliffs, NJ
4. Goodwin G.C., Graebe S.F., and Salgado M.E. Control system design (2000), Prentice Hall
5. Holmstrom L.A., Santiago R.A., and Lendaris G.G. On-line system identification using context discernment. Proc of the international joint conference on neural networks'05 (2005), IEEE Press
6. Lendaris G.G. On systemness and the problem solver: Tutorial comments. IEEE Transactions on Systems, Man, and Cybernetics SMC-16 4 (1986) 604-610
7. ®". Final Report. NASA P.O. L-17041 (also, for NAS1-01070; AAC Subcontract # 462), June 15
8. Lendaris G.G. Higher level application of ADP: A next phase for the control field?. IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics 38 4 (2008)
9. Lendaris G.G. A retrospective on adaptive dynamic programming for control. Proceedings of international joint conference on neural networks (2009), IEEE Press
10. Lendaris, G.G., & Schultz, L.J. (2000). Controller design (from scratch) using approximate dynamic programming. In Proceedings of IEEE international symposium on intelligent control '2000
11. Lendaris, G. G., Schultz, L. J., & Shannon, T. T. (2000). Adaptive critic design for intelligent steering and speed control of a 2-axle vehicle. In Proceedings of international joint conference on neural networks '2000
12. Lendaris G.G., and Neidhoefer J.C. Guidance in the use of adaptive critics for control. Handbook of learning and approximate dynamic programming (2004), IEEE Press, Piscataway, NJ 97-124
13. Lewis F.L. Applied optimal control and estimation (1992), Prentice-Hall, Englewood Cliffs, NJ
14. Lewis F.L., and Syrmos V.L. Optimal control. 2nd ed. (1995), Wiley, NJ
15. Mosca V. Optimal, predictive, and adaptive control (1995), Prentice-Hall, Englewood Cliffs, NJ
16. Ogata K. Modern control engineering. 3rd ed. (2000), Prentice-Hall, Englewood Cliffs, NJ
17. Phillips C.L., and Harbor R.D. Feedback control systems. 4th ed. (2000), Prentice-Hall, Englewood Cliffs, NJ
18. Santiago, R. A. (2005). Dissertation proposal, unpublished
19. Sastry S., and Bodson M. Adaptive control: Stability, convergence, and robustness (1989), Prentice-Hall, Englewood Cliffs, NJ
20. Si J., Barto A.G., Powell W.B., and Wunsch II D. Handbook of learning and approximate dynamic programming (2004), IEEE Press/Wiley-Interscience
21. Watt, J. (2005). Microsoft Encarta Online Encyclopedia 2005. 1997-2005 Microsoft Corporation. [Online]. Available: http://encarta.msn.com
22. Zhou K., and Doyle J.C. Essentials of robust control (1998), Prentice-Hall, Englewood Cliffs, NJ