Accelerating Critic Learning in Approximate Dynamic Programming Via Value Templates and Perceptual Learning

Proceedings of the International Joint Conference on Neural Networks

Volumn 4, Issue , 2003, Pages 2922-2927

  Shannon, Thaddeus T ^a   Santiago, Roberto A ^a   Lendaris, George G ^a  

^a PORTLAND STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONSTRAINT THEORY; DYNAMIC PROGRAMMING; FUZZY CONTROL; HEURISTIC PROGRAMMING; VALUE ENGINEERING;

VALUE TEMPLATES;

LEARNING SYSTEMS;

EID: 0141704189     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Barto, A.G., R.S. Sutton & C.W. Anderson, "Neuron-like Adaptive Elements That Can Solve Difficult Learning Control Problems", IEEE Transactions on Systems, Man, and Cybernetics, Vol. 13, pp. 834-846, 1983.
2. Bellman, R.E., Dynamic Programming, Princeton University Press, 1957.
3. Chomsky, N. Knowledge of Language: Its Nature, Origin, and Use, Praeger, New York, 1986.
4. Fodor, J. The present status of the innateness controversy in representations, MIT Press, Cambridge, MA, 1981, pp. 257-316.
5. Lin, C.T. & C.S.G. Lee, Neural Fuzzy Systems, Prentice Hall, Upper Saddle River, NJ, 1996.
6. Lin, C.T., & Y.C. Lu, "A Neural Fuzzy System with Linguistic Teaching Signals", IEEE Transactions on Fuzzy Systems, Vol. 3, # 2, 1995.
7. Liu, G.P., V. Kadirkamanathan & S.A. Billings, "Variable Neural Networks for Adaptive Control Of Nonlinear Systems", IEEE Transactions on Systems Man & Cybernetics - Part C, vol. 29, #1, February 1999, pp. 34-43.
8. Prokhorov, D., Adaptive Critic Designs and their Application, Ph.D. Dissertation, Department of Electrical Engineering, Texas Tech University, 1997.
9. Prokhorov, D. & D. Wunsch, "Adaptive Critic Designs", IEEE Transactions on Neural Networks, vol. 8 (5), 1997, pp. 997-1007.
10. Prokhorov, D., R. Santiago & D. Wunsch, "Adaptive Critic Designs: A Case Study for Neurocontrol", Neural Networks, vol. 8 (9), pp. 1367 - 1372, 1995.
11. Sanner, R.M. & J.J.E. Slotine, "Gaussian Networks for Direct Adaptive Control", IEEE Transactions on Neural Networks, vol. 13, pp. 837-863, June 1992.
12. Santiago, R. & P.J. Werbos, "New Progress Towards Truly Brain-Like Control", Proceedings of WCNN'94, San Diego, CA, 1994, pp. 27-33.
13. Shannon, T.T & G. G. Lendaris, "A Hierarchical Tuning of a Fuzzy Pitch Controller for an Unstable Airframe", in Proc. of IFSA-NAFIPS 2001, Vancouver BC, IEEE Press, July 2001.
14. Shannon, T.T & G. G. Lendaris, "Adaptive Critic Based Approximate Dynamic Programming for Tuning Fuzzy Controllers", in Proc. of IEEE-FUZZ 2000, San Antonio TX, IEEE Press, May 2000.
15. Shannon T.T., "Partial, Noisy and Qualitative Models for Adaptive Critic Based Neurocontrol", in Proceedings of IJCNN'99, Washington D.C., IEEE, 1999.
16. Shannon T.T., G.G. Lendaris "Qualitative Models for Adaptive Critic Neurocontrol", in Proceedings of SMC'99, IEEE, 1999.
17. Takagi, T, & M. Sugeno, "Fuzzy Identification of Systems and its Application to Modeling and Control", IEEE Transactions on Systems, Man, and Cybernetics, Vol. 15, #1, 1985.
18. Werbos, P.J., "A Menu of Designs for Reinforcement Learning Over Time", in Miller, W.T., R.S. Sutton, & P.J. Werbos eds., Neural Networks for Control, MIT Press, Cambridge, MA, 1990, pp. 67-95.
19. Werbos, P.J., "Approximate Dynamic Programming for Real-Time Control and Neural Modeling", in D.A. White & D.A. Sofge eds., Handbook of Intelligent Control: Neural, Fuzzy and Adaptive Approaches, Van Nostrand Reinhold, New York, 1992, pp. 493 - 525.
20. Yen, J. & R. Langari, Fuzzy Logic, Prentice Hall, Upper Saddle River, NJ, 1999.