Solving the curse of dimensionality utilizing action-dependent heuristic dynamic programming

Proceedings - 2011 IEEE International Conference on Computer Science and Automation Engineering, CSAE 2011

Volumn 2, Issue , 2011, Pages 289-292

  Huang, Zhi Jian ^a,b   Ma, Jie ^a  

^a Shanghai Jiao Tong University   (China)

^b SHANGHAI MARITIME UNIVERSITY   (China)

Author keywords

Adaptive critic designs; Approximate dynamic programming; engine fluctuation control at idle; neural network

Indexed keywords

ADAPTIVE CRITIC DESIGNS; APPROXIMATE DYNAMIC PROGRAMMING; CONTROLLED OBJECTS; CONVERGENCE PERFORMANCE; CURSE OF DIMENSIONALITY; DECISION MAKING PROCESS; GENERAL PURPOSE; HEURISTIC DYNAMIC PROGRAMMING; MULTI-STAGE; OPTIMAL CONTROL METHODS; SECOND ORDERS; SPEED FLUCTUATIONS; STABILITY PERFORMANCE; SYSTEM FRAMEWORK; THEORY AND METHODS; TRAINING ALGORITHMS;

COMPUTER SCIENCE; CONVERGENCE OF NUMERICAL METHODS; DECISION MAKING; DIESEL ENGINES; ENGINE CYLINDERS; HEURISTIC METHODS; HEURISTIC PROGRAMMING; NEURAL NETWORKS; PROBLEM SOLVING;

DYNAMIC PROGRAMMING;

EID: 80051904843     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CSAE.2011.5952472     Document Type: Conference Paper

References (12)

1. R. Bellman, Dynamic Programming, Princeton University Press, Princeton: NJ, 1957, pp.1-58.
2. R. E. Larson and J. L. Casti, Principles of Dynamic Programming: Basic Analytical and Computational Methods. Marcel Dekker Inc: NY, 1978; 1-105.
3. D. Liu, X. Xiong, and Y. Zhang, "Action-dependent adaptive critic designs," Proceedings of the IEEE-INNS International Joint Conference on Neural Networks, Washington, DC, July 2001, pp.990-995. (Pubitemid 32805299)
4. W. B. Powell, Approximate Dynamic Programming: Solving the Curses of Dimensionality, John Wiley & Sons, Inc. Press, Hoboken, New Jersey, 2007, pp.17-126
5. J. Govindhasamy, S. McLoone, G. Irwin, J. French and R. Doyle, "Reinforcement Learning for Online Control and Optimization," IEE Control Engineering Book Series, 70 (9), 2005, pp.293-326.
6. J. Si and Y. T. Wang, "On-line learning control by association and reinforcement," IEEE Trans. Neural Networks, vol. 12, no. 2, Mar. 2001, pp.264-276. (Pubitemid 32371483)
7. L. S. H. Ngia, J. Sjöberg and M. Viberg, "Adaptive Neural Networks Filter Using a Recrusive Levenberg-Marquardt Search Direction," Proceedings of the 3rd Asilomar Conference on Signals, System and Computers, November 1988, pp. 697-701.
8. M. E. Salgado, G. C. Goodwin and R. H. Middleton, "Modified Least Squares Algorithm Incorporating Exponential Resetting and Forgetting," International Journal of Control, vol.47, no.2, 1988, pp. 477-491.
9. C.W. Anderson, "Learning and problem solving with multilayer connectionist systems," Doctoral Dissertation, Department of Computer and Information Science, University of Massachusetts, Amherst, MA, 1986, pp.9-150.
10. L. Ljung, and T. Söderström, "Theory and Practice of Receusive Identification," MIT, Cambridge, MA, 1983.
11. D. Shim, J. Park, P. P. Khargonekar and W. B. Ribbens, "Reducing automotive engine speed fluctuation at idle," IEEE Trans. On Control Systems Technology, vol. 4, no. 4, July 1996, pp.404-410. (Pubitemid 126777703)
12. D. Kim and J. Park, "Application of adaptive control to the fluctuation of engine speed at idle," Information Sciences, vol.177, no. 16, Aug. 2007, pp. 3341-3355. (Pubitemid 46809880)