A hierarchical learning architecture with multiple-goal representations based on adaptive dynamic programming

2010 International Conference on Networking, Sensing and Control, ICNSC 2010

Volumn , Issue , 2010, Pages 286-291

  He, Haibo ^a,b   Liu, Bo ^b  

^a University of Rhode Island   (United States)

^b Stevens Institute of Technology   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE DYNAMIC PROGRAMMING; HIERARCHICAL LEARNING; LEARNING AND ADAPTATION; MULTI-LEVEL; REFERENCE NETWORK; REINFORCEMENT SIGNAL; SIMULATION RESULT; SYSTEM-LEVEL ARCHITECTURES;

DYNAMIC PROGRAMMING; INTELLIGENT SYSTEMS;

REINFORCEMENT;

EID: 77953112568     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICNSC.2010.5461483     Document Type: Conference Paper

References (27)

1. P. J. Werbos, "Intelligence in the brain: A theory of how it works and how to build it," Neural Networks, pp. 200-212, 2009.
2. -, "Using ADP to understand and replicate brain intelligence: the next level design," in IEEE Int. Symposium on Approximate Dynamic Programming and Reinforcement Learning (ADPRL'07), 2007, pp. 209-216.
3. J. Hawkins and S. Blakeslee, On Intelligence, ser. Times Books, 2004.
4. -, "Why can't a computer be more like a brain?" IEEE Spectrum, vol. 44, no. 4, pp. 20-26, 2007.
5. R. A. Brooks, Flesh and Machines: How Robots Will Change Us. Pantheon, 2002.
6. R. Pfeifer and J. C. Bongard, How the Body Shapes the Way We Think - A New View of Intelligence. MIT Press, 2006.
7. Y. L. J. A. Starzyk and H. He, "Challenges of embodied intelligence," in Proc. Int. Conf. Signals and Electronic Syst. (ICSES'06), 2006, pp. 534-541.
8. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
9. P. J.Werbos, Handbook of Intelligent Control. New York: Van Nostrand, 1992, ch. Approximate Dynamic Programming for Real Time Control and Neural Modeling, pp. 493-525.
10. W. B. P. J. Si, A. G. Barto and D. W. II, Handbook of Learning and Approximate Dynamic Programming. IEEE Press, 2004.
11. D. V. Prokhorov and D. C. Wunsch, "Adaptive critic designs," IEEE Trans. on Neural Netw., vol. 8, no. 5, pp. 997-1007, 1997.
12. D. A. White and D. A. Sofge, Handbook of Intelligent Control. New York: Van Nostrand, 1992.
13. D. P. and J. Tsitsiklis, Neuro-Dynamic Programming. Athena Scientific, 1996.
14. W. B. Powell, Approximate Dynamic Programming: Solving the Curses of Dimensionality. Wiley-Interscience, 2007.
15. P. J. Werbos, Handbook of Learning and Approximate Dynamic Programming. IEEE Press, 2004, ch. ADP: Goals, Opportunities And Principles.
16. R. E. Bellman, Dynamic Programming. Princeton, NJ: Princeton University Press, 1957.
17. S. Ferrari and R. F. Stengel, Handbook of Learning and Approximate Dynamic Programming. IEEE Press, 2004, ch. Model-based Adaptive Critic Designs.
18. P. J.Werbos, Handbook of Intelligent Control. New York: Van Nostrand, 1992, ch. Neuralcontrol and Supervised Learning: an Overview and Evaluation.
19. -, "Building and understanding adaptive systems: A statistical/ numerical approach to factory automation and brain research," IEEE Trans. on Syst. Man, Cybern., vol. 17, no. 1, pp. 7-20, 1987.
20. -, Handbook of Intelligent Control. New York: Van Nostrand, 1992, ch. Approximate Dynamic Programming for Real Time Control and Neural Modeling, pp. 493-525.
21. R. K. R. Ilin and P. J. Werbos, "Beyond feedforward models trained by backpropagation: A practical training tool for a more efficient universal approximator," IEEE Trans. on Neural Netw., vol. 19, no. 6, pp. 929-937, 2008.
22. J. Si and D. Liu, Handbook of Learning and Approximate Dynamic Programming. IEEE Press, 2004, ch. Direct Neural Dynamic Programming, pp. 125-151.
23. J. Si and Y. T. Wang, "On-line learning control by association and reinforcement," IEEE Trans. on Neural Netw., vol. 12, no. 2, pp. 264-276, 2001.
24. R. Enns and J. Si, Handbook of Learning and Approximate Dynamic Programming. IEEE Press, 2004, ch. Helicopter Flight Control Using Direct Neural Dynamic Programming, pp. 535-559.
25. R. S. S. A. G. Barto and C. W. Anderson, "Neuron like adaptive elements that can solve difficult learning control problems," IEEE Trans. on Syst. Man, Cybern., vol. 13, pp. 834-847, 1983.
26. C. Anderson, "Strategy learning with multi-layer connectionist representation," in Proc. Fourth International Workshop on Machine Learning, 1987, pp. 103-114.
27. -, "Learning to control an inverted pendulum using neural networks," IEEE Control Syst. Mag., vol. 9, no. 3, pp. 31-37, 1989.