Optimal trade-off between exploration and exploitation

Proceedings of the American Control Conference

Volumn , Issue , 2008, Pages 33-38

  Simpkins, Alex ^a   De Callafon, Raymond ^a   Todorov, Emanuel ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIORAL RESEARCH; CONTROL THEORY; DYNAMICS; INTERSECTIONS; NUMERICAL METHODS;

CONTROL LAWS; EQUIVALENCE PRINCIPLE; HUMAN BEHAVIORS; OPTIMAL CONTROL; SENSORY INFORMATION; STOCHASTIC OPTIMAL CONTROL; TO ESTIMATION; UNCERTAIN ENVIRONMENTS;

COMMERCE;

EID: 52449105901     PISSN: 07431619     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACC.2008.4586462     Document Type: Conference Paper

References (18)

1. B. Anderson and J. Moore. Optimal Filtering. Prentice Hall, 1979.
2. Y. Bar-Shalom. Stochastic dymamic programming: Caution and probing. IEEE Transactions on Automatic Control, 26(5):1184-1195, 1981.
3. D. Bertsekas and S. Schreve. Stochastic Optimal Control: The Discrete Time Case. Athena Scientific, 1995.
4. L. Collatz. The Numerical Treatment of Differential Equations. Springer-Verlag, 1966.
5. R. de Callafon and P. Van den Hof. Multivariable feedback relevant system identification of a wafer stepper system. IEEE Transactions on Control Systems Technology, 9(2):281-390, March 2001.
6. A. Feldbaum. Dual control theory i-iv. Automation and Remote Control, 21:874-880, 21:1033-1039, 22:1-12, 22:109-121, 1960-61.
7. J. Ferziger. Numerical Methods for Engineering Application. John Wiley and Sons, New York, NY, 2nd edition edition, 1998.
8. P. Ioanno and J. Sun. Robust Adaptive Control. Prentice Hall, 1996.
9. M. Krstic, I. Kanellakopoulos, and P. Kokotovic. Nonlinear and Adaptive Control Design. John Wiley and Sons, 1995.
10. H. Kushner and P. Dupuis. Numerical Methods for Stochastic Control Problems in Continuous Time. Springer-Verlag, New York, New York, 1992.
11. L. Ljung. System Identification: Theory for the User. Prentice Hall, PTR, Upper Saddle River, NJ, 2nd edition edition, 1999.
12. L. Scardoviet, M. Baglietto, and T. Parisini. Active state estimation for nonlinear systems: A neural approximation approach. IEEE Transactions on Neural Networks, 18(4):1172-1184, July 2007.
13. J. Si, A. Barto, W. Powell, and D. Wunsch, editors. Handbook of Learning and Approximate Dynamic Programming. IEEE Press on Computational Intelligence, 2004.
14. H. W. Sorenson, editor. Kalman Filtering: Theory and Application. IEEE Press, 1985.
15. R. Stengel. Stochastic Optimal Control: Theory and Application. John Wiley and Sons, 1986.
16. E. Todorov. Optimality principles in sensorimotor control. Nature Neuroscience, 7:907-915, 2004.
17. P. Van den Hof and R. Schrama. Idenfication and control - closed loop issues. Automatica, 31(12):1751-1770, 1995.
18. B. Wittenmark. Adaptive dual control methods: An overview. In 5th IFAC symposium on Adaptive Systems in Control and Signal Processing, pages 67-73, 1995.