Bounds of optimal learning

2009 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning, ADPRL 2009 - Proceedings

Volumn , Issue , 2009, Pages 199-204

  Belavkin, Roman V ^a  

^a MIDDLESEX UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DYNAMIC PROCESS; DYNAMICAL CONSTRAINTS; FUNCTION SPACES; GAUGE FUNCTIONS; INFORMATION GEOMETRY; KL-DIVERGENCE; LEARNING TRAJECTORIES; NON-PARAMETRIC; ONLINE LEARNING SYSTEMS; OPTIMAL UTILITY; OPTIMALITY CONDITIONS; OPTIMISATION; ORLICZ SPACES; PARAMETRISATION; QUASI-METRIC SPACES; STATISTICAL MANIFOLDS; VARIATIONAL METHODS;

EDUCATION; INFORMATION THEORY; INTERNET; ONLINE SYSTEMS; OPTIMIZATION; REINFORCEMENT; REINFORCEMENT LEARNING; SET THEORY; STATISTICAL MECHANICS; SYSTEMS ENGINEERING; TOPOLOGY;

DYNAMIC PROGRAMMING;

EID: 67650458719     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ADPRL.2009.4927545     Document Type: Conference Paper

References (21)

1. R. E. Bellman, Dynamic Programming. Princeton, NJ: Princeton University Press, 1957.
2. L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze, and E. F. Mishchenko, The mathematical theory of optimal processes. John Wiley and Sons, 1962, translated from Russian.
3. R. L. Stratonovich, "Conditional Markov processes," Theory of Probability and its Applications (USSR), Vol. 5, no. 2, pp. 156-178, 1960.
4. L. P. Kaelbling, M. L. Littman, and A. W. Moore, "Reinforcement learning: A survey," Journal of Artificial Intelligence Research, Vol. 4, pp. 237-285, 1996. (Pubitemid 126646155)
5. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, ser. Adaptive Computation and Machine Learning. Cambridge, MA: MIT Press, 1998.
6. R. L. Stratonovich, "On value of information," Izvestiya of USSR Academy of Sciences, Technical Cybernetics, Vol. 5, pp. 3-12, 1965, in Russian.
7. R. V. Belavkin, "The duality of utility and information in optimally learning systems," in 7th IEEE International Conference on 'Cybernetic Intelligent Systems'. London: IEEE, 2008.
8. N. N. Chentsov, Statistical Decision Rules and Optimal Inference. Moscow, U.S.SR.: Nauka, 1972, in Russian, English translation: Providence, RI: AMS, 1982.
9. S.-I. Amari, Differential-Geometrical Methods of Statistics, ser. Lecture Notes in Statistics. Berlin, Germany: Springer, 1985, Vol. 25.
10. G. Pistone and C. Sempi, "An infinite-dimensional geometric structure on the space of all the probability measures equivalent to a given one," The Annals of Statistics, Vol. 23, no. 5, pp. 1543-1561, October 1995. (Pubitemid 126033100)
11. A. Wald, Statistical Decision Functions. New York: John Wiley & Sons, 1950.
12. J. Von Neumann and O. Morgenstern, Theory of games and economic behavior, 1st ed. Princeton, NJ: Princeton University Press, 1944.
13. R. T. Rockafellar, Conjugate Duality and Optimization, ser. CBMSNSF Regional Conference Series in Applied Mathematics. PA: Society for Industrial and Applied Mathematics, 1974, Vol. 16.
14. R. E. Showalter, Monotone operators in Banach space and nonlinear partial differential equations, ser. Mathematical Surveys and Monographs. American Mathematical Society, 1997, Vol. 49.
15. C. E. Shannon, "A mathematical theory of communication," Bell System Technical Journal, Vol. 27, pp. 379-423 and 623-656, July and October 1948.
16. S. Kullback, Information Theory and Statistics. John Wiley and Sons, 1959.
17. R. I. Kachurovskii, "Nonlinear monotone operators in Banach spaces," Russian Mathematical Surveys, Vol. 23, no. 2, pp. 117-165, 1968.
18. E. T. Jaynes, "Information theory and statistical mechanics," Physical Review, Vol. 106-108, pp. 620-630 and 171-190,1957.
19. R. V. Belavkin and F. E. Ritter, "The use of entropy for analysis and control of cognitive models," in Proceedings of the Fifth International Conference on Cognitive Modeling, F. Detje, D. Dörner, and H. Schaub, Eds. Bamberg, Germany: Universitäts-Verlag Bamberg, April 2003, pp. 21-26.
20. R. V. Belavkin, "Acting irrationally to improve performance in stochastic worlds," in Proceedings of AI-2005, the 25th SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence, M. Bramer, F. Coenen, and T. Allen, Eds., Vol. XXII, BCS. Cambridge: Springer, 2005, pp. 305-316.
21. R. V. Belavkin and C. Huyck, "Emergence of rules in cell assemblies of fLIF neurons," in The 18th European Conference on Artificial Intelligence, 2008.