Kullback-Leibler divergence rate between probability distributions on sets of different cardinalities

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2010, Pages 948-953

  Vidyasagar, M ^a  

^a The University of Texas at Dallas   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MARKOV PROCESSES;

AGGREGATED MODELING; CARDINALITIES; FINITE SET; GREEDY ALGORITHMS; HIDDEN MARKOV PROCESS; KULLBACK LEIBLER DIVERGENCE; UPPER BOUND;

PROBABILITY DISTRIBUTIONS;

EID: 79953146095     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2010.5716982     Document Type: Conference Paper

References (14)

1. T. M. Cover and J. A. Thomas, Elements of Information Theory, (Second Edition), Wiley, New York, 2006.
2. I. Csiszár, "The method of types," IEEE Trans. Info. Thy., 44(6), 2505-2523, 1998.
3. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems, Academic Press, New York, 1981.
4. A. Dembo and O. Zeitouni, Large Deviation Techniques and Applications, Springer-Verlag, Berlin, 1998.
5. K. Deng, Y. Sun, P. G. Mehta, and S. P. Meyn, "An informationtheoretic framework to aggregate a Markov chain", Proceedings of American Control Conference, St. Louis, MO, pp. 731736, 2009.
6. K. Deng, P. G. Mehta and S. P. Meyn, "Optimal Kullback-Leibler aggregation via the spectral theory of Markov chains", Preprint, 2009.
7. F. Den Hollander, Large Deviations, Amer. Math. Soc., Providence, RI, 2000.
8. B-H. Juang and L. R. Rabiner, "A probabilistic distance measure for hidden Markov models," AT&T Tech. J., 64(2), 391-408, February 1985.
9. G. Kotsalis and M. Dahleh, "Model reduction of irreducible Markov chains", Proc. Conf. Decision and Control, 1631-1633, 2003.
10. Z. Rached, F. Alalaji and L. L. Campbell, "The Kullback-Leibler divergence rate between Markov sources," IEEE Trans. Info. Thy., 50(5), 917-921, May 2004.
11. I. N. Sanov, "On the probability of large deviations of random variables," (English translation), Selected Translations in Mathematical Statistics and Probability I, 213-244, 1961.
12. M. Vidyasagar, "Stochastic modelling over a finite alphabet: Approximation using the Kullback-Leibler divergence rate," Proc. European Control Conference, Kos, Greece, 2007.
13. M. Vidyasagar, "An elementary derivation of the large deviation rate function for finite state Markov chains," Proc. 48th IEEE Conference on Decision and Control, Shanghai, China, 1599-1606, 2009.
14. M. Vidyasagar, S. S. Mande, C. V. S. K. Reddy and V. Raja Rao, "The 4M (mixed memory Markov model) algorithm for finding genes in prokaryotic genomes," IEEE Transactions on Circuits and Systems, CAS-55(1), 26-37, January 2008 (Special Issue on Systems Biology). (Pubitemid 351314537)