An information-theoretic framework to aggregate a markov chain

Proceedings of the American Control Conference

Volumn , Issue , 2009, Pages 731-736

  Deng, Kun ^a   Sun, Yu ^a   Mehta, Prashant G ^a   Meyn, Sean P ^a  

^a United States of America   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EIGENVALUE PROBLEM; KULLBACK-LEIBLER; MARKOV CHAIN; MARKOV MODEL; MODEL REDUCTION; OPTIMIZATION PROBLEMS; PARTITION PROBLEM; RECURSIVE ALGORITHMS; REDUCED ORDER; REDUCED ORDER MODELS;

EIGENVALUES AND EIGENFUNCTIONS; INFORMATION THEORY;

MARKOV PROCESSES;

EID: 70449623573     PISSN: 07431619     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACC.2009.5160607     Document Type: Conference Paper

References (16)

1. O. Junge and M. Dellnitz, "Almost invariant sets in Chua's circuit," Int. J. Bif. and Chaos, vol. 7, pp. 2475-85, 1997.
2. C. Schütte, A. Fischer, W. Huisinga, and P. Deuflhard, "A direct approach to conformational dynamics based on hybrid Monte Carlo," J. Comput. Phys., Special Issue on Computational Biophysics, vol. 151, pp. 146-168, 1999.
3. P. G. Mehta, M. Dorobantu, and A. Banaszuk, "Graph-based multiscale analysis of building system transport models," in Procs. of American Controls Conference, Minneapolis, 2006, pp. 1110-1115.
4. W. Huisinga, S. P. Meyn, and C. Schütte, "Phase transitions and metastability in Markovian and molecular systems," Ann. Appl. Probab., vol. 14, no. 1, pp. 419-458, 2004.
5. S. P. Meyn, G. Hagen, G. Mathew, and A. Banasuk, "On complex spectra and metastability of Markov models," in Proc. of the IEEE Conf. on Decision & Control, December 2008.
6. I. Kontoyiannis and S. P. Meyn, "Spectral theory and limit theorems for geometrically ergodic Markov processes," Ann. Appl. Probab., vol. 13, pp. 304-362, 2003, presented at the INFORMS Applied Probability Conference, NYC, July, 2001.
7. A. Bovier, M. Eckhoff, V. Gayrard, and M. Klein, "Metastability in stochastic dynamics of disordered mean-field models," Probab. Theory Related Fields, vol. 119, no. 1, pp. 99-161, 2001.
8. H. A. Simon and A. Ando, "Aggregation of variables in dynamical systems," Econometrica, vol. 28, pp. 111-138, 1961.
9. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, 2000.
10. R. G. Phillips and P. V. Kokotovic, "A singular perturbation approach to modeling and control of Markov chains," IEEE Trans. Automat. Contr., vol. 26, no. 5, pp. 1087-1094, 1981.
11. Z. Rached, F. Alalaji, and L. L. Campbell, "The Kullback-Leibler divergence rate between Markov sources," IEEE Trans. Info. Thy., vol. 50, no. 5, pp. 917-921, 2004.
12. S. P. Meyn and R. L. Tweedie, Markov Chains and Stochastic Stability, 2nd ed. London: Springer-Verlag, 1993, online: http://black.csl.uiuc.edu/̃meyn/pages/book.html.
13. T. M. Cover and J. A. Thomas, Elements of Information Theory, 1st ed. New York, NY: John Wiley & Sons, Inc., 1991.
14. W. Huisinga, "Metastability of markovian systems: A transfer operator approach in application to molecular dynamics," Ph.D. dissertation, Free University Berlin, 2001.
15. M. Meila and L. Xu, "Multiway cuts and spectral clustering," May 2003, Technical Report 442.
16. J. Niedbalski, K. Deng, P. G. Mehta, and S. Meyn, "Model reduction for reduced order estimation in traffic models," in Proceeding of American Control Conference, 2008, pp. 914-919.