Spectral and graph-theoretic bounds on steady-state-probability estimation performance for an ergodic Markov chain

Proceedings of the American Control Conference

Volumn , Issue , 2011, Pages 2399-2404

  Xue, Mengran ^a   Roy, Sandip ^a  

^a Washington State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSICAL ESTIMATORS; ERGODICS; ESTIMATION PERFORMANCE; GRAPH STRUCTURES; GRAPH-THEORETIC; MARKOV CHAIN; PERFORMANCE ANALYSIS; PERFORMANCE MEASURE; STATE TRANSITION MATRIX; STATE TRANSITIONS; STEADY STATE PROBABILITIES; SUBDOMINANT EIGENVALUE; UNDERLYING GRAPHS; UPPER BOUND;

EIGENVALUES AND EIGENFUNCTIONS; ESTIMATION; GRAPH THEORY;

MARKOV PROCESSES;

EID: 80053139315     PISSN: 07431619     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. J. L. Gauvain, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains," IEEE Transactions on Speech and Audio Processing 2, pp. 291-298, 1994.
2. S. T. Garren and R. L. Smith, "Estimating the second largest eigen-value of a Markov transition matrix," Bernoulli, vol. 6, no. 2, pp. 215-242, April 2000.
3. L. E. Baum and T. Petrie, "Statistical inference for probabilistic functions of finite state Markov chains," The Annals of Mathematical Statistics, Vol. 37, No. 6, pp. 1554-1563, Dec., 1966.
4. O. Cappé, E. Moulines, T. Rydén, Inference in Hidden Markov Models, Springer, New York, 2005.
5. A. Nasroallah, "Monte Carlo simulation of Markov chain steady-state distribution," Extracta Mathematicae, vol. 19 no. 2, pp. 279-288, 2004.
6. H. Damerdji, "Strong consistency of the variance estimator in steady-state simulation output analysis," Mathematics of Operations Research, vol. 19, no. 2, pp. 494-512, May 1994.
7. A. Doucet, A. Logothetis, V. Krishnamurthy, "Stochastic sampling algorithms for state estimation of jump Markov linear systems," IEEE Transactions on Automatic Control, Vol.45, No.2, 188-202, 2000.
8. A. Doucet and C. Andrieu, "Iterative algorithm for state estimation for jump Markov linear systems," IEEE Transaction on Signal Processing, vol. 49, no. 6, June 2001.
9. L. A. Liporace, "Maximum likelihood estimation for multivariate observations of Markov sources," IEEE Transactions on Information Theory, Vol. IT-28, pt. 1, pp. 729-734. Sept. 1982.
10. M. Rudemo, "State estimation for partially observed Markov chains," Mathematical Analysis and Applications, vol. 44, issue 3, pp. 581-611, December 1973.
11. T. W. Anderson and L. A. Goodman, "Statistical inference about Markov chains," The Annuals of Mathematical Statistics, vol. 28, no. 1, pp. 89-110, March 1957.
12. A. D. Sokal, "Monte Carlo methods in statistical mechanics: foundations and new algorithms," Cours de Troisieme Cycle de la Physique, Suisse Romande, 1989.
13. P. Doyle, "The Kemeny constant of a Markov chain," Arxiv preprint arXiv:0909.2636, September 2009.
14. M. Jerrum and A. Sinclair, "Conductance and the rapid mixing property for Markov chains: the approximation of permanent resolved," Proceedings of the Twentieth Annual ACM Symposium on Theory of Computing, pp. 235-244, Chicago, IL, 2-4 May 1988.
15. S. Boyd, P. Diaconis and L. Xiao, "Fastest mixing Markov chain on a graph," SIAM Review, vol. 46, no. 4, pp. 667-689, Dec., 2004.
16. C. D. Meyer, "Sensitivity of the stationary distribution of a Markov chain," SIAM Joournal on Matrix Analysis and Applications, vol. 15, issue 3, pp. 715-728, July 1994.
17. B. D. Theelen, J. P. M. Voeten, and Y. Pribadi, "Accuracy analysis of long-run average performance metrics," Proceeding of the 2nd workshop on Embedded Systems, pp. 261-269, Utrecht, STW, 2001.
18. W. Landowski, M. Xue, S. Roy, "Comparison of Schedule-Based and Flow-Based Paradigms for Air Traffic Management," submitted to the AIAA Aviation Technology, Integrations and Operations Conference, Virginia Beach, VA, 20-22 Sep 2011.
19. S. Mannor, D. Simester, P. Sun, J. N. Tsitsiklis, "Bias and variance approximations in value function estimates," Management Science, vol. 53, no. 2, pp. 308-322, 2007.
20. R. M. Neal, "Probabilistic Inference Using Markov chain Monte Carlo Methods," technical report, University of Toronto, 1993.
21. J. Besag, "Markov chain Monte Carlo for statistical inference," technical report, University of Washington, Centre for Statistical and the Social Sciences, working paper no. 9, 2000.
22. M. Xue, E. Yeung, A. Rai, S. Roy, Y. Wan, S. Warnick, "Initial-condition estimation in network synchronization processes: algebraic and graphical characterizations of the estimator," submitted to the AIAA Guidance, Navigation and Control Conference, Portland, OR, 8-11 Aug 2011.
23. Y. Wan, S. Roy, "On inference of network time constants from impulse response data: graph-theoretic Cramer-Rao bounds," in Proceedings of the 2009 IEEE Conference on Decision and Control, Shanghai, China, pp. 4111-4116, Dec. 2009.
24. G. L. Jones, "On the Markov chain central limit theorem," Probability Surveys, vol. 1, pp. 299-320, 2004.
25. R. G. Gallager, Discrete Stochastic Processes, Kluwer Academic Publishers: Boston, 1996.
26. H. Minc, "On the maximal eigenvector of a positive matrix," SIAM Journal on Numerical Analysis, vol. 7, no. 3, pp. 366-379, Oct. 2007.
27. S. Cioaba and D. A. Gregory, "Principal eigenvectors of irregular graphs," Electronic Journal of Linear Algebra, vol. 16, pp. 366-379, Oct. 2007.
28. C. Zenger, "A comparison of some bounds for the nontrivial eigenvalues of stochastic matrices," Numerische Mathematik, vol. 19, no. 3, June 1972.
29. D. J. Hartfiel and Carl D. Meyer, "On the structure of stochastic matrices with a subdominant eigenvalue near 1," Linear Algebra and its Applications, vol. 272, issues 1-3, pp. 193-203, March 1998.
30. M. Fiedler, "A Property of Eigenvectors of Non-negative Symmetric Matrices and its Application to Graph Theory", Czech. Math. J., vol. 85, pp. 619-633, 1975.
31. M. Xue and S. Roy, "Spectral and Graph-Theoretic Bounds on Steady- State-Probability Estimation Performance for an Ergodic Markov Chain," submitted to Journal of the Franklin Institute, available at http://www.eecs.wsu.edu/∼mxue/j2.pdf.