Almost sure convergence of Titterington's recursive estimator for mixture models

Statistics and Probability Letters

Volumn 76, Issue 18, 2006, Pages 2001-2006

  Wang, Shaojun ^a   Zhao, Yunxin ^b  

^a UNIVERSITY OF ALBERTA   (Canada)

^b University of Missouri   (United States)

Author keywords

Almost sure convergence; Incomplete data; Mixture model; Recursive estimation; Regular exponential family; Stochastic approximation

Indexed keywords

EID: 33749682432     PISSN: 01677152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.spl.2006.05.017     Document Type: Article

References (18)

1. Benveniste A., Metivier M., and Priouret P. Adaptive Algorithms and Stochastic Approximations (1990), Springer, Berlin
2. Brown L. Fundamentals of Statistical Exponential Families (1987), Institute of Mathematical Statistics
3. Cover T., and Thomas J. Elements of Information Theory (1991), Wiley, New York
4. Delyon B. General results on the convergence of stochastic algorithms. IEEE Trans. Automat. Control 41 9 (1996) 1245-1255
5. Dempster A., Laird N., and Rubin D. Maximum likelihood estimation from incomplete data via the EM algorithm. J. R. Statist. Soc. Ser. B 39 (1977) 1-38
6. Durrett R. Probability: Theory and Examples (1996), Wadsworth Publishing Company, Belmont, CA
7. Fabian V. On asymptotically efficient recursive estimation. Ann. Statist. 6 4 (1978) 854-866
8. Fu K. Sequential Methods in Pattern Recognition and Machine Learning (1968), Academic Press, New York
9. Huo Q., and Lee C. Online adaptive learning of the continuous density hidden Markov model based on approximate recursive Bayes estimate. IEEE Trans. Speech Audio Process. 5 2 (1997) 161-172
10. Kushner H., and Clark D.D. Stochastic Approximation Methods for Constrained and Unconstrained Systems (1978), Springer, Berlin
11. Lazarev, V., 1992. Convergence of stochastic approximation procedures in the case of a regression equation with several roots. Probl. Inform. Transmission 66-78.
12. McLachlan G., and Krishnan T. The EM Algorithm and Extensions (1997), Wiley, New York
13. Nevelson B., and Khasminskii R. Stochastic Approximation and Recursive Estimation (1976), American Mathematical Society, Providence, RI
14. Robbins H., and Monro S. A stochastic approximation method. Ann. Math. Statist. 22 (1951) 400-407
15. Smith A., and Makov U. A quasi-Bayes sequential procedure for mixtures. J. R. Statist. Soc. Ser. B 40 1 (1978) 106-112
16. Titterington D. Recursive parameter estimation using incomplete data. J. R. Statist. Soc. B 46 (1984) 257-267
17. Wang S., and Zhao Y. Online Bayesian tree-structured transformation of HMMs with optimal model selection for speaker adaptation. IEEE Trans. Speech Audio Process. 9 3 (2001) 663-677
18. Weinstein E., Feder M., and Oppenheim A. Sequential algorithms for parameter estimation based on the Kullback-Leibler information measure. IEEE Trans. Acoustics Speech Signal Process. 38 9 (1990) 1652-1654