A model-selection-based self-splitting Gaussian mixture learning with application to speaker identification

Eurasip Journal on Applied Signal Processing

Volumn 2004, Issue 17, 2004, Pages 2626-2639

  Cheng, Shih Sian ^a,b   Wang, Hsin Min ^a   Fu, Hsin Chia ^b  

^a INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

^b NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

Author keywords

Bayesian information criterion; Gaussian mixture modelling; Speaker identification; Unsupervised learning

Indexed keywords

ALGORITHMS; DATA REDUCTION; LEARNING SYSTEMS; MATHEMATICAL MODELS; PARAMETER ESTIMATION; PATTERN RECOGNITION; SGML; STATISTICAL METHODS;

BAYESIAN INFORMATION CRITERION; GAUSSIAN MIXTURE MODELING; SPEAKER IDENTIFICATION; UNSUPERVISED LEARNING;

GAUSSIAN NOISE (ELECTRONIC);

EID: 14944352376     PISSN: 11108657     EISSN: None     Source Type: Journal    
DOI: 10.1155/S1110865704407100     Document Type: Article

References (30)

1. J.-M. Jolion, P. Meer, and S. Bataouche, "Robust clustering with applications in computer vision," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 13, no. 8, pp. 791-802, 1991.
2. J. Hertz, A. Krogh, and R. G. Palmer, Introduction to the Theory of Neural Computation, Addison-Wesley, New York, NY, USA, 1991.
3. E. Forgy, "Cluster analysis of multivariate data: Efficiency vs. interpretability of classifications," Biometrics, vol. 21, no. 3, pp. 768, 1965.
4. S. P. Lloyd, "Least squares quantization in PCM," IEEE Transactions on Information Theory, vol. 28, no. 2, pp. 129-137, 1982.
5. Y. Linde, A. Buzo, and R. M. Gray, "An algorithm for vector quantizer design," IEEE Trans. Communications, vol. 28, no. 1, pp. 84-95, 1980.
6. J. MacQueen, "Some methods for classification and analysis of multivariate observations," in Proc. 5th Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281-297, University of California Press, Berkeley, Calif, USA, 1967.
7. A. K. Jain, M. N. Murty, and P. J. Flynn, "Data clustering: a review," ACM Computing Surveys, vol. 31, no. 3, pp. 264-323, 1999.
8. G. McLachlan and D. Peel, Finite Mixture Models, John Wiley & Sons, New York, NY, USA, 2000.
9. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," Journal of the Royal Statistical Society: Series B, vol. 39, no. 1, pp. 1-38, 1977.
10. X. Huang, A. Acero, and H.-W. Hon, Spoken Language Processing: A Guide to Theory, Algorithm, and System Development, Prentice-Hall, Upper Saddle River, NJ, USA, 2001.
11. R. A. Redner and H. F. Walker, "Mixture densities, maximum likelihood and the EM algorithm," SIAM Review, vol. 26, no. 2, pp. 195-239, 1984.
12. N. Ueda, R. Nakano, Z. Ghahramani, and G. Hinton, "SMEM algorithm for mixture models," Neural Computation, vol. 12, no. 9, pp. 2109-2128, 2000.
13. D. Ormoneit and V. Tresp, "Improved Gaussian mixture density estimates using Bayesian penalty terms and network averaging," in Advances in Neural Information Processing Systems, D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, Eds., vol. 8, pp. 542-548, MIT Press, Cambridge, Mass, USA, 1996.
14. K. P. Burnham and D. R. Anderson, Model Selection and Inference: A Practical Information-Theoretic Approach, SpringerVerlag, New York, NY, USA, 1998.
15. G. Schwarz, "Estimation the dimension of a model," Annals of Statistics, vol. 6, no. 2, pp. 461-464, 1978.
16. A. E. Raftery, "Bayesian model selection in social research," Sociological Methodology, vol. 25, pp. 111-196, 1995.
17. C. Fraley and A. E. Raftery, "How many clusters? which clustering method? Answers via model-based cluster analysis," Computer Journal, vol. 41, no. 8, pp. 578-588, 1998.
18. J. Rissanen, "Modeling by shortest data description," Automatica, vol. 14, no. 5, pp. 465-471, 1978.
19. J. J. Oliver, R. A. Baxter, and C. S. Wallace, "Unsupervised learning using MML," in Proc. 13th International Conference on Machine Learning (ICML '96), pp. 364-372, San Francisco, Calif, USA, 1996.
20. B. D. Ripley, Pattern Recognition and Neural Networks, Cambridge University Press, Cambridge, UK, 1996.
21. R. E. Kass and A. E. Raftery, "Bayes factors," Journal of the American Statistical Association, vol. 90, no. 430, pp. 773-795, 1995.
22. D. A. Reynolds and R. C. Rose, "Robust text-independent speaker identification using Gaussian mixture speaker models," IEEE Trans. Speech, and Audio Processing, vol. 3, no. 1, pp. 72-83, 1995.
23. L. Wang, K. Chen, and H. S. Chi, "Capture interspeaker information with a neural network for speaker identification," IEEE Transactions on Neural Networks, vol. 13, no. 2, pp. 436-445, 2002.
24. S. J. Young and P. C. Woodland, "State clustering in hidden Markov model-based continuous speech recognition," Computer Speech & Language, vol. 8, no. 4, pp. 369-384, 1994.
25. S.-C. Chu and J. F. Roddick, "Pattern clustering using incremental splitting for non-uniformly distributed data," in Proc. 5th International Conference on Knowledge-Based Intelligent Information Engineering Systems and Allied Technologies, N. Baba, L. C. Jain, and R. J. Hewlett, Eds., vol. 69 of Frontiers in Artificial Intelligence and Applications, pp. 1037-1041, IOS Press, Osaka, Japan, 2001.
26. D. A. Reynolds, "Speaker identification and verification using Gaussian mixture speaker models," Speech Communication, vol. 17, no. 1, pp. 91-108, 1995.
27. D. A. Reynolds, T. F. Quatieri, and R. B. Dunn, "Speaker verification using adapted Gaussian mixture models," Digital Signal Processing, vol. 10, no. 1-3, pp. 19-41, 2000.
28. H.-C. Fu, H.-Y. Chang, Y. Y. Xu, and H.-T. Pao, "User adaptive handwriting recognition by self-growing probabilistic decision-based neural networks," IEEE Transactions on Neural Networks, vol. 11, no. 6, pp. 1373-1384, 2000.
29. S.-H. Lin, S.-Y. Kung, and L.-J. Lin, "Face recognition/detection by probabilistic decision-based neural network," IEEE Transactions on Neural Networks, vol. 8, no. 1, pp. 114-132, 1997, Special issue on artificial neural network and pattern recognition.
30. B. Efron and R. J. Tibshirani, An Introduction to the Bootstrap, Chapman & Hall, New York, NY, USA, 1993.