Centroid neural network with a divergence measure for GPDF data clustering

IEEE Transactions on Neural Networks

Volumn 19, Issue 6, 2008, Pages 948-957

  Park, Dong Chul ^a   Kwon, Oh Hyun ^a,b   Chung, Jio ^a,b  

^a Myong Ji University   (South Korea)

^b Infinity Telecom Co Ltd   (South Korea)

Author keywords

Clustering method; Gaussian distributions; Hidden Markov models (HMM); Neural networks; Speech recognition

Indexed keywords

CLUSTERING METHOD; CODE VECTORS; CODE-BOOK DESIGNS; CODEBOOK; COMPETITIVE NEURAL NETWORKS; CONTINUOUS DENSITY HIDDEN MARKOV MODELS; CONVENTIONAL CLUSTERING; DATA CLUSTERING; DISTANCE MEASURES; DIVERGENCE MEASURES; GAUSSIAN PROBABILITY DENSITY FUNCTIONS; HIDDEN MARKOV MODELS (HMM); K-MEANS ALGORITHMS; MEAN VALUES; PERFORMANCE COMPARISONS; RECOGNITION ACCURACIES; SELF-ORGANIZING MAPS; STATISTICAL CHARACTERISTICS; UNSUPERVISED NEURAL NETWORKS;

CLUSTERING ALGORITHMS; COMPUTATIONAL GRAMMARS; CONFORMAL MAPPING; GAUSSIAN DISTRIBUTION; HIDDEN MARKOV MODELS; OBJECT RECOGNITION; PROBABILITY DENSITY FUNCTION; SPEECH ANALYSIS; SPEECH RECOGNITION; VECTOR QUANTIZATION; VECTORS;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; CLUSTER ANALYSIS; FEMALE; HUMAN; MALE; PATTERN RECOGNITION; PHYSIOLOGY; PROBABILITY; RECOGNITION;

ALGORITHMS; CLUSTER ANALYSIS; FEMALE; HUMANS; MALE; MARKOV CHAINS; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; PATTERN RECOGNITION, PHYSIOLOGICAL; PATTERN RECOGNITION, VISUAL; RECOGNITION (PSYCHOLOGY);

EID: 49149129340     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2007.2000051     Document Type: Article

References (26)

1. K. Lee, "Context-independent phonetic hidden Markov models for speaker-independent continuous speech recognition," IEEE Trans. Signal Process., vol. 38, no. 4, pp. 599-609, Apr. 1990.
2. T. Watanabe, K. Shinoda, K. Takagi, and K. Iso, "High speed speech recognition using tree structured probability density function," in Proc. Int. Conf. Acoust. Speech Signal Process., 1995, vol. 1, pp. 556-559.
3. J. Campbell, Jr., "Speaker recognition: A tutorial," Proc. IEEE, vol. 85, no. 9, pp. 1437-1462, Sep. 1997.
4. J. Silva and S. Narayanan, "Average divergence distance as a statistical discrimination measure for hidden Markov models," IEEE Trans. Audio Speech Lang. Process., vol. 14, no. 3, pp. 890-906, May 2006.
5. J. Silva and S. Narayanan, "Upper bound Kullback-Leibler divergence for hidden Markov models with application as discrimination measure for speech recognition," in Proc. IEEE Int. Symp. Inf. Theory, Seattle, WA, 2006, pp. 2299-2303.
6. Y. Zhang, R. Togneri, and M. Alder, "Phoneme-based vector quantization in a discrete HMM speech recognizer," IEEE Trans. Speech Audio Process., vol. 5, no. 1, pp. 26-32, Jan. 1997.
7. S. Yoon, K. Jung, M. Park, and H. Kim, "Korean speech vector quantization using a continuous hidden Markov model," in Proc. IEEE Region 10 Annu. Conf. Speech Image Technol. Comput. Telecommun., 1997, vol. 1, pp. 249-252.
8. K. Shinoda and K. Iso, "Efficient reduction of Gaussian components using MDL criterion for HMM-based speech recognition," in Proc. Int. Conf. Acoust. Speech Signal Process., 2002, vol. 1, pp. 869-872.
9. L. Rigazio, B. Tsakam, and J. Junqua, "An optimal Bhattacharyya centroid algorithm for Gaussian clustering with applications in automatic speech recognition," in Proc. Int. Conf. Acoust. Speech Signal Process., 2000, vol. 3, pp. 1599-1602.
10. J. Kim, R. Haimi-Cohen, and F. Soonge, "Hidden Markov models with divergence based vector quantized variances," in Proc. Int. Conf. Acoust. Speech Signal Process., 1999, vol. 1, pp. 125-128.
11. N. Chatzichrisafis, V. Diakoloukas, V. Digalakis, and C. Harizakis, "Gaussian mixture clustering and language adaptation for the development of a new language speech recognition system," IEEE Trans. Audio Speech Lang. Process., vol. 15, no. 3, pp. 928-938, Mar. 2007.
12. L. Parsons, E. Haque, and H. Liu, "Subspace clustering for high dimensional data: A review," SIGKDD Explorations, Newsletter ACMSpecial Interest Group Knowl. Disc. Data Mining, vol. 6, no. 1, p. 90, 2004.
13. M. Ravishankar, R. Bisiani, and E. Thayer, "Sub-vector clustering to improve memory and speed performance of acoustic likelihood computation," in Proc. Eurospeech, 1997, vol. 1, pp. 151-154.
14. B. Mak, E. Bocchieri, and E. Barnard, "Stream derivation and clustering scheme for subspace distribution clustering hidden Markov model," in Proc. IEEE Workshop Autom. Speech Recognit. Understanding, 1997, pp. 339-346.
15. L. Kuncheva and D. Vetrov, "Evaluation of stability of k-Means cluster ensembles with respect to random initialization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 11, pp. 1198-1808, Nov. 2006.
16. J. Lu, X. Yuan, and T. Yahagi, "A method of face recognition based on fuzzy c-means clustering and associated sub-NNs," IEEE Trans. Neural Netw., vol. 18, no. 1, pp. 150-160, Jan. 2007.
17. J. Sitte, L. Zhang, and U. Rueckert, "Characterization of analog local cluster neural network hardware for control," IEEE Trans. Neural Netw., vol. 18, no. 4, pp. 1242-1253, Jul. 2007.
18. D. Park, "Centroid neural network for unsupervised competitive learning," IEEE Trans. Neural Netw., vol. 11, no. 2, pp. 520-528, Mar. 2000.
19. D. Park and Y. Woo, "Weighted centroid neural network for edge reserving image compression," IEEE Trans. Neural Netw., vol. 12, no. 5, pp. 1134-1146, Sep. 2001.
20. S. Young, "The state of the art in ASR," in Proc. IMA Workshop Math. Found. Speech Process. Recognit., Sep. 2000, pp. 61-72.
21. S. Young, D. Kershaw, J. Odell, D. Ollason, and P. Woodland, The HTK Book (Version 3.2). Cambridge, U.K.: Cambridge Univ. Press, 2002.
22. Y. Liu and P. Fung, "State-dependent phonetic tied mixtures with pronunciation modeling for spontaneous speech recognition," IEEE Trans. Speech Audio Process., vol. 12, no. 4, pp. 351-364, Jul. 2004.
23. L. Gu and K. Rose, "Sub-state tying with combined parameter training and reduction in tied-mixture HMM design," IEEE Trans. Speech Audio Process., vol. 10, no. 3, pp. 137-145, Mar. 2002.
24. L. Rabiner and B. Juang, Fundamentals of Speech Recognitions. Englewood Cliffs, NJ: Prentice-Hall, 1994.
25. V. Digalakis, P. Monaco, and H. Murveit, "Genones: Generalized mixture tying in continuos hidden Markov model-based speech recognition," IEEE Trans. Speech Audio Process., vol. 4, no. 4, pp. 281-289, Jul. 1996.
26. J. Ilonen, P. Paalanen, J. Kamarainen, and H. Kalviainen, "Gaussian mixture pdf in one-class classification: Computing and utilizing confidence values," in Proc. 18th Int. Conf. Pattern Recognit., Hong Kong, 2006, pp. 577-580.