Comparison of clustering methods: A case study of text-independent speaker modeling

Pattern Recognition Letters

Volumn 32, Issue 13, 2011, Pages 1604-1617

  Kinnunen, Tomi ^a   Sidoroff, Ilja ^a   Tuononen, Marko ^a   Fränti, Pasi ^a  

^a UNIVERSITY OF EASTERN FINLAND   (Finland)

Author keywords

Clustering methods; Gaussian mixture model; Speaker recognition; Universal background model; Vector quantization

Indexed keywords

CLUSTERING METHODS; CLUSTERING QUALITY; CLUSTERING VALIDITY; CRITICAL TASKS; EXPECTATION MAXIMIZATION; EXPERIMENTAL COMPARISON; FUZZY C MEAN; GAUSSIAN MIXTURE MODEL; K-MEANS; LOW ORDER MODELS; NEAREST NEIGHBORS; NON-PARAMETRIC; PERSON AUTHENTICATION; PROCESSING TIME; RECOGNITION ACCURACY; SELF ORGANIZING; SPEAKER MODELING; SPEAKER RECOGNITION; SPLIT-AND-MERGE; TEXT-INDEPENDENT SPEAKER VERIFICATION; UNIVERSAL BACKGROUND MODEL;

BIOMETRICS; CHARACTER RECOGNITION; CLUSTER ANALYSIS; COMPUTATIONAL COMPLEXITY; CONFORMAL MAPPING; DATA COMPRESSION; GENETIC ALGORITHMS; IMAGE CODING; IMAGE SEGMENTATION; INFORMATION RETRIEVAL; SPEECH CODING; SPEECH RECOGNITION; VECTOR QUANTIZATION;

CLUSTERING ALGORITHMS;

EID: 79960442111     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2011.06.023     Document Type: Article

References (81)

1. R. Auckenthaler, M. Carey, and H. Lloyd-Thomas Score normalization for text-independent speaker verification systems Digital Signal Process. 10 2000 42 54 (Pubitemid 30592165)
2. U. Bagci, and E. Erzin Automatic classification of musical genres using inter-gender similarity IEEE Signal Process Lett. 14 8 2007 521 524 (Pubitemid 47250021)
3. J. Bezdek, and N. Pal Some new indices of cluster validity IEEE Trans. Systems Man Cybernet. Part B 28 3 1998 301 315 (Pubitemid 128752585)
4. F. Bimbot, J.-F. Bonastre, C. Fredouille, G. Gravier, I. Magrin-Chagnolleau, S. Meignier, T. Merlin, J. Ortega-Garcia, D. Petrovska-Delacretaz, and D.A. Reynolds A tutorial on text-independent speaker verification EURASIP J. Appl. Signal Process. 4 2004 430 451
5. C.M. Bishop Pattern Recognition and Machine Learning 2006 Springer
6. Brew, A., Cunningham, P., 2010. Vector quantization mappings for speaker verification. In: Proc. 20th Internat. Conf. on Pattern Recognition (ICPR 2010), pp. 560-564.
7. L. Burget, P. Matejka, P. Schwarz, O. Glembek, and J.H. Cernocky Analysis of feature extraction and channel compensation in a GMM speaker recognition system IEEE Trans. Audio Speech Lang. Process. 15 7 2007 1979 1986
8. D. Burton Text-dependent speaker verification using vector quantization source coding IEEE Trans. Acoust. Speech Signal Process. 35 2 1987 133 143 (Pubitemid 17549544)
9. J. Campbell Speaker recognition: A tutorial Proc. IEEE 85 9 1997 1437 1462 (Pubitemid 127745630)
10. W.M. Campbell, J.P. Campbell, D.A. Reynolds, E. Singer, and P.A. Torres-Carrasquillo Support vector machines for speaker and language recognition Comput. Speech Lang. 20 2-3 2006 210 229 (Pubitemid 41787537)
11. W.M. Campbell, D.E. Sturim, and D.A. Reynolds Support vector machines using GMM supervectors for speaker verification IEEE Signal Process. Lett. 13 5 2006 308 311
12. D.L. Davies, and D.W. Bouldin A cluster separation measure IEEE Trans. Pattern Anal. Machine Intell. 1 2 1979 224 227
13. N. Dehak, P. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet Front-end factor analysis for speaker verification IEEE Trans. Audio Speech Lang. Process. 19 4 2011 788 798
14. R.O. Duda, and P.E. Hart Pattern Classification and Scene Analysis 1973 John Wiley and Sons New York
15. J.C. Dunn A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters J. Cybernet. 3 3 1974 32 57
16. W.H. Equitz A new vector quantization clustering algorithm IEEE Trans. Acoust. Speech Signal Process. 37 10 1989 1568 1575
17. K.R. Farrell, R.J. Mammone, and K.T. Assaleh Speaker recognition using neural networks and conventional classifiers IEEE Trans. Speech Audio Process. 2 1 1994 194 205
18. P. Fränti, J. Kivijärvi, T. Kaukoranta, and O. Nevalainen Genetic algorithms for large scale clustering problem Comput. J. 40 9 1997 547 554
19. P. Fränti, T. Kaukoranta, and O. Nevalainen On the splitting method for vector quantization codebook generation Opt. Eng. 36 11 1997 3043 3051 (Pubitemid 127629715)
20. Fränti, P., 1999. On the usefulness of self-organizing maps for the clustering problem in vector quantization. In: Proc. 11th Scandinavian Conf. on Image Analysis (SCIA99), Kangerlussuaq, Greenland, pp. 415-422.
21. P. Fränti Genetic algorithm with deterministic crossover for vector quantization Pattern Recognition Lett. 21 1 2000 61 68 (Pubitemid 30534049)
22. P. Fränti, and J. Kivijärvi Randomized local search algorithm for the clustering problem Pattern Anal. Appl. 3 4 2000 358 369 (Pubitemid 33213769)
23. P. Fränti, T. Kaukoranta, D.-F. Shen, and K.-S. Chang Fast and memory efficient implementation of the exact PNN IEEE Trans. Image Process. 9 5 2000 773 777
24. P. Fränti, and O. Virmajoki Iterative shrinking method for clustering problems Pattern Recognition 39 5 2006 761 765
25. Fränti, P., Virmajoki, O., Hautamäki, V., 2008. Probabilistic clustering by random swap algorithm. In: IAPR Internat. Conf. on Pattern Recognition (ICPR'08), Tampa, Florida, USA.
26. M.R. Garey, D.S. Johnson, and H.S. Witsenhausen The complexity of the generalized Lloyd-Max problem IEEE Trans. Inform. Theory 28 2 1982 255 256
27. A.B. Geva, Y. Steinber, S. Bruckmair, and G. Nahum A comparison of cluster validity criteria for a mixture of normal distributed data Pattern Recognition Lett. 21 2000 511 529
28. J. He, L. Liu, and G. Palm A discriminative training algorithm for VQ-based speaker identification IEEE Trans. Speech Audio Process. 7 3 1999 353 356
29. C. Hanilci, and F. Ertas Comparison of the impact of some Minkowski metrics on VQ/GMM based speaker recognition Comput. Electr. Eng. 37 2011 41 56
30. Hasan, T., Hansen, J.H.L., 2011. A study on universal background model training in speaker verification. IEEE Trans. Speech, Audio Language Process. in press.
31. Hautamäki, V., Tuononen, M., Niemi-Laitinen, T., Fränti, P., 2007. Improving speaker verification by periodicity based voice activity detection. In: Proc. 12th Internat. Conf. on Speech and Computer (SPECOM 2007), vol. 2, Moscow, pp. 645-650.
32. V. Hautamäki, T. Kinnunen, I. Kärkkäinen, M. Tuononen, J. Saastamoinen, and P. Fränti Maximum a posteriori estimation of centroid model parameters for speaker verification IEEE Signal Process. Lett. 15 2008 162 165
33. H. Hermansky, and N. Morgan RASTA processing of speech IEEE Trans. Speech Audio Process. 2 4 1994 578 589
34. X. Huang, A. Acero, and H.-W. Hon Spoken Language Processing: A Guide to Theory, Algorithm, and System Development 2001 Prentice-Hall New Jersey
35. P.K. Ito Robustness of ANOVA and MANOVA test procedures P.R. Krishnaiah, Handbook of Statistics 1: Analysis of Variance 1980 North-Holland Publishing Company pp. 199-236
36. A.K. Jain, M.N. Murty, and P.J. Flynn Data clustering: A review ACM Comput. Surv. 31 3 1999 264 323
37. A.K. Jain Data clustering: 50 years beyond K-means Pattern Recognition Lett. 31 8 2010 651 666
38. Y.-T. Juang, K.-C. Huang, and I.-J. Ding Speaker adaptation based on MAP estimation using fuzzy controller Pattern Recognition Lett. 24 2003 2807 2813 (Pubitemid 37027800)
39. T. Kaukoranta, P. Fränti, and O. Nevalainen Iterative split-and-merge algorithm for VQ codebook generation Opt. Eng. 37 10 1998 2726 2732 (Pubitemid 128495293)
40. T. Kaukoranta, P. Fränti, and O. Nevalainen A fast exact GLA based on code vector activity detection IEEE Trans. Image Process. 9 8 2000 1337 1342
41. P. Kenny, P. Ouellet, N. Dehak, V. Gupta, and P. Dumouchel A study of inter-speaker variability in speaker verification IEEE Trans. Audio Speech Lang. Process. 16 5 2008 980 988
42. T. Kinnunen, and H. Li An overview of text-independent speaker recognition: From features to supervectors Speech Commun. 52 1 2010 12 40
43. Kinnunen, T., Kilpeläinen, Fränti, P., 2000. Comparison of clustering algorithms in speaker identification. In: Proc. 28 Internat. Conf. Signal Processing and Communications (SPC 2000), Marbella, Spain, pp. 222-227.
44. Kinnunen, T., Kärkkäinen, I., Fränti, P., 2001. Is speech data clustered? - Statistical analysis of cepstral features. In: Proc. 7th European Conf. on Speech Communication and Technology, (Eurospeech 2001), vol. 4, Aalborg, Denmark, pp. 2627-2630.
45. T. Kinnunen, E. Karpov, and P. Fränti Real-time speaker identification and verification IEEE Trans. Audio Speech Lang. Process. 14 1 2006 277 288 (Pubitemid 43863473)
46. T. Kinnunen, J. Saastamoinen, V. Hautamäki, M. Vinni, and P. Fränti Comparative evaluation of maximum a posteriori vector quantization and Gaussian mixture models in speaker verification Pattern Recognition Lett. 30 4 2009 341 347
47. Kolano, G., Regel-Brietzmann, P., 1999. Combination of vector quantization and Gaussian mixture models for speaker verification. In: Proc. 6th European Conf. on Speech Communication and Technology (Eurospeech 1999), Budapest, Hungary, pp. 1203-1206.
48. Kärkkäinen, I., Fränti, P., 2002. Stepwise algorithm for finding unknown number of clusters. In: Proc. Advanced Concepts for Intelligent Vision Systems (ACIVS'2002), Gent, Belgium, pp. 136-143.
49. Lee, K.A., You, C., Li, H., Kinnunen, T., Zhu, D., 2008. Characterizing speech utterances for speaker verification with sequence kernel SVM. In: Proc. Interspeech 2008, Brisbane, Australia, pp. 1397-1400.
50. Lei, Z., Yang, Y., Wu, Z., 2005. Mixture of support vector machines for text-independent speaker recognition. In: Proc. 9th European Conf. on Speech Communication and Technology (Interspeech'2005), pp. 2041-2044. (Pubitemid 43908492)
51. D.A.v. Leeuwen, A.F. Martin, M.A. Przybocki, and J.S. Bouten NIST and NFI-TNO evaluations of automatic speaker recognition Comput. Speech Lang. 20 2006 128 158 (Pubitemid 41787534)
52. Y. Linde, A. Buzo, and R.M. Gray An algorithm for vector quantizer design IEEE Trans. Commun. 28 1 1980 84 95
53. Linguistic Data Consortium. .
54. Louradour, J., Daoudi, K., 2005. SVM speaker verification using a new sequence kernel. In: Proc. 13th European Conf. on Signal Processing (EUSIPCO'2005), Antalya, Turkey.
55. Martin, A., Doddington, G., Kamm, T., Ordowski, M., Przybocki, M., 1997. The DET curve in assessment of detection task performance. In: Proc. 5th European Conf. on Speech Communication and Technology, (Eurospeech 1997), Rhodes, Greece, pp. 1895-1898.
56. A. Martin, and M. Przybocki The NIST 1999 speaker recognition evaluation - An overview Digital Signal Process. 10 2000 1 18 (Pubitemid 30592167)
57. G. McLachlan, and D. Peel Finite Mixture Models 2001 John Wiley & Sons Brisbane
58. McQueen, J.B., 1967. Some methods for classification and analysis of multivariate observations. In: 5th Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281-297.
59. M. Meil, and D. Heckerman An experimental comparison of model-based clustering methods Machine Learn. 42 2001 9 29 (Pubitemid 32872397)
60. G.W. Milligan A Monte Carlo study of thirty internal criterion measures for cluster analysis Psychometrika 46 2 1981 187 199
61. N.M. Nasrabadi, and Y. Feng Vector quantization of images based upon the Kohonen self-organization feature maps Neural Networks 1 1988 518
62. NIST 2006 Speaker Recognition Evaluation Webpage, 2006. .
63. Pelecanos, J., Myers, S., Sridharan, S., Chandran, V., 2000. Vector quantization based Gaussian modeling for speaker verification. In: Proc. 15th Internat. Conf. on Pattern Recognition (ICPR'2000), vol. 3, pp. 294-297.
64. R.P. Ramachandran, K.R. Farrell, R. Ramachandran, and R.J. Mammone Speaker recognition - General classifier approaches and data fusion methods Pattern Recognition 35 12 2002 2801 2821
65. D.A. Reynolds, and R.C. Rose Robust text-independent speaker identification using Gaussian mixture speaker models IEEE Trans. Speech Audio Process. 3 1 1995 72 83
66. D.A. Reynolds, T.F. Quatieri, and R.B. Dunn Speaker verification using adapted Gaussian mixture models Digital Signal Process. 10 1 2000 19 41 (Pubitemid 30592166)
67. Reynolds, D.A., Campbell, W., Gleason, T., Quillen, C., Sturim, D., Torres-Carrasquillo, P., Adami, A., 2005. The 2004 MIT Lincoln Laboratory Speaker recognition system. In: Proc. Internat. Conf. Acoustics, Speech, and Signal Processing (ICASSP 2005), Vol. 1, 2005, pp. 177-180.
68. M. Roch Gaussian-selection-based non-optimal search for speaker identification Speech Commun. 48 2006 85 95 (Pubitemid 41751109)
69. J. Saastamoinen, E. Karpov, V. Hautamäki, and P. Fränti Accuracy of MFCC based speaker recognition in Series 60 device EURASIP J. Appl. Signal Process. 17 2005 2816 2827 (Pubitemid 44178263)
70. M. Sarkar, B. Yegnanarayana, and D. Khemani A clustering algorithm using an evolutionary programming-based approach Pattern Recognition Lett. 18 10 1997 975 986 (Pubitemid 127434126)
71. Singh, G., Panda, A., Bhattacharyya, S., Srikanthan, T., 2003. Vector quantization techniques for GMM based speaker verification, In: Proc. Internat. Conf. Acoustics, Speech, and Signal Processing (ICASSP'2003), Vol. 2, April 2003, pp. 65-68.
72. F.K. Soong, A.E. Rosenberg, B.-H. Juang, and L.R. Rabiner A vector quantization approach to speaker recognition AT&T Tech. J. 66 1987 14 26
73. Stapert, R.,Mason, J.S., 2001. Speaker recognition and the acoustic speech space. In: Proc. 2001: A Speaker Odyssey - The Speaker Recognition Workshop, pp. 195-199.
74. Steinbach, M., Karypis, G., Kumar, V., 2000. A comparison of document clustering techniques. In: Proc. KDD Workshop on Text Mining.
75. S. Theodoridis, and K. Koutroumbas Pattern Recognition 4th ed. 2009 Elsevier Inc.
76. Tran, D.T., 2000. Fuzzy Approaches to Speech and Speaker Recognition, Ph.D. Thesis, University of Canberra, Australia, May 2000, p. 154.
77. Tran, D., Le, T.V., Wagner, M., 1998. Fuzzy Gaussian mixture models for speaker recognition. In: Proc. Internat. Conf. Spoken Language Processing (ICSLP 1998), paper 0798, Sydney, Australia.
78. Tran, D., Wagner, M., 2002. Fuzzy C-Means Clustering-based speaker verification. In: Proc. Advances in Soft Computing (AFSS 2002), Calcutta, India, 2002, pp. 318-324.
79. Um, I.-T., Ra, J.-H., Kim, M.-H., 2000. Comparison of clustering methods for MLP-based speaker verification. In: Proc. 15th Internat. Conf. on Pattern Recognition (ICPR'2000), vol. 2, 2000, pp. 475-478.
80. D. Wu, J. Li, and H. Wu α-Gaussian mixture modelling for speaker recognition Pattern Recognition Lett. 30 2009 589 594
81. B. Yegnanarayana, and S.P. Kishore AANN: An alternative to GMM for pattern recognition Neural Networks 15 2002 459 469 (Pubitemid 34518411)