Sparse classifier fusion for speaker verification

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 8, 2013, Pages 1622-1631

  Hautamaki, Ville ^a   Kinnunen, Tomi ^a   Sedlak, Filip ^a   Lee, Kong Aik ^b   Ma, Bin ^b   Li, Haizhou ^b  

^a UNIVERSITY OF EASTERN FINLAND   (Finland)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

Author keywords

Classifier ensemble selection; experimentation; linear fusion; speaker verification

Indexed keywords

CLASSIFIER ENSEMBLES; EXPERIMENTATION; LINEAR FUSIONS; LOGISTIC REGRESSION MODELS; SPEAKER RECOGNITION EVALUATIONS; SPEAKER VERIFICATION; SPEAKER VERIFICATION SYSTEM; WEIGHTED LINEAR COMBINATIONS;

LOGISTICS; REGRESSION ANALYSIS;

SPEECH RECOGNITION;

EID: 84877743396     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2013.2256895     Document Type: Article

References (43)

1. T. Kinnunen and H. Li, "An overview of text-independent speaker recognition: From features to supervectors," Speech Commun., vol. 52, no. 1, pp. 12-40, Jan. 2010.
2. D. Reynolds, T. Quatieri, and R. Dunn, "Speaker verification using adapted Gaussian mixture models," DSP, vol. 10, no. 1, pp. 19-41, Jan. 2000. (Pubitemid 30592166)
3. W. Campbell, J. Campbell, D. Reynolds, E. Singer, and P. Torres-Carrasquillo, "Support vector machines for speaker and language recognition," Comput. Speech Lang., vol. 20, no. 2-3, pp. 210-229, Apr. 2006. (Pubitemid 41787537)
4. P. Kenny, P. Ouellet, N. Dehak, V. Gupta, and P. Dumouchel, "A study of inter-speaker variability in speaker verification," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 5, pp. 980-988, Jul. 2008.
5. A. Solomonoff,W. Campbell, and I. Boardman, "Advances in channel compensation for SVM speaker recognition," in Proc. ICASSP '05, Philadelphia, PA, USA, Mar. 2005, pp. 629-632.
6. C. P. Robert, The Bayesian Choice: From Decision-Theoretic Motivations to Computational Implementation, 2nd ed. New York, NY, USA: Springer-Verlag, 2001.
7. C. Bishop, Pattern Recognition and Machine Learning. NewYork, NY, USA: Springer Science+Business Media, LLC, 2006.
8. S. Pigeon, P. Druytsa, and P. Verlinde, "Applying logistic regression to the fusion of the NIST'99 1-speaker submissions," DSP, vol. 10, no. 1-3, pp. 237-248, Jan. 2000. (Pubitemid 30592153)
9. N. Brümmer, L. Burget, J. ernocký, O. Glembek, F. Grézl, M. Karafiát, D. Leeuwen, P. Matijka, P. Schwartz, and A. Strasheim, "Fusion of heterogeneous speaker recognition systems in the STBU submission for the NIST speaker recognition evaluation 2006," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 7, pp. 2072-2084, Sep. 2007.
10. L. Ferrer, K. Sönmez, and E. Shriberg, "An anticorrelation kernel for subsystem training in multiple classifier systems," J. Mach. Learn. Res., vol. 10, pp. 2079-2114, 2009.
11. N. Brümmer, Fusion and Toolkit [Software Package], Jun. 2011, [Online]. Available: http://sites.google.com/site/nikobrummer/focal
12. Bosaris Toolkit [Software Package], Jun. 2011 [Online]. Available: https://sites.google.com/site/bosaristoolkit/
13. R. Duda, P. Hart, and D. Stork, Pattern Classification, 2nd ed. New York, NY, USA: Wiley Interscience, 2000.
14. V. Hautamäki, K. Lee, A. Larcher, T. Kinnunen, B. Ma, and H. Li, "Variational bayes logistic regression as regularized fusion for NIST SRE 2010," in Speaker Odyssey '12, Singapore, Jun. 2012.
15. M. I. Jordan, "Why the logistic function? A tutorial discussion on probabilities and neural networks," Mass. Inst. of Technol., Cambridge, MA, USA, Aug. 1995, Tech. Rep.
16. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning-Data Mining, Inference, and Prediction, 2nd ed. New York, NY, USA: Springer, 2008.
17. G. Brown, A. Pocock,M. Zhao, andM. Luján, "Conditional likelihood maximization: A unifying framework for information theoretic feature selection," J. Mach. Learn. Res., vol. 13, pp. 27-66, 2012.
18. H. Li, B. Ma, K. A. Lee, H. Sun, D. Zhu, K. C. Sim, C. H. You, R. Tong, I. Kärkkäinen, C.-L. Huang, V. Pervouchine, W. Guo, Y. Li, L. Dai, M. Nosratighods, T. Tharmarajah, J. Epps, E. Ambikairajah, E.-S. Chng, T. Schultz, and Q. Jin, "The I4U system in NIST 2008 speaker recognition evaluation," in Proc. ICASSP '09, Taipei, Taiwan, Apr. 2009, pp. 4201-4204.
19. F. Sedlák, T.Kinnunen,K.A. L.Ville Hautamäki, andH. Li, "Classifier subset selection and fusion for speaker verification," in Proc. ICASSP '11, 2011, pp. 4544-4547.
20. E. Singer, P. Torres-Carrasquillo, D. Reynolds, A. McCree, F. Richardson, N. Dehak, and D. Sturim, "The MITLL NIST LRE 2011 language recognition system," in Proc. Speaker Odyssey '12, Singapore, Jun. 2012, pp. 209-215.
21. S. Geman, E. Bienenstock, and R. Doursat, "Neural networks and the bias/variance dilemma," Neural Comput., vol. 4, no. 1, pp. 1-58, Jan. 1992.
22. R. Tibshirani, "Regression shrinkage and selection via the lasso," J. R. Statist. Soc., Ser. B, vol. 58, no. 1, pp. 267-288, 1996.
23. A. Genkin, D. D. Lewis, and D. Madigan, "Large-scale Bayesian logistic regression for text categorization," Technometrics, vol. 49, no. 3, pp. 291-304, Aug. 2007. (Pubitemid 47292487)
24. H. Zou and T. Hastie, "Regularization and variable selection via the elastic net," J. R. Statist. Soc., Ser. B, vol. 67, pp. 301-320, 2005. (Pubitemid 40465877)
25. V. Hautamäki, K. Lee, T. Kinnunen, B. Ma, and H. Li, "Regularized logistic regression fusion for speaker verification," in Proc. Interspeech '11, Florence, Italy, Aug. , pp. 2745-2748.
26. W. Campbell, D. Sturim, W. Shen, D. Reynolds, and J. Navratil, "The MIT-LL/IBM 2006 speaker recognition system: High-performance reduced-complexity recognition," in Proc. ICASSP '07, 2007, vol. IV, pp. 217-220.
27. N. Brümmer and J. Preez, "Application-independent evaluation of speaker detection," Comput. Speech Lang., vol. 20, pp. 230-275, Apr.-Jul. 2006. (Pubitemid 41787538)
28. A. Jain, K. Nandakumar, and A. Ross, "Score normalization in multimodal biometric systems," Pattern Recogn., vol. 38, no. 3, pp. 2270-2285, 2005. (Pubitemid 41336698)
29. R. Auckenthaler, M. Carey, and H. Lloyd-Thomas, "Score normalization for text-independent speaker verification systems," DSP, vol. 10, no. 1-3, pp. 42-54, Jan. 2000. (Pubitemid 30592165)
30. Z-cal, 2006, [Online]. Available: http://ww.dsp.sun.ac.za/nbrummer/focal/ cllr/calibration/z-cal/index.htm
31. J. A. Nelder and R. Mead, "A simplex method for function minimization," Comput. J., vol. 7, pp. 308-313, 1965.
32. M. Schmidt, G. Fung, and R. Rosales, "Fast optimization methods for L1 regularization: A comparative study and two new approaches," in Proc. ECML '07, Warsaw, Poland, Sep. 2007.
33. A. Kabán, "On Bayesian classification with Laplacian priors," Pattern Recogn. Lett., vol. 28, pp. 1271-1282, 2007.
34. C.-L. Huang, H. Su, B. Ma, and H. Li, "Speaker characterization using long-term and temporal information," in Proc. Interspeech '10, Makuhari, Japan, Sep. 2010, pp. 370-373.
35. R. Saeidi, J. Pohjalainen, T. Kinnunen, and P. Alku, "Temporally weighted linear prediction features for tackling additive noise in speaker verification," IEEE Signal Process. Lett., vol. 17, no. 6, pp. 599-602, 2010.
36. D. Zhu, B. Ma, and H. Li, "Speaker verification with feature-space MAPLR parameters," IEEE Trans. Audio, Speech, Signal Process., vol. 19, no. 3, pp. 505-515, Mar. 2011.
37. C. H. You, K. A. Lee, and H. Li, "GMM-SVM kernel with a Bhattacharyya-based distance for speaker recognition," IEEE Trans. Audio, Speech, Signal Process., vol. 18, no. 6, pp. 1300-1312, Aug. 2010.
38. D. van Leeuwen, "A note on performance metrics for speaker recognition using multiple conditions in an evaluation," Research note, Jun. 2008 [Online]. Available: http://sites.google.com/site/sretools/cond- weight.pdf?attredirects=0
39. W. Campbell, D. Sturim, and D. Reynolds, "Support vector machines using GMM supervectors for speaker verification," IEEE Signal Process. Lett., vol. 13, no. 5, pp. 308-311, May 2006.
40. D. van Leeuwen, A. Martin, M. Przybocki, and J. Bouten, "NIST and NFI-TNO evaluations of automatic speaker recognition," Comput. Speech Lang., vol. 20, pp. 128-158, Apr.-Jul. 2006. (Pubitemid 41787534)
41. X. Huang, A. Acero, and H.-W. Hon, Spoken Language Processing: A Guide to Theory, Algorithm, and System Development. Upper Saddle River, NJ, USA: Prentice-Hall, 2001.
42. B. Krishnapuram, L. Carin, M. Figueiredo, and A. Hartemink, "Sparse multinomial logistic regression: Fast algorithms and generalization bounds," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 6, pp. 957-968, Jun. 2005. (Pubitemid 40889845)
43. G. Brown, "An information theoretic perspective on multiple classifier systems," in Proc. Multiple Classifier Syst. (MCS '09), 2009, pp. 344-353.