Feature space mahalanobis sequence Kernels: Application to SVM speaker verification

IEEE Transactions on Audio, Speech and Language Processing

Volumn 15, Issue 8, 2007, Pages 2465-2475

  Louradour, Jércme ^a,b   Daoudi, Khalid ^a   Bach, Francis ^c  

^a UNIVERSITÉ PAUL SABATIER   (France)

^b UNIVERSITÉ DE MONTRÉAL   (Canada)

^c PSL RESEARCH UNIVERSITY   (France)

Author keywords

Sequence kernel; Speaker verification; Support vector machines (SVMs)

Indexed keywords

COMPARATIVE EXPERIMENTS; COVARIANCE KERNELS; FEATURE SPACES; GAUSSIAN KERNELS; GRAM MATRICES; LINEAR DISCRIMINANTS; LOW-RANK APPROXIMATIONS; MAHALANOBIS; MERCER KERNELS; MIXTURE MODELS; POLYNOMIAL DEGREES; POLYNOMIAL EXPANSIONS; SEQUENCE KERNEL; SPEAKER RECOGNITION; SPEAKER VERIFICATION; SUPPORT VECTOR MACHINES (SVMS); UNIVERSAL BACKGROUND MODELS;

IMAGE RETRIEVAL; SUPPORT VECTOR MACHINES;

SPEECH RECOGNITION;

EID: 62949108526     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2007.905147     Document Type: Article

References (54)

1. D. Reynolds, T. Quatieri, and R. Dunn, "Speaker verification using adapted Gaussian mixture models," Digital Signal Process., vol. 10, pp. 19-41, 2000.
2. M. Schmidt and H. Gish, "Speaker identification via support vector classifiers," in Proc. ICASSP, 1996, pp. 105-108.
3. Z. Lei, Y. Yang, and Z. Wu, "Mixture of support vector machines for text-independent speaker recognition," in Proc. Interspeech, 2005, pp. 993-996.
4. J. Kharroubi, D. Petrovska-Delacretaz, and G. Chollet, "Combining GMM's with suport vector machines for text-independent speaker verification," in Proc. Eurospeech, 2001, vol. 3, pp. 1757-1760.
5. V. Wan, "Speaker verification using support vector machines," Ph.D. dissertation, Univ. Sheffield, Sheffield, U.K., 2003.
6. P. Ho and P. Moreno, "SVM kernel adaptation in speaker classification and verification," in Proc. ICSLP, 2004, pp. 1413-1416.
7. N. Dehak and G. Chollet, "Support vector GMMs for speaker verification," in Proc. IEEE Odyssey, 2006.
8. W. M. Campbell, J. P. Campbell, D. Reynolds, E. Singer, and P. Torres-Carrasquillo, "Support vector machines for speaker and language recognition," Comput. Speech Lang., vol. 20, pp. 210-229, 2006.
9. J.-W. Xu, P. Pokharel, K.-H. Jeong, and J. C. Principe, "An explicit construction of a reproducing Gaussian kernel Hilbert space," in Proc. ICASSP, 2006, pp. V-573-V-576.
10. V. Wan and S. Renals, "Speaker verification using sequence discriminant support vector machines," IEEE Trans. Speech Audio Process., vol. 13, no. 2, pp. 203-210, Mar. 2004.
11. W. M. Campbell, D. E. Sturim, D. A. Reynolds, and A. Solomonoff, "SVM based speaker verification using a GMM supervector kernel and NAP variability compensation," in Proc. ICASSP, 2006, pp. I-97-I-100.
12. N. Krause and R. Gazit, "SVM-based speaker classification in the GMM models space," in Proc. IEEE Odyssey, 2006, pp. 1-5.
13. T. S. Jaakkola and D. Haussler, "Exploiting generative models in discriminative classifiers," Adv. Neural Inf. Process. Syst., vol. 11, pp. 487-493, 1998.
14. M. Seeger, "Covariance kernels from bayesian generative models," Adv. Neural Inf. Process. Syst., vol. 14, 2002.
15. T. Jebara, R. Kondor, and A. Howard, "Probability product kernels," J. Mach. Learn. Res., vol. 5, pp. 819-844, 2004.
16. S. Lyu, "A kernel between unordered sets of data: The Gaussian mixture approach," in Proc. ECML, 2005, pp. 255-267.
17. T. Jebara and R. Kondor, "Bhattacharyya and expected likelihood kernels," in Proc. Annu. Conf. Comput. Learn. Theory and Kernel Workshop, 2003.
18. P. Moreno and P. Ho, "A new SVM approach to speaker identification and verification using probabilistic distance kernels," in Proc. Eurospeech, 2003, pp. 2965-2968.
19. R. Kondor and T. Jebara, "A kernel between sets of vectors," in Proc. ICML, 2003.
20. S. Zhou and R. Chellappa, "From sample similarity to ensemble similarity: Probabilistic distance measures in reproducing kernel hilbert space," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 6, pp. 917-929, Jun. 2006.
21. H. Shimodaira, K. I. Noma, M. Nakai, and S. Sagayama, "Support vector machine with dynamic time-alignment kernel for speech recognition," in Proc. Interspeech, 2001.
22. V. Wan and J. Carmichael, "Polynomial dynamic time warping kernel support vector machines for dysarthric speech recognition with sparse training data," in Proc. Interspeech, 2005, pp. 3321-3324.
23. C.Wallraven, B. Caputo, and A. Graf, "Recognition with local features: The kernel recipe," in Proc. ICCV, 2003, pp. 257-264.
24. J. Mariéthoz and S. Bengio, "A max kernel for text-independent speaker verification systems," in Proc. MMUA, 2006.
25. S. Boughorbel, J.-P. Tarel, and F. Fleuret, "Non-Mercer kernels for SVM object recognition," in Proc. British Mach. Vision Conf. (BMVC), 2004, pp. 137-146.
26. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge, U.K.: Cambridge Univ. Press, 2004.
27. G. H. Golub and C. F. Van Loan, Matrix Computation. Baltimore, MD: The Johns Hopkins Univ. Press, 1996.
28. B. Schölkopf, S. Mika, C. J. C. Burges, P. Knirsch, K.-R. Müller, G. Rätsch, and A. J. Smola, "Input space versus feature space," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1000-1017, Sep. 1999.
29. M. J. Daniels and R. E. Kass, "Shrinkage estimators for covariance matrices," Biometrics, vol. 57, no. 4, pp. 1173-1184, 2001.
30. Y.-S. Choi, H.-C. Shin, and W.-J. Song, "Affine projection algorithms with adaptive regularization matrix," in Proc. ICASSP, 2006, pp. I-202-I-204.
31. C. Rasmussen and C. Williams, Gaussian Processes for Machine Learning. Cambridge, MA: MIT Press, 2006.
32. B. Schölkopf, A. J. Smola, and K. R. Müller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, no. 5, pp. 1299-1319, 1998.
33. A. J. Smola and B. Schölkopf, "Sparse greedy matrix approximation for machine learning," in Proc. ICML, 2000, pp. 911-918.
34. S. Fine and K. Scheinberg, "Efficient SVM training using low-rank kernel representations," J. Mach. Learn. Res., vol. 2, pp. 243-264, 2001.
35. F. R. Bach and M. I. Jordan, "Kernel independent component analysis," J. Mach. Learn. Res., vol. 3, pp. 1-48, 2002.
36. F. R. Bach and M. I. Jordan, "Predictive low-rank decomposition for kernel methods," in Proc. ICML, 2005, pp. 33-40.
37. G. Blanchard, P. Massart, R. Vert, and L. Zwald, "Kernel projection machine: A new tool for pattern recognition," in Proc. NIPS, 2004, pp. 1649-1656.
38. C. K. I. Williams and M. Seeger, Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2001, vol. 13, ch. Using the Nyström method to speed up kernel machines.
39. C. K. I. Williams and M. Seeger, "Effect of the input density distribution on kernel-based classifiers," in Proc. ICML, 2000, pp. 1159-1166.
40. S. Mika, B. Schölkopf, A. J. Smola, K. R. Müller, M. Scholz, and G. Rätsch, Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1999, vol. 11, ch. Kernel PCA and de-noising in feature spaces, pp. 536-542.
41. M. E. Tipping, "Sparse kernel principal component analysis," Adv. Neural Inf. Process. Syst., vol. 13, pp. 633-639, 2001.
42. R. Fisher, "The use of multiple measurements in taxonomic problems," in Annals of Eugenics. New York: Academic, 1936, vol. 7, pp. 179-188.
43. A. Bhattacharyya, "On a measure of divergence between two statistical populations defined by their probability distributions," Bull. Calcutta Math. Soc., vol. 35, pp. 99-109, 1943.
44. quot;The NIST Year 2005 Speaker Recognition Evaluation Plan," 2005 [Online]. Available: http://www.nist.gov/speech/tests/spk/2005/sre- 05-evalplan-v5.pdf
45. quot;Biosecure Network of Excellence: Biometrics for Secure Authentification," 2005 [Online]. Available: http://www.biosecure.info
46. I. Magrin-Chagnolleau, G. Gravier, and R. Blouet, "Overview of the 2000-2001 ELISA consortium research activities," in Proc. IEEE Odyssey, 2001.
47. J. Pelecanos and S. Sridharan, "Feature warping for robust speaker verification," in Proc. IEEE Odyssey, 2001.
48. Y. Linde, A. Buzo, and R. M. Gray, "An algorithm for vector quantization design," IEEE Trans. Commun., vol. COM-28, no. 1, pp. 84-95, Jan. 1980.
49. J. Louradour and K. Daoudi, "Conceiving a new sequence kernel and applying it to SVM speaker verification," in Proc. Interspeech, 2005.
50. R. Auckenthaler, M. Carey, and H. Lloyd-Thomas, "Score normalization for text-independent speaker verification systems," Digital Signal Process., vol. 10, no. 1-3, pp. 42-54, 2000.
51. C. Barras and J.-L. Gauvain, "Feature and score normalization for speaker verification of cellular data," in Proc. ICASSP, 2003, pp. II-49-II-52.
52. J.-F. Bonastre, F. Wils, and S. Meignier, "Alize, a free toolkit for speaker recognition," in Proc. ICASSP, 2005, pp. 737-740.
53. N. Scheffer and J.-F. Bonastre, "Fusing generative and discriminative UBM-based systems for speaker verification," in Proc. 2nd Int. Workshop MultiModal User Authentification (MMUA), 2006.
54. A. Solomonoff, C. Quillen, and W. M. Campbell, "Channel compensation for SVM speaker recognition," in Proc. IEEE Odyssey, 2004.