Analysis of large-scale svm training algorithms for language and speaker recognition

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 5, 2012, Pages 1585-1596

  Cumani, Sandro ^a   Laface, Pietro ^a  

^a POLITECNICO DI TORINO   (Italy)

Author keywords

Language recognition; large scale training; speaker recognition; support vector machines (SVMs)

Indexed keywords

LANGUAGE RECOGNITION; SPEAKER RECOGNITION; STATE-OF-THE-ART PERFORMANCE; SUPPORT VECTOR MACHINE (SVM); SVM MODEL; TRAINING ALGORITHMS; TRAINING SETS; TRAINING TIME;

ALGORITHMS; SPEECH RECOGNITION;

SUPPORT VECTOR MACHINES;

EID: 84859066901     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2186290     Document Type: Article

References (43)

1. B. E. Boser, I. M. Guyon, and V. N. Vapnik, "A training algorithm for optimal margin classifiers," in Proc. 5th Annu. ACMWorkshop Comput. Learn. Theory, 1992, pp. 144-152.
2. C.-J. Hsieh, K.-W. Chang, C.-J. Lin, S. S.Keerthi, and S. Sundararajan, "A dual coordinate descent method for large-scale linear SVM," Proc. ICML '08, pp. 408-415, 2008.
3. C. H. Teo, A. Smola, S. V. Vishwanathan, and Q. V. Le, "Bundle methods for regularized risk minimization," J. Mach. Learn. Res., vol. 11, pp. 311-365, Mar. 2010.
4. W. M. Campbell, "A covariance kernel for SVM language recognition," Proc. ICASSP '08, pp. 4141-4144, 2008.
5. C. J. C. Burges, "A tutorial on support vector machines for pattern recognition," Data Mining Knowl. Disc., vol. 2, pp. 121-167, 1998. (Pubitemid 128695475)
6. M. A. Zissman, "Comparison of four approaches to automatic language identification of telephone speech," IEEE Trans. Speech Audio Process., vol. 4, no. 1, pp. 31-44, Jan. 1996. (Pubitemid 126752987)
7. D. A. Reynolds, T. F. Quatieri, and R. B. Dunn, "Speaker verification using adapted Gaussian mixture models," Digital Signal Process., vol. 10, no. 1-3, pp. 31-44, 2000.
8. J.-L. Gauvain, A. Messaoudi, and H. Schwenk, "Language recognition using phone lattices," Proc. Interspeech '04, pp. 25-28, 2004.
9. J.-L. Gauvain, A. Messaoudi, and H. Schwenk, "Language recognition with word lattices and support vector machines," Proc. ICASSP '07, pp. 15-20, 2007.
10. P. A. Torres-Carrasquillo, D. A. Reynolds, E. Singer, A. Kohler, R. J. Greene, and J. J. R. Deller, "Approaches to language identification using Gaussian mixture models and shifted delta cepstral features," Proc. ICSLP '02, pp. 89-92, 2002.
11. L. B. P. Matéjka and J. Cernocky, "Discriminative training techniques for acoustic language identification," Proc. ICASSP '06, pp. 209-212, 2006.
12. W. M. Campbell, J. P. Campbell, D. A. Reynolds, E. Singer, and P. A. Torres-Carrasquillo, "Support vector machines for speaker and language recognition," Comput. Speech Lang., vol. 20, no. 1-3, pp. 210-229, 2006. (Pubitemid 41787537)
13. F. Castaldo, D. Colibro, E. Dalmasso, P. Laface, and C. Vair, "Acoustic language identification using fast discriminative training," Proc. Interspeech '07, pp. 346-349, 2007.
14. W. Campbell, J. Campbell, T. Gleason, D. Reynolds, and W. Shen, "Speaker verification using support vector machines and high-level features," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 7, pp. 2085-2094, Sep. 2007.
15. D. Albesano, R. Gemello, and F. Mana, "Hybrid HMM-NN modeling of stationary-transitional units for continuous speech recognition," Proc. Neural Inf. Process. '07, pp. 1112-1115, 1997.
16. W. M. Campbell, D. E. Sturim, D. A. Reynolds, and A. Solomonoff, "SVM based speaker verification using a GMMsupervector kernel and NAP variability compensation," Proc. ICASSP '06, pp. 97-100, 2006.
17. K. Berkling, J.-F. Bonastre, and J. P. Campbell, "Introduction to the special section on speaker and language recognition," IEEE Trans. Audio Speech Lang. Process., vol. 15, no. 7, pp. 1949-1950, 2007.
18. P. Kenny, G. Boulianne, P. Ouellet, and P. Dumouchel, "Joint factor analysis versus eigenchannels in speaker recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 4, pp. 1435-1447, May 2007.
19. L. Burget et al., "Robust speaker recognition over varying channels," in Johns Hopkins University CLSP Summer Workshop Report, 2009 [Online]. Available: http://www.clsp.jhu.edu/workshops/ws08/documents/jhu report main.pdf
20. S. Cumani, N. Brümmer, L. Burget, and P. Laface, "Fast discriminative speaker verification in the i-vector space," in Proc. ICASSP '11, 2011, pp. 4852-4855.
21. L. Burget, O. Plchot, S. Cumani, O. G. P. Matejka, and N. Brümmer, "Discriminatively trained probabilistic linear discriminant analysis for speaker verification," in Proc. ICASSP '11, 2011, pp. 4832-4835.
22. N. Dehak, R. Dehak, P. K. N. Brümmer, and P. Ouellet, "Support vector machines versus fast scoring in the low-dimensional total variability space for speaker verification," Proc. Interspeech '09, pp. 1559-1562, 2009.
23. N. Dehak, P. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, "Front-end factor analysis for speaker verification," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 4, pp. 788-798, May 2010.
24. N. Dehak, R. Dehak, P. Kenny, N. Brümmer, and P. Ouellet, "Probabilistic linear discriminant analysis for inferences about identity," in Proc. 11th Int. Conf. Comput. Vis., 2007, pp. 1-8.
25. P. Kenny, "Bayesian speaker verification with heavy-tailed priors," in Keynote presentation, Odyssey '10, The Speaker and Language Recognition Workshop, 2010 [Online]. Available: http://www.crim.ca/perso/ patrick.kenny/kenny-Odyssey2010.pdf
26. T. Joachims, "Making large-scale Support Vector Machine learning practical," in Advances in Kernel Methods-Support Vector Learning. Cambridge, MA: MIT Press, 1999, pp. 169-184.
27. S. Cumani, F. Castaldo, P. Laface, D. Colibro, and C. Vair, "Comparison of large-scale SVM training algorithms for language recognition," in Proc. Odyssey '10, Speaker Lang. Recognition Workshop, 2010, pp. 222-229.
28. T. Joachims, "A support vector method for multivariate performance measures," Proc. ICML '05, pp. 377-384, 2005. (Pubitemid 43183356)
29. T. Joachims, "Training linear SVMs in linear time," in Proc. KDD '06, 2006, pp. 217-226. (Pubitemid 44535518)
30. T. Joachims and C.-N. J. Yu, "Sparse kernel SVMs via cutting-plane training," Mach. Learn., vol. 76, no. 2-3, pp. 179-193, 2009.
31. S. Shalev-Shwartz, Y. Singer, and N. Srebro, "Primal estimated subgradient solver for SVM," Proc. ICML '07, pp. 807-814, 2007.
32. C. H. Teo, A. Smola, S. V. Vishwanathan, and Q. V. Le, "A scalable modular convex solver for regularized risk minimization," Proc. KDD '07, pp. 727-736, 2007. (Pubitemid 350229258)
33. [Online]. Available: http://numpy.scipy.org
34. [Online]. Available: http://abel.ee.ucla.edu/cvxopt
35. [Online]. Available: http://www.openmp.org
36. [Online]. Available: http://www.itl.nist.gov/iad/mig/tests/sre/2010/NIST- SRE10-evalplan.r6.pdf
37. [Online]. Available: http://www.itl.nist.gov/iad/mig/tests/lre/2009/ LRE09-EvalPlan-v6.pdf
38. F. Castaldo, D. Colibro, S. Cuman, E. Dalmasso, P. Laface, and C. Vair, "Loquendo-politecnico di Torino system for the 2009 NIST language recognition evaluation," Proc. ICASSP '10, pp. 5002-5005, 2010.
39. F. Castaldo, D. Colibro, E. Dalmasso, P. Laface, and C.Vair, "Compensation of nuisance factors for speaker and language recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 7, pp. 1969-1978, Jul. 2007.
40. P. Matejka, L. Burget, O. Glembek, P. Schwarz, V. Hubeika, M. Fapso, T. Mikolov, O. Plchot, and J. Cernocky, "But language recognition system for NIST 2007 evaluations," Proc. Interspeech '07, pp. 739-742, 2007.
41. [Online]. Available: http://www.ldc.upenn.edu/Catalog/
42. P. Matejka, O. Glembek, F. Castaldo, O. Plchot, P. Kenny, L. Burget, and J. Cernocky, "Full-covariance ubm and heavy-tailed plda in i-vector speaker verification," Proc. ICASSP '11, pp. 4828-4831, 2011.
43. V. Franc and S. Sonnenburg, "Optimized cutting plane algorithm for support vector machines," Proc. ICML '08, pp. 320-327, 2008.