Low-variance multitaper MFCC features: A case study in robust speaker verification

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 7, 2012, Pages 1990-2001

  Kinnunen, Tomi ^a   Saeidi, Rahim ^a,b   Sedlák, Filip ^a   Lee, Kong Aik ^c   Sandberg, Johan ^d,e   Hansson Sandsten, Maria ^e   Li, Haizhou ^c  

^a UNIVERSITY OF EASTERN FINLAND   (Finland)

^b RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^c INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^d Nordea Bank   (Denmark)

^e LUND UNIVERSITY   (Sweden)

Author keywords

Mel frequency cepstral coefficient (MFCC); multitaper; small variance estimation; speaker verification

Indexed keywords

AUDIO APPLICATIONS; AUTO REGRESSIVE PROCESS; BIAS AND VARIANCE; FREQUENCY DOMAINS; GAUSSIAN MIXTURE MODEL; JOINT FACTOR ANALYSIS; MEL-FREQUENCY CEPSTRAL COEFFICIENTS; MULTITAPER; MULTITAPER METHODS; MULTITAPERS; PARAMETER SELECTION; ROBUST SPEAKER VERIFICATION; SIGNAL SPECTRUM; SPEAKER VERIFICATION; SPECTRAL LEAKAGE; TIME DOMAIN; UNIVERSAL BACKGROUND MODEL;

DISCRETE FOURIER TRANSFORMS; GESTURE RECOGNITION; SOFTWARE AGENTS; SPEECH PROCESSING; SUPPORT VECTOR MACHINES; TELEPHONE SYSTEMS; TIME DOMAIN ANALYSIS;

SPEECH RECOGNITION;

EID: 84860850285     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2191960     Document Type: Article

References (51)

1. F. J. Harris, "On the use of windows for harmonic analysis with the discrete Fourier transform," Proc. IEEE, vol. 66, no. 1, pp. 51-84, Jan. 1978.
2. J. Makhoul, "Linear prediction: A tutorial review," Proc. IEEE, vol. 64, no. 4, pp. 561-580, Apr. 1975.
3. S. B. Davis and P. Mermelstein, "Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences," IEEE Trans. Acoust., Speech, Signal Process., vol. 28, no. 4, pp. 357-366, Aug. 1980. (Pubitemid 11464930)
4. X. Huang, A. Acero, and H.-W. Hon, Spoken Language Processing: A Guide to Theory, Algorithm, and System Development. Upper Saddle River, New Jersey: Prentice-Hall, 2001.
5. H. Hermansky and N. Morgan, "RASTA processing of speech," IEEE Trans. Speech Audio Process., vol. 2, no. 4, pp. 578-589, Oct. 1994.
6. X. Xiao, E.-S. Chng, and H. Li, "Temporal structure normalization of speech feature for robust speech recognition," IEEE Signal Process. Lett., vol. 14, no. 7, pp. 500-503, Jul. 2007. (Pubitemid 47018924)
7. J. Pelecanos and S. Sridharan, "Feature warping for robust speaker verification," in Proc. Speaker Odyssey: Speaker Recognition Workshop (Odyssey 2001), Crete, Greece, Jun. 2001, pp. 213-218.
8. C.-P. Chen and J. A. Bilmes, "MVA processing of speech features," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 1, pp. 257-270, Jan. 2007.
9. M. Hansson-Sandsten and J. Sandberg, "Optimal cepstrum estimation using multiple windows," in Proc. ICASSP '09, Taipei, Taiwan, Apr. 2009, pp. 3077-3080.
10. D. B. Percival and A. T.Walden, Spectral Analysis for Physical Applications. Cambridge, MA: Cambridge Univ. Press, 1993.
11. T. Kinnunen and H. Li, "An overview of text-independent speaker recognition: From features to supervectors," Speech Comm., vol. 52, no. 1, pp. 12-40, Jan. 2010.
12. D. A. Reynolds, T. F. Quatieri, and R. B. Dunn, "Speaker verification using adapted Gaussian mixture models," Digital Signal Process., vol. 10, no. 1, pp. 19-41, Jan. 2000. (Pubitemid 30592166)
13. W. M. Campbell, D. E. Sturim, and D. A. Reynolds, "Support vector machines using GMM supervectors for speaker verification," IEEE Signal Process. Lett., vol. 13, no. 5, pp. 308-311, May 2006.
14. N. Brümmer, L. Burget, J. H. Cernocký, O. Glembek, F. Grézl, M. Karafiát, D. A. v. Leeuwen, P. Matejka, P. Schwartz, and A. Strasheim, "Fusion of heterogeneous speaker recognition systems in the STBU submission for the NIST speaker recognition evaluation 2006," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 7, pp. 2072-2084, Sep. 2007.
15. P. Kenny, P. Ouellet, N. Dehak, V. Gupta, and P. Dumouchel, "A study of inter-speaker variability in speaker verification," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 5, pp. 980-988, Jul. 2008.
16. P. Kenny, G. Boulianne, P. Ouellet, and P. Dumouchel, "Joint factor analysis versus eigenchannels in speaker recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 4, pp. 1435-1447, May 2007.
17. A. Stolcke, S. S. Kajarekar, L. Ferrer, and E. Shriberg, "Speaker recognition with session variability normalization based on MLLR adaptation transforms," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 7, pp. 1987-1998, Sep. 2007.
18. C. H. You, K. A. Lee, and H. Li, "GMM-SVM kernel with a Bhattacharyya-based distance for speaker recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 6, pp. 1300-1312, Aug. 2010.
19. N. Dehak, P. J. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, "Front-end factor analysis for speaker verification," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 4, pp. 788-798, May 2011.
20. A. Davis, S. Nordholm, and R. Togneri, "Statistical voice activity detection using low-variance spectrum estimation and an adaptive threshold," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 2, pp. 412-424, Mar. 2006.
21. P. K. Ghosh, A. Tsiartas, and S. Narayanan, "Robust voice activity detection using long-term signal variability," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 3, pp. 600-613, Mar. 2010.
22. Y. Hu and P. C. Loizou, "Speech enhancement based on wavelet thresholding the multitaper spectrum," , vol. 12, no. 1, pp. 59-67, Jan. 2004.
23. L. P. Ricotti, "Multitapering and a wavelet variant of MFCC in speech recognition," IEE Proc. Vis., Image Signal Process., vol. 152, no. 1, pp. 29-35, Feb 2005. (Pubitemid 40527360)
24. D. J. Thomson, "Spectrum estimation and harmonic analysis," Proc. IEEE, vol. 70, no. 9, pp. 1055-1096, Sep. 1982.
25. K. S. Riedel and A. Sidorenko, "Minimum bias multiple taper spectral estimation," IEEE Trans. Signal Process., vol. 43, no. 1, pp. 188-195, Jan 1995.
26. M. Hansson and G. Salomonsson, "A multiple window method for estimation of peaked spectra," IEEE Trans. Signal Process., vol. 45, no. 3, pp. 778-781, Mar. 1997. (Pubitemid 127765966)
27. J. Sandberg, M. Hansson-Sandsten, T. Kinnunen, R. Saeidi, P. Flandrin, and P. Borgnat, "Multitaper estimation of frequency-warped cepstra with application to speaker verification," IEEE Signal Process. Lett., vol. 17, no. 4, pp. 343-346, Apr. 2010.
28. A. T. Walden, E. McCoy, and D. B. Percival, "The variance of multitaper spectrum estimates for real gaussian processes," IEEE Trans. Signal Process., vol. 42, no. 2, pp. 479-482, Feb. 1994.
29. T. P. Bronez, "On the performance advantage of multitaper spectral analysis," IEEE Trans. on Sign. Proc., vol. 40, no. 12, pp. 2941-2946, Dec. 1992.
30. P. D. Welch, "The use of Fast Fourier Transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms," IEEE Trans. Audio Electroacoust., vol. AU-15, no. 2, pp. 70-73, Jun. 1967.
31. C. H. Shadle and G. Ramsay, "Multitaper analysis of fundamental frequency variations during voiced fricatives," in Proc. 6th Int. Seminar Speech Product., Dec. 2003, p. CD-6.
32. N. Erdol and T. Gunes, "Multitaper covariance estimation and spectral denoising," in Proc. Conf. Rec. 39th Asilomar Conf. Signals, Syst., Comput., Nov. 2005, pp. 1144-1147. (Pubitemid 46350492)
33. T. Kinnunen, R. Saeidi, J. Sandberg, and M. Hansson-Sandsten, "What else is new than the Hamming window? Robust MFCCs for speaker recognition via multitapering," in Proc. Interspeech, Makuhari, Japan, Sep. 2010, pp. 2734-2737.
34. A. Solomonoff, W. M. Campbell, and I. Boardman, "Advances in channel compensation for SVM speaker recognition," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP 2005), Philadelphia, PA, Mar. 2005, pp. 629-632.
35. P. Kenny, Joint factor analysis of speaker and session variability: Theory and algorithms Tech. Rep. CRIM-06/08-14, 2006.
36. P. Kenny, G. Boulianne, P. Ouellet, and P. Dumouchel, "Speaker and session variability in GMM-based speaker verification," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 4, pp. 1448-1460, May 2007.
37. D. J. Thomson, "Jackknifing multitaper spectrum estimates," IEEE Signal Process. Mag., vol. 24, no. 4, pp. 20-30, Jul. 2007. (Pubitemid 47316164)
38. T. Gerkmann and R. Martin, "On the statistics of spectral amplitudes after variance reduction by temporal cepstrum smoothing and cepstral nulling," IEEE Trans. Signal Process., vol. 57, no. 11, pp. 4165-4174, Nov 2009.
39. G. Schwarz, "Estimating the dimension of a model," Ann. Statist., vol. 6, pp. 461-464, Mar. 1978.
40. T. Schneider and A. Neumaier, "Algorithm 808: ARfit-a Matlab package for the estimation of parameters and eigenmodes of multivariate autoregressive models," ACM Trans. Math. Softw., vol. 27, pp. 58-65, 2001. (Pubitemid 33609115)
41. R. Auckenthaler, M. Carey, and H. Lloyd-Thomas, "Score normalization for text-independent speaker verification systems," Digital Signal Process., vol. 10, no. 1-3, pp. 42-54, Jan. 2000. (Pubitemid 30592165)
42. R. Vogt, B. Baker, and S. Sridharan, "Modelling session variability in text-independent speaker verification," in Proc. Interspeech '05, Lisbon, Portugal, Sep. 2005, pp. 3117-3120.
43. R. Saeidi, H. R. S. Mohammadi, T. Ganchev, and R. D. Rodman, "Particle swarm optimization for sorted adapted Gaussian mixture models," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 2, pp. 344-353, Feb. 2009.
44. R. Saeidi, J. Pohjalainen, T. Kinnunen, and P. Alku, "Temporally weighted linear prediction features for tackling additive noise in speaker verification," IEEE Signal Process. Lett., vol. 17, no. 6, pp. 599-602, Jun. 2010.
45. J. Pohjalainen, R. Saeidi, T. Kinnunen, and P. Alku, "Extended weighted linear prediction (XLP) analysis of speech and its application to speaker verification in adverse conditions," in Proc. Interspeech '10, Makuhari, Japan, Sep. 2010, pp. 1477-1480.
46. H. Li, B. Ma, K.-A. Lee, H. Sun, D. Zhu, K. C. Sim, C. You, R. Tong, I. Kärkkäinen, C.-L. Huang, V. Pervouchine, W. Guo, Y. Li, L. Dai, M. Nosratighods, T. Tharmarajah, J. Epps, E. Ambikairajah, E.-S. Chng, T. Schultz, and Q. Jin, "The I4U system in NIST 2008 speaker recognition evaluation," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP '09), Taipei, Taiwan, Apr. 2009, pp. 4201-4204.
47. R. Saeidi, J. Pohjalainen, T. Kinnunen, and P. Alku, "Temporally weighted linear prediction features for speaker verification in additive noise," in Proc. Odyssey 2010: Speaker Lang. Recogni. Workshop, Brno, Czech Republic, Jun. 2010.
48. P. C. Loizou, Speech Enhancement: Theory and Practice. Boca Raton, FL: CRC, 2007.
49. A. Martin, G. Doddington, T. Kamm, M. Ordowski, and M. Przybocki, "The DET curve in assessment of detection task performance," in Proc. 5th Eur. Conf. Speech Commun. Technol. (Eurospeech '97), Rhodos, Greece, Sep. 1997, pp. 1895-1898.
50. D. A. van Leeuwen, A. F. Martin, M. A. Przybocki, and J. S. Bouten, "NIST and NFI-TNO evaluations of automatic speaker recognition," Comput. Speech Lang., vol. 20, pp. 128-158, Apr.-Jul. 2006. (Pubitemid 41787534)
51. M. J. Alam, T. Kinnunen, P. Kenny, P. Ouellet, and D. O'Shaughnessy, "Multitaper MFCC features for speaker verification using i-vectors," in Proc. IEEE Autom. Speech Recognit. Understanding (ASRU 2011), Dec. 2011, pp. 547-552.