Exemplar-based sparse representations for noise robust automatic speech recognition

IEEE Transactions on Audio, Speech and Language Processing

Volumn 19, Issue 7, 2011, Pages 2067-2080

  Gemmeke, Jort F ^a   Virtanen, Tuomas ^b   Hurmalainen, Antti ^b  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^b TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

Exemplar based; noise robustness; non negative matrix factorization; sparse representations; speech recognition

Indexed keywords

CONNECTED DIGITS; EXEMPLAR-BASED; FEATURE ENHANCEMENT; LINEAR COMBINATIONS; MISSING DATA; NOISE ROBUSTNESS; NOISE-ROBUST AUTOMATIC SPEECH RECOGNITION; NOISY SPEECH; NONNEGATIVE MATRIX FACTORIZATION; PHONETIC INFORMATION; SIGNAL TO NOISE; SOURCE SEPARATION; SPARSE REPRESENTATION; TIME FRAME; TIME FREQUENCY;

BLIND SOURCE SEPARATION; FACTORIZATION; FEATURE EXTRACTION; HYBRID SYSTEMS; SIGNAL TO NOISE RATIO;

SPEECH RECOGNITION;

EID: 79960657803     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2011.2112350     Document Type: Article

References (47)

1. H. Bourlard, H. Hermansky, and N. Morgan, "Towards increasing speech recognition error rates," Speech Commun., vol. 18, pp. 205-231, 1996. (Pubitemid 126362800)
2. P. Moreno, B. Raj, and R. Stern, "A vector Taylor series approach for environment-independent speech recognition," in Proc. Int. Conf. Audio, Speech, Signal Process., Atlanta, GA, 1996, pp. 733-736.
3. M. J. F. Gales and S. J. Young, "Robust continuous speech recognition using parallel model combination," IEEE Trans. Speech Audio Process., vol. 4, no. 5, pp. 352-359, Sep. 1996. (Pubitemid 126753023)
4. B. Raj and R. M. Stern, "Missing-feature approaches in speech recognition," IEEE Signal Process. Mag., vol. 22, no. 5, pp. 101-116, Sep. 2005. (Pubitemid 41488524)
5. M. Cooke, P. Green, and M. Crawford, "Handling missing data in speech recognition," in Proc. Int. Conf. Speech Lang. Process., 1994, pp. 1555-1558.
6. N. S. Kim, D. K. Kim, and S. R. Kim, "Application of sequential estimation to time-varying environment compensation in speech recognition," in IEEE Workshop Autom. Speech Recognition Understanding, 1997, pp. 389-395.
7. B. J. Frey, L. Deng, A. Acero, and T. Kristjansson, "ALGONQUIN: Iterating laplace's method to remove multiple types of acoustic distortion for robust speech recognition," in Proc. Eurospeech, 2001, pp. 901-904.
8. K. Yao and S. Nakamura, "Sequential noise compensation by sequential Monte Carlo method," in Proc. Neural Inf. Process. Syst., 2002, pp. 1205-1212.
9. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," in Proc. Neural Inf. Process. Syst., Apr. 2001, pp. 556-562.
10. E. J. Candés and M. B. Wakin, "An introduction to compressive sampling," IEEE Signal Process. Mag., vol. 25, no. 2, pp. 21-30, Mar. 2008.
11. P. Smaragdis and J. C. Brown, "Non-negative matrix factorization for polyphonic music transcription," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., 2003, pp. 177-180.
12. T. Virtanen, "Monaural sound source separation by non-negative matrix factorization with temporal continuity and sparseness criteria," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 3, pp. 1066-1074, Mar. 2007.
13. M. N. Schmidt and R. K. Olsson, "Linear regression on sparse features for single-channel speech separation," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA), 2007, pp. 26-29.
14. T. Virtanen and A. T. Cemgil, "Mixtures of gamma priors for nonnegative matrix factorization based speech separation," in Proc. ICA, 2009, pp. 646-653.
15. B. Raj, T. Virtanen, S. Chaudhure, and R. Singh, "Non-negative matrix factorization based compensation of music for automatic speech recognition," in Proc. Int. Conf. Speech, Lang. Process., 2010, pp. 717-720.
16. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
17. T. N. Sainath, A. Carmi, D. Kanevsky, and B. Ramabhadran, "Bayesian compressive sensing for phonetic classification," in Proc. Int. Conf. Audio, Speech, Signal Process., 2010, pp. 4370-4373.
18. J. F. Gemmeke, L. ten Bosch, L. Boves, and B. Cranen, "Using sparse representations for exemplar based continuous digit recognition," in Proc. EUSIPCO, Glasgow, Scotland, Aug. 24-28, 2009, pp. 1755-1759.
19. J. F. Gemmeke and T. Virtanen, "Noise robust exemplar-based connected digit recognition," in Proc. Int. Conf. Audio, Speech, Signal Process., 2010, pp. 4546-4549.
20. J. F. Gemmeke and B. Cranen, "Noise robust digit recognition using sparse representations," in Proc. ISCA 2008 ITRW Speech Anal. Process. Knowl. Discov., 2008.
21. G. S. V. S. Sivaram, S. K. Nemala, M. Elhilali, T. D. Tran, and H. Hermansky, "Sparse coding for speech recognition," in Proc. Int. Conf. Audio, Speech, Signal Process., 2010, pp. 4346-4349.
22. J. F. Gemmeke, H. Van Hamme, B. Cranen, and L. Boves, "Compressive sensing for missing data imputation in noise robust speech recognition," IEEE J. Sel. Topics Signal Process., vol. 4, no. 2, pp. 272-287, Apr. 2010.
23. M. D. Wachter, M. Matton, K. Demuynck, P. Wambacq, R. Cools, and D. Van Compernolle, "Template based continuous speech recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 4, pp. 1377-1390, May 2007.
24. M. Van Segbroeck and H. Van Hamme, "Applying non-negative matrix factorization on time-frequency reassignment spectra for missing data mask estimation," in Proc. Interspeech, Brighton, U.K., Sep. 6-10, 2009, pp. 2511-2514.
25. H. Van Hamme, "Robust speech recognition using cepstral domain missing data techniques and noisy masks," in Proc. Int. Conf. Audio, Speech, Signal Process., 2004, vol. 1, pp. 213-216.
26. T. Virtanen, A. T. Cemgil, and S. Godsill, "Bayesian extensions to nonnegative matrix factorization for audio signal modelling," in Proc. Int. Conf. Audio, Speech, Signal Process., 2008, pp. 1825-1828.
27. T. Virtanen, J. F. Gemmeke, and A. Hurmalainen, "State-based labeling for a sparse representation of speech and its application to robust speech recognition," in Proc. Interspeech, 2010, pp. 893-896.
28. P. Smaragdis, M. Shashanka, and B. Raj, "A sparse non-parametric approach for single channel separation of known sounds," in Proc. Neural Inf. Process. Syst., 2009, pp. 1705-1713.
29. L. Benaroya, F. Bimbot, and R. Gribonval, "Audio source separation with a single sensor," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 1, pp. 191-199, Jan. 2006. (Pubitemid 43863465)
30. B. Raj, R. Singh, and R. Stern, "Inference of missing spectrographic features for robust automatic speech recognition," in Proc. Int. Conf. Speech Lang. Process., Sydney, Australia, Nov. 4, 1998, pp. 1491-1494.
31. H.Van Hamme, "Prospect features and their application to missing data techniques for robust speech recognition," in Proc. Interspeech, 2004, pp. 101-104.
32. C.-P. Chen and J. A. Bilmes, "MVA processing of speech features," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 1, pp. 257-270, Jan. 2007.
33. H. Hirsch and D. Pearce, "The Aurora experimental framework for the performance evaluation of speech recognition systems under noisy conditions," in Proc. ISCA Tutorial Research Workshop ASR2000, Paris, France, Sep. 18-20, 2000, pp. 181-188.
34. H. Van Hamme, "Handling time-derivative features in a missing data framework for robust automatic speech recognition," in Proc. Int. Conf. Audio, Speech, Signal Process., 2006, pp. 293-296.
35. J. F. Gemmeke and T. Virtanen, "Artificial and online acquired noise dictionaries for noise robust ASR," in Proc. Interspeech, 2010, pp. 2082-2085.
36. A. Acero, L. Deng, T. Kristjansson, and J. Zhang, "HMM adaptation using vector Taylor series for noise speech recognition," in Proc. Int. Conf. Spoken Lang. Process., Beijing, China, 2000, pp. 869-872.
37. R. C. Van Dalen, F. Flego, and M. J. F. Gales, "Transforming features to compensate speech recognizer models for noise," in Proc. Interspeech, Brighton, U.K., Sep. 6-10, 2009, pp. 2499-2502.
38. Y. Sun, J. F. Gemmeke, B. Cranen, L. ten Bosch, and L. Boves, "Using a DBN to integrate sparse classification and GMM-based ASR," in Proc. Interspeech, 2010, pp. 2098-2101, DOI:10.1016/j.csl.2010.06. 004.
39. J. F. Gemmeke, B. Cranen, and U. Remes, "Sparse imputation for large vocabulary noise robust ASR," Comput. Speech Lang., pp. 462-479, 2010.
40. P. Nagesh, R. Gowda, and B. Li, "Fast GPU implementation of large scale dictionary and sparse representation based vision problems," in Proc. Int. Conf. Audio, Speech, Signal Process., 2010, pp. 1570-1573.
41. M. Van Segboeck and H. Van Hamme, "Unsupervised learning of timefrequency patches as a noise-robust representation of speech," Speech Commun., vol. 51, no. 11, 2009.
42. A. Majumdar and R. K. Ward, "Classification via group sparsity promoting regularization," in Proc. Int. Conf. Audio, Speech, Signal Process., 2009, pp. 861-864.
43. S. Sharma, D. Ellis, S. Kajarekar, P. Jain, and H. Hermansky, "Feature extraction using non-linear transformation for robust speech recognition on the Aurora database," in Proc. Int. Conf. Audio, Speech, Signal Process., 2000, pp. 1117-1120.
44. M. Aharon, M. Elad, and A. M. Bruckstein, "The K-SVD: An algorithm for designing of overcomplete dictionaries for sparse representations," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006. (Pubitemid 44637761)
45. T. Virtanen, "Separation of sound sources by convolutive sparse coding," in Proc. ISCA Tutorial and Research Workshop Statist. Perceptual Audio Process., 2004.
46. P. Smaragdis, "Convolutive speech bases and their application to supervised speech separation," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 1, pp. 1-12, Jan. 2007.
47. C.-J. Lin, "On the convergence of multiplicative update algorithms for nonnegative matrix factorization," IEEE Trans. Neural Netw., vol. 18, no. 6, pp. 1589-1596, Nov. 2007. (Pubitemid 350148414)