Bounded conditional mean imputation with observation uncertainties and acoustic model adaptation

IEEE Transactions on Audio, Speech and Language Processing

Volumn 23, Issue 7, 2015, Pages 1198-1208

  Remes, Ulpu ^a   López, Ana Ramírez ^a   Palomäki, Kalle ^a   Kurimo, Mikko ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Acoustic model adaptation; missing data; noise robust speech recognition; observation uncertainties

Indexed keywords

ACOUSTIC NOISE; ACOUSTIC NOISE MEASUREMENT; SPEECH; UNCERTAINTY ANALYSIS;

ACOUSTIC MODEL ADAPTATION; AUTOMATIC SPEECH RECOGNITION SYSTEM; ENVIRONMENTAL VARIATIONS; MISSING DATA; MISSING DATA METHODS; NOISE ROBUST SPEECH RECOGNITION; OBSERVATION UNCERTAINTIES; POSTERIOR DISTRIBUTIONS;

SPEECH RECOGNITION;

EID: 84929376602     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASLP.2015.2424322     Document Type: Article

References (44)

1. R. Rose, "Environmental robustness in automatic speech recognition," in Proc. ISCA Workshop Robustness Conversat. Interact., 2004.
2. J. N. Holmes and N. C. Sedgwick, "Noise compensation for speech recognition using probabilistic models," in Proc. ICASSP, 1986, pp. 741-744.
3. M. Cooke, P. Green, L. Josifovski, and A. Vizinho, "Robust automatic speech recognition with missing and unreliable acoustic data," Speech Commun., vol. 34, pp. 267-285, 2001.
4. B. Raj, M. L. Seltzer, and R. M. Stern, "Reconstruction of missing features for robust speech recognition," Speech Commun., vol. 43, pp. 275-296, 2004.
5. B. Raj and R. Singh, "Reconstructing spectral vectors with uncertain spectrographic masks for robust speech recognition," in Proc. ASRU, 2005.
6. F. Faubel, J. McDonough, and D. Klakow, "Bounded conditional mean imputation with Gaussian mixture models: A reconstruction approach to partly occluded features," in Proc. ICASSP, 2009, pp. 3869-3872.
7. J. F. Gemmeke, H. Van hamme, B. Cranen, and L. Boves, "Compres-sive sensing for missing data imputation in noise robust speech recognition," IEEE J. Sel. Topics Signal Process., vol. 4, no. 2, pp. 272-287, Apr. 2010.
8. M. Braun, F. Faubel, and D. Klakow, "A comparative study of missing feature imputation techniques," in Proc. 10. ITG Symp. Speech Commun., 2012.
9. J. A. González, A. M. Peinado, A. M. Gómez, N. Ma, and J. Barker, "Combining missing-data reconstruction and uncertainty decoding for robust speech recognition," in Proc. ICASSP, 2012, pp. 4693-4696.
10. J. A. González, A. M. Peinado, N. Ma, A. M. Gómez, and J. Barker, "MMSE-based missing-feature reconstruction with temporal modeling for robust speech recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 3, pp. 624-635, Mar. 2013.
11. U. Remes, "Bounded conditional mean imputation with an approximate posterior," in Proc. Interspeech, 2013.
12. U. Remes, Y. Nankaku, and K. Tokuda, "GMM-based missing-feature reconstruction on multi-frame windows," in Proc. Interspeech, 2011.
13. U. Remes, K. J. Palomäki, and M. Kurimo, "Robust automatic speech recognition using acoustic model adaptation prior to missing feature reconstruction," in Proc. EUSIPCO, 2009.
14. S. Srinivasan and D. L. Wang, "Transforming binary uncertainties for robust speech recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 7, pp. 2130-2140, Sep. 2007.
15. J. F. Gemmeke, U. Remes, and K. J. Palomäki, "Observation uncertainty measures for sparse imputation," in Proc. Interspeech, 2010.
16. R. F. Astudillo, D. Kolossa, P. Mandelartz, and R. Orglmeister, "An uncertainty propagation approach to robust ASR using the ETSI advanced front-end," IEEE J. Sel. Topics Signal Process., vol. 4, no. 5, pp. 824-833, Oct. 2010.
17. R. F. Astudillo and D. Kolossa, "Uncertainty propagation," in Robust Speech Recognition of Uncertain and Missing Data, D. Kolossa and R. Haeb-Umbach, Eds. New York, NY, USA: Springer Verlag, 2011, pp. 35-64.
18. J. A. Arrowood and M. A. Clements, "Using observation uncertainty in HMM decoding," in Proc. ICSLP, 2002, pp. 1561-1564.
19. L. Deng, J. Droppo, and A. Acero, "Dynamic compensation of HMM variances using the feature enhancement uncertainty computed from a parametric model of speech distortion," IEEE Trans. Speech Audio Process., vol. 13, no. 3, pp. 412-421, May 2005.
20. H. Liao and M. J. F. Gales, "Issues with uncertainty decoding for noise robust automatic speech recognition," Speech Commun., vol. 50, pp. 265-277, 2008.
21. D. Kolossa, A. Klimas, and R. Orglmeister, "Separation and robust recognition of noisy, convolutive speech mixtures using time-frequency masking and missing data techniques," in Proc. ASPAA, 2005.
22. A. H. Abdelaziz, S. Zeiler, D. Kolossa, V. Leutnant, and R. Haeb-Um-bach, "GMM-based significance decoding," in Proc. ICASSP, 2013, pp. 6827-6831.
23. M. J. F. Gales, "Maximum likelihood linear transformations for HMM-based speech recognition," Comput. Speech Lang., vol. 12, pp. 75-98, 1998.
24. G. Papandreou, A. Katsamanis, V. Pitsikalis, and P. Maragos, "Adaptive multimodal fusion by uncertainty compensation with application to audiovisual speech recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 3, pp. 423-435, Mar. 2009.
25. A. Ozerov, M. Lagrange, and E. Vincent, "Uncertainty-based learning of acoustic models from noisy data," Comput. Speech Lang., vol. 27, pp. 874-894, 2013.
26. A. Krueger and R. Haeb-Umbach, "MAP-based estimation of the parameters of non-stationary Gaussian processes from noisy observations," in Proc. ICASSP, 2011, pp. 3596-3599.
27. A. Chinaev and R. Haeb-Umbach, "MAP-based estimation of the parameters of a Gaussian mixture model in the presence of noisy observations," in Proc. ICASSP, 2013, pp. 3352-3356.
28. V. V. Digalakis, D. Rtischev, and L. G. Neumeyer, "Speaker adaptation using constrained estimation of Gaussian mixtures," IEEE Trans. Speech Audio Process., vol. 3, no. 5, pp. 357-366, Sep. 1995.
29. M. L. Seltzer and A. Acero, "Separating speaker and environmental variability using factored transforms," in Proc. Interspeech, 2011.
30. Y. Wang and M. J. F. Gales, "Speaker and noise factorization for robust speech recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 7, pp. 2149-2158, Sep. 2012.
31. D. K. Kim and M. J. F. Gales, "Noisy constrained maximum-likelihood linear regression for noise-robust speech recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 2, pp. 315-325, Feb. 2011.
32. D. Iskra, B. Grosskopf, K. Marasek, H. van den Heuvel, F. Diehl, and A. Kiessling, "SPEECON-speech databases for consumer devices: Database specification and validation," in Proc. LREC, 2002.
33. T. Hirsimäki, J. Pylkkönen, and M. Kurimo, "Importance of high-order n-gram models in morph-based speech recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 4, pp. 724-732, May 2009.
34. J. Pylkkönen and M. Kurimo, "Duration modeling techniques for continuous speech recognition," in Proc. Interspeech, 2004.
35. A. Willis, QPC-Quadratic Programming in C V2.0. 2010.
36. J. Kämäräinen and P. Paalanen, GMMBAYES-Bayesian classifier and Gaussian mixture model toolbox V1.0. 2005.
37. T. Kinnunen and P. Rajan, "A practical, self-adaptive voice activity detector for speaker verification with noisy telephone and microphone data," in Proc. ICASSP, 2013, pp. 7229-7231.
38. M. Cooke, "A glimpsing model of speech perception in noise," J. Acoust. Soc. Amer., vol. 119, pp. 1562-1573, 2006.
39. H. Kallasjoki, J. F. Gemmeke, and K. J. Palomäki, "Estimating uncertainty to improve exemplar-based feature enhancement for noise robust speech recognition," IEEE/ACM Trans. Audio, Speech, Lang. Process., vol. 22, no. 2, pp. 368-380, Feb. 2014.
40. S. Keronen, U. Remes, H. Kallasjoki, and K. Palomäki, "Noise robust missing data mask estimation based on automatically learned features," in Proc. CHIME, 2013.
41. H. Kallasjoki, J. F. Gemmeke, K. J. Palomäki, A. V. Beeston, and G. J. Brown, "Recognition of reverberant speech by missing data imputation and NMF feature enhancement," in Proc. REVERB, 2014.
42. V. Stouten, H. Van hamme, and P. Wambacq, "Accounting for the uncertainty of speech estimates in the context of model-based feature enhancement," in Proc. Interspeech, 2004.
43. M. Delcroix, T. Nakatani, and S. Watanabe, "Static and dynamic variance compensation for recognition of reverberant speech with derever-beration preprocessing," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 2, pp. 324-334, Feb. 2009.
44. D. T. Tran, E. Vincent, and D. Jouvet, "Extension of uncertainty propagation to dynamic MFCCs for noise robust ASR," in Proc. ICASSP, 2014, pp. 5507-5511.