Transforming binary uncertainties for robust speech recognition

IEEE Transactions on Audio, Speech and Language Processing

Volumn 15, Issue 7, 2007, Pages 2130-2140

  Srinivasan, Soundararajan ^a,b   Wang, Deliang ^c  

^a OHIO STATE UNIVERSITY   (United States)

^b ROBERT BOSCH GMBH   (Germany)

^c Ohio State University   (United States)

Author keywords

Binary time x2013; frequency mask; Computational auditory scene analysis (CASA); Robust automatic speech recognition; Spectrogram reconstruction; Uncertainty decoding

Indexed keywords

BASE-LINE PERFORMANCE; BINARY MASKS; CEPSTRAL; CEPSTRAL DOMAINS; CEPSTRAL FEATURES; COMPUTATIONAL AUDITORY SCENE ANALYSIS (CASA); LINEAR SPECTRAL; NOISE CONDITIONS; NOISE ENERGIES; NOISY SPEECH; NOISY SPEECH SIGNALS; NON-LINEAR TRANSFORMATIONS; REGRESSION TREES; ROBUST AUTOMATIC SPEECH RECOGNITION; ROBUST SPEECH RECOGNITION; SPECTROGRAM RECONSTRUCTION; SYSTEMATIC EVALUATIONS; TIME FREQUENCIES; UNCERTAINTY DECODING;

DECODING; IMAGE SENSORS; PATIENT REHABILITATION; RESTORATION; SPECTROGRAPHS; SPEECH ANALYSIS; STRAIN MEASUREMENT; UNCERTAINTY ANALYSIS;

SPEECH RECOGNITION;

EID: 56249136428     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2007.901836     Document Type: Article

References (55)

1. S. Araki, S. Makino, H. Sawada, and R. Mukai, "Underdetermined blind separation of convolutive mixtures of speech with directivity pattern based mask and ica," in Proc. 5th Int. Conf. Independent Compon. Anal., 2004, pp. 898-905.
2. J. A. Arrowood and M. A. Clements, "Using observation uncertainty in HMM decoding," in Proc. Int. Conf. Spoken Lang. Process., 2002, pp. 1561-1564.
3. J. P. Barker, M. P. Cooke, and D. P. W. Ellis, "Decoding speech in the presence of other sources," Speech Commun., vol. 45, pp. 5-25, 2005.
4. M. C. Benitez, J. C. Segura, A. D. Torre, J. Ramirez, and A. Rubio, "Including uncertainty of speech observations in robust speech recognition," in Proc. Int. Conf. Spoken Lang. Process., 2004, pp. 137-140.
5. P. Boersma and D. Weenink, "Praat: Doing Phonetics by Computer, Version 4.0.26," 2002. [Online]. Available: http://www.fon.hum.uva.nl/praat
6. S. F. Boll, "Suppression of acoustic noise in speech using spectral subtraction," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-27, no. 2, pp. 113-120, Apr. 1979.
7. L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone, Classification and Regression Trees. New York: Chapman & Hall, 1984.
8. C. Breithaupt and R. Martin, "Statistical analysis and performance of DFT domain noise reduction filters for robust speech recognition," in Proc. Interspeech'06, 2006, pp. 365-368.
9. D. S. Brungart, P. S. Chang, B. D. Simpson, and D. L. Wang, "Isolating the energetic component of speech-on-speech masking with ideal time-frequency segregation," J. Acoust. Soc. Amer., vol. 120, pp. 4007-4018, 2006.
10. quot;The CMU Pronouncing Dictionary," Carnegie Mellon University, Pittsburgh, PA [Online]. Available: http://www.speech.cs.cmu.edu/cgi-bin/cmudict
11. P. S. Chang, "Exploration of behavioral, physiological, and computational approaches to auditory scene analysis," Master's thesis, Dept. Compu. Sci. Eng., The Ohio State Univ., Columbus, 2004.
12. M. Cooke, P. Green, L. Josifovski, and A. Vizinho, "Robust automatic speech recognition with missing and unreliable acoustic data," Speech Commun., vol. 34, pp. 267-285, 2001.
13. S. B. Davis and P. Mermelstein, "Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-28, no. 4, pp. 357-366, Aug. 1980.
14. L. Deng, A. Acero, M. Plumpe, and X. Huang, "Large-vocabulary speech recognition under adverse acoustic environments," in Proc. Int. Conf. Spoken Lang. Process., 2000, pp. 806-809.
15. L. Deng, J. Droppo, and A. Acero, "Dynamic compensation of HMM variances using the feature enhancement uncertainty computed from a parametric model of speech distortion," IEEE Trans. Speech Audio Process., vol. 13, no. 3, pp. 412-421, May 2005.
16. Y. Ephraim and M. Rahim, "On second-order statistics and linear estimation of cepstral coefficients," IEEE Trans. Speech Audio Process., vol. 7, no. 2, pp. 162-176, Mar. 1999.
17. M. J. F. Gales and S. J. Young, "Robust continuous speech recognition using parallel model combination," IEEE Trans. Speech Audio Process., vol. 4, no. 5, pp. 352-359, Sep. 1996.
18. Z. Ghahramani and M. I. Jordan, "Supervised learning from incomplete data via an EM approach," in Advances in Neural Information Processing Systems 6, J. D. Cowan, G. Tesauro, and J. Alspector, Eds. San Francisco, CA: Morgan Kaufmann, 1993, pp. 120-127.
19. G. Hu and D. L. Wang, "Monaural speech segregation based on pitch tracking and amplitude modulation," IEEE Trans. Neural Netw., vol. 15, no. 5, pp. 1135-1150, Sep. 2004.
20. X. Huang, A. Acero, and H. Hon, Spoken Lang. Process.. Upper Saddle River, NJ: Prentice-Hall, 2001.
21. V. Ion and R. Haeb-Umbach, "Improved source modeling and predictive classification for channel robust speech recognition," in Proc. Interspeech, 2006, pp. 633-636.
22. Int. Telecomm. Union (ITU-T), "Transmission characteristics for wideband (150-7000 Hz) digital hands-free telephony terminals," Recommendation P.341, 2005, .
23. D. Kolossa, A. Klimas, and R. Orglmeister, "Separation and robust recognition of noisy, convolutive speech mixtures using time-frequency masking and missing-data techniques," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., 2005, pp. 82-85.
24. R. G. Leonard, "A database for speaker-independent digit recognition," in Proc. ICASSP'84, 1984, pp. 111-114.
25. H. Liao and M. J. F. Gales, "Joint uncertainty decoding for noise robust speech recognition," in Proc. Interspeech'05, 2005, pp. 3129-3132.
26. H. Liao and M. J. F. Gales, "Issues with uncertainty decoding for noise robust speech recognition," in Proc. Interspeech'06, 2006, pp. 1121-1124.
27. R. Martin, "Statistical methods for the enhancement of noisy speech," in Speech Enhancement, J. Benesty, S.Makino, and J. Chen, Eds. NY: Springer, 2005, ch. 3, pp. 43-65.
28. G. J. McLachlan and K. E. Basford, Mixture Models: Inference and Applications to Clustering. New York: Marcel Dekker, 1988.
29. N. Merhav and C. H. Lee, "A minimax classification approach with application to robust speech recognition," IEEE Trans. Speech Audio Process., vol. 1, no. 1, pp. 90-193, Jan. 1993.
30. P. J. Moreno, B. Raj, and R. M. Stern, "A vector Taylor series approach for environment-independent speech recognition," in Proc. ICASSP'96, 1996, vol. 2, pp. 733-736.
31. K. J. Palomaki, G. J. Brown, and D. L. Wang, "A binaural processor for missing data speech recognition in the presence of noise and smallroom reverberation," Speech Commun., vol. 43, pp. 361-378, 2004.
32. N. Parihar and J. Picone, "DSR front end LVCSR evaluation," AuroraWorking Group, Eur. Telecomm. Standards Inst., Sophia-Antipolis Cedex, France, 2002.
33. N. Parihar and J. Picone, "Analysis of the aurora large vocabulary evalutions," in Proc. Eurospeech'03, 2003, pp. 337-340.
34. D. Paul and J. Baker, "The design of wall street journal-based CSR corpus," in Proc. Int. Conf. Spoken Lang. Process., 1992, pp. 899-902.
35. M. S. Pedersen, D. L. Wang, J. Larsen, and U. Kjems, "Separating underdetermined convolutive speech mixtures," in Proc. 6th Int. Conf. Independent Compon. Anal. Blind Source Separation, 2006, pp. 674-681.
36. J. C. Principe, N. R. Euliano, and W. C. Lefebvre, Neural and Adaptive Systems. New York: Wiley, 2000.
37. B. Raj, M. L. Seltzer, and R. M. Stern, "Reconstruction of missing features for robust speech recognition," Speech Commun., vol. 43, pp. 275-296, 2004.
38. P. Renevey and A. Drygajlo, "Detection of reliable features for speech recognition in noisy conditions using a statistical criterion," in Proc. Consist. Rel. Acoust. Cues Sound Anal. Workshop, 2001, pp. 71-74.
39. N. Roman, D. L. Wang, and G. J. Brown, "Speech segregation based on sound localization," J. Acoust. Soc. Amer., vol. 114, pp. 2236-2252, 2003.
40. S. T. Roweis, "Factorial models and refiltering for speech separation and denoising," in Proc. Eurospeech'03, 2003, pp. 1009-1012.
41. S. J. Russell and P. Norvig, Artificial Intelligence: AModern Approach, 2nd ed. Upper Saddle River, NJ: Prentice-Hall, 2003.
42. M. L. Seltzer, J. Droppo, and A. Acero, "A harmonic-model-based front end for robust speech recognition," in Proc. Eurospeech'03, 2003, pp. 1277-1280.
43. M. L. Shire, "Discriminant training of front-end and acoustic modeling stages to heterogeneous acoustic environments for multi-stream automatic speech recognition," Ph.D. dissertation, Univ. California, Berkeley, 2000.
44. S. Srinivasan, N. Roman, and D. L. Wang, "Binary and ratio time-frequency masks for robust speech recognition," Speech Commun., vol. 48, no. 11, pp. 1486-1501, 2006.
45. S. Srinivasan and D. L. Wang, "A supervised learning approach to uncertainty decoding for robust speech recognition," in Proc. ICASSP'06, 2006, vol. I, pp. 297-300.
46. V. Stouten, H. V. Hamme, and P.Wambacq, "Model-based feature enhancement with uncertainty decoding for noise robust ASR," Speech Commun., vol. 48, no. 11, pp. 1502-1514, 2006.
47. A. P. Varga and R. K. Moore, "Hidden Markov model decomposition of speech and noise," in Proc. ICASSP'90, 1990, pp. 845-848.
48. A. P. Varga, H. J. M. Steeneken, M. Tomlinson, and D. Jones, "The NOISEX-92 study on the effect of additive noise on automatic speech recogonition," Speech Res. Unit, Def. Res. Agency, Malvern, U.K., 1992.
49. D. L. Wang, "On ideal binary mask as the computational goal of auditory scene analysis," in Speech Separation by Humans and Machines, P. Divenyi, Ed. Norwell, MA: Kluwer, 2005, pp. 181-197.
50. C. K. I. Williams, "How to pretend that correlated variables are independent by using difference observations," Neural Comput., vol. 17, pp. 1-6, 2005.
51. D.Williams, X. Liao, Y. Xue, and L. Carin, L. D. Raedt and S. Wrobel, Eds., "Incomplete-data classification using logistic regression," in Proc. 22nd Int. Mach. Learning Conf., 2005, pp. 972-979.
52. H. Xu, L. Rigazio, and D. Kryze, "Vector Taylor series based joint uncertainty decoding," in Proc. Interspeech'06, 2006, pp. 1125-1128.
53. C. Yang, F. K. Soong, and T. Lee, "Static and dynamic spectral features: Their noise robustness and optimal weights," in Proc. ICASSP'05, 2005, vol. I, pp. 241-244.
54. O. Yilmaz and S. Rickard, "Blind separation of speech mixtures via time-frequency masking," IEEE Trans. Signal Process., vol. 52, pp. 1830-1847, 2004.
55. S. Young, D. Kershaw, J. Odell, V. Valtchev, and P. Woodland, The HTK Book (for HTK Version 3.0). Redmond, WA: Microsoft Corp., 2000.