Combining speech fragment decoding and adaptive noise floor modeling

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 3, 2012, Pages 818-827

  Ma, Ning ^a   Barker, Jon ^a   Christensen, Heidi ^a   Green, Phil ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Adaptive noise floor modeling; fragment decoding; missing data decoding; noise robust speech recognition

Indexed keywords

ACOUSTIC EVENTS; ADAPTIVE NOISE; DECODING SYSTEM; HIGH ENERGY; HIGH ENERGY REGIONS; MISSING DATA; MODEL ESTIMATES; NOISE FLOOR; NOISE MODELING; NOISE MODELS; NOISE ROBUST SPEECH RECOGNITION; NOISE-ROBUST AUTOMATIC SPEECH RECOGNITION; SOURCE SEPARATION; TARGET SPEECH;

ACOUSTIC NOISE; DECODING; FLOORS; HIGH ENERGY PHYSICS; SPEECH COMMUNICATION; SPURIOUS SIGNAL NOISE;

SPEECH RECOGNITION;

EID: 84856140165     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2011.2165945     Document Type: Article

References (42)

1. J. M. Baker, L. Deng, J. Glass, S. Khudanpur, C. -H. Lee, N. Morgan, and D. O'Shaughnessy, "Research developments and directions in speech recognition and understanding, Part 1, " IEEE Signal Process. Mag. , vol. 26, no. 3, pp. 75-80, May 2009.
2. P. Lockwood and J. Boudy, "Experiments with nonlinear spectral subtractor (NSS), hidden Markov models and the projection for robust speech recognition in cars, " Speech Commun. , vol. 11, pp. 215-228, 1992. (Pubitemid 23572493)
3. R. Martin, "Noise power spectral density estimation based on optimal smoothing and minimum statistics, " IEEE Trans. Speech. Audio Process. , vol. 9, no. 5, pp. 504-512, Jul. 2001. (Pubitemid 32631178)
4. M. Cooke, P. Green, L. Josifovski, and A. Vizinho, "Robust automatic speech recognition with missing and uncertain acoustic data, " Speech Commun. , vol. 34, pp. 267-285, 2001. (Pubitemid 32284867)
5. M. Seltzer, B. Raj, and R. Stern, "A Bayesian classifier for spectrographic mask estimation for missing feature speech recognition, " Speech Commun. , vol. 43, pp. 379-393, 2004.
6. J. Barker, M. Cooke, and D. Ellis, "Decoding speech in the presence of other sources, " Speech Commun. , vol. 45, pp. 5-25, 2005. (Pubitemid 40034706)
7. J. Droppo, L. Deng, and A. Acero, "Uncertainty decoding with splice for noise robust speech recognition, " in Proc. IEEE Int. Conf. Acoust. , Speech, Signal Process. , 2002, pp. 57-60.
8. L. Deng, J. Droppo, and A. Acero, "Dynamic compensation of HMM variances using the feature enhancement uncertainty computed from a parametric model of speech distortion, " IEEE Trans. Speech. Audio Process. , vol. 13, no. 3, pp. 412-421, May 2005. (Pubitemid 40666175)
9. H. Liao and M. Gales, "Issues with uncertainty decoding for noise robust automatic speech recognition, " Speech Commun. , vol. 50, pp. 265-277, 2008.
10. A. Varga and R. Moore, "Hidden Markov model decomposition of speech and noise, " in Proc. IEEE Int. Conf. Acoust. , Speech, Signal Process. , 1990, pp. 845-848.
11. M. Gales and S. Young, "HMM recognition in noise using parallel model combination, " in Proc. Eurospeech, Berlin, 1993.
12. B. Frey, L. Deng, A. Acero, and T. Kristjansson, "ALGONQUIN: Iterating Laplace's method to remove multiple types of distortion for robust speech recognition, " in Proc. Eurospeech, Aalborg, Denmark, 2001, pp. 901-904.
13. J. R. Hershey, S. J. Rennie, and P. A. Olsen, "Super-human multi-talker speech recognition: A graphical modeling approach, " Comput. Speech. Lang. , vol. 24, pp. 45-66, 2010.
14. S. J. Rennie, J. R. Hershey, and P. A. Olsen, "Single-channel multitalker speech recognition, " IEEE Signal Process. Mag. , vol. 27, pp. 66-80, 2010.
15. M. Cooke, J. Hershey, and S. Rennie, "Monaural speech separation and recognition challenge, " Comput. Speech. Lang. , vol. 24, pp. 1-15, 2010.
16. T. Virtanen, "Monaural sound source separation by nonnegative matrix factorization with temporal continuity and sparseness criteria, " IEEE Trans. Audio. Speech. , vol. 15, no. 3, pp. 1066-1074, Mar. 2007.
17. M. N. Schmidt and R. K. Olsson, "Single-channel speech separation using sparse non-negative matrix factorization, " in Proc. Interspeech, Pittsburgh, PA, 2006, pp. 2614-2617.
18. M. Seltzer, B. Raj, and R. Stern, "Likelihood-maximizing beamforming for robust hands-free speech recognition, " IEEE Trans. Speech. Audio Process. , vol. 12, no. 5, pp. 489-498, Sep. 2004.
19. R. Takeda, S. Yamamoto, K. Komatani, T. Ogata, and H. Okuno, "Missing-feature based speech recognition for two simultaneous speech signals separated by ICA with a pair of humanoid ears, " in IEEE/RSJ Int. Conf. Intell. Robots Syst. , 2006, pp. 878-885. (Pubitemid 46927954)
20. H. Christensen, J. Barker, N. Ma, and P. Green, "The CHiME corpus: A resource and a challenge for Computational Hearing in Multisource Environments, " in Proc. Interspeech, 2010.
21. S. Greenberg, W. Ainsworth and S. Greenberg, Eds. , "Understanding speech understanding: Towards a unified theory of speech perception, " in Proc. ESCA Workshop Auditory Basis Speech Percept. , U. K. , 1996, pp. 1-8.
22. M. Slaney and R. Lyon, "On the importance of time - A temporal representation of sound, " in Visual Representations of Speech Signals, M. Cooke, S. Beet, and M. Crawford, Eds. Sussex, U. K. : Wiley, 1993, pp. 95-116.
23. B. C. J. Moore, "Temporal integration and context effects in hearing, " in J. Phonetics, 2003, vol. 31, pp. 563-574. (Pubitemid 37495928)
24. H. Fletcher, Speech and Hearing in Communication. New York: Van Nostrand, 1953.
25. R. Warren, K. Riener, J. Bashford, and B. Brubaker, "Spectral redundancy: Intelligibility of sentences heard through narrow spectral slits, " Percept. Psychophys. , vol. 57, pp. 175-182, 1995.
26. K. Kasturi, P. C. Loizou, M. Dorman, and T. Spahr, "The intelligibility of speech with "holes" in the spectrum, " J. Acoust. Soc. Amer. , vol. 112, pp. 1102-1111, 2002.
27. M. Cooke, "A glimpsing model of speech perception in noise, " J. Acoust. Soc. Amer. , vol. 119, pp. 1562-1573, 2006. (Pubitemid 43326025)
28. B. Raj, M. Seltzer, and R. Stern, "Reconstruction of missing features for robust speech recognition, " Speech Commun. , vol. 43, pp. 275-296, 2004.
29. J. Barker, L. Josifovski, M. Cooke, and P. Green, "Soft decisions in missing data techniques for robust automatic speech recognition, " in Proc. ICSLP, Beijing, China, 2000, pp. 373-376.
30. P. Renevey and A. Drygajlo, "Detection of reliable features for speech recognition in noisy conditions using a statistical criterion, " in Proc. CRAC, Aalborg, Denmark, 2001.
31. C. Cerisara, S. Demange, and J. Haton, "On noise masking for automatic missing data speech recognition: A survey and discussion, " Comput. Speech. Lang. , vol. 21, pp. 443-457, 2007. (Pubitemid 46367508)
32. I. Cohen, "Noise spectrum estimation in adverse environments: Improved minima controlled recursive averaging, " IEEE Trans. Speech. Audio Process. , vol. 11, no. 5, pp. 466-475, Sep. 2003.
33. S. Rangachari and P. C. Loizou, "A noise-estimation algorithm for highly non-stationary environments, " Speech Commun. , vol. 48, pp. 220-231, 2006. (Pubitemid 43012033)
34. C. Stauffer and W. Grimson, "Learning patterns of activity using realtime tracking, " IEEE Trans. Pattern Anal. Mach. Intell. , vol. 22, no. 8, pp. 747-757, Aug. 2000.
35. B. Glasberg and B. Moore, "Derivation of auditory filter shapes from notched-noise data, " Hearing Res. , vol. 47, pp. 103-138, 1990. (Pubitemid 20244652)
36. N. Ma, P. Green, J. Barker, and A. Coy, "Exploiting correlogram structure for robust speech recognition with multiple speech sources, "Speech Commun. , vol. 49, pp. 874-891, 2007. (Pubitemid 47488511)
37. J. Barker, M. Cooke, and P. Green, "Robust ASR based on clean speech models: An evaluation of missing data techniques for connected digit recognition in noise, " in Proc. Eurospeech, Aalborg, Denmark, 2001, pp. 213-216.
38. J. Licklider, "A duplex theory of pitch perception, " Experientia, vol. 7, pp. 128-134, 1951.
39. M. Slaney and R. Lyon, "A perceptual pitch detector, " in Proc. IEEE Int. Conf. Acoust. , Speech, Signal Process. , Albequerque, NM, 1990, pp. 357-360.
40. M. Cooke, J. Barker, S. Cunningham, and X. Shao, "An audio-visual corpus for speech perception and automatic speech recognition, " J. Acoust. Soc. Amer. , vol. 120, pp. 2421-2424, 2006. (Pubitemid 44631681)
41. L. Gillick and S. Cox, "Some statistical issues in the comparison of speech recognition algorithms, " in Proc. IEEE Int. Conf. Acoust. , Speech, Signal Process. , 1989, pp. 532-535. (Pubitemid 20604171)
42. Z. Ghahramani and M. I. Jordan, "Factorial hidden Markov models, " Mach. Learn. , vol. 29, pp. 245-273, 1997. (Pubitemid 127510040)