A multistream feature framework based on bandpass modulation filtering for robust speech recognition

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 2, 2013, Pages 416-426

  Nemala, Sridhar Krishna ^a   Patil, Kailash ^a   Elhilali, Mounya ^a  

^a Johns Hopkins University   (United States)

Author keywords

Auditory cortex; automatic speech recognition (ASR); modulation; multistream; speech parameterization

Indexed keywords

AUDITORY CORTEX; AUTOMATIC SPEECH RECOGNITION; BAND PASS; BANDPASS OPERATION; CHANNEL DISTORTIONS; LOCALIZED FEATURES; MODULATION FILTERING; MULTI-STREAM; NONSTATIONARY NOISE; PARALLEL PATH; PARALLEL STREAMS; PHONEME RECOGNITION; PROPOSED ARCHITECTURES; ROBUST SPEECH RECOGNITION; SIGNAL DYNAMICS; SPECTRAL MODULATION; SPEECH SIGNALS; SPEECH SOUNDS; TEMPORAL DIMENSIONS;

SPEECH PROCESSING; SPEECH RECOGNITION;

MODULATION;

EID: 84871829474     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2219526     Document Type: Article

References (50)

1. S. Greenberg, A. Popper, andW. Ainsworth, Speech Processing in the Auditory System. Berlin, Germany: Springer, 2004.
2. H. Hermansky, "Should recognizers have ears?, " Speech Commun. , vol. 25, pp. 3-27, 1998. (Pubitemid 128413632)
3. S. Boll, "Suppression of acoustic noise in speech using spectral subtraction, " IEEE Trans. Acoustic, Speech, Signal Process. , vol. ASSP-27, no. 2, pp. 113-120, Apr. 1979. (Pubitemid 9467471)
4. S. Furui, "Cepstral analysis technique for automatic speaker verification, " IEEE Trans. Acoust. , Speech, Signal Process. , vol. 29, no. 2, pp. 254-272, Apr. 1981. (Pubitemid 11495877)
5. G. Cook, D. Kershaw, J. Christie, C. Seymour, and S. Waterhouse, "Transcription of broadcast television and radio news: The 1996 abbot system, " Proc. Int. Acoustics Speech Signal Process. , pp. 723-726, 1997.
6. C. Chen and J. Bilmes, "Mva processing of speech features, " IEEE Trans. Audio, Speech, Lang. Process. , vol. 15, no. 1, pp. 257-270, Jan. 2007.
7. ETSI ES 202 050 v1. 1. 1 STQ; Distributed Speech Recognition; Advanced Front-End Feature Extraction Algorithm; Compression Algorithms, ETSI ES 202 050 v1. 1. 1 STQ, ETSI, 2002.
8. P. Loizou, Speech Enhancement: Theory and Practice, 1st ed. Boca Raton, FL: CRC, 2007.
9. S. Sharma, "Multi-stream approach to robust speech recognition, " Ph. D. dissertation, Oregon Graduate Inst. of Sci. Technol. , Portland, OR, 1999.
10. A. Hagen, "Robust speech recognition based on multi-stream processing, " Ph. D. dissertation, Lab. Intell. Artif. Perceptive, cole Polytechnique Fdrale, Lausanne, Switzerland, 2001.
11. F. Valente, "Multi-stream speech recognition based onDempster-Shafer combination rule, " Speech Commun. , vol. 52, no. 3, pp. 213-222, 2010.
12. S. Y. Zhao, R. S. , and M. N. , "Multi-stream to many-stream: Using spectro-temporal features for ASR, " in Proc. INTERSPEECH, 2009, pp. 2951-2954.
13. N. Mesgarani, S. Thomas, and H. Hermansky, "A multistream multiresolution framework for phoneme recognition, " in Proc. INTERSPEECH, 2010, pp. 318-321.
14. A. Morris, A. Hagen, H. Glotin, and H. Bourlard, "Multi-stream adaptive evidence combination for noise robust ASR, " Speech Commun. , vol. 34, pp. 25-40, 2001. (Pubitemid 32874681)
15. J. Woojay and B. Juang, "Speech analysis in a model of the central auditory system, " IEEE Trans. Speech Audio Process. , vol. 15, no. 6, pp. 1802-1817, Aug. 2007.
16. M. Kleinschmidt, "Spectro-temporal gabor features as a front end for automatic speech recognition, " in Forum Acusticum, 2002.
17. B. Meyer, S. Ravuri, M. Schädler, and N. Morgan, "Comparing different flavors of spectro-temporal features for ASR, " Proc. INTERSPEECH, vol. 1, pp. 1269-1272, 2011.
18. H. Lei, B. Meyer, and N. Mirghafori, "Spectro-temporal gabor features for speaker recognition, " in Proc. IEEE Conf. Acoust. , Speech, Signal Process. , 2012, pp. 4241-4244.
19. S. Nemala, K. Patil, and M. Elhilali, "Multistream bandpass modulation features for robust speech recognition, " in Proc. ISCA, 2011, pp. 1277-1280.
20. X. Yang, K. Wang, and S. A. Shamma, "Auditory representations of acoustic signals, " IEEE Trans. Inf. Theory, vol. 38, no. 2, pp. 824-839, Mar. 1992.
21. T. Chi, P. Ru, and S. Shamma, "Multiresolution spectrotemporal analysis of complex sounds, " J. Acoust. Soc. Amer. , vol. 118, pp. 887-906, 2005. (Pubitemid 41129224)
22. G. Hickock and D. Poeppel, "The cortical organization of speech processing, " Nature Neurosc. Reviews, vol. 8, pp. 393-402, 2007. (Pubitemid 46652465)
23. J. P. Rauschecker, "Cortical processing of complex sounds, " Curr. Opin. Neurobiol. , vol. 8, pp. 516-521, 1998. (Pubitemid 28431742)
24. N. F. Viemeister, "Temporal modulation transfer functions based upon modulation thresholds, " J Acoust Soc Amer. , vol. 66, no. 5, pp. 1364-1380, Nov. 1979. (Pubitemid 10098323)
25. D. Green, Auditory Frequency Selectivity. Cambridge, MA: Plenum, 1986, ch. Frequency and the detection of spectral shape change, pp. 351-359.
26. T. Chi, Y. Gao, M. C. Guyton, P. Ru, and S. A. Shamma, "Spectrotemporal modulation transfer functions and speech intelligibility, " J. Acoust. Soc. Amer. , vol. 106, pp. 2719-2732, 1999.
27. R. Drullman, J. Festen, and R. Plomp, "Effect of temporal envelope smearing on speech reception, " J. Acoust. Soc. Amer. , vol. 95, pp. 1053-1064, 1994. (Pubitemid 24056370)
28. M. Elhilali, T. Chi, and S. A. Shamma, "A spectro-temporal modulation index (STMI) for assessment of speech intelligibility, " Speech Commun. , vol. 41, pp. 331-348, 2003.
29. F.-G. Zeng, K. Nie, G. S. Stickney, Y.-Y. Kong, M. Vongphoe, A. Bhargave, C. Wei, and K. Cao, "Speech recognition with amplitude and frequency modulations, " Proc. National Acad. Sci. , USA, vol. 102, no. 7, pp. 2293-2298, Feb. 2005. (Pubitemid 40279369)
30. T. Elliott and F. Theunissen, "The modulation transfer function for speech intelligibility, " PLoS Comput. Biol. , vol. 5, p. e1000302, 2009.
31. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, D. S. Pallett, and N. L. Dahlgren, DARPA TIMIT Acoustic Phonetic Continuous Speech Corpus. Philadelphia, PA: Linguistic Data Consortium, 1993, p. LDC93S1.
32. H. Bourlard and N. Morgan, Connectionist Speech Recognition: A Hybrid Approach. Dordrecht, The Netherlands: Kluwer, 1994, p. 348.
33. K. F. Lee and H. W. Hon, "Speaker-independent phone recognition using hidden Markov models, " IEEE Trans. Acoust. , Speech, Signal Process. , vol. 37, no. 11, pp. 1641-1648, Nov. 1989.
34. S. Garimella, S. Nemala, N. Mesgarani, and H. Hermansky, "Datadriven and feedback based spectro-temporal features for speech recognition, " IEEE Signal Process. Lett. , vol. 17, no. 11, pp. 957-960, Nov. 2010.
35. P. Pujol, S. Pol, C. Nadeu, A. Hagen, and H. Bourlard, "Comparison and combination of features in a hybridHMM/MLP and aHMM/GMM speech recognition system, " IEEE Trans. Speech Audio Process. , vol. 13, no. 1, pp. 14-22, Jan. 2005. (Pubitemid 40049936)
36. M. Richard and R. Lippmann, "Neural network classifiers estimate Bayesian a posteriori probabilities, " Neural Computation, vol. 3, no. 4, pp. 461-483, 1991.
37. J. Pinto, S. Garimella, M. Magimai.-Doss, H. Hermansky, and H. Bourlard, "Analyzing MLP. Based Hierarchical Phoneme posterior probability estimator, " IEEE Trans. Speech and Audio Process. , vol. 19, pp. 225-241, 2011.
38. D. Gelbart, "Ensemble feature selection for multi-stream automatic speech recognition, " Ph. D. dissertation, UC Berkeley, Berkeley, CA, 2008.
39. A. Varga, H. Steeneken, M. Tomlinson, and D. Jones, The Noisex-92 study on the effect of additive noise on automatic speech recognition Speech Research Unit, Defense Research Agency, Malvern, U. K. , 1992, Tech. Rep. .
40. H. Hirsch, FaNT: Filtering andNoiseAdding Tool. [Online]. Available: http://dnt. kr. hsnr. de/download. html (date last viewed 11/25/2011), 2005
41. D. Gelbart and N. Morgan, "Evaluating long-term spectral subtraction for reverberant ASR, " in Proc. IEEE Workshop Autom. Speech Recognit. Understanding (ASRU), 2001, pp. 103-106.
42. D. Reynolds, HTIMIT. Philadelphia, PA: Linguistic Data Consortium, 1998, p. LDC98S67.
43. Readings in Speech Recognition, A. Waibel and K. Lee, Eds. Burlington, MA: Morgan Kaufmann, 1990, p. 680.
44. H. Hermansky and N. Morgan, "RASTA processing of speech, " IEEE Trans. Speech Audio Process. , vol. 2, no. 4, pp. 382-395, Oct. 1994.
45. S. Ganapathy, S. Thomas, and H. Hermansky, "Temporal envelope compensation for robust phoneme recognition using modulation spectrum, " J. Acoust. Soc. Amer. , vol. 128, pp. 3769-3780, 2010.
46. M. K. Qin and A. J. Oxenham, "Effects of simulated cochlear-implant processing on speech reception in fluctuating maskers, " J. Acoust. Soc. Amer. , vol. 114, no. 1, pp. 446-454, Jul. 2003. (Pubitemid 36835514)
47. M. Chait, S. Greenberg, T. Arai, J. Simon, and D. Poeppel, "Two time scales in speech processing, " in Proc. Annu. Meeting Cognitive Neurosci. Soc. , New York, 2005.
48. N. Mesgarani, S. Thomas, and H. Hermansky, "Toward optimizing stream fusion in multistream recognition of speech, " J. Acoust. Soc. Amer. , vol. 130, pp. 14-18, 2011.
49. M. Carlin, K. Patil, S. Nemala, and M. Elhilali, "Robust phoneme recognition based on biomimetic speech contours, " in Proc. 13th Annu. Conf. Int. Speech Commun. Assoc. (INTERSPEECH, 2012.
50. H. Hermansky, D. P. Ellis, and S. Sharma, "Tandem connectionist feature extraction for conventional HMM systems, " in Proc. IEEE Int. Conf. Acoust. , Speech, Signal Process. , 2000, pp. 1635-1638.