Hearing is believing: Biologically inspired methods for robust automatic speech recognition

IEEE Signal Processing Magazine

Volumn 29, Issue 6, 2012, Pages 34-43

  Stern, Richard M ^a   Morgan, Nelson ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b INTERNATIONAL COMPUTER SCIENCE INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTICS; AUDIO SYSTEMS; AUDITION; DEEP NEURAL NETWORKS; FEATURE EXTRACTION;

AUDIO PROCESSING SYSTEMS; AUTOMATIC SPEECH RECOGNITION; BIOLOGICAL MECHANISMS; BIOLOGICALLY INSPIRED METHODS; FEATURE EXTRACTION METHODS; FUNCTIONAL PROPERTIES; ROBUST AUTOMATIC SPEECH RECOGNITION;

SPEECH RECOGNITION;

EID: 85032751341     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2012.2207989     Document Type: Article

References (59)

1. P. Aarabi and G. Shi "Phase-based dual-microphone robust speech enhancement," IEEE Trans. Syst., Man, Cybern., B, vol. 34, no. 4, pp. 1763-1773, 2004.
2. J. B. Allen, "How do humans process and recognize speech?," IEEE Trans. Speech Audio, vol. 2, no. 4, pp. 567-577, 1994.
3. M. Athineos and D. Ellis, "Frequency-domain linear prediction for temporal features," in Proc. IEEE ASRU Workshop, 2003, pp. 261-266.
4. T. Chi, P. Ru, and S. A. Shamma, "Multiresolution spectrotemporal analysis of complex sounds," J. Acoust. Soc. Amer., vol. 118, no. 2, pp. 887-906, 2005. (Pubitemid 41129224)
5. J. R. Cohen, "Application of an auditory model to speech recognition," J. Acoust. Soc. Amer., vol. 85, no. 6, pp. 2623-2629, 1989. (Pubitemid 19160389)
6. J. R. Cohen, T. Kamm, and A.G. Andreou, "Vocal track normalization in speech recognition: Compensating for systematic speaker variability," J. Acoust. Soc. Amer., vol. 97, no. 5, pp. 3246-3247, 1995.
7. S. Davis and P. Mermelstein, "Comparison of parametric representations of monosyllabic word recognition in continuously spoken sentences," IEEE Trans. Acoust. Speech Signal Processing, vol. 28, no. 4, pp. 357-366, 1980. (Pubitemid 11464930)
8. L. Deng and D. C. Geisler, "A composite auditory model for processing speech sounds," J. Acoust. Soc. Amer., vol. 82, no. 6, pp. 2001-2012, 1987.
9. D. A. Depireux, J. Z. Simon, D. J. Klein, and S. A. Shamma, "Spectro-temporal response field characterization with dynamic ripples in ferret primary auditory cortex," J. Neurophysiol., vol. 85, no. 3, pp. 1220-1234, 2001. (Pubitemid 32209608)
10. H. Fletcher, "Auditory patterns," Rev. Mod. Phys., vol. 12, no. 1, pp. 47-65, 1940.
11. H. Fletcher and W. A. Munson, "Loudness, its definition, measurement, and calculation," J. Acoust. Soc. Amer., vol. 5, no. 2, pp. 82-108, 1933.
12. N. R. French and J. C. Steinberg, "Factors governing the intelligibility of speech sounds," J. Acoust. Soc. Amer. vol. 19, no. 1, pp. 90-119, 1947.
13. S. Furui, "On the role of spectral transition for speech perception," J. Acoust. Soc. Amer., vol. 80, no. 4, pp. 1016-1025, 1986. (Pubitemid 16023317)
14. O. Ghitza, "Auditory nerve representation as a front-end for speech recognition in a noisy environment," Comput. Speech Lang., vol. 1, no. 2, pp. 109-130, 1986.
15. M. Glenn, S. Strassel, H. Lee, K. Maeda, R. Zakhary, and X. Li, "Transcription methods for consistency, volume and efficiency," in Proc. LREC 2010, Valletta, Malta.
16. H. Hermansky, "Perceptual linear predictive (PLP) analysis of speech," J. Acoust. Soc. Amer., vol. 87, no. 4, pp. 1738-1752, 1990. (Pubitemid 20256470)
17. H. Hermansky, D. Ellis, and S. Sharma, "Tandem connectionist feature extraction for conventional HMM systems," in Proc. IEEE ICASSP, Istanbul, Turkey, 2000, pp. 1635-1638.
18. H. Hermansky and N. Morgan, "RASTA processing of speech," IEEE Trans. Speech Audio Processing, vol. 2, no. 4, pp. 578-589, 1994.
19. H. Hermansky and S. Sharma, "Temporal patterns (TRAPS) in ASR of noisy speech," in Proc. IEEE ICASSP, Phoenix, AZ, 1999, pp. 1255-1258.
20. H. Hermansky, S. Tibrewala, and M. Pavel, "Towards ASR on partially corrupted speech," in Proc. ICSLP, Philadelphia, PA, 1996, vol. 1, pp. 462-465.
21. L. A. Jeffress, "A place theory of sound localization," J. Comp. Physiol. Psychol., vol. 41, no. 1, pp. 35-39, 1948.
22. P. X. Joris, C. E. Schreiner, and A. Rees, "Neural processing of amplitude-modulated sounds," Physiol. Rev., vol. 84, no. 2, pp. 541-577, 2004. (Pubitemid 38365492)
23. C. Kim and R. M. Stern, "Nonlinear enhancement of onset for robust speech recognition," in Proc. Interspeech, Makuhari, Japan, 2010.
24. C. Kim, R. M. Stern, K. Eom, and J. Lee, "Automatic selection of thresholds for signal separation algorithms based on interaural delay," in Proc Interspeech, Makuhari, Japan, 2010.
25. C. Kim and R. M. Stern, "Power-normalized cepstral coefficients (PNCC) for robust speech recognition," IEEE Trans. Audio, Speech, Lang. Processing, to be published.
26. D. Kim, S. Lee, and R. M. Kil, "Auditory processing of speech signals for robust speech recognition in real world noisy environments," IEEE Trans. Speech Audio Processing, vol. 7, no. 1, pp. 55-69, 1999.
27. B. Kingsbury, "Perceptually-inspired signal processing strategies for robust speech recognition in reverberant environments," Ph.D. dissertation, Univ. California, Berkeley, Dec. 1998.
28. M. Kleinschmidt, "Localized spectro-temporal features for automatic speech recognition," in Proc. Eurospeech, 2003, pp. 2573-2576.
29. J. C. R. Licklider, "A duplex theory of pitch perception," Experientia, vol. 7, no. 4, pp. 128-134, 1951.
30. X. Lu, M. Unoki , and S. Nakamura. "Subband temporal modulation spectrum normalization for automatic speech recognition in reverberant environments," in Proc. Interspeech 2009.
31. R. F. Lyon, "A computational model of filtering, detection and compression in the cochlea," in Proc. ICASSP, Paris, France, 1982, pp. 1282-1285.
32. R. F. Lyon, "A computational model of binaural localization and separation," in Proc. ICASSP, Boston, MA, 1983, pp. 1148-1151.
33. C. Ma, K.-K. J. Kuo, H. Soltau, X. Cui, U. Chaudhari, L. Mangu, and C.-H. Lee, "A comparative study on system combination schemes for LVCSR," in Proc. ICASSP 2010, Dallas, TX, pp. 4394-4397.
34. L. Mangu, E. Brill, and A. Stolcke, "Finding consensus in speech recognition; word error minimization and other applications of confusion networks," Comput. Speech Lang., vol. 14, no. 4, pp. 373-400, 2000.
35. K. D. Martin, "Echo suppression in a computational model of the precedence effect," in Proc. IEEE ASSP Workshop Applications of Signal Processing to Audio and Acoustics, 1997.
36. N. Mesgarani, M. Slaney, and S. Shamma. "Discrimination of speech from nonspeech based on multiscale spectro-temporal modulations," IEEE Trans. Audio, Speech, Lang. Processing, vol. 14, no. 3, pp. 920-929, 2006.
37. B. C. J. Moore, An Introduction to the Psychology of Hearing, 5th ed. London: Academic Press, 2003.
38. B. C. J. Moore and B. R. Glasberg, "Suggested formulae for calculating auditory-filter bandwidths and excitation patterns," J. Acoust. Soc. Amer., vol. 74, no. 3, pp. 750-753, 1983. (Pubitemid 13019047)
39. N. Morgan, "Deep and wide: Multiple layers in automatic speech recognition," IEEE Trans. Audio, Speech, Lang. Processing (Special Issue on Deep Learning), vol. 20, no. 1, pp. 7-13, Jan. 2012.
40. Y. Ohshima and R. M. Stern, "Environmental robustness in automatic speech recognition using physiologically motivated signal processing," in Proc. ICSLP 1994, pp. 1619-1622.
41. R. P. Lippmann, "Speech recognition by machines and humans," Speech Commun., vol. 22, no. 1, pp. 1-15, 1997. (Pubitemid 127403436)
42. R. D. Patterson, K. Robinson, J. Holdsworth, D. McKeown, C. Zhang, and M. Allerhand, "Complex sounds and auditory images," in Auditory Physiology and Perception (Proc. 9th Int. Symp. Hearing), Y Cazals, L. Demany, and K. Horner, Eds. Oxford: Pergamon, 1992, 429-446.
43. K. L. Payton, "Vowel processing by a model of the auditory periphery: A comparison to eighth-nerve responses," J. Acoust. Soc. Amer., vol. 83, no. 1, pp. 145-162, 1988. (Pubitemid 18036631)
44. J. O. Pickles, An Introduction to the Physiology of Hearing, 3rd ed. New York: Academic Press, 2008.
45. S. Ravuri, "On the use of spectro-temporal features in noise-additive speech," M.S. thesis, Dept. Elect. Eng. Comput. Sciences, Univ. California, Berkeley, Spring 2011.
46. N. Roman, DeL. Wang, and G. J. Brown, "Speech segregation based on sound localization," J. Acoust. Soc. Amer., vol. 114, no. 4, pp. 2236-2252, 2003. (Pubitemid 37266649)
47. O. Scharenborg and M. Cooke, "Comparing human and machine recognition performance on a VCV corpus," in Proc. Workshop Speech Analysis and Processing for Knowledge Discovery, Aalborg, 2008.
48. M. R. Schroeder, "Recognition of complex acoustic signals," in Life Sciences Research Report 5, T. H. Bullock, Ed. Abakon Verlag, 1977.
49. S. Seneff, "A joint synchrony/mean-rate model of auditory speech processing," J. Phonet., vol. 15, no. 1, pp. 55-76, 1988.
50. H. Sheikhzadeh and L. Deng, "Speech analysis and recognition using interval statistics generated from a composite auditory model," IEEE Trans. Speech Audio Processing, vol. 6, no. 1, pp. 50-54, 1998.
51. R. M. Stern, G. J. Brown, and D. Wang, "Binaural sound localization," in Computational Auditory Scene Analysis, D. Wang and G. J. Brown, Eds. New York: IEEE Press, 2006, pp. 147-185.
52. R. M. Stern, E. Gouvêa, and G. Thattai, "'Polyaural' array processing for automatic speech recognition in degraded environments," in Proc. Interspeech 2007.
53. S. S. Stevens, "On the psychophysical law," Psychol. Rev., vol. 64, pp. 153-181, 1957.
54. S. S. Stevens, J. Volkman, and E. Newman, "A scale for the measurement of the psychological magnitude pitch," J. Acoust. Soc. Amer., vol. 8, no. 3, pp. 185-190, 1937.
55. J. Tchorz and B. Kollmeier, "A model of auditory perception as front end for automatic speech recognition," J. Acoust. Soc. Amer., vol. 106, no. 4, pp. 2040-2060, 1999.
56. T. Virtanen, R. Singh, and B. Raj, Eds., Noise Robust Techniques for Automatic Speech Recognition. Hoboken, NJ: Wiley, 2012.
57. X. Zhang, M. G. Heinz, I. C. Bruce, and L. H. Carney, "A phenomenological model for the response of auditory-nerve fibers: I. Nonlinear tuning with compression and suppression," J. Acoust. Soc. Amer., vol. 109, no. 2, pp. 648-670, 2001. (Pubitemid 32144001)
58. E. Zwicker, "Subdivision of the audible frequency range into critical bands (frequenzgruppen)," J. Acoustic. Soc. Amer., vol. 33, no. 248, , p. 248, 1961.
59. W. Lindemann, "Extension of a binaural cross-correlation model by contralateral inhibiltion: I Simulation of lateralizaton for stationary signals," J. Acoustic. Soc. Amer., vol. 80, no. 6, pp. 1608-1622.