A binaural processor for missing data speech recognition in the presence of noise and small-room reverberation

Speech Communication

Volumn 43, Issue 4 SPEC. ISS., 2004, Pages 361-378

  Palomäki, Kalle J ^a,b,c   Brown, Guy J ^a   Wang, DeLiang ^d  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b AALTO UNIVERSITY   (Finland)

^c UNIVERSITY OF HELSINKI   (Finland)

^d OHIO STATE UNIVERSITY   (United States)

Author keywords

Binaural model; Missing data; Precedence effect; Speech recognition

Indexed keywords

ACOUSTIC NOISE; COMPUTATIONAL METHODS; DECODING; MICROPHONES; REVERBERATION; SENSORY AIDS;

BINAURAL MODEL; MISSING DATA; PRECEDENCE EFFECT; SPEECH CHANNELS;

SPEECH RECOGNITION;

EID: 4644304197     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2004.03.005     Document Type: Article

References (54)

1. Allen, J.B., Berkley, D.A., 1979. Image method for efficiently simulating small-room acoustics. J. Acoust. Soc. Amer. 65 (4), 943-950.
2. Barker, J., Cooke, M.P., Ellis, D.P.W., 2000a. Decoding speech in the presence of other sound sources. Proc. ICSLP 4, 270-273.
3. Barker, J., Josifovski, L., Cooke, M.P., Green, P.D., 2000b. Soft decisions in missing data techniques for robust automatic speech recognition. Proc. ICSLP 1, 373-376.
4. Blauert, J., 1997. Spatial Hearing: The Psychophysics of Human Sound Localization (Revised Edition). MIT Press, Cambridge, MA.
5. Bodden, M., 1993. Modelling human sound-source localization and the cocktail-party-effect. Acta Acoust. 1, 43-55.
6. Bregman, A.S., 1990. Auditory Scene Analysis. MIT Press, Cambridge, MA.
7. Brown, G.J., Cooke, M.P., 1994. Computational auditory scene analysis. Comput. Speech Lang. 8, 297-336.
8. Brown, G.J., Wang, D.L., Barker, J., 2001. A neural oscillator sound separator for missing data speech recognition. Proc. IJCNN 4, 2907-2912.
9. Cohen, L., 1994. Time-Frequency Analysis: Theory and Applications. Prentice Hall, Englewood Cliffs, NJ.
10. Cooke, M.P., 1993. Modelling Auditory Processing and Organization. Cambridge University Press, Cambridge, UK.
11. Cooke, M.P., Green, P.D., Josifovski, L., Vizinho, A., 2001. Robust automatic speech recognition with missing and unreliable acoustic data. Speech Comm. 34 (3), 267-285.
12. Culling, J.F., Summerfield, Q., 1995. Perceptual separation of concurrent speech sounds: Absence of across-frequency grouping by common interaural delay. J. Acoust. Soc. Amer. 98 (2), 785-797.
13. Darwin, C.J., Carlyon, R.P., 1995. Auditory grouping. In: The Handbook of Perception and Cognition. In: Moore, B.C.J. (Ed.), Hearing, Vol. 6. Academic, London, pp. 387-424.
14. Darwin, C.J., Hukin, R.W., 1999. Auditory objects of attention: the role of interaural time differences. J. Exp. Psychol. Hum. Percept. Perform. 25 (3), 617-629.
15. Darwin, C.J., Hukin, R.W., 2000. Effects of reverberation on spatial, prosodic and vocal-tract size cues to selective attention. J. Acoust. Soc. Amer. 108 (1), 335-342.
16. Denbigh, P.N., Zhao, J., 1992. Pitch extraction and separation of overlapping speech. Speech Comm. 11, 119-125.
17. Gardner, B., Martin, K.D., 1994. HRTF measurements of a KEMAR dummy-head microphone. Technical Report #280, MIT Media Lab. Available from: http://web.media.mit.edu/~kdm/hrtf.html.
18. Glasberg, B.R., Moore, B.C.J., 1990. Derivation of auditory filter shapes from notched-noise data. Hear. Res. 47 (1-2), 103-138.
19. Glotin, H., Berthommier, F., Tessier, E., 1999. A CASA-labelling model using the localisation cue for robust cocktail-party speech recognition. In: Proc. EUROSPEECH, 1999, pp. 2351-2354.
20. Hall, D.E., 1991. Musical Acoustics, second ed. Pacific Brooks Cole Publishing, Grove, CA.
21. Hawley, M.L., Litovsky, R.Y., Colburn, H.S., 1999. Speech intelligibility and localization in a multi-source environment. J. Acoust. Soc. Amer. 105 (6), 3436-3448.
22. Hermansky, H., 1998. Should recognizers have ears?. Speech Comm. 25 (1-3), 3-27.
23. Hermansky, H., Morgan, N., 1994. RASTA processing of speech. IEEE Trans. Speech Audio Process. 2 (4), 578-589.
24. Huopaniemi, J., Savioja, L., Karjalainen, M., 1997. Modeling of reflections and air absorption in acoustical spaces: a digital filter design approach. In: Proc. IEEE Workshop on Applications of Signal Processing to Acoustics and Audio, New Paltz, NY.
25. Hukin, R.W., Darwin, C.J., 1995. Effects of contralateral presentation and of interaural time differences in segregating a harmonic from a vowel. J. Acoust. Soc. Amer. 98 (3), 1380-1387.
26. Kingsbury, B.E.D., 1998. Perceptually inspired signal-processing strategies for robust speech recognition in reverberant environments. Ph.D. Thesis. University of California, Berkeley.
27. Kingsbury, B.E.D., Morgan, N., Greenberg, S., 1998. Robust speech recognition using the modulation spectrogram. Speech Comm. 25, 117-132.
28. Koutras, A., Dermatas, E., Kokkinakis, O., 2001. Improving simultaneous speech recognition in real room environments using overdetermined blind source separation. Proc. EUROSPEECH 2, 1009-1012.
29. Leonard, R.G., 1984. A database for speaker-independent digit recognition. Proc. ICASSP 3, 111-114.
30. Lindemann, W., 1986. Extension of a binaural cross-correlation model by contralateral inhibition. II. The law of the first wave front. J. Acoust. Soc. Amer. 80 (6), 1623-1630.
31. Litovsky, R.Y., Colburn, S.H., Yost, W.A., Guzman, S.J., 1999. The precedence effect. J. Acoust. Soc. Amer. 106 (4), 1633-1654.
32. Lokki, T., 2002. Physically-based auralization. Ph.D. Thesis. Publications in Telecommunications Software and Multimedia, Helsinki University of Technology.
33. MacPherson, E.A., 1991. A computer model of binaural localization for stereo imaging measurement. J. Audio Eng. Soc. 39 (9), 604-622.
34. Martin, K.D., 1997. Echo suppression in a computational model of the precedence effect. In: Proc. IEEE Workshop on Applications of Signal Processing to Acoustics and Audio, New Paltz, NY.
35. Møller, H., 1992. Fundamentals of binaural technology. Appl. Acoust. 36, 171-218.
36. Moore, B.C.J., 1997. An Introduction to the Psychology of Hearing, fourth ed. Academic Press, New York.
37. Nabelek, A.K., Robinson, P.K., 1982. Monaural and binaural speech perception in reverberation for listeners of various ages. J. Acoust. Soc. Amer. 71 (5), 1242-1248.
38. Okuno, H.G., Nakatani, T., Kawabata, T., 1999. Listening to two simultaneous speeches. Speech Comm. 27, 299-310.
39. Palomäki, K.J., Brown, G.J., Barker, J., 2002. Missing data speech recognition in reverberant conditions. In: Proc. ICASSP, Orlando, 13th-17th May. pp. 65-68.
40. Palomäki, K.J., Brown, G.J., Barker, J., 2004. Techniques for handling convolutional distortion with 'missing data' automatic speech recognition. Speech Comm. 43, 123-142.
41. Palomäki, K.J., Brown, G.J., Wang, D.L., 2001. A binaural model for missing data speech recognition in noisy and reverberant conditions. In: Proc. Workshop on Consistent and Reliable Acoustic Cues for Sound Analysis (CRAC), Aalborg.
42. Patterson, R.D., Nimmo-Smith, I., Holdsworth, J., Rice, P., 1988. APU report 2341: an efficient auditory filterbank based on the gammatone function. Applied Psychology Unit, Cambridge.
43. Roman, N., Wang, D.L., 2003. Binaural tracking of multiple moving sources. In: Proc. ICASSP, pp. 149-152.
44. Roman, N., Wang, D.L., Brown, G.J., 2002. Location-based sound segregation. In: Proc. ICASSP, Orlando, 13th-17th May. pp. 1013-1016.
45. Rosenthal, D.F., Okuno, H.G., 1998. Computational Auditory Scene Analysis. Lawrence Erlbaum Associates, Mahwah, NJ.
46. Seltzer, M.L., Raj, B., 2001. Calibration of microphone arrays for improved speech recognition. Proc. EUROSPEECH 2, 1005-1008.
47. Shackleton, T.M., Meddis, R., Hewitt, M.J., 1992. Across frequency integration in a model of lateralization. J. Acoust. Soc. Amer. 91 (4), 2276-2279.
48. Shamsoddini, A., Denbigh, P.N., 2001. A sound segregation algorithm for reverberant conditions. Speech Comm. 33, 179-196.
49. Spieth, W., Curtis, J.F., Webster, J.C., 1954. Responding to one of two simultaneous messages. J. Acoust. Soc. Amer. 26 (3), 391-396.
50. van der Kouwe, A.J.W., Wang, D.L., Brown, G.J., 2001. A comparison of auditory and blind separation techniques for speech segregation. IEEE Trans. Speech Audio Process. 9, 189-195.
51. Wallach, H., Neumann, E.B., Rosenzweig, M.R., 1949. The precedence effect in sound localization. Amer. J. Psychol. 52, 315-336.
52. Watkins, A.J., 1991. Central, auditory mechanisms of perceptual compensation for spectral- envelope distortion. J. Acoust. Soc. Amer. 90 (6), 2942-2955.
53. Yost, W.A., 1997. The cocktail party problem: Forty years later. In: Gilkey, R.H., Anderson, T.R. (Eds.), Binaural Hearing in Real and Virtual Environments. Lawrence Erlbaum Associates, Mahwah, NJ, pp. 329-348.
54. Zurek, P.M., 1987. The precedence effect. In: Yost, W.A., Gourevitch, G. (Eds.), Directional Hearing. Springer-Verlag, New York, pp. 85-105.