An algorithm to improve speech recognition in noise for hearing-impaired listeners

Journal of the Acoustical Society of America

Volumn 134, Issue 4, 2013, Pages 3029-3038

  Healy, Eric W ^a,b   Yoho, Sarah E ^a,b   Wang, Yuxuan ^b   Wang, Deliang ^b  

^a OHIO STATE UNIVERSITY   (United States)

^b Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HEARING-IMPAIRED LISTENERS; IDEAL BINARY MASK; PREMIXED; PRIOR KNOWLEDGE; SPEECH IN NOISE; SPEECH-SHAPED NOISE;

ALGORITHMS; AUDITION; SPEECH RECOGNITION;

SPEECH INTELLIGIBILITY;

ADULT; AGED; ALGORITHM; ARTICLE; AUDITORY REHABILITATION; AUDITORY STIMULATION; AUDITORY THRESHOLD; CASE CONTROL STUDY; EQUIPMENT; EQUIPMENT DESIGN; FEMALE; HEARING AID; HUMAN; MALE; MIDDLE AGED; NOISE; PATIENT; PERCEPTION; PERCEPTION DEAFNESS; PSYCHOLOGICAL ASPECT; PURE TONE AUDIOMETRY; RECOGNITION; SIGNAL PROCESSING; SOUND DETECTION; SPEECH AUDIOMETRY; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION;

ACOUSTIC STIMULATION; ADULT; AGED; ALGORITHMS; AUDIOMETRY, PURE-TONE; AUDIOMETRY, SPEECH; AUDITORY THRESHOLD; CASE-CONTROL STUDIES; CORRECTION OF HEARING IMPAIRMENT; EQUIPMENT DESIGN; FEMALE; HEARING AIDS; HEARING LOSS, SENSORINEURAL; HUMANS; MALE; MIDDLE AGED; NOISE; PERCEPTUAL MASKING; PERSONS WITH HEARING IMPAIRMENTS; RECOGNITION (PSYCHOLOGY); SIGNAL PROCESSING, COMPUTER-ASSISTED; SOUND SPECTROGRAPHY; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION;

EID: 84885412715     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.4820893     Document Type: Article

References (51)

1. ANSI (1987). S3.39 (R2012), American National Standard Specifications for Instruments to Measure Aural Acoustic Impedance and Admittance (Aural Acoustic Immittance) (Acoustical Society of America, New York).
2. ANSI (2004). S3.21 (R2009), American National Standard Methods for Manual Pure-Tone Threshold Audiometry (Acoustical Society of America, New York).
3. Anzalone, M. C., Calandruccio, L., Doherty, K. A., and Carney, L. H. (2006). " Determination of the potential benefit of time-frequency gain manipulation.," Ear Hear. 27, 480-492. 10.1097/01.aud.0000233891.86809.df
4. Apoux, F., and Healy, E. W. (2009). " On the number of auditory filter outputs needed to understand speech: Further evidence for auditory channel independence.," Hear. Res. 255, 99-108. 10.1016/j.heares.2009.06. 005
5. Apoux, F., and Healy, E. W. (2010). " Relative contribution of off- and on-frequency spectral components of background noise to the masking of unprocessed and vocoded speech.," J. Acoust. Soc. Am. 128, 2075-2084. 10.1121/1.3478845
6. Bacon, S. P., Fay, R. R., and Popper, A. N. (2004). Compression: From Cochlea to Cochlear Implants (Springer, New York), pp. 136-152.
7. Bacon, S. P., and Gleitman, R. M. (1992). " Modulation detection in subjects with relatively flat hearing losses.," J. Speech Hear. Res. 35, 642-653.
8. Bacon, S. P., Opie, J. M., and Montoya, D. Y. (1998). " The effects of hearing loss and noise masking on the masking release for speech in temporally complex backgrounds.," J. Speech Lang. Hear. Res. 41, 549-563.
9. Baer, T., and Moore, B. C. J. (1993). " Effects of spectral smearing on the intelligibility of sentences in noise.," J. Acoust. Soc. Am. 94, 1229-1241. 10.1121/1.408176
10. Bernstein, J. G. W., and Grant, K. W. (2009). " Auditory and auditory-visual intelligibility of speech in fluctuating maskers for normal-hearing and hearing-impaired listeners.," J. Acoust. Soc. Am. 125, 3358-3372. 10.1121/1.3110132
11. Brungart, D. S., Chang, P. S., Simpson, B. D., and Wang, D. (2006). " Isolating the energetic component of speech-on-speech masking with ideal time-frequency segregation.," J. Acoust. Soc. Am. 120, 4007-4018. 10.1121/1.2363929
12. Cao, S., Li, L., and Wu, X. (2011). " Improvement of intelligibility of ideal binary-masked noisy speech by adding background noise.," J. Acoust. Soc. Am. 129, 2227-2236. 10.1121/1.3559707
13. Festen, J. M., and Plomp, R. (1990). " Effects of fluctuating noise and interfering speech on the speech-reception threshold for impaired and normal hearing.," J. Acoust. Soc. Am. 88, 1725-1736. 10.1121/1.400247
14. Fink, N., Furst, M., and Muchnik, C. (2012). " Improving word recognition in noise among hearing-impaired subjects with a single-channel cochlear noise-reduction algorithm.," J. Acoust. Soc. Am. 132, 1718-1731. 10.1121/1.4739441
15. Fitzgibbons, P. L., and Wightman, F. L. (1982). " Gap detection in normal and hearing-impaired listeners.," J. Acoust. Soc. Am. 72, 761-765. 10.1121/1.388256
16. Garofolo, J. S., Lamel, L. F., Fisher, W. M., Fiscus, J. G., Pallett, D. S., and Dahlgren, N. L. (1993). " DARPA TIMIT acoustic-phonetic continuous speech corpus.," technical report No. NISTIR4930, National Institute of Standards and Technology.
17. Glasberg, B. R., Moore, B. C. J., and Bacon, S. P. (1987). " Gap detection and masking in hearing-impaired and normal-hearing subjects.," J. Acoust. Soc. Am. 81, 1546-1556. 10.1121/1.394507
18. Grant, K. W., Tufts, J. B., and Greenberg, S. (2007). " Integration efficiency for speech perception within and across sensory modalities by normal-hearing and hearing-impaired individuals.," J. Acoust. Soc. Am. 121, 1164-1176. 10.1121/1.2405859
19. Han, K., and Wang, D. (2012). " A classification based approach to speech segregation.," J. Acoust. Soc. Am. 132, 3475-3483. 10.1121/1.4754541
20. Han, K., and Wang, D. L. (2013). " Towards generalizing classification based speech separation.," IEEE Trans. Audio Speech Lang. Process. 21, 166-175.
21. Healy, E. W., and Bacon, S. P. (2002). " Across-frequency comparison of temporal speech information by listeners with normal and impaired hearing.," J. Speech Lang. Hear. Res. 45, 1262-1275. 10.1044/1092- 4388(2002/101)
22. Healy, E. W., and Carson, K. A. (2010). " Influence of broad auditory tuning on across-frequency integration of speech patterns.," J. Speech Lang. Hear. Res. 53, 1087-1095. 10.1044/1092-4388(2010/09-0185)
23. Hinton, G. E. (2002). " Training products of experts by minimizing contrastive divergence.," Neural Comput. 14, 1771-1800. 10.1162/089976602760128018
24. Hinton, G. E., Osindero, S., and Teh, Y.-W. (2006). " A fast learning algorithm for deep belief nets.," Neural Comput. 18, 1527-1554. 10.1162/neco.2006.18.7.1527
25. Hu, G., and Wang, D. L. (2001). " Speech segregation based on pitch tracking and amplitude modulation. " in Proceedings of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, pp. 79-82.
26. Hu, Y., and Loizou, P. C. (2007). " A comparative intelligibility study of single-microphone noise reduction algorithms.," J. Acoust. Soc. Am. 122, 1777-1786. 10.1121/1.2766778
27. Hu, Y., and Loizou, P. C. (2010). " Environment-specific noise suppression for improved speech intelligibility by cochlear implant users.," J. Acoust. Soc. Am. 127, 3689-3695. 10.1121/1.3365256
28. IEEE (1969). " IEEE recommended practice for speech quality measurements.," IEEE Trans. Audio Electroacoust. 17, 225-246.
29. Kim, C., and Stern, R. M. (2008). " Robust signal-to-noise ratio estimation based on waveform amplitude distribution analysis.," in Proceedings of INTERSPEECH, pp. 2598-2601.
30. Kim, G., Lu, Y., Hu, Y., and Loizou, P. C. (2009). " An algorithm that improves speech intelligibility in noise for normal-hearing listeners.," J. Acoust. Soc. Am. 126, 1486-1494. 10.1121/1.3184603
31. Levitt, H. (1997). " NEW TRENDS: Digital hearing aids: Past, present, and future.," Guest Editorial in Practical Hearing Aid Selection and Fitting, edited by, H. Tobin, (VA-Rehabilitation RD Service, Washington DC), pp. xi-xxiii.
32. Levitt, H. (2001). " Noise reduction in hearing aids: A review.," J. Rehab. Res. Dev. 38, 111-121.
33. Li, N., and Loizou, P. C. (2008). " Factors influencing intelligibility of ideal binary-masked speech: Implications for noise reduction.," J. Acoust. Soc. Am. 123, 1673-1682. 10.1121/1.2832617
34. Li, Y., and Wang, D. L. (2009). " On the optimality of ideal binary time-frequency masks.," Speech Commun. 51, 230-239. 10.1016/j.specom.2008. 09.001
35. Loizou, P. C. (2007). Speech Enhancement: Theory and Practice (CRC Press, Boca Raton, FL), Chap..
36. Lorenzi, C., Gilbert, G., Carn, H., Garnier, S., and Moore, B. C. J. (2006). " Speech perception problems of the hearing impaired reflect inability to use temporal fine structure.," Proc. Natl. Acad. Sci. U.S.A. 103, 18866-18869. 10.1073/pnas.0607364103
37. Moore, B. C. J. (2007). Cochlear Hearing Loss: Physiological, Psychological and Technical Issues, 2nd ed. (Wiley, Chichester), pp. 45-91.
38. Moore, B. C. J., Shailer, M. J., and Schooneveldt, G. P. (1992). " Temporal modulation transfer functions for band-limited noise in subjects with cochlear hearing loss.," Br. J. Audiol. 26, 229-237. 10.3109/ 03005369209076641
39. Narayanan, A., and Wang, D. L. (2012). " A CASA-based system for long-term SNR estimation.," IEEE Trans. Audio Speech Lang. Process. 20, 2518-2527. 10.1109/TASL.2012.2205242
40. Nelson, P. B., and Thomas, S. D. (1997). " Gap detection as a function of stimulus loudness for listeners with and without hearing loss.," J. Speech Lang. Hear. Res. 40, 1387-1394.
41. Nilsson, M., Soli, S. D., and Sullivan, J. A. (1994). " Development of the hearing in noise test for the measurement of speech reception thresholds in quiet and in noise.," J. Acoust. Soc. Am. 95, 1085-1099. 10.1121/1.408469
42. Souza, P. E., and Boike, K. T. (2006). " Combining temporal-envelope cues across channels: Effects of age and hearing loss.," J. Speech Lang. Hear. Res. 49, 138-149. 10.1044/1092-4388(2006/011)
43. ter Keurs, M., Festen, J. M., and Plomp, R. (1992). " Effect of spectral envelope smearing on speech reception I.," J. Acoust. Soc. Am. 91, 2872-2880. 10.1121/1.402950
44. ter Keurs, M., Festen, J. M., and Plomp, R. (1993). " Effect of spectral envelope smearing on speech reception II.," J. Acoust. Soc. Am. 93, 1547-1552. 10.1121/1.406813
45. Turner, C. W., Chi, S.-L., and Flock, S. (1999). " Limiting spectral resolution in speech for listeners with sensorineural hearing loss.," J. Speech Lang. Hear. Res. 42, 773-784.
46. Wang, D., and Brown, G. (2006). Computational Auditory Scene Analysis: Principles, Algorithms and Applications (Wiley-IEEE, Hoboken, NJ), pp. 1-44.
47. Wang, D., Kjems, U., Pedersen, M., Boldt, J., and Tunner, T. (2009). " Speech intelligibility in background noise with ideal binary time-frequency masking.," J. Acoust. Soc. Am. 125, 2336-2347. 10.1121/1.3083233
48. Wang, D. L. (2005). " On ideal binary mask as the computational goal of auditory scene analysis.," in Speech Separation by Humans and Machines, edited by, P. Divenyi, (Kluwer, Norwell, MA), pp. 181-197.
49. Wang, Y., Han, K., and Wang, D. (2013). " Exploring monaural features for classification-based speech segregation.," IEEE Trans. Audio. Speech Lang. Process. 21, 270-279. 10.1109/TASL.2012.2221459
50. Wang, Y., and Wang, D. (2013). " Towards scaling up classification-based speech separation.," IEEE Trans. Audio. Speech Lang. Process. 21, 1381-1390. 10.1109/TASL.2013.2250961
51. Wilson, R. H., and Carhart, R. (1969). " Influence of pulsed masking on the threshold for spondees.," J. Acoust. Soc. Am. 46, 998-1010. 10.1121/1.1911820