Sound processing for better coding of monaural and binaural cues in auditory prostheses

Proceedings of the IEEE

Volumn 101, Issue 9, 2013, Pages 1986-1997

  Wouters, Jan ^a   Doclo, Simon ^b   Koning, Raphael ^a   Francart, Tom ^a  

^a KU LEUVEN UNIVERSITY OF LEUVEN   (Belgium)

^b UNIVERSITY OF OLDENBURG   (Germany)

Author keywords

Auditory prostheses; binaural cues; signal processing; temporal coding

Indexed keywords

ACOUSTIC STREAMING; COCHLEAR IMPLANTS; CODES (SYMBOLS); PROSTHETICS; SIGNAL PROCESSING;

AUDITORY PROSTHESIS; BINAURAL CUES; COCHLEAR IMPLANT (CIS); INTERFERING SOUNDS; SIGNAL PROCESSING ALGORITHMS; SPEECH UNDERSTANDING; TECHNICAL ADVANCES; TEMPORAL CODING;

AUDITION;

EID: 84883051300     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2013.2257635     Document Type: Article

References (63)

1. A. S. Bregman, Auditory Scene Analysis. Cambridge, MA, USA: MIT Press, 1990.
2. S. Rosen, "Temporal information in speech: Acoustic, auditory and linguistic aspects," Phil. Trans. Roy. Soc. Lond. B, Biol. Sci., vol. 59, pp. 367-373, Jul. 1992.
3. J. Blauert, Spatial Hearing: The Psychophysics of Human Sound Localisation. Cambridge, MA, USA: MIT Press, 1983.
4. A. Bronkhorst and R. Plomp, "The effect of head-induced interaural time and level differences on speech intelligibility in noise," J. Acoust. Soc. Amer., vol. 83, pp. 1508-1516, Apr. 1988.
5. D. McFadden and E. G. Pasanen, "Lateralization of high frequencies based on interaural time differences," J. Acoust. Soc. Amer., vol. 59, no. 3, pp. 634-639, 1976.
6. T. van den Bogaert, T. J. Klasen, M. Moonen, L. Van Deun, and J. Wouters, "Horizontal localisation with bilateral hearing aids: Without is better than with," J. Acoust. Soc. Amer., vol. 119, pp. 515-526, Jan. 2006. (Pubitemid 43104732)
7. O. Qazi, B. van Dijk, M. Moonen, and J. Wouters, "Speech understanding performance of cochlear implant subjects using time-frequency masking-based noise reduction," IEEE. Trans. Biomed. Eng., vol. 59, no. 5, pp. 1364-1373, May 2012.
8. K. Eneman, A. Leijon, S. Doclo, A. Spriet, M. Moonen, and J. Wouters, "Auditory-profile-based physical evaluation of multimicrophone noise reduction techniques in hearing instruments," in Advances in Digital Speech Transmission. New York, NY, USA: Wiley, 2008, pp. 431-458.
9. M. L. Jepsen and T. Dau, "Characterizing auditory processing and perception in individual listeners with sensorineural hearing loss," J. Acoust. Soc. Amer., vol. 129, pp. 262-281, 2011.
10. M. S. Zilany and I. C. Bruce, "Modeling auditory-nerve responses for high sound pressure levels in the normal and impaired auditory periphery," J. Acoust. Soc. Amer., vol. 120, pp. 1446-1466, Sep. 2006. (Pubitemid 44370666)
11. T. Dau, D. Püschel, and A. Kohlrausch, "A quantitative model of the 'effective' signal processing in the auditory system: II. simulations and measurements," J. Acoust. Soc. Amer., vol. 99, pp. 3623-3631, 1996.
12. R. V. Shannon, F.-G. Zeng, V. Kamath, J. Qygonski, and M. Ekelid, "Speech recognition with primarily temporal cues," Science, vol. 270, pp. 303-304, 1995.
13. C. E. Stilp and K. R. Kluender, "Cochlea-scaled entropy, not consonants, vowels, or time, best predicts speech intelligibility," Proc. Nat. Acad. Sci. USA, vol. 107, no. 27, pp. 12 387-12 392, 2010.
14. F. Chen and P. C. Loizou, "Contribution of cochlea-scaled entropy and consonant-vowel boundaries to prediction of speech intelligibility in noise," J. Acoust. Soc. Amer., vol. 131, pp. 4104-4113, 2006.
15. B. Delgutte and N. Y. S. Kiang, "Speech coding in the auditory nerve: Iv. sounds with consonant-like dynamic characteristics," J. Acoust. Soc. Amer., vol. 75, pp. 897-907, 1984. (Pubitemid 14173754)
16. J. Chen, T. Baer, and B. C. J. Moore, "Effect of enhancement of spectral changes on speech intelligibility and clarity preferences for the hearing impaired," J. Acoust. Soc. Amer., vol. 131, pp. 4104-4113, 2012.
17. L. Geurts and J. Wouters, "Enhancing the speech envelope of continuous interleaved sampling processors for cochlear implants," J. Acoust. Soc. Amer., vol. 105, pp. 2476-2484, 1999. (Pubitemid 29174334)
18. A. Vandali, "Emphasis of short-duration acoustic speech cues for cochlear implant users," J. Acoust. Soc. Amer., vol. 109, pp. 2049-2061, 2001.
19. R. Koning and J. Wouters, "The potential of onset enhancement for increased speech intelligibility in auditory prostheses," J. Acoust. Soc. Amer., vol. 132, no. 4, pp. 2569-2581, 2012.
20. M. McKay, A. E. Vandali, H. McDermott, and G. M. Clark, "Speech processing for multichannel cochlear implants: Variations of the spectral maxima sound processor strategy," Acta Otolaryngol., vol. 114, no. 1, pp. 52-58, 1994. (Pubitemid 24009235)
21. A. E. Vandali, L. A. Whitford, K. L. Plant, and G. M. Clark, "Speech perception as a function of electrical stimulation rate: Using the nucleus 24 cochlear implant system," Ear Hear., vol. 21, pp. 608-624, 2000.
22. I. Hochmair, P. Nopp, C. Jolly, M. Schmidt, H. Schosser, C. Garnham, and I. Anderson, "Med-el cochlear implants: State of the art and a glimpse into the future," Trends Amplif., vol. 10, pp. 201-219, 2006.
23. M. Milczynski, J. Wouters, and A. van Wieringen, "Perception of mandarin Chinese with cochlear implants using enhanced temporal pitch cues," Hear Res., vol. 285, pp. 1-12, 2012.
24. A. Vandali, C. Sucher, D. Tsang, C. McKay, J. Chew, and H. McDermott, "Pitch ranking ability of cochlear implant recipients: A comparison of sound-processing strategies," J. Acoust. Soc. Amer., vol. 117, pp. 3126-3138, 2005. (Pubitemid 40675174)
25. A. Vandali and R. van Hoesel, "Enhancement of temporal cues to pitch in cochlear implants: Effects on pitch ranking," J. Acoust. Soc. Amer., vol. 132, pp. 392-402, 2012.
26. B. Laback, S.-M. Pok, W.-D. Baumgartner, W. A. Deutsch, and K. Schmid, "Sensitivity to interaural level and envelope time differences of two bilateral cochlear implant listeners using clinical sound processors," Ear Hear., vol. 25, pp. 488-500, Oct. 2004. (Pubitemid 39332011)
27. R. J. M. van Hoesel and R. S. Tyler, "Speech perception, localization, and lateralization with bilateral cochlear implants," J. Acoust. Soc. Amer., vol. 113, no. 3, pp. 1617-1630, 2003. (Pubitemid 36297965)
28. C. J. Long, D. K. Eddington, H. S. Colburn, and W. M. Rabinowitz, "Binaural sensitivity as a function of interaural electrode position with a bilateral cochlear implant user," J. Acoust. Soc. Amer., vol. 114, pp. 1565-1574, Sep. 2003. (Pubitemid 37075731)
29. R. J. M. van Hoesel, "Sensitivity to binaural timing in bilateral cochlear implant users," J. Acoust. Soc. Amer., vol. 121, pp. 2192-2206, Apr. 2007. (Pubitemid 46548419)
30. L. Van Deun, A. van Wieringen, T. Francart, A. Büchner, T. Lenarz, and J. Wouters, "Binaural unmasking of multi-channel stimuli in bilateral cochlear implant users," J. Assoc. Res. Otolaryngol., vol. 12, pp. 659-670, 2011.
31. T. Ching, E. van Wanrooy, and H. Dillon, "Binaural-bimodal fitting or bilateral implantation for managing severe to profound deafness: A review," Trends Amplif., vol. 11, pp. 161-192, 2007. (Pubitemid 47246426)
32. B. U. Seeber and H. Fastl, "Localization cues with bilateral cochlear implants," J. Acoust. Soc. Amer., vol. 123, pp. 1030-1042, 2008. (Pubitemid 351222574)
33. Z. Smith, "Speech coding of interaural time differences for bilateral cochlear implants," in Proc. Conf. Implantable Auditory Prostheses, 2009.
34. C. A. von Ilberg, U. Baumann, J. Kiefer, J. Tillein, and O. F. Adunka, "Electric-acoustic stimulation of the auditory system: A review of the first decade," Audiol. Neurootol., vol. 16, no. Suppl. 2, pp. 1-30, 2011.
35. T. Francart, J. Brokx, and J. Wouters, "Sensitivity to interaural level difference and loudness growth with bilateral bimodal stimulation," Audiol. Neurootol., vol. 13, pp. 309-319, 2008.
36. T. Francart, J. Brokx, and J. Wouters, "Sensitivity to interaural time differences with combined cochlear implant and acoustic stimulation," J. Assoc. Res. Otolaryngol., vol. 10, pp. 131-141, 2009.
37. A. Lenssen, T. Francart, J. Brokx, and J. Wouters, "Bimodal listeners are not sensitive to interaural time differences in unmodulated low-frequency stimuli," J. Acoust. Soc. Amer., vol. 129, pp. 3457-3460, 2011.
38. B. C. J. Moore, B. R. Glasberg, and T. Baer, "A model for the prediction of thresholds, loudness, and partial loudness," J. Audio Eng. Soc., vol. 45, no. 4, pp. 224-240, 1997.
39. C. M. McKay, K. R. Henshall, R. J. Farrell, and H. McDermott, "A practical method of predicting the loudness of complex electrical stimuli," J. Acoust. Soc. Amer., vol. 113, no. 4, pt. 1, pp. 2054-2063, 2003. (Pubitemid 36389944)
40. T. Francart and H. McDermott, "Development of a loudness normalisation strategy for combined cochlear implant and acoustic stimulation," Hear Res., vol. 294, pp. 114-124, Dec. 2012.
41. T. Francart, A. Lenssen, and J. Wouters, "Sensitivity of bimodal listeners to interaural time differences with modulated single-and multiple channel stimuli," Audiol. Neurootol., vol. 16, no. 2, pp. 82-92, 2011.
42. T. Francart, A. Lenssen, and J. Wouters, "The effect of interaural differences in envelope shape on the perceived location of sounds (l)," J. Acoust. Soc. Amer., vol. 132, pp. 611-614, Aug. 2012.
43. T. Francart, A. Lenssen, and J. Wouters, "Modulation emphasis improves perception of interaural time differences in vowels with bimodal stimulation," PLoS One, under review.
44. R. Plomp and A. M. Mimpen, "Improving the reliability of testing the speech reception threshold for sentences," Audiology, vol. 18, no. 1, pp. 43-52, 1979. (Pubitemid 9111887)
45. H. Luts, K. Eneman, J. Wouters, M. Schulte, M. Vormann, M. Buechler, N. Dillier, R. Houben, W. A. Dreschler, M. Froehlich, H. Puder, G. Grimm, V. Hohmann, A. Leijon, A. Lombard, D. Mauler, and A. Spriet, "Multicenter evaluation of signal enhancement algorithms for hearing aids," J. Acoust. Soc. Amer., vol. 127, pp. 2054-2063, Mar. 2010.
46. P. C. Loizou and G. Kim, "Reasons why current speech-enhancement algorithms do not improve speech intelligibility and suggested solutions," IEEE Trans. Audio Speech Lang. Process., vol. 19, no. 1, pp. 47-56, Jan. 2011.
47. P. W. Dawson, S. J. Mauger, and A. A. Hersbach, "Clinical evaluation of signal-to-noise ratio-based noise reduction in nucleus cochlear implant recipients," Ear Hear., vol. 32, no. 3, pp. 382-390, 2011.
48. S. J. Mauger, P. W. Dawson, and A. A. Hersbach, "Perceptually optimized gain function for cochlear implant signal-to-noise ratio based noise reduction," J. Acoust. Soc. Amer., vol. 131, no. 1, pp. 327-336, 2012.
49. A. Spriet, L. Van Deun, K. Eftaxiadis, J. Laneau, M. Moonen, B. van Dijk, A. van Wieringen, and J. Wouters, "Speech understanding in background noise with the two-microphone adaptive beamformer beam in the nucleus freedom cochlear implant system," Ear Hear., vol. 28, pp. 62-72, Feb. 2007. (Pubitemid 46066844)
50. S. Doclo, S. Gannot, M. Moonen, and A. Spriet, "Acoustic beamforming for hearing aid applications," in Handbook on Array Processing and Sensor Networks. New York, NY, USA: Wiley, 2010, pp. 269-302.
51. V. Hamacher, U. Kornagel, T. Lotter, and H. Puder, "Binaural signal processing in hearing aids: Technologies and algorithms," in Advances in Digital Speech Transmission. New York, NY, USA: Wiley, 2008, pp. 401-429.
52. T. Wittkop and V. Hohmann, "Strategy-selective noise reduction for binaural digital hearing aids," Speech Commun., vol. 39, no. 1-2, pp. 111-138, 2003. (Pubitemid 35412365)
53. G. Grimm, V. Hohmann, and B. Kollmeier, "Increase and subjective evaluation of feedback stability in hearing aids by a binaural coherence-based noise reduction scheme," IEEE Trans. Audio Speech Lang. Process., vol. 17, no. 7, pp. 1408-1419, Sep. 2009.
54. T. Lotter and P. Vary, "Dual-channel speech enhancement by superdirective beamforming," EURASIP J. Appl. Signal Process., vol. 2006, pp. 175-175, Jan. 2006.
55. T. Rohdenburg, "Development and objective perceptual quality assessment of monaural and binaural noise reduction schemes for hearing aids," Ph.D. dissertation, Dept. Med. Phys., Univ. Oldenburg, Oldenburg, Germany, 2008.
56. J. Desloge, W. Rabinowitz, and P. Zurek, "Microphone-array hearing aids with binaural outputVPart I: Fixed-processing systems," IEEE Trans. Speech Audio Process., vol. 5, no. 6, pp. 529-542, Nov. 1997. (Pubitemid 127746023)
57. F. L. Luo, J. Y. Yang, C. Pavlovic, and A. Nehorai, "Adaptive null-forming scheme in digital hearing aids," IEEE Trans. Signal Process., vol. 50, no. 7, pp. 1583-1590, Jul. 2003.
58. D. Welker, J. Greenberg, J. Desloge, and P. Zurek, "Microphone-array hearing aids with binaural outputVPart II: A two-microphone adaptive system," IEEE Trans. Speech Audio Process., vol. 5, no. 6, pp. 543-551, Nov. 1997. (Pubitemid 127746024)
59. T. van den Bogaert, S. Doclo, J. Wouters, and M. Moonen, "The effect of multimicrophone noise reduction systems on sound source localization by users of binaural hearing aids," J. Acoust. Soc. Amer., vol. 124, pp. 484-497, Jul. 2008. (Pubitemid 352019337)
60. S. Doclo, A. Spriet, J. Wouters, and M. Moonen, "Frequency-domain criterion for speech distortion weighted multichannel Wiener filter for robust noise reduction," Speech Commun., vol. 49, pp. 636-656, Jul.-Aug. 2007. (Pubitemid 47039261)
61. B. Cornelis, S. Doclo, T. van den Bogaert, J. Wouters, and M. Moonen, "Theoretical analysis of binaural multi-microphone noise reduction techniques," IEEE Trans. Audio Speech Lang. Process., vol. 18, no. 2, pp. 342-355, Feb. 2010.
62. T. van den Bogaert, S. Doclo, J. Wouters, and M. Moonen, "Speech enhancement with multichannel Wiener filter techniques in multimicrophone binaural hearing aids," J. Acoust. Soc. Amer., vol. 125, pp. 360-371, Jan. 2009.
63. B. Cornelis, M. Moonen, and J. Wouters, "Speech intelligibility improvements with hearing aids using bilateral and binaural adaptive multichannel Wiener filtering based noise reduction," J. Acoust. Soc. Amer., vol. 131, pp. 4743-4755, Jun. 2012.