Bandwidth Extension of Telephone Speech Using a Neural Network and a Filter Bank Implementation for Highband Mel Spectrum

IEEE Transactions on Audio, Speech and Language Processing

Volumn 19, Issue 7, 2011, Pages 2170-2183

  Pulakka, Hannu ^a   Alku, Paavo ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Bandwidth extension; listening test; speech enhancement; speech processing

Indexed keywords

EID: 85008581155     PISSN: 15587916     EISSN: 15587924     Source Type: Journal    
DOI: 10.1109/TASL.2011.2118206     Document Type: Article

References (52)

1. H. Pulakka, V. Myllylä, L. Laaksonen, and P. Alku, “Bandwidth extension of telephone speech using a filter bank implementation for high-band mel spectrum,” in Proc. Eur. Signal Process. Conf. (EUSIPCO), 2010, pp. 979–983.
2. Adaptive Multi-Rate (AMR) Speech Codec, Transcoding Functions, 3GPP TS 26.090 3rd Generation Partnership Project (3GPP), version 6.0.0, 2004.
3. Adaptive Multi-Rate-Wideband (AMR-WB) Speech Codec, Transcoding Functions, 3GPP TS 26.190 2005, 3rd Generation Partnership Project (3GPP), version 6.1.1.
4. B. Bessette, R. Salami, R. Lefebvre, M. Jelínek, J. Rotola-Pukkila, J. Vainio, H. Mikkola, and K. Jarvinen, “The adaptive multirate wideband speech codec (AMR-WB),” IEEE Trans. Speech Audio Process., vol. 10, no. 8, pp. 620–636, Nov. 2002.
5. Orange Launches World's First High-Definition Voice Service for Mobile Phones in Moldova. [Online]. Available: http://www.orange.com/en_EN/press/press_releases/att00013018/CP_Orange_Moldova_HD-Voice_en.pdf, Orange, press release, 10 Sep. 2009, accessed 12 Mar. 2010.
6. Orange Accelerates the Roll-Out of Mobile hd Voice in Europe. [Online] Available: http://www.orange.com/en_EN/press/press_releases/att00014472/GroupHDrelease.pdf Orange, press release, 14 Feb. 2010, accessed 12 Mar. 2010.
7. P. Jax, “Enhancement of Bandlimited Speech Signals: Algorithms and Theoretical Bounds,” Ph.D. dissertation, Rheinisch-Westfalische Technische Hochschule Aachen, Aachen, Germany, Oct. 2002.
8. B. Iser and G. Schmidt “Bandwidth extension of telephony speech,” EURASIP Newslett., vol. 16, no. 2, pp. 2–24, 2005.
9. T. Unno and A. McCree, “A robust narrowband to wideband extension system featuring enhanced codebook mapping,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2005, vol. 1, pp. 805–808.
10. H. Carl and U. Heute, “Bandwidth enhancement of narrow-band speech signals,” in Proc. Eur. Signal Process. Conf. (EUSIPCO), 1994, vol. 2, pp. 1178–1181.
11. U. Kornagel “Techniques for artificial bandwidth extension of telephone speech,” Signal Process., vol. 86, no. 6, pp. 1296–1306, 2006.
12. Y. Qian and P. Kabal, “Combining equalization and estimation for bandwidth extension of narrowband speech,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2004, pp. 713–716.
13. K.-T. Kim, M.-K. Lee, and H.-G. Kang, “Speech bandwidth extension using temporal envelope modeling,” IEEE Signal Process. Lett., vol. 15, pp. 429–432, 2008.
14. P. Jax and P. Vary “On artificial bandwidth extension of telephone speech,” Signal Process., vol. 83, no. 8, pp. 1707–1719, Aug. 2003.
15. G.-B. Song and P. Martynovich “A study of HMM-based bandwidth extension of speech signals,” Signal Process., vol. 89, no. 10, pp. 2036–2044, 2009.
16. J. Kontio, L. Laaksonen, and P. Alku, “Neural network-based artificial bandwidth expansion of speech,” IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 3, pp. 873–881, Mar. 2007.
17. B. Geiser, P. Jax, P. Vary, H. Taddei, S. Schandl, M. Gartner, C. Guillaume, and S. Ragot, “Bandwidth extension for hierarchical speech and audio coding in ITU-T Rec. G.729.1,” IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 8, pp. 2496–2509, Nov. 2007.
18. B. Geiser, H. Taddei, and P. Vary, “Artificial bandwidth extension without side information for ITU-T G.729.1,” in Proc. Interspeech, 2007, pp. 2493–2496.
19. L. Laaksonen, J. Kontio, and P. Alku, “Artificial bandwidth expansion method to improve intelligibility and quality of AMR-coded narrowband speech,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Philadelphia, PA, May 2005, vol. 1, pp. 809–812.
20. H. Pulakka, L. Laaksonen, M. Vainio, J. Pohjalainen, and P. Alku “Evaluation of an artificial speech bandwidth extension method in three languages,” IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 6, pp. 1124–1137, Aug. 2008.
21. L. Laaksonen, H. Pulakka, V. Myllylä, and P. Alku, “Development, evaluation and implementation of an artificial bandwidth extension method of telephone speech in mobile terminal,” IEEE Trans. Consum. Electron., vol. 55, no. 2, pp. 780–787, May 2009.
22. A. V. Oppenheim and R. W. Schafer, Discrete-Time Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1989.
23. M. Nilsson, H. Gustafsson, S. V. Andersen, and W. B. Kleijn, “Gaussian mixture model based mutual information estimation between frequency bands in speech,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2002, pp. 525–528.
24. P. Jax and P. Vary, “Feature selection for improved bandwidth extension of speech signals,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2004, pp. 697–700.
25. ITU-T Rec. G.191, software tools for speech and audio coding standardization,” 2005, Int. Telecomm. Union.
26. R. Kohavi and G. H. John “Wrappers for feature subset selection,” Artif. Intell., vol. 97, pp. 273–324, 1997.
27. Y. Saeys, I. Inza, and P. Larranaga “A review of feature selection techniques in bioinformatics,” Bioinformatics, vol. 23, no. 19, pp. 2507–2517, 2007.
28. D. O'Shaughnessy, Speech Communication: Human and Machine. Reading, MA: Addison-Wesley, 1987.
29. J. W. Paulus, “Variable bitrate wideband speech coding using perceptually motivated thresholds,” in Proc. IEEE Workshop Speech Coding (SCW), 1995, pp. 35–36.
30. B. Iser, W. Minker, and G. Schmidt, Bandwidth Extension of Speech Signals. New York: Springer, 2008.
31. “Adaptive multi-rate (AMR) speech codec, voice activity detector (VAD), 3GPP TS 26.094,” 2007, 3rd Generation Partnership Project (3GPP), version 7.0.0.
32. L. Rabiner and B.-H. Juan, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
33. S. Haykin, Neural Networks: A Comprehensive Foundation, 2nd ed. Upper Saddle River: Prentice-Hall, 1999.
34. J. W. Picone “Signal modeling techniques in speech recognition,” Proc. IEEE, vol. 81, no. 9, pp. 1215–1247, Sep. 1993.
35. K. O. Stanley and R. Miikkulainen, “Evolving neural networks through augmenting topologies,” Evol. Comput., vol. 10, no. 2, pp. 99–127, 2002.
36. “Multi-lingual speech database for telephonometry,” 1994. [Online]. Available: http://www.ntt-at.com/products_e/speech/index.html, NTT Adv. Technol. Corp.
37. P. Bauer and T. Fingscheidt, “An HMM-based artificial bandwidth extension evaluated by cross-language training and test,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2008, pp. 4589–4592.
38. “The DARPA TIMIT Acoustic-Phonetic Continuous Speech Corpus,” 1990, National Institute of Standards and Technology, Speech Disc CD1-1.1.
39. J.-H. Chen and A. Gersho “Adaptive postfiltering for quality enhancement of coded speech,” IEEE Trans. Speech Audio Process, vol. 3, no. 1, pp. 59–71, Jan. 1995.
40. G. Fuchs and R. Lefebvre, “A new post-filtering for artificially replicated high-band in speech coders,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2006, pp. 713–716.
41. J. Makhoul and M. Berouti, “High-frequency regeneration in speech coding systems,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 1979, vol. 4, pp. 428–431.
42. A. McCree, “A 14 kb/s wideband speech coder with a parametric high-band model,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2000, pp. 1153–1156.
43. Y. Agiomyrgiannakis and Y. Stylianou, “Combined estimation/coding of highband spectral envelopes for speech spectrum expansion,” in Proc. IEEE Int. Conf Acoust., Speech, Signal Process. (ICASSP), 2004, pp. 469–472.
44. R. Taori, R. J. Sluijter, and A. J. Gerrits, “Hi-BIN: An alternative approach to wideband speech coding,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2000, pp. 1157–1160.
45. D. Chazan, R. Hoory, G. Cohen, and M. Zibulski, “Speech reconstruction from mel frequency cepstral coefficients and pitch frequency,” in Proc. IEEE Int. Conf Acoust., Speech, Signal Process. (ICASSP), 2000, pp. 1299–1302.
46. “ITU-T Recommendation p. 800, Methods for subjective determination of transmission quality,” 1996, Int. Telecomm. Union.
47. P. Jax and P. Vary, “An upper bound on the quality of artificial bandwidth extension of narrowband speech signals,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2002, pp. 237–240.
48. A. H. Nour-Eldin and P. Kabal, “Objective analysis of the effect of memory inclusion on bandwidth extension of narrowband speech,” in Proc. Interspeech, 2007, pp. 2489–2492.
49. B. Geiser, P. Jax, and P. Vary, “Artificial bandwidth extension of speech supported by watermark-transmitted side information,” in Proc. Interspeech, 2005, pp. 1497–1500.
50. B. Geiser and P. Vary, “Backwards compatible wideband telephony in mobile networks: CELP watermarking and bandwidth extension,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2007, pp. 533–536.
51. A. Nishimura, “Steganographic band width extension for the amr codec of low-bit-rate modes,” in Proc. Interspeech, 2009, pp. 2611–2614.
52. H. Pulakka, P. Alku, L. Laaksonen, and P. Valve, “The effect of high-band harmonic structure in the artificial bandwidth expansion of telephone speech,” in Proc. Interspeech, 2007, pp. 2497–2500.