Cross-language transfer learning for deep neural network based speech enhancement

Proceedings of the 9th International Symposium on Chinese Spoken Language Processing, ISCSLP 2014

Volumn , Issue , 2014, Pages 336-340

  Xu, Yong ^a   Du, Jun ^a   Dai, Li Rong ^a   Lee, Chin Hui ^b  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

deep neural network; multi lingual; Resource limited language; speech enhancement; transfer learning

Indexed keywords

DEEP LEARNING; DEEP NEURAL NETWORKS; LEARNING SYSTEMS; LINGUISTICS; REGRESSION ANALYSIS; SPEECH ENHANCEMENT; TRANSFER LEARNING;

FEATURE EXTRACTOR; MULTI-LINGUAL; PERFORMANCE DEGRADATION; REGRESSION MODEL; RESOURCE MATERIALS; RESOURCE-LIMITED LANGUAGE; SPEECH MATERIALS; TARGET LANGUAGE;

NEURAL NETWORKS;

EID: 84912072504     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISCSLP.2014.6936608     Document Type: Conference Paper

References (27)

1. S. Boll, "Suppression of acoustic noise in speech using spectral subtraction , " IEEE Trans. on Acoustic, Speech and Signal Processing, Vol. 27, No. 2, pp. 113-120, 1979.
2. J. S. Lim and A. V. Oppenheim, "Enhancement and bandwidth compression of noisy speech , " in Proc. IEEE, Vol. 67, No. 12, pp. 1586-1604, 1979.
3. Y. Ephraim and D. Malah, "Speech enhancement using a minimum-mean square error short-time spectral amplitude estimator , " IEEE Trans. on Acoustics, Speech and Signal Processing, Vol. 32, No.6, pp. 1109-1121, 1984.
4. Y. Ephraim and D. Malah, "Speech enhancement using minimu mean square log spectral amplitude estimator , " IEEE Trans. on Acoustics, Speech and Signal Processing, Vol. 33, No. 2, pp. 443-445, 1985.
5. I. Cohen and B. Berdugo, "Speech enhancement for nonstationary noise environments , " Signal Processing, Vol. 81, No. 11, pp. 2403-2418, 2001.
6. I. Cohen, "Noise spectrum estimation in adverse environments: improved minima controlled recursive averaging , " IEEE Trans. on Speech and Audio Processing, Vol. 11, No. 5, pp. 466-475, 2003.
7. A. Varga and H. J. M. Steeneken, "Assessment for automatic speech recognition: II. NOISEX-92: A database and an experiment to study the effect of additive noise on speech recognition systems"
8. K. Manohar and P. Rao, "Speech enhancement in nonstationary noise environments using noise properties , " Speech Communication, Vol. 48, No. 1, pp. 96-109, 2006.
9. Y. Xu, J. Du, L.-R. Dai and C.-H. Lee, "An experimental study on speech enhancement based on deep neural networks , " IEEE Signal Processing Letters, Vol. 21, No. 1, pp. 65-68, 2014.
10. J. Benesty, S. Makino, and J. D. Chen, Speech Enhancement, Springer, 2005.
11. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks , " Science, Vol. 313, No. 5786, pp. 504-507, 2006.
12. Y. Bengio, "Learning deep architectures for AI , " Foundations and Trends in Machine Learning, Vol. 2, No. 1, pp. 1-127, 2009.
13. B.-Y. Xia and C.-C. Bao, "Speech enhancement with weighted denoising Auto-Encoder , " Proc. Interspeech, pp. 3444-3448, 2013.
14. X.-G. Lu and Y. Tsao and S. Matsuda and C. Hori, "Speech enhancement based on deep denoising Auto-Encoder , " Proc. Interspeech, pp. 436-440, 2013.
15. B.-Y. Xia and C.-C. Bao, "Wiener filtering based speech enhancement with weighted denoising auto-encoder and noise classification , " Speech Communication, Vol. 60, pp. 13-29, 2014.
16. Y. Xu, J. Du, L.-R. Dai and C.-H. Lee, "Global variance equalization for improving deep neural network based speech enhancement , " Proc. ChinaSIP, 2014.
17. Y. X. Wang and D. L. Wang, "Towards scaling up classificationbased speech separation , " IEEE Trans. on Audio, Speech and Language Processing, Vol. 21, No. 7, pp. 1381-1390, 2013.
18. J. T. Huang, J. Li, D. Yu, L. Deng and Y. Gong, "Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers , " Proc. ICASSP, pp. 7304-7308, 2013.
19. G. Heigold, V. Vanhoucke, A. Senior, P. Nguyen, M. Ranzato, M. Devin and J. Dean, "Multilingual acoustic models using distributed deep neural networks , " Proc. ICASSP, pp. 8619-8623, 2013.
20. A. Ghoshal, P. Swietojanski and S. Renals, "Multilingual training of deep neural networks , " Proc. ICASSP, pp. 7319-7323, 2013.
21. J. Du and Q. Huo, "A speech enhancement approach using piecewise linear approximation of an explicit model of environmental distortions , " Proc. Interspeech, pp. 569-572, 2008.
22. S. J. Pan and Q. Yang, "A survey on transfer learning. Knowledge and Data Engineering , " IEEE Trans. on Knowledge and Data Engineering, Vol. 22, No. 10, pp. 1345-1359, 2010.
23. S. I. Tamura, "An analysis of a noise reduction neural network , " Proc. ICASSP, pp. 2001-2004, 1989.
24. H. G. Hirsch and D. Pearce, "The AURORA experimental framework for the preformance evaluations of speech recognition systems under noisy conditions , " Proc. ISCA ITRW ASR, pp. 181-188, 2000.
25. G. Hu, 100 nonspeech environmental sounds, 2004. http://www.cse.ohio-state.edu/pnl/corpus/HuCorpus.html.
26. J. S. Garofolo, Getting started with the DARPA TIMIT CD-ROM: an acoustic phonetic continuous speech database, NIST Tech Report, 1988.
27. ITU-T, Recommendation P.862, "Perceptual evaluation of speech quality (PESQ): an objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs , " International Telecommunication Union-Telecommunication Standardisation Sector, 2001.