Boosting contextual information for deep neural network based voice activity detection

IEEE/ACM Transactions on Audio Speech and Language Processing

Volumn 24, Issue 2, 2016, Pages 252-264

  Zhang, Xiao Lei ^a   Wang, DeLiang ^a  

^a The Ohio State University   (United States)

Author keywords

Cochleagram; Deep neural network; Ensemble learning; Multi resolution stacking; Noise independent training; Voice activity detection

Indexed keywords

ACOUSTIC NOISE; ARTIFICIAL INTELLIGENCE; AUDIO SIGNAL PROCESSING; FORECASTING; LEARNING SYSTEMS; SIGNAL DETECTION; SIGNAL PROCESSING; SIGNAL TO NOISE RATIO;

COCHLEAGRAM; DEEP NEURAL NETWORKS; ENSEMBLE LEARNING; MULTI-RESOLUTION STACKING; VOICE ACTIVITY DETECTION;

SPEECH RECOGNITION;

EID: 84962856978     PISSN: 23299290     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASLP.2015.2505415     Document Type: Article

References (51)

1. A. Benyassine, E. Shlomot, H. Y. Su, D. Massaloux, C. Lamblin, and J. P. Petit, "ITU-T recommendation G. 729 Annex B: A silence compression scheme for use with G. 729 optimized for V. 70 digital simultaneous voice and data applications, " IEEE Commun. Mag., vol. 35, no. 9, pp. 64-73, Sep. 1997.
2. S. Boll, "Suppression of acoustic noise in speech using spectral subtraction, " IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-27, no. 2, pp. 113-120, Apr. 1979.
3. ETSI, "Speech processing, transmission and quality aspects (STQ); distributed speech recognition; advanced front-end feature extraction algorithm; compression algorithms, " ETSI ES vol. 202, no. 050.
4. G. E. Dahl, D. Yu, L. Deng, and A. Acero, "Context-dependent pretrained deep neural networks for large-vocabulary speech recognition, " IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 1, pp. 30-42, Jan. 2012.
5. E. Nemer, R. Goubran, and S. Mahmoud, "Robust voice activity detection using higher-order statistics in the LPC residual domain, " IEEE Trans., Speech, Audio Process., vol. 9, no. 3, pp. 217-231, Mar. 2001.
6. I. V. McLoughlin, "The use of low-frequency ultrasound for voice activity detection, " in Proc. Interspeech, 2014, pp. 1553-1557.
7. G. Aneeja and B. Yegnanarayana, "Single frequency filtering approach for discriminating speech and nonspeech, " IEEE/ACM Trans. Audio, Speech, Lang. Process., vol. 23, no. 4, pp. 705-717, Apr. 2015.
8. J. Sohn, N. S. Kim, and W. Sung, "A statistical model-based voice activity detection, " IEEE Signal Process. Lett., vol. 6, no. 1, pp. 1-3, Jan. 1999.
9. D. Ying, Y. Yan, J. Dang, and F. Soong, "Voice activity detection based on an unsupervised learning framework, " IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 8, pp. 2624-2644, Nov. 2011.
10. S. Gazor and W. Zhang, "A soft voice activity detector based on a Laplacian-Gaussian model, " IEEE Trans. Speech Audio Process., vol. 11, no. 5, pp. 498-505, Sep. 2003.
11. J. H. Chang, N. S. Kim, and S. K. Mitra, "Voice activity detection based on multiple statistical models, " IEEE Trans. Signal Process., vol. 54, no. 6, pp. 1965-1976, Jun. 2006.
12. Y. Ephraim and D. Malah, "Speech enhancement using a minimum- mean square error short-time spectral amplitude estimator, " IEEE Trans. Audio, Speech, Signal Process., vol. 32, no. 6, pp. 1109-1121, Dec. 1984.
13. J. Ramírez, J. C. Segura, C. Benítez, L. García, and A. Rubio, "Statistical voice activity detection using a multiple observation likelihood ratio test, " IEEE Signal Process. Lett., vol. 12, no. 10, pp. 689-692, Oct. 2005.
14. S. O. Sadjadi and J. H. L. Hansen, "Unsupervised speech activity detection using voicing measures and perceptual spectral flux, " IEEE Signal Process. Lett., vol. 20, no. 3, pp. 197-200, Mar. 2013.
15. P. Teng and Y. Jia, "Voice activity detection via noise reducing using non-negative sparse coding, " IEEE Signal Process. Lett., vol. 20, no. 5, pp. 475-478, May 2013.
16. S. Mousazadeh and I. Cohen, "Voice activity detection in presence of transient noise using spectral clustering, " IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 6, pp. 1261-1271, Jun. 2013.
17. J. Gorriz, J. Ramirez, E. Lang, and C. Puntonet, "Hard c-means clustering for voice activity detection, " Speech Commun., vol. 48, no. 12, pp. 1638-1649, 2005.
18. T. Ng, B. Zhang, L. Nguyen, S. Matsoukas, X. Zhou, N. Mesgarani, K. Veselý, and P. Matejka, "Developing a speech activity detection system for the DARPA RATS program, " in Proc. Interspeech, 2012, pp. 1969-1972.
19. D. Enqing, L. Guizhong, Z. Yatong, and Z. Xiaodi, "Applying support vector machines to voice activity detection, " in Proc. Int. Conf. Signal Process., 2002, vol. 2, pp. 1124-1127.
20. J. W. Shin, J. H. Chang, and N. S. Kim, "Voice activity detection based on statistical models and machine learning approaches, " Comput. Speech Lang., vol. 24, no. 3, pp. 515-530, 2010.
21. X.-L. Zhang and J. Wu, "Deep belief networks based voice activity detection, " IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 4, pp. 697-710, Apr. 2013.
22. T. Hughes and K. Mierle, "Recurrent neural networks for voice activity detection, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2013, pp. 7378-7382.
23. F. Eyben, F. Weninger, S. Squartini, and B. Schuller, "Real-life voice activity detection with lstm recurrent neural networks and an application to Hollywood movies, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process, 2013, pp. 483-487.
24. G. Saon, S. Thomas, H. Soltau, S. Ganapathy, and B. Kingsbury, "The IBM speech activity detection system for the DARPA RATS program, " in Proc. Interspeech, 2013, pp. 3497-3501.
25. X.-L. Zhang and D. L. Wang, "Boosted deep neural networks and multi-resolution cochleagram features for voice activity detection, " in Proc. Interspeech, 2014, pp. 1534-1538.
26. S. Thomas, G. Saon, M. Van Segbroeck, and S. S. Narayanan, "Improvements to the IBM speech activity detection system for the DARPA RATS program, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process, 2015, pp. 4500-4504.
27. X.-L. Zhang, "Unsupervised domain adaptation for deep neural network based voice activity detection, " in Proc. IEEE Int. Conf. Acoust. Speech, Signal Process., 2014, pp. 6864-6868.
28. K. Walker and S. Strassel, "The RATS radio traffic collection system, " in Proc. ISCA Odyssey, 2012, pp. 291-297.
29. Y. Wang, J. Chen, and D. L. Wang, "Deep neural network based supervised speech segregation generalizes to novel noises through largescale training, " Dept. of Comput. Sci. and Eng., The Ohio State Univ., Columbus, OH, USA, Tech. Rep. OSU-CISRC-3/15-TR02, 2015.
30. Y. Wang and D. L. Wang, "Towards scaling up classification-based speech separation, " IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 7, pp. 1381-1390, Jul. 2013.
31. J. Chen, Y. Wang, and D. L. Wang, "A feature study for classificationbased speech separation at very low signal-to-noise ratio, " IEEE/ACM Trans. Audio, Speech, Lang. Process., vol. 22, no. 12, pp. 1993-2002, Dec. 2014.
32. D. Pearce and H. Hirsch et al., "The AURORA experimental framework for the performance evaluation of speech recognition systems under noisy conditions, " in Proc. ICSLP'00, 2000, vol. 4, pp. 29-32.
33. D. Pearce and J. Picone, "Aurora working group: DSR front end LVCSR evaluation AU/384/02, " Inst. for Signal & Inf. Process., Mississippi State Univ., Tech. Rep., 2002.
34. X.-L. Zhang and D. L. Wang, Boosting contextual information for deep neural network based voice activity detection Dept. of Comput. Sci. Eng., The Ohio State Univ., Columbus, OH, USA, Tech. Rep. OSUCISRC- 5/15-TR06, 2015, Tech. Rep..
35. T. G. Dietterich, "Ensemble methods in machine learning, " in Multiple Classifier Sys., G. Goos, J. Hartmanis, and J. van Leeuwen, Eds. New York, NY, USA: Springer, 2000, pp. 1-15.
36. Y. Freund and R. E. Schapire, "A desicion-theoretic generalization of on-line learning and an application to boosting, " in Proc. Int. Conf. Comput. Learn. Theory, 1995, pp. 23-37.
37. R. E. Schapire, "The strength of weak learnability, " Mach. Learn., vol. 5, no. 2, pp. 197-227, 1990.
38. L. Breiman, "Random forests, " Mach. Learn., vol. 45, no. 1, pp. 5-32, 2001.
39. S. Nie, H. Zhang, X. Zhang, and W. Liu, "Deep stacking networks with time series for speech separation, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2014, pp. 6667-6671.
40. D. Yu, L. Deng, and F. Seide, "The deep tensor neural network with applications to large vocabulary speech recognition, " IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 2, pp. 388-396, Feb. 2013.
41. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting, " J. Mach. Learn. Res., vol. 15, no. 1, pp. 1929-1958, 2014.
42. J. Dean, G. Corrado, R. Monga, K. Chen, M. Devin, Q. V. Le, M. Z. Mao, M. Ranzato, A. W. Senior, and P. A. Tucker et al., "Large scale distributed deep networks, " in Adv. Neural Inf. Process. Syst., 2012, pp. 1232-1240.
43. I. Sutskever, J. Martens, G. Dahl, and G. Hinton, "On the importance of initialization and momentum in deep learning, " in Proc. Int. Conf. Mach. Learn., 2013, pp. 1-8.
44. L. Breiman, "Bagging predictors, " Mach. Learn., vol. 24, no. 2, pp. 123-140, 1996.
45. G. Hu and D. L. Wang, "Auditory segmentation based on onset and offset analysis, " IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 2, pp. 396-405, Feb. 2007.
46. S. K. Nemala, K. Patil, and M. Elhilali, "A multistream feature framework based on bandpass modulation filtering for robust speech recognition, " IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 2, pp. 416-426, Feb. 2013.
47. D. L. Wang and G. J. Brown, Eds., Computational Auditory Scene Analysis: Principles, Algorithms and Applications. New York, NY, USA: Wiley-IEEE Press, 2006.
48. J.-H. Choi and J.-H. Chang, "Dual-microphone voice activity detection technique based on two-step power level difference ratio, " IEEE/ACM Trans. Audio, Speech, Lang. Process., vol. 22, no. 6, pp. 1069-1081, Jun. 2014.
49. The Rice University, "Noisex-92 database, " [Online]. Available: http://spib.rice.edu/spib.
50. K. Han and D. Wang, "Neural network based pitch tracking in very noisy speech, " IEEE/ACM Trans. Audio, Speech, Lang. Process., vol. 22, no. 12, pp. 2158-2168, Dec. 2014.
51. Z.-H. Tan and B. Lindberg, "Low-complexity variable frame rate analysis for speech recognition and voice activity detection, " IEEE J. Sel. Topics Signal Process., vol. 4, no. 5, pp. 798-807, Oct. 2010.