Deep belief networks based voice activity detection

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 4, 2013, Pages 697-710

  Zhang, Xiao Lei ^a   Wu, Ji ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Deep learning; information fusion; voice activity detection

Indexed keywords

ACOUSTIC FEATURES; DEEP BELIEF NETWORKS; DEEP LEARNING; EMPIRICAL COMPARISON; GENERATIVE MODEL; HIDDEN LAYERS; INPUT LAYERS; LINEAR CLASSIFIERS; MACHINE-LEARNING; MULTIPLE FEATURE FUSION; MULTIPLE FEATURES; PERFORMANCE ANALYSIS; REAL-TIME DETECTION; VOICE ACTIVITY DETECTION;

BAYESIAN NETWORKS; FEATURE EXTRACTION; INFORMATION FUSION; LEARNING SYSTEMS;

SPEECH RECOGNITION;

EID: 84872300403     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2229986     Document Type: Article

References (74)

1. A. Benyassine, E. Shlomot, H. Y. Su, D.Massaloux, C. Lamblin, and J. P. Petit, "ITU-T recommendation G. 729 Annex B: A silence compression scheme for use with G. 729 optimized for V. 70 digital simultaneous voice and data applications," IEEE Commun. Mag., vol. 35, no. 9, pp. 64-73, Sep. 1997. (Pubitemid 127557050)
2. "Speech processing, transmission and quality aspects (STQ); distributed speech recognition; advanced front-end feature extraction algorithm; compression algorithms," ETSI ES, vol. 202, no. 050.
3. K. Han and D. L. Wang, "Towards generalizing classification based speech separation," IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 1, pp. 1-27, Jan. 2012.
4. A. Mohamed, D. Yu, and L. Deng, "Investigation of full-sequence training of deep belief networks for speech recognition," in Proc. Interspeech-10, 2010, pp. 2846-2849.
5. D. Yu and L. Deng, "Deep-structured hidden conditional random fields for phonetic recognition," in Proc. Interspeech-10, 2010, pp. 2986-2989.
6. A. Mohamed, G. Dahl, and G. Hinton, "Acoustic modeling using deep belief networks," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 1, pp. 14-22, Jan. 2012.
7. G.Dahl, D.Yu, L.Deng, andA.Acero, "Context-dependent pre-trained deep neural networks for large vocabulary speech recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 1, pp. 30-42, 2012.
8. D. Yu, F. Seide, and G. Li, "Conversational speech transcription using context-dependent deep neural networks," in Proc. 29th Int. Conf. Mach. Learn., 2012, pp. 1-2.
9. G. Hinton et al., "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups," IEEE Signal Process. Mag., vol. 11, no. 3, pp. 229-241, Nov. 2012.
10. D. Enqing, L. Guizhong, Z. Yatong, and Z. Xiaodi, "Applying support vector machines to voice activity detection," in Proc. Int. Conf. Signal Process., 2002, vol. 2, pp. 1124-1127.
11. S. I. Kang, Q. H. Jo, and J. H. Chang, "Discriminative weight training for a statistical model-based voice activity detection," IEEE Signal Process. Lett., vol. 15, pp. 170-173, 2008.
12. Q. H. Jo, J. H. Chang, J. W. Shin, and N. S. Kim, "Statistical model-based voice activity detection using support vector machine," IET Signal Process., vol. 3, no. 3, pp. 205-210, 2009.
13. J. W. Shin, J. H. Chang, and N. S. Kim, "Voice activity detection based on statisticalmodels andmachine learning approaches," Comput. Speech Lang., vol. 24, no. 3, pp. 515-530, 2010.
14. T. Yu and J. H. L. Hansen, "Discriminative training for multiple observation likelihood ratio based voice activity detection," IEEE Signal Process. Lett., vol. 17, no. 11, pp. 897-900, 2010.
15. J. Wu and X. L. Zhang, "Maximum margin clustering based statistical VAD with multiple observation compound feature," IEEE Signal Process. Lett., vol. 18, no. 5, pp. 283-286, 2011.
16. J. Wu and X. L. Zhang, "Efficient multiple kernel support vector machine based voice activity detection," IEEE Signal Process. Lett., vol. 18, no. 8, pp. 466-499, 2011.
17. X. L. Zhang and J. Wu, "Linearithmic time sparse and convex maximum margin clustering," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 6, pp. 1669-1692, Dec. 2012.
18. Y. Suh and H. Kim, "Multiple acoustic model-based discriminative likelihood ratio weighting for voice activity detection," IEEE Signal Process. Lett., vol. 19, no. 8, pp. 507-510, 2012.
19. J. Ramírez, P. Yélamos, J. M. Górriz, and J. C. Segura, "SVM-based speech endpoint detection using contextual speech features," Electron. Lett., vol. 42, no. 7, pp. 426-428, 2006.
20. D. Cournapeau, S.Watanabe, A. Nakamura, and T. Kawahara, "Online unsupervised classification with model comparison in the variational bayes framework for voice activity detection," IEEE J. Sel. Topics Signal Process., vol. 4, no. 6, pp. 1071-1083, Dec. 2010.
21. D.Ying, Y. Yan, J.Dang, and F. Soong, "Voice activity detection based on an unsupervised learning framework," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 8, pp. 2624-2644, Nov. 2011.
22. J. Sohn, N. S. Kim, and W. Sung, "A statistical model-based voice activity detection," IEEE Signal Process. Lett., vol. 6, no. 1, pp. 1-3, 1999.
23. S. Gazor and W. Zhang, "A soft voice activity detector based on a Laplacian-Gaussian model," IEEE Trans. Speech, Audio Process., vol. 11, no. 5, pp. 498-505, Sep. 2003.
24. J. Ramírez, J. C. Segura, C. Benitez, A. D. L. Torre, and A. Rubio, "Efficient voice activity detection algorithms using long-term speech information," Speech Commun., vol. 42, no. 3-4, pp. 271-287, 2004.
25. J. Ramírez, J. C. Segura, C. Benítez, L. García, and A. Rubio, "Statistical voice activity detection using a multiple observation likelihood ratio test," IEEE Signal Process. Lett., vol. 12, no. 10, pp. 689-692, Oct. 2005. (Pubitemid 41448576)
26. J. H. Chang, N. S. Kim, and S. K.Mitra, "Voice activity detection based on multiple statistical models," IEEE Trans. Signal Process., vol. 54, no. 6, pp. 1965-1976, Jun. 2006. (Pubitemid 43811393)
27. J.Ramírez, J. Segura, J.Górriz, and L.García, "Improved voice activity detection using contextualmultiple hypothesis testing for robust speech recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 8, pp. 2177-2189, Nov. 2007.
28. R. Tahmasbi and S. Rezaei, "A soft voice activity detection using GARCH filter and variance Gamma distribution," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 4, pp. 1129-1134, May 2007.
29. T. Petsatodis, C. Boukis, F. Talantzis, Z. Tan, and R. Prasad, "Convex combination of multiple statistical models with application to VAD," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 8, pp. 2314-2327, Nov. 2011.
30. G. Hinton, S. Osindero, and Y. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006. (Pubitemid 44024729)
31. G. Hinton and R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, 2006. (Pubitemid 44148451)
32. Y. Bengio, "Learning deep architectures for AI," Foundat. Trends® in Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
33. M. A. Carreira-Perpinan and G. E. Hinton, "On contrastive divergence learning," in Proc. Int. Conf. Artif. Intell. Stat., 2005, pp. 17-25.
34. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, "Greedy layerwise training of deep networks," Proc. Adv. Neural Inf. Process. Syst., vol. 19, pp. 153-161, 2007.
35. G. Hinton, "A practical guide to training restricted Boltzmann machines," Momentum, vol. 9, pp. 1-19, 2010.
36. D. Yu, L. Deng, and S. Wang, "Learning in the deepstructured conditional random fields," in Proc. NIPS Workshop, 2009, pp. 1-8.
37. D. Yu and L. Deng, "Deep learning and its applications to signal and information processing [exploratory dsp]," IEEE Signal Process.Mag., vol. 28, no. 1, pp. 145-154, Jan. 2011.
38. R. Collobert and J.Weston, "A unified architecture for natural language processing: Deep neural networks with multitask learning," in Proc. 25th Int. Conf. Mach. Learn., 2008, pp. 160-167.
39. Z. Jin and D. L.Wang, "Reverberant speech segregation based on multipitch tracking and classification," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 8, pp. 2328-2337, Nov. 2011.
40. C. L. Hsu, D. L.Wang, J. S. R. Jang, and K.Hu, "A tandemalgorithm for singing pitch extraction and voice separation from music accompaniment," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 5, pp. 1482-1491, Jul. 2012.
41. Y. X.Wang, K. Han, and D. L.Wang, "Exploring monaural features for classification-based speech segregation," IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 2, pp. 270-279, Jan. 2013.
42. J. Wu, X. L. Zhang, and W. Li, "A new VAD framework using statistical model and human knowledge based empirical rule," in Proc. Interspeech-10, 2010, pp. 3090-3093.
43. J. Wu and X. L. Zhang, "An efficient voice activity detection algorithm by combining statistical model and energy detection," EURASIP J. Adv. Signal Process., vol. 2011, no. 1, pp. 18-27, 2011.
44. D. Erhan, Y. Bengio, A. Courville, P. A. Manzagol, P. Vincent, and S. Bengio, "Why does unsupervised pre-training help deep learning?," J. Mach. Learn. Res., vol. 11, pp. 625-660, 2010.
45. D. Pearce et al., "The AURORA experimental framework for the performance evaluation of speech recognition systems under noisy conditions," Proc. ICSLP-00, vol. 4, pp. 29-32, 2000.
46. D. P. W. Ellis, "PLP and RASTA (and MFCC, and Inversion) in Matlab," 2005 [Online]. Available: http://www.ee.columbia. edu/~dpwe/resources/matlab/rastamat/
47. J. Tchorz and B. Kollmeier, "Snr estimation based on amplitude modulation analysis with applications to noise suppression," IEEE Trans. Speech, Audio Process., vol. 11, no. 3, pp. 184-192, May 2003.
48. G. Kim, Y. Lu, Y. Hu, and P. C. Loizou, "An algorithm that improves speech intelligibility in noise for normal-hearing listeners," J. Acoust. Soc. Amer., vol. 126, pp. 1486-1494, 2009.
49. M.Wu, D. L.Wang, and G. J. Brown, "A multipitch tracking algorithm for noisy speech," IEEE Trans. Speech, Audio Process., vol. 11, no. 3, pp. 229-241, May 2003.
50. G. Hu and D. Wang, "Monaural speech segregation based on pitch tracking and amplitude modulation," IEEE Trans. Neural Netw., vol. 15, no. 5, pp. 1135-1150, Sep. 2004.
51. Z. Jin and D. L. Wang, "A supervised learning approach to monaural segregation of reverberant speech," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 4, pp. 625-638, May 2009.
52. G. Hu and D. L. Wang, "A tandem algorithm for pitch estimation and voiced speech segregation," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 8, pp. 2067-2079, Nov. 2010.
53. Z. Jin and D. L. Wang, "Hmm-based multipitch tracking for noisy and reverberant speech," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 5, pp. 1091-1102, Jul. 2011.
54. C. L. Hsu, D. L.Wang, J. S. R. Jang, and K.Hu, "A tandemalgorithm for singing pitch extraction and voice separation from music accompaniment," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 5, pp. 1482-1491, Jul. 2012.
55. X. Sun, "Pitch determination and voice quality analysis using subharmonic-to-harmonic ratio," in Proc. Int. Conf. Acoust., Speech, Signal Process., 2002, vol. 1, pp. 333-336.
56. "Enhanced variable rate codec, speech service option 3 for wideband spectrum digital systems," TIA/EIA/IS-127, 2004, 3GPP2 C.S0014-A.
57. C. W. Hsu, C. C. Chang, and C. J. Lin, "A practical guide to support vector classification," 2003 [Online]. Available: http://www.csie.ntu. edu.tw/~cjlin/papers/guide/guide.pdf
58. T. Joachims and C. N. J. Yu, "Sparse kernel SVMs via cutting-plane training," Mach. Learn., vol. 76, no. 2, pp. 179-193, 2009.
59. Z. Xu, R. Jin, H. Yang, I. King, and M. R. Lyu, "Simple and efficient multiple kernel learning by group lasso," in Proc. 27th Int. Conf.Mach. Learn., 2010, pp. 1175-1182.
60. Y. Bengio, "Deep learning of representations for unsupervised and transfer learning," in Proc. ICML Workshop Unsupervised Transfer Learn., 2011, vol. 7, pp. 1-20.
61. A. S. Bregman, Auditory Scene Analysis: The Perceptual Organization of Sound. Cambridge, MA: MIT Press, 1994.
62. D. L.Wang and G. J. Brown, Computational Auditory Scene Analysis: Principles, Algorithms and Applications. New York: Wiley-IEEE Press, 2006.
63. D. L. Wang and D. Terman, "Locally excitatory globally inhibitory oscillator networks," IEEE Trans. Neural Netw., vol. 6, no. 1, pp. 283-286, Jan. 1995.
64. D. L. Wang, "The time dimension for scene analysis," IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1401-1426, Nov. 2005.
65. A. Coates and A. Y. Ng, "Selecting receptive fields in deep networks," Proc. Adv. Neural Inf. Process. Syst., vol. 24, pp. 2528-2536, 2011.
66. K. Hu and D. L.Wang, "Unvoiced speech segregation from nonspeech interference via casa and spectral subtraction," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 6, pp. 1600-1609, Aug. 2011.
67. K. Hu and D. L. Wang, "An unsupervised approach to cochannel speech separation," IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 1, pp. 122-131, Jan. 2013.
68. D. Koller and N. Friedman, Probabilistic Graphical Models: Principles and Techniques. Cambridge, MA: MIT Press, 2009.
69. S. J. Pan and Q. Yang, "A survey on transfer learning," IEEE Trans. Knowl. Data Eng., vol. 22, no. 10, pp. 1345-1359, Oct. 2010.
70. F. Sha and B. Kingsbury, "Domain adaptation in machine learning and speech processing," in Tutorial of Interspeech-12, 2012, pp. 1-214.
71. P. Vincent, H. Larochelle, Y. Bengio, and P. A.Manzagol, "Extracting and composing robust features with denoising autoencoders," in Proc. 25th Int. Conf. Mach. Learn., 2008, pp. 1096-1103.
72. M. Chen, Z. Xu, K. Weinberger, and F. Sha, "Marginalized denoising autoencoders for domain adaptation," in Proc. 29th Int. Conf. Mach. Learn, 2012, pp. 1-8.
73. Y. X.Wang and D. L.Wang, "Cocktail party processing via structured prediction," in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 1-8.
74. Q. Le, R. Monga, M. Devin, G. Corrado, K. Chen, M. A. Ranzato, J. Dean, and A. Y. Ng, "Building high-level features using large scale unsupervised learning," in Proc. 29th Int. Conf. Mach. Learn., 2011, pp. 1-8.