Data Augmentation for deep neural network acoustic modeling

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 5582-5586

  Cui, Xiaodong ^a   Goel, Vaibhava ^a   Kingsbury, Brian ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

automatic speech recognition; data augmentation; deep neural networks; stochastic feature mapping; vocal tract length perturbation

Indexed keywords

MAPPING; NEURAL NETWORKS; SPEECH RECOGNITION; STOCHASTIC SYSTEMS;

AUTOMATIC SPEECH RECOGNITION; DATA AUGMENTATION; DEEP NEURAL NETWORKS; STOCHASTIC FEATURES; VOCAL TRACT LENGTHS;

SIGNAL PROCESSING;

EID: 84905247925     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6854671     Document Type: Conference Paper

References (17)

1. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradientbased learning applied to document recognition," Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, 1998.
2. P. Y. Simard, D. Steinkraus, and J. C. Platt, "Best practices for convolutional neural networks applied to visual document analysis," in International Conference on Document Analysis and Recognition (ICDAR), 2003, pp. 958-963.
3. N. Jaitly and G. E. Hinton, "Vocal tract length perturbation (VTLP) improves speech recognition," in International Conference on Machine Learning (ICML) Workshop on Deep Learning for Audio, Speech, and Language Processing, 2013.
4. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Neural Information Processing Systems (NIPS), 2012, pp. 1106-1114.
5. F. Seide, G. Li, and D. Yu, "Conversational speech transcription using context-dependent deep neural networks," in Interspeech, 2011, pp. 437-440.
6. F. Seide, G. Li, X. Chen, and D. Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription," in Automatic Speech Recognition and Understanding Workshop (ASRU), 2011, pp. 24-29.
7. G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition," in IEEE Signal Processing Maganize, November 2012, pp. 82-97.
8. B. Kingsbury, T. N. Sainath, and H. Soltau, "Scalable minimum Bayes risk training of deep neural network acoustic models using distributed Hessian-free optimization," in Interspeech, 2012.
9. http://www.iarpa.gov/Programs/ia/Babel/babel.html.
10. J. Cui, X. Cui, B. Ramabhadran, J. Kim, B. Kingsbury, J. Mamou, L. Mangu, M. Picheny, T. N. Sainath, and A. Sethy, "Developing speech recognition systems for corpus indexing under the IARPA Babel program," in International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2013, pp. 6753-6757.
11. B. Kingsbury, J. Cui, X. Cui, M. J. F. Gales, K. Knill, J. Mamou, L. Mangu, D. Nolden, M. Picheny, B. Ramabhadran, R. Schluter, A. Sethy, and P. C. Woodland, "A highperformance Cantonese keyword search system," in International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2013, pp. 8277-8281.
12. L. Lee and R. Rose, "A frequency warping approach to speaker normalization," IEEE Transactions on Speech and Audio Processing, vol. 6, no. 1, pp. 49-60, 1998.
13. M. J. F. Gales, "Semi-tied covariance matrices for hidden Markov models," IEEE Transactions on Speech and Audio Processing, vol. 7, no. 3, pp. 272-281, 1999.
14. M. J. F. Gales, "Maximum likelihood linear transformations for HMM-based speech recognition," Computer Speech and Language, vol. 12, pp. 75-98, 1998.
15. H. Soltau, G. Saon, and B. Kingsbury, "The IBM Attila speech recognition toolkit," in Spoken Language Technology Workshop (SLT), 2010, pp. 97-101.
16. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hiddenMarkov models," Computer Speech and Language, vol. 9, pp. 171-185, 1995.
17. X. Cui, J. Xue, X. Chen, P. A. Olsen, P. L. Dognin, U. V. Chaudhari, J. R. Hershey, and B. Zhou, "Hidden Markov acoustic modeling with bootstrap and restructuring for lowresourced languages," IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 8, pp. 2252-2264, 2012.