Towards implicit complexity control using variable-depth deep neural networks for automatic speech recognition

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2016-May, Issue , 2016, Pages 5965-5969

  Tan, Shawn ^a   Sim, Khe Chai ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Deep Learning; Speech Recognition

Indexed keywords

EID: 84973322569     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2016.7472822     Document Type: Conference Paper

References (11)

1. G. Hinton, L. Deng, D. Yu, G. E. Dahl, A.-r. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath et al., "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, " Signal Processing Magazine, IEEE, vol. 29, no. 6, pp. 82-97, 2012
2. G. Hinton, O. Vinyals, and J. Dean, "Distilling the Knowledge in a Neural Network, " pp. 1-9
3. L. J. Ba and R. Caurana, "Do Deep Nets Really Need to be Deep " arXiv preprint arXiv: 1312. 6184, pp. 1-6, 2013. [Online]. Available: http: //arxiv. org/abs/1312. 6184
4. J. Li, R. Zhao, J.-T. Huang, and Y. Gong, "Learning small-size dnn with output-distribution-based criteria, " in Proc. Interspeech, 2014
5. A. Romero, N. Ballas, S. E. Kahou, A. Chassang, C. Gatta, and Y. Bengio, "Fitnets: Hints for thin deep nets, " arXiv preprint arXiv: 1412. 6550, 2014
6. A. Senior and X. Lei, "Fine context, low-rank, softplus deep neural networks for mobile speech recognition, " ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing-Proceedings, pp. 7644-7648, 2014
7. T. N. Sainath, B. Kingsbury, V. Sindhwani, E. Arisoy, and B. Ramabhadran, "Low-Rank Matrix Factorization for Deep Neural Network Training With High-Dimensional Output Targets, " Icassp2013, pp. 6655-6659, 2013
8. J. Xue, J. Li, and Y. Gong, "Restructuring of deep neural network acoustic models with singular value decomposition. " in INTERSPEECH, 2013, pp. 2365-2369
9. C.-Y. Lee, S. Xie, P. Gallagher, Z. Zhang, and Z. Tu, "Deeply-supervised nets, " arXiv preprint arXiv: 1409. 5185, 2014
10. D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlícek, Y. Qian, P. Schwarz et al., "The kaldi speech recognition toolkit, " 2011
11. J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, and Y. Bengio, "Theano: A CPU and GPU math expression compiler, " in Proceedings of the Python for Scientific Computing Conference (SciPy), Jun. 2010, oral Presentation.