Improving the interpretability of deep neural networks with stimulated learning

2015 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2015 - Proceedings

Volumn , Issue , 2016, Pages 617-623

  Tan, Shawn ^a   Sim, Khe Chai ^a   Gales, Mark ^b  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Deep Neural Networks

Indexed keywords

CHEMICAL ACTIVATION; KNOWLEDGE MANAGEMENT; TELEPHONE SETS;

ACOUSTIC MODELLING; AUTOMATIC SPEECH RECOGNITION; CLASSIFICATION ACCURACY; DEEP LEARNING; DEEP NEURAL NETWORKS; HIDDEN LAYERS; INTERPRETABILITY; TRAINING PROCESS;

SPEECH RECOGNITION;

EID: 84964556177     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2015.7404853     Document Type: Conference Paper

References (15)

1. Geoffrey Hinton, Li Deng, Dong Yu, George E Dahl, Abdel-rahman Mohamed, Navdeep Jaitly, Andrew Senior, Vincent Vanhoucke, Patrick Nguyen, Tara N Sainath, et al., "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups," Signal Processing Magazine, IEEE, vol. 29, no. 6, pp. 82-97, 2012
2. Frank Seide, Gang Li, Xie Chen, and Dong Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription," in Proceedings of the IEEEWorkshop on Automatic Speech Recognition and Understanding, 2011, pp. 24-29
3. A. Senior and I. L. Moreno, "Improving dnn speaker independence with i-vector inputs," in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, 2014
4. G. David Garson, "Interpreting neural-network connection weights," AI Expert, vol. 6, no. 4, pp. 46-51, Apr. 1991
5. ATC Goh, "Back-propagation neural networks for modeling complex systems," Artificial Intelligence in Engineering, vol. 9, no. 3, pp. 143-151, 1995
6. Anh Nguyen, Jason Yosinski, and Jeff Clune, "Deep neural networks are easily fooled: High confidence predictions for unrecognizable images," arXiv preprint arXiv:1412.1897, 2014
7. Aravindh Mahendran and Andrea Vedaldi, "Understanding deep image representations by inverting them," arXiv preprint arXiv:1412.0035, 2014
8. Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman, "Deep inside convolutional networks: Visualising image classification models and saliency maps," arXiv preprint arXiv:1312.6034, 2013
9. Matthew D Zeiler and Rob Fergus, "Visualizing and understanding convolutional networks," in Computer Vision-ECCV 2014, pp. 818-833. Springer, 2014
10. Laurens Maaten and Geoffrey Hinton, "Visualizing data using t-sne," Journal of Machine Learning Research, vol. 9, no. 2579-2605, pp. 85, 2008
11. Abdel Rahman Mohamed, Geoffrey Hinton, and Gerald Penn, "Understanding how deep belief networks perform acoustic modelling," in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, 2012
12. D. Povey, a. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlicek, Y. Qian, P. Schwarz, J. Silovsky, G. Stemmer, and K. Vesely, "The kaldi speech recognition toolkit," in Proceedings of the IEEE Workshop on Automatic Speech Recognition and Understanding, 2011, pp. 1-4
13. James Bergstra, Olivier Breuleux, Frédéric Bastien, Pascal Lamblin, Razvan Pascanu, Guillaume Desjardins, Joseph Turian, David Warde-Farley, and Yoshua Bengio, "Theano: A cpu and GPU math compiler in python," in Proc. 9th Python in Science Conf, 2010, pp. 1-7
14. Pawel Swietojanski and Steve Renals, "Learning hidden unit contributions for unsupervised speaker adaptation of neural network acoustic models," in Spoken Language Technology Workshop (SLT), 2014 IEEE. IEEE, 2014, pp. 171-176
15. Koray Kavukcuoglu, Marc Aurelio Ranzato, Rob Fergus, and Yann Le-Cun, "Learning invariant features through topographic filter maps," in Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on. IEEE, 2009, pp. 1605-1612