Personalized speech recognition on mobile devices

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2016-May, Issue , 2016, Pages 5955-5959

  McGraw, Ian ^a   Prabhavalkar, Rohit ^a   Alvarez, Raziel ^a   Arenas, Montse Gonzalez ^a   Rao, Kanishka ^a   Rybach, David ^a   Alsharif, Ouais ^a   Sak, Hasim ^a   Gruenstein, Alexander ^a   Beaufays, Francoise ^a   Parada, Carolina ^a  

^a GOOGLE INC   (United States)

Author keywords

CTC; embedded speech recognition; LSTM; model compression; quantization

Indexed keywords

EID: 84973402464     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2016.7472820     Document Type: Conference Paper

References (25)

1. Xin Lei, Andrew Senior, Alexander Gruenstein, and Jeffrey Sorensen, "Accurate and compact large vocabulary speech recognition on mobile devices., " in INTERSPEECH. 2013, pp. 662-665, ISCA
2. Alex Graves, Santiago Fernández, Faustino Gomez, and Jürgen Schmidhuber, "Connectionist temporal classification: Labelling unsegmented sequence data with recurrent neural networks, " in ICML, 2006, pp. 369-376
3. Brian Kingsbury, "Lattice-based optimization of sequence classification criteria for neural-network acoustic modeling, " in ICASSP. 2009, pp. 3761-3764, IEEE
4. Jian Xue, Jinyu Li, and Yifan Gong, "Restructuring of deep neural network acoustic models with singular value decomposition, " in INTERSPEECH, 2013, pp. 2365-2369
5. Rohit Prabhavalkar, Ouais Alsharif, Antoine Bruguier, and Ian McGraw, "On the compression of recurrent neural networks with an application to LVCSR acoustic modeling for embedded speech recognition, " in ICASSP. 2016, IEEE
6. Yu-hsin Chen, Ignacio Lopez-Moreno, Tara N. Sainath, Mirkó Visontai, Raziel Alvarez, and Carolina Parada, "Locallyconnected and convolutional neural networks for small footprint speaker recognition, " in INTERSPEECH. 2015, pp. 1136-1140, ISCA
7. Preetum Nakkiran, Raziel Alvarez, Rohit Prabhavalkar, and Carolina Parada, "Compressing deep neural networks using a rank-constrained topology, " in INTERSPEECH. 2015, pp. 1473-1477, ISCA
8. Vikas Sindhwani, Tara N. Sainath, and Sanjiv Kumar, "Structured transforms for small-footprint deep learning, " in NIPS (to appear), 2015
9. Tara N. Sainath, Brian Kingsbury, Vikas Sindhwani, Ebru Arisoy, and Bhuvana Ramabhadran, "Low-rank matrix factorization for deep neural network training with high-dimensional output targets, " in ICASSP. 2013, pp. 6655-6659, IEEE
10. Yongqiang Wang, Jinyu Li, and Yifan Gong, "Small-footprint high-performance deep neural network-based speech recognition using split-VQ, " in ICASSP. 2015, pp. 4984-4988, IEEE
11. William Chan, Nan Rosemary Ke, and Ian Lane, "Transferring knowledge from a RNN to a DNN, " in INTERSPEECH. 2015, ISCA
12. Petar Aleksic, Cyril Allauzen, David Elson, Aleksandar Kracun, Diego Melendo Casado, and Pedro J. Moreno, "Improved recognition of contact names in voice commands, " in ICASSP, 2015, pp. 5172-5175
13. Keith Hall, Eunjoon Cho, Cyril Allauzen, Françoise Beaufays, Noah Coccaro, Kaisuke Nakajima, Michael Riley, Brian Roark, David Rybach, and Linda Zhang, "Composition-based on-the-fly rescoring for salient n-gram biasing, " in INTERSPEECH. 2015, ISCA
14. Haşim Sak, Andrew Senior, and Françoise Beaufays, "Long short-term memory recurrent neural network architectures for large scale acoustic modeling, " in INTERSPEECH. 2014, pp. 338-342, ISCA
15. Haşim Sak, Andrew Senior, Kanishka Rao, Ozan Irsoy, Alex Graves, Françoise Beaufays, and Johan Schalkwyk, "Learning acoustic frame labeling for speech recognition with recurrent neural networks, " in ICASSP, 2015, pp. 4280-4284
16. Haşim Sak, Andrew Senior, Kanishka Rao, and Françoise Beaufays, "Fast and accurate recurrent neural network acoustic models for speech recognition, " in INTERSPEECH. 2015, pp. 1468-1472, ISCA
17. Jeffrey Sorensen and Cyril Allauzen, "Unary data structures for language models, " in INTERSPEECH. 2011, ISCA
18. Jeffrey Dean, Greg S. Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Quoc V. Le, Mark Z. Mao, Marc'Aurelio Ranzato, Andrew Senior, Paul Tucker, Ke Yang, and Andrew Y. Ng, "Large scale distributed deep networks, " in NIPS, 2012, pp. 1223-1231
19. Haşim Sak, Oriol Vinyals, Georg Heigold, Andrew Senior, Erik McDermott, Rajat Monga, and Mark Mao, "Sequence discriminative distributed training of long short-term memory recurrent neural networks, " in INTERSPEECH, 2014, pp. 1209-1213
20. Alan C. Bovik, Handbook of Image and Video Processing (Communications, Networking and Multimedia), Academic Press, Inc., Orlando, FL, USA, 2005
21. Allen Gersho and Robert M. Gray, Vector Quantization and Signal Compression, Springer US, 1992
22. Vincent Vanhoucke, Andrew Senior, and Mark Mao, "Improving the speed of neural networks on cpus, " in Deep Learning and Unsupervised Feature LearningWorkshop, NIPS 2011, 2011
23. Cyril Allauzen and Michael Riley, "Bayesian language model interpolation for mobile speech input, " in INTERSPEECH, 2011, pp. 1429-1432
24. Mehryar Mohri, Fernando Pereira, and Michael Riley, "Speech recognition with weighted finite-state transducers, " in Handbook of Speech Processing, Jacob Benesty, M. Sondhi, and Yiteng Huang, Eds., chapter 28, pp. 559-582. Springer, 2008
25. Kanishka Rao, Fuchun Peng, Haşim Sak, and Françoise Beaufays, "Grapheme-to-phoneme conversion using long shortterm memory recurrent neural networks, " in ICASSP, 2015.