Accurate and compact large vocabulary speech recognition on mobile devices

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2013, Pages 662-665

  Lei, Xin ^a   Senior, Andrew ^a   Gruenstein, Alexander ^a   Sorensen, Jeffrey ^a  

^a GOOGLE INC   (United States)

Author keywords

Deep neural networks; Embedded speech recognition; LM compression; SIMD

Indexed keywords

COMPUTATIONAL LINGUISTICS; SPEECH RECOGNITION; VOCABULARY CONTROL;

DEEP NEURAL NETWORKS; LARGE VOCABULARY SPEECH RECOGNITION; REAL-TIME OPERATION; RECOGNITION ACCURACY; SIMD; SMALL FOOTPRINTS; SPEECH RECOGNIZER; SPEED-UP TECHNIQUES;

MOBILE DEVICES;

EID: 84906251664     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. J. Schalkwyk, D. Beeferman, F. Beaufays, B. Byrne, C. Chelba, M. Cohen, M. Kamvar, and B. Strope, "Google search by voice: A case study, " in Advances in Speech Recognition: Mobile Environments, Call Centers and Clinics, pp. 61-90. Springer, 2010.
2. B. Ballinger, C. Allauzen, A. Gruenstein, and J. Schalkwyk, "Ondemand language model interpolation for mobile speech input, " in Proc. Interspeech, 2010.
3. J. Zheng et al., "Implementing SRI's Pashto speech-to-speech translation system on a smart phone, " in SLT, 2010.
4. J. Xue, X. Cui, G. Daggett, E. Marcheret, and B. Zhou, "Towards high performance LVCSR in speech-to-speech translation system on smart phones, " in Proc. Interspeech, 2012.
5. R. Prasad et al., "BBN Transtalk: Robust multilingual two-way speech-to-speech translation for mobile platforms, " Computer Speech and Language, vol. 27, pp. 475-491, February 2013.
6. M. J. F. Gales, "Semi-tied covariance matrices for hidden Markov models, " IEEE Trans. Speech and Audio Processing, vol. 7, pp. 272-281, 1999.
7. D. Povey, D. Kanevsky, B. Kingsbury, B. Ramabhadran, G. Saon, and K. Visweswariah, "Boosted MMI for model and feature-space discriminative training, " in Proc. ICASSP, 2008.
8. E. Bocchieri, "Fixed-point arithmetic, " Automatic Speech Recognition on Mobile Devices and over Communication Networks, pp. 255-275, 2008.
9. N. Jaitly, P. Nguyen, A. Wu Senior, and V. Vanhoucke, "Application of pretrained deep neural networks to large vocabulary speech recognition, " in Proc. Interspeech, 2012.
10. M. D. Zeiler et al., "On rectified linear units for speech processing, " in Proc. ICASSP, 2013.
11. V. Vanhoucke, A. Senior, and M. Z. Mao, "Improving the speed of neural networks on CPUs, " in Proc. Deep Learning and Unsupervised Feature Learning NIPS Workshop, 2011.
12. V. Vanhoucke, M. Devin, and G. Heigold, "Multiframe deep neural networks for acoustic modeling, " in Proc. ICASSP, 2013.
13. T. Brants, A. C. Popat, P. Xu, F. J. Och, and J. Dean, "Large language models in machine translation, " in EMNLP, 2007, pp. 858-867.
14. M. Mohri, F. Pereira, and M. Riley, "Speech recognition with weighted finite-state transducers, " Handbook of Speech Processing, pp. 559-582, 2008.
15. T. Hori and A. Nakamura, "Generalized fast on-the-fly composition algorithm for WFST-based speech recognition, " in Proc. Interspeech, 2005.
16. A. Stolcke, "Entropy-based pruning of backoff language models, " in DARPA Broadcast News Transcription and Understanding Workshop, 1998, pp. 8-11.
17. B. Roark, R. Sproat, C. Allauzen, M. Riley, J. Sorensen, and T. Tai, "The OpenGrm open-source finite-state grammar software libraries, " in Proceedings of the ACL 2012 System Demonstrations. 2012, ACL '12, pp. 61-66, Association for Computational Linguistics.
18. C. Allauzen, M. Riley, J. Schalkwyk, W. Skut, and M. Mohri, "OpenFst: A general and efficient weighted finite-state transducer library, " in Proceedings of the Ninth International Conference on Implementation and Application of Automata, (CIAA 2007). 2007, vol. 4783 of Lecture Notes in Computer Science, pp. 11- 23, Springer, http://www.openfst.org.
19. J. Sorensen and C. Allauzen, "Unary data structures for language models, " in Proc. Interspeech, 2011.
20. S. Yata, "Prefix/Patricia trie dictionary compression by nesting prefix/Patricia tries (japanese), " in Proceedings of 17th Annual Meeting of the Association for Natural Language, Toyohashi, Japan, 2011, NLP 2011, https://code.google.com/p/marisa-trie/.