Small-footprint keyword spotting using deep neural networks

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 4087-4091

  Chen, Guoguo ^a   Parada, Carolina ^b   Heigold, Georg ^b  

^a Johns Hopkins University   (United States)

^b GOOGLE INC   (United States)

Author keywords

Deep Neural Network; Embedded Speech Recognition; Keyword Spotting

Indexed keywords

HIDDEN MARKOV MODELS; SIGNAL PROCESSING;

COMPUTATIONAL COSTS; CONFIDENCE SCORE; DEEP NEURAL NETWORKS; KEYWORD SPOTTING; KEYWORD SPOTTING SYSTEMS; MODEL-BASED SYSTEMS; SMALL FOOTPRINTS; SMALL MEMORY FOOTPRINT;

SPEECH RECOGNITION;

EID: 84905252895     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6854370     Document Type: Conference Paper

References (23)

1. Johan Schalkwyk, Doug Beeferman, Françoise Beaufays, Bill Byrne, Ciprian Chelba, Mike Cohen, Maryam Kamvar, and Brian Strope, ""Your word is my command": Google search by voice: A case study," in Advances in Speech Recognition, pp. 61-90. Springer, 2010.
2. David RH Miller, Michael Kleber, Chia-Lin Kao, Owen Kimball, Thomas Colthurst, Stephen A Lowe, RichardMSchwartz, and Herbert Gish, "Rapid and accurate spoken term detection.," in INTERSPEECH, 2007, pp. 314-317.
3. Siddika Parlak and Murat Saraclar, "Spoken term detection for turkish broadcast news," in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2008, pp. 5244-5247.
4. Jonathan Mamou, Bhuvana Ramabhadran, and Olivier Siohan, "Vocabulary independent spoken term detection," in Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval. ACM, 2007, pp. 615-622.
5. J.R. Rohlicek, W. Russell, S. Roukos, and H. Gish, "Continuous hidden Markov modeling for speaker-independent wordspotting," in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1990, pp. 627-630.
6. Richard C Rose and Douglas B Paul, "A hidden Markov model based keyword recognition system," in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1990, pp. 129-132.
7. JGWilpon, LG Miller, and P Modi, "Improvements and applications for key word recognition using hidden Markov modeling techniques," in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1991, pp. 309-312.
8. Marius-Calin Silaghi and Hervé Bourlard, "Iterative posteriorbased keyword spotting without filler models," in Proceedings of the Automatic Speech Recognition and UnderstandingWorkshop (ASRU). IEEE, 1999, pp. 213-216.
9. Marius-Calin Silaghi, "Spotting subsequences matching an HMM using the average observation probability criteria with application to keyword spotting.," in Proceedings of the National Conference on Artificial Intelligence. Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press; 1999, 2005, vol. 20, p. 1118.
10. David Grangier, Joseph Keshet, and Samy Bengio, "Discriminative keyword spotting," Automatic speech and speaker recognition: large margin and kernel methods, pp. 175-194, 2009.
11. Shima Tabibian, Ahmad Akbari, and Babak Nasersharif, "An evolutionary based discriminative system for keyword spotting," in International Symposium on Artificial Intelligence and Signal Processing (AISP). IEEE, 2011, pp. 83-88.
12. KP Li, JA Naylor, and ML Rossen, "A whole word recurrent neural network for keyword spotting," in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1992, vol. 2, pp. 81-84.
13. Santiago Fernández, Alex Graves, and Jürgen Schmidhuber, "An application of recurrent neural networks to discriminative keyword spotting," in Artificial Neural Networks-ICANN 2007, pp. 220-229. Springer, 2007.
14. Thad Hughes and Keir Mierle, "Recurrent neural networks for voice activity detection," in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2013, pp. 7378-7382.
15. Xin Lei, Andrew Senior, Alexander Gruenstein, and Jeffrey Sorensen, "Accurate and compact large vocabulary speech recognition on mobile devices," in INTERSPEECH, Apr. 2013, vol. 1.
16. Matthew D Zeiler, Marc'Aurelio Ranzato, Rajat Monga, Mark Mao, Ke Yang, Quoc V Le, Patrick Nguyen, Andrew Senior, Vincent Vanhoucke, Jeff Dean, and Geoffrey E Hinton, "On rectified linear units for speech processing," in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, Canada, Apr. 2013, IEEE, vol. 1.
17. George E Dahl, Dong Yu, Li Deng, and Alex Acero, "Large vocabulary continuous speech recognition with contextdependent DBN-HMMs," in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2011, pp. 4688-4691.
18. N. Jaitly, P. Nguyen, A. Senior, and V. Vanhoucke, "Application of pretrained deep neural networks to large vocabulary speech recognition," in INTERSPEECH, 2012.
19. Quoc Le, Marc'Aurelio Ranzato, Rajat Monga, Matthieu Devin, Ken Chen, Greg Corrado, Jeff Dean, and Andrew Ng, "Building high-level features using large scale unsupervised learning," in International Conference on Machine Learning (ICML), 2012, pp. 81-88.
20. Jeff Dean, Greg Corrado, Rajat Monga, Ken Chen, Matthieu Devin, Quoc Le, Mark Mao, Marc'Aurelio Ranzato, Andrew Senior, Paul Tucker, Ke Yang, and Andrew Ng, "Large scale distributed deep networks," in Advances in Neural Information Processing Systems (NIPS), 2012.
21. Rich Caruana, "Multitask learning," Machine Learning, vol. 28, pp. 41-75, 1997.
22. Georg Heigold, Vincent Vanhoucke, Andrew Senior, Patrick Nguyen, Marc'Aurelio Ranazaot, Matthieu Devin, and Jeff Dean, "Multilingual acoustic models using distributed deep neural networks," in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, Canada, Apr. 2013, IEEE, vol. 1.
23. Mitchel Weintraub, "Keyword spotting using sri's decipher large vocabulary speech recognition system.," in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1993, vol. 2, pp. 463-466.