Long short term memory neural network for keyboard gesture decoding

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2015-August, Issue , 2015, Pages 2076-2080

  Alsharif, Ouais ^a   Ouyang, Tom ^a   Beaufays, Francoise ^a   Zhai, Shumin ^a   Breuel, Thomas ^a   Schalkwyk, Johan ^a  

^a GOOGLE INC   (United States)

Author keywords

gesture typing; keyboard; Long short term memory; LSTM

Indexed keywords

AUDIO SIGNAL PROCESSING; BRAIN; DECODING; SPEECH COMMUNICATION;

CO-ARTICULATION; FINITE STATE TRANSDUCERS; GESTURE TYPING; HYBRID APPROACH; KEYBOARD; LARGE-SCALE DATASET; LSTM; RECURRENT NETWORKS;

LONG SHORT-TERM MEMORY;

EID: 84946055752     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2015.7178336     Document Type: Conference Paper

References (21)

1. Sepp Hochreiter and Jürgen Schmidhuber, "Long shortterm memory," Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997.
2. Mehryar Mohri, "Finite-state transducers in language and speech processing," Computational linguistics, vol. 23, no. 2, pp. 269-311, 1997.
3. Shumin Zhai and Per Ola Kristensson, "The wordgesture keyboard: reimagining keyboard interaction," Communications of the ACM, vol. 55, no. 9, pp. 91-101, 2012.
4. Shumin Zhai and Per-Ola Kristensson, "Shorthand writing on stylus keyboard," in SIGCHI. ACM, 2003, pp. 97-104.
5. Per-Ola Kristensson and Shumin Zhai, "Shark 2: a large vocabulary shorthand writing system for penbased computers," in Proceedings of the 17th annual ACM symposium on User interface software and technology. ACM, 2004, pp. 43-52.
6. Marcus Liwicki, Alex Graves, Horst Bunke, and Jürgen Schmidhuber, "A novel approach to on-line handwriting recognition based on bidirectional long short-term memory networks," in ICDAR, 2007.
7. Haşim Sak, Andrew Senior, and Françoise Beaufays, "Long short-term memory based recurrent neural network architectures for large vocabulary speech recognition," arXiv preprint arXiv:1402. 1128, 2014.
8. Ronald J Williams and David Zipser, "A learning algorithm for continually running fully recurrent neural networks," Neural computation, vol. 1, no. 2, pp. 270-280, 1989.
9. Yoshua Bengio, Patrice Simard, and Paolo Frasconi, "Learning long-term dependencies with gradient descent is difficult," IEEE Transactions on Neural Networks, vol. 5, no. 2, pp. 157-166, 1994.
10. Steve Lawrence, C Lee Giles, and Sandiway Fong, "Natural language grammatical inference with recurrent neural networks," IEEE Transactions on Knowledge and Data Engineering, vol. 12, no. 1, pp. 126-140, 2000.
11. Alex Graves, Abdel-rahman Mohamed, and Geoffrey Hinton, "Speech recognition with deep recurrent neural networks," in ICASSP. IEEE, 2013, pp. 6645-6649.
12. Alex Graves, Santiago Fernández, Faustino Gomez, and Jürgen Schmidhuber, "Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks," in ICML. ACM, 2006, pp. 369-376.
13. Alex Graves and Navdeep Jaitly, "Towards end-to-end speech recognition with recurrent neural networks," in ICML, 2014, pp. 1764-1772.
14. Andrew D Wilson and Aaron F Bobick, "Hidden markov models for modeling and recognizing gesture under variation," PAMI, vol. 15, no. 01, pp. 123-160, 2001.
15. Miguel Angel Bautista, Antonio Hernández-Vela, Victor Ponce, Xavier Perez-Sala, Xavier Baró, Oriol Pujol, Cecilio Angulo, and Sergio Escalera, "Probability-based dynamic time warping for gesture recognition on rgb-d data," in Advances in Depth Image Analysis and Applications, pp. 126-135. Springer, 2013.
16. Sushmita Mitra and Tinku Acharya, "Gesture recognition: A survey," IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 37, no. 3, pp. 311-324, 2007.
17. Lawrence Rabiner, "A tutorial on hidden markov models and selected applications in speech recognition," Proceedings of the IEEE, vol. 77, no. 2, pp. 257-286, 1989.
18. Stuart Russell and Peter Norvig, "A modern approach," 1995.
19. Shiri Azenkot and Shumin Zhai, "Touch behavior with different postures on soft smartphone keyboards," in Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services. ACM, 2012, pp. 251-260.
20. Bryan Klimt and Yiming Yang, "Introducing the enron corpus,".
21. Jeffrey Dean, Greg Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Mark Mao, Andrew Senior, Paul Tucker, Ke Yang, Quoc V Le, et al., "Large scale distributed deep networks," in NIPS, 2012, pp. 1223-1231.