Attention-based Wav2Text with feature transfer learning

2017 IEEE Automatic Speech Recognition and Understanding Workshop, ASRU 2017 - Proceedings

Volumn 2018-January, Issue , 2017, Pages 309-315

  Tjandra, Andros ^a   Sakti, Sakriani ^a   Nakamura, Satoshi ^a  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

end to end neural network; raw speech waveform; Speech recognition

Indexed keywords

DECODING; DEEP NEURAL NETWORKS; SIGNAL ENCODING; SPEECH RECOGNITION;

AUTOMATIC SPEECH RECOGNITION; ENCODER-DECODER; END TO END; END-TO-END NEURAL NETWORK; FEATURE TRANSFERS; NEURAL-NETWORKS; RAW SPEECH WAVEFORM; SPEECH WAVEFORMS; TRANSFER LEARNING;

HIDDEN MARKOV MODELS;

EID: 85050532161     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2017.8268951     Document Type: Conference Paper

References (31)

1. Mark Gales and Steve Young, "The application of hidden Markov models in speech recognition, " Foundations and Trends in Signal Processing, vol. 1, no. 3, pp. 195-304, 2008.
2. Dimitri Palaz, Ronan Collobert, Mathew Magimai Doss, "End-to-end phoneme sequence recognition using convolutional neural networks, " arXiv preprint arXiv:1312.2137, 2013.
3. Dimitri Palaz, Mathew Magimai Doss, Ronan Collobert, "Convolutional neural networks-based continuous speech recognition using raw speech signal, " in Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on. IEEE, 2015, pp. 4295-4299.
4. Tara N Sainath, Ron J Weiss, Andrew W Senior, Kevin W Wilson, Oriol Vinyals, "Learning the speech front-end with raw waveform CLDNNs., " in Interspeech, 2015, vol. 2015.
5. Pegah Ghahremani, Vimal Manohar, Daniel Povey, Sanjeev Khudanpur, "Acoustic modelling from the signal domain using CNNs, " in Interspeech, 2016, vol. 2016.
6. Douglas B. Paul and Janet M. Baker, "The design for the Wall Street Journal-based CSR corpus, " in Proceedings of the Workshop on Speech and Natural Language, Stroudsburg, PA, USA, 1992, HLT '91, pp. 357-362, Association for Computational Linguistics.
7. Alex Graves, Santiago Fernández, Faustino Gomez, Jürgen Schmidhuber, "Connectionist temporal classification: Labelling unsegmented sequence data with recurrent neural networks, " in Proceedings of the 23rd International Conference on Machine learning. ACM, 2006, pp. 369-376.
8. Alex Graves, Abdel Rahman Mohamed, Geoffrey Hinton, "Speech recognition with deep recurrent neural networks, " in Acoustics, Speech and Signal processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 6645-6649.
9. Dario Amodei, Rishita Anubhai, Eric Battenberg, Carl Case, Jared Casper, Bryan Catanzaro, JingDong Chen, Mike Chrzanowski, Adam Coates, Greg Diamos, et al., "Deep speech 2: End-to-end speech recognition in English and Mandarin, " in Proceedings of The 33rd International Conference on Machine Learning, 2016, pp. 173-182.
10. Jan Chorowski, Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio, "End-to-end continuous speech recognition using attention-based recurrent NN: First results, " arXiv preprint arXiv:1412.1602, 2014.
11. William Chan, Navdeep Jaitly, Quoc Le, Oriol Vinyals, "Listen, attend and spell: A neural network for large vocabulary conversational speech recognition, " in Acoustics, Speech and Signal Processing (ICASSP), 2016 IEEE International Conference on. IEEE, 2016, pp. 4960-4964.
12. Ronan Collobert, Christian Puhrsch, Gabriel Synnaeve, "Wav2letter: An end-to-end convnetbased speech recognition system, " arXiv preprint arXiv:1609.03193, 2016.
13. Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio, "Neural machine translation by jointly learning to align and translate, " arXiv preprint arXiv:1409.0473, 2014.
14. Minh-Thang Luong, Hieu Pham, Christopher D Manning, "Effective approaches to attentionbased neural machine translation, " arXiv preprint arXiv:1508.04025, 2015.
15. Yann LeCun, Bernhard Boser, John S Denker, Donnie Henderson, Richard E Howard, Wayne Hubbard, Lawrence D Jackel, "Backpropagation applied to handwritten zip code recognition, " Neural computation, vol. 1, no. 4, pp. 541-551, 1989.
16. Min Lin, Qiang Chen, Shuicheng Yan, "Network in network, " arXiv preprint arXiv:1312.4400, 2013.
17. Sepp Hochreiter and Jürgen Schmidhuber, "Long shortterm memory, " Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997.
18. Jost Tobias Springenberg, Alexey Dosovitskiy, Thomas Brox, Martin Riedmiller, "Striving for simplicity: The all convolutional net, " arXiv preprint arXiv:1412.6806, 2014.
19. Daniel Povey, Arnab Ghoshal, Gilles Boulianne, Lukas Burget, Ondrej Glembek, Nagendra Goel, Mirko Hannemann, Petr Motlicek, Yanmin Qian, Petr Schwarz, Jan Silovsky, Georg Stemmer, Karel Vesely, "The Kaldi speech recognition toolkit, " in IEEE 2011 Workshop on Automatic Speech Recognition and Understanding. Dec. 2011, IEEE Signal Processing Society, IEEE Catalog No.: CFP11SRW-USB.
20. Awni Y Hannun, Andrew L Maas, Daniel Jurafsky, Andrew Y Ng, "First-pass large vocabulary continuous speech recognition using bi-directional recurrent DNNs, " arXiv preprint arXiv:1408.2873, 2014.
21. Andrew L Maas, Awni Y Hannun, Andrew Y Ng, "Rectifier nonlinearities improve neural network acoustic models, " in in ICML Workshop on Deep Learning for Audio, Speech and Language Processing, 2013.
22. Alex Graves, "Supervised sequence labelling, " in Supervised Sequence Labelling with Recurrent Neural Networks, pp. 5-13. Springer, 2012.
23. Dzmitry Bahdanau, Jan Chorowski, Dmitriy Serdyuk, Philemon Brakel, Yoshua Bengio, "End-to-end attention-based large vocabulary speech recognition, " in Acoustics, Speech and Signal Processing (ICASSP), 2016 IEEE International Conference on. IEEE, 2016, pp. 4945-4949.
24. Diederik Kingma and Jimmy Ba, "Adam: A method for stochastic optimization, " arXiv preprint arXiv:1412.6980, 2014.
25. Suyoun Kim, Takaaki Hori, ShinjiWatanabe, "Joint CTC-attention based end-to-end speech recognition using multi-task learning, " in Acoustics, Speech and Signal processing (ICASSP), 2017 IEEE International Conference on. IEEE, 2017, p. to appear.
26. Yoshua Bengio, Aaron Courville, Pascal Vincent, "Representation learning: A review and new perspectives, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 8, pp. 1798-1828, 2013.
27. Jason Yosinski, Jeff Clune, Yoshua Bengio, Hod Lipson, "How transferable are features in deep neural networks?, " in Advances in neural information processing systems, 2014, pp. 3320-3328.
28. Amit Das and Mark Hasegawa-Johnson, "Cross-lingual transfer learning during supervised training in low resource scenarios., " in INTERSPEECH, 2015, pp. 3531-3535.
29. Frantisek Grézl, Martin Karafiát, Stanislav Kontár, Jan Cernocky, "Probabilistic and bottle-neck features for LVCSR of meetings, " in Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on. IEEE, 2007, vol. 4, pp. IV-757.
30. Z.J. Yan, Q. Huo, J. Xu, "A scalable approach to using DNN-derived features in GMM-HMM based acoustic modeling for LVCSR, " in Proc. INTERSPEECH, 2013.
31. K. Vesely, M. Karafiát, F. Grézl, "Convolutive bottleneck network features for LVCSR, " in Proc. ASRU, Waikoloa, USA, 2011, pp. 42-47.