Direct conversion from facial myoelectric signals to speech using Deep Neural Networks

Proceedings of the International Joint Conference on Neural Networks

Volumn 2015-September, Issue , 2015, Pages

  Diener, Lorenz ^a   Janke, Matthias ^a   Schultz, Tanja ^a  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

Author keywords

Electromyography

Indexed keywords

ELECTROMYOGRAPHY; MAPPING; SPEECH; SPEECH ANALYSIS; SPEECH SYNTHESIS;

DEEP NEURAL NETWORKS; DIRECT CONVERSION; ELECTROMYOGRAPHIC; EVALUATION CRITERIA; GAUSSIAN MIXTURE MODEL; MAPPING TECHNIQUES; MYOELECTRIC SIGNALS; SUBJECTIVE LISTENING TEST;

SPEECH COMMUNICATION;

EID: 84951114437     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2015.7280404     Document Type: Conference Paper

References (23)

1. B. Denby, T. Schultz, K. Honda, T. Hueber, and J. Gilbert, "Silent Speech Interfaces," Speech Communication, 52(4):270-287, 2010.
2. A. D. C. Chan, K. Englehart, B. Hudgins, D. F. Lovely, D. F., "Hidden Markov Model Classification of Myolectric Signals in Speech," IEEE Engineering in Medicine and Biology Society, vol. 21, no. 5, pp. 143-146, 2002.
3. S.-c. Jou, T. Schultz, M. Walliczek, F. Kraft, and A. Waibel, "Towards Continuous Speech Recognition using Surface Electromyography,", Proceedings of the Annual Conference of the International Speech Communication Association (lnterspeech), pp. 573-576, 2006.
4. A. R. Toth, M. Wand, and T. Schultz, "Synthesizing Speech from Electromyography using Voice Transformation Techniques," Proceedings of Interspeech 2009, pp. 652-655, 2009.
5. T. Toda and K. Shikano, "NAM-to-Speech Conversion with Gaussian Mixture Models," Proceedings of Interspeech 2005, pp. 1957-1960, 2005.
6. K. Nakamura, M. Janke, M. Wand, and T, Schultz "Estimation of Fundamental Frequency from Surface Electromyographic Data: EMGto-FO," Proceedings of International Conference on Acoustics, Speech and Signal Processing (ICASSP),pp. 573-576, 2011.
7. M. Zahner, M. Janke, M. Wand, and T. Schultz, "Conversion from Facial Myoelectric Signals to Speech: A Unit Selection Approach", Proceedings of the Annual Conference of the International Speech Communication Association (Interspeech), pp. 1184-1188, 2014.
8. T. Tsuji, N. Bu, J. Arita, and M. Ohga. "A speech synthesizer using facial EMG signals", International Journal of Computational Intelligence and Applications, pp. 1-15, 2008.
9. F. Bocquelet, T. Hueber, L. Girin, P. Badin, and B. Y vert, "Robust Articulatory Speech Synthesis using Deep Neural Networks for BCI Applications", Proceedings of the Annual Conference of the International Speech Communication Association (lnterspeech), pp. 2288-2292, 2014.
10. M. Janke, M. Wand, K. Nakamura, and T. Schultz, "Further Investigations on EMG-to-Speech Conversion", IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 365-368, 2012.
11. S. Imai, "Cepstral Analysis Synthesis on the Mel Frequency Scale", IEEE International Conference on Acoustics, Speech, and Signal Processing Vol. 8, pp. 93-96, 1983.
12. M. Wand, C. Schulte, M. Janke, and T. Schultz "Array-based Electromyographic Silent Speech Interface", International Conference on Bio-inspired Systems and Signal Processing (BIOSIGNALS), pp. 89-96, 2013.
13. L. Maier-Hein, F. Metze, T. Schultz, and A. Waibel, "Session Independent Non-Audible Speech Recognition Using Surface Electromyography", IEEE Workshop on Automatic Speech Recognition and Understanding, pp. 331-336, 2005.
14. T. Schultz, and M. Wand, "Modeling Coarticulation in Large Vocabulary EMG-based Speech Recognition", Speech Communication, 52(4):341-353, 2010.
15. J. Kominek, and A. W. Black, "The CMU Arctic speech databases" In Fifth ISCA Workshop on Speech Synthesis, pp. 223-224, 2004.
16. J. Garofolo, L. Lamel, W. Fisher, L. Fiscus, D. Pallett, and N. Dahlgren "DARPA TIMlT: Acoustic-Phonetic Continuous Speech Corpus", National Institute of Standards and Technology, 1993.
17. D. Yu, A. Eversole, M. Seltzer, K. Yao, Z. Huang, B. Guenter, O. Kuchaiev, Y. Zhang, F. Seide, H. Wang, J. Droppo, G. Zweig, C. Rossbach, J. Currey, J. Gao, A. May, B. Peng, A. Sto1cke, M. Slaney, "An Introduction to Computational Networks and the Computational Network Toolkit", Microsoft Technical Report MSR-TR-2014-112, 2014.
18. M. Janke, M. Wand, T. Heistermann, T. Schultz, K. Prahallad, "Fundamental Frequency Generation for Whisper-to-Audible Speech Conversion" IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2598-2602, 2014
19. T. Fukada, K. Tokuda, T. Kobayashi, and S. lmai, "An Adaptive Algorithm for Mel-Cepstral Analysis of Speech," IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 137-140, 1992.
20. S.-c. Jou, L. Maier-Hein, T. Schultz, and A. Waibel, "Articulatory Feature Classification using Surface Electromyography", IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 605-608, 2006.
21. E. J. Scheme, B. Hudgins, and P. A. Parker, "Myoelectric Signal Classification for Phoneme-based Speech Recognition", IEEE Transactions on Biomedical Engineering, 54(4), pp. 694-699, 2007.
22. R. F. Kubichek, "Mel-Cepstral Distance Measure for Objective Speech Quality Assessment", IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, pp. 125-128, 1993.
23. S. Kraft, U. Zlzer: "BeaqleJS: HTML5 and JavaScript based Framework for the Subjective Evaluation of Audio Quality", Linux Audio Conference, 2014.