Direct speech generation for a silent speech interface based on permanent magnet articulography

BIOSIGNALS 2016 - 9th International Conference on Bio-Inspired Systems and Signal Processing, Proceedings; Part of 9th International Joint Conference on Biomedical Engineering Systems and Technologies, BIOSTEC 2016

Volumn , Issue , 2016, Pages 96-105

  Gonzalez, Jose A ^a   Cheah, Lam A ^b   Gilbert, James M ^b   Bai, Jie ^b   Ell, Stephen R ^c   Green, Phil D ^a   Moore, Roger K ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b UNIVERSITY OF HULL   (United Kingdom)

^c CASTLE HILL HOSPITAL   (United Kingdom)

Author keywords

Silent speech interfaces; Speech rehabilitation; Speech synthesis and permanent magnet articulography

Indexed keywords

BIOMEDICAL ENGINEERING; BIOMIMETICS; PERMANENT MAGNETS; RESTORATION; SPEECH SYNTHESIS;

ACOUSTIC DOMAINS; ACOUSTIC SIGNALS; SILENT SPEECH INTERFACES; SIMULTANEOUS RECORDING; SPEAKER DEPENDENTS; SPEECH GENERATION; SPEECH REHABILITATION; TOTAL LARYNGECTOMIES;

SIGNAL PROCESSING;

EID: 84969166556     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.5220/0005754100960105     Document Type: Conference Paper

References (31)

1. Braz, D. S. A., Ribas, M. M., Dedivitis, R. A., Nishimoto, I. N., and Barros, A. P. B. (2005). Quality of life and depression in patients undergoing total and partial laryngectomy. Clinics, 60(2):135-142.
2. Byrne, A., Walsh, M., Farrelly, M., and O'Driscoll, K. (1993). Depression following laryngectomy. A pilot study. The British Journal of Psychiatry, 163(2):173-176.
3. Cheah, L. A., Bai, J., Gonzalez, J. A., Ell, S. R., Gilbert, J. M., Moore, R. K., and Green, P. D. (2015). A usercentric design of permanent magnetic articulography based assistive speech technology. In Proc. BioSignals, pages 109-116.
4. Chen, L.-H., Ling, Z.-H., Liu, L.-J., and Dai, L.-R. (2014). Voice conversion using deep neural networks with layer-wise generative training. IEEE/ACM Trans. Audio Speech Lang. Process., 22(12):1859-1872.
5. Danker, H., Wollbrück, D., Singer, S., Fuchs, M., Brähler, E., and Meyer, A. (2010). Social withdrawal after laryngectomy. European Archives of Oto-Rhino-Laryngology, 267(4):593-600.
6. De Jong, S. (1993). SIMPLS: an alternative approach to partial least squares regression. Chemometrics Intell. Lab. Syst., 18(3):251-263.
7. Denby, B., Schultz, T., Honda, K., Hueber, T., Gilbert, J., and Brumberg, J. (2010). Silent speech interfaces. Speech Commun., 52(4):270-287.
8. Fagan, M. J., Ell, S. R., Gilbert, J. M., Sarrazin, E., and Chapman, P. M. (2008). Development of a (silent) speech recognition system for patients following laryngectomy. Medical engineering & physics, 30(4):419-425.
9. Freitas, J., Teixeira, A., Bastos, C., and Dias, M. (2011). Speech Technologies, volume 10, chapter Towards a multimodal silent speech interface for European Portuguese, pages 125-150. InTech.
10. Fukada, T., Tokuda, K., Kobayashi, T., and Imai, S. (1992). An adaptive algorithm for Mel-cepstral analysis of speech. In Proc. ICASSP, pages 137-140.
11. Ghahramani, Z. and Hinton, G. E. (1996). The EM algorithm for mixtures of factor analyzers. Technical Report CRG-TR-96-1, University of Toronto.
12. Gilbert, J. M., Rybchenko, S. I., Hofe, R., Ell, S. R., Fagan, M. J., Moore, R. K., and Green, P. (2010). Isolated word recognition of silent speech using magnetic implants and sensors. Medical engineering & physics, 32(10):1189-1197.
13. Gonzalez, J. A., Cheah, L. A., Bai, J., Ell, S. R., Gilbert, J. M., 1, R. K. M., and Green, P. D. (2014). Analysis of phonetic similarity in a silent speech interface based on permanent magnetic articulography. In Proc. Interspeech, pages 1018-1022.
14. Herff, C., Heger, D., de Pesters, A., Telaar, D., Brunner, P., Schalk, G., and Schultz, T. (2015). Brain-to-text: decoding spoken phrases from phone representations in the brain. Frontiers in Neuroscience, 9 (217).
15. Hofe, R., Ell, S. R., Fagan, M. J., Gilbert, J. M., Green, P. D., Moore, R. K., and Rybchenko, S. I. (2013). Small-vocabulary speech recognition using a silent speech interface based on magnetic sensing. Speech Commun., 55(1):22-32.
16. Hueber, T., Benaroya, E.-L., Chollet, G., Denby, B., Dreyfus, G., and Stone, M. (2010). Development of a silent speech interface driven by ultrasound and optical images of the tongue and lips. Speech Commun., 52(4):288-300.
17. Hueber, T., Benaroya, E.-L., Denby, B., and Chollet, G. (2011). Statistical mapping between articulatory and acoustic data for an ultrasound-based silent speech interface. In Proc. Interspeech, pages 593-596.
18. Jou, S.-C., Schultz, T., Walliczek, M., Kraft, F., and Waibel, A. (2006). Towards continuous speech recognition using surface electromyography. In Proc. Interspeech, pages 573-576.
19. Kominek, J. and Black, A. W. (2004). The CMU Arctic speech databases. In Fifth ISCA Workshop on Speech Synthesis, pages 223-224.
20. Kubichek, R. (1993). Mel-cepstral distance measure for objective speech quality assessment. In Proc. IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, pages 125-128.
21. Leonard, R. (1984). A database for speaker-independent digit recognition. In Proc. ICASSP, pages 328-331.
22. Petajan, E. D. (1984). Automatic lipreading to enhance speech recognition (speech reading). PhD thesis, University of Illinois at Urbana-Champaign.
23. Schultz, T. and Wand, M. (2010). Modeling coarticulation in EMG-based continuous speech recognition. Speech Commun., 52(4):341-353.
24. Toda, T., Black, A. W., and Tokuda, K. (2007). Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory. IEEE Trans. Audio Speech Lang. Process., 15(8):2222-2235.
25. Toda, T., Black, A. W., and Tokuda, K. (2008). Statistical mapping between articulatory movements and acoustic spectrum using a Gaussian mixture model. Speech Commun., 50(3):215-227.
26. Toda, T., Nakagiri, M., and Shikano, K. (2012). Statistical voice conversion techniques for body-conducted unvoiced speech enhancement. IEEE Trans. Audio Speech Lang. Process., 20(9):2505-2517.
27. Toth, A. R., Kalgaonkar, K., Raj, B., and Ezzat, T. (2010). Synthesizing speech from Doppler signals. In Proc. ICASSP, pages 4638-4641.
28. Uria, B., Renals, S., and Richmond, K. (2011). A deep neural network for acoustic-articulatory speech inversion. In Proc. NIPS 2011 Workshop on Deep Learning and Unsupervised Feature Learning.
29. Wand, M., Janke, M., and Schultz, T. (2014). Tackling speaking mode varieties in EMG-based speech recognition. IEEE Trans. Bio-Med. Eng., 61(10):2515-2526.
30. Wang, J., Samal, A., Green, J. R., and Rudzicz, F. (2012). Sentence recognition from articulatory movements for silent speech interfaces. In Proc. ICASSP, pages 4985-4988.
31. Zahner, M., Janke, M., Wand, M., and Schultz, T. (2014). Conversion from facial myoelectric signals to speech: a unit selection approach. In Proc. Interspeech, pages 1184-1188.