Robust articulatory speech synthesis using deep neural networks for BCI applications

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2014, Pages 2288-2292

  Bocquelet, Florent ^a,b,c,d   Hueber, Thomas ^d   Girin, Laurent ^d   Badin, Pierre ^d   Yvert, Blaise ^a,b,c  

^a INSERM   (France)

^b UNIV GRENOBLE ALPES   (France)

^c CEA GRENOBLE   (France)

^d GIPSA LAB   (France)

Author keywords

Articulatory speech synthesis; Brain computer interface (BCI); Deep auto encoder; Deep neural networks; Dimensionality reduction; EMA; Noise robustness

Indexed keywords

BEHAVIORAL RESEARCH; BRAIN COMPUTER INTERFACE; INTERFACES (COMPUTER); LEARNING SYSTEMS; SPEECH COMMUNICATION; SPEECH SYNTHESIS;

AUTO ENCODERS; DEEP NEURAL NETWORKS; DIMENSIONALITY REDUCTION; EMA; NOISE ROBUSTNESS;

SPEECH RECOGNITION;

EID: 84910066630     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. V. Gilja, P. Nuyujukian, C. a Chestek, J. P. Cunningham, B. M. Yu, J. M. Fan, M. M. Churchland, M. T. Kaufman, J. C. Kao, S. I. Ryu, and K. V Shenoy, "A high-performance neural prosthesis enabled by control algorithm design", Nat. Neurosci., vol. 15, no. 12, pp. 1752-7, Dec. 2012.
2. M. Velliste, S. Perel, M. C. Spalding, A. S. Whitford, and A. B. Schwartz, "Cortical control of a prosthetic arm for selffeeding", Nature, vol. 453, no. 7198, pp. 1098-101, Jun. 2008.
3. J. L. Collinger, B. Wodlinger, J. E. Downey, W. Wang, E. C. Tyler-Kabara, D. J. Weber, A. J. C. McMorland, M. Velliste, M. L. Boninger, and A. B. Schwartz, "High-performance neuro prosthetic control by an individual with tetraplegia", Lancet, vol. 381, no. 9866, pp. 557-64, Feb. 2013.
4. L. R. Hochberg, D. Bacher, B. Jarosiewicz, N. Y. Masse, J. D. Simeral, J. Vogel, S. Haddadin, J. Liu, S. S. Cash, P. van der Smagt, and J. P. Donoghue, "Reach and grasp by people with tetraplegia using a neurally controlled robotic arm", Nature, vol. 485, no. 7398, pp. 372-5, May 2012.
5. J. S. Brumberg and F. H. Guenther, "Development of speech prostheses: current status and recent advances", Expert Rev. Med. Devices, vol. 7, no. 5, pp. 667-79, Sep. 2010.
6. F. H. Guenther, J. S. Brumberg, E. J. Wright, A. Nieto- Castanon, J. A Tourville, M. Panko, R. Law, S. a Siebert, J. L. Bartels, D. S. Andreasen, P. Ehirim, H. Mao, and P. R. Kennedy, "A wireless brain-machine interface for real-time speech synthesis", PLoS One, vol. 4, no. 12, p. e8218, Jan. 2009.
7. S. Maeda, "Compensatoy Articulation During Speech: Evidence from the analysis and Synthesis of Vocal-Tract shapes using an articulatory model", Speech Prod. Speech Model., pp. 131-149, 1990.
8. D. Beautemps, P. Badin, and G. Bailly, "Linear degrees of freedom in speech production: Analysis of cineradio- And labiofilm data and articulatory-acoustic modeling", J. Acoust. Soc. Am., vol. 109, no. 5, pp. 2165-2180, May 2001.
9. K. E. Bouchard, N. Mesgarani, K. Johnson, and E. F. Chang, "Functional organization of human sensorimotor cortex for speech articulation", Nature, vol. 495, no. 7441, pp. 327-32, Mar. 2013.
10. S. C. C. Silva, "Articulatory Analysis using a Codebook for Articulatory based Low BIt-Rate Speech Coding", in The 5th International Conference on Spoken Language Processing, 1998.
11. W. K. Lo and P. C. Ching, "Phone-based speech synthesis with neural network and articulatory control", Proceeding Fourth Int. Conf. Spok. Lang. Process. ICSLP '96, vol. 4, pp. 2227- 2230.
12. T. Hueber, E. Benaroya, B. Denby, and G. Chollet, "Statistical Mapping Between Articulatory and Acoustic Data for an Ultrasound-Based Silent Speech Interface", Proc. Inter speech, no. August, pp. 593-596, 2011.
13. T. Toda, A. W. Black, and K. Tokuda, "Statistical mapping between articulatory movements and acoustic spectrum using a Gaussian mixture model", Speech Commun., vol. 50, no. 3, pp. 215-227, Mar. 2008.
14. K. H. Wee, L. Turicc, and R. Sarpeshkar, "An Articulatory Speech-Prosthesis System", 2010 Int. Conf. Body Sens. Networks, pp. 133-138, Jun. 2010.
15. K. Richmond, P. Hoole, S. King, and I. Forum, "Announcing the Electromagnetic Articulography (Day 1) Subset of the mngu0 Articulatory Corpus", Proc. Inter speech, no. Day 1, pp. 1-4.
16. C. T. Kello and D. C. Plaut, "A neural network model of the articulatory-acoustic forward mapping trained on recordings of articulatory parameters", J. Acoust. Soc. Am., vol. 116, no. 4, p. 2354, 2004.
17. K. Tokuda, K. Oura, A. Tamamori, S. Sako, H. Zen, T. Nose, T. Takahashi, J. Yamagishi, and Y. Nankaku, "Speech Signal Processing Toolkit (SPTK)", http://sp-tk.sourceforge.net/.
18. H. Larochelle, Y. Bengio, and P. Lamblin, "Exploring Strategies for Training Deep Neural Networks", J. Mach. Learn. Res., vol. 1, pp. 1-40, 2009.
19. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks", Science, vol. 313, no. 5786, pp. 504-7, Jul. 2006.
20. G. Hinton, "A Practical Guide to Training Restricted Boltzmann Machines A Practical Guide to Training Restricted Boltzmann Machines", Comput. Sci., vol. 7700, pp. 599-619.
21. L. van der Maaten, "Matlab Toolbox for Dimensionality Reduction", http://homepage.tudelft.nl/19j49/Matlab-Toolbox-for-Dimensionality-Reduction.html. .
22. L. J. P. Van Der Maaten, E. O. Postma, and H. J. Van Den Herik, "Dimensionality Reduction : A Comparative Review", J. Mach. Learn. Res., no. January, 2008.
23. D. Quade, "Using Weighted Rankings in the Analysis of Complete Blocks with Additive Block Effects", J. Am. Stat. Assoc., vol. 74, no. 367, pp. 680-683, Sep. 1979.
24. M. Gales and S. Young, "The Application of Hidden Markov Models in Speech Recognition", Found. Trends® Signal Process., vol. 1, no. 3, pp. 195-304, 2007.
25. S. IMAI, "Cepstral analysis synthesis on the mel frequency scale", Acoust. Speech, Signal Process. IEEE Int. Conf. ICASSP, pp. 93-96, 1983.