Continuous articulatory-to-acoustic mapping using phone-based trajectory HMM for a silent speech interface

13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012

Volumn 1, Issue , 2012, Pages 722-725

  Hueber, Thomas ^a   Bailly, Gérard ^a   Denby, Bruce ^b  

^a GIPSA LAB   (France)

^b PSL RESEARCH UNIVERSITY   (France)

Author keywords

Audiovisual speech processing; Handicap; HMM based speech synthesis; Silent speech interface

Indexed keywords

AUDIOVISUAL SPEECH PROCESSING; COVARIANCE MATRICES; HANDICAP; HIDDEN MARKOV MODEL(HMM); HMM-BASED SPEECH SYNTHESIS; MULTIVARIATE GAUSSIAN DISTRIBUTIONS; PERCEPTUAL EVALUATION; SILENT SPEECH INTERFACES;

COVARIANCE MATRIX; HIDDEN MARKOV MODELS; SPEECH SYNTHESIS; ULTRASONIC APPLICATIONS;

TRAJECTORIES;

EID: 84878391491     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Denby, B., Schultz, T., Honda, K., Hueber, T., et al., "Silent Speech Interfaces," Speech Communication, vol. 52, no. 4, pp. 270-287, 2010.
2. Schultz, T., Wand, M., "Modeling coarticulation in EMG-based continuous speech recognition", Speech Communication, vol. 52, no. 4, pp. 341-353, 2010.
3. Tran, V.-A., Bailly, G., Loevenbruck, H., Toda, T., "Improvement to a NAM-captured whisper-to-speech system", Speech Communication, vol. 52, no. 4, pp. 314-326, 2010.
4. Gilbert, JM., Rybchenko, SI., Hofe, R., et. al. "Isolated word recognition of silent speech using magnetic implants and sensors", Med. Eng. and Physics, vol. 32, no. 10, pp. 1189-1197, 2010.
5. Hueber, T., Benaroya, E.L., Chollet, G., Denby, B., Dreyfus, G., Stone, M., "Development of a Silent Speech Interface Driven by Ultrasound and Optical Images of the Tongue and Lips", Speech Communication, 52(4), pp. 288-300, 2010.
6. Hueber, T., Benaroya, E.L, Denby, B., Chollet, G., "Statistical Mapping between Articulatory and Acoustic Data for an Ultrasound-based Silent Speech Interface", in Proc. of Interspeech, pp. 593-596, Firenze, Italia, 2011.
7. Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., Kitamura, T., "Speech parameter generation algorithms for HMM-based speech synthesis", in Proc. of ICASSP, pp. 1315-1318, 2000.
8. Cai, J., Hueber, T. Denby, B., et al. "A Visual Speech Recognition System for an Ultrasound-based Silent Speech Interface", in Proc. of ICPhS, pp. 384-387, 2011.
9. Toda, T., Black, A.W., Tokuda, K., "Statistical mapping between articulatory movements and acoustic spectrum using a Gaussian mixture model", Speech Comm., vol. 50, no. 3, pp. 215-227, 2008.
10. Zen, H., Nankaku, Y., Tokuda, K., "Continuous Stochastic Feature Mapping Based on Trajectory HMMs", IEEE Trans. on Audio, Speech, and Language Processing, vol. 19, no. 2, pp. 417-430, 2011.
11. M. Kay., S, "Fundamentals of Statistical Signal Processing: Estimation Theory", Prentice Hall, 1993.
12. Hueber, T., Chollet, G., Denby, B., Stone, M., "Acquisition of ultrasound, video and acoustic speech data for a silent-speech interface application", in Proc. of ISSP, pp. 365-369, 2008.
13. Kominek, J. and Black, A., "The CMU Arctic speech databases", in Proc. of the 5th Speech Synthesis Workshop, pp 223-224, 2004.
14. Hueber, T., Aversano, G., Chollet, G., Denby, B., et al. "Eigentongue Feature Extraction for an Ultrasound-Based Silent Speech Interface", in Proc. of ICASSP, pp. I1245-I1248, 2007.
15. Feng, G., Hu, F., Zhou, Z., "A direct locality preserving projections (DLPP) algorithm for image recognition", Neural Processing Letters, vol. 27, no. 3, pp.1370-4621, 2008.
16. Kawahara, H., Morise, M., et al., "Tandem-STRAIGHT: A temporally stable power spectral representation for periodic signals and applications to interference-free spectrum, F0, and aperiodicity estimation", in Proc. of ICASSP, pp. 3933-3936, 2008.
17. Muramatsu, T., Ohtani, Y., Toda, T., Saruwatari, H., Shikano, K., "Low-delay voice conversion based on maximum likelihood estimation of spectral parameter trajectory", in Proc. of Interspeech, pp. 1076-1079, 2008.