Speech interfaces based upon surface electromyography

Speech Communication

Volumn 52, Issue 4, 2010, Pages 354-366

  Jorgensen, Charles ^a   Dusan, Sorin ^a  

^a NASA AMES RESEARCH CENTER   (United States)

Author keywords

Articulatory synthesis; Bioelectric control; Electromyography; EMG; Speech recognition; Speech synthesis

Indexed keywords

ACOUSTIC SPEECH; ARTICULATORY SYNTHESIS; BIOELECTRIC CONTROL; BREATHING APPARATUS; CLEAR SPEECH; EMG; EMG SIGNAL; EXPERIMENT TESTING; HIGH NOISE; LESSONS LEARNED; ROBOTIC PLATFORMS; SPEECH INTERFACE; SPEECH SYNTHESIZER; SURFACE ELECTROMYOGRAPHY;

ACOUSTICS; ELECTROMYOGRAPHY; EXPERIMENTS; FIRE EXTINGUISHERS; LINGUISTICS; MANNED SPACE FLIGHT; SPEECH ANALYSIS; SPEECH PROCESSING; SPEECH SYNTHESIS;

SPEECH RECOGNITION;

EID: 76849089845     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2009.11.003     Document Type: Article

References (34)

1. Betts B.J., Binsted K., and Jorgensen C. Small-vocabulary speech recognition using surface electromyography. Interact. Computers: Interdiscip. J. Human-Computer Interact. 18 (2006) 1242-1259
2. Birkholz, P., Steiner, I., Breuer, S., 2007. Control concepts for articulatory speech synthesis. In: 6th ISCA Workshop on Speech Synth.
3. Brady, K., Quatieri, T.F., Campbell, J.P., Campbell, W.M., Brandstein, M., Weinstein, C.J., 2004. Multisensor MELPe using parameter substitution. In: Proc. IEEE Internat. Conf. on Acoust. Speech Signal Process., Vol. 1. pp. 477-480.
4. Carnegie Mellon University Robotics. The Personal Exploration Rover. .
5. Chan A.D.C., and Englehart K. Continuous myoelectric control for powered prostheses using hidden Markov models. IEEE Trans. Biomed. Eng. 52 1 (2005) 121-124
6. Coker C., and Fujimura O. Model for specification of the vocal-tract area function. J. Acoust. Soc. Amer. 40 (1966) 1271
7. De Luca, C.J., 2005. Imaging the Behavior of Motor Units by Decomposition of the EMG Signal. .
8. Dusan, S., Deng, L., 2000. Acoustic-to-articulatory inversion using dynamical and phonological constraints. In: Proc. 5th Seminar on Speech Production: Models and Data, Kloster Seeon, Germany, May 1-4, 2000.
9. Faaborg-Andersen K. Electromyographic investigation of intrinsic laryngeal muscles in humans: an investigation of subjects with normally movable vocal cords and patients with vocal cord paresis. Acta Physiol. Scand. 41 140 (1957) 1-148
10. Gerdle B., Karlsson S., Day S., and Djupsjobacka M. Acquisition, processing and analysis of the surface electromyogram. In: Windhorst U., and Johansson H. (Eds). Modern Techniques in Neuroscience (1999), Springer Verlag, Berlin 705-755
11. Graciarena M., Franco H., Sonmez K., and Bratt H. Combining standard and throat microphones for robust speech recognition. IEEE Signal Process. Lett. 10 3 (2003) 72-74
12. Jorgensen, C., Binsted, K., 2005. Web browser control using EMG based sub vocal speech recognition. In: Proc. 38th Ann. Hawaii Internat. Conf. on System Sci. (HICSS). pp. 294c.1-294c.8.
13. Jorgensen, C., Lee, D.D., Agabon, S., 2003. Sub auditory speech recognition based on EMG signals. In: Proc. Internat. Joint Conf. on Neural Networks (IJCNN). pp. 3128-3133.
14. Jou, S.-C., Schultz, T., Waibel, A., 2005. Whispery speech recognition using adapted articulatory features. In: Proc. IEEE Internat. Conf. of Acoust. Speech Signal Process. pp. 1009-1012.
15. Junqua J.-C. The Lombard reflex and its role on human listeners and automatic speech recognizers. J. Acoust. Soc. Amer. 93 1 (1993) 512-524
16. Junqua, J.-C., Fincke, S., Field, K., 1999. The Lombard effect: a reflex to better communicate with others in noise. In: Proc. IEEE Internat. Conf. on Acoust. Speech Signal Process. (ICASSP). pp. 2083-2086.
17. Kingsbury N. Complex wavelets for shift invariant analysis and filtering of signals. Appl. Comput. Harmonic Anal. 10 3 (2001) 234-253
18. Laboissière, R., Galván, A., 1995. Inferring the commands of an articulatory model from acoustical specifications of stop/vowel sequences. In: Proc. ICPhS, Vol. 1. pp. 358-361.
19. Maeda S. An articulatory model of the tongue based on a statistical analysis. J. Acoust. Soc. Amer. 65 (1979) S22
20. Maeda, S., 1982. A digital simulation method of the vocal-tract system. Speech Comm.
21. Maeda S. Improved articulatory model. J. Acoust. Soc. Amer. 84 (1988) S146
22. McCowan I., Moore D., Dines J., Gatica-Perez D., Flynn M., Wellner P., and Bourlard H. On the use of information retrieval measures for speech recognition evaluation. IDIAP Res. Rep. 04 (2005) 73
23. McGowan R., and Lee M. Task dynamic and articulatory recovery of lip and velar approximations under model mismatch conditions. J. Acoust. Soc. Amer. 99 1 (1996) 595-608
24. Mendes J.A.G., Robson R.R., Labidi S., and Barros A.K. Subvocal speech recognition based on EMG signal using independent component analysis and neural network MLP. IEEE Computer Soc. Congress Image Signal Process. (2008)
25. Mermelstein P. Articulatory model for the study of speech production. J. Acoust. Soc. Amer. 53 4 (1973) 1070-1082
26. Meyer P., Wilhelms R., and Strube H. An efficient vocal tract model running in real time. Signal Process. III (1986) 377-380
27. Ng, L.C., Burnett, G.C., Holzrichter, J.F., Gable, T.J., 2000. Denoising of human speech using combined acoustic and EM sensor signal processing. In: Proc. 2000 IEEE Internat. Conf. on Acoust. Speech Signal Process. (ICASSP'00), Vol. 1. pp. 229-232.
28. Perrier P., Boë L., and Stock R. Vocal-tract function estimation from midsagittal dimensions with CT scans and a vocal-tract cast: modeling the transition with two sets of coefficients. J. Speech Hear. Res. 35 (1992) 53-67
29. Rubin P., Baer T., and Mermelstein P. An articulatory synthesizer for perceptual research. J. Acoust. Soc. Amer. 70 2 (1981) 321-328
30. Saltzman E.L., and Munhall K.G. A dynamical approach to gestural patterning in speech production. Ecol. Psychol. 1 4 (1989) 333-382
31. Shahina, A., Yegnanarayana, B., 2005. Language identification in noisy environments using throat microphone signals. In: Proc. 2005 Internat. Conf. of Intelligent Sensing and Information Process. (ICISIP'05). pp. 400-403.
32. Steiner, I., Richmond, K., 2008. Generating gestural timing from EMA data using articulatory resynthesis. In: 8th Internat. Seminar on Speech Production.
33. Trejo L.J., Wheeler K.R., Jorgensen C.C., Rosipal R., Clanton S.T., Matthews B., Hibbs A.D., Matthews R., and Krupka M. Multimodal neuroelectric interface development. IEEE Trans. Neural Systems Rehabil. Eng. 11 2 (2003) 199-204
34. Wheeler K.R., and Jorgensen C.C. Gestures as input: neuroelectric joysticks and keyboards. IEEE Pervasive Comput. 2 2 (2003) 56-61