Across-speaker articulatory normalization for speaker-independent silent speech recognition

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2014, Pages 1179-1183

  Wang, Jun ^a,b   Samal, Ashok ^c   Green, Jordan R ^d  

^a The University of Texas at Dallas   (United States)

^b UNIVERSITY OF TEXAS AT DALLAS   (United States)

^c UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^d MGH INSTITUTE OF HEALTH PROFESSIONS   (United States)

Author keywords

Procrustes analysis; Silent speech recognition; Speech kinematics; Support vector machine

Indexed keywords

AUDIO ACOUSTICS; INFORMATION USE; SPEECH; SPEECH COMMUNICATION; SUPPORT VECTOR MACHINES;

ARTICULATORY INFORMATIONS; CLASSIFICATION ACCURACY; NEUROLOGICAL DISEASE; PROCRUSTES ANALYSIS; RECOGNITION ACCURACY; REGRESSION TECHNIQUES; ROTATIONAL EFFECTS; SILENT SPEECH INTERFACES;

SPEECH RECOGNITION;

EID: 84910051225     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (40)

1. Bailey, B. J., Johnson, J. T., and Newlands, S. D., Head and Neck Surgery - Otolaryngology, Lippincot, Williams & Wilkins, Philadelphia, PA, USA, 4th Ed., 1779-1780, 2006.
2. Liu, H., & Ng, M. L. "Electrolarynx in voice rehabilitation, " Auris Nasus Larynx, 34(3):327-332, 2007.
3. Denby, B., Schultz, T., Honda, K., Hueber, T., Gilbert, J. M., and Brumberg, J. S. "Silent speech interfaces", Speech Communication, 52:270-287, 2010.
4. Wang, J., Samal, A., Green, J. R., & Carrell, T. D. "Vowel recognition from articulatory position time-series data, " Proc. IEEE Intl. Conf. on Signal Processing and Communication Systems, Omaha, NE, 1-6, 2009.
5. Wang, J. Silent speech recognition from articulatory motion, Ph.D. Dissertation, Dept. of Comp. Sci., Univ. of Nebraska, Lincoln, NE, 2011.
6. Huang, X. D., Acero, A., Hon, H.-W., Ju, Y.-C., Liu, J., Meredith, S., and Plumpe, M., "Recent Improvements on Microsoft's Trainable Text-to-Speech System: Whistler, " Proc. IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, 959-962, 1997.
7. Khan, Z. A., Green, P., Creer, S., and Cunningham, S. "Reconstructing the voice of an individual following laryngectomy, " Augmentative and Alternative Communication, 27(1):61-66, 2011.
8. Hueber, T., Benaroya, E.-L., Chollet, G., Denby, B., Dreyfus, G., Stone, M., "Development of a silent speech interface driven by ultrasound and optical images of the tongue and lips", Speech Communication, 52:288-300, 2010.
9. Denby, B., Cai, J., Roussel, P., Dreyfus, G., Crevier-Buchman, L., Pillot-Loiseau, C., Hueber, and T., Chollet, G., "Tests of an interactive, phrasebook-style post-laryngectomy voicereplacement system", the 17th International Congress on Phonetic Sciences, Hong Kong, China, 572-575, 2011.
10. Jorgensen, C. and Dusan, S., "Speech interfaces based upon surface electromyography", Speech Communication, 52:354- 366, 2010.
11. Heaton, J. T., Robertson, M., and Griffin, C., "Development of a wireless electromyographically controlled electrolarynx voice prosthesis", Proc. IEEE Intl. Conf. on Engineering in Medicine & Biology Society, Boston, MA, 5352-5355, 2011.
12. Fagan, M. J., Ell, S. R., Gilbert, J. M., Sarrazin, E., and Chapman, P. M., "Development of a (silent) speech recognition system for patients following laryngectomy", Medical Engineering & Physics, 30(4):419-425, 2008.
13. Wang, J., Samal, A., and Green, J. R., "Preliminary test of a realtime, interactive silent speech interface based on electromagnetic articulograph, " ACL/ISCA Workshop on Speech and Language Processing for Assistive Technologies, 2014 (In press).
14. Kent, R. D., Adams, S. G., and Tuner, G. S. Models of speech production. Lass, N. J. : Principles of experimental Phonetics. Mosby, 1996.
15. Kent, R. D., and Minifie, F. D., "Coarticulation in recent speech production models", Journal of Phonetics, 5(2):115-133, 1977.
16. Hashi, M., Westbury, J. R., and Honda, K., "Vowel posture normalization, " Journal of Acoustical Society of America, 104(4):2426-2437, 1982.
17. Johnson, K., Ladefoged, P., and Lindau, M., "Individual differences in vowel production, " Journal of Acoustical Society of America, 94(2):701-714, 1993.
18. Simpson, A. P., Gender-specific differences in the articulatory and acoustics realization of interword vowel sequences in American English, In Philip Hoole, Masaaki Honda, & Christine Mooshammer (eds.), 5th Seminar on Speech Production: Models and Data. Kloster Seeon, 209-212, 2000.
19. Westbury, J. H., Hashi, M., and Lindstrom, M. J., "Differences among speakers in lingual articulation for American English/r/, " Speech Communication, 26(3):203-226, 1998.
20. Felps, D. and Gutierrez-Osuna, R., "Normalization of articulatory data through Procrustes transformations and analysis-by-synthesis, " Technical Report, Texas A&M University, 2010-5-3.
21. Li, S. and Wang, L., "Cross linguistic comparison of Mandarin and English EMA articulatory data, " Interspeech, Portland, OR, 903-906, 2012.
22. Dryden I. L. and Mardia, K.V., Statistical shape analysis, Hoboken: John Wiley, 1998.
23. Wang, J., Samal, A., Green, J. R., and Rudzicz, F., "Whole-word recognition from articulatory movements for silent speech interfaces", Interspeech, Portland, OR, 1327-30, 2012.
24. Wang, J., Balasubramanian, A., Mojica de La Vega, L., Green, J. R., Samal, A., and Prabhakaran, B., "Word recognition from continuous articulatory movement time-series data using symbolic representations, " ACL/ISCA Interspeech Workshop on Speech and Language Processing for Assistive Technologies, Grenoble, France, 119-127, 2013.
25. Wang, J., Green, J. R., Samal, A. and Yunusova, Y. "Articulatory distinctiveness of vowels and consonants: A datadriven approach, " Journal of Speech, Language, and Hearing Research, 56:1539-1551, 2013.
26. Wang, J., Green, J. R., Samal, A., and Marx, D. B. "Quantifying articulatory distinctiveness of vowels", Interspeech, Florence, Italy, 277-280, 2011.
27. Wang, J., Samal, A., Green, J. R., and Rudzicz, F., "Sentence recognition from articulatory movements for silent speech interfaces", Proc. IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, 4985-4988, 2012.
28. Boser, B., Guyon, I., Vapnik, V., "A training algorithm for optimal margin classifiers", Conf. on Learning Theory (COLT), 144-152, 1992.
29. Chang, C. -C., and Lin C. -J., "LIBSVM: A library for support vector machines", ACM Trans. on Intelligent Systems and Technology, 2(27):1-27, 2011.
30. Wang, J., Green, J. R., Samal, A., and Carrell, T. D., "Vowel recognition from continuous articulatory movements for speakerdependent applications, " Proc. IEEE Intl. Conf. on Signal Processing and Communication Systems, 1-7, 2010.
31. Green, J. R., Wang, J., and Wilson, D. L., "SMASH: A tool for articulatory data processing and analysis", Interspeech, Lyon, France, 1331-35, 2013.
32. Yunusova, Y., Green, J. R., and Mefferd, A., "Accuracy assessment for AG500 electromagnetic articulograph", Journal of Speech, Language, and Hearing Research, 52(2):547-555, 2009.
33. Katz, W., Bharadwaj, S., Rush, M., and Stettler, M., "Influences of EMA receiver coils on speech production by normal and aphasic/apraxic talkers", Journal of Speech, Language, and Hearing Research, 49:645-659, 2006.
34. Green, J. R. and Wang, Y., "Tongue-surface movement patterns during speech and swallowing", Journal of Acoustical Society of America, 113:2820-2833, 2003.
35. Westbury, J. X-ray microbeam speech production database user's handbook. University of Wisconsin, 1994.
36. Wang, J., Green, J. R., & Samal, A., "Individual articulator's contribution to phoneme production", Proc. IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, Vancouver, Canada, 7795-89, 2013.
37. King, S., Frankel, J., Livescu, K., McDermott, E., Richmond, K., and Wester, M., "Speech production knowledge in automatic speech recognition, " Journal of the Acoustical Society of America, 121(2):723-742, 2007.
38. Rudzicz, F., "Articulatory knowledge in the recognition of dysarthric speech, " IEEE Transactions on Audio, Speech, and Language Processing, 19(4):947-960, 2011.
39. Katz, W. F., Campbell, T. F., Wang, J., Farrar, E., Eubanks, J. C., Balasubramanian, A., Prabhakaran, B., and Rennaker, R., "Opti-speech: A real-time, 3D visual feedback system for speech training", Interspeech, Singapore, 2014 (In press).
40. Ouni, S. "Tongue control and its implication in pronunciation training, " Computer Assisted Language Learning, 16:1-15, 2013.