Preliminary Test of a Real-Time, Interactive Silent Speech Interface Based on Electromagnetic Articulograph

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2014, Pages 38-45

  Wang, Jun ^a   Samal, Ashok ^b   Green, Jordan R ^c  

^a The University of Texas at Dallas   (United States)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^c MGH INSTITUTE OF HEALTH PROFESSIONS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH COMMUNICATION;

ELECTROMAGNETICS; MOVEMENT DATUM; ONLINE TESTS; ORAL COMMUNICATION; REAL- TIME; RECOGNITION ALGORITHM; SILENT SPEECH; SILENT SPEECH INTERFACES; SPEECH OUTPUT; VOICE IMPAIRMENTS;

SPEECH RECOGNITION;

EID: 85009518223     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (44)

1. American Cancer Society. 2013. Cancer Facts and Figures 2013. American Cancer Society, Atlanta, GA. Retrieved on February 18, 2014.
2. Bailey, B. J., Johnson, J. T., and Newlands, S. D. 2006. Head and Neck Surgery - Otolaryngology, Lippincot, Williams & Wilkins, Philadelphia, PA, USA, 4th Ed., 1779-1780.
3. Berry, J. 2011. Accuracy of the NDI wave speech research system, Journal of Speech, Language, and Hearing Research, 54:1295-1301.
4. Beukelman, D. R., and Gutmann, M. 1999. Generic Message List for AAC users with ALS. http://aac.unl.edu/ALS_Message_List1.htm
5. Broekx, L., Dreesen, K., Gemmeke, J. F., and Van Hamme, H. 2013. Comparing and combining classifiers for self-taught vocal interfaces, ACL/ISCA Workshop on Speech and Language Processing for Assistive Technologies, 21-28, 2013.
6. Chen, W.-H., Loke, W.-F., Thompson, G., and Jung, B. 2012. A 0.5V, 440uW frequency synthesizer for implantable medical devices, IEEE Journal of Solid-State Circuits, 47:1896-1907.
7. Dam, E. B., Koch, M., and Lillholm, M. 1998. Quaternions, interpolation and animation. Technical Report DIKU-TR-98/5, University of Copenhagen.
8. Denby, B., Cai, J., Roussel, P., Dreyfus, G., Crevier-Buchman, L., Pillot-Loiseau, C., Hueber, and T., Chollet, G. 2011. Tests of an interactive, phrasebook-style post-laryngectomy voice-replacement system, the 17th International Congress on Phonetic Sciences, Hong Kong, China, 572-575.
9. Denby, B., Schultz, T., Honda, K., Hueber, T., Gilbert, J. M., and Brumberg, J. S. 2010. Silent speech interface, Speech Communication, 52:270-287.
10. Doi, H., Nakamura, K., Toda, T., Saruwatari, H., Shikano, K. 2010. Esophageal speech enhancement based on statistical voice conversion with Gaussian mixture models, IEICE Transactions on Information and Systems, E93-D, 9:2472-2482.
11. Fagan, M. J., Ell, S. R., Gilbert, J. M., Sarrazin, E., and Chapman, P. M. 2008. Development of a (silent) speech recognition system for patients following laryngectomy, Medical Engineering & Physics, 30(4):419-425.
12. Green, P. D., Khan, Z., Creer, S. M. and Cunningham, S. P. 2011. Reconstructing the voice of an individual following Laryngectomy, Augmentative and Alternative Communication, 27(1):61-66.
13. Green, J. R., Wang, J., and Wilson, D. L. 2013. SMASH: A tool for articulatory data processing and analysis, Proc. Interspeech, 1331-35.
14. Green, J. R. and Wang, Y. 2003. Tongue-surface movement patterns during speech and swallowing, Journal of the Acoustical Society of America, 113:2820-2833.
15. Hofe, R., Ell, S. R., Fagan, M. J., Gilbert, J. M., Green, P. D., Moore, R. K., and Rybchenko, S. I. 2013. Small-vocabulary speech recognition using a silent speech interface based on magnetic sensing, Speech Communication, 55(1):22-32.
16. Hofe, R., Ell, S. R., Fagan, M. J., Gilbert, J. M., Green, P. D., Moore, R. K., and Rybchenko, S. I. 2011. Speech Synthesis Parameter Generation for the Assistive Silent Speech Interface MVOCA, Proc. Interspeech, 3009-3012.
17. Huang, X. D., Acero, A., Hon, H.-W., Ju, Y.-C., Liu, J., Meredith, S., and Plumpe, M. 1997. Recent Improvements on Microsoft's Trainable Text-to-Speech System: Whistler, Proc. IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, 959-962.
18. Hueber, T., Benaroya, E.-L., Chollet, G., Denby, B., Dreyfus, G., Stone, M. 2010. Development of a silent speech interface driven by ultrasound and optical images of the tongue and lips, Speech Communication, 52:288-300.
19. Heaton, J. T., Robertson, M., and Griffin, C. 2011. Development of a wireless electromyographically controlled electrolarynx voice prosthesis, Proc. of the 33rd Annual Intl. Conf. of the IEEE Engineering in Medicine & Biology Society, Boston, MA, 5352-5355.
20. Heracleous, P., and Hagita, N. 2011. Automatic recognition of speech without any audio information, Proc. IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, 2392-2395.
21. Jorgensen, C. and Dusan, S. 2010. Speech interfaces based upon surface electromyography, Speech Communication, 52:354-366, 2010.
22. Katz, W., Bharadwaj, S., Rush, M., and Stettler, M. 2006. Influences of EMA receiver coils on speech production by normal and aphasic/apraxic talkers, Journal of Speech, Language, and Hearing Research, 49:645-659.
23. Kent, R. D., Adams, S. G., and Tuner, G. S. 1996. Models of speech production, in Principles of Experimental Phonetics, Ed., Lass, N. J., Mosby: St Louis, MO.
24. King, S., Frankel, J. Livescu, K., McDermott, E., Richmond, K., Wester, M. 2007. Speech production knowledge in automatic speech recognition, Journal of the Acoustical Society of America, 121(2):723-742.
25. Kuipers, J. B. 1999. Quaternions and rotation Sequences: A Primer with Applications to Orbits, Aerospace, and Virtual Reality, Princeton University Press, Princeton, NJ.
26. Liu, H., and Ng, M. L. 2007. Electrolarynx in voice rehabilitation, Auris Nasus Larynx, 34(3): 327-332.
27. Livescu, K., Çetin, O., Hasegawa-Johnson, Mark, King, S., Bartels, C., Borges, N., Kantor, A., et al. (2007). Articulatory feature-based methods for acoustic and audio-visual speech recognition: Summary from the 2006 JHU Summer Workshop. Proc. IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, 621-624.
28. Meier, U., Stiefelhagen, R., Yang, J., and Waibel, A. (2000). Towards Unrestricted Lip Reading. International Journal of Pattern Recognition and Artificial Intelligence, 14(5): 571-585.
29. Oviatt, S. L. 2003. Multimodal interfaces, in Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, Eds. Julie A. Jacko and Andrew Sears (Mahwah, NJ:Erlbaum): 286-304.
30. Park, H., Kiani, M., Lee, H. M., Kim, J., Block, J., Gosselin, B., and Ghovanloo, M. 2012. A wireless magnetoresistive sensing system for an intraoral tongue-computer interface, IEEE Transactions on Biomedical Circuits and Systems, 6(6):571-585.
31. Potamianos, G., Neti, C., Cravier, G., Garg, A. and Senior, A. W. 2003. Recent advances in the automatic recognition of audio-visual speech, Proc. of IEEE, 91(9):1306-1326.
32. Rudzicz, F., Hirst, G., Van Lieshout, P. 2012. Vocal tract representation in the recognition of cerebral palsied speech, Journal of Speech, Language, and Hearing Research, 55(4): 1190-1207.
33. Toda, T., Nakagiri, M., Shikano, K. 2012. Statistical voice conversion techniques for body-conducted unvoiced speech enhancement, IEEE Transactions on Audio, Speech and Language Processing, 20(9): 2505-2517.
34. Uraga, E. and Hain, T. 2006. Automatic speech recognition experiments with articulatory data, Proc. Inerspeech, 353-356.
35. Wang, J., Samal, A., Green, J. R., and Carrell, T. D. 2009. Vowel recognition from articulatory position time-series data, Proc. IEEE Intl. Conf. on Signal Processing and Communication Systems, Omaha, NE, 1-6.
36. Wang, J., Green, J. R., Samal, A., and Marx, D. B. 2011. Quantifying articulatory distinctiveness of vowels, Proc. Interspeech, Florence, Italy, 277-280.
37. Wang, J., Samal, A., Green, J. R., and Rudzicz, F. 2012a. Sentence recognition from articulatory movements for silent speech interfaces, Proc. IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, 4985-4988.
38. Wang, J., Samal, A., Green, J. R., and Rudzicz, F. 2012b. Whole-word recognition from articulatory movements for silent speech interfaces, Proc. Interspeech, 1327-30.
39. Wang, J., Green, J. R., Samal, A. and Yunusova, Y. 2013a. Articulatory distinctiveness of vowels and consonants: A data-driven approach, Journal of Speech, Language, and Hearing Research, 56, 1539-1551.
40. Wang, J., Green, J. R., and Samal, A. 2013b. Individual articulator's contribution to phoneme production, Proc. IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, Vancouver, Canada, 7795-89.
41. Wang, J., Balasubramanian, A., Mojica de La Vega, L., Green, J. R., Samal, A., and Prabhakaran, B. 2013c. Word recognition from continuous articulatory movement time-series data using symbolic representations, ACL/ISCA Workshop on Speech and Language Processing for Assistive Technologies, Grenoble, France, 119-127.
42. Wang J. 2014. DJ and his friend: A demo of conversation using a real-time silent speech interface based on electromagnetic articulograph. [Video]. Available: http://www.utdallas.edu/-wangjun/ssidemo. html
43. Weismer, G. and Bunton, K. (1999). Influences of pellet markers on speech production behavior: Acoustical and perceptual measures, Journal of the Acoustical Society of America, 105: 2882-2891.
44. Westbury, J. 1994. X-ray microbeam speech production database user's handbook. University of Wisconsin-Madison, Madison, Wisconsin.