Word Recognition from Continuous Articulatory Movement Time-Series Data using Symbolic Representations

SLPAT 2013 - 4th Workshop on Speech and Language Processing for Assistive Technologies, SLPAT 2013, Workshop Proceedings

Volumn , Issue , 2013, Pages 119-127

  Wang, Jun ^a   Balasubramanian, Arvind ^b   De La Vega, Luis Mojica ^b   Green, Jordan R ^c   Samal, Ashok ^d   Prabhakaran, Balakrishnan ^b  

^a UNIVERSITY OF TEXAS AT DALLAS   (United States)

^b The University of Texas at Dallas   (United States)

^c MGH INSTITUTE OF HEALTH PROFESSIONS   (United States)

^d UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Laryngectomy; SAX; Silent speech recognition; Support vector machine; Time series

Indexed keywords

SPEECH; SPEECH COMMUNICATION; SPEECH RECOGNITION; SUPPORT VECTOR MACHINES;

LARYNGECTOMY; RECOGNITION ACCURACY; SAX; SILENT SPEECH; SILENT SPEECH INTERFACES; SILENT SPEECH RECOGNITION; SUPPORT VECTORS MACHINE; SYMBOLIC REPRESENTATION; TIMES SERIES; WORD RECOGNITION;

TIME SERIES;

EID: 85009500921     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (48)

1. Bailey, B. J., Johnson, J. T., and Newlands, S. D., Head and Neck Surgery - Otolaryngology, Lippincot, Williams & Wilkins, Philadelphia, PA, USA, 4th Ed., 1779-1780, 2006.
2. American Cancer Society, "Cancer Facts and Figures 2012", Atlanta, GA: American Cancer Society. Retrieved on December 26, 2012.
3. Denby, B., Schultz, T., Honda, K., Hueber, T., Gilbert, J. M., and Brumberg, J. S. "Silent speech interface", Speech Communication, 52:270-287, 2010.
4. Sproat, R. (Ed.), "Multilingual text-to-speech synthesis: The Bell Labs approach", in Computational Linguistics (1st ed.), vol. 24, p. 328. 1998: Springer.
5. Hueber, T., Benaroya, E.-L., Chollet, G., Denby, B., Dreyfus, G., Stone, M., "Development of a silent speech interface driven by ultrasound and optical images of the tongue and lips", Speech Communication, 52:288-300, 2010.
6. Denby, B., Cai, J., Roussel, P., Dreyfus, G., Crevier-Buchman, L., Pillot-Loiseau, C., Hueber, and T., Chollet, G., "Tests of an interactive, phrasebook-style post-laryngectomy voicereplacement system", the 17th International Congress on Phonetic Sciences, Hong Kong, China, 572-575, 2011.
7. Jorgensen, C. and Dusan, S., "Speech interfaces based upon surface electromyography", Speech Communication, 52:354-366, 2010.
8. Heaton, J. T., Robertson, M., and Griffin, C., "Development of a wireless electromyographically controlled electrolarynx voice prosthesis", Proc. of the 33rd Annual Intl. Conf. of the IEEE Engineering in Medicine & Biology Society, Boston, MA, 5352-5355, 2011.
9. Wang, J., Samal, A., Green, J. R., and Rudzicz, F., "Sentence recognition from articulatory movements for silent speech interfaces", Proc. IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, 4985-4988, 2012.
10. Wang, J., Samal, A., Green, J. R., and Rudzicz, F., "Whole-word recognition from articulatory movements for silent speech interfaces", Proc. Interspeech, Portland, OR, 1327-30, 2012.
11. Fagan, M. J., Ell, S. R., Gilbert, J. M., Sarrazin, E., and Chapman, P. M., "Development of a (silent) speech recognition system for patients following laryngectomy", Medical Engineering & Physics, 30(4):419-425, 2008.
12. King, S., Frankel, J., Livescu, K., McDermott, E., Richmond, K., and Wester, M., "Speech production knowledge in automatic speech recognition", Journal of Acoustical Society of America, 121(2):723-742, 2007.
13. Livescu, K., Cetin, O., Hasegawa-Johnson, M., King, S., Bartels, C., Borges, N., Kantor, Lal, P., Yung, L., Bezman, A., Dawson- Haggerty, S., Woods, B., "Articulatory feature-based methods for acoustic and audio-visual speech recognition: Summary from the 2006 JHU Summer Workshop", Proc. Intl. Conf. on Acoustics, Speech, and Signal Processing, 621-624, 2007.
14. Rudzicz, F., "Articulatory knowledge in the recognition of dysarthric speech", IEEE Trans. on Audio, Speech, and Language Processing, 19(4):947-960, 2011.
15. Uraga, E. and Hain, T., "Automatic speech recognition experiments with articulatory data", Proc. Inerspeech, 353-356, 2006.
16. Sharma H. V., Hasegawa-Johnson, M., Gunderson, J., and Perlman A., "Universal access: Speech recognition for talkers with spastic dysarthria", Proc. Interspeech, 1451-1454, 2009.
17. Kantor, A., "Pronunciation modeling for large vocabulary speech recognition", PhD Dissertation, Dept. Comput. Sci., University of Illinois, Urbana, 2011.
18. Akdemir, E., and Ciloglu, T., "The use of articulator motion information in automatic speech segmentation", Speech Communication, 50(7):594-604, 2008.
19. Gilbert, J. M., Rybchenko, S. I., Hofe, R., Ell, S. R., Fagan, M. J., Moore, R.K., and Green, P., "Isolated word recognition of silent speech using magnetic implants and sensors", Medical Engineering & Physics, 32(10):1189-1197, 2011.
20. Green, J.R., Beukelman, D.R., and Ball, L. J., "Algorithmic estimation of pauses in extended speech samples", Journal of Medical Speech-Language Pathology, 12, 149-154, 2004.
21. Kent, R. D., Adams, S. G., and Tuner, G. S. Models of speech production. Lass, N. J.: Principles of experimental Phonetics. Mosby, 1996.
22. Kent, R. D., and Minifie, F. D., "Coarticulation in recent speech production models", Journal of Phonetics, 5(2):115-133, 1977.
23. Lin, J., Keogh, E., Lonardi, S., and Chiu, B. "A symbolic representation of time series, with implications for streaming algorithms", Proc. of the 8th ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery. San Diego, CA, 2003.
24. Mueen, A., Keogh, E., "Online discovery and maintenance of time series motifs", Proc. 16th ACM SIGKDD Intl. Conf. on Knowledge Discovery and Data Mining, Washington, DC, 1089-98, 2010.
25. Wei, L., Kumar, N., Lolla, V. N., Keogh, E., Lonardi, S., and Ratanamahatana, C. A., "Assumption-free anomaly detection in time series", Proc. 17th International Scientific and Statistical Database Management Conference, Santa Barbara, CA, 237-240, 2005.
26. Lin, J., Keogh, E., and Lonard, S. "Visualizing and discovering non-trivial patterns in large time series databases", Information Visualization, 4(2):61-82, 2005.
27. Boser, B., Guyon, I., Vapnik, V., "A training algorithm for optimal margin classifiers", Conf. on Learning Theory (COLT), 144-152, 1992.
28. Chang, C. -C., and Lin. C. -J., "LIBSVM: a library for support vector machines", ACM Trans. on Intelligent Systems and Technology, 2(27):1-27, 2011.
29. Wang, J., "Silent speech recognition from articulatory motion", Ph.D. dissertation, Dept. Comput. Sci., Univ. of Nebraska- Lincoln, 2011.
30. Shutts, R. E., Burke, K. S., and Creston, J. E., "Derivation of twenty-five-word PB Lists", Journal of Speech Hearing Disorders, 29:442-447, 1964.
31. Perkell, J. S., Cohen, M. H., Svirsky, M. A., Matthies, M. L., Garabieta, I., and Jackson, M. T. T., "Electromagnetic midsagittal articulometer systems for transducing speech articulatory movements", Journal of Acoustical Society of America, 92(6):3078-3096, 1992.
32. Hoole, P., and Zierdt, A., "Five-dimensional articulography", in Speech Motor Control: New Developments in Basic and Applied Research, B. Maassen and P. van Lieshout, Eds. Oxford University Press, ch. 20, pp. 331-349, 2010.
33. Green, J. R., Wang, J., and Wilson, D. L., "SMASH: A tool for articulatory data processing and analysis", Proc. Interspeech, 2013 (In press).
34. Yunusova, Y., Green, J. R., and Mefferd, A., "Accuracy assessment for AG500 electromagnetic articulograph", Journal of Speech, Language, and Hearing Research, 52(2):547-555, 2009.
35. Berry, J. "Accuracy of the NDI wave speech research system", Journal of Speech, Language, and Hearing Research, 54:1295-1301, 2011.
36. Katz, W., Bharadwaj, S., Rush, M., and Stettler, M., "Influences of EMA receiver coils on speech production by normal and aphasic/apraxic talkers", Journal of Speech, Language, and Hearing Research, 49:645-659, 2006.
37. Wang, J., Green, J. R., & Samal, A., "Individual articulator's contribution to phoneme production", Proc. IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, Vancouver, Canada, 7795-89, 2013.
38. Wang, J., Green, J. R., Samal, A. and Yunusova, Y. "Articulatory distinctiveness of vowels and consonants: A datadriven approach", Journal of Speech, Language, and Hearing Research, 2013 (In press).
39. Wang, J., Green, J. R., Samal, A., and Marx, D. B. "Quantifying articulatory distinctiveness of vowels", Proc. Interspeech, Florence, Italy, 277-280, 2011
40. Green, J. R. and Wang, Y., "Tongue-surface movement patterns during speech and swallowing", Journal of Acoustical Society of America, 113:2820-2833, 2003.
41. Westbury, J. X-ray microbeam speech production database user's handbook. University of Wisconsin, 1994.
42. Chen, W.-H., Loke, W.-F., Thompson, G., and Jung, B., "A 0.5V, 440uW frequency synthesizer for implantable medical devices", IEEE Journal of Solid-State Circuits, 47:1896-1907, 2012.
43. Park, H, Kiani, M., Lee, H. M., Kim, J., Block, J., Gosselin, B., and Ghovanloo, M., "A wireless magnetoresistive sensing system for an intraoral tongue-computer interface", IEEE Transactions on Biomedical Circuits and Systems, 6(6):571-585, 2012.
44. Cai, J., Denby, B., Roussel, P., Dreyfus, G., and Crevier- Buchman, L., "Recognition and real time performances of a lightweight ultrasound based silent speech interface employing a language model", Proc. Interspeech, Florence, Italy, 1005-08, 2011.
45. Heracleous, P., and Hagita, N., "Automatic recognition of speech without any audio information", Proc. IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, pp. 2392-2395, 2011.
46. Hofe, R., Ell, S. R., Fagan, M. J., Gilbert, J. M., Green, P. D., Moore, R. K., and Rybchenko, S. I., "Small-vocabulary speech recognition using a silent speech interface based on magnetic sensing", Speech Communication, 55(1):22-32, 2013.
47. Salvador, S., and Chan, P., "Toward accurate dynamic time warping in linear time and space", Intelligent Data Analysis, 11(5):561-580, 2007.
48. Frankel, J., Wester, M., and King, S., "Articulatory feature recognition using dynamic bayesian networks", Computer Speech Language, 21(4):620-640, 2006.