Vowel recognition from continuous articulatory movements for speaker-dependent applications

4th International Conference on Signal Processing and Communication Systems, ICSPCS'2010 - Proceedings

Volumn , Issue , 2010, Pages

  Wang, Jun ^a   Green, Jordan R ^b   Samal, Ashok ^a   Carrell, Tom D ^b  

^a UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Articulation; Machine learning; Recognition; Support vector machine

Indexed keywords

ARTICULATION; ARTICULATORY FEATURES; CONTINUOUS INPUT; DATA SETS; EMPIRICAL FINDINGS; LIP MOVEMENTS; MACHINE-LEARNING; MOVEMENT PATTERN; RECOGNITION; RECOGNITION ACCURACY; RECOGNITION ALGORITHM; SOUND SAMPLE; SUPPORT VECTOR; VOWEL RECOGNITION;

COMMUNICATION SYSTEMS; LINGUISTICS; SIGNAL PROCESSING; SUPPORT VECTOR MACHINES;

SPEECH RECOGNITION;

EID: 79952491602     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSPCS.2010.5709716     Document Type: Conference Paper

References (29)

1. R. Paush and R. D. Williams, "Giving CANDY to children: User-tailored gesture input driving an articulator-based speech synthesizer," Univ. of Virginia Computer Science Report, TR-91-23, 1991.
2. W. Samuel and M. D. Beenken, "Laryngeal cancer (cancer of the larynx)," Armenian Health Network. Online: http://www.health.am/cr/ laryngeal-cancer/. Retrieved on 2009-06-23.
3. W. M. Mendenhall, C. E. Riggs, and N. J. Cassisi, "Treatment of head and neck cancers," in Cancer: Principles and Practice of Oncology, 7th Edition, Chapter 26.2, V. T. DeVita, S. Hellman, S. A. Rosenberg Eds. Philadelphia: Lippincott, Williams, & Wilkins, 2005, pp. 642-743.
4. J. Jiang, A. Alwan, P. A. Keating, E. T. Auer, and L. E. Bernstein, "On the relationship between face movements, tongue movements and speech acoustics," Journal on Applied Signal Processing(EURASIP), vol. 11, pp. 1174-1188, 2002.
5. C. T. Kello, and D. C. Plaut, "A neural network model of the articulatory-acoustic forward mapping trained on recordings of articulatory parameters," Journal of Acoustic Society of America, vol. 116, pp. 2354-2364, 2004.
6. H. C. Yehia, T. Kuratate, and E. Vatikiotis-Bateson, "Linking facial animation, head motion and speech acoustics," Journal of Phonetics, vol. 30, pp. 555-568, 2002.
7. E. Akdemir and T. Ciloglu, "The use of articulator motion information in automatic speech segmentation," Speech Communication, vol. 50(7), pp. 594-604, 2008.
8. G. Potamianos, C. Neti, G. Gravier, A. Garg and A. W. Senior, "Recent advances in the automatic recognition of audio-visual speech," Proc. of IEEE, vol. 91, no. 9, 2003.
9. S. King, J. Frankel, K. Livescu, E. McDermott, K. Richmond, and M. Wester, "Speech production knowledge in automatic speech recognition," Journal of the Acoustical Society of America, vol. 121(2), pp. 723-742, 2007.
10. Y. Yunusova, J. R. Green, and A. Mefferd, "Accuracy assessment for AG500 electromagnetic articulograph," Journal of Speech, Language, and Hearing Research, vol. 52(2), pp. 547-555, 2009.
11. J. S. Perkell, and M. H. Cohen, "An indirect test of the quantal nature of speech in the production of the vowels /i/, /a/ and /u/," Journal of Phonetics, vol. 17, pp. 123-133, 1989.
12. M. Richardson, J. Bilmes, and C. Diorio, "Hidden-Articulator Markov Models for speech recognition," ISCA Tutorial and Research Workshop on Automatic Speech Recognition, pp. 133-139, 2000.
13. K. Saenko, T. Darrell and J. R. Glass, "Articulatory features for robust visual speech recognition," In Proceedings of the 6th international Conference on Multimodal interfaces (ICMI04), State College, PA, USA, Oct 2004.
14. K. Saenko, K. Livescu, J. Glass, and T. Darrell, "Multistream Articulatory Feature-Based Models for Visual Speech Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31(9), pp. 1700-1707, 2009.
15. T. Shinchi, Y. Maeda, K. Sugahara, and R. Konishi, "Vowel recognition according to lip shapes by using neural network," Proc. of IEEE, 1998.
16. A. J. Goldschen, O. N. Garcia, and E. Petajau, "Continuous optical automatic speech recognition by lipreading," The 28th Annual Asilomar conference on Signals, Systems, and Computers, pp. 572-577, 1994.
17. M. Visser, M. Poel, and A. Nijholt, "Classifying visemes for automatatic lipreading," LNCS, vol. 1692, pp. 349-352, Springer, Heidelberg, 1999.
18. M. N. Kaynak, Zhi Qi, A. D. Cheok, K. Sengupta, Jian Zhang, Ko Chi Chung, "Analysis of lip geometric features for audio-visual speech recognition," IEEE Trans. on Systems, Man and Cybernetics, Part A, vol. 34(4), pp. 564-570, 2004.
19. P. Cosi, and E. Caldognetto, "Lips and Jaw Movements for Vowels and Consonants: Spatio-Temporal Characteristics and Bimodal Recognition Applications," NATO ASI Series F Computer And Systems Sciences, vol. 150, pp. 291-314, 1996.
20. C. C. Chang and C. J. Lin, "LIBSVM:a library for support vector machines," 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/ libsvm
21. J. Wang, A. Samal, J. R. Green, and T. D. Carrell, "Vowel recognition from articulatory position time-series data," IEEE Intl. Conf. on Signal Processing and Communication Systems (ICSPCS), pp. 1-6, 28-30, September 2009.
22. J. Westbury, "X-ray microbeam speech production database user's handbook," University of Wisconsin, 1994.
23. J. R. Green, and Y. T. Wang, "Tongue-surface movement patterns during speech and swallowing," Journal of Acoustical Society of America, vol. 113(5), pp. 2820-2833, 2003.
24. J. R. Green, L. Phan, I. Nip, and A. Mefferd, "A real-time articulatory controlled vowel synthesizer for research on speech motor learning, " Stem-, Spraak- en Taalpathologie, 14(Supp.), 46, 2006.
25. J. R. Green, E. M. Wilson, Y. Wang, and C. A. Moore, Estimating mandibular motion based on chin surface targets during speech, Journal of Speech, Language, and Hearing Research, vol. 50, pp. 928-939, 2007.
26. J. S. Perkell and W. L. Nelson, "Variability in production of the vowels /i/ and /a/," Journal of Acoustic Society of America, vol. 77, pp. 1889-1895, 1985.
27. D. Yarrington, J. Gray, C. Pennington, H. T. Bunnell, A. Cornaglia, J. Lilley, K. Nagao, and J. B. Polikoff, "ModelTalker Voice Recorder - An Interface System for Recorded a Corpus of Speech for Synthesis," Proceedings of the ACL-08: HLT Demo Session, Columbus, OH, pp. 28-31, 2008.
28. J. R. Green, D. R. Beukelman, and L. J. Ball, "Algorithmic estimation of pauses in extended speech samples of dysarthric and typical speech," Journal of Medical Speech-Language Pathology, vol. 12, pp. 149-154, 2004.
29. Q. Yang and X. Wu, "10 challenging problems in data mining research," International Journal of Information Technology and Decision Making, vol. 5, no. 4, pp. 597-604, 2006.