A Vision System Performing Lip Shape Analysis for Speech Pathology Research

IECON Proceedings (Industrial Electronics Conference)

Volumn 2, Issue , 2003, Pages 1086-1091

  Lee, D J ^a   Bates, Daniel ^a   Dromey, Christopher ^b   Xu, Xiaoqian ^a  

^a Department of Electrical and Computer Engineering   (United States)

^b BRIGHAM YOUNG UNIVERSITY   (United States)

Author keywords

Color Segmentation; Lip Shape Recognition; Shape Analysis; Speech Pathology

Indexed keywords

COLOR SEGMENTATION; LIP SHAPE RECOGNITION; SHAPE ANALYSIS; SPEECH PATHOLOGY;

ALGORITHMS; COLOR IMAGE PROCESSING; COMPUTER SIMULATION; CONTOUR MEASUREMENT; FEATURE EXTRACTION; IMAGE RECONSTRUCTION; IMAGE SEGMENTATION; MATHEMATICAL MODELS; PATHOLOGY; SPEECH RECOGNITION; SYNCHRONIZATION; VIDEO SIGNAL PROCESSING;

COMPUTER VISION;

EID: 1442329136     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IECON.2003.1280196     Document Type: Conference Paper

References (25)

1. H. Yehia, P. Rubin, and E. Vatikiotis-Bateson, "Quantitative association of vocal-tract and facial behavior", Speech Communication, vol. 26, pp. 23-43, 1998.
2. C. Bregler and Y. Konig, "Eigenlips" for robust speech recognition", Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. II/669-II/672 vol. 2, 19-22, Adelaide, SA, Australia, April 1994.
3. S.H. Luo and R.W. King, "A novel approach for classifying continuous speech into visible mouth-shape related classes", Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. I/465-I/468 vol. 1, 19-22, Adelaide, SA, Australia, April 1994.
4. I. Matthews, T.F. Cootes, J.A. Bangham, S. Cox, and R. Harvey, "Extraction of visual features for lipreading", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, pp. 198-213, February 2002.
5. P. Scanlon and R. Reilly, "Feature analysis for automatic speech reading" Proceedings of IEEE Fourth Workshop on Multimedia Signal Processing, pp. 625-630, Cannes, France, October 2001.
6. J. Yang, J. Xiao, and M. Ritter, "Automatic selection of visemes for image-based visual speech synthesis", IEEE International Conference on Multimedia and Expo, vol. 2, pp. 1081-1084, Location: New York, NY, USA, 2000.
7. B. Tiddeman, D. Perrett, "Prototyping and transforming visemes for animated speech", Proceedings of Computer Animation, pp. 248-251, 2002.
8. S. Kshirsagar, T. Molet, and N. Magnenat-Thalmann, "Principal components of expressive speech animation", Proceedings of IEEE Computer Graphics International, Hong Kong, China, pp. 38-44, 2002.
9. S.K. Karunaratne and Y. Hong, "An emotional viseme compiler for facial animation", Proceedings of the Fifth International Symposium on Signal Processing and Its Applications, vol. 1, pp. 459-461, Brisbane, Qld., Australia, 1999.
10. T. Ezzat, and T. Poggio, "Visual speech synthesis by morphing visemes", International Journal of Computer Vision, vol. 38-1, pp. 45-57, 2001.
11. S. M. Barlow, K. J. Cole, and J. H. Abbs, "A new head-mounted lip-jaw movement transduction system for the study of motor speech disorders", Journal of Speech & Hearing Research, vol. 26, 1983, pp. 283-288.
12. O. M. Hughes, and J. H. Abbs, "Labial-mandibular coordination in the production of speech: Implications for the operation of motor equivalence", Phonetica, vol. 33, pp. 199-221, 1976.
13. A. J. Caruso, J. H. Abbs, and V. L. Gracco, "Kinematic analysis of multiple movement coordination during speech in stutterers", Brain, vol. 111, pp. 439-455, 1988.
14. P. H. Van Lieshout, C. A. W. Rutjens, and P.H.M. Spauwen, "The dynamics of interlip coupling in speakers with a repaired unilateral cleft-lip history", Journal of Speech, Language, & Hearing Research, vol. 45, pp. 5-19, 2002.
15. J. R. Green, C. A. Moore, and K. J. Reilly, "The sequential development of jaw and lip control for speech", Journal of Speech, Language, & Hearing Research, vol. 45, pp. 66-79, 2002.
16. A. Smith, L. Goffman, H. N. Zelaznik, G. Ying, and C. McGillem, "Spatiotemporal stability and patterning of speech movement sequences", Experimental Brain Research, vol. 104, pp. 493-501, 1995.
17. K.L. Sum, W.H. Lau, S.H. Leung, A.W.C. Liew, and K.W. Tse, "A new optimization procedure for extracting the point-based lip contour using active shape model", Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, Salt Lake City, UT, vol. 3, pp. 1485-1488, 2001.
18. A. Caplier, "Lip detection and tracking", Proceedings of IEEE 11th International Conference on Image Analysis and Processing, Palermo, Italy, pp. 8-13, 2002.
19. H. Yao and W. Gao, "Face detection and location based on skin chrominance and lip chrominance transformation from color images", Pattern Recognition, vol. 34, pp. 1555-1564, 2001.
20. X. Zhang, R.M. Mersereau, M. Clements, C.C. Broun, "Visual speech feature extraction for improved speech recognition", Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processin, Orlando, FL, pp. 1993-1996, May 2002.
21. th IEEE International Symposium on Computer-Based Medical Systems, New York, NY, USA, June 2003.
22. L.J. Latecki and R. LakÄmper, "Application of planar shape comparison to object retrieval in image databases", Pattern Recognition, vol. 35(1), pp. 15-29, 2002.
23. L.J. Latecki and R. LakÄmper, "Shape description and search for similar objects in image databases", State-of-the-Art in Content-Based Image and Video Retrieval, Kluwer Academic Publishers, 2001.
24. A.M. Esther, L.P. Chew, D. P. Huttenlocher, K. Kedem, and J. S. B. Mitchell. "An efficient computable metric for comparing polygon shapes", IEEE Transactions on Patten Analysis and Machine Intelligence, vol. 13-3, pp. 209-216, 1991.
25. C. Zahn, and R. Roskie, "Fourier descriptors for plane closed curves", IEEE Transaction on Computer, vol. C-21-3, 1972.