Real-time lip tracking and bimodal continuous speech recognition

1998 IEEE 2nd Workshop on Multimedia Signal Processing

Volumn 1998-December, Issue , 1998, Pages 65-70

  Chan, M T ^a   Zhang, Y ^b   Huang, T S ^b  

^a ROCKWELL SCIENCE CENTER   (United States)

^b University of Illinois at Urbana Champaign   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONTINUOUS SPEECH RECOGNITION; HIDDEN MARKOV MODELS;

AFFINE SUBSPACES; CONTEXT DEPENDENT; CONTOUR MODELING; FIRST DERIVATIVE; LIP LOCALIZATION; MODEL INITIALIZATION; OUTLIER REJECTION; TRAINING AND TESTING;

MULTIMEDIA SIGNAL PROCESSING;

EID: 84925639646     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MMSP.1998.738914     Document Type: Conference Paper

References (13)

1. S. V. Vaseghi and B. P. Milner, "Noise Compensation Methods for Hidden Markov Model Speech Recognition in Adverse Environments," IEEE Transactions on Speech and Audio processing, vol. 5, pp. 11-21, 1997.
2. B. Strope and A. Alwan, "Model of Dynamic Auditory Perception and Its Application to Robust Word Recognition," IEEE Transactions on Speech and Audio Processing, vol. 5, pp. 451-464, 1997.
3. E. D. Petajan, B. Bischoff, and D. Bodoff, "An Improved Automatic Lipreading System to Enhance Speech Recognition," in ACM SIGCHI-88, pp.19-25, 1988.
4. C. Bregler and Y. Konig, ""Eigenlips" for Robust Speech Recognition," in Proc. International Conference on Acoustics Speech and Signal Processing, pp. 669-672, 1994.
5. M. E. Hennecke, D. G. Stork, and K. V. Prasad, "Visionary Speech: Looking Ahead to Practical Speechreading Systems," in D.G. Stork and M.E. Henneck (eds.), Speechreading by Humans and Machines: Models Systems and Applications, Springer, 1995.
6. A. J. Goldschen, "Continuous Automatic Speech Recognition by Lipreading," Ph.D. Dissertation, George Washington University, Washington, D.C, 1993.
7. R. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition, Prentice-Hall, New Jersey, 1993.
8. A. P. Benguerel and M. K. Pichora-Fuller, "Coarticulation Effects in Lipreading," Journal of Speech and Hearing Research, vol. 25, pp. 600-607, 1982.
9. S. Young, J. Odell, D. Ollason, V. Valtchev, and P. Woodland. The HTKHidden Markov Model Toolkit V2. I , Entropic Research, Cambridge, 1997.
10. M. Kass, A. Witkin, and D. Terzopoulus, "Snakes: Active Contour Models," International Journal of Computer Vision, vol. 1, pp. 321-331, 1987.
11. A. L. Yuille, P. Hallinan, and D. S. Cohen, "Feature Extraction from Faces Using Deformable Templates," International Journal of Computer Vision, vol. 1, pp. 99-1 12, 1992.
12. R. Kaucic and A. Blake, "Accurate, Real-Time, Unadorned Lip Tracking," in Proc. 6th International Conference on Computer Vision, pp. 370-375, 1998.
13. G. Potamianos and H. P. Graf, "Discriminative Training of HMM Stream Exponents for Audio-visual Speech Recognition," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 3733-3736, 1998.