Real-time lip tracking for audio-visual speech recognition applications

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 1065, Issue , 1996, Pages 376-387

  Kaucic, Robert ^a   Dalton, Barney ^a   Blake, Andrew ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84957886748     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-61123-1_154     Document Type: Conference Paper

References (23)

1. A. Adjoudani and C. Benoit. On the integration of auditory and visual parameters in an HMM-based ASR. In Proceedings NATO ASI Conference on Speechreading by Man and Machine: Models, Systems and Applications. NATO Scientific Affairs Division, Sep 1995.
2. A. Blake, R. Curwen, and A. Zisserman. A framework for spatio-temporal control in the tracking of visual contours. Int. Journal of Computer Vision, 11(2): 127–145, 1993.
3. A. Blake and M.A. Isard. 3D position, attitude and shape input using video tracking of hands and lips. In Proc. Siggraph, pp. 185-192. ACM, 1994.
4. A. Blake, M.A. Isard, and D. Reynard. Learning to track the visual motion of contours. Artificial Intelligence, 78: 101-134, 1995.
5. C. Bregler and Y. Konig. Eigenlips for robust speech recognition. In Proc. Int. Conf. on Acoust., Speech, Signal Processing, pp. 669-672, Adelaide, 1994.
6. C. Bregler and S.M. Omohundro. Nonlinear manifold learning for visual speech recognition. In Proc. 5th Int. Conf. on Computer Vision, pp. 494-499, Boston, Jun 1995.
7. R. Cole, L. Hirschmann, L. Atlas, et al. The challenge of spoken language systems: Research directions for the nineties. IEEE Trans, on Speech and Audio Processing, 3(1): 1–20, 1995.
8. B. Dalton, R. Kaucic, and A. Blake. Automatic Speechreading using dynamic contours. In Proceedings NATO ASI Conference on Speech reading by Man and Machine: Models, Systems and Applications. NATO Scientific Affairs Division, Sep 1995.
9. B. Dodd and R. Campbell. Hearing By Eye: The Psychology of Lip Reading. Erlbaum, 1987.
10. E. K. Finn and A. A. Montgomery. Automatic optically based recognition of speech. Pattern Recognition Letters, 8(3): 159-164, 1988.
11. M.J.F. Gales and S. Young. An improved approach to the Hidden Markov Model decomposition of speech and noise. In Proc. Int. Conf. on Acoust., Speech, Signal Processing, pp. 233-239, San Franciso, Mar 1992.
12. M.W. Mak and W.G. Allen. Lip-motion analysis for speech segmentation in noise. Speech Communication, 14(3): 279-296, 1994.
13. Y. Moses, D. Reynard, and A. Blake. Determining facial expressions in real-time. In Proc. 5th Int. Conf. on Computer Vision, pp. 296-301, Boston, Jun 1995.
14. J.P. Openshaw and J.S. Mason. A review of robust techniques for the analysis of degraded speech. In Proc. IEEE Region 10 Conf. on Comp., Control, and Power Engr., pp. 329-332, 1993.
15. E.D. Petajan, N.M. Brooke, B.J. Bischofy, and D.A. Bodoff. An improved automatic lipreading system to enhance speech recognition. In E. Soloway, D. Frye, and S.B. Sheppard, editors, Proc. Human Factors in Computing Systems, pp. 19-25. ACM, 1988.
16. L. Rabiner and J. Bing-Hwang. Fundamentals of speech recognition. Prentice-Hall, 1993.
17. D. Reisberg, J. McLean, and A. Goldfield. Easy to hear but hard to understand: A lip-reading advantage with intact auditory stimuli. In B. Dodd and R Campbell, editors, Hearing By Eye: The Psychology of Lip Reading, pp. 97-113. Erlbaum, 1987.
18. D. Reynard, A. Wildenberg, A. Blake, and J. Marchant. Learning dynamics of complex motions from image sequences. In Proc. 4th European Conf. on Computer Vision, Cambridge, England, Apr 1996.
19. D.G. Stork, G. Wolff, and E. Levine. Neural network lipreading system for improved speech recognition. In Proceedings International Joint Conference on Neural Networks, volume 2, pp. 289-295, 1992.
20. Q. Summerfield, A. MacLeod, M. McGrath, and M. Brooke. Lips, teeth and the benefits of lipreading. In A.W. Young and H.D. Ellis, editors, Handbook of Research on Face Processing, pp. 223-233. Elsevier Science Publishers, 1989.
21. A.P. Varga and R.K. Moore. Hidden Markov Model decomposition of speech and noise. In Proc. Int. Conf. on Acoust., Speech, Signal Processing, pp. 845-848, 1990.
22. B.P. Yuhas, M.H. Goldstein, T.J. Sejnowski, and R.E. Jenkins. Neural network models of sensory integration for improved vowel recognition. Proceedings of the IEEE, 78(10): 1658-1668, 1990.
23. V. Zue, J. Glass, D. Goodine, L. Hirschman, H. Leung, M. Phillips, J. Polifroni, and S. Seneff. From speech recognition to spoken language understanding: The development of the MIT SUMMIT and VOYAGER systems. In R.P. Lippman, J.E. Moody, and D.S. Touretzky, editors, Advances in Neural Information Processing pp. 255-261. Morgan Kaufman, 1991.