Towards unrestricted lip reading

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 14, Issue 5, 2000, Pages 571-585

  Meier, Uwe ^a   Stiefelhagen, Rainer ^a   Yang, Jie ^a   Waibel, Alex ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; FEATURE EXTRACTION; HUMAN COMPUTER INTERACTION; IMAGE PROCESSING; INTERACTIVE COMPUTER SYSTEMS; NEURAL NETWORKS; PATTERN RECOGNITION SYSTEMS; REAL TIME SYSTEMS; STATISTICAL METHODS; WHITE NOISE;

LINEAR DISCRIMINANT ANALYSIS (LDA); LIP READING; PRINCIPLE COMPONENT ANALYSIS (PCA);

SPEECH RECOGNITION;

EID: 0034238554     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218001400000374     Document Type: Article

References (24)

1. P. Duchnowski, U. Meier and A. Waibel, "See me, hear me: integrating automatic speech recognition and lip-reading." Int. Conf. Spoken Language Processing, ICSLP, 1994, pp. 547-550.
2. A. J. Goldschen, O. N. Garcia and E. Petajan, "Continuous optical automatic speech recognition by lipreading," 28th Annual Asimolar Conf. Signal Speech and Computers, 1994, pp. 575-577.
3. H. Günther Hirsch, "Estimation of noise spectrum and its application to SNR-estimation and speech enhancement," Computer Science Institute, Berkeley, California, USA, Technical Report, Int.
4. M. E. Hennecke, K. V. Prasad and D. G. Stork, "Using deformable templates to infer visual speech dynamics," 28th Annual Asimolar Conf. Signal Speech and Computers, 1994, pp. 578-582.
5. H. Hild and A. Waibel, "Multi-speaker/Speaker-independent architectures for the multi-state time delay neural network," Proc. Int. Conf. Acoustics, Speech and Signal Processing, IEEE, 1993, pp. 255-258.
6. H. Hild and A. Waibel, "Speaker-independent connected letter recognition with a multi-state time delay neural network," 3rd European Conf. Speech, Communication and Technology (EUROSPEECH 93), September 1993, pp. 1481-1487.
7. W. Hürst, "Adaptive bimodale Sensorfusion für automatische Spracherkennung und Lippenlesen," Studienarbeit, Institut für Logik, Komplexität und Deduktionssysteme, Universität Karlsruhe (TH), Germany, 1995.
8. K. Mase and A. Pentland, "Automatic lipreading by optical-flow analysis," Syst. Comput. Jpn. 22, 6 (1991) 67-76.
9. H. McGurk and J. MacDonald, "Hearing lips and seeing voices," Nature 264 (1976) 746-748.
10. U. Meier, "Lippenlesen: Verschiedene Methoden der visuellen Vorverarbeitung und Merkmalsextraktion," Studienarbeit, Institut für Logik Komplexität und Deduktionssysteme, Universität at Karlsruhe (TH), Germany, 1994.
11. U. Meier, "Robuste Systemarchitekturen für automatisches Lippenlesen," Diplom-Arbeit, Institut für Logik, Komplexität und Deduktionssysteme, Universität Karlsruhe (TH), Germany, 1995.
12. U. Meier, R. Stiefelhagen and J. Yang, "Preprocessing of visual speech under real world conditions," Proc. Workshop on Audio-Visual Speech Processing (AVSP 97), pp. 205-208.
13. U. Meier, W. Hürst and P. Duchnowski, "Adaptive bimodal sensor fusion forautomatic speechreading," Proc. ICASSP 2 (1996) 833-837.
14. J. R. Movellan, "Visual speech recognition with stochastic networks," NIPS 94, 1994, pp. 851-858.
15. C. Pelachaud, N. Badler and M. L. Viaud, "Final report to nsf of the standards for facial animation workshop," Technical Report University of Pennsylvania, 1994.
16. E. D. Petajan, "Automatic lipreading to enhance speech recognition," Proc. IEEE Communications Society Global Telecommunications Conf., 1984, pp. 265-272.
17. K. V. Prasad, D. G. Stork and G. J. Wolff. "Preprocessing video images for neural learning of lipreading," Ricoh California Research Center, Technical Report CRC-TR-93-25.
18. W. K. Pratt, Digital Image Processing, A Wiley-Interscience Publication.
19. M. Schoch, "Schätzung des signal-rausch-abstandes," Studienarbeit, Institut für Logik, Komplexität und Deduktionssysteme, Universität Karlsruhe (TH), Germany, 1995.
20. P. L. Silsbee, "Sensory integration in audiovisual automatic speech recognition," 28th Annual Asimolar Conf. Signal Speech and Computers, 1994, pp. 561-565.
21. R. Stiefelhagen, J. Yang and U. Meier, "Real time lip tracking for lipreading," Eurospeech 97, 1997, pp. 2007-2010.
22. D. G. Stork, G. Wolff and E. Levine, "Neural network lipreading system for improved speech recognition," IJCNN 2 (1992) 289-295.
23. A. Waibel, T. Hanazawa, G. Hinton and K. Shikano, "Phoneme recognition using time-delay neural networks," IEEE Trans. Acoust. Speech Sign. Process. 37, 3 (1989) 328-339.
24. J. Yang and A. Waibel, "A real-time face tracker," Proc. WACV 96, 1996, pp. 142-147.