Lip synchronization: From phone lattice to PCA eigen-projections using neural networks

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2008, Pages 2016-2019

  Al Moubayed, Samer ^a   De Smet, Michael ^b   Van Hamme, Hugo ^b  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

3D morphable models; Audio visual speech; Lip synchronization; Phone lattice; Principal component analysis; Speech recognition

Indexed keywords

3D MORPHABLE MODEL; AUDIO-VISUAL SPEECH; LIP SYNCHRONIZATION; PHONE LATTICE; PRINCIPAL COMPONENTS;

FACE RECOGNITION; NEURAL NETWORKS; PRINCIPAL COMPONENT ANALYSIS; SPEECH COMMUNICATION; SYNCHRONIZATION; TELEPHONE SETS; THREE DIMENSIONAL; VIDEO RECORDING;

SPEECH RECOGNITION;

EID: 84867204708     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. W. H. Sumby and I. Pollack, "Visual contribution to speech intelligibility in noise," J. Acoust. Soc. Am., vol. 26, no. 2, pp. 212-215, March 1954.
2. T. Ezzat and T. Poggio, "MikeTalk: A talking facial display based on morphing visemes," In Proc. of the Computer Animation Conference '98, Philadelphia, PA, June 1998, pp. 96-102.
3. P. Vanroose, G. A. Kalberer, P. Wambacq, and L. Van Gool, "From speech to 3D face animation," In Proc. of the 23rd Symposium on Information Theory in the Benelux, Louvain-la-Neuve, Belgium, May 2002, pp. 255-260.
4. D. W. Massaro, J. Beskow, M. M. Cohen, C. L. Fry and T. Rodriguez, "Picture my voice: Audio to visual speech synthesis using artificial neural networks," In Proc. AVSP '99, Santa Cruz, CA, August 1999, pp. 133-138.
5. K. Demuynck, T. Laureys, D. Van Compernolle and H. Van hamme, "FLaVoR: A flexible architecture for LVCSR," In Proc. European Conference on Speech Communication and Technology, Geneva, Switzerland, September 2003, pp. 1973-1976.
6. K. Demuynck, D. Van Compernolle and H. Van hamme, "Robust Phone Lattice Decoding," In Proc. International Conference on Spoken Language Processing, Pittsburgh, PA, September 2006, pp. 1622-1625.
7. F. Wessel, R. Schluter, K. Macherey and H. Ney, "Confidence measures for large vocabulary continuous speech recognition," IEEE Transactions on Speech and Audio Processing, vol. 9, no. 3, pp. 288-289, March 2001.
8. Patrick Lucey, Terrence Martin and Sridha Sridharan. 2004. Confusability of Phonemes Grouped According to their Viseme Classes in Noisy Environments. Presented at Tenth Australian International Conference on Speech Science & Technology, Macquarie University, Sydney, 8th-10th December, 2004.
9. T. Ezzat, G. Geiger, and T. Poggio, "Trainable videorealistic speech animation," In Proc. of ACM SIGGRAPH 2002, San Antonio, TX, July 2002, pp. 388-398.
10. V. Blanz and T. Vetter, "A morphable model for the synthesis of 3D faces," In Proc. of ACM SIGGRAPH '99, Los Angeles, CA, August 1999, pp. 187-194.
11. M. De Smet, R. Fransens, and L. Van Gool, "A generalized EM approach for 3D model based face recognition under occlusions," In Proc. CVPR, New York, NY, June 2006, vol. 2, pp. 1423-1430.