Objective Viseme Extraction and Audiovisual Uncertainty: Estimation Limits between Auditory and Visual Modes

Auditory-Visual Speech Processing 2007, AVSP 2007

Volumn , Issue , 2007, Pages

  Melenchón, Javier ^a   Simó, Jordi ^a   Cobo, Germán ^a   Martínez, Elisa ^a  

^a UNIVERSITAT RAMON LLULL   (Spain)

Author keywords

Audiovisual processing; Auditory visual uncertainty; Viseme extraction

Indexed keywords

SPEECH PROCESSING;

AUDIOVISUAL PROCESSING; AUDITORY VISUAL UNCERTAINTY; AUDITORY-VISUAL; DISTANCE MATRIX; EARLY EVALUATION; UNCERTAINTY; UNCERTAINTY ESTIMATION; VISEME EXTRACTION; VISEMES; VISUAL MODES;

EXTRACTION;

EID: 85133380725     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Chen, T., “Audiovisual Speech Processing: Lip Reading and Lip Synchronization”, IEEE Signal Processing Magazine, 18:9-31, 2001.
2. Campbell, R., Dodd, B. and Burnham, D, “Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech”, UK: Psychology Press, 1998.
3. Massaro, D.W., Beskow, J., Cohen, M.M., Fry C.L. and Rodriguez, T., “Picture My Voice: Audio to Visual Speech Synthesis using Artificial Neural Networks”, Proc. of AVSP, Santa Cruz, CA. pp. 133-138, 1999.
4. Yehia, H., Rubin, P. and Vatikiotis-Bateson, E., “Quantitative Association of Vocal-tract and Facial Behaviour”, Speech Communication, 26:23-43, 1998.
5. Hong, P., Wen, Z. and Huang., T., “Real-Time Speech-Driven Face Animation With Expressions Using Neural Networks”. IEEE Transactions on neural networks, 13:916-927, 2002.
6. Choi, K. and Hwang, J., “Automatic Creation of a Talking Head from a Video Sequence”. IEEE Transactions on Multimedia 7:628-637, 2005.
7. Huang, X., Hon, H.W. and Reddy, R., “Spoken Language Processing: A Guide to Theory, Algorithm, and System Development”. USA: Prentice Hall PTR, 2001.
8. Fisher, C.G., “Confusions Among Visually Perceived Consonants”, JSHR, 11:796-804, 1968.
9. Binnie, C., Montgomery, A. and Jackson, P., “Auditory and Visual Contributions to the Perception of Consonants”, JSHR, 17:619-630, 1974.
10. Owens, E. and Blazek, B., “Visemes Observed by Hearing-Impaired and Normal-Hearing Adult Viewers”, JSHR, 28:381-393, 1985.
11. Summerfield, A.Q., “Some Preliminaries to a Comprehensive Account of Audio-Visual Speech Perception”, Hearing by Eye: The psychology of lip-reading, USA: Lawrence Erlbaum Ass., pp. 3-51, 1987.
12. Tekalp, A.M. and Ostermann, J., “Face and 2-D Mesh Animation in MPEG-4”, Signal Processing: Image Communication, 15:387-421, 2000.
13. Fukunaga, K., “Introduction to Statistical Pattern Recognition” USA: Academic Press, 2nd edition, 1990.
14. Kirby, M., “Geometric Data analysis: An Empirical Approach to Dimensionality Reduction and the Study of Patterns”, USA: John Wiley & Sons Inc., 2001.
15. Jolliffe, I.T., “Principal Component Analysis”, USA: Springler-Verlag, 1986.
16. Melenchón, J., Iriondo, I. and Meler, L., “Simultaneous and Causal Appearance Learning and Tracking”, ELCVIA, 3:44-54, 2005.
17. Young, S., Evermann, G., Hain, T., Kershaw, D., Moore, G., Odell, J., Ollason, D., Povey, D., Valtchev, V., and Woodland, P. “The HTK Book (for HTK Version 3.2.1)”, Cambridge University Engineering Department, 2003.
18. Yehia, H. and Itakura, F., 1994, “Determination of Human Vocaltract Dynamic Geometry from Formant Trajectories Using Spatial and Temporal Fourier Analysis”, Proc. IEEE ICASSP, pp. 477-480, 1994.
19. GSM 06.90 version 7.2.1. “Digital cellular telecommunications system (Phase 2+); Adaptive Multi-Rate speech transcoding”, 1998.
20. Moon, T.K. and Stirling, W.C., “Mathematical Methods and Algorithms for Signal Processing”, USA: Prentice-Hall, 2000.