Towards perceptually realistic talking heads: Models, methods and McGurk

Proceedings - 1st Symposium on Applied Perception in Graphics and Visualization, APGV 2004

Volumn , Issue , 2004, Pages 151-158

  Cosker, Darren ^a   Paddock, Susan ^b   Marshall, David ^a   Rosin, Paul L ^a   Rushton, Simon ^b  

^a CARDIFF UNIVERSITY   (United Kingdom)

^b CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

Audio analysis; Facial animation; Learning; Lip syncing; McGurk Effect; Perceptual Analysis; Psychological Analysis; Video analysis; Video synthesis

Indexed keywords

ALGORITHMS; ANIMATION; BEHAVIORAL RESEARCH; COMPUTER VISION; SPEECH COMMUNICATION; THREE DIMENSIONAL COMPUTER GRAPHICS; VIDEO RECORDING;

AUDIO ANALYSIS; FACIAL ANIMATION; LIP-SYNCING; MCGURK EFFECT; PERCEPTUAL ANALYSIS; PSYCHOLOGICAL ANALYSIS; VIDEO ANALYSIS; VIDEO SYNTHESIS;

ARTIFICIAL INTELLIGENCE;

EID: 14344264749     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. BRAND, M. 1999. Voice puppetry. In Proc. Computer graphics and interactive techniques, ACM Press, 21-28.
2. BREGLER, C., COVELL, M., AND SLANEY, M. 1997. Video rewrite: driving visual speech with audio. In Proc. of 24th conf. on Computer graphics and interactive techniques, ACM Press, 353-360.
3. COHEN, M., MASSARO, D., AND CLARK, R. 2002. Training a talking head. IEEE Fourth International Conference on Multimodal Interfaces.
4. COSATTO, E., AND GRAF, H. P. 2000. Photo-realistic talking-heads from image samples. IEEE Transactions on Multimedia 2, 3, 152-163.
5. COSKER, D., MARSHALL, D., ROSIN, P., AND HICKS, Y. 2003. Video realistic talking heads using hierarchical non-linear speech-appearance models. In In Proc. of Mirage, 20 - 27.
6. COSKER, D., MARSHALL, D., ROSIN, P. L., AND HICKS, Y. 2004. Speech driven facial animation using a hierarchical model. IEE Vision, Image and Signal Processing (to appear).
7. DEKLE, D., FOWLER, C., AND FUNNELL, M. 1992. Audio-visual integration in perception of real words. Perception and Psychophysics 51, 4, 355-362.
8. DODD, B. 1977. The role of vision in the perception of speech. Perception 6, 31-40.
9. EASTON, R., AND BASALA, M. 1982. Perceptual dominance during lipreading. Perception and Psychophysics 32, 6, 562-570.
10. EZZAT, T., AND POGGIO, T. 1998. Miketalk: A talking facial display based on morphing visemes. Proc. of Computer Animation Conference.
11. EZZAT, T., GEIGER, G., AND POGGIO, T. 2002. Trainable videorealistic speech animation. In Proc. of Computer Graphics and Interactive Techniques, ACM Press, 388-398.
12. GEIGER, G., EZZAT, T., AND POGGIO, T. 2003. Perceptual evaluation of video-realistic speech. CBCL Paper 224/AI Memo 2003-003, MIT, Cambridge, MA.
13. HACK, C., AND TAYLOR, C. J. 2003. Modelling talking head behavior. In Proc. of British Machine Vision Conference.
14. KAHLER, KOLJA, HABER, JORG, AND SEIDEL. 2001. Geometry-based muscle modeling for facial animation. In Proc. of Graphics Interface, 27-36.
15. KALBERER, G. A., AND GOOL, L. V. 2002. Realistic face animation for speech. Journal of Visualization and Computer Animation 13, 97-106.
16. KATSYRI, J., KLUCHAREV, V., FRYDRYCH, M., AND SAMS, M. 2003. Identification of synthetic and natural emotional facial expressions. In In Proc. of International Conference on Audio-Visual Speech Processing, 239-243.
17. MACDONALD, J., AND MCGURK, H. 1978. Visual influences on speech perception processes. Perception and Psychophysics 24, 3, 253-257.
18. MACDONALD, J., ANDERSON, S., AND BACHMANN, T. 2000. Hearing by eye: How much spatial degradation can be tolerated? Perception 29, 10, 1155-1168.
19. MCGURK, H., AND MACDONALD, J. 1976. Hearing lips and seeing voices. Nature 264, 746-748.
20. OUNI, S., MASSARO, D., COHEN, M., YOUNG, K., AND JESSE, A. 2003. Internationalization of a talking head. In Proc. of 15th International Congress of Phonetic Sciences, Barcelona, Spain.
21. PARKE, F. I., AND WATERS, K. 1996. Computer Facial Animation. A. K. Peters.
22. PARKE, F. 1972. Computer generated animation of faces. In Proc. of ACM National Conference.
23. REVERET, L., BAILLY, G., AND BADIN, P. 2000. Mother: A new generation of talking heads providing a flexible articulatory control for video-realistic speech animation.
24. THEOBALD, B., CAWLEY, G., GLAUERT, J., AND BANGHAM, A. 2003. 2.5d visual speech synthesis using appearance models. In Proc. of BMVC 2003, vol. 1, 43-52.
25. WATERS, K. 1987. A muscle model for animation three-dimensional facial expression. In Proc. of Computer Graphics and Interactive Techniques, ACM Press, 17-24.