Towards a low bandwidth talking face using appearance models

Image and Vision Computing

Volumn 21, Issue 13-14, 2003, Pages 1117-1124

  Theobald, B J ^a   Kruse, S M ^a   Bangham, J A ^a   Cawley, G C ^a  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

Author keywords

Principal component analysis; Shape and appearance models; Talking faces

Indexed keywords

BANDWIDTH; FACE RECOGNITION; MATHEMATICAL MODELS; PRINCIPAL COMPONENT ANALYSIS; VIRTUAL REALITY;

AUDIO-VISUAL SPEECH;

IMAGE ANALYSIS;

EID: 0344515609     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2003.08.015     Document Type: Conference Paper

References (28)

1. Gregory S., Bishop J., Sheldon L. Deaf Young People and their Families: Developing Understanding. 1995;Cambridge University Press, Cambridge.
2. B.U.C. for Deaf Studies, Deaf people and television, Research Notes 10.
3. Parke F., Waters K. Peters A.K. Comptuer Facial Animation. 1996.
4. F. Parke, A parametric model for human faces, PhD. thesis, University of Utah, Saltlake City, Utah, 1974.
5. Waters K. A muscle model for animating three-dimensional facial expressions. Proceeding of ACM SIGGRAPH. 21:(4):1987;17-24.
6. Essa I., Pentland A. Coding, analysis, interpretation and recognition of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence. 19:(7):1997;757-763.
7. Tian Y., Kanade T., Cohn J. Recognizing action units for facial expression analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence. 23:(2):2001;97-115.
8. Ezzat T., Poggio T. Visual speech synthesis by morphing visemes. Technical Report 1658. 1999;Massachusetts Institute of Technology.
9. Pighin F., Hecker J., Lischinski D., Szeliski R., Salesin D. Synthesizing realistic facial expressions from photographs. Proceedings of SIGGRAPH. 1998.
10. Horn B., Schunck B. Determining optical flow. Artificial Intelligence. 17:1981;185-203.
11. Edwards G., Taylor C., Cootes T. Learning to identify and track faces in image sequences. Proceedings of the British Machine Vision Conference. 1997;. pp. 130-139.
12. Cootes T., Edwards G., Taylor C. Active appearance models. Burkhardt H., Neumann B. Proceedings of the European Conference on Computer Vision. vol. 2:1998;484-498 Springer-Verlag.
13. Matthews I., Cootes T., Cox S., Harvey R., Bangham J. Lip-reading using shape, shading and scale. Proceedings of Auditory-Visual Speech Processing. 1998.
14. O'Toole A., Adbi H., Deffenbacher K., Valentin D. Low-dimensional representation of faces in higher dimensions of the face space. Journal of the Optical Society of America. 10:1993;405-410.
15. Abdi H., Valentin D., Edelman B. Eigenfeatures as intermediate level representations: the case for PCA models. Brain and Behavioural Sciences. 21:1997;175-177.
16. Bregler C., Covell M., Slaney M. Video rewrite: driving visual speech with audio. Proceedings of SIGGRAPH. 1997;. pp. 353-360.
17. Brooke N., Scott S. Two- and three-dimensional audio-visual speech synthesis. Proceedings of Auditory-Visual Speech Processing. 1998;. pp. 213-218.
18. Cootes T., Taylor C., Cooper D., Graham J. Training models of shape from sets of examples. Proceedings of the British Machine Vision Conference. 1992;. pp. 9-18.
19. I. Matthews, Features for audio-visual speech recognition, PhD thesis, School of Information Systems, University of East Anglia, Norwich NR4 7TJ, UK, 1998.
20. Cootes T., Edwards G., Taylor C. A comparative evaluation of active appearance model algorithms. Proceedings of the British Machine Vision Conference. vol. 2:1998;. 680-689.
21. Matthews I., Bangham J., Harvey R., Cox S. A comparison of active shape model and scale decomposition based features for visual speech recognition. European Conference on Computer Vision. 1998.
22. Max J. Quantising for minimum distortion. IRE Trans. Inf. Theory IT-6. 1960;7-12.
23. Methodology for the subjective assessment of the quality of television pictures, Technical Report, Recommendation ITU-R BT.500-10 (1974-1978-1982-1986-1990-1992-1994-1995-1998-1998-2000).
24. Johnston R. Beyond intelligibility - the performance of text-to-speech synthesisers. BT Technology Journal. 14:(1):1996;100-111.
25. Wells M., Pezeshkpour F., Tutt M., Bangham J., Marshall I. Simon - an innovative approach to deaf signing on television. Proceedings of the International Broadcasting Convention. 1999;. 477-482.
26. Theobald B., Cawley G., Matthews I., Glauert J., Bangham J. 2.5D visual speech synthesis using appearance models. Proceedings of the British Machine Vision Conference (To Appear). 2003.
27. Pearson D. Developments in models-based video coding. Proceedings of the IEEE. 83:(6):1995;892-906.
28. Koufakis I., Buxton B. Very low bit rate face video compression using linear combination of 2D face views and principal components analysis. Image Vision Computing. 17:1999;1031-1051.