Automatic adaptation of a face model in a layered coder with an object-based analysis-synthesis layer and a knowledge-based layer

Signal Processing: Image Communication

Volumn 9, Issue 3, 1997, Pages 201-220

  Kampmann, Markus ^a   Ostermann, Jörn ^b  

^a LEIBNIZ UNIVERSITY HANNOVER   (Germany)

^b LUCENT TECHNOLOGIES   (United States)

Author keywords

Analysis synthesis coding; Face detection; Feature extraction; Image analysis; MPEG 4; Object based image coding; Parameter coding; Videophone

Indexed keywords

ALGORITHMS; BIT ERROR RATE; COMPUTER SIMULATION; FEATURE EXTRACTION; IMAGE ANALYSIS; KNOWLEDGE BASED SYSTEMS; OBJECT RECOGNITION; PARAMETER ESTIMATION; THREE DIMENSIONAL; VIDEO TELEPHONE EQUIPMENT;

FACE DETECTION; MOTION PICTURES EXPERT GROUP (MPEG) STANDARD; OBJECT BASED ANALYSIS SYNTHESIS CODER (OBASC); OBJECT BASED IMAGE CODING;

IMAGE CODING;

EID: 0031096524     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0923-5965(96)00019-7     Document Type: Article

References (44)

1. K. Aizawa, H. Harashima and T. Saito, "Model-based analysis synthesis image coding (MBASIC) system for a person's face", Signal Processing: Image Communication, Vol. 1, No. 2, October 1989, pp. 139-152.
2. E. Badiqué, "Knowledge-based facial area recognition and improved coding in a CCITT-compatible low-bitrate video-codec", Proc. Picture Coding Symp. (PCS 90), 9.1, Cambridge, MA, March 1990.
3. H. Busch, "Subdividing nonrigid 3D objects into quasi rigid parts", Proc. IEE 3rd Internat. Conf. on Image Processing and Applications, IEE Publ. 307, pp 1-4, Warwick, UK, July 1989.
4. CCITT, "Draft revision of recommendation H.261: video codec for audio visual services at p × 64 kbit/s", Study Group XV, WP/1/Q4, Specialist Group on Coding for Visual Telephony, Doc. No. 584, November 1989.
5. CCITT SG XV, Doc. #525, Description of Ref. Model 8 (RM8), 1989.
6. Y.Q. Cheng, K. Liu, Y. Yang and H.F. Wang, "A robust algebraic method for human face recognition", Proc. 11th Internat. Conf. on Pattern Recognition, IEEE Computer Soc. Press, Vol. 2, 1992, pp. 221-224.
7. C.S. Choi, K. Aizawa, H. Harashima and T. Takebe, "Analysis and synthesis of facial image sequences in model-based image coding", IEEE Trans. Circuits Systems for Video Technology, Vol. 4, No. 3, June 1994, pp. 257-275.
8. C.S. Choi, T. Takebe and H. Harashima, "Threedimensional (3-D) facial model-based description and synthesis of facial expressions", IEICE Trans. Electronics Communications in Japan, Part 3, Vol. 74, No. 7, 1991, pp. 12-23.
9. M.F. Chowdury, A.F. Clark, A.C. Downton, E. Morimatsu and D.E. Pearson, "A switched model-based coder for video signals", IEEE Trans. Circuits Systems for Video Technology, Vol. 4, No. 3, June 1994, pp. 216-227.
10. M.M. Cohen and D.W. Massaro, "What can visual speech synthesis tell visual speech recognition", Proc. 28th Asilomar Conf. on Signals Systems Computers, Pacific Grove, CA, October-November 1994.
11. Commitee Draft of Standard ISO 11172, Coding of moving pictures and associated audio, ISO/MPEG 90/176, December 1990.
12. Y. Dai, Y. Nakano and H. Miyao, "Extraction of facial images from a complex background using SGLD matrices", Proc. 12th Internat. Conf. on Pattern Recognition, IEEE Computer Soc. Press, Vol. I, 1994, pp. 137-141.
13. P. Eckman and V. W. Friesen, Facial Coding System, Consulting Psychologists Press, Palo Alto, USA, 1977.
14. R. Forchheimer, O. Fahlander and T. Kronander, "A semantic approach to the transmission of face images". Proc. Picture Coding Symp. (PCS'84), Cesson-Sevigne. France, No. 10.5, July 1984.
15. P. Gerken, "Object-based analysis-synthesis coding of image sequences at very low bit rate", IEEE Trans. Circuits Systems for Video Technology, Vol. 4, No. 3, June 1994, pp. 228-235.
16. M. Gilge, T. Engelhardt and R. Mehlan, "Coding of arbitrarily shaped image segments based on a generalized orthogonal transform", Signal Processing: Image Communication, Vol. 1, No. 2, October 1989, pp. 153-180.
17. H.P. Graf, T. Chen, E. Petajan and E. Cosatto, "Locating faces and facial parts", Proc. International Workshop on Face and Gesture Recognition. Zürich, June 1995.
18. H. Harashima, K. Aizawa and T. Saito, "Model-based analysis-synthesis coding of videotelephone images - conception and basic study of intelligent image coding", Trans. IEICE, Vol. E 72, No. 5, May 1989, pp. 452-459.
19. H. Harashima and F. Kishino, "Intelligent image coding and communications with realistic sensations - recent trends", Trans. IEICE, Vol. E 74, No. 6, June 1991, pp. 1582-1592.
20. M. Hötter, "Object-oriented analysis-synthesis coding based on moving two-dimensional objects", Signal Processing: Image Communication, Vol. 2. No. 4, December 1990, pp. 409-428.
21. M. Hötter, "Optimization of an object-oriented analysis-synthesis coder based on the model of flexible 2D-objects", Proc. Picture Coding Symp. (PCS'91), Tokyo, Japan, No. 10.4, September 1991.
22. M. Hötter, "Optimization and efficiency of an object-oriented analysis-synthesis coder", IEEE Trans. Circuit Systems Video Technology, Vol. 4, No. 2, April 1994, pp. 181-194.
23. R. Koch, "Adaptation of a 3D facial mask to human faces in videophone sequences using model based image analysis", Proc. Picture Coding Symp. (PCS'91), Tokyo, Japan, September 1991, pp. 285-288.
24. F. Lavagetto and S. Curinga, "Object-oriented scene modeling for interpersonal video communication at very low bit-rate", Signal Processing: Image Communication, Vol 6, No. 5, October 1994, pp. 379-398.
25. H. Li, A. Lundmark and R. Forchheimer, "Image sequence coding at very low bit-rates: A review", IEEE Trans. Image Process., Vol. 3, No. 5, September 1994, pp. 589-609.
26. H. Li, P. Roivainen and R. Forchheimer, "3-D motion estimation in model-based facial image coding", IEEE Trans. Pattern Machine Intell., Vol. 15, No. 6, June 1993, pp. 545-555.
27. G. Martinez, "Shape estimation of articulated 3D objects for object-based analysis-synthesis coding (OBASC)", Signal Processing: Image Communication, Vol. 9, No. 3, March 1997, pp. 175-199.
28. H.G. Musmann, M. Hötter and J. Ostermann, "Object-oriented analysis-synthesis coding of moving images", Signal Processing: Image Communication, Vol. 1, No. 2, November 1989, pp. 117-138.
29. H.G. Musmann, "A layered coding system for very low bit rate video coding", Signal Processing: Image Communication, Vol. 7, Nos. 4-6, November 1995, pp. 267-278..
30. J. Ostermann, "Modelling of 3D-moving objects for an analysis-synthesis coder", in: B. Girod, ed., Proc. SPIE/SPSE Symp. on Sensing and Reconstruction of 3D Objects and Scenes '90, Proc. SPIE 1260, Santa Clara, California, February 1990, pp. 240-250.
31. J. Ostermann, "Coding of color parameters in an analysis-synthesis coder based on moving 3D-objects", Proc. Picture Coding Symp. (PCS '91), Tokyo. Japan, No. 10.5, September 1991.
32. J. Ostermann, "Object-based analysis-synthesis coding based on the source model of moving rigid 3D objects", Signal Processing: Image Communication, Vol. 6, No. 2, May 1994, pp. 143-161.
33. J. Ostermann, "Object-based analysis synthesis coding (OBASC) based on the source model of moving flexible 3D objects", IEEE Trans. Image Process., Vol. 3, No. 5, September 1994, pp. 705-711.
34. J. Ostermann, "The block-based coder model in an object-based analysis-synthesis coder", Proc. 28th Asilomar Conf. on Signals, Systems, and Computers, Pacific Grove, CA, October-November 1994.
35. J. Ostermann and M. Kampmann, "Automatic adaptation of a facial mask in an analysis-synthesis coder based on moving flexible 3D objects", Proc. Internat. Workshop on Coding Techniques for Very Low Bit-rate Video (VLBV 94), Colchester, UK, April 1994, pp. 2.4.
36. J. Ostermann and H. Li, "Detection and coding of model failures in an analysis-synthesis coder based on moving 3D-objects", Proc. 3rd Internat. Workshop on 64 kbit/s Coding of Moving Video, Rotterdam, The Netherlands, No. 4.4, September 1990.
37. F.I. Parke, A parametric model for human faces, Tech. Report UTEC-Csc-75-047, University of Utah, Salt Lake City, 1974.
38. D.E. Pearson, "Texture mapping in model-based image coding", Signal Processing: Image Communication, Vol. 2, No. 4, December 1990, pp. 377-395.
39. ter European Workshop on New Techniques for Coding of Video Signals at Very Low Bitrates, No. 4.1, December 1993.
40. P. Roivainen and R. Forchheimer, "Model-based coding: estimation of face motion", Proc. Picture Coding Symp. (PCS '90), Boston, No. 7.7, March 1990.
41. R. Rydfalk, CANDIDE, A parameterised face, Internal Report Lith-ISY-I-0866, Linköping University, Linköping, Sweden, 1987.
42. R. Vaillant, C. Monrocq and Y. LeCun, "Original approach for the localisation of objects in images", IEE Proc. Vis. Image Signal Process., Vol. 141, No. 4, 1994, pp. 245-250.
43. K. Waters, "A muscle model for animating 3-dimensional facial expression", Proc. SIGGRAPH 87, 1987, pp. 61-68.
44. W.J. Welsh, S. Searby and J.B. Waite, "Model-based image coding", British Telecom Technology J., Vol. 8, No. 3, July 1990, pp. 94-106.