Visual analysis/synthesis feedback loop for accurate face tracking

Signal Processing: Image Communication

Volumn 16, Issue 6, 2001, Pages 585-608

  Valente, Stéphane ^a   Dugelay, Jean Luc ^a  

^a EURECOM   (France)

Author keywords

[No Author keywords available]

Indexed keywords

IMAGE ANALYSIS; IMAGE QUALITY; KALMAN FILTERING; STANDARDS; TELECONFERENCING; VIRTUAL REALITY;

FACE CLONING; FACE TRACKING;

OBJECT RECOGNITION;

EID: 0035254311     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0923-5965(00)00038-2     Document Type: Article

References (41)

1. P.M. Antoszczyszyn, J.M. Hannah, P.M. Grant, Accurate automatic frame fitting for semantic-based moving image coding using a facial code-book, in: IEEE International Conference on Image Processing, Lausanne, Switzerland, September 1996.
2. P.M. Antoszczyszyn, J.M. Hannah, P.M. Grant, Automatic frame fitting for semantic-based moving image coding using a facial code-book, in: Eusipco-96, Trieste, Italy, September 1996.
3. Azarbayejani A., Starner T., Horowitz B., Pentland A. Visually controlled graphics. IEEE Trans. Pattern Anal. Mach. Intell. 15(6):June 1993;602-605.
4. S. Basu, I. Essa, A. Pentland, Motion regularization for model-based head tracking, Technical Report 362, MIT Media Lab., 1996.
5. P. Belhumeur, D. Kriegman, What is the set of images of an object under all possible lighting conditions?, in: IEEE Conference on Computer Vision and Pattern Recognition, November 1996.
6. Bozdagi G., Tekalp M., Onural L. 3-D motion estimation and wireframe adaptation including photometric effects for model-based coding of facial image sequences. IEEE Trans. Circuits Systems Video Technol. 4(3):June 1994;246-256.
7. CYBERWARE Home Page, URL http: // www.cyberware.com.
8. D. DeCarlo, D. Metaxas, The integration of optical flow and deformable models with applications to human face shape and motion estimation, in: IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, California, 18-20 June 1996, pp. 231-238.
9. Delingette H. General object reconstruction based on simplex meshes. Int. J. Comput. Vision. 32(2):1999;111-146.
10. J.-L. Dugelay, K. Fintzel, S. Valente, Synthetic natural hybrid video processings for virtual teleconferencing systems, in: Picture Coding Symposium, Portland, Oregon, 21-23 April 1999.
11. Dugelay J.-L., Sanson H. Differential methods for the identification of 2D and 3D motion models in image sequences. Signal Processing: Image Communication. 7(1):1995;105-127.
12. P. Eisert, B. Girod, Model-based 3D-motion estimation with illumination compensation, in: Sixth International Conference on Image Processing and its Applications (IPA 97), Dublin, Ireland, July 1997, pp. 194-198.
13. Eisert P., Girod B. Analysing facial expressions for virtual conferencing. IEEE Comput. Graphics Appl. 18(5):September 1998;70-78.
14. Eleftheriadis A., Jacquin A. Automatic face location detection and tracking for model-assisted coding of video teleconferencing sequences at very low bit-rates. Signal Processing: Image Communication. 7(3):June 1995;231-248.
15. K. Fintzel, J.-L. Dugelay, Visual spatialization of a meeting room from 2D uncalibrated views, in: H. Niemann, H.-P. Seidel, B. Girod (Eds.), Image and Multidimensional Digital Signal Processing'98, Alpbach, Austria, 1998, pp. 323-326.
16. G. Hager, P. Belhumeur, Real-time tracking of image regions with changes in geometry and illumination, in: IEEE Conference on Computer Vision and Pattern Recognition, November 1996.
17. Institut National de l'Audiovisuel, Televirtuality project: cloning and real-time animation system, URL http: // www.ina.fr / INA / Recherche / TV.
18. T.S. Jebara, A. Pentland, Parametrized structure from motion for 3D adaptive feedback tracking of faces, in: IEEE Conference on Computer Vision and Pattern Recognition, November 1996.
19. T. Kanade, P.J. Narayanan, P.W. Rander, Virtualized reality: concepts and early results, in: IEEE Workshop on Representation of Visual Scenes, Cambridge, MA, June 1995. In conjunction with ICCV'95.
20. S.M. Kay, Fundamentals of Statistical Signal Processing Estimation Theory, PTR Prentice-Hall, Englewood Cliffs, NJ, 1993, Chapter 13, pp. 419-477.
21. Koch R. Dynamic 3-D scene analysis through synthesis feedback control. IEEE Trans. Pattern Anal. Mach. Intell. 15(6):June 1993;556-568.
22. Li H., Roivainen P., Forchheimer R. 3-D motion estimation in model-based facial image coding. IEEE Trans. Pattern Anal. Mach. Intell. 15(6):June 1993;545-555.
23. MPEG demo of the face tracking system, URL http: // www.eurecom.fr /~ image / TRAIVI / valente-8points.mpg (1,782,100 bytes).
24. MPEG demo of the animation system, URL http: // www.eurecom.fr /~ image / TRAIVI / animation.mpg (1,258,604 bytes).
25. MPEG sequence used to evaluate the tracking algorithm, URL http: // www.eurecom.fr /~ image / TRAIVI / accuracy-test.mpg (2,906,348 bytes).
26. MPEG-4 synthetic / natural hybrid coding, URL http: // www.es.com / mpeg4-snhc.
27. J. Neider, T. Davis, M. Woo, OpenGL Programming Guide, OpenGL Architecture Review Board, Release 1 Edition, June 1993.
28. Ohya J., Kitamura Y., Kishino F., Terashima N. Virtual space teleconferencing: real-time reproduction of tridimensional human images. J. Visual Commun. Image Representation. 6(1):March 1995;1-25.
29. Overview of the MPEG-4 standard, Technical Report ISO / IEC JTC1 / SC29 / WG11 N2725, International Organisation for Standardisation, Seoul, South Korea, March 1999.
30. Proceedings of the Second International Conference on Audio- and Video-based Biometric Person Authentification (AVBPA'99), Washington, DC, 22-23 March 1999.
31. M. Proesmans, L. Van Gool, One-shot 3D-shape and texture acquisition of facial data, in: Audio- and Video-based Biometric Person Authentification, Crans-Montana, Switzerland, March 1997, pp. 411-418.
32. Reinders M.J.T., van Beek P.L.J., Sankur B., van der Lubbe J.C.A. Facial feature localization and adaptation of a generic face model for model-based coding. Signal Processing: Image Communication. 7(1):1995;57-74.
33. A. Saulnier, M.-L. Viaud, D. Geldreich, Real-time facial analysis and synthesis chain, in: International Workshop on Automatic Face- and Gesture-Recognition, Zurich, Switzerland, 1995, pp. 86-91.
34. A. Schödl, A. Haro, I.A. Essa, Head tracking using a textured polygonal model, in: Workshop on Perceptual User Interfaces, San Francisco, California, 4-6 November 1998.
35. C. Schoeneman, J. Dorsey, B. Smits, J. Arvo, D. Greenberg, Painting with light, in: SIGGRAPH 93, Anaheim, California, 1-6 August 1993, pp. 143-146.
36. J. Signès, J. Close, Streaming VRML and mixed media with MPEG-4, in: SIGGRAPH 98, Orlando, Florida, 19-24 July 1998.
37. L. Tang, T.S. Huang, Automatic construction of 3D human face models based on 2D images, in: IEEE International Conference on Image Processing, Lausanne, Switzerland, September 1996.
38. Valente S., Dugelay J.-L. A multi-site teleconferencing system using VR paradigms, in: Ecmast. 1997;Milano, Italy.
39. S. Valente, J.-L. Dugelay, Face tracking and realistic animations for telecommunicant clones, in: IEEE International Conference on Multimedia Computing and Systems, Florence, Italy, 7-11 June 1999.
40. VIDAS - VIDeo ASsisted audio coding and representation, URL http: // miralabwww.unige.ch / Vidas-TO.html.
41. VRML, URL http: // vrml.sgi.com.