Accurate and quasi-automatic lip tracking

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 14, Issue 5, 2004, Pages 706-715

  Eveno, Nicolas ^a   Caplier, Alice ^a   Coulon, Pierre Yves ^a  

^a Laboratoire des Images et des Signaux   (France)

Author keywords

Active contour; Deformable model; Points tracking; Segmentation

Indexed keywords

ALGORITHMS; ERROR DETECTION; IMAGE CODING; IMAGE SEGMENTATION; LIGHTING; MULTIMEDIA SYSTEMS; ROBUSTNESS (CONTROL SYSTEMS); VIDEO CONFERENCING; VISUAL COMMUNICATION;

ACTIVE CONTOUR; DEFORMABLE MODEL; LIP SEGMENTATION; POINTS TRACKING;

SPEECH RECOGNITION;

EID: 2542485577     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2004.826754     Document Type: Article

References (22)

1. X. Zhang, R. M. Mersereau, M. A. Clements, and C. C. Broun, "Visual speech feature extraction for improved speech recognition," in Proc. ICASSP, 2002. pp. 1993-1996.
2. A. Nefian, L. Liang, X. Pi, L. Xiaoxiang, C. Mao, and K. Murphy, "A couple HMM for audio-visual speech recognition," in Proc. ICASSP, 2002, pp. 2013-2016.
3. M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active contour models," Int. J. Comput. Vis., vol. 1, no. 4, pp. 321-331, Jan. 1988.
4. D. Terzopoulos and K. Waters, "Analysis and synthesis of facial image sequences using physical and anatomical models," IEEE Trans. Pattern Anal. Machine Intell., vol. 15, pp. 569-579, June 1993.
5. P. Delmas, P.-Y. Coulon, and V. Fristot, "Automatic snakes for robust lip boundaries extraction," in Proc. ICASSP, 1999, pp. 3069-3072.
6. P. S. Aleksic, J. J. Williams, Z. Wu, and A. K. Katsaggelos, "Audiovisual speech recognition using MPEG-4 compliant visual features," EURASIP J. Appl. Signal Processing, vol., pp. 1213-1227, Sept. 2002.
7. J. Luettin, N. A. Tracker, and S. W. Beet, "Active Shape Models for Visual Speech Feature Extraction," Univ. of Sheffield, Sheffield, U.K., Electronic System Group Rep. 95/44, 1995.
8. A. Yuille, P. Hallinan, and D. Cohen, "Feature extraction from faces using deformable templates," Int. J. Comput. Vis., vol. 8, no. 2, pp. 99-111, 1992.
9. Y. Tian, T. Kanade, and J. Cohn, "Robust lip tracking by combining shape, color and motion," in Proc. ACCV, 2000, pp. 1040-1045.
10. T. Coianiz, L. Torresani, and B. Caprile, "2D deformable models for visual speech analysis," NATO Advanced Study Institute: Speech reading by Man and Machine, pp. 391-398, 1995.
11. M. E. Hennecke, K. V. Prasad, and D. G. Stork, "Using deformable templates to infer visual speech dynamics," in P roc. 28th Annu. Asilomar Conf. Signals, Systems, and Computers, 1994, pp. 578-582.
12. N. Eveno, A. Caplier, and P. Y. Coulon, "Jumping snake and parametric model for lip segmentation," in Proc. ICIP, Barcelona, Spain, 2003, pp. 867-870.
13. M. O. Berger and R. Mohr, "Toward autonomy in active contour models," in Proc. ICPR, 1990, pp. 847-851.
14. N. Eveno, A. Caplier, and P. Y. Coulon, "Key points based segmentation of lips," in Proc. ICME, 2002, pp. 125-128.
15. A. Hulbert and T. Poggio, "Synthesizing a color algorithm from examples," Science, vol. 239, pp. 482-485, 1998.
16. N. Eveno, A. Caplier, and P. Y. Coulon, "A new color transformation for lips segmentation," in Proc. MMSP, 2001, pp. 3-8.
17. _, "A parametric model for realistic lip segmentation," presented at the ICARCV, 2002.
18. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. IJCAJ'81. Vancouver, BC, Canada, 1981, pp. 674-679.
19. C. Tomasi and T. Kanade, "Detection and Tracking of Point Features," Carnegie Mellon Univ., Tech. Rep. CMU-CS-91-132, 1991.
20. P. Delmas, N. Eveno, and M. Lievin, "Toward robust lip tracking," in Proc. ICPR, 2002, pp. 528-531.
21. E. C. Hildreth, The Measurement of Visual Motion. Cambridge, MA: MIT Press, 1984.
22. Nicolas Eveno's Page, Research Results [Online]. Available: http://www.lis.inpg.fr/pages_perso/eveno/recherche_en.htm