Nonlinear color space and spatiotemporal MRF for hierarchical segmentation of face features in video

IEEE Transactions on Image Processing

Volumn 13, Issue 1, 2004, Pages 63-71

  Liévin, Marc ^a   Luthon, Franck ^b  

^a CENTER OF ADVANCED EUROPEAN STUDIES AND RESEARCH CAESAR   (Germany)

^b UNIVERSITÉ DE PAU ET DES PAYS DE L'ADOUR   (France)

Author keywords

Face analysis; Hue; Liptracking; Logarithmic color space; Markov random field; Motion detection; Segmentation

Indexed keywords

ALGORITHMS; CAMERAS; EDGE DETECTION; FEATURE EXTRACTION; HUMAN COMPUTER INTERACTION; IMAGE COMPRESSION; IMAGE SEGMENTATION; MARKOV PROCESSES; NEURAL NETWORKS;

FACE ANALYSIS; LIPTRACKING; MARKOV RANDOM FIELD MODELING; MOTION DETECTION;

FACE RECOGNITION;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; COLOR; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; EVALUATION; EYE; EYE MOVEMENT; FACE; HISTOLOGY; HUMAN; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; LIP READING; METHODOLOGY; NONLINEAR SYSTEM; PHYSIOLOGY; PROBABILITY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; STATISTICAL MODEL; VALIDATION STUDY; VIDEORECORDING;

ALGORITHMS; COLOR; EYE; EYE MOVEMENTS; FACE; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; LIPREADING; MARKOV CHAINS; MODELS, STATISTICAL; NONLINEAR DYNAMICS; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; VIDEO RECORDING;

EID: 4844220360     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2003.818013     Document Type: Article

References (33)

1. M. H. Yang, D. J. Kriegman, and N. Ahuja, "Detecting faces in images: A survey," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, pp. 34-58, Jan. 2002.
2. E. Hjelmås and B. K. Low, "Face detection: A survey," Comput. Vis. Image Understand., vol. 83, no. 3, pp. 236-274, Sept. 2001.
3. H. A. Rowley, S. Baluja, and T. Kanade, "Neural network-based face detection," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 23-38, Jan. 1998.
4. S. Ben-Yacoub, B. Fasel, and J. Luettin, "Fast face detection using MLP and FFT," in Proc. Int. Conf. on Audio and Video-Based Biometric Person Authentication, Washington, DC, 1999.
5. S. J. McKenna, S. Gong, and Y. Raja, "Modeling facial color and identity with Gaussian mixtures," Pattern Recognit., vol. 12, pp. 1883-1892, Dec. 1998.
6. A. Colmenarez et al., "Detection and tracking of faces and facial features," in Proc. IEEE Int. Conf. Image Processing, Kobe, Japan, Oct. 1999.
7. M. S. Lew and N. Huijsmans, "Information theory and face detection," in Proc. Int. Conf. Pattern Recognition, Vienna, Austria, Aug. 1996, pp. 601-605.
8. C. H. Lin and J. L. Wu, "Automatic facial feature extraction by genetic algorithm," IEEE Trans. Image Processing, vol. 8, pp. 834-845, June 1999.
9. A. L. Yuille, P. W. Hallinan, and D. S. Cohen, "Feature extraction from faces using deformable templates," Int. J. Comput. Vis., vol. 2, no. 8, pp. 99-111, 1992.
10. T. Chen, "Audiovisual speech processing. Lip reading and lip synchronization," IEEE Signal Processing Mag., vol. 18, pp. 9-21, Jan. 2001.
11. D. DeCarlo and D. Metaxas, "Combining information using hard constraints," in Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, Ft. Collins, CO, 1999, pp. 132-138.
12. J. Ström, T. Jebara, S. Basu, and A Pentland, "Real time tracking and modeling of faces: An EKF-based analysis by synthesis approach," in Proc. IEEE Int. Conf. on Computer Vision, Zurich, Switzerland, 1999.
13. R. Ishiyama and S. Sakamoto, "Geodesic illumination basis: Compensating for illumination variations in any pose for face recognition," in Proc. Int. Conf. on Pattern Recognition, Aug. 2002.
14. I. A. Essa and A. P. Pentland, "Coding, analysis, interpretation, and recognition of facial expressions," IEEE Trans. Pattern Anal. Machine Intell., vol. 19, no. 7, pp. 757-763, 1997.
15. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. G. Taylor, "Emotion recognition in human-computer interaction," IEEE Signal Processing Mag., vol. 19, pp. 32-80, Jan. 2001.
16. B. Menser and M. Wien, "Segmentation and tracking of facial regions in color image sequences," Proc. SPIE, pp. 731-740, June 2000.
17. D. Chai and K. N. Ngan, "Face segmentation using skin-color map in videophone applications," IEEE Trans. Circuits, Syst., Video Technol., vol. 9, pp. 551-564, June 1999.
18. B. Martinkauppi, M. Soriano, and M. Laaksonen, "Behavior of skin color under varying illumination seen by different cameras in different color spaces," Proc. SPIE, vol. 4301, pp. 102-103 Jan. 2001.
19. C. Garcia and G. Tziritas, "Face detection using quantized skin color regions merging and wavelet packet analysis," IEEE Trans. Multimedia, vol. 1, pp. 264-277, Sept. 1999.
20. R.-L. Hsu, M. Abdel-Mottaleb, and A. K. Jain, "Face detection in color images," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, pp. 696-706, May 2002.
21. F. J. Huang and T. Chen, "Tracking of multiple faces for human-computer interfaces and virtual environnements," in Proc. IEEE Int. Conf. on Multimedia and Expo, New York, July 2000.
22. C. Wang and M. S. Brandstein, "A hybrid real-time face tracking system," in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, 1998.
23. S. Shah and M. D. Levine, "Visual information processing in primate cone pathways - Part I: A model," IEEE Trans. Syst., Man, Cybern., vol. 26, pp. 259-289, Apr. 1996.
24. G. Deng and J.-C. Pinoli, "Differentiation-based edge detection using the logarithmic image processing model," J. Math. Imag. Vis., vol. 8, pp. 161-180, 1998.
25. M. Jourlin, and J.-C. Pinoli, "Image dynamic range enhancement and stabilization in the context of the logarithmic image processing model," Signal Process., vol. 41, no. 2, pp. 225-237, Jan. 1995.
26. M. M. Fleck, D. A. Forsyth, and C. Bregler, "Finding naked people," in Proc. Eur. Conf. on Computer Vision, vol. 2, Cambridge, U.K., 1996, pp. 593-602.
27. F. Luthon, A. Caplier, and M. Liévin, "Spatiotemporal MRF approach to video segmentation: Application to motion detection and lip segmentation," Signal Process., vol. 76, no. 1, pp. 253-260, 1999.
28. Y. W. Lim and S. U. Lee, "On the color image segmentation algorithm based on the thresholding and the fuzzy C-means techniques," Pattern Recognit., vol. 23, no. 9, pp. 935-952, 1990.
29. T. Coianiz, L. Torresani, and B. Caprile, "2D deformable models for visual speech analysis," in Proc. 29th Asilomar Conf. Signals, Systems, and Computers, Pacific Grove, CA, Nov. 1995, pp. 391-398.
30. F. Luthon and M. Liévin, "Entropic thresholding in image processing," in Proc. Eur. Signal Processing Conf., vol. 1, Toulouse, France, Sept. 2002, pp. 605-608.
31. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Machine Intell., vol. 6, pp. 721-741, Nov. 1984.
32. P. Bouthémey and P. Lalande, "Recovery of moving object masks in an image sequence using local spatiotemporal contextual information," Opt. Eng., vol. 32, no. 6, pp. 1205-1212, June 1993.
33. M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active contour models," Int. J. Comput. Vis., pp. 321-331, 1988.