FaceSeg: Automatic face segmentation for real-time video

IEEE Transactions on Multimedia

Volumn 11, Issue 1, 2009, Pages 77-88

  Li, Hongliang ^a   Ngan, King N ^b   Liu, Qiang ^b  

^a UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Adaboost; face detection; graph cut; matting; segmentation

Indexed keywords

DETECTION PROCESS; FACE SEGMENTATION; GENERATION METHOD; GRAPH CUT; INTERACTIVE METHODS; MATTING; REAL TIME VIDEOS; SEGMENTATION SYSTEM;

ADAPTIVE BOOSTING; IMAGE SEGMENTATION;

FACE RECOGNITION;

EID: 77955999577     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2008.2008922     Document Type: Article

References (42)

1. H. Li and K. N. Ngan, "Automatic video segmentation and tracking for content-based applications," IEEE Commun. Mag., vol. 45, no. 1, pp. 27-33, Jan. 2007.
2. Y. Boykov and M.-P. Jolly, "Interactive graph cuts for optimal boundary & region segmentation of objects in n-d images," in Proc. ICCV 2001, July 2001, vol. 1, pp. 105-112.
3. J. Sun, J. Jia, C.-K. Tang, and H.-Y. Shum, "Poisson matting," in Proc. SIGGRAPH 2004.
4. C. Rother, V. Kolmogorov, and A. Blake, "GrabCut? interactive foreground extraction using iterated graph cuts," in Proc. SIGGRAPH 2004, 2004.
5. Y. Li, J. Sun, C.-K. Tang, and H.-Y. Shum, "Lazy snapping," in Proc. SIGGRAPH 2004, 2004.
6. Y. Li, J. Sun, and H.-Y. Shum, "Video object cut and paste," in Proc. SIGGRAPH 2005, 2005.
7. J. Wang, P. Bhat, R. A. Colburn, M. Agrawala, and M. F. Cohen, "In- teractive video cutout," in Proc. SIGGRAPH 2005, 2005.
8. D. Chai and K. N. Ngan, "Face segmentation using skin-color map in videophone applicaiton," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 4, pp. 551-564, Jun. 1999.
9. C. Garcia and G. Tziritas, "Face detection using quantized skin color regions merging and wavelet packet analysis," IEEE Trans. Multi- media, vol. 1, no. 3, pp. 264-277, Sep. 1999.
10. H. Greespan, J. Goldberger, and I. Eshet, "Mixture model for face color modeling and segmentation," Pattern Recognit. Lett., vol. 22, pp. 1525-1536, Sep. 2001.
11. M. J. Jones and J. M. Rehg, "Statistical color model with applicaiton to skin detection," Int. J. Comput. Vis., vol. 46, no. 1, pp. 81-96, 2002.
12. R. L. Hsu, M. A. Mottaleb, and A. K. Jain, "Face detection in color images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 696-706, May 2002.
13. M. Lievin and F. Luthon, "Nonlinear color space and spatiotemporal MRF for hierarchical segmentation of face features in video," IEEE Trans. Image Process., vol. 13, no. 1, pp. 63-71, Jan. 2004.
14. N. Habili, C. C. Lim, and A. Moini, "Segmentation of the face and hands in sign language video seguences using color and motion cues," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 8, pp. 1086-1097, Aug. 2004.
15. S. L. Phung, A. Bouzerdoum, and D. Chai, "Skin segmentation using color pixel classi?cation: Analysis and comparison," IEEE Trans. Pat- tern Anal. Machine Intell., vol. 27, no. 1, pp. 148-154, Jan. 2005.
16. H. Luo and A. Eleftheriadis, "Model-based segmentation and tracking of head-and-shoulder video objects for real time multimedia services," IEEE Trans. Multimedia, vol. 5, no. 3, pp. 379-389, Sep. 2003.
17. T. Zhao and R. Nevatia, "Bayesian human segmentation in crowded situations," in IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, 2003, vol. 2, pp. 459-466.
18. H. Li and K. N. Ngan, "Face segmentation in head-and-shoulder video sequences based on facial saliency map," in Proc. IEEE ISCAS2006, May 2006, pp. 2681-2684.
19. H. Li and K. N. Ngan, "Saliency model based face segmentation and tracking in head-and-shoulder video sequences," J. Vis. Commun. Image Represent., vol. 19, no. 5, pp. 320-333, 2008.
20. J. Sun, W. Zhang, X. Tang, and H.-Y. Shum, "Background cut," Proc. ECCV 2006, 2006.
21. A.Himanshu,L.Nicolas,A.F.David,andA.Narendra,"Unsupervised segmentation of objects using ef?cient learning," Proc. CVPR2007, pp. 1-7, 2007.
22. B. Wu and N. Ram, "Simultaneous object detection and segmenta- tionby boosting local shape feature based classi?er," Proc. CVPR2007, 2007.
23. G. Laura, J. P. Thiran, and P. Nikos, "Joint object segmentation and behavior classi?cation in image sequences," Proc. CVPR2007, 2007.
24. M.-H. Yang, D. Roth, and N. Ahuja, "ASNoW-BasedFace detector," in Proc. Neural Information Processing Systems, 2000, pp. 855-861.
25. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Dec. 2001, vol. 1, pp. 511-518.
26. R. Lienhart and J. Maydt, "An extended set of haar-like features for rapid object detection," in Proc. IEEE Conf. Image Processing, 2002, vol. 1, pp. 900-903.
27. S. Z. Li and Z. Q. Zhang, "FloatBoost learning and statistical face de- tection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1112-1123, Sep. 2004.
28. T. Mita, T. Kaneko, and O. Hori, "Joint haar-like features for face de- tection," in Proc. IEEE Computer Soc. Conf. Computer Vision, Oct. 2005, vol. 2, pp. 1619-1626.
29. C. Liu and H.-Y. Shum, "Kullback-Leibler boosting," in Proc. CVPR 2003, 2003, vol. 1, pp. 587-594.
30. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," J. Comput. Syst. Sci., vol. 55, pp. 119-139, 1997.
31. P. Wang and Q. Ji, "Learning discriminant features for multi-view face andeyedetection,"inProc.CVPR2005,Jun.2005,vol.1,pp.373-379.
32. S. Baluja and H. A. Rowley, "Boosting sex indenti?caiton perfor- mance," Int. J. Comput. Vis., vol. 71, no. 1, pp. 111-119, 2007.
33. S. Avidan and M. Butman, "The power of feature clustering: An ap- plication to object detection," Neural Information Processing Systems (NIPS), Dec. 2004.
34. Y. Boykov and V. Kolmogorov, "An experimental comparison of min-cut/max-?ow algorithms for energy minimization in vision," IEEE Trans. Pattern Anal. Machine Intell., vol. 26, no. 9, pp. 1124-1137, Sep. 2004.
35. Y.-Y. Chuang, B. Curless, D. H. Salesin, and R. Szeliski, "A Bayesian approach to digital matting," in Proc. CVPR 2001, vol. 2, pp. 264-271.
36. M. A. Ruzon and C. Tomasi, "Alpha estimation in natural images," in Proc. CVPR 2000, June 2000, vol. 1, pp. 18-25.
37. M. Mcguire, W. Matusik, H. P?ster, J. F. Hughes, and F. Durand, "De- focus video matting," in Proc. SIGGRAPH 2005.
38. N. Joshi, W. Matusik, and S. Avidan, "Natural video matting using camera arrays," in Proc. SIGGRAPH 2006.
39. J. Sun, Y. Li, S. B. Kang, and H.-Y. Shum, "Flash matting," in Proc. SIGGRAPH 2006.
40. H. Li and K. N. Ngan, "Unsupervised video segmentation with low depth of eld," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 12, pp. 1742-1751, Dec. 2007.
41. L. Fei-Fei, R. Fergus, and P. Perona, "Learning generative visual models from few training examples: An incremental Bayesian ap- proach tested on 101 object categories," in IEEE. CVPR 2004, Workshop on Generative-Model Based Vision, 2004.
42. [Online]. Available: vspc.ee.cuhk.edu.hk/projects/itf.shtml