Detecting skin in face recognition systems: A colour spaces study

Digital Signal Processing: A Review Journal

Volumn 20, Issue 3, 2010, Pages 806-823

  Chaves González, Jose M ^a   Vega Rodríguez, Miguel A ^a   Gómez Pulido, Juan A ^a   Sánchez Pérez, Juan M ^a  

^a UNIVERSITY OF EXTREMADURA   (Spain)

Author keywords

Colour spaces; Face detection and recognition; HSV; RGB; Skin colour detection; YCbCr; YIQ; YUV

Indexed keywords

CHROMIUM ALLOYS; COLOR; LEAD ALLOYS; PRASEODYMIUM ALLOYS; SKIN; TERNARY ALLOYS;

COLOUR SPACES; EFFICIENT FACES; FACE DETECTION AND RECOGNITION; FACE RECOGNITION SYSTEMS; FALSE NEGATIVES; FALSE POSITIVE; SKIN COLOUR; YCBCR;

FACE RECOGNITION;

EID: 77949488671     PISSN: 10512004     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dsp.2009.10.008     Document Type: Article

References (97)

1. Zhao W., Chellappa R., Phillips P.J., and Rosenfeld A. Face recognition: A literature survey. ACM Computing Surveys 35 4 (2003) 399-458
2. Zhao W.Y., and Chellappa R. Image-based face recognition: Issues and methods. In: Javidi B. (Ed). Image Recognition and Classification (2002), Marcel Dekker 375-402
3. X. Lu, Image analysis for face recognition, personal notes, May 2003
4. Yang M.-H., Kriegman D.J., and Ahuja N. Detecting faces in images: A survey. IEEE Trans. Pattern Anal. Mach. Intell. 24 1 (2002) 34-58
5. McKenna S., Raja Y., and Gong S. Tracking colour objects using adaptive mixture models. Image Vision Computing 17 3/4 (1998) 223-229
6. H.P. Graf, T. Chen, E. Petajan, E. Cosatto, Locating faces and facial parts, in: Proc. First International Workshop Automatic Face and Gesture Recognition, 1995, pp. 41-46
7. H.P. Graf, E. Cosatto, D. Gibbon, M. Kocheisen, E. Petajan, Multimodal system for locating heads and faces, in: Proc. Second International Conference on Automatic Face and Gesture Recognition, 1996, pp. 88-93
8. J. Yang, A. Waibel, A real-time face tracker, in: Proc. Third Workshop Applications of Computer Vision, 1996, pp. 142-147
9. Chai D., and Ngan K.N. Face segmentation using skin-color map in videophone applications. IEEE Trans. Circuits Syst. Video Technology 9 4 (1999) 551-564
10. L. Chen, C. Grecos, A fast skin region detector for colour images, in: IEE International Conference on Visual Information Engineering, 2005, pp. 195-201
11. O. Ikeda, Segmentation of faces in video footage using HSV color of face detection and image retrieval, in: IEEE International Conference on Image Processing 2003 (ICIP 2003), vol. 3, 2003, pp. 913-916
12. W.-H. Lai, C.-T. Li, Skin colour-based face detection in colour images, in: IEEE International Conference on Video and Signal Based Surveillance, 2006, pp. 56-62
13. N. Soontranon, S. Aramvith, T.H. Chalidabhongst, Face and hands localization and tracking for sign language recognition, in: International Symposium on Communications and Information Technologies, 2004, pp. 1246-1251
14. I. Naseem, M. Deriche, Robust human face detection in complex color images, in: IEEE International Conference on Image Processing, vol. 2, 2005, pp. 338-341
15. C. Lin, Face detection by color and multilayer feedforward neural network, in: IEEE International Conference on Information Acquisition, vol. 1, 2005, pp. 518-523
16. R. Jailani, M.N. Taib, S. Sulaiman, Color space for psoriasis skin diseases analysis, in: IEEE Asian Conference on Sensors, 2003, pp. 263-268
17. T.S. Jebara, A. Pentland, Parameterized structure from motion for 3D adaptive feedback tracking of faces, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition, 1997, pp. 144-150
18. T.S. Jebara, K. Russell, A. Pentland, Mixtures of eigenfeatures for real-time structure from texture, in: Proc. Sixth IEEE International Conference Computer Vision, 1998, pp. 128-135
19. Satoh S., Nakamura Y., and Kanade T. Name-it: Naming and detecting faces in news videos. IEEE Multimedia 6 1 (1999) 22-35
20. P.-T. Pham-Ngoc, K.-H. Jo, Multi-face detection system in video sequence, in: The 1st International Forum on Strategic Technology, 2006, pp. 146-150
21. Chen M.-J., Chi M.-C., Hsu C.-T., and Chen J.-W. ROI video coding based on H.263+ with robust skin-color detection technique. IEEE Trans. Consum. Electron. 49 3 (2003) 724-730
22. C. Lin, Face detection by color and multilayer feedforward neural network, in: IEEE International Conference on Information Acquisition, 2005, pp. 518-523
23. Miyake Y., Saitoh H., Yaguchi H., and Tsukada N. Facial pattern detection and color correction from television picture for newspaper printing. J. Imaging Technol. 16 5 (1990) 165-169
24. J. Yang, R. Stiefelhagen, U. Meier, A. Waibel, Visual tracking for multimodal human computer interaction, in: Proc. ACM Human Factors in Computing Systems Conference, 1998, pp. 140-147
25. Q.B. Sun, W.M. Huang, J.K. Wu, Face detection based on color and local symmetry information, in: Proc. Third International Conference on Automatic Face and Gesture Recognition, 1998, pp. 130-135
26. I. Naseem, M. Deriche, Robust human face detection in complex color images, in: IEEE International Conference on Image Processing, vol. 2, 2005, pp. 338-341
27. F. Boussaid, D. Chai, A. Bouzerdoum, A current-mode VLSI architecture for skin detection, in: Proc. Seventh International Symposium on Signal Processing and Its Applications, vol. 1, 2003, pp. 629-632
28. J.A. Dargham, A. Chekima, Lips detection in the normalised RGB colour scheme, in: Proc. 2nd Conference on Information and Communication Technologies, vol. 1, 2006, pp. 1546-1551
29. F. Boussaid, D. Chai, A. Bouzerdoum, On-chip skin detection for color CMOS imagers, in: Proc. International Conference on MEMS, NANO and Smart Systems, 2003, pp. 357-361
30. S.M. Yoon, S.C. Kee, Speaker detection and tracking at mobile robot platform, in: International Symposium on Intelligent Signal Processing and Communication Systems, 2004, pp. 596-600
31. M.-J. Seow, V.K. Asari, Associative memory based on ratio learning for real time skin color detection, in: 32nd Applied Imagery Pattern Recognition Workshop, 2003, pp. 151-156
32. M.-J. Seow, D. Valaparla, V.K. Asari, Neural network based skin color model for face detection, in: 32nd Applied Imagery Pattern Recognition Workshop, 2003, pp. 141-145
33. J.-M. Zhang, L.-M. Wang, D.-J. Niu, Y.-Z. Zhan, Research and implementation of a real time approach to lip detection in video sequences, in: International Conference on Machine Learning and Cybernetics, vol. 5, 2003, pp. 2795-2799
34. D. Chai, S.L. Phung, A. Bouzerdoum, A Bayesian skin/non-skin color classifier using non-parametric density estimation, in: International Symposium on Circuits and Systems, vol. 2, 2003, pp. 464-467
35. J. Brand, J.S. Mason, A comparative assessment of three approaches to pixel-level human skin-detection, in: Proc. 15th International Conference on Pattern Recognition, vol. 1, 2000, pp. 1056-1059
36. P-T. Pham-Ngoc, K-H. Jo, Color-based face detection using combination of modified local binary patterns and embedded hidden Markov models, in: International Joint Conference SICE-ICASE, 2006, pp. 5598-5603
37. H. Ramos, A.C. Frery, J. Alencar-Neto, Skin detection in Web imagery: Comparison of techniques and proposal, in: IEEE International Conference on Image Processing, 2006, pp. 3009-3012
38. S. Cooray, N. O'Connor, A hybrid technique for face detection in color images, in: IEEE Conference on Advanced Video and Signal Based Surveillance, 2005, pp. 253-258
39. R. Kjeldsen, J. Kender, Finding skin in color images, in: Proc. Second International Conference on Automatic Face and Gesture Recognition, 1996, pp. 312-317
40. K. Sobottka, I. Pitas, Face localization and feature extraction based on shape and color information, in: Proc. IEEE International Conference on Image Processing, 1996, pp. 483-486
41. L. Jordao, M. Perrone, J.P. Costeira, J. Santos-Victor, Active face and feature tracking, in: Proc. International Conference on Image Analysis and Processing, 1999, pp. 572-576
42. T. Yamada, T. Watanabe, Analysis and synthesis of facial color for the affect display of virtual facial image under fearful emotion, in: Proc. International Conference on Active Media Technology, 2005, pp. 219-224
43. Z.-M. Liu, Y. Li, X. He, W.-K. Wang, J.-L. Zhou, K. Li, Extraction of face regions in color image, in: Proc. International Conference on Machine Learning and Cybernetics, vol. 3, 2002, pp. 1340-1343
44. M. Ikeda, H. Ebine, O. Nakamura, Extraction of faces of more than one person from natural background for personal identification, in: Canadian Conference on Electrical and Computer Engineering, vol. 1, 2001, pp. 323-328
45. Q. Qiang, Z. Jiliu, H. Kun, Face detection in color images based on sub-image fusion and SVM, in: IEEE International Conference on Mechatronics and Automation, vol. 2, 2005, pp. 626-630
46. M.A.-A. Bhuiyan, On gesture recognition for human-robot symbiosis, in: The 15th IEEE International Symposium on Robot and Human Interactive Communication, 2006, pp. 541-545
47. Sigal L., Sclaroff S., and Athitsos V. Skin color-based video segmentation under time-varying illumination. IEEE Trans. Pattern Anal. Mach. Intell. 26 7 (2004) 862-877
48. H. Lee, S. Hong, K. Oh, E. Kim, M. Park, TSK fuzzy modeling approach for Face detection, in: International Joint Conference SICE-ICASE, 2006, pp. 3941-3944
49. Garcia C., and Tziritas G. Face detection using quantized skin color regions merging and wavelet packet analysis. IEEE Trans. Multimedia 1 3 (1999) 264-277
50. K. Shang, Y. Liu, Study on digital imaging colorimeter in dermatology, in: The Second Asian and Pacific Rim Symposium on Biophotonics, 2004, pp. 146-147
51. L. Sigal, S. Sclaroff, V. Athitsos, Estimation and prediction of evolving color distributions for skin segmentation under varying illumination, in: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, 2000, pp. 152-159
52. K. Sobottka, I. Pitas, Face localization and facial feature extraction based on shape and color information, in: International Conference on Image Processing, vol. 3, 1996, pp. 483-486
53. K. Yamaji, M. Hagiwara, Color-illustration generation system from facial image, in: IEEE International Conference on Systems, Man, and Cybernetics, vol. 2, 2001, pp. 1199-1204
54. T. Sawangsri, V. Patanavijit, S. Jitapunkul, Face segmentation based on Hue-Cr components and morphological technique, in: IEEE International Symposium on Circuits and Systems, vol. 6, 2005, pp. 5401-5404
55. D. Chai, N.K. Ngan, Locating facial region of a head-and-shoulders color image, in: Proc. Third International Conference on Automatic Face and Gesture Recognition, 1998, pp. 124-129
56. D. Chai, A. Bouzerdoum, A Bayesian approach to skin color classification in YCbCr color space, in: Proc. TENCON 2000, vol. 2, 2000, pp. 421-424
57. S.L. Phung, A. Bouzerdoum, D. Chai, A novel skin color model in YCbCr color space and its application to human face detection, in: Proc. 2002 International Conference on Image Processing, vol. 1, 2002, pp. I-289-I-292
58. L. Zhi-fang, Y. Zhi-sheng, A.K. Jain, W. Yun-qiong, Face detection and facial feature extraction in color image, in: Proc. Fifth International Conference on Computational Intelligence and Multimedia Applications, 2003, pp. 126-130
59. S. Kim, T. Jung, Y. Park, J. Kim, Adaptive skin detection system on DTV, in: Proc. of 2004 International Symposium on Intelligent Signal Processing and Communication Systems, 2004, pp. 586-591
60. J. Yang, Z. Fu, T. Tan, W. Hu, Adaptive skin detection using multiple cues, in: International Conference on Image Processing, vol. 2, 2004, pp. 901-904
61. S. Gundimada, L. Tao, V. Asari, Face detection technique based on intensity and skin color distribution, in: International Conference on Image Processing, vol. 2, 2004, pp. 1413-1416
62. K.-Y. Choi, K. Takaya, Facial feature extraction from a video sequence using independent component analysis (ICA), in: IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, vol. 1, 2001, pp. 259-262
63. Y. Hu, R.N.G. Naguib, A.G. Todman, S.A. Amin, H. Al-Omishy, A. Oikonomou, N. Tucker, Hand motion segmentation against skin colour background in breast awareness applications, in: 26th Annual International Conference of the Engineering in Medicine and Biology Society, vol. 2, 2004, pp. 3221-3224
64. Habili N., Lim C.-C., and Moini A. Automatic human skin segmentation based on color information in the YCbCr color space. Inform. Decision Control (2002) 377-382
65. J.J. de Dios, N. Garcia, Face detection based on a new color space YCgCr, in: International Conference on Image Processing, vol. 3, 2003, pp. III-909-912
66. J.J. de Dios, N. Garcia, Fast face segmentation in component color space, in: International Conference on Image Processing, vol. 1, 2004, pp. 191-194
67. Z. Bing, G. Yunhong, L. Bo, Z. Guangwei, T. Tian, A practical algorithm for exception event detection for the home video security surveillance, in: International Conferences on Info-tech and Info-net, vol. 3, 2001, pp. 202-208
68. R. Ji, B. Kong, F. Zheng, J. Gao, Color edge detection based on YUV space and minimal spanning tree, in: IEEE International Conference on Information Acquisition, vol. 1, 2006, pp. 941-945
69. O. Schreer, I. Feldmann, U. Golz, P. Kauff, Fast and robust shadow detection in videoconference applications, in: 4th IEEE International Symposium on VIPromCom (Video/Image Processing and Multimedia Communications), vol. 1, 2002, pp. 371-375
70. P.J. Thomas, R.J. Stonier, P.J. Wolfs, Robustness of colour detection for robot soccer, in: 7th International Conference on Control, Automation, Robotics and Vision, vol. 3, 2002, pp. 1245-1249
71. L.-Q. Xu, Simultaneous tracking and segmentation of two free moving hands in a video conferencing scenario, in: International Conference on Visual Information Engineering, vol. 1, 2003, pp. 49-52
72. E. Casiraghi, R. Lanzarotti, G. Lipori, A face detection system based on color and support vector machines, in: Italian Workshop on Neural Nets, vol. 1, 2003, pp. 113-120
73. O.J. Hernandez, M.S. Kleiman, Face recognition using multispectral random field texture models, color content, and biometric features, in: 34th Applied Imagery and Pattern Recognition Workshop, vol. 1, 2005, pp. 1-6
74. P. Campadelli, R. Lanzarotti, G. Lipori, Face and facial feature localization, in: 13th International Conference on Image Analysis and Processing, vol. 1, 2005, pp. 1002-1009
75. Y. Dai, Y. Nakano, Extraction for facial images from complex background using color information and SGLD matrices, in: First International Workshop Automatic Face and Gesture Recognition, 1995, pp. 238-242
76. Dai Y., and Nakano Y. Face-texture model based on SGLD and its application in face detection in a color scene. Pattern Recognition 29 6 (1996) 1007-1017
77. Y. Dai, Y. Shibata, K. Hashimoto, T. Ishii, A. Osuo, K. Katamachi, K. Nokuchi, N. Kakizaki, D. Cai, Facial expression recognition of person without language ability based on the optical flow histogram, in: ICSP2000, vol. 2, 2000, pp. 1209-1212
78. S. Karungaru, M. Fukumi, N. Akamatsu, Face recognition using genetic algorithm based template matching, in: IEEE International Symposium on Communications and Information Technology, vol. 2, 2004, pp. 1252-1257
79. M. Yamada, K. Ebihara, J. Ohya, A new robust real-time method for extracting human silhouettes from color images, in: 3rd IEEE International Conference on Face & Gesture Recognition, vol. 1, 1998, pp. 528-533
80. S. Karungaru, M. Fukumi, N. Akamatsu, Feature extraction for face detection and recognition, in: 13th IEEE International Workshop on Robot and Human Interactive Communication, vol. 1, 2004, pp. 235-239
81. Y. Adachi, A. Imai, M. Ozaki, N. Ishii, Extraction of face region by using characteristics of color space and detection of face direction through an eigenspace, in: Fourth International Conference on Knowledge-Based Intelligent Engineering Systems & Allied Technologies, vol. 1, 2000, pp. 393-396
82. M. Hasanuzzaman, V. Ampornaramveth, T. Zhang, M.A. Bhuiyan, Y. Shirai, H. Ueno, Real-time vision-based gesture recognition for human-robot interaction, in: IEEE International Conference on Robotics and Biomimetics, vol. 1, 2004, pp. 413-418
83. Y. Takahashi, S. Karungaru, M. Fukumi, N. Akamatsu, Feature point extraction in face image by neural network, in: SICE-ICASE International Joint Conference, vol. 1, 2006, pp. 3783-3786
84. Q. Chen, H. Wu, M. Yachida, Face detection by fuzzy matching, in: Fifth IEEE International Conference on Computer Vision, 1995, pp. 591-596
85. Haeghen Y.V., Naeyaert J.M.A.D., Lemahieu I., and Philips W. An imaging system with calibrated color image acquisition for use in dermatology. IEEE Trans. Med. Imaging 19 7 (2000) 722-730
86. C. Grana, G. Pellacani, S. Seidenari, R. Cucchiara, Color calibration for a dermatological video camera system, in: 17th International Conference on Pattern Recognition, vol. 3, 2004, pp. 798-801
87. R. Montufar-Chaveznaza, F.H. Gallardo, S.P. Hernandez, Face detection by polling, in: IEEE International Workshop on Intelligent Signal Processing, 2005, pp. 292-297
88. G. Gomez, On selecting colour components for skin detection, in: 16th International Conference on Pattern Recognition, vol. 2, 2002, pp. 961-964
89. A. Chikando, J. Kinser, Optimizing image segmentation using color model mixtures, in: 34th Applied Imagery and Pattern Recognition Workshop, 2005, pp. 1-6
90. A. Albiol, L. Torres, E.J. Delp, Optimum color spaces for skin detection, in: IEEE International Conference on Image Processing, vol. 1, 2001, pp. 122-124
91. Phung S.L., Bouzerdoum A., and Chai D. Skin segmentation using color pixel classification: Analysis and comparison. IEEE Trans. Pattern Anal. Mach. Intell. 27 1 (2005) 148-154
92. S. Jayaram, S. Schmugge, M.C. Shin, L.V. Tsap, Effect of colorspace transformation, the illuminance component, and color modeling on skin detection, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, 2004, pp. 813-818
93. A.M. Martinez, R. Benavente, The AR face database, CVC technical report #24, June 1998
94. Shapiro L.G., and Stockman G.C. Computer Vision (2001), Prentice-Hall. 0-13-030796-3
95. Forsyth D., and Ponce J. Computer Vision: A Modern Approach (2003), Prentice-Hall. 0130851981
96. Pratt W.K. Digital Image Processing: Pinks Inside. 3rd edition (2001), John Wiley & Sons. 0-471-37407-5
97. M. Tkalcic, J.F. Tasic, Colour spaces: Perceptual, historical and applicational background, in: IEEE Region 8 Eurocon Conference, Computer as a Tool, vol. 1, 2003, pp. 304-308