A novel fuzzy facial expression recognition system based on facial feature extraction from color face images

Engineering Applications of Artificial Intelligence

Volumn 25, Issue 1, 2012, Pages 130-146

  Ilbeygi, Mahdi ^a   Shah Hosseini, Hamed ^b  

^a ISLAMIC AZAD UNIVERSITY   (Iran)

^b SHAHID BEHESHTI UNIVERSITY   (Iran)

Author keywords

Emotion Recognition; Facial Feature Extraction; Fuzzy Inference Systems; Genetic Algorithms; Partially Occluded Facial Images

Indexed keywords

BASIC EMOTIONS; EMOTION RECOGNITION; FACE IMAGES; FACIAL EXPRESSION RECOGNITION; FACIAL EXPRESSIONS; FACIAL FEATURE EXTRACTION; FACIAL IMAGES; FUZZY INFERENCE SYSTEMS; HUMAN-COMPUTER; NOVEL METHODS; PARAMETER-TUNING; PRECISION RATES;

FEATURE EXTRACTION; FUZZY INFERENCE; FUZZY SYSTEMS; GENETIC ALGORITHMS; GESTURE RECOGNITION; MEMBERSHIP FUNCTIONS;

FACE RECOGNITION;

EID: 80855147489     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2011.07.004     Document Type: Article

References (45)

1. S. Bashyal, and G.K. Venayagamoorthy Recognition of facial expressions using Gabor wavelets and learning vector quantization Engineering Applications of Artificial Intelligence 21 7 2008 1056 1064
2. Bezdek, J.C.; 1973. Fuzzy Mathematics in Pattern Classification. Ph.D. Dissertation. Appl. Math. Center, Cornell Univ.; Ithaca, NY.
3. John Canny A computational approach to edge detection IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-8 6 1986 679 698
4. D. Chai, and K.N. Ngan Face segmentation using skin-color map in videophone applications IEEE Transactions on Circuits and Systems for Video Technology 9 4 1999 551 564
5. A. Chakraborty, A. Konar, U.K. Chakraborty, and A. Chatterjee Emotion recognition from facial expressions and its control using fuzzy logic IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 39 4 2009 726 743
6. Cohen, I.; 2000. Automatic Facial Expression Recognition from Video Sequences Using Temporal Information. Master's Thesis. Department of Electrical Engineering, University of Illinois at Urbana-Champaign.
7. R. Contreras, O. Starostenko, V. Alarcon-Aquino, and L. Flores-Pulido Facial Feature Model for Emotion Recognition Using Fuzzy Reasoning, Advances in Pattern Recognition A. Jesus, Jse F. Carrasco-Ochoa, Josef Kittler Martinez-Trinidad, Lecture Notes in Computer Science, Advances in pattern Recognition 2010 Springer-Verlag Berlin, Germany 11 21 ISSN 0302-9743, # 6256
8. Cowie, R.; Douglas-Cowie, E.; Taylor, J.G.; Ioannou, S.; Wallace, M.; Kollias, S.; 2005. An intelligent system for facial emotion recognition. In: Proceedings of the IEEE International Conference on Multimedia and Expo, ICME.
9. N.C. Ebner, M. Riediger, and U. Lindenberger FACES - a database of facial expressions in young, middle-aged, and older women and men: development and validation Behavior Research Methods 42 1 2010 Psychonomic Society Publications
10. P. Ekman Facial expression and emotion American Psychologist 48 1993 384 392
11. P. Ekman, and W.V. Friesen Facial Action Coding System (FACS): Manual 1978 Consulting Psychologists Press Palo Alto
12. Esau, N.; Kleinjohann, L.; Kleinjohann, B.; 2005. An adaptable fuzzy emotion model for emotion recognition. In: Proceedings of the EUSFLAT Conference, Citeseer, pp. 7378.
13. Esau, N.; Wetzel, E.; Kleinjohann, L.; Keinjohann, B.; 2007. Real-time facial expression recognition using a fuzzy emotion model. In: Proceedings of the IEEE International Fuzzy Systems Conference FUZZ-IEEE 2007, pp. 16.
14. C. Garcia, and G. Tziritas Face detection using quantized skin color regions merging andwavelet packet analysis IEEE Transactions on Multimedia 1 3 1999 264 277
15. F. Gasparini, and R. Schettini Skin segmentation using multiple thresholding Proceedings of SPIE 6061 2006 128 135
16. V. Gomathi, K. Ramar, and A.S. Jeevakumar Human facial expression recognition using MANFIS model World Academy of Science, Engineering and Technology 50 2009
17. G. Gomez, and E. Morales Automatic feature construction and a simple rule induction algorithm for skin detection Proceedings of the ICML Workshop on Machine Learning in Computer Vision 2002 31 38
18. Guo, Y.; Gao, H.; 2007. Emotion recognition system in images based on fuzzy neural network and HMM. In: Proceedings of the Fifth IEEE International Conference on Cognitive Informatics, ICCI 2006, pp. 7378.
19. Ilbeygi, M.; Shah-Hosseini, H, 2010. Eye Opening Calculation Using Edge and Skin Color Detectors. In: Proceedings of the International Conference on Intelligence and Information Technology (ICIIT), vol. 1, pp. 146150.
20. S. Ioannou, G. Caridakis, K. Karpouzis, and S. Kollias Robust feature detection for facial expression recognition Journal on Image and Video Processing 2007 2 2007 Hindawi Publishing Corp
21. S.V. Ioannou, A.T. Raouzaiou, V.A. Tzouvaras, T.P. Mailis, K.C. Karpouzis, and S.D. Kollias Emotion recognition through facial expression analysis based on a neurofuzzy network Neural Networks 18 4 2005 423 435 Elsevier (Pubitemid 40922649)
22. Jamshidnejad, A.; Jamshidined, A.; 2009. Facial emotion recognition for human computer interaction using a fuzzy model in the e-business. Innovative Technologies in Intelligent Systems and Industrial Applications, CITISIA, pp. 202204.
23. M.I. Khan, and A.A. Bhuiyan Facial expression recognition for humanrobot interface IJCSNS 2009
24. A. Khanum, M. Mufti, M.Y. Javed, and M.Z. Shafiq Fuzzy case-based reasoning for facial expression recognition Fuzzy Sets and Systems 160 2 2009 231 250 Elsevier
25. G.U Kharat, and S.V. Dudul Human emotion recognition system using optimally designed SVM with different facial feature extraction techniques WSEAS Transactions on Computers 7 6 2008 650 659
26. Ko, K.E.; Sim, K.B.; 2009. Development of advanced active appearance model for facial emotion recognition. In: IEEE International Symposium on Industrial Electronics, ISIE 2009, pp. 10191022.
27. O. Langner, R.G. Dotsch, G. Bijlstra, D.H.J. Wigboldus, S.T. Hawk, and A. van Knippenberg Presentation and validation of the Radboud Faces Database Cognition and Emotion 24 8 2010 1377 1388
28. I. Maglogiannis, D. Vouyioukas, and C. Aggelopoulos Face detection and recognition of natural human emotion using Markov random fields In Personal and Ubiquitous Computing 13 1 2009 95 101 Springer, London
29. Tom Mitchell Machine Learning 1997 McGraw Hill
30. K. Muthukaruppan, M. Rizon, M. Juhari, N. Ramachandran, S. Masanori, Y. Sazali, M. Rozailan, and D. Hazry Development of a personified face emotion recognition technique using fitness function 2007 Springer Japan
31. M. Pantic, and L. Rothkrantz Expert system for automatic analysis of facial expressions Image and Vision Computing 18 11 2000 881 905
32. M. Pantic, and L.J.M Rothkrantz Facial action recognition for facial expression analysis from static face images IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 34 3 2004 1449 1461
33. Pantic, M.; Valstar, M.F.; Rademaker R.; Maat, L.; 2005. Web-based database for facial expression analysis. In: Proceedings of the IEEE International Conference on Multimedia and Expo (ICME05), Amsterdam, The Netherlands.
34. Peer, P.; Kovac, J.; Solina, F.; 2003. Human skin colour clustering for face detection. In: Proceedings of the EUROCON1993, Ljubljana, Slovenia, pp. 144148.
35. Rahman, Nusirwan A.; Wei, Kit C.; See, J.; 2006. RGB-H-CbCr Skin colour model for human face detection. In: Proceedings of the MMU International Symposium on Information & Communications Technologies, M2USIC.
36. Rizon, M.; Hazry, D.; Karthigayan, M.; Nagarajan, R.; Alajlan, N.; Sazali, Y.; Nor Azmi, J.; Ina Suryani, R.; 2009. Personalized human emotion classification using genetic algorithm. In: Proceedings of the Second International Conference in Visualisation.
37. Sayeed, A.; Sohail, M.; Bhattacharya, P.; 2007. Detection of facial feature points using anthropometric face model. Signal Processing for Image Enhancement and Multimedia Processing, pp. 189200.
38. Shah-Hosseini, H.; 2007. Problem solving by intelligent water drops. In: Proceedings of the IEEE Congress on Evolutionary Computation, Swissotel The Stamford, Singapore, pp. 32263231.
39. H. Shah-Hosseini Intelligent water drops algorithm: a new optimization method for solving the multiple knapsack problem International Journal of Intelligent Computing and Cybernetics 2008 193 212
40. H. Shah-Hosseini The intelligent water drops algorithm: A nature-inspired swarm-based optimization algorithm International Journal of Bio-Inspired Computation 2009 71 79
41. Shah-Hosseini, H. Principal components analysis by the galaxy-based search algorithm: a novel metaheuristic for continuous optimisation. International Journal of Computational Science and Engineering, submitted for publication.
42. Tsekeridou, S.; Pitas, I.; 1998. Facial feature extraction in frontal views using biometric analogies. In: Proceedings of the EUSIPCO, vol. 98, pp. 315318.
43. Y. Wang, and B. Yuan A novel approach for human face detection from color images under complex background Pattern Recognition 34 10 2001 1983 1992 Oxford, New York, Pergamon Press (Pubitemid 32760628)
44. Z. Zeng, Y. Fu, G.I. Roisman, Z. Wen, Y. Hu, and T.S. Huang Spontaneous Emotional Facial Expression Detection Journal of Multimedia 1 5 2006 1 8
45. Zhou, X.; Huang, X.; Wang, Y.; 2004. Real-time facial expression recognition in the interactive game based on embedded hidden Markov model. In: Proceedings of the International Conference on Computer Graphics, Imaging and Visualization (CGIV04).