Intelligent facial emotion recognition using a layered encoding cascade optimization model

Applied Soft Computing Journal

Volumn 34, Issue , 2015, Pages 72-93

  Neoh, Siew Chin ^a   Zhang, Li ^a   Mistry, Kamlesh ^a   Hossain, Mohammed Alamgir ^b   Lim, Chee Peng ^c   Aslam, Nauman ^a   Kinghorn, Philip ^a  

^a NORTHUMBRIA UNIVERSITY   (United Kingdom)

^b ANGLIA RUSKIN UNIVERSITY   (United Kingdom)

^c DEAKIN UNIVERSITY   (Australia)

Author keywords

Cascade optimization; Ensemble classifier; Evolutionary algorithm; Facial expression recognition; Feature selection; Layered representation structure

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); CLASSIFIERS; DATABASE SYSTEMS; ENCODING (SYMBOLS); EVOLUTIONARY ALGORITHMS; FEATURE EXTRACTION; OPTIMIZATION; SPEECH RECOGNITION;

DATABASE EVALUATIONS; ENSEMBLE CLASSIFIERS; FACIAL EXPRESSION RECOGNITION; FEATURE OPTIMIZATIONS; LAYERED REPRESENTATION; LOCAL GABOR BINARY PATTERNS; OPTIMIZATION ALGORITHMS; OPTIMIZATION MODELING;

FACE RECOGNITION;

EID: 84929631105     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2015.05.006     Document Type: Article

References (80)

1. G.U. Kharat, and S.V. Dudul Human Emotion Recognition System Using Optimally Designed SVM With Different Facial Feature Extraction Techniques, PhD Thesis 2008 Anuradha Engineering College, Amravati University India
2. G. Littlewort, M.S. Bartlett, I. Fasel, J. Susskind, and J. Movellan Dynamics of facial expression extracted automatically from video Image Vision Comput. 24 2006 615 625
3. W. Gu, C. Xiang, Y.V. Venkatesh, D. Huang, and H. Lin Facial expression recognition using radial encoding of local Gabor features and classifier synthesis Pattern Recogn. 45 2012 80 91
4. L. Zhang, M. Jiang, D. Farid, and M.A. Hossain Intelligent facial emotion recognition and semantic-based topic detection for a humanoid robot Expert Syst. Appl. 40 13 2013 5160 5168
5. M. Kumbhar, A. Jadhav, and M. Patil Facial expression recognition based on image feature Int. J. Comput. Commun. Eng. 1 2012 117 119
6. S.M. Lajevardi, and Z.M. Hussain Automatic facial expression recognition: feature extraction and selection Signal Image Video Process. 6 2012 159 169
7. W. Chen, X. Lu, Y. Du, and W. Tian Boosting local Gabor binary patterns for gender recognition Proceedings of Ninth International Conference on Natural Computation China 2013 34 38
8. P. Lucey, J.F. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews The extended Cohn-Kanade dataset (CK+): a complete expression dataset for action unit and emotion-specified expression Proceedings of the Third International Workshop on CVPR for Human Communicative Behavior Analysis San Francisco, USA 2010 94 101
9. M. Pantic, M.F. Valstar, R. Rademaker, and L. Maat Web-based database for facial expression analysis Proceedings of IEEE Int'l Conf. Multimedia and Expo Amsterdam, The Netherlands 2005 317 321
10. C.A.C. Coello, and G.T. Pulido Multiobjective structural optimization using a micro-genetic algorithm Struct. Multidiscip. Optim. 30 5 2005 388 403
11. D. Huang, C. Shan, M. Ardabilian, Y. Wang, and L. Chen Local binary patterns and its application to facial image analysis: a survey IEEE Trans. Syst., Man, Cybern. - Part C: Appl. Rev. 41 6 2011 765 781
12. W. Zhang, S. Shan, W. Gao, X. Chen, and H. Zhang Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition Proceedings of the 10th IEEE International Conference on Computer Vision 2005 786 791
13. R.M. Ramadan, and R.F. Abdel-Kader Face recognition using particle swarm optimization-based selected features Int. J. Signal Process. Image Process. Pattern Recogn. 2 2 2009 51 66
14. C. Liu, and H.H. Wechsler Evolutionary pursuit and its application to face recognition IEEE Trans. Pattern Anal. Mach. Intell. 22 6 2000 570 582
15. A.P. Gosavi, and S.R. Khot Facial expression recognition using principal component analysis Int. J. Soft Comput. Eng. 3 4 2013 258 262
16. M. Kaur, R. Vashisht, and N. Neeru Recognition of facial expressions with principal component analysis and singular value decomposition Int. J. Soft Comput. Eng. 9 12 2010 36 40
17. D.L. Swets, and J. Weng Using discriminant eigenfeatures for image retrieval IEEE Trans. Pattern Anal. Mach. Intell. 18 8 1996 831 836
18. S.K. Shah A survey of facial expression recognition methods IOSR J. Eng. 4 4 2014 1 5
19. U.B. Chavan, and D.B. Kulkarni Facial expression recognition-review Int. J. Latest Trends Eng. Technol. 3 1 2013 237 243
20. S.S. Ravindran, S.-C. Neoh, and H. Muthusamy A hybrid expert system for automatic detection of voice disorders Int. J. Med. Eng. Inform. 6 3 2014 218 237
21. Z. Zeng, H. Zhang, R. Zhang, and Y. Zhang A hybrid feature selection method based on rough conditional mutual information and Naive Bayesian classifier ISRN Appl. Math. 2014 1 11
22. A.W. Mohemmed, M. Zhang, and M. Johnston Particle swarm optimization based Adaboost for face detection IEEE Congress on Evolutionary Computation 2009 2494 2501
23. N.L. Ajit Krisshna, V. Kadetotad Deepak, K. Manikantan, and S. Ramachandran Face recognition using transform domain feature extraction and PSO-based feature selection Appl. Soft Comput. 22 2014 141 161
24. B. Xue, M. Zhang, and W.N. Browne Particle swarm optimization for feature selection in classification: a multi-objective approach IEEE Trans. Cybern. 43 6 2013 1656 1671
25. A. Rosales-Pérez, J.A. Gonzalez, C.A.C. Coello, C.A. Reyes-Garcia, and H.J. Escalante Evolutionary multi-objective approach for prototype generation and feature selection Prog. Pattern Recognit. Image Anal. Comput. Vis. Appl. Lect. Notes Comput. Sci. 8827 2014 424 431
26. J. Pacheco, S. Casado, F. Angel-Bello, and A. Alvarez Bi-objective feature selection for discriminant analysis in two-class classification Knowl. Based Syst. 44 2013 64 67
27. Z. Wang, M. Li, and J. Li A multi-objective evolutionary algorithm for feature selection based on mutual information with a new redundancy measure Inf. Sci. 307 2015 73 88
28. H.H. Maheta, and V.K. Dabhi An improved SPEA2 multi objective algorithm with non dominated elitism and generational crossover Proceedings of the 2014 International Conference on Issues and Challenges in Intelligent Computing Techniques Ghaziabad, India 2014 75 82
29. G. Mahalingam, and C. Kambhamettu Face verification with aging using AdaBoost and local binary patterns Proceedings of the Seventh Indian Conference on Computer Vision, Graphics and Image Processing Chennai, India 2010 101 108
30. B. Yao, H. Ai, Y. Ijiri, and S. Lao Domain-partitioning Rankboost for face recognition IEEE International Conference on Image Processing San Antonio, Texas 2007 129 132
31. K. Yan, Y. Chen, and D. Zhang Gabor surface feature for face recognition The First Asian Conference on Pattern Recognition China 2011 288 292
32. S. Chowdhury, J.K. Sing, D.K. Basu, and M. Nasipuri Face recognition by generalized two-dimensional FLD method and multi-class support vector machines Appl. Soft Comput. 11 2011 4282 4292
33. G.-C. Luh, and C.-Y. Lin PCA based immune networks for human face recognition Appl. Soft Comput. 11 2011 1743 1752
34. E. Owusu, Y. Zhan, and Q.R. Mao A neural-AdaBoost based facial expression recognition system Expert Syst. Appl. 41 2014 3383 3390
35. C. Shan, S. Gong, and P.W. McOwan Facial expression recognition based on local binary patterns: a comprehensive study Image Vis. Comput. 27 2009 803 816
36. W. Bouaguel, and G.B. Mufti An improvement direction for filter selection techniques using information theory measures and quadratic optimization Int. J. Adv. Res. Artif. Intell. 1 5 2012 7 11
37. R. Xiao, Q. Zhao, D. Zhang, and P. Shi Facial expression recognition on multiple manifolds Pattern Recogn. 44 2011 107 116
38. J. Yu, and B. Bhanu Evolutionary feature synthesis for facial expression recognition Pattern Recogn. Lett. 27 2006 1289 1298
39. M. Schiezaro, and H. Pedrini Data feature selection based on artificial bee colony algorithm EURASIP J. Image Video Process. 47 2013 1 8
40. C.J. Tan, C.P. Lim, and Y.-N. Cheah A multi-objective evolutionary algorithm-based ensemble optimizer for feature selection and classification with neural network models Neurocomputing 125 2014 217 228
41. Y. Chen, D. Miao, and R. Wang A rough set approach to feature selection based on ant colony optimization Pattern Recogn. Lett. 31 2010 226 233
42. B. de la Iglesia Evolutionary computation for feature selection in classification Problems WIREs Data Min. Knowl. Discov. 3 2013 381 407
43. W. Zhang, S. Shan, X. Chen, and W. Gao Local Gabor binary patterns based on mutual information for face recognition Int. J. Image Graph. 7 3 2007 1 17
44. C. Tomasi, and R. Manduchi Bilateral filtering for gray and color images Proceedings of Sixth International Conference on Computer Vision 1998 839 846
45. S. Paris, P. Kornprobst, J. Tumblin, and F. Durand Bilateral filtering: theory and applications Found. Trends Comput. Graph. Vis. 4 1 2008 1 73
46. T. Ojala, M. Pietikainen, and D. Harwood A comparative study of texture measures with classification based on featured distribution Pattern Recogn. 29 1 1996 51 59
47. A.C. Kokossis, P. Linke, and S. Yang The cascade optimization algorithm: a new distributed approach for the stochastic optimization of engineering applications Ind. Eng. Chem. Res. 50 2011 5266 5278
48. F. Cecelja, A. Kokossis, D. Du, and S. Yang Asynchronous optimisation with the use of a cascade search algorithm Comput. Chem. Eng. 66 2014 276 289
49. S.N. Patnaik, R.M. Coroneos, J.D. Guptill, and D.A. Hopkins Comparative evaluation of different optimization algorithms for structural design applications Int. J. Numer. Methods Eng. 39 10 1996 1761 1774
50. S.C. Neoh, N. Morad, C.P. Lim, and Z. Abdul Aziz A layered encoding cascade optimization approach to product-mix planning in high-mix-low-volume manufacturing IEEE Trans. Syst. Man Cybern. - Part A 39 6 2010 133 146
51. S.C. Neoh, N. Morad, C.P. Lim, and Z. Abdul Aziz A GA-PSO layer encoded hybrid approach to 0/1 knapsack optimization Int. J. Innov. Comput. Inf. Control 6 8 2010 3489 3506
52. J.D. Knowles, and D.W. Corne Approximating the nondominated front using the Pareto archived evolution strategy Evol. Comput. 8 2 2000 149 172
53. C.J. Tan, C.P. Lim, and Y.-N. Cheah A modified micro genetic algorithm for undertaking multi-objective optimization problems J. Intell. Fuzzy Syst. 24 2013 483 495
54. E. Zitzler, and L. Thiele Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach IEEE Trans. Evol. Comput. 3 4 1999 257 271
55. E. Zitzler, M. Laumanns, and L. Thiele SPEA2: Improving the Strength Pareto Evolutionary Algorithm, Technical Report 103 2001 Computer Engineering and Networks Laboratory, Swiss Federal Institute of Technology (ETH) Zurich
56. F.G. Lobo, C.F. Lima, and Z. Michalewicz Parameter Setting in Evolutionary Algorithms (Studies in Computational Intelligence) 2007 Springer
57. P. Ekman, W.V. Friesen, and J.C. Hager Facial Action Coding System, the Manual 2002 Research Nexus division of Network Information Research Corporation USA
58. L. Rokach Ensemble-based classifiers Artif. Intell. Rev. 33 2010 1 39
59. R. Polikar Ensemble based systems in decision making IEEE Circuits Syst. Mag. 6 2006 21 45
60. A.D. Lattner, A. Grimme, and I.J. Timm An evaluation of meta learning and distribution strategies in distributed machine learning Proceedings of the European Conference on Data Mining 2010
61. S.B. Kotsiantis, I.D. Zaharakis, and P.E. Pintelas Machine learning: a review of classification and combining techniques Artif. Intell. Rev. 26 3 2006 159 190
62. E. Menahem, L. Rokach, and Y. Elovici Combining one-class classifiers via meta learning Proceedings of the 22nd ACM international conference on Conference on information & knowledge management 2013 2435 2440
63. D. Farid, L. Zhang, A.M. Hossain, C.M. Rahman, R. Strachan, G. Sexton, and K. Dahal An adaptive ensemble classifier for mining concept-drifting data streams Expert Syst. Appl. 40 15 2013 5895 5906
64. M.M. Masud, J. Gao, L. Khan, J. Han, and B. Thuraisingham Classification and novel class detection in concept-drifting data streams under time constraints IEEE Trans. Knowl. Data Eng. 23 2011 859 874
65. M.A. Bagheri, Gh. Montazer, and E. Kabir A subspace approach to error-correcting output coding Pattern Recogn. Lett. 34 2013 176 184
66. A.K. Seewald How to make stacking better and faster while also taking care of an unknown weakness Proceedings of International Conference of Machine Learning San Fransisco, CA 2002 Morgan Kaufmann Publishers Inc. 554 561
67. A.K. Seewald, and J. Fürnkranz An evaluation of grading classifiers F.H. Hoffman, Advances in Intelligent Data Analysis 2189 2001 Springer, LNCS Berlin 115 124
68. H. AltInçay A Dempster-shafer theoretic framework for boosting based ensemble design Pattern Anal. Appl. 8 3 2005 287 302
69. S. Ulukaya, and C.E. Erdem Gaussian mixture model based estimation of the neutral face shape for emotion recognition Digit. Signal Process. 32 2014 11 23
70. A. Majumder, L. Behera, and V.K. Subramanian Emotion recognition from geometric facial features using self-organizing map Pattern Recogn. 47 2014 1282 1293
71. L. Zhong, Q. Liu, P. Yang, B. Liu, J. Huang, and D.N. Metaxas Learning active facial patches for expression analysis Proceedings of CVPR 2012 2562 2569
72. P.S. Aleksic, and A.K. Katsaggelos Automatic facial expression recognition using facial animation parameters and multi-stream HMMS IEEE Trans. Inf. Forensics Secur. 1 2006 3 11
73. G.Y. Zhao, and M. Pietikainen Dynamic texture recognition using local binary patterns with an application to facial expressions IEEE Trans. Pattern Anal. Mach. Intell. 29 6 2007 915 928
74. Z.S. Li, J. Imai, and M. Kaneko Facial expression recognition using facial-component-based bag of words and PHOG descriptors Inf. Media Technol. 5 3 2010 1003 1009
75. L. Zhang, and D.W. Tjondronegoro Facial expression recognition using facial movement features IEEE Trans. Affect. Comput. 2 4 2011 219 229
76. J. Wang, L. Yin, X. Wei, and Y. Sun 3D facial expression recognition based on primitive surface feature distribution IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2006 1399 1406
77. C. Theekapun, S. Tokai, and H. Hase Facial expression recognition from a side view face by using face plane Proceedings of the 2007 International Conference on Wavelet Analysis and Pattern Recognition Beijing, China 2007 1096 1101
78. Y. Huang, Y. Li, and N. Fan Robust symbolic dual-view facial expression recognition with skin wrinkles: local versus global approach IEEE Trans. Multimed. 12 6 2010 536 543
79. U. Tariq, J. Yang, and T.S. Huang Multi-view facial expression recognition analysis with generic sparse coding feature Lect. Notes Comput. Sci. 7585 2012 578 588
80. S. Moore, and R. Bowden Local binary patterns for multi-view facial expression recognition Comput. Vis. Image Underst. 115 2011 541 558