Automated facial expression recognition – an integrated approach with optical flow analysis and Support Vector Machines

International Journal of Intelligent Systems Technologies and Applications

Volumn 7, Issue 3, 2009, Pages 316-346

  Surendran, Nanda ^a   Xie, Shane ^b  

^a The University of Auckland ^*  (United States)

^b UNIVERSITY OF AUCKLAND   (New Zealand)

Author keywords

cross validation; feature extraction; Lagrange multiplier method; Laplacian of Gaussian; LoG; Lucas Kanade algorithm; support vector machines; SVM

Indexed keywords

EID: 80053039514     PISSN: 17408865     EISSN: 17408873     Source Type: Journal    
DOI: 10.1504/IJISTA.2009.027112     Document Type: Article

References (43)

1. Barron, J.L., Fleet, D.J and Beauchemin, S.S. (1994) ‘Performance of optical flow techniques’, Int. J. Computer Vision, Vol. 12, p.43–77.
2. Bartlett, M.S., Littlewort, G., Fasel, I. and Movellan, J.R. (2003) ‘Real time face detection and facial expression recognition: development and applications to human computer interaction’, CVPR Workshop on Computer Vision and Pattern Recognition for Human-Computer Interaction.
3. Bartlett, M.S., Littlewort, G., Frank, M.G., Lainscsek, C., Fasel, I., and Movellan, J. (2005) ‘Recognizing facial expression: machine learning and application to spontaneous behavior’, Computer Vision and Pattern Recognition, CVPR 2005. IEEE Computer Society Conference, Vol. 2.
4. Bourel, F., Chibelushi, C.C. and Low, A.A. (2002) ‘Robust facial expression recognition using a state-based model ofspatially-localised facial dynamics’, Automatic Face and Gesture Recognition, Paper presented in the Proceedings Of the Fifth IEEE International Conference, pp.106–111.
5. Burges, C.J.C. (1998) ‘A tutorial on support vector machines for pattern recognition’, Data Mining and Knowledge Discovery, Vol. 2, p.121–167.
6. Chan, Y.H. and Abu-Bakar, S.A.R. (2004) ‘Face detection system based on feature-based chrominance colour information’, Computer Graphics, Imaging and Visualization, Paper presented in the Proceedings of the International Conference, pp. 153–158.
7. Chang, C.C. and Lin, C.J. (2001) LIBSVM: a Library for Support Vector Machines, Vol. 80, pp.604–611, Available at: http://www.csie.ntu.edu.tw/cjlin/libsvm.
8. Daugman, J.G. (1988) ‘Complete discrete 2-D Gabor transforms by neural networks for imageanalysis and compression’, Acoustics, Speech, and Signal Processing [see also IEEE Transactions on Signal Processing], IEEE Transactions on, Vol. 36, pp.1169–1179.
9. Dodgson, N.A. (2004) ‘Variation and extrema of human interpupillary distance’, Paper presented in the Proceedings of the SPIE, Vol. 5291, pp. 36–46.
10. Donato, G.L., Bartlett, M.S., Hager, J.C., Ekman, P., and Sejnowski, T.J. (1999) ‘Classifying facial actions’, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 21, pp.974–989.
11. Duin, A. (2000) ‘Statistical Pattern Recognition: A Review’, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), Vol. 22, pp.4–37.
12. Ekman, P. and Friesen, W.V. (1978) The Facial Action Coding System: A Technique for The Measurement of Facial Movement. San Francisco, CA: Consulting Psychologists Press.
13. Essa, I. A. and Pentland, A.P. (1997) ‘Coding, analysis, interpretation, and recognition of facial expressions’, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, pp.757–763.
14. Essa, I.A. and Pentland, A.P. (1995) ‘Facial expression recognition using a dynamic model and motionenergy’, Computer Vision, Paper presented in the Proceedings of the Fifth International Conference, pp.360–367.
15. Galvin, B. McCane, B., Novins, K., Mason, D. and Mills, S. (1998) ‘Recovering motion fields: an evaluation of eight optical flow algorithms’, Paper presented in the Proceedings of the Ninth British Machine Vision Conference.
16. Garcia, C. and Tziritas, G. (1999) ‘Face detection using quantized skin color regions merging andwavelet packet analysis’, Multimedia, IEEE Transactions, Vol. 1, pp.264–277.
17. Haralick, R.M. and Shapiro, L.G. (1992) Computer and Robot Vision. Boston, MA: Addison- Wesley Longman Publishing Co., Inc.
18. Hearst, M.A. (1998) ‘Trends and Controversies: Support Vector Machines’, IEEE Intelligent Systems, Vol. 13, pp.18–28.
19. Heisele, B., Ho, P. and Poggio, T. (1998) ‘Face recognition with support vector machines: Global versus component-based approach’, Paper presented in the Proceedings of the 8th International Conference on Computer Vision. pp.688–694.
20. Hiremath, P.S. and Danti, A. (2006) ‘Detection Of Multiple Faces In An Image Using Skin Color Information And Lines-Of-Separability Face Model’, Int. J. Pattern Recognition And Artificial Intelligence, Vol. 20, p.39.
21. Hsu, C.W., Chang, C.C. and Lin, C.J. (2003) A Practical Guide to Support Vector Classification, National Taiwan University, Technical Report, July.
22. Hsu, R.L., Abdel-Mottaleb, M. and Jain, A.K. (2002) ‘Face detection in color images’, Pattern Analysis and Machine Intelligence, IEEE Transactions, Vol. 24, pp.696–706.
23. Jones, J.P. and Palmer, L.A. (1987) ‘An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex’, Journal of Neurophysiology, Vol. 58, pp.1233–1258.
24. Kecman, V., Huang, T.M. and Vogt, M. (2004) ‘Iterative single data algorithm for training kernel machines from huge data sets: theory and performance’, Support Vector Machines: Theory and Applications: Springer-Verlag.
25. Kloomark, M. (2005) ‘Occupant detection using computer vision’, Thesis in Computer Vision, Linköping University.
26. Lien, J.J., Kanade, T. and Cohn, J.F. (1998) ‘Automated facial expression recognition based on FACS action units’, Automatic Face and Gesture Recognition, Paper presented in the Proceedings of the Third IEEE International Conference, pp.390–395.
27. Liu, H., Hong, T.H., Herman, M., Camus, T. and Chellappa, R. (1998) ‘Accuracy vs efficiency trade-offs in optical flow algorithms’, Computer Vision Image Understanding, Vol. 72, pp.271–286.
28. Marius, D., Pennathur, S. and Rose, K. (2003) ‘Face detection using color thresholding, and eigenimage template matching’, Digital Image Processing project. Stanford University.
29. Mehrabian, A. and Ferris, S.R. (1967) ‘Inference of attitudes from nonverbal communication in two channels’, Journal of Consulting Psychology, Vol. 31, pp.248–252.
30. Michel, P. and El Kaliouby, R. (2003) ‘Real time facial expression recognition in video using support vector machines’, Paper presented in the Proceedings of the 5th international conference on Multimodal interfaces, pp.258–264.
31. Pantic, M. and Rothkrantz, L.J.M. (1999) ‘An expert system for multiple emotional classification of facialexpressions’, Tools with Artificial Intelligence, Paper presented in the Proceedings of the 11th IEEE International Conference, pp.113–120.
32. Pantie, M. and Rothkrantz, L.J.M. (2000) ‘Automatic analysis of facial expressions: the state of the art’, Pattern Analysis and Machine Intelligence, Paper presented in the Proceedings of the IEEE Transactions, Vol. 22, pp.1424–1445.
33. Platt, J. (1998) Sequential minimal optimization: A fast algorithm for training support vector machines. Cambridge, MA: MIT Press.
34. Pollen, D.A. and Ronner, S.F. (1981) ‘Phase relationships between adjacent simple cells in the visual cortex’, Science, Vol. 212, p.1409.
35. Qi, Y., Doermann, D. and DeMenthon, D. (2001) ‘Hybrid independent component analysis and support vector machinelearning scheme for face detection’, Acoustics, Speech, and Signal Processing, Paper presented in the Proceedings of the (ICASSP'01), IEEE International Conference, Vol. 3.
36. Qin, J. and He, Z.S. ‘A SVM Face recognition method based on Gabor-featured key points’, Machine Learning and Cybernetics, Paper presented in the Proceedings of the 2005 International Conference, Vol. 8.
37. Schule, M.M. (2002) Facial Expression Recognition with Support Vector Machines, University of Appplied Sciences Konstanz, Germany.
38. Shan, C., Gong, S. and McOwan, P.W. (2005) ‘Robust facial expression recognition using local binary patterns’, IEEE International Conference on Image Processing, Vol. 2, pp.370–373.
39. Singh, S.K., Chauhan, D.S., Vatsa, M. and Singh, R. (2003) ‘A robust skin color based face detection algorithm’, Tamkang Journal of Science And Engineering, Vol. 6, pp.227–234.
40. Singular Inversions (1998), FaceGen Modeler 3.1.
41. Tian, Y.I., Kanade, T. and Cohn, J.F. ‘Recognizing action units for facial expression analysis’, Pattern Analysis and Machine Intelligence, IEEE Transactions, Vol. 23, pp.97–115.
42. Vapnik, V.N. (2000) The Nature of Statistical Learning Theory. New York, NY: Springer.
43. Yang, M.H., Kriegman, D.J. and Ahuja, N. (2002) ‘Detecting faces in images: a survey’, Pattern Analysis and Machine Intelligence, IEEE Transactions, Vol. 24, pp.34–58.