Classifying facial expressions using level set method based lip contour detection and multi-class support vector machines

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 25, Issue 6, 2011, Pages 835-862

  Sohail, Abu Sayeed Md ^a   Bhattacharya, Prabir ^a  

^a Concordia University ^*  (Canada)

Author keywords

facial expression; Facial feature points; support vector machines; variational level set method

Indexed keywords

ACTION UNIT; ANALYTIC REPRESENTATION; AVERAGE REPRESENTATION; COMPUTER VISION SYSTEM; FACIAL EXPRESSIONS; FACIAL FEATURE POINT DETECTION; FACIAL FEATURE POINTS; FEATURE VECTORS; IMAGE DATABASE; LEVEL SET METHOD; LIP CONTOUR; MULTI-CLASS SUPPORT VECTOR MACHINES; MULTI-DETECTORS; MULTICLASS SVM; MUSCLE MOVEMENT; RECOGNITION RATES; SUPPORT VECTOR; VARIATIONAL FORMULATION; VARIATIONAL LEVEL SET; VISUAL OBSERVATIONS;

COMPUTER VISION; DROP BREAKUP; EYE MOVEMENTS; FACE RECOGNITION; IMAGE SEGMENTATION; LEVEL MEASUREMENT; NUMERICAL METHODS; VECTORS;

SUPPORT VECTOR MACHINES;

EID: 80053192744     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218001411008762     Document Type: Article

References (53)

1. E. Alpaydin, Introduction to Machine Learning (MIT Press, Cambridge, 2004
2. A. R. Apu and M. L. Gavrilova, Shape matching through contour extraction using circular augmented rotational trajectory (CART) algorithm, Int. J. Busin. Intell. Data Min. 4(2) (2010) 192-210.
3. M. S. Bartlett, G. Littlewort, M. Frank, C. Lainscsek, I. Fasel and J. Movellan, Recognizing facial expression: Machine learning and application to spontaneous behavior, Proc. Computer Vision and Pattern Recognition (20-25 June 2005), Vol. 2, pp. 568-573.
4. M. J. Black and Y. Yacoob, Recognizing facial expressions in image sequences using local parameterized models of image motion, Int. J. Comput. Vis. 25(1) (1997) 23-48. (Pubitemid 127506559)
5. S. Cheng, M. Chen, H. Chang and T. Chao, Semantic-based facial expression recognition using analytical hierarchy process, Expert Syst. Appl. 33 (2007) 86-95. (Pubitemid 44959920)
6. I. Cohen, N. Sebe, A. Garg, L. S. Chen and T. S. Huang, Facial expression recognition from video sequences: Temporal and static modeling, Comput. Vis. Imag. Underst. 91 (2003) 160-187.
7. J. F. Cohn, A. J. Zlochower, J. J. Lien and T. Kanade, Feature-point tracking by optical flow discriminates subtle differences in facial expression, Proc. Third IEEE Int. Conf. Automatic Face and Gesture Recognition (Nara, Japan, 1998), pp. 196-401.
8. C. Cortes and V. Vapnik, Support-vector networks, Mach. Learn. 20(3) (1995) 273-297.
9. C. R. De Silva, S. Ranganath and L. C. De Silva, Cloud basis function neural network: A modified RBF network architecture for holistic facial expression recognition, Patt. Recogn. 41(4) (2008) 1241-1253. (Pubitemid 350218150)
10. G. J. Edwards, T. F. Cootes and C. J. Taylor, Face recognition using active appearance models, Proc. European Conf. Computer Vision (Freiburg, Germany, 1998), Vol. 2, pp. 581-695.
11. N. Efford, Digital Image Processing: A Practical Introduction Using Java (Addison- Wesley, 2000
12. P. Ekman and W. V. Friesen, Unmasking the Face (Prentice Hall, New Jersey, 1975
13. I. A. Essa and A. Pentland, Coding, analysis, interpretation and recognition of facial expressions, IEEE Trans. Patt. Anal. Mach. Intell. 19(7) (1997) 757-763. (Pubitemid 127762267)
14. L. Evans, Partial Differential Equations (American Math. Soc., Providence, 1998
15. I. Fasel, B. Fortenberry and J. R. Movellan, A generative framework for real time object detection and classification, Comput. Vis. Imag. Underst. 98 (2005) 182-210.
16. X. Feng, M. Pietikainen and A. Hadid, Facial expression recognition with local binary patterns and linear programming, IEEE Trans. Patt. Recogn. Image Anal. 15(2) (2005) 546-548. (Pubitemid 41064824)
17. G. Guo and C. R. Dyer, Learning from examples in the small sample case: Face expression recognition, IEEE Trans. Systems, Man and Cybern Part-B, 35(3) (2005) 477-488. (Pubitemid 40794859)
18. F. Hara and H. Kobayashi, Facial interaction between 3D face robot and human beings, Proc. IEEE Int. Conf. Systems, Man and Cybernetics (Florida, 1997), pp. 3732-3737.
19. T. Kanade, J. F. Cohn and Y. Tian, Comprehensive database for facial expression analysis, Proc. 4th IEEE Int. Conf. Automatic Face and Gesture Recognition (France, 2000), pp. 46-53.
20. H. Kobayashi and F. Hara, Recognition of mixed facial expressions and their strength by neural network, Proc. IEEE Int. Workshop on Robot and Human Communication (Tokyo, 1992), pp. 381-386.
21. C. Li, C. Xu, C. Gui and M. D. Fox, Level set evolution without re-initialization: A new variational formulation, Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition (San Diego, CA, 2005), Vol. 1, pp. 430-436.
22. W. F. Liu and Z. F. Wang, Facial expression recognition based on fusion of multiple Gabor features, Proc. Int. Conf. Patt. Recogn. (August 20-24, 2006, Hong Kong), pp. 536-539.
23. Y. Luo, M. L. Gavrilova and P. S. P. Wang, Facial metamorphosis using geometrical methods for biometric applications, Int. J. Patt. Recogn. Artif. Intell. 22(3) (2008) 555-584. (Pubitemid 351730134)
24. J. Lyons, S. Akamatsu, M. Kamachi and J. Gyoba, Coding facial expressions with Gabor wavelets, Proc. Third IEEE Int. Conf. Automatic Face and Gesture Recognition (Nara, Japan, 1998), pp. 200-205.
25. M. J. Lyons, J. Budynek and S. Akamatsu, Automatic classification of single facial imges, IEEE Trans. Patt. Anal. Mach. Intell. 21(12) (1999) 1357-1362. (Pubitemid 30568926)
26. D. Marr and E. Hildreth, Theory of edge detection, Roy. Soc. London B207 (1980) 187-217. (Pubitemid 10103608)
27. K. Mase and A. Pentland, Recognition of facial expression from optical flow, IEICE Trans. E 74(10) (1991) 3474-3483.
28. A. Mehrabian, Communication without words, Psychol. Today 2(4) (1968) 53-56.
29. P. Michel and R. E. Kaliouby, Real rime facial expression recognition in video using support vector machines, Proc. 5th Int. Conf. Multimodal Interfaces (Canada, 2003), pp. 258-264. (Pubitemid 40681880)
30. S. Osher and J. A. Sethian, Fronts propagating with curvature dependent speed: Algorithms based on Hamilton-Jacobi formulations, J. Comput. Phys. 79(1) (1988) 12-49.
31. N. Otsu, A threshold selection method from gray level histograms, IEEE Trans. Syst Man Cybern. 9(1) (1979) 62-66. (Pubitemid 9413341)
32. C. Padgett and G. W. Cottrell, Representing face images for emotion classification, Proc. Int. Conf. Advances in Neural Information Processing Systems (1996), pp. 894-900.
33. M. Pantic and L. J. M. Rothkrantz, Expert system for automatic analysis of facial expressions, Imag. Vis. Comput. J. 18(11) (2000) 881-905.
34. M. Pantic and L. J. M. Rothkrantz, Automatic analysis of facial expressions: The state of the art, IEEE Trans. Pattern Analysis and Machine Intell. 22(12) (2000) 1424-1443.
35. J. Platt, N. Cristianini and J. Shawe-Taylor, Large margin dags for multiclass classification, Adv. Neural Inform. Process. Syst. 12 (2000) 547-553.
36. G. X. Ritter and J. N. Wilson, Handbook of Computer Vision Algorithms in Image Algebra (CRC Press, Boca Raton, USA, 1996
37. N. Sebe, M. S. Lew, Y. Sun, I. Cohen, T. Gevers and T. S. Huang, Authentic facial expression analysis, Imag. Vis. Comput. 25 (2007) 1856-1863. (Pubitemid 47333322)
38. A. S. M. Sohail and P. Bhattacharya, Detection of facial feature points using anthropometric face model, Signal Processing for Image Enhancement and Multimedia Processing, eds. E. Damiani, A. Dipanda, K. Yetongnon, L. Legrand and P. Schelkens, Multimedia Systems and Applications Series, Vol. 34 (Springer-Verlag, Berlin Heidelberg New York, December, 2007), pp. 189-200.
39. A. S. M. Sohail and P. Bhattacharya, Automated lip contour detection using the level set segmentation method, Proc. 14th Int. Conf. Image Analysis and Processing (Modena, Italy, Sept 2007), pp. 425-430.
40. A. S. M. Sohail and P. Bhattacharya, Classification of facial expressions using k-nearest neighbor classifier, Advances in Computer Vision and Computer Graphics, eds. A. Gagalowicz and W. Philips, LNCS, Vol. 4418, (Springer-Verlag, Berlin Heidelberg New York, 2007), pp. 555-566. (Pubitemid 350259272)
41. A. S. M. Sohail and P. Bhattacharya, Classifying facial expressions using point-based analytic face model and support vector machines, Proc. IEEE Int. Conf. Systems, Man, and Cybernetics (SMC 2007) (October 7-10, 2007, Montreal, Canada), pp. 1008-1013. (Pubitemid 351409691)
42. M. Suwa, N. Sugie and K. Fujimora, A preliminary note on pattern recognition of human emotional expression, Proc. 4th Int. Joint Conf. Pattern Recognition (1978), pp. 408-410.
43. K. Suzuki, H. Yamada and S. Hashimoto, A similarity-based neural network for facial expression analysis, Patt. Recogn. Lett. 28(9) (2007) 1104-1111. (Pubitemid 46560886)
44. L. van Poecke, Nonverbal Communication (Garant-Uitgevers, Apeldoorn, Netherlands, 1996
45. M. F. Valstar and M. Pantic, Biologically vs. logic inspired encoding of facial actions and emotions in video, Proc. IEEE Int. Conf. Multimedia and Expo (July 9-12, 2006, Toronto, Ontario, Canada), pp. 325-328. (Pubitemid 46679720)
46. P. Vanger, R. Honlinger and H. Haken, Applications of synergetics in decoding facial expression of emotion, Proc. IEEE Int. Conf. Automatic Face and Gesture Recognition (Zurich, 1995), pp. 24-29.
47. V. N. Vapnik, The Nature of Statistical Learning Theory, 2nd edn. (Springer-Verlag, New York, 2000
48. M. Wang, Y. Iwai and M. Yachida, Expression recognition from time sequential facial images by use of expression change model, Proc. Third IEEE Int. Conf. Automatic Face and Gesture Recognition (Nara, Japan, 1998), pp. 324-329.
49. P. Yang, Q. Liu and D. N. Metaxas, Boosting coded dynamic features for facial action units and facial expression recognition, Proc. IEEE Conf. Comput. Vis. Patt. Recogn. (June 2007), pp. 1-6.
50. M. Yoneyama, Y. Iwano, A. Ohtake and K. Shirai, Facial expressions recognition using discrete 24opfield neural networks, Proc. IEEE Int. Conf. Image Processing (1997), Vol. 3, pp. 117-120.
51. J. Yu and B. Bhanu, Evolutionary feature synthesis for facial expression recognition, Patt. Recogn. Lett. 27 (2006) 1289-1298.
52. Y. Zhang and Q. Ji, Active and dynamic information fusion for facial expression understanding from image sequences, IEEE Trans. Patt. Anal. Mach. Intell. 27(5) (2005) 699-714. (Pubitemid 40608403)
53. Z. Zhang, M. Lyons, M. Schuster and S. Akamatsu, Comparison between geometry-based and gabor wavelets-based facial expression recognition using multi-layer perceptron, Proc. Third IEEE Int. Conf. Automatic Face and Gesture Recognition (Nara, Japan, 1998), pp. 454-459.