Facial expression classification: An approach based on the fusion of facial deformations using the transferable belief model

International Journal of Approximate Reasoning

Volumn 46, Issue 3, 2007, Pages 542-567

  Hammal, Z ^a   Couvreur, L ^b   Caplier, A ^a   Rombaut, M ^a  

^a GIPSA LAB   (France)

^b FACULTÉ POLYTECHNIQUE DE MONS   (Belgium)

Author keywords

Bayesian model; Classification; Data fusion; Facial expressions; Transferable belief model

Indexed keywords

BAYESIAN NETWORKS; CLASSIFICATION (OF INFORMATION); DATA FUSION; DECISION THEORY; FEATURE EXTRACTION; IMAGE SEGMENTATION; MATHEMATICAL MODELS;

BAYESIAN MODELS; FACIAL EXPRESSIONS; FACIAL FEATURES; TRANSFERABLE BELIEF MODELS;

FACE RECOGNITION;

EID: 36048993248     PISSN: 0888613X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijar.2007.02.003     Document Type: Article

References (48)

1. SimilarNet: the European Taskforce for Creating Human-Machine Interfaces Similar to Human-Human Communication, http://www.similar.cc/.
2. Donato G., Barlett M.S., Hager J.C., Ekman P., and Sejnowski T.J. Classifying facial actions. IEEE Transactions on Pattern Analysis and Machine Intelligence 21 10 (1999) 974-989
3. Mehrabian A. Communication Without Words. Psychology Today 2 4 (1968) 53-56
4. Ekman P. Facial expression. The Handbook of Cognition and Emotion (1999), Wiley
5. Pantic M., and Rothkrantz M. Automatic analysis of facial expressions: the state of the art. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 12 (2000)
6. Fasel B., and Luettin J. Automatic facial expression analysis: a survey. Pattern Recognition 1 30 (2003) 259-275
7. Yacoob Y., and Davis L.S. Recognizing human facial expressions from long image sequences using optical flow. IEEE Transactions on Pattern Analysis and Machine Intelligence 18 6 (1996) 636-642
8. Rosenblum M., Yacoob Y., and S Davis L. Human expression recognition from motion using a radial basis function network architecture. IEEE Transactions on Neural Networks 7 5 (1996) 1121-1137
9. Black M.J., and Yacoob Y. Recognizing facial expression in image sequences using local parameterized models of image motion. International Journal of Computer Vision 25 1 (1997) 23-48
10. Essa I.A., and Pentland A.P. Coding, analysis, interpretation, and recognition of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 (1997) 757-763
11. J.F. Cohn, A.J. Zlochower, J.J. Lien, T. Kanade. Feature-point tracking by optical flow discriminates subtles differences in facial expression, in: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, April, Nara, Japan, 1998, pp. 396-401.
12. M. Lyons, S. Akamatsu, Coding facial expressions with gabor wavelets, in: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, April, Nara, Japan, 1998, pp. 200-205.
13. Z. Zhang, L. Lyons, M. Schuster, S. Akamatsu, Comparison between geometry-based and Gabor wavelets-based facial expression recognition using multi-layer perceptron, in: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, 1998, pp. 454-459.
14. Gao Y., Leung M.K.H., Hui S.C., and Tananda M.W. Facial expression recognition from line-based caricatures. IEEE Transactions on System Man and Cybernetics - PART A: System and Humans 33 3 (2003)
15. Oliver N., Pentland A., and Bérard F. LAFTER: a real-time face and tracker with facial expression recognition. Pattern Recognition 33 (2000) 1369-1382
16. Abboud B., Davoine F., and Dang M. Facial expression recognition and synthesis based on appearance model. Signal Processing: Image Communication 19 8 (2004) 723-740
17. J.J. Lien, T. Kanade, J.F. Cohn, C. Li. Subtly different facial expression recognition and expression intensity estimation, in: Proceedings of the IEEE Computer Vision and Pattern Recognition, June 23-25, Santa Barbara, CA, 1998, pp. 853-859.
18. Pantic M., and Rothkrantz L.J.M. Expert system for automatic analysis of facial expressions. Image and Vision Computing Journal 18 11 (2000) 881-905
19. Tian Y., Kanade T., and Cohn J.F. Recognizing action units for facial expression analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 2 (2001) 97-115
20. I. Cohen, F.G. Cozman, N. Sebe, M.C Cirelo, T.S. Huang. Learning Bayesian network classifiers for facial expression recognition using both labeled and unlabeled data, in: Proceedings of the IEEE Computer Vision and Pattern Recognition, 2003.
21. M. Pardàs, Extraction and tracking of the eyelids, in: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 4, Istambul, Turkey, June 2000, pp. 2357-2360.
22. N. Tsapatsoulis, K. Karpouzis, G. Stamou, F. Piat, S.A. Kollias, A fuzzy system for emotion classification based on the MPEG-4 facial definition parameter set, in: Proceedings of the 10th European Signal Processing Conference, Tampere, Finlande, September 2000.
23. Ekman P., and Friesen W.V. Facial Action Coding System (1978), Consulting Psychologist Press
24. Bassili J.N. Facial motion in the perception of faces and emotional expression. Journal of Experimental Psychology - Human Perception and Performance 4 3 (1978) 373-379
25. Anandan P. A computational framework and an algorithm for the measurement of visual motion. International Journal on Computer Vision 2 (1989) 283-310
26. Y. Gao, M.K.H. Leung, Human face recognition using line edge maps, in: Proceedings of the IEEE 2nd Workshop Automatic Identification Advanced Technology, 1999, pp. 173-176.
27. B. Abboud, F. Davoine, Appearance factorization for facial expression analysis, BMVA British Machine Vision Conference, Kingston, UK, September 2004.
28. B.D. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, in: Proceedings of the International Joint Conference on Artificial Intelligence, Vancouver, Canada, August 1981, pp. 674-680.
29. Tao H., and Huang T.S. Connected vibration: a model analysis approach to non-rigid motion tracking. Proceedings of the IEEE Computer Vision and Pattern Recognition (1998) 735-740
30. Tekalp M. Face and 2-D mesh animation in MPEG-4. Tutorial Issue on the MPEG-4 Standard, Image Communication Journal (1999)
31. Smets P. The transferable belief model for quantified belief representation. Handbook of Defeasible Reasoning and Uncertainty Management System vol. 1 (1998), Kluwer pp. 267-301
32. D Boucher J., and Ekman P. Facial areas and emotional information. Journal of Communication 25 2 (1975) 21-29
33. Bassili J.N. Emotion recognition: The role of facial movements and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology 61 11 (1979) 298-307
34. Gouta K., and Miyamoto M. Facial areas and emotional information. Japanese Journal of Psychology 71 3 (2000) 211-218
35. Eveno N., Caplier A., and Y Coulon P. Automatic and accurate lip tracking. IEEE Transactions on Circuits and Systems for Video Technology 14 5 (2004) 706-715
36. Hammal Z., Eveno N., Caplier A., and Coulon P.Y. Parametric models for facial features segmentation. Signal Processing 86 (2006) 399-413
37. Z. Hammal, A. Caplier, M. Rombaut, Belief theory applied to facial expressions classification, in: Proceedings of the 3rd International Conference on Advances in Pattern Recognition, Bath, United Kingdom, August 22-25, 2005.
38. Z. Hammal, L. Couvreur, A. Caplier, M. Rombaut. Facial expression recognition based on the belief theory: comparison with different classifiers, in: Proceedings of the International Conference on Image Analysis and Processing, Cagliari, Italy, September, 2005.
39. Dempster A. A generalization of Bayesian inference. Journal of the Royal Statistical Society, Series B 30 (1968) 205-247
40. Shafer G. A Mathematical Theory of Evidence (1976), Princeton University Press
41. P. Smets, Data fusion in the transferable belief model, in: Proceedings of the International Conference on. Information Fusion, Paris, France, July 2000, pp. 21-33.
42. Canny J. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 8 6 (1986) 679-698
43. Hammal-Caplier Database: This Address will be Specified in the Final Version.
44. M. Dailey, G.W. Cottrell, J. Reilly, California Facial Expressions (CAFE), unpublished digital images, University of California, San Diego, 2001.
45. Cohn-Kanade AU-Coded Facial Expression Database, .
46. Devijver P.R., and Kittler J. Pattern Recognition: A Statistical Approach (1982), Prentice-Hall
47. J.A. Bilmes, A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian Mixture and hidden Markov models, Technical Report, ICSI-TR-97-021, International Computer Science Institute, April. 1998.
48. Linde Y., Buzo A., and Gray R.M. An algorithm for vector quantizer design. IEEE Transactions on Communication 28 1 (1980) 84-95