Action unit classification using active appearance models and conditional random fields

Cognitive Processing

Volumn 13, Issue SUPPL. 2, 2012, Pages

  Van Der Maaten, Laurens ^a   Hendriks, Emile ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Active appearance models; Conditional random fields; Facial action coding system; Facial expressions

Indexed keywords

ACTION UNIT; ACTIVE APPEARANCE MODEL; ALGORITHM; ARTICLE; CODING; COMPUTER; COMPUTER VISION; CONDITIONAL RANDOM FIELD; CONTROLLED STUDY; DATA PROCESSING; EXPERIMENT; FACE; FACIAL ACTION CODING SYSTEM; FACIAL EXPRESSION; GROUP DYNAMICS; HUMAN; MACHINE LEARNING; PRIORITY JOURNAL; SAMPLE; SOCIAL PSYCHOLOGY; SOCIAL SIGNAL; STATISTICAL MODEL; VIDEORECORDING; VISUAL MEMORY; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; METHODOLOGY;

ARTIFICIAL INTELLIGENCE; FACIAL EXPRESSION; HUMANS; PATTERN RECOGNITION, AUTOMATED;

EID: 84870191881     PISSN: 16124782     EISSN: 16124790     Source Type: Journal    
DOI: 10.1007/s10339-011-0419-7     Document Type: Article

References (68)

1. Ambady N, Rosenthal R (1992) Thin slices of expressive behavior as predictors of interpersonal consequences: a meta-analysis. Psychol Bull 111(2):256-274
2. Ashraf A, Lucey S, Cohn J, Chen T, Ambadar Z, Prkachin K, Solomon P, Theobald B-J (2007) The painful face: pain expression recognition using active appearance models. In: Proceedings of the 9th international conference on multimodal interfaces, pp 9-14
3. Bartlett M, Whitehill J Automated facial expression measurement: recent applications to basic research in human behavior, learning, and education. In: Calder A, Rhodes G, Haxby JV, Johnson MH (eds) Handbook of face perception. Oxford University Press, Oxford (2010)
4. Bartlett M, Littlewort G, Frank M, Lainscsek C, Fasel I, Movellan J (2005) Recognizing facial expression: machine learning and application to spontaneous behavior. In: Proceedings of the IEEE conference on computer vision and pattern recognition, vol 2, pp 568-573
5. Bartlett M, Littlewort-Ford G, Frank M, Lainscsek C, Fasel I, Movellan J (2006) Fully automatic facial action recognition in spontaneous behavior. In: Proceedings of the IEEE conference on face and gesture recognition, pp 223-230
6. Bay H, Ess A, Tuytelaars T, van Gool L (2008) Surf: Speeded up robust features. Comput Vis Image Underst 110(3):346-359
7. Bell RM, Koren Y (2007) Lessons from the Netflix prize challenge. ACM SIGKDD Explor Newslett 9(2):75-79
8. Boker SM, Cohn JF, Theobald B-J, Matthews I, Brick T, Spies J (2007) Effects of damping head movement and facial expression in dyadic conversation using real-time facial expression tracking and synthesized avatars. Philos Trans B R Soc 364(1535): 3485-3495
9. Bottou L (2004) Stochastic learning. In: Bousquet O, von Luxburg U (eds) Advanced lectures on machine learning, pp 146-168
10. Bousmalis K., Mehu M., Pantic M. (2009) Spotting agreement and disagreement: a survey of nonverbal audiovisual cues and tools. In: Proceedings of the international conferences on affective computation and intelligent interaction
11. Bradley AP (1997) The use of the area under the roc curve in the evaluation of machine learning algorithms. Patt Recog 30(7): 1145-1159
12. Brown M, Lowe DG (2003) Recognising panoramas. In: Proceedings of the 9th IEEE international conference on computer vision, vol 2, pp 1218-1225
13. Chang Y, Hu C, Feris R, Turk M (2006) Manifold-based analysis of facial expression. J Image Vis Comput 24(6):605-614
14. Cohn J, Zlochower A, Lien JJ, Kanade T (1999) Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding. Psychophysiology 36:35-43 (Pubitemid 29044454)
15. Cootes TF, Edwards G, Taylor CJ (1998) Active appearance models. In: Proceedings of the European conference on computer vision, vol 2, pp 484-498
16. Cortes C, Mohri M (2005) Confidence intervals for the area under the ROC curve. In: Advances in neural information processing systems, pp 305-312
17. Cunningham DW, Kleiner M, Bülthoff HH, Wallraven C (2004) The components of conversational facial expressions. In: Proceedings of the symposium on applied perception in graphics and visualization, pp 143-150
18. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, vol 2, pp 886-893
19. Daugman G (1985) Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. J Opt Soc Am 2(7):1160-1169
20. Ekman P, Friesen WV (1969) The repertoire of nonverbal behavior. Semiotica 1(1):49-98
21. Ekman P, Friesen WV (1978) Facial action coding system: a technique for the measurement of facial movement. Consulting Psychologists Press, Palo Alto
22. Ekman P, Rosenberg E (2005) What the face reveals, 2nd edn. Oxford, New York
23. Ekman P, Friesen WV, Hager JC (2002) Facial action coding system (FACS): manual
24. Fasel B, Luettin J (2000) Recognition of asymmetric facial action unit activities and intensities. In: Proceedings of the 15th international conference on pattern recognition
25. Fasel B, Luettin J (2003) Automatic facial expression analysis: a survey. Patt Recogn 36(1):259-275
26. Freund Y, Schapire RE (1995) A decision-theoretic generalization of on-line learning and an application to boosting. In: Computational learning theory: Eurocolt '95, Springer, pp 23-37
27. Del Giudice M, Colle L (2007) Differences between children and adults in the recognition of enjoyment smiles. Dev Psychol 43(3):796-803
28. Gottman J, Levenson R, Woodin E (2001) Facial expressions during marital conflict. J Family Commu 1:37-57
29. Gross R, Matthews I, Baker S (2005) Generic versus person specific active appearance models. Image Vis Comput 23:1080-1093 (Pubitemid 41329840)
30. Jones JP, Palmer LA (1987) An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. J Neurophysiol 58(6):1233-1258 (Pubitemid 18023459)
31. Kang YG, Joo HJ, Rhee PK (2006) Real time head nod and shake detection using HMMs. In: Lecture notes in computer science, vol 4253, pp 707-714 (Pubitemid 44700507)
32. Kapoor A, Picard RW (2001) A real-time head nod and shake detector. In: Proceedings of the 2001 workshop on perceptive user interfaces
33. Ke Y, Sukthankar R (2004) Pca-sift: a more distinctive representation for local image descriptors. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, vol 2, pp 506-513
34. Koelstra S, Pantic M, Patras I (2010) A dynamic texture-based approach to recognition of facial actions and their temporal models. IEEE Trans Patt Anal Mach Intell 32(11):1940-1954
35. Lafferty J, McCallum A, Pereira F (2001) Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In: Proceedings of the international conference on machine learning, pp 282-289
36. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11): 2278-2324
37. Lien JJ, Kanade T, Cohn JF, Ching-Chung L (1998) Automated facial expression recognition based on facs action units. In: Proceedings of the IEEE international conference on automonas face and gesture recognition, pp 390-395
38. Littlewort G, Bartlett M, Fasel I, Susskind J, Movellan J (2006) Dynamics of facial expression extracted automatically from video. Image Vis Comput 24(6):615-625 (Pubitemid 43867835)
39. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91-110
40. Lucey P, Cohn JF, Kanade T, Saragih J, Ambadar Z, Matthews I (2010) The extended Cohn-Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression. In: IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW), pp 94-101
41. Lucey S, Ashraf A, Cohn J (2007) Investigating spontaneous facial action recognition through AAM representations of the face. In: Delac K, Grgic M (eds) Face recognition, pp 275-286
42. Matthews I, Baker S (2004) Active appearance models revisited. Int J Comput Vis 60(2):135-164
43. Pantic M, Patras I (2005) Detecting facial actions and their temporal segments in nearly frontal-view face image sequences. In: Proceedings of the IEEE conference on systems, man and cybernetics, vol 4, pp 3358-3363
44. Pantic M, Rothkrantz LJM (2004) Facial action recognition for facial expression analysis from static face images. IEEE Trans Syst Man Cybern B Cybern 34(3):1449-1461
45. Papandreou G, Maragos P (2008) Adaptive and constrained algorithms for inverse compositional active appearance model fitting. In: Proceedings of the international conference on computer vision and pattern recognition, pp 1-8
46. Phillips PJ, Flynn PJ, Scruggs T, Bowyer KW, Chang J, Hoffman K, Marques J, Min J, Worek W (2005) Overview of the face recognition grand challenge. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp 947-954
47. Poggi I, DErrico F, Vincze L (2010) Agreement and its multimodal communication in debates. a qualitative analysis. Cogn Comput 1-14
48. Quattoni A, Wang S, Morency LP, Collins M, Darrell T (2010) Hidden conditional random fields. IEEE Trans Patt Anal Mach Intell 29(10)
49. Robbins H, Monro S (1951) A stochastic approximation model. Ann Math Stat 22:400-407
50. Shawe-Taylor J, Christianini N (2004) Kernel methods for pattern analysis. Cambridge Univ. Press, Cambridge
51. Sivic J, Zisserman A (2003) Video google: a text retrieval approach to object matching in videos. In: Proceedings of the IEEE international conference on computer vision, vol 2, pp 1470-1478
52. Susskind JM, Hinton GE, Movellan JR, Anderson AK Generating facial expressions with deep belief nets. In: Or J (eds) Affective computing, focus on emotion expression, synthesis and recognition. ARS Publishers, India (2008)
53. Sutton C, McCallum A, Rohanimanesh K (2007) Dynamic conditional random fields: Factorized probabilistic models for labeling and segmenting sequence data. J Mach Learn Res 8(Mar):693-723 (Pubitemid 46491655)
54. Tan W, Rong G (2003) A real-time head nod and shake detector using HMMs. Expert Syst Appl 25:461-466
55. Theobald BJ, Matthews IA, Cohn JF, Baker SM (2007) Real-time expression cloning using appearance models. In: Proceedings of the international conference on multimodal interfaces, pp 134-139
56. Tong Y, Liao W, Ji Q (2007) Facial action unit recognition by exploiting their dynamic and semantic relationships. Trans Pattern Anal Mach Intell 29(10):1683-1699
57. Tong Y, Chen J, Ji Q (2010) A unified probabilistic framework for spontaneous facial action modeling and understanding. IEEE Trans Pattern Anal Mach Intell 32(2):258-273
58. Tsochantaridis I, Joachims T, Hofmann T, Altun Y (2005) Large margin methods for structured and interdependent output variables. J Mach Learn Res 6:1453-1484
59. Valstar M, Pantic M (2006) Fully automatic facial action unit detection and temporal analysis. In: Proceedings of the IEEE conference on computer vision and pattern recognition, p 149
60. Valstar M, Pantic M (2007) Combined support vector machines and hidden markov models for modeling facial action temporal dynamics. In: Lecture notes on computer science, vol 4796, pp 118-127
61. Valstar M, Pantic M, Patras I (2004) Motion history for facial action detection from face video. In: Proceedings of the IEEE conference on systems, man and cybernetics, pp 635-640
62. Vapnik V (1995) The nature of statistical learning theory. Springer, Berlin
63. Vinciarelli A, Pantic M, Bourlard H (2009) Social signal processing: survey of an emerging domain. Image Vis Comput 27:1743-1759
64. Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 511-518
65. Viterbi AJ (1967) Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Trans Inform Theory 13(2):260-269
66. Wang P, Barrett F, Martin E, Milonova M, Gurd R, Gurb R, Kohler C, Verma R (2008) Automated video-based facial expression analysis of neuropsychiatric disorders. J Neurosci Methods 168:224-238
67. Whitehill J, Omlin C (2006) Haar features for FACS AU recognition. In: Proceedings of the IEEE international conference on face and gesture recognition
68. Williams ACC (2003) Facial expression of pain: an evolutionary account. Behav Brain Sci 25(4):439-455