Automatic coding of facial expressions displayed during posed and genuine pain

Image and Vision Computing

Volumn 27, Issue 12, 2009, Pages 1797-1803

  Littlewort, Gwen C ^a   Bartlett, Marian Stewart ^a   Lee, Kang ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Automated FACS; Computer vision; Facial expression; Machine learning; Malingering; Spontaneous behavior

Indexed keywords

AUTOMATION; CLASSIFIERS; COMPUTER KEYBOARDS; COMPUTER VISION; EDUCATION; GESTURE RECOGNITION; ROBOT LEARNING; VIDEO RECORDING;

AUTOMATED FACS; FACIAL EXPRESSION; MACHINE LEARNING; MALINGERING; SPONTANEOUS BEHAVIOR;

FACE RECOGNITION;

EID: 70349281749     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2008.12.010     Document Type: Article

References (30)

1. Bartlett M.S., Littlewort G.C., Frank M.G., Lainscsek C., Fasel I., and Movellan J.R. Automatic recognition of facial actions in spontaneous expressions. J. Multimedia 1 6 (2006) 22-35
2. Cohn J.F., and Schmidt K.L. The timing of facial motion in posed and spontaneous smiles. J. Wavelets Multi-resolution Inform. Process. 2 2 (2004) 121-132
3. Craig K.D., Hyde S., and Patrick C.J. Genuine, supressed, and faked facial behaviour during exacerbation of chronic low back pain. Pain 46 (1991) 161-172
4. Craig K.D., and Patrick C.J. Facial expression during induced pain. J. Pers. Soc. Psychol. 48 4 (1985) 1080-1091
5. Donato G., Bartlett M.S., Hager J.C., Ekman P., and Sejnowski T.J. Classifying facial actions. IEEE Trans. Pattern Anal. Mach. Intell. 21 10 (1999) 974-989
6. Ekman P., and Friesen W. Facial Action Coding System: A Technique for the Measurement of Facial Movement (1978), Consulting Psychologists Press, Palo Alto, CA
7. Ekman P. Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage (2001), W.W. Norton, New York
8. In: Ekman P., and Rosenberg E.L. (Eds). What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the FACS (2005), Oxford University Press, Oxford
9. Fasel I., Fortenberry B., and Movellan J.R. A generative framework for real-time object detection and classification. Comput. Vis. Image Understand. (2005) 98
10. Fishbain D.A., Cutler R., Rosomoff H.L., and Rosomoff R.S. Accuracy of deception judgments. Pers. Soc. Psychol. Rev. 10 3 (2006) 214-234
11. Frank M.G., Ekman P., and Friesen W.V. Behavioral markers and recognizability of the smile of enjoyment. J. Pers. Soc. Psychol. 64 1 (1993) 83-93
12. Grossman S., Shielder V., Swedeen K., and Mucenski J. Correlation of patient and caregiver ratings of cancer pain. J. Pain Symp. Manage. 6 2 (1991) 53-57
13. Hadjistavropoulos H.D., Craig K.D., Hadjistavropoulos T., and Poole G.D. Subjective judgments of deception in pain expression: accuracy and errors. Pain 65 2-3 (1996) 251-258
14. Hill M.L., and Craig K.D. Detecting deception in pain expressions: the structure of genuine and deceptive facial displays. Pain 98 1-2 (2002) 135-144
15. Hill M.L., and Craig K.D. Detecting deception in facial expressions of pain: accuracy and training. Clin. J. Pain 20 6 (2002) 415-422
16. T. Kanade, J.F. Cohn, Y. Tian, Comprehensive database for facial expression analysis, in: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition (FG'00), Grenoble, France, 2000, pp. 46-53.
17. Larochette A.C., Chambers C.T., and Craig K.D. Genuine, suppressed and faked facial expressions of pain in children. Pain 15;126 1-3 (2006) 64-71 Dec
18. Littlewort G., Bartlett M.S., Fasel I., Susskind J., and Movellan J. Dynamics of facial expression extracted automatically from video. J. Image Vis. Comput. 24 6 (2006) 615-625
19. Morecraft R.J., Louie J.L., Herrick J.L., and Stilwell-Morecraft K.S. Cortical innervation of the facial nucleus in the non-human primate: a new interpretation of the effects of stroke and related subtotal brain trauma on the muscles of facial expression. Brain 124 1 (2001) 176-208
20. M. Pantic, A. Pentland, A. Nijholt, T. Huang, Human computing and machine understanding of human behaviour: a survey, in: Proceedings of the ACM International Conference on Multimodal Interfaces, 2006, pp. 239-248.
21. M. Pantic, M.F. Valstar, R. Rademaker, L. Maat, Web-based Database for facial expression analysis, in: Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'05), Amsterdam, The Netherlands, July 2005.
22. Prkachin KM. Dissociating deliberate and spontaneous expressions of pain. Pain 51 3 (1992) 57-65
23. Prkachin KM. Effects of deliberate control on verbal and facial expressions of pain. Pain 114 (2005) 328-338
24. Prkachin K.M., Schultz I., Berkowitz J., Hughes E., and Hunt D. Assessing pain behaviour of low-back pain patients in real time: concurrent validity and examiner sensitivity. Behav. Res. Ther. 40 5 (2002) 595-607
25. Prkachin K.M., Solomon P.A., and Ross A.J. The underestimation of pain among health-care providers. Can. J. Nurs. Res. 39 (2007) 88-106
26. Rinn W.E. The neurophysiology of facial expression: a review of the neurological and psychological mechanisms for producing facial expression. Psychol. Bull. 95 (1984) 52-77
27. Schmidt K.L., Cohn J.F., and Tian Y. Signal characteristics of spontaneous facial expressions: automatic movement in solitary and social smiles. Biol. Psychol. 65 1 (2003) 49-66
28. H. Schneiderman, T. Kanade, Probabilistic modeling of local appearance and spatial relationships for object recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1998, pp. 45-51.
29. Viola P., and Jones M. Robust real-time face detection. J. Comput. Vis. 57 2 (2004) 137-154
30. E. Vural, A. Ercil, G.C. Littlewort, M.S. Bartlett, J.R. Movellan, Machine learning systems for detecting driver drowsiness, in: Proceedings of the Biennial Conference on Digital Signal Processing for in Vehicle and Mobile Systems, 2007.