Data mining spontaneous facial behavior with automatic expression coding

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5042 LNAI, Issue , 2008, Pages 1-20

  Bartlett, Marian ^a   Littlewort, Gwen ^a   Vural, Esra ^a,c   Lee, Kang ^b   Cetin, Mujdat ^c   Ercil, Aytul ^c   Movellan, Javier ^a  

^a UNIVERSITY OF CALIFORNIA SAN DIEGO   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

^c SABANCI UNIVERSITY   (Turkey)

Author keywords

Facial expression recognition; Machine learning

Indexed keywords

APPLICATIONS; AUTOMATION; BEHAVIORAL RESEARCH; COMPUTER KEYBOARDS; COMPUTER VISION; EDUCATION; FLOW INTERACTIONS; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION; IMAGE PROCESSING; INFORMATION MANAGEMENT; LEARNING SYSTEMS; MAN MACHINE SYSTEMS; PROGRAMMING THEORY; ROBOT LEARNING; THEOREM PROVING;

AUTOMATED CLASSIFIERS; AUTOMATED DETECTIONS; AUTOMATIC FACIAL EXPRESSION RECOGNITIONS; BEHAVIORAL SCIENCES; DRIVER DROWSINESSES; FACIAL ACTION CODING SYSTEMS; FACIAL EXPRESSION ANALYSES; FACIAL EXPRESSION RECOGNITION; HUMAN BEHAVIORS; HUMAN SUBJECTS; MACHINE LEARNING; MACHINE LEARNING SYSTEMS; MACHINE PERCEPTIONS; ON MACHINES; REAL APPLICATIONS; RESEARCH QUESTIONS; SAN DIEGO; SPONTANEOUS FACIAL BEHAVIORS;

FACE RECOGNITION;

EID: 58349099836     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-70872-8_1     Document Type: Conference Paper

References (38)

1. Bartlett, M.S., Littlewort, G.C., Frank, M.G., Lainscsek, C., Fasel, I., Movellan, J.R.: Automatic recognition of facial actions in spontaneous expressions. Journal of Multimedia 1(6), 22-35 (2006)
2. Cobb, W.: Recommendations for the practice of clinical neurophysiology. Elsevier, Amsterdam (1983)
3. Cohn, J.F., Schmidt, K.L.: The timing of facial motion in posed and spontaneous smiles. J. Wavelets, Multi-resolution & Information Processing 2(2), 121-132 (2004)
4. Craig, K.D., Hyde, S., Patrick, C.J.: Genuine, supressed, and faked facial behaviour during exacerbation of chronic low back pain. Pain 46, 161-172 (1991)
5. Craig, K.D., Patrick, C.J.: Facial expression during induced pain. J Pers Soc Psychol. 48(4), 1080-1091 (1985)
6. Donato, G., Bartlett, M.S., Hager, J.C., Ekman, P., Sejnowski, T.J.: Classifying facial actions. IEEE Trans. Pattern Analysis and Machine Intelligence 21(10), 974-989 (1999)
7. DOT, Saving lives through advanced vehicle safety technology. USA Department of Transportation. (2001), http://www.its.dot.gov/ivi/docs/AR2001.pdf
8. Ekman, P., Friesen, W.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)
9. Ekman, P.: Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage. W.W. Norton, New York (2001)
10. Ekman, P., Rosenberg, E.L. (eds.): What the face reveals: Basic and applied studies of spontaneous expression using the FACS. Oxford University Press, Oxford (2005)
11. Fasel, I., Fortenberry, B., Movellan, J.R.: A generative framework for real-time object detection and classification. Computer Vision and Image Understanding 98 (2005)
12. Fishbain, D.A., Cutler, R., Rosomoff, H.L., Rosomoff, R.S.: Chronic pain disability exaggeration/malingering and submaximal effort research. Clin J Pain 15(4), 244-274 (1999)
13. Fishbain, D.A., Cutler, R., Rosomoff, H.L., Rosomoff, R.S.: Accuracy of deception judgments. Pers Soc Psychol Rev. 10(3), 214-234 (2006)
14. Frank, M.G., Ekman, P., Friesen, W.V.: Behavioral markers and recognizability of the smile of enjoyment. J Pers Soc Psychol. 64(1), 83-93 (1993)
15. Grossman, S., Shielder, V., Swedeen, K., Mucenski, J.: Correlation of patient and caregiver ratings of cancer pain. Journal of Pain and Symptom Management 6(2), 53-57 (1991)
16. Gu, H., Ji, Q.: An automated face reader for fatigue detection. In: FGR, pp. 111-116 (2004)
17. Gu, H., Zhang, Y., Ji, Q.: Task oriented facial behavior recognition with selective sensing. Comput. Vis. Image Underst. 100(3), 385-415 (2005)
18. Hadjistavropoulos, H.D., Craig, K.D., Hadjistavropoulos, T., Poole, G.D.: Subjective judgments of deception in pain expression: accuracy and errors. Pain 65(2-3), 251-258 (1996)
19. Hill, M.L., Craig, K.D.: Detecting deception in pain expressions: the structure of genuine and deceptive facial displays. Pain 98(1-2), 135-144 (2002)
20. Hong, C.K.: Electroencephalographic study of drowsiness in simulated driving with sleep deprivation. International Journal of Industrial Ergonomics 35(4), 307-320 (2005)
21. Igarashi, K., Takeda, K., Itakura, F., Abut, H.: DSP for In-Vehicle and Mobile Systems. Springer, US (2005)
22. Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: Proceedings of the fourth IEEE International conference on automatic face and gesture recognition (FG 2000), Grenoble, France, pp. 46-53 (2000)
23. Larochette, A.C., Chambers, C.T., Craig, K.D.: Genuine, suppressed and faked facial expressions of pain in children. Pain 126(1-3), 64-71 (2006)
24. Littlewort, G., Bartlett, M.S., Fasel, I., Susskind, J., Movellan, J.: Dynamics of facial expression extracted automatically from video. J. Image & Vision Computing 24(6), 615-625 (2006)
25. Morecraft, R.J., Louie, J.L., Herrick, J.L., Stilwell-Morecraft, K.S.: Cortical innervation of the facial nucleus in the non-human primate: a new interpretation of the effects of stroke and related subtotal brain trauma on the muscles of facial expression. Brain 124(Pt 1), 176-208 (2001)
26. Orden, K.F.V., Jung, T.P., Makeig, S.: Combined eye activity measures accurately estimate changes in sustained visual task performance. Biological Psychology 52(3), 221-240 (2000)
27. Pantic, M., Pentland, A., Nijholt, A., Huang, T.: Human Computing and machine understanding of human behaviour: A Survey. In: Proc. ACM Int'l Conf. Multimodal Interfaces, pp. 239-248 (2006)
28. Pantic, M.F.V., Rademaker, R., Maat, L.: Web- based Database for Facial Expression Analysis. In: Proc. IEEE Int'l Conf. Multmedia and Expo (ICME 2005), Amsterdam, The Netherlands (July 2005)
29. Prkachin, K.M.: The consistency of facial expressions of pain: a comparison across modalities. Pain 51 (3), 297-306 (1992)
30. Prkachin, K.M., Schultz, I., Berkowitz, J., Hughes, E., Hunt, D.: Assessing pain behaviour of low-back pain patients in real time: concurrent validity and examiner sensitivity. Behav Res Ther. 40(5), 595-607
31. Rinn, W.E.: The neuropsyhology of facial expression: a review of the neurological and psychological mechanisms for producing facial expression. Psychol Bull 95, 52-77
32. Schmand, B., Lindeboom, J., Schagen, S., Heijt, R., Koene, T., Hamburger, H.L.: Cognitive complaints in patients after whiplash injury: the impact of malingering. J Neurol Neurosurg Psychiatry 64(3), 339-343
33. Schmidt, K.L., Cohn, J.F., Tian, Y.: Signal characteristics of spontaneous facial expressions: automatic movement in solitary and social smiles. Biol Psychol. 65(1), 49-66 (2003)
34. Schneiderman, H., Kanadě, T.: Probabilistic Modeling of Local Appearance and Spatial Relationships for Object Recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 45-51 (1998)
35. Takei, Y., Furukawa, Y.: Estimate of driver's fatigue through steering motion. In: Man and Cybernetics, 2005 IEEE International Conference, vol. 2, pp. 1765-1770 (2005)
36. Viola, P., Jones, M.: Robust real-time face detection. J. Computer Vision 57(2), 137-154 (2004)
37. Vural, E., Ercil, A., Littlewort, G.C., Bartlett, M.S., Movellan, J.R.: Machine learning systems for detecting driver drowsiness. In: Proceedings of the Biennial Conference on Digital Signal Processing for in-Vehicle and Mobile Systems (2007)
38. Zhang, Z., Shu Zhang, J.: Driver fatigue detection based intelligent vehicle control. In: Proceedings of the 18th International Conference on Pattern Recognition, Washington, DC, USA, pp. 1262-1265. IEEE Computer Society, Los Alamitos (2006)