Detecting depression from facial actions and vocal prosody

Proceedings - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009

Volumn , Issue , 2009, Pages

  Cohn, Jeffrey F ^a,b   Kruez, Tomas Simon ^b   Matthews, Iain ^c   Yang, Ying ^a   Nguyen, Minh Hoai ^b   Padilla, Margara Tejera ^b   Zhou, Feng ^b   De La Torre, Fernando ^b  

^a UNIVERSITY OF PITTSBURGH   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c Diseney Research   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPEARANCE MODELING; AUTOMATIC DETECTION; BEHAVIORAL OBSERVATION; CLINICAL DIAGNOSIS; CLINICAL INTERVIEW; FACIAL ACTION; FACIAL IMAGES; LEAVE-ONE-OUT; LOGISTIC REGRESSIONS; MACHINE-LEARNING; PITCH EXTRACTION; THEORY AND PRACTICE; VOCAL EXPRESSION;

COMPUTER KEYBOARDS; DIAGNOSIS; IMAGE ANALYSIS;

INTELLIGENT COMPUTING;

EID: 77949378865     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACII.2009.5349358     Document Type: Conference Paper

References (45)

1. Tian, Y., Kanade, T., and Cohn, J.F.: 'Recognizing action units for facial expression analysis', IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23, (2), pp. 97-115
2. Tong, Y., Liao, W., and Ji, Q.: 'Facial action unit recognition by exploiting their dynamic and semantic relationships', IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29, (10), pp. 1683-1699.
3. Pantic, M., and Bartlett, M.S.: 'Machine analysis of facial expressions', in Delac, K., and Grgic, M. (Eds.): 'Face recognition' (I-Tech Education and Publishing, 2007), pp. 377-416.
4. Lucey, P., Cohn, J.F., Lucey, S., Sridharan, S., and Prkachin, K.: 'Automatically detecting action units from faces of pain: Comparing shape and appearance features'. Proc. 2nd IEEE Workshop on CVPR for Human Communicative Behavior Analysis (CVPR4HB), June 2009.
5. Schmidt, K.L., Ambadar, Z., Cohn, J.F., and Reed, L.I.: 'Movement differences between deliberate and spontaneous facial expressions: Zygomaticus major action in smiling', Journal of Nonverbal Behavior, 2006, 30, pp. 37-52
6. Valstar, M.F., Pantic, M., Ambadar, Z., and Cohn, J.F.: 'Spontaneous vs. posed facial behavior: Automatic analysis of brow actions'. Proc. ACM International Conference on Multimodal Interfaces, Banff, Canada, November 2006.
7. De la Torre, F., Campoy, J., Ambadar, Z., and Cohn, J.F.: 'Temporal segmentation of facial behavior', IEEE International Conference on Computer Vision, 2007, pp. xxx-xxx
8. Reilly, J., Ghent, J., and McDonald, J.: 'Investigating the dynamics of facial expression', in Bebis, G., Boyle, R., Koracin, D., and Parvin, B. (Eds.): 'Advances in visual computing. Lecture Notes in Computer Science' (Springer 2006), pp. 334-343
9. Krumhuber, E., and Kappas, A.: 'Moving smiles: The role of dynamic components for the perception of the genuineness of smiles', Journal of Nonverbal Behavior, 2005, 29, pp. 3-24
10. Ambadar, Z., Cohn, J.F., and Reed, L.I.: 'All smiles are not created equal: Morphology and timing of smiles perceived as amused, polite, and embarrassed/nervous', Journal of Nonverbal Behavior, 2009, 33, pp. 17-34.
11. Cohn, J.F., Boker, S.M., Matthews, I., Theobald, B.-J., Spies, J., and Brick, T.: 'Effects of damping facial expression in dyadic conversation using real-time facial expression tracking and synthesized avatars', Philosophical Transactions B of the Royal Society, In press
12. Beebe, B., and Gerstman, L.J.: 'The "packaging" of maternal stimulation in relation to infant facial-visual engagement: A case study at four months ', Merrill-Palmer Quarterly of Behavior and Development, 1980, 26, (4), pp. 321-339.
13. Messinger, D.S., Chow, S.M., and Cohn, J.F.: 'Automated measurement of smile dynamics in mother-infant interaction: A pilot study', Infancy, Accepted with revisions.
14. Littlewort, G.C., Bartlett, M.S., and Lee, K.: 'Automatic coding of facial expressions displayed during posed and genuine pain', Image and Vision Computing, in press, 2009
15. Ashraf, A.B., Lucey, S., Cohn, J.F., Chen, T., Prkachin, K.M., Solomon, P., and Theobald, B.J.: 'The painful face: Pain expression recognition using active appearance models'. Proc. Proceedings of the ACM International Conference on Multimodal Interfaces, 2007.
16. Schmidt, K.L., VanSwearingen, J.M., and Levenstein, R.M.: 'Speed, amplitude, and asymmetry of lip movement in voluntary puckering and blowing expressions: Implications for facial assessment.', Motor Control, 2007, 9, pp. 270-280.
17. Wang, P., Barrett, F., Martin, E., Milonova, M., Gurd, R.E., Gur, R.C., Kohler, C., and Verma, R.: 'Automated video-based facial expression analysis of neuropsychiatric disorders', Journal of Neuroscience Methods, 2008, 168, pp. 224-238.
18. Schmidt, K.L., Bhattacharya, S., and Denlinger, R.: 'Comparison of deliberate and spontaneous facial movement in smiles and eyebrow raises', Journal of Nonverbal Behavior, 2009, 33, pp. 35-45.
19. Schmidt, K.L., Lui, Y., and Cohn, J.F.: 'The role of structural facial asymmetry in asymmetry of peak facial expressions', Laterality, 2006, 11, (6), pp. 540-561.
20. American Psychiatric Association: 'Diagnostic and statistical manual of mental disorders' (American Psychiatric Association, 1994, Fourth edn. 1994).
21. Ekman, P., Friesen, W.V., and Hager, J.C.: 'Facial action coding system' (Research Nexus, Network Research Information, Salt Lake City, UT, 2002. 2002).
22. Cohn, J.F., and Ekman, P.: 'Measuring facial action by manual coding, facial EMG, and automatic facial image analysis', in Harrigan, J.A., Rosenthal, R., and Scherer, K. (Eds.): 'Handbook of nonverbal behavior research methods in the affective sciences' (Oxford, 2005), pp. 9-64.
23. Ekman, P., and Rosenberg, E.: 'What the face reveals' (Oxford, 2005, 2nd edn. 2005).
24. Moving Picture Experts Group: 'Overview of the MPEG-4 standard' (2002)
25. Cootes, T.F., Edwards, G., and Taylor, C.J.: 'Active Appearance Models', IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23, (6), pp. 681-685.
26. Cohn, J.F., Ambadar, Z., and Ekman, P.: 'Observer-based measurement of facial expression with the Facial Action Coding System', in Coan, J.A., and Allen, J.J.B. (Eds.): 'The handbook of emotion elicitation and assessment. Oxford University Press Series in Affective Science' (Oxford University, 2007), pp. 203-221.
27. First, M.B., Spitzer, R.L., Gibbon, M., and Williams, J.B.W.: 'Structured clinical interview for DSM-IV axis I disorders' (Biometrics Research Department, New York State Psychiatric Institute-Patient Edition, 1995, SCID-I/P, Version 2.0 edn. 1995).
28. Hollon, S.D., Thase, M.E., and Markowitz, J.C.: 'Treatment and prevention of depression', Psychological Science in the Public Interest, 2002, 3, (2), pp. 38-77.
29. Hamilton, M.: 'A rating scale for depression', Journal of Neurology and Neurosurgery, 1960, 23, pp. 56-61.
30. Heller, M., and Haynal-Reymond, V.: 'Depression and suicide faces', in Ekman, P., and Rosenberg, E. (Eds.): 'What the face reveals' (Oxford, 1997), pp. 398-407.
31. Ekman, P., Matsumoto, D., and Friesen, W.V.: 'Facial expression in affective disorders', in Ekman, P., and Rosenberg, E. (Eds.): 'What the face reveals' (Oxford, 2005, 2nd edn.), pp. 331-341.
32. Ellgring, H.: 'Nonverbal communication in depression' (Cambridge University, 1999. 1999).
33. Fleiss, J.L.: 'Statistical methods for rates and proportions' (Wiley, 1981)
34. Kerlinger, F.N.: 'Foundations of behavioral research: Educational, psychological and sociological inquiry ' (Holt, Rinehart and Winston, 1973. 1973)..
35. Matthews, I., and Baker, S.: 'Active appearance models revisited', International Journal of Computer Vision, 2004, 60, (2), pp. 135-164.
36. Ashraf, A.B., Lucey, S., Cohn, J.F., Chen, T., Prkachin, K.M., and Solomon, P.: 'The painful face: Pain expression recognition using active appearance models', Image and Vision Computing, In press.
37. Lucey, S., Matthews, I., Hu, C., Ambadar, Z., De la Torre, F., and Cohn, J.F.: 'AAM derived face representations for robust facial action recognition', Seventh IEEE International Conference on Automatic Face and Gesture Recognition, 2006, FG '06, pp. 155-160.
38. Boersma, P., and Weenink, D.: 'Praat: Doing phonetics by computer' (Undated)
39. Bettes, B.A.: 'Maternal depression and motherese: Temporal and intonational features', Child Development, 1988, 59, pp. 1089-1096.
40. Zlochower, A.J., and Cohn, J.F.: 'Vocal timing in face-to-face interaction of clinically depressed and nondepressed mothers and their 4-month-old infants', Infant Behavior and Development, 1996, 19, pp. 373-376.
41. Ekman, P., Matsumoto, D., and Friesen, W.V.: 'Assessment of facial behavior in affective disorders', in Maser, J.D. (Ed.): 'Depression and expressive behavior' (Lawrence Erlbaum Associates, 1987).
42. Chang, C.-C., and Lin, C.-J.: 'LIBSVM: A library for support vector machines' (2001).
43. Littlewort, G.C., Bartlett, M.S., and Lee, K.: 'Faces of pain: Automated measurement of spontaneous facial expressions of genuine and posed pain'. Proc. International Conference on Multimodal Interfaces, Nagoya2007.
44. Reed, L.I., Sayette, M.A., and Cohn, J.F.: 'Impact of depression on response to comedy: A dynamic facial coding analysis', Abnormal Psychology, 2007, 116, (4), pp. 804-809.
45. Scherer, K.R.: 'Emotion', in Hewstone, M., and Stroebe, W. (Eds.): 'Introduction to Social Psychology: A European perspective' (Blackwell, 2000, 3rd edn.), pp. 151-191.