Quantification of facial expressions using high-dimensional shape transformations

Journal of Neuroscience Methods

Volumn 141, Issue 1, 2005, Pages 61-73

  Verma, Ragini ^a   Davatzikos, Christos ^a   Loughead, James ^b   Indersmitten, Tim ^b   Hu, Ranliang ^c   Kohler, Christian ^b   Gur, Raquel E ^b   Gur, Ruben C ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b HUP   (United States)

^c UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Elastic deformations; Emotion intensity quantification; Expression analysis; Facial action coding system (FACS); Shape transformation

Indexed keywords

AFFECT; ARTICLE; ELASTICITY; EMOTION; FACIAL EXPRESSION; FACIES; HUMAN; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS;

ADOLESCENT; ADULT; AGED; ALGORITHMS; EMOTIONS; FACIAL EXPRESSION; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MALE; MIDDLE AGED; PHOTOGRAPHY; SOCIAL BEHAVIOR;

EID: 10044221994     PISSN: 01650270     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jneumeth.2004.05.016     Document Type: Article

References (41)

1. R. Bajcsy, and S. Kovacic Multiresolution elastic matching Comput. Vision Graphics Image Process. 46 1989 1 21
2. M.R. Bartlett, J.C. Hager, P. Ekman, and T.J. Sejnowski Measuring facial expressions by computer image analysis Psychophysiology 36 1999 253 264
3. M.J. Black, and Y. Yacoob Recognizing facial expressions in image sequences using local parameterized models of image motion Int. J. Comput. Vision 25 1 1997 23 48
4. G.E. Christensen, S.C. Joshi, and M.I. Miller Volumetric transformation of brain anatomy IEEE Trans. Med. Imaging 16 6 1997 864 877
5. J.F. Cohn, A.J. Zlochower, J. Lien, and T. Kanade Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding Psychophysiology 36 1999 35 43
6. D.L. Collins, and A.C. Evans Automatic 3D estimation of gross morphometric variability in human brain Neuroimage 3 3 1996
7. C. Darwin The expression of the emotions in man and animals 1872 John Murray London
8. C. Davatzikos Measuring biological shape using geometry-based shape transformations Image Vision Comput. 19 2001 63 74
9. C. Davatzikos, S. Vaillant, J.L. Resnick, S. Prince, N. Levotsky, and Bryan A computerized approach for morphological analysis of the corpus callosum J. Comput. Assisted Tomography 20 1996 88 97
10. G. Donato, M.R. Bartlett, P. Ekman, and T.J. Sejnowski Classifying facial actions IEEE Trans. Pattern Anal. Mach. Intell. 21 10 1999 974 989
11. R.O. Duda, P.E. Hart, and D.G. Stork Pattern classification 2001 Wiley
12. P. Ekman, and W.V. Friesen Facial action coding system 1978 Consulting Psychologists Press
13. P. Ekman, and E. Rosenberg What the face reveals 1997 Oxford University Press
14. I.A. Essa, and A.P. Pentland Coding, analysis, interpretation and recognition of facial expressions IEEE Trans. Pattern Anal. Mach. Intell. 19 7 1997 757 763
15. G. Gainnoti, C. Caltagirone, and P. Zoccolotti Left/right and cortical/subcortical dichotomies in the neuropsychological study of human emotions Cognition Emotion 7 1993 71 94
16. R.C. Gur, R.J. Erwin, R.E. Gur, A.S. Zwil, C. Heimberg, and H.C. Kraemer Facial emotion discrimination. II. Behavioral findings in depression Psychiatry Res. 42 1992 241 251
17. R.C. Gur, R. Sara, M.A. Agerdoorn, O. Marom, P. Hughett, and L. Macy A method for obtaining 3-dimensional facial expressions and its standardization for the use in neurocognitive studies J. Neurosci. Meth. 115 2002 137 143
18. R.E. Gur, C. Kohler, B.I. Turetsky, S.J. Seigel, S.J. Kanes, and W.B. Bilker A sexually dimorphic ratio of orbitofrontal to amygdala volume is altered in schizophrenia Biol Psychiatry. 55 2004 512 517
19. T. Indersmitten, and R.C. Gur Emotion processing in chimeric faces: hemispheric asymmetries in expression and recognition of emotions J. Neurosci. 23 2003 3820 3825
20. Karpouzis K, Votsis G, Moschovitis G, Kollias S. Emotion recognition using feature extraction and 3D models. Computational intelligence and applications. World Scientific and Engineering Society Press; 1999. pp. 342-7.
21. Kohler CG, Turner T, Stolar NM, Bilker WB, Bresinger CM, Gur RE, et al. Differences in facial expression of four universal emotion. Psychiat Res 2004, in press.
22. J. Lien, T. Kanade, J. Cohn, and C.C. Li Detection, tracking and classification of action units in facial expression J. Robot. Autonom. Syst. 31 2000 131 146
23. J.B.A. Maintz, and M.A. Viergever A survey of medical image registration Med. Image Anal. 2 1 1998 1 36
24. A. Martinez Recognizing imprecisely localized, partially occluded and expression variant faces from a single sample per class IEEE Trans Pattern Anal Mach Intell. 24 6 2002 748 763
25. A. Martinez, and A.C. Kak PCA versus LDA IEEE Trans. Pattern Anal. Mach. Intell. 23 2 2001 228 233
26. Palermo R, Coltheart M. Photographs of facial expression accuracy, response times and ratings of intensity. Behav Res Meth, Instrum Comp 2004, in press.
27. W.E. Rinn The neuropsychology of facial expression: a review of the neurological and psychological mechanisms for producing facial expressions Psychol. Bull. 95 1984 52 77
28. H.A. Sackeim, R.C. Gur, and M.C. Saucy Emotions are expressed more intensely on the left side of the face Science 202 1978 434 436
29. H.A. Sakheim, M.S. Greenberg, A.L. Weiman, R.C. Gur, J.P. Hungerbuhler, and N. Geschwind Hemispheric asymmetry in the expression of positive and negative emotions: neurological evidence Arch. Neurol. 39 1982 210 218
30. J.E. Salem, A.M. Kring, and S.L. Kerr More evidence for generalized poor performance in facial emotion perception in schizophrenia J. Abnormal Psychol. 105 1996 480 483
31. K.L. Schmidt, and J.F. Cohn Human facial expressions as adaptations: Evolutionary questions in facial expression research Yearbook Phys. Anthropol. 44 2001 3 24
32. D.L. Shtasel, R.E. Gur, F. Gallacher, C. Heimberg, and R.C. Gur Gender difference in the clinical expression of schizophrenia Schizophr. Res. 7 1992 225 232
33. G. Subsol, J.P. Thirion, and N. Ayache Application of an automatically built 3D morphometric brain atlas: study of cerebral ventricle shape In: Vision in biomedical computing. Lecture notes in computer science 1996 pp. 373-82
34. Terzopoulos D, Waters K. Analysis of facial images using physical and anatomical models. In: Proceedings of the International Conference of Computer Vision, 1990.
35. D.W. Thompson On growth and form 1917 Cambridge University Press Cambridge
36. Tian Y-L, Kanade T, Cohn J. Recognizing action units for facial expression analysis. CMU Technical Report CMU-RI-TR-99-40, 1999.
37. Y.-L. Tian, T. Kanade, and J. Cohn Recognizing action units for facial expression analysis IEEE Trans. Pattern Anal. Mach. Intell. 23 2001 97 115
38. Y. Yacoob, and L. Davis Recognizing human facial expression 1994 Centre for Automation Research, University of Maryland
39. Y. Yacoob, and L. Davis Recognizing human facial expression from long image sequences using optical flow IEEE Trans. Pattern Anal. Mach. Intell. 18 6 1996 636 642
40. A. Yuille, P. Haallinaan, and D.S. Cohen Feature extraction from faces using deformable templates Int. J. Comput. Vision 8 2 1992 99 111
41. Z. Zhang Feature-based facial expression recognition: Sensitivity analysis and experiments with a multilayer perception Int. J. Pattern Recog. Artif. Intell. 13 6 1999 898 911