In the pursuit of effective affective computing: The relationship between features and registration

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 42, Issue 4, 2012, Pages 1006-1016

  Chew, S W ^a   Lucey, P ^b   Lucey, S ^d   Saragih, J ^d   Cohn, J F ^c   Matthews, I ^b   Sridharan, S ^a  

^a QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

^b DISNEY RESEARCH   (United States)

^c UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^d CSIRO   (Australia)

Author keywords

Active appearance models; automatic facial expression recognition; biologically inspired appearance descriptors; constrained local models

Indexed keywords

ACTIVE APPEARANCE MODELS; AFFECTIVE COMPUTING; ALIGNMENT ALGORITHMS; ALIGNMENT ERROR; APPEARANCE BASED; AUTOMATIC FACIAL EXPRESSION RECOGNITION; BIOLOGICALLY INSPIRED; DATA SETS; DESCRIPTORS; DETECTION METHODS; FACE ALIGNMENT; FACIAL EXPRESSION RECOGNITION; FACIAL MOVEMENTS; HIGH RELIABILITY; ILLUMINATION CONDITIONS; ILLUMINATION VARIATION; LOCAL MODEL; PIXEL REPRESENTATION; REALISTIC ENVIRONMENTS; RELIABILITY AND ROBUSTNESS;

FACE RECOGNITION; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION;

ALIGNMENT;

EID: 84864120410     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2194485     Document Type: Article

References (34)

1. M. Bartlett, G. Littlewort, M. Frank, C. Lainscsek, I. Fasel, and J. Movellan, "Automatic recognition of facial actions in spontaneous expressions," J. Multimedia, vol. 1, no. 6, pp. 22-35, 2006.
2. T. Wu, M. Bartlett, and J. Movellan, "Facial expression recognition using Gabor motion energy filters," Machine Perception Laboratory, Univ. California, San Diego, CA, Tech. Rep..
3. A. Ashraf, S. Lucey, and T. Chen, "Re-interpreting the application of Gabor filters as a manipulation of the margin in linear support vector machines," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 7, pp. 1335-1341, Jul. 2010.
4. J. Whitehill and C. Omlin, "Haar features for FACS AU recognition," in Proc. 7th IEEE Int. Conf. FG, 2006, pp. 97-101. (Pubitemid 44711334)
5. S. Lucey, I. Matthews, C. Hu, Z. A. F. de la Torre, and J. Cohn, "AAM derived face representations for robust facial action recognition," in Proc. Int. Conf. Autom. Face Gesture Recog., I. Matthews, Ed., 2006, pp. 155-160.
6. P. Lucey, J. Cohn, K. Prkachin, P. Solomon, and I. Matthews, "PAINFUL DATA: The UNBC-McMaster shoulder pain expression archive database," in Proc. IEEE Int. Conf. Autom. Face Gesture Recog., 2011, pp. 57-64.
7. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. Int. Conf. Comput. Vis. Pattern Recog., 2001, vol. 1, pp. 511-518.
8. T. Cootes, G. Edwards, and C. Taylor, "Active appearance models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, Jun. 2001. (Pubitemid 32585279)
9. I. Matthews and S. Baker, "Active appearance models revisited," Int. J. Comput. Vis., vol. 60, no. 2, pp. 135-164, Nov. 2004.
10. A. Ashraf, S. Lucey, J. Cohn, K. M. Prkachin, and P. Solomon, "The painful face II-Pain expression recognition using active appearance models," Image Vis. Comput., vol. 27, no. 12, pp. 1788-1796, Nov. 2009.
11. A. Asthana, J. Saragih, M. Wagner, and R. Goecke, "Evaluating AAM fitting methods for facial expression recognition," in Proc. Int. Conf. Affective Comput. Intell. Interact., 2009, pp. 1-8.
12. P. Lucey, J. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews, "The extended Cohn-Kanade dataset (CK+): A complete dataset for action unit and emotion-specified expression," in Proc. IEEE Workshop CVPR Human Commun. Behav. Anal., 2010, pp. 94-101.
13. D. Cristinacce and T. Cootes, "Feature detection and tracking with constrained local models," in Proc. Brit. Mach. Vis. Conf., 2006, vol. 3, pp. 929-938.
14. J. Saragih, S. Lucey, and J. Cohn, "Face alignment through subspace constrained mean-shifts," in Proc. ICCV, 2009, pp. 1034-1041.
15. D. G. Lowe, "Distinctive image features from scale-Invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
16. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 2005, pp. 886-893. (Pubitemid 43897286)
17. M. Bartlett, G. Littlewort, M. Frank, C. Lainscsek, I. Fasel, and J. Movellan, "Automatic recognition of facial actions in spontaneous expressions," J. Multimedia, vol. 1, no. 6, pp. 22-35, Sep. 2006.
18. J. Whitehill, G. Littlewort, I. Fasel, M. Bartlett, and J. Movellan, "Towards practical smile detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 11, pp. 2106-2111, Nov. 2009.
19. T. Serre, L. Wolf, S. Bileschi, M. Riesenhuber, and T. Poggio, "Robust object recognition with cortex-like mechanisms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 411-426, Mar. 2007. (Pubitemid 46336417)
20. D. Hubel and T. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex," J. Physiol., vol. 160, pp. 106-154, 1962.
21. M. Yeasin, B. Bullot, and R. Sharma, "Recognition of facial expressions and measurement of levels of interest from video," IEEE Trans. Multimedia, vol. 8, no. 3, pp. 500-508, Jun. 2006.
22. M. Valstar, B. Jiang, M. Mehu, M. Pantic, and K. Scherer, "The first facial expression recognition and analysis challenge," in Pro. IEEE Int. Conf. Autom. Face Gesture Recog., 2011, pp. 921-926.
23. J. Xiao, S. Baker, I. Matthews, and T. Kanade, "Real-Time combined 2-D +3-D active appearance models," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2004, pp. 535-542.
24. A. Ashraf, S. Lucey, J. Cohn, T. Chen, Z. Ambadar, and K. Prkachin, "The painful face: Pain expression recognition using active appearance models," in Proc. 9th Int. Conf. Multimodal Interfaces, Nagoya, Japan, 2007, pp. 9-14.
25. D. J. Field, "Relations between the statistics of natural images and the response properties of cortical cells," J. Opt. Soc. Amer. A, vol. 4, no. 12, pp. 2379-2393, Dec. 1987.
26. Y. Lecun, K. Kavukcuoglu, and C. Farabet, "Convolutional networks and applications in vision," in Proc. ISCAS, 2010, pp. 253-256.
27. N. Pinto and D. Cox, "Beyond simple features: A large-scale feature search approach to unconstrained face recognition," in Proc. IEEE Int. Conf. Autom. Face Gesture Recog., 2011, pp. 8-15.
28. N. Pinto, D. Doukhan, J. J. DiCarlo, and D. D. Cox, "A high-Throughput screening approach to discovering good forms of biologically inspired visual representation," PLoS Comput. Biol., vol. 5, no. 11, p. e1000579, 2009. DOI: 10.1371/journal.pcbi.1000579.
29. A. Berg and J. Malik, "Geometric blur for template matching," in Proc. Comput. Vis. Pattern Recog., 2001, pp. 607-614.
30. M. Bartlett, G. Littlewort,M. Frank, C. Lainscsek, I. Fasel, and J.Movellan, "Fully automatic facial action recognition in spontaneous behavior," in Proc. Int. Conf. Autom. Face Gesture Recog., 2006, pp. 223-228.
31. G. Littlewort, M. Bartlett, I. Fasel, J. Susskind, and J. Movellan, "Dynamics of facial expression extracted automatically from video," J. Image Vis. Comput., vol. 24, no. 6, pp. 615-625, Jun. 2006. (Pubitemid 43867835)
32. M. Valstar andM. Pantic, "Fully automatic facial action unit detection and temporal analysis," in Proc. CVPRW, Jun. 2006, p. 149.
33. C. Cortes andM.Mohri, "Confidence intervals for the area under the ROC curve," Proc. Adv. Neural Inf. Process. Syst., pp. 305-312, 2004.
34. J. Fleiss, Statistical Methods for Rates and Proportions. New York: Wiley, 1981.