Component-based recognition of facesand facial expressions

IEEE Transactions on Affective Computing

Volumn 4, Issue 4, 2013, Pages 360-371

  Taheri, Sima ^a   Patel, Vishal M ^b   Chellappa, Rama ^c  

^a Digital Signal Corporation   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c UNIVERSITY OF MARYLAND   (United States)

Author keywords

dictionary learning; expression recognition; face recognition; image separation; Simultaneous face and expression recognition; sparse representation

Indexed keywords

ALGORITHMS; GESTURE RECOGNITION;

COMPONENT SEPARATION; DICTIONARY LEARNING; EXPRESSION RECOGNITION; FACIAL EXPRESSION RECOGNITION; FACIAL EXPRESSIONS; IMAGE SEPARATION; MORPHOLOGICAL DIVERSITY; SPARSE REPRESENTATION;

FACE RECOGNITION;

EID: 84897030771     PISSN: 19493045     EISSN: None     Source Type: Journal    
DOI: 10.1109/T-AFFC.2013.28     Document Type: Article

References (56)

1. W. Zhao, R. Chellappa, A. Rosenfeld, and P.J. Phillips, "Face Recognition: A Literature Survey," ACM Computing Surveys, vol. 35, pp. 399-458, 2003.
2. A. Jorstad, D. Jacobs, and A. Trouv, "A Deformation and Lighting Insensitive Metric for Face Recognition Based on Dense Correspondences," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 2353-2360, Jun. 2011.
3. I. Naseem, R. Togneri, and M. Bennamoun, "Linear Regression for Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 11, pp. 2106-2112, Nov. 2010.
4. B. Amberg, R. Knothe, and T. Vetter, "Expression-Invariant 3D Face Recognition with a Morphable Model," Proc. Eighth IEEE Int'l Conf. Automatic Face and Gesture Recognition (FG '08), 2008.
5. P. Nagesh and B. Li, "A Compressive Sensing Approach for Expression-Invariant Face Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
6. P.-H. Tsai and T. Jan, "Expression-Invariant Face Recognition System Using Subspace Model Analysis," Proc. IEEE Conf. Systems, Man, and Cybernetics, vol. 2, pp. 1712-1717, 2005. (Pubitemid 41667551)
7. Z. Zeng, M. Pantic, G.I. Roisman, and T.S. Huang, "A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 1, pp. 39-58, Jan. 2009.
8. Yang P., Liu Q., Dimitris M.,. Exploring facial expression with compositional features. Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010
9. S. Taheri, P. Turaga, and R. Chellappa, "Towards View-Invariant Expression Analysis using Analytic Shape Manifolds," Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition and Workshops (FG), 2011.
10. P. Lucey, J. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews, "The Extended Cohn-Kanade Dataset (CK+): A Complete Dataset for Action Unit and Emotion-Specified Expression," Proc. IEEE Conf. Computer Vision and Pattern Recognition Workshops (CVPRW), 2010.
11. A. Colmenarez, B. Frey, and T.S. Huang, "A Probabilistic Framework for Embedded Face and Facial Expression Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 1999.
12. X. Li, G. Mori, and H. Zhang, "Expression-Invariant Face Recognition with Expression Classification," Proc. Third Canadian Conf. Computer and Robot Vision, 2006.
13. J. Tenenbaum and W. Freeman, "Separating Style and Content with Bilinear Models," Neural Computation, vol. 12, pp. 1247-1283, 2000.
14. M.A.O. Vasilescu and D. Terzopoulos, "Multilinear Subspace Analysis of Image Ensembles," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2003.
15. H. Wang and N. Ahuja, "Facial Expression Decomposition," Proc. Ninth IEEE Int'l Conf. Computer Vision (ICCV), 2003.
16. I. Mpiperis, S. Malassiotis, and M. Strintzis, "Bilinear Models for 3D Face and Facial Expression Recognition," IEEE Trans. Information Forensics and Security, vol. 3, no. 3, pp. 498-511, Sept. 2008.
17. C.-S. Lee and A. Elgammal, "Facial Expression Analysis Using Nonlinear Decomposable Generative Model," Proc. Second Int'l Conf. Analysis and Modelling of Faces and Gestures (AMFG '05), 2005.
18. E. Candes, X. Li, Y. Ma, and J. Wright, "Robust Principal Component Analysis?" J. ACM, vol. 58, no. 3, article 3, 2011.
19. S. Li and A. Jain, Handbook of Face Recognition. Springer, 2005.
20. D.O. Gorodnichy, "Video-Based Framework for Face Recognition in Video," Proc. Second Canadian Conf. Computer and Robot Vision, pp. 330-338, 2005.
21. U. Park, H. Chen, and A. Jain, "3D Model-Assisted Face Recognition in Video," Proc. Second Canadian Conf. Computer and Robot Vision, pp. 322-329, 2005.
22. A.M. Martinez, "Recognizing Expression Variant Faces from A Single Sample Image Per Class," Proc. IEEE Computer Vision and Pattern Recognition (CVPR), 2003.
23. C. Hsieh, S. Lai, and Y. Chen, "Expression-Invariant Face Recognition with Constrained Optical Flow Warping," IEEE Trans. Multimedia, vol. 11, no. 4, pp. 600-610, June 2009.
24. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust Face Recognition via Sparse Representation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 2, pp. 210- 227, Feb. 2008.
25. J. Huang, X. Huang, and D. Metaxas, "Simultaneous Image Transformation and Sparse Representation Recovery," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2008.
26. Y. Chang, C. Hu, and M. Turk, "Probabilistic Expression Analysis on Manifolds," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
27. Z. Ying, Z. Wang, and M.W. Huang, "Facial Expression Recognition Based on Fusion of Sparse Representation," Proc. Advanced Intelligent Computing Theories and Applications, and Sixth Int'l Conf. Intelligent Computing, pp. 457-464, 2010.
28. Z. Zhu and Q. Ji, "Robust Real-Time Face Pose and Facial Expression Recovery," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 681-688, 2006. (Pubitemid 44931391)
29. Y. Tong, J. Chen, and Q. Ji, "A Unified Probabilistic Framework for Spontaneous Facial Action Modeling and Understanding," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 2, pp. 258-273, Feb. 2010.
30. M. Bartlett, G. Littlewort, M. Frank, C. Lainscsek, I. Fasel, and J. Movellan, "Automatic Recognition of Facial Actions in Spontaneous Expressions," J. Multimedia, vol. 1, pp. 22-35, 2006.
31. M.H. Mahoor, M. Zhou, K.L. Veon, S.M. Mavadati, and J.F. Cohn, "Facial Action Unit Recognition with Sparse Representation," Proc. Ninth IEEE Int'l Conf. Automatic Face and Gesture Recognition (FG), 2011.
32. P. Yang, Q. Liu, and D.N. Metaxas, "RankBoost with L1 Regularization for Facial Expression Recognition and Intensity Estimation," Proc. 12th IEEE Int'l Conf. Computer Vision (ICCV), 2009.
33. C. Shan, S. Gong, and P. McOwan, "Robust Facial Expression Recognition Using Local Binary Patterns," Proc. IEEE Int'l Conf. Image Processing (ICIP), 2005.
34. Y.-L. Tian, T. Kanade, and J. Cohn, "Recognizing Lower Face Action Units for Facial Expression Analysis," Proc. Fourth IEEE Int'l Conf. Automatic Face and Gesture Recognition (FG), pp. 484-490, Mar. 2000.
35. M. Pantic and I. Patras, "Dynamics of Facial Expression: Recognition of Facial Actions and Their Temporal Segments from Face Profile Image Sequences," IEEE Trans. Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 36, no. 2, pp. 433-449, Apr. 2006.
36. M.F. Valstar and M. Pantic, "Fully Automatic Recognition of the Temporal Phases of Facial Actions," IEEE Trans. System, Man, and Cybernetics, vol. 42, no. 1, pp. 28-43, Feb. 2012.
37. W.-K. Liao and G. Medioni, "3D Face Tracking and Expression Inference from a 2D Sequence Using Manifold Learning," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2008.
38. G. Ford, "Fully Automatic Coding of Basic Expressions from Video," technical report, Machine Perception Lab, Inst. for Neural Computing, Univ. of California San Diego UCSD, 2002.
39. Z. Wen and T. Huang, "Capturing Subtle Facial Motions in 3D Face Tracking," Proc. Ninth IEEE Int'l Conf. Computer Vision (ICCV), 2003.
40. T. Cootes, C. Taylor, D. Cooper, and J. Graham, "Active Shape Models-Their Training and Application," Computer Vision and Image Understanding, vol. 61, pp. 38-59, 1995.
41. T. Cootes, G.J. Edwards, and C. Taylor, "Active Appearance Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, June 2001. (Pubitemid 32585279)
42. S.W. Chew, R. Rana, P. Lucey, S. Lucey, and S. Sridharan, "Sparse Temporal Representations for Facial Expression Recognition," Proc. Fifth Pacific Rim Conf. Advances in Image and Video Technology, pp. 311-322, 2012.
43. J.-L. Starck, M. Elad, and D.L. Donoho, "Image Decomposition via the Combination of Sparse Representations and a Variational Approach," IEEE Trans. Image Processing, vol. 14, no. 10, pp. 1570- 1582, Oct. 2005. (Pubitemid 41623087)
44. S. Sardy, A.G. Bruce, and P. Tseng, "Block Coordinate Relaxation Methods for Nonparametric Wavelet Denoising," J. Computational and Graphical Statistics, vol. 9, no. 2, pp. 361-379, 2000.
45. M. Elad, Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing. Springer, 2010.
46. I. Daubechies, M. Defrise, and C. De Mol, "An Iterative Thresholding Algorithm for Linear Inverse Problems with a Sparsity Constraint," Comm. Pure and Applied Math., vol. 57, pp. 1413-1541, 2004.
47. M. Zibulevsky and M. Elad, "L1-L2 Optimization in Signal and Image Processing," IEEE Signal Processing Magazine, vol. 27, no. 3, pp. 76-88, May 2010.
48. V. Chandrasekaran, S. Sanghavi, P. Parrilo, and A. Willsky, "Rank-Sparsity Incoherence for Matrix Decomposition," SIAM J. Optimization, vol. 21, no. 2, pp. 572-596, 2011.
49. M. Aharon, M. Elad, and A.M. Bruckstein, "The K-SVD: An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation," IEEE Trans. Signal Processing, vol. 54, no. 11, pp. 4311-4322, Nov. 2006. (Pubitemid 44637761)
50. S. Chen, D. Donoho, and M. Saunders, "Atomic Decomposition by Basis Pursuit," SIAM J. Scientific Computing, vol. 20, no. 1, pp. 33- 61, 1998. (Pubitemid 128689501)
51. Y.C. Pati, R. Rezaiifar, and P.S. Krishnaprasad, "Orthogonal Matching Pursuit: Recursive Function Approximation with Applications to Wavelet Decomposition," Proc. Conf. Record 27th Asilomar Conf. Signals, Systems and Computers, vol. 1, pp. 40-44, 1993.
52. X. Liu, T. Chen, and B.V. Kumar, "Face Authentication for Multiple Subjects Using Eigenflow," Pattern Recognition, vol. 36, pp. 313-328, 2003.
53. J. Friedman, T. Hastie, and R. Tibshirani, "A Note on the Group Lasso and a Sparse Group Lasso," technical report, Dept. of Statistics, Stanford Univ., 2010.
54. J. Liu, S. Ji, and J. Ye, SLEP: Sparse Learning with Efficient Projections, Arizona State Univ., http://www.public.asu.edu/jye02/ Software/SLEP, 2009.
55. M. Yang, L. Zhang, X. Feng, and D. Zhang, "Fisher Discrimination Dictionary Learning for Sparse Representation," Proc. IEEE Int'l Conf. Computer Vision (ICCV), 2011.
56. T. Kanade, J.F. Cohn, and Y. Tian, "Comprehensive Database for Facial Expression Analysis," Proc. Fourth IEEE Int'l Conf. Automatic Face and Gesture Recognition, 2000.