Using Hankel matrices for dynamics-based facial emotion recognition and pain detection

IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

Volumn 2015-October, Issue , 2015, Pages 26-33

  Lo Presti, Liliana ^a   La Cascia, Marco ^a  

^a UNIVERSITY OF PALERMO   (Italy)

Author keywords

Emotion recognition; Face; Feature extraction; Hidden Markov models; Linear systems; Pain; Support vector machines

Indexed keywords

BENCHMARKING; COMPUTER VISION; DYNAMICS; FEATURE EXTRACTION; HEALTH; HIDDEN MARKOV MODELS; LINEAR SYSTEMS; MATRIX ALGEBRA; PSYCHOLOGY COMPUTING; SPEECH RECOGNITION; SUPPORT VECTOR MACHINES; TEMPORAL LOGIC;

CLASSIFICATION ACCURACY; CLASSIFICATION FRAMEWORK; COMPETITIVE PERFORMANCE; EMOTION RECOGNITION; FACE; LINEAR TIME-INVARIANT SYSTEM; PAIN; STATE-OF-THE-ART APPROACH;

FACE RECOGNITION;

EID: 84951999053     PISSN: 21607508     EISSN: 21607516     Source Type: Conference Proceeding    
DOI: 10.1109/CVPRW.2015.7301351     Document Type: Conference Paper

References (37)

1. S. W. Chew, P. Lucey, S. Lucey, J. Saragih, J. F. Cohn, and S. Sridharan. Person-independent facial expression detection using constrained local models. In Proc. of Conf. and Workshop on Automatic Face & Gesture Recognition (FG), pages 915-920. IEEE, 2011.
2. S.W. Chew, S. Lucey, P. Lucey, S. Sridharan, and J. F. Conn. Improved facial expression recognition via uni-hyperplane classification. In Proc. of Conf. on Computer Vision and Pattern Recognition (CVPR), pages 2554-2561. IEEE, 2012.
3. S. W. Chew, R. Rana, P. Lucey, S. Lucey, and S. Sridharan. Sparse temporal representations for facial expression recognition. In Advances in Image and Video Technology, pages 311-322. Springer, 2012.
4. M. Cuturi. Fast global alignment kernels. In Int. Conf. on Machine Learning (ICML), pages 929-936, 2011.
5. M. Cuturi, J. Vert, O. Birkenes, and T. Matsui. A kernel for time series based on global alignments. In Proc. of Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), volume 2, pages II-413. IEEE, 2007.
6. H. Dibeklioʇlu. Enabling dynamics in face analysis. PhD thesis, University of Amsterdam, 2014.
7. B. Fasel and J. Luettin. Automatic facial expression analysis: a survey. Pattern recognition, 36 (1): 259-275, 2003.
8. M. Fazel. Matrix rank minimization with applications. PhD thesis, PhD thesis, Stanford University, 2002.
9. Z. Hammal and J. F. Cohn. Automatic detection of pain intensity. In Proceedings of the 14th ACM international conference on Multimodal interaction, pages 47-52. ACM, 2012.
10. Z. Hammal and M. Kunz. Pain monitoring: A dynamic and context-sensitive system. Pattern Recognition, 45 (4): 1265-1280, 2012.
11. L. A. Jeni, J. M. Girard, J. F. Cohn, and F. De La Torre. Continuous AU intensity estimation using localized, sparse facial feature space. In Proc. of Conf. on Automatic Face & Gesture Recognition (FG), pages 1-7. IEEE, 2013.
12. S. Kaltwang, O. Rudovic, and M. Pantic. Continuous pain intensity estimation from facial expressions. In Advances in Visual Computing, pages 368-377. Springer, 2012.
13. J. Klamka. Controllability of dynamical systems. a survey. Bulletin of the Polish Academy of Sciences: Technical Sciences, 61 (2): 335-342, 2013.
14. B. Li, O. I. Camps, and M. Sznaier. Cross-view activity recognition using Hankelets. In Proc. of Conf. on Computer Vision and Pattern Recognition (CVPR), pages 1362-1369. IEEE, 2012.
15. L. Lo Presti and M. La Cascia. An on-line learning method for face association in personal photo collection. Image and Vision Computing, 30 (4): 306-316, 2012.
16. L. Lo Presti, M. La Cascia, S. Sclaroff, and O. Camps. Gesture modeling by Hanklet-based hidden Markov model. In Computer Vision -ACCV 2014, volume 9005 of Lecture Notes in Computer Science, pages 529-546. Springer, 2015.
17. L. Lo Presti, S. Sclaroff, and A. Rozga. Joint alignment and modeling of correlated behavior streams. In Int. Conf. on Computer Vision-Workshops, pages 730-737, 2013.
18. A. Lorincz, L. A. Jeni, Z. Szabó, J. F. Cohn, and T. Kanade. Emotional expression classification using time-series kernels. In Conf. on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 889-895. IEEE, 2013.
19. P. Lucey, J. F. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews. The Extended Cohn-Kanade dataset (CK+): A complete dataset for action unit and emotion-specified expression. In Proc. of Conf. on Computer Vision and Pattern RecognitionWorkshops (CVPRW), pages 94-101. IEEE, 2010.
20. P. Lucey, J. F. Cohn, K. M. Prkachin, P. E. Solomon, and I. Matthews. Painful data: The UNBC-McMaster shoulder pain expression archive database. In Proc. of Conf. and Workshop on Automatic Face & Gesture Recognition (FG), pages 57-64. IEEE, 2011.
21. H. Meng and N. Bianchi-Berthouze. Affective state level recognition in naturalistic facial and vocal expressions. IEEE Transactions on Cybernetics, 44 (3): 315-328, 2014.
22. S. Nie, Z. Wang, and Q. Ji. A generative restricted Boltzmann machine based method for high-dimensional motion data modeling. Computer Vision and Image Understanding, 2015.
23. S. M. Rabbitt, A. E. Kazdin, and B. Scassellati. Integrating socially assistive robotics into mental healthcare interventions: Applications and recommendations for expanded use. Clinical psychology review, 35: 35-46, 2015.
24. J. M. Rehg et al. Decoding children's social behavior. In Proc. of Conf. on Computer Vision and Pattern Recognition (CVPR), pages 3414-3421. IEEE, 2013.
25. B. Romera-Paredes, A. Argyriou, N. Berthouze, and M. Pontil. Exploiting unrelated tasks in multi-task learning. In International Conference on Artificial Intelligence and Statistics, pages 951-959, 2012.
26. B. Romera-Paredes, H. Aung, N. Bianchi-Berthouze, and M. Pontil. Multilinear multitask learning. In Proceedings of the 30th International Conference on Machine Learning, pages 1444-1452, 2013.
27. O. Rudovic, V. Pavlovic, and M. Pantic. Automatic pain intensity estimation with heteroscedastic conditional ordinal random fields. In Advances in Visual Computing, pages 234-243. Springer, 2013.
28. A. C. Sankaranarayanan, P. K. Turaga, R. G. Baraniuk, and R. Chellappa. Compressive acquisition of dynamic scenes. In Proc. of European Conf. on Computer Vision (ECCV), pages 129-142. Springer, 2010.
29. C. Shan, S. Gong, and P. W. McOwan. Robust facial expression recognition using local binary patterns. In Int. Conf. on Image Processing, volume 2, pages II-370. IEEE, 2005.
30. C. Shan, S. Gong, and P. W. McOwan. Dynamic facial expression recognition using a Bayesian temporal manifold model. In BMVC, pages 297-306, 2006.
31. E. D. Sontag. Nonlinear regulation: The piecewise linear approach. IEEE Transactions on Automatic Control, 26 (2): 346-358, 1981.
32. M. Viberg. Subspace-based methods for the identification of linear time-invariant systems. Automatica, 31 (12): 1835-1851, 1995.
33. Z. Wang, S. Wang, and Q. Ji. Capturing complex spatiotemporal relations among facial muscles for facial expression recognition. In Conf. on Computer Vision and Pattern Recognition (CVPR), pages 3422-3429. IEEE, 2013.
34. M. Zanfir, M. Leordeanu, and C. Sminchisescu. The moving pose: An efficient 3D kinematics descriptor for low-latency action recognition and detection. In Proc. of Int. Conf. on Computer Vision (ICCV), pages 2752-2759. IEEE, 2013.
35. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI), 31 (1): 39-58, 2009.
36. G. Zhao and M. Pietikainen. Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI), 29 (6): 915-928, 2007.
37. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld. Face recognition: A literature survey. Acm Computing Surveys (CSUR), 35 (4): 399-458, 2003.