A facial expression based continuous emotional state monitoring system with GPU acceleration

2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013

Volumn , Issue , 2013, Pages

  Cheng, Jinkuang ^a   Deng, Yangdong ^a   Meng, Hongying ^b   Wang, Zhihua ^a  

^a TSINGHUA UNIVERSITY   (China)

^b BRUNEL UNIVERSITY   (United Kingdom)

Author keywords

affective computing; dimension model of emotion; facial expression; GPU; pattern recognition

Indexed keywords

AFFECTIVE COMPUTING; AUTOMATIC DETECTION; COMPUTING COMPLEXITY; DIMENSION MODEL OF EMOTION; FACIAL EXPRESSIONS; GPU; GPU ACCELERATIONS; PERSONAL BEHAVIOR;

HUMAN COMPUTER INTERACTION; PATTERN RECOGNITION;

MONITORING;

EID: 84881488221     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FG.2013.6553811     Document Type: Conference Paper

References (30)

1. S. Gaulin and D. McBurney, "Evolutionary psychology". Prentice Hall. Chapter 6, pages 121-142, 2003.
2. R. Picard , Affective computing, MIT Press, Cambridge. 1997.
3. M. El Ayadi, M. S. Kamel, and F. Karray. "Survey on speech emotion recognition: Features, classification schemes, and databases". Pattern Recognition, 44(3): 572-587, 2011.
4. M. Pantic and L. J.M. Rothkrantz. "Automatic analysis of facial expressions: The state of the art". IEEE Transactions on Pattern Analysis and Machine Intelligence, 22: 1424-1445, 2000.
5. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang. "A survey of affect recognition methods: Audio, visual, and spontaneous expressions". IEEE Trans. Pattern Anal. Mach. Intell., 31(1): 39-58, 2009.
6. A. Kleinsmith, N. Bianchi-Berthouze, and A. Steed. "Automatic recognition of non-acted affective postures". IEEE Transactions on Systems, Man and Cybernetics, Part B., 2011.
7. R. L. Mandryk, K. M. Inkpen and T. W. Calvert, "Using psychophysiological techniques to measure user experience with entertainment technologies". Behaviour & IT, 25(2): 141-158, 2006.
8. M. Valstar, B. Jiang, M. Méhu, M. Pantic and K. Scherer, "The First Facial Expression Recognition and Analysis Challenge", in Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, 2011
9. B. Schuller, M. Valstar, F. Eyben, G. McKeown, R. Cowie, and M. Pantic, "AVEC 2011-The first international audio/visual emotion challenge", International Conference on Affective Computing and Intelligent Interaction 2011 (ACII 2011), Oct. 2011.
10. B. Schuller, M. Valstar, F. Eyben, R. Cowie, M. Pantic: "AVEC 2012-The Continuous Audio/Visual Emotion Challenge, Proc. Second International Audio/Visual Emotion Challenge and Workshop (AVEC 2012)", Grand Challenge and Satellite of ACM ICMI 2012, ACM, Santa Monica, CA, 22-26.10.2012.
11. H. Gunes and B. Schuller, "Categorical and Dimensional Affect Analysis in Continuous Input: Current Trends and Future Directions", Image and Vision Computing, 2012.
12. F. Eyben, M. Wollmer, M. Valstar, H. Gunes, B. Schuller, and M. Pantic, "String-based audiovisual fusion of behavioural events for the assessment of dimensional affect", Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (FG'11), Santa Barbara, CA, USA, March 2011.
13. M. Nicolaou, H. Gunes, and M. Pantic, "Output-associative RVM regression for dimensional and continuous emotion prediction", Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (FG'11), Santa Barbara, CA, USA, March 2011.
14. H. Meng and N. Bianchi-Berthouze, "Naturalistic affective expression classification by a multi-stage approach based on Hidden Markov Models". 1st International Audio/Visual Emotion Challenge and Workshop (AVEC 2011), LNCS 6975: 378-387, 2011.
15. J. Nicolle, V. Rapp, K. Bailly, L. Prevost and M. Chetouani, "Robust continuous prediction of human emotions using multiscale dynamic cues", Proc. Second International Audio/Visual Emotion Challenge and Workshop (AVEC 2012), Grand Challenge and Satellite of ACM ICMI 2012.
16. R. Kaliouby and P. Robinson, "Real-time inference of complex mental states from facial expressions and head gestures", Real-Time Vision for Human-Computer Interaction, Springer, 181-200, 2005.
17. M. E. Hoque, J. Hernandez, R. Picard, "Mood Meter: Large-Scale and Long-Term Smile Monitoring System", ACM SIGGRAPH Emerging Technologies, August 2012.
18. Y. Deng, B. Wang and S. Mu. "Taming irregular EDA applications on GPUs". Proceedings of the International Conference on Computer-Aided Design, 539-546, 2009.
19. J. Kong and Y. Deng, "GPU Accelerated Face Detection," International Conference on Intelligent Control and Information Processing, 2010.
20. J. Fung, "Advances in GPU-based Image Processing and Computer Vision". ACM SIGGRAPH, 2009.
21. B. Catanzaro, N. Sundaram, K. Keutzer. "Fast Support Vector Machine Training and Classification on Graphics Processors". Proceedings of International Conference on Machine Learning (ICML), 104-111, 2008.
22. M.S.M.Yik, J.A. Russell, L. Feldman-Barrett, "Structure of selfreported current affect: Integration and beyond". Journal of Personality and Social Psychology, 77, 600-619, 1999.
23. H. Meng, B. Romera-Paredes and N. Bianchi-Berthouze, "Emotion recognition by two view SVM-2K classifier on dynamic facial expression features", Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (FG'11), pages 854-859, Santa Barbara, CA, USA, 2011.
24. T. Ojala, M. Pietikinen, and D. Harwood. "A comparative study of texture measures with classification based on featured distributions". Pattern Recognition, 29(1): 51-59, 1996.
25. T. Ojala, M. Pietikainen, and T. Maenpaa. "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns". IEEE Transactions on Pattern Analysis and Machine Intelligence, 24: 971-987, 2002.
26. G. Zhao and M. Pietikainen. "Dynamic texture recognition using local binary patterns with an application to facial expressions". IEEE Transactions on Pattern Analysis and Machine Intelligence, 29: 915-928, June 2007.
27. W.T. Freeman and M. Roth. "Orientation histograms for hand gesture recognition". International Workshop on Automatic Face and Gesture Recognition, pages 296-301, 1994.
28. C. Yang, R. Duraiswami and L. Davis. "Fast multiple object tracking via a hierarchical particle filter". Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05), Volume 1, pages 212-219, Washington, DC, USA, 2005.
29. KV, NSmith, Accelerating MATLAB with CUDA Using MEX Files, NVIDIA Corporation White Paper, 2007.
30. R. Cowie, E. Douglas-Cowie, S. Savvidou, E. McMahon, M. Sawey, M. Schroder, "Feeltrace: An instrument for recording perceived emotion in real time". Proc. of ISCA Workshop on Speech and Emotion. pages 19-24. Belfast, UK, 2000.