Deep learning for facial expression recognition: A step closer to a smartphone that knows your moods

2017 IEEE International Conference on Consumer Electronics, ICCE 2017

Volumn , Issue , 2017, Pages 217-220

  Bazrafkan, Shabab ^a   Nedelcu, Tudor ^a   Filipczuk, Pawel ^b   Corcoran, Peter ^a  

^a NATIONAL UNIVERSITY OF IRELAND   (Ireland)

^b FotoNation Inc   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); DEEP NEURAL NETWORKS; FACE RECOGNITION; LEARNING SYSTEMS; PATTERN RECOGNITION;

CLASSIFICATION ACCURACY; FACIAL EXPRESSION CLASSIFICATION; FACIAL EXPRESSION RECOGNITION; FACIAL EXPRESSIONS; HAND HELD DEVICE; MOOD DETECTION; PROCESSING POWER; ROBUST NETWORK;

DEEP LEARNING;

EID: 85016179744     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCE.2017.7889290     Document Type: Conference Paper

References (23)

1. V. Pejovic and M. Musolesi, "Anticipatory mobile computing: A survey of the state of the art and research challenges," ACM Comput. Surv., vol. 47, no. 3, pp. 1-29, 2015.
2. R. Rana, M. Hume, J. Reilly, R. Jurdak, and J. Soar, "Opportunistic and Context-Aware Affect Sensing on Smartphones," IEEE Pervasive Comput., vol. 15, no. 2, pp. 60-69, 2016.
3. M. El Ayadi, M. S. Kamel, and F. Karray, "Survey on speech emotion recognition: Features, classification schemes, and databases," Pattern Recognit., vol. 44, no. 3, pp. 572-587, 2011.
4. C. N. Anagnostopoulos, T. Iliou, and I. Giannoukos, "Features and classifiers for emotion recognition from speech: a survey from 2000 to 2011," Artif. Intell. Rev., vol. 43, no. 2, pp. 155-177, 2012.
5. R. Rana, R. Jurdak, X. Li, and J. Soar, "Emotion Classification from Noisy Speech-A Deep Learning Approach," arXiv Prepr. arXiv, 2016.
6. J. Sung and D. Kim, "Pose-Robust Facial Expression Recognition Using View-Based 2D + 3D AAM," Syst. Man Cybern. Part A Syst. Humans, IEEE Trans., vol. 38, no. 4, pp. 852-866, 2008.
7. I. Bacivarov and P. Corcoran, "Facial expression modeling using component AAM models-Gaming applications," in Games Innovations Conference, International IEEE Consumer Electronics Societys. (ICEGIC 2009), 2009, pp. 1-16.
8. G. Mancini, S. Agnoli, B. Baldaro, P. E. R. Bitti, and P. Surcinelli, "Facial expressions of emotions: recognition accuracy and affective reactions during late childhood.," J. Psychol., vol. 147, no. 6, pp. 599-617, 2013.
9. S. L. Happy and A. Routray, "Automatic facial expression recognition using features of salient facial patches," IEEE Trans. Affect. Comput., vol. 6, no. 1, pp. 1-12, 2015.
10. L. Ding and A. M. Martinez, "Features versus context: An approach for precise and detailed detection and delineation of faces and facial features.," Pattern Anal. Mach. Intell. IEEE Trans., vol. 32, no. 11, pp. 2022-38, Nov. 2010.
11. I. Bacivarov, "Advances in the Modelling of Facial Sub-Regions and Facial Expressions using Active Appearance Techniques," National Uinversity of Ireland Galway, 2009.
12. O. Rudovic, M. Pantic, and I. Patras, "Coupled Gaussian processes for pose-invariant facial expression recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 6, pp. 1357-1369, 2013.
13. M. Liu, S. Li, S. Shan, and X. Chen, "AU-inspired Deep Networks for Facial Expression Feature Learning," Neurocomputing, vol. 159, no. 1, pp. 126-136, 2015.
14. C.-H. Hjortsjö, Mans face and mimic language. Studen litteratur, 1969.
15. P. Liu, S. Han, Z. Meng, and Y. Tong, "Facial Expression Recognition via a Boosted Deep Belief Network," 2014 IEEE Conf. Comput. Vis. Pattern Recognit., pp. 1805-1812, 2014.
16. C. Shan, S. Gong, and P. W. McOwan, "Facial expression recognition based on local binary patterns: A comprehensive study," Image Vis. Comput., vol. 27, no. 6, pp. 803-816, 2009.
17. U. Tariq, K.-H. Lin, Z. Li, X. Zhou, Z. Wang, V. Le, T. S. Huang, X. Lv, and T. X. Han, "Emotion recognition from an ensemble of features," in Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, 2011, pp. 872-877.
18. Y. Hu, Z. Zeng, L. Yin, X. Wei, X. Zhou, and T. S. Huang, "Multi-view facial expression recognition," in Automatic Face & Gesture Recognition, 2008. FG08. 8th IEEE International Conference on, 2008, pp. 1-6.
19. Y. Wu, Z. Wang, and Q. Ji, "Facial feature tracking under varying facial expressions and face poses based on restricted boltzmann machines," Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 1, pp. 3452-3459, 2013.
20. I. Song, H. J. Kim, and P. B. Jeon, "Deep learning for real-time robust facial expression recognition on a smartphone," Dig. Tech. Pap.-IEEE Int. Conf. Consum. Electron., pp. 564-567, 2014.
21. O. Langner, R. Dotsch, G. Bijlstra, D. H. J. Wigboldus, S. T. Hawk, and A. van Knippenberg, "Presentation and validation of the Radboud Faces Database," Cogn. Emot., vol. 24, no. 8, pp. 1377-1388, 2010.
22. P. Lucey, J. F. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews, "The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression," in 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, 2010, pp. 94-101.
23. M. Lyons, S. Akamatsu, M. Kamachi, and J. Gyoba, "Coding facial expressions with gabor wavelets," in Automatic Face and Gesture Recognition, 1998. Proceedings. Third IEEE International Conference on, 1998, pp. 200-205.