Automating facial emotion recognition

Web Intelligence

Volumn 17, Issue 1, 2019, Pages 17-27

  Gervasi, Osvaldo ^a   Franzoni, Valentina ^b   Riganelli, Matteo ^c   Tasso, Sergio ^a  

^a UNIVERSITY OF PERUGIA   (Italy)

^b SAPIENZA UNIVERSITY OF ROME   (Italy)

^c NONE   (Italy)

Author keywords

convolutional neural networks; emotion recognition; face detection; Image recognition; machine learning

Indexed keywords

AUGMENTED REALITY; CONVOLUTION; IMAGE RECOGNITION; LEARNING SYSTEMS; MACHINE LEARNING; NEURAL NETWORKS; SPEECH RECOGNITION;

CONVOLUTIONAL NEURAL NETWORK; EMOTION RECOGNITION; FACIAL EMOTIONS; HUMAN EMOTION; MACHINE LEARNING APPROACHES; OPEN-SOURCE LIBRARIES; REAL TIME; VISUAL RECOGNITION;

FACE RECOGNITION;

EID: 85062171971     PISSN: 24056456     EISSN: 24056464     Source Type: Journal    
DOI: 10.3233/WEB-190397     Document Type: Article

References (46)

1. A. Alkuhlani, M. Nassef and I. Farag, Multistage feature selection approach for high-dimensional cancer data, Soft Computing 21(22) (2017), 6895-6906. doi: 10.1007/s00500-016-2439-9.
2. P. Angelov, X. Gu, J.A. Iglesias, A. Ledezema, A. Sanchis, O. Sipele and R. Ramezani, Cybernetics of the mind, learning individual's perceptions autonomously, IEEE Systems, Man, and Cybernetics Magazine 3(2) (2017), 6-17. doi: 10.1109/MSMC.2017.2664478. ISSN: 2333-942X.
3. E. Bastianelli, D. Nardi, L.C. Aiello, F. Giacomelli and N. Manes, Speaky for robots: The development of vocal interfaces for robotic applications, Applied Intelligence 44(1) (2016), 43-66. doi: 10.1007/s10489-015-0695-5.
4. F. Bertola and V. Patti, Emotional responses to artworks in online collections, UMAP Workshops Proceedings 997 (2013).
5. G. Biondi, V. Franzoni, Y. Li and A. Milani, Web-based similarity for emotion recognition in web objects, in: Proceedings of the 9th International Conference on Utility and Cloud Computing, UCC 2016, Shanghai, China, December 6-9, 2016, pp. 327-332. doi: 10.1145/2996890.3007883.
6. Caffe Framework: Github: https://github.com/BVLC/caffe, last visited on Sept 12, 2018.
7. A. Canossa, J. Badler, M.S. El-Nasr and E. Anderson, Eliciting emotions in design of games-a theory driven approach, CEUR Workshop Proceedings 1680 (2016), 34-40.
8. A. Chmiel, J. Sienkiewicz, M. Thelwall, G. Paltoglou, K. Buckley, A. Kappas and J.A. Hołyst, Collective emotions online and their influence on community life, PLoS ONE 6(7) (2011), e22207. doi: 10.1371/journal.pone.0022207.
9. M. Cieliebak, O. Dürr and F. Uzdilli, Potential and limitations of commercial sentiment detection tools, in: CEUR Workshop Proceedings, Vol. 1096, 2013, pp. 47-58.
10. T.F. Cootes, C.J. Taylor, D.H. Cooper and J. Graham, Active shape models-their training and application, Computer Vision and Image Understanding 61(1) (1995), 38-59. doi: 10.1006/cviu.1995.1004.
11. W. Cui, Y. Du, Z. Shen, Y. Zhou and J. Li, Personalized microblog recommendation using sentimental features, in: 2017 IEEE International Conference on Big Data and Smart Computing, BigComp 2017, Art. No. 7881756, 2017, pp. 455-456. doi: 10.1109/BIGCOMP.2017.7881756.
12. N. Eveno, A. Caplier and P.Y. Coulon, Accurate and quasi-automatic lip tracking, IEEE Transactions on Circuits and Systems for Video Technology 14(5) (2004), 706-715. doi: 10.1109/TCSVT.2004.826754. ISSN:1051-8215.
13. V. Franzoni, Autonomous hexapod robot with artificial vision and remote control by myo-electric gestures, Cyber-Physical Systems for Next-Generation Networks (2018), 143-162. doi: 10.4018/978-1-5225-5510-0.ch007.
14. V. Franzoni, A. Chiancone and A. Milani, A multistrain bacterial diffusion model for link prediction, International Journal of Pattern Recognition and Artificial Intelligence 31(11) (2017). doi: 10.1142/S0218001417590248.
15. V. Franzoni and O. Gervasi, Guidelines for web usability and accessibility on the Nintendo Wii, in: Transactions in Computer Science VI, Lecture Notes in Computer Science, Vol. 5730, 2009, pp. 19-40. doi: 10.1007/978-3-642-10649-1_2.
16. V. Franzoni, A. Milani, S. Pallottelli, C.H.C. Leung and Y. Li, Context-based image semantic similarity, in: 12th International Conference on Fuzzy Systems and Knowledge Discovery, FSKD 2015, Art. No. 7382127, 2015, pp. 1280-1284.
17. V. Franzoni, A. Milani and J. Vallverdu, Emotional affordances in human-machine interactive planning and negotiation, in: Proceedings of WI 2017, Workshop on Affective Computing and Emotion Recognition (ACER), 2017, pp. 924-930. doi: 10.1145/3106426.3109421.
18. V. Franzoni, V. Poggioni and F. Zollo, Automated classification of book blurbs according to the emotional tags of the social network, in: Zazie CEUR Workshop Proceedings, Vol. 1096, 2013, pp. 83-94. doi: 10.13140/RG.2.1.3194.7689.
19. O. Gervasi, R. Magni and M. Ferri, A method for predicting words by interpreting labial movements, in: Lecture Notes in Computer Science, ICCSA 2016, Vol. 9787, Springer, Beijing (China) 2016, pp. 450-464. doi: 10.1007/978-3-319-42108-7_34.
20. O. Gervasi, R. Magni and M. Zampolini, Nu!RehaVR: Virtual reality in neuro tele-rehabilitation of patients with traumatic brain injury and stroke, Virtual Reality 14(2) (2010), 131-141. doi: 10.1007/s10055-009-0149-7.
21. O. Gervasi, D. Russo and F. Vella, The AES implantation based on OpenCL for multi/many core architecture, in: 2010 International Conference on Computational Science and Its Applications, Fukuoka, ICCSA 2010, Washington, DC, USA, IEEE Computer Society, 2010, pp. 129-134. doi: 10.1109/ICCSA.2010.44.
22. G.R. Hayes, S. Hirano, G. Marcu, M. Monibi, D.H. Nguyen and M. Yeganyan, Interactive visual supports for children with autism, Personal and Ubiquitous Computing 14(7) (2010), 663-680. doi: 10.1007/s00779-010-0294-8.
23. S. Karayev, M. Trentacoste and H. Han, Recognizing Image Style, University of California Barkley Adobe, 2014, arXiv:1311.3715 [cs.CV].
24. A. Krizhevsky, I. Sutskever and G. Hinton, Imagenet classification with deep convolutional neural networks, in: 25th International Conference on Advance in Neural Information Processing System, 2012, pp. 1106-1114.
25. Y. LeCun, Y. Bengio and G. Hinton, Deep learning, Nature 521 (2015), 436-444. doi: 10.1038/nature14539.
26. V.I. Levenshtein, Binary codes capable of correcting deletions, insertions and reversals, Cibernetics and Control Theory, Soviet Physics Doklady 10 (1966), 707-710.
27. T.W. Lewis and D.M.W. Powers, Lip contour detection techniques based on front view of face, Journal of Global Research in Computer Science 2(5) (2011), 43-46 ISSN: 2229-371X.
28. L. Lombardi, W.R. Butt and M. Grecuccio, Lip tracking towards an automatic lip reading approach, JMPT 5 (2014), 1-11. doi: 10.4236/jmp.2014.51001.
29. Y. Lou, W. Wu, R.-D. Vatavu and W.T. Tsai, Personalized gesture interactions for cyber-physical smart-home environments, Science China Information Sciences 60(7) (2017). doi: 10.1007/s11432-015-1014-7.
30. P.C. Mahalanobis, On the generalised distance in statistics,in, Proceedings of the National Institute of Sciences of India 2(1) (1936), 49-55.
31. M. Mariotti, O. Gervasi, F. Vella, A. Cuzzocrea and A. Costantini, Strategies and systems towards grids and clouds integration: A DBMS-based solution, Future Generation Computer Systems 88 (2018), 718-729. doi: 10.1016/j.future.2017.02.047.
32. M. Neumann, N. Patricia, R. Garnett and K. Kersting, Efficient graph kernels by randomization, in: Lecture Notes in Computer Science, LNAI (PART 1), Vol. 7523, (2012), 378-393. doi: 10.1007/978-3-642-33460-3_30.
33. A. Pantelopoulos and N.G. Bourbakis, A survey on wearable sensor-based systems for health monitoring and prognosis, IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews 40(1) (2010), 5306098.
34. V.M. Patel, R. Gopalan, R. Li, Chellappa and R. Visual, Domain adaptation: A survey of recent advances, IEEE Signal Processing Magazine 32(3) (2015), 53-69. doi: 10.1109/MSP.2014.2347059.
35. K.-C. Peng, T. Chen, A. Sadovnik and A. Gallagher, A mixed bag of emotions: Model, predict, and transfer emotion distributions, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern, 2015, pp. 860-868.
36. I. Phelan, M. Arden, C. Garcia and C. Roast, Exploring virtual reality and prosthetic training, in: 2015 IEEE Virtual Reality Conference, VR 2015-Proceedings, Art. No. 7223441, 2015, pp. 353-354.
37. R.W. Picard, Affective computing: Challenges, International Journal of Human Computer Studies 59(1-2) (2003), 55-64. doi: 10.1016/S1071-5819(03)00052-1.
38. R.W. Picard, E. Vyzas and J. Healey, Toward machine emotional intelligence: Analysis of affective physiological state, IEEE Transactions on Pattern Analysis and Machine Intelligence 23(10) (2001), 1175-1191. doi: 10.1109/34.954607.
39. M. Riganelli, V. Franzoni, O. Gervasi and S. Tasso, EmEx, a tool for automated emotive face recognition using convolutional neural networks, in: ICCSA 2017, Workshop on Emotion Recognition, Lecture Notes in Computer Science, Vol. 10406, 2017, pp. 692-704. doi: 10.1007/978-3-319-62398-6_49.
40. U. Saeed and J.-L. Dugelay, Combining edge detection and region segmentation for lip contour extraction, in: AMDO, 2010, 6th Conference on Articulated Motion and Deformable Objects, Andratx, Mallorca, Spain, July 7-9, 2010, Also published in LNCS, Volume 6169, pp.11-20, 2010.
41. H. Saif, M. Fernandez, Y. He and H. Alani, Evaluation datasets for Twitter sentiment analysis a survey and a new dataset, the STS-Gold, in: CEUR Workshop Proceedings, Vol. 1096, 2013, pp. 9-21.
42. P. Stephane and V. Luc, The M2VTS multimodal face database (release 1.00) audio-and video-based biometric person authentication, in: First International Conference, AVBPA'97 Crans-Montana, Proceedings, Switzerland, March 12-14, 1997, Springer, Berlin Heidelberg 1997, pp. 403-409. ISBN 978-3-540-68425-1. doi: 10.1007/BFb0016021.
43. R. Stiefelhagen, J. Yang and A. Waibel, A model-based gaze tracking system, International Journal of Artificial Intelligence Tools 6(2) (1997), 193-209. doi: 10.1142/S0218213097000116.
44. S. Tasso, S. Pallottelli, M. Rui and A. Laganá, Learning objects efficient handling in a federation of science distributed repositories, in: Lecture Notes in Computer Science, LNCS (PART 1), Vol. 8579, 2014, pp. 615-626. doi: 10.1007/978-3-319-09144-0_42.
45. F. Vella, I. Neri, O. Gervasi and S. Tasso, A simulation framework for scheduling performance evaluation on CPU-GPU heterogeneous system, in: Lecture Notes in Computer Science, ICCSA 2012, Vol. 7336, Springer, 2012, pp. 457-469. doi: 10.1007/978-3-642-31128-4_34.
46. N. Voirin, C. Payet, A. Barrat, C. Cattuto, N. Khanafer, C. Regis, B.-A. Kim, B. Comte, J.-S. Casalegno, B. Lina and P. Vanhems, Combining high-resolution contact data with virological data to investigate influenza transmission in a Tertiary care hospital, Infection Control and Hospital Epidemiology 36(3) (2015), 254-260. doi: 10.1017/ice.2014.53.