Physiological signals based human emotion recognition: A review

Proceedings - 2011 IEEE 7th International Colloquium on Signal Processing and Its Applications, CSPA 2011

Volumn , Issue , 2011, Pages 410-415

  Jerritta, S ^a   Murugappan, M ^a   Nagarajan, R ^a   Wan, Khairunizam ^a  

^a UNIVERSITY MALAYSIA PERLIS   (Malaysia)

Author keywords

Emotion; Inducement Stimuli; Physiological signals; Signal Processing Techniques

Indexed keywords

CLASSIFICATION RATES; DATA SAMPLE; EMOTION; EMOTION RECOGNITION; EMOTIONAL STATE; FACIAL IMAGES; HUMAN EMOTION; HUMAN EMOTION RECOGNITION; INDEPENDENT SYSTEMS; INDUCEMENT STIMULI; INTELLIGENT SIGNAL PROCESSING; NEURO-IMAGING; PHYSIOLOGICAL SIGNALS; SIGNAL PROCESSING TECHNIQUES; SMOOTH INTERFACE; STATE OF RESEARCH; USER-DEPENDENT;

HUMAN COMPUTER INTERACTION; INTERFACES (COMPUTER); MAN MACHINE SYSTEMS; RESEARCH; SIGNAL PROCESSING;

PHYSIOLOGY;

EID: 79957439131     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CSPA.2011.5759912     Document Type: Conference Paper

References (46)

1. W. R. Picard, "Affective computing: challenges," International Journal of Human-Computer Studies - Application of affective computing in human - Computer interaction, vol. 59, pp. 55-64, 2003.
2. E. Bal, E. Harden, D. Lamb, A. Van Hecke, J. Denver, and S. Porges, "Emotion Recognition in Children with Autism Spectrum Disorders: Relations to Eye Gaze and Autonomic State," Journal of Autism and Developmental Disorders, vol. 40, pp. 358-370,2009.
3. Y. Demazeau, F. Dignum, J. Corchado, J. Bajo, R. Corchuelo, E. Corchado, F. Fernández-Riverola, V. Julián, P. Pawlewski, A. Campbell, R. Martínez, K. de Ipiña, E. Irigoyen, N. Asla, N. Garay, A. Ezeiza, and I. Fajardo, "Emotion Elicitation Oriented to the Development of a Human Emotion Management System for People with Intellectual Disabilities," in Trends in Practical Applications of Agents and Multiagent Systems. vol. 71: Springer Berlin / Heidelberg, pp. 689-696,2010.
4. L. Kessous, G. Castellano, and G. Caridakis, "Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis," Journal on Multimodal User Interfaces, vol. 3, pp. 33-48,2009.
5. O. Kaynak, E. Alpaydin, E. Oja, L. Xu, A. Raouzaiou, S. Ioannou, K. Karpouzis, N. Tsapatsoulis, S. Kollias, and R. Cowie, "An Intelligent Scheme for Facial Expression Recognition," in Artificial Neural Networks and Neural Information Processing - ICANN/ICONIP 2003. vol. 2714: Springer Berlin / Heidelberg, pp. 182-182,2003.
6. P. Cheonshu, R. Jungwoo, S. Joochan, and C. Hyunkyu, "An Emotion Expression System for the Emotional Robot," in IEEE International Symposium on Consumer Electronics, 2007. ISCE 2007., pp. 1-6,2007.
7. P. Rani and N. Sarkar, " A New Approach to Implicit Human-Robot Interaction Using Affective Cues, ," Mobile Robots: towards New Applications, Aleksandar Lazinica (Ed.),I-Tech Education and Publishing,2006.
8. B. Apolloni, R. Howlett, L. Jain, K.-B. Sim, I.-H. Jang, and C.-H. Park, "The Development of Interactive Feature Selection and GA Feature Selection Method for Emotion Recognition," in Knowledge-Based Intelligent Information and Engineering Systems. vol. 4694: Springer Berlin / Heidelberg, pp. 73-81,2007.
9. K. Kim, S. Bang, and S. Kim, "Emotion recognition system using short-term monitoring of physiological signals," Medical and Biological Engineering and Computing, vol. 42, pp. 419-427, 2004.
10. K. Jonghwa and E. Ande, "Emotion Recognition Based on Physiological Changes in Music Listening,", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, pp. 2067-2083, 2008.
11. P. C. Petrantonakis and L. J. Hadjileontiadis, "Emotion Recognition from Brain Signals Using Hybrid Adaptive Filtering and Higher Order Crossings Analysis," IEEE Transactions on affective computing, vol. 1, pp. 81-97, 2009.
12. "www.thefreedictionary.com/emotion," in The free dictionary.
13. "http://en.wikipedia.org/wiki/Emotion," in Wiki.
14. P. Ekman and W. V. Friesen, "Universals and Cultural Differences in the Judgments of Facial Expressions of Emotion," Journal of Personality and Social Psychology, vol. 53, pp. 712-714, 1987.
15. P. J. Lang, "The Emotion Probe: Studies of Motivation and Attention," American Psychologist, vol. 50, pp. 372-385, 1995.
16. C. Peter and A. Herbon, "Emotion representation and physiology assignments in digital systems," Interacting with Computers, vol. 18, pp. 139-170, 2006.
17. P. Rani, C. Liu, N. Sarkar, and E. Vanman, "An empirical study of machine learning techniques for affect recognition in human-robot interaction," Pattern Analysis & Applications, vol. 9, pp. 58-69, 2006.
18. T. Gross, J. Gulliksen, P. Kotzé, L. Oestreicher, P. Palanque, R. Prates, M. Winckler, G. van der Vloed, and J. Berentsen, "Measuring Emotional Wellbeing with a Non-intrusive Bed Sensor," in Human-Computer Interaction - INTERACT 2009. vol. 5727: Springer Berlin / Heidelberg, pp. 908-911,2009.
19. C. L. Bethel, K. Salomon, R. R. Murphy, and J. L. Burke, "Survey of Psychophysiology Measurements Applied to Human-Robot Interaction," in Robot and Human interactive Communication, 2007. RO-MAN 2007. The 16th IEEE International Symposium on 26-29 Aug. 2007, pp. 732-737,2007.
20. E. Fernandez-Egea, E. Parellada, F. Lomeña, C. Falcon, J. Pavia, A. Mane, G. Horga, and M. Bernardo, "FDG PET study of amygdalar activity during facial emotion recognition in schizophrenia," European Archives of Psychiatry and Clinical Neuroscience, vol. 260, pp. 69-76,2010.
21. S. Blain, A. Mihailidis, and T. Chau, "Assessing the potential of electrodermal activity as an alternative access pathway," Medical Engineering and Physics, vol. 30, pp. 498-505, 2008.
22. D. Kulic and E. A. Croft, "Affective State Estimation for Human-Robot Interaction," IEEE Transactions on Robotics, vol. 23, pp. 991-1000, 2007.
23. M. Smith, G. Salvendy, and S.-H. Jeong, "Suggestion of Methods for Understanding User's Emotional Changes While Using a Product," in Human Interface and the Management of Information. Methods, Techniques and Tools in Information Design. vol. 4557: Springer Berlin / Heidelberg, pp. 59-67,2007.
24. R. W. Picard, E. Vyzas, and J. Healey, "Toward machine emotional intelligence: analysis of affective physiological state," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, pp. 1175-1191, 2001.
25. G. Rigas, C. D. Katsis, G. Ganiatsas, and D. I. Fotiadis, "A User Independent, Biosignal Based, Emotion Recognition Method," in Proceedings of the 11th international conference on User Modeling Corfu, Greece: Springer-Verlag, 2007.
26. E. André, L. Dybkjae r, W. Minker, P. Heisterkamp, A. Haag, S. Goronzy, P. Schaich, and J. Williams, "Emotion Recognition Using Biosensors: First Steps towards an Automatic System," in Affective Dialogue Systems. vol. 3068: Springer Berlin / Heidelberg, pp. 36-48, 2004.
27. L. Lan and C. Ji-hua, "Emotion Recognition Using Physiological Signals from Multiple Subjects," in International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2006. IIH-MSP '06., pp. 355-358, 2006.
28. F. Nasoz, K. Alvarez, C. Lisetti, and N. Finkelstein, "Emotion recognition from physiological signals using wireless sensors for presence technologies," Cognition, Technology & Work, vol. 6, pp. 4-14, 2004.
29. G. Chanel, J. J. M. Kierkels, M. Soleymani, and T. Pun, "Short-term emotion assessment in a recall paradigm," International Journal of Human-Computer Studies, vol. 67, pp. 607-627, 2009.
30. J. J. Gross and R. W.Levenson, "Emotion Elicitation using Films," Cognition and Emotion, vol. 9, pp. 87-108, 1995.
31. C. D. Katsis, N. Katertsidis, G. Ganiatsas, and D. I. Fotiadis, "Toward Emotion Recognition in Car-Racing Drivers: A Biosignal Processing Approach," IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans vol. 38, pp. 502-512, 2008.
32. C. Chuan-Yu, Z. Jun-Ying, and W. Chi-Jane, "Based on Support Vector Regression for emotion recognition using physiological signals, "International Joint Conference on in Neural Networks (IJCNN), pp. 1-7,2010.
33. Z. Cong and M. Chetouani, "Hilbert-Huang transform based physiological signals analysis for emotion recognition," International Symposium on in Signal Processing and Information Technology (ISSPIT), pp. 334-339,2009.
34. L. M. Regan and M. S. Atkins, "A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies," Int. J. Hum.-Comput. Stud., vol. 65, pp. 329-347, 2007.
35. Cheng, B. Liu, and Guangyuan, "Emotion Recognition from Surface EMG Signal Using Wavelet Transform and Neural Network," in The 2nd International Conference on Bioinformatics and Biomedical Engineering, 2008. ICBBE 2008. Shanghai, China, pp. 1363-1366, 2008.
36. X. Zhu, "Emotion Recognition of EMG Based on BP Neural Network," in Proceedings of the Second International Symposium on Networking and Network Security (ISNNS '10) Jinggangshan, P. R. China, pp. 227-229, 2010.
37. Z. Long, G. Liu, and X. Dai, "Extracting Emotional Features from ECG by Using Wavelet Transform," in International Conference on Biomedical Engineering and Computer Science (ICBECS), 2010 Wuhan, pp. 1-4, 2010.
38. B.-C. Chien, T.-P. Hong, S.-M. Chen, M. Ali, Y. Mohammad, and T. Nishida, "Measuring Naturalness during Close Encounters Using Physiological Signal Processing," in Next-Generation Applied Intelligence. vol. 5579: Springer Berlin / Heidelberg, pp. 281-290,2009.
39. F. Honig, J.Wagner, A. Batliner, and E.Noth, "Classification of user states with physiological signals: On-line Generic features vs. Specialized feature sets," in 17th European Signal Processing Conference 2009 Glasgow, Scotland, pp. 2357-2361, 2009.
40. E. Leon, G. Clarke, F. Sepulveda, and V. Callaghan, "Optimised attribute selection for emotion classification using physiological signals," 26th Annual International Conference of the IEEE in Engineering in Medicine and Biology Society, IEMBS '04, pp. 184-187,2004.
41. C. Maaoui and A. Pruski, "Emotion Recognition through Physiological Signals for Human-Machine Communication," in Cutting Edge Robotics 2010, Vedran Kordic (Ed.), 2010.
42. MIT AUBT Database, "http://affect.media.mit.edu/share-data.php. "
43. Y. Gu, S.-L. Tan, K.-J. Wong, M.-H. R. Ho, and L. Qu, "A biometric signature based system for improved emotion recognition using physiological responses from multiple subjects,"in 8th IEEE International Conference on Industrial Informatics (INDIN), 2010 Osaka, 2010.
44. W. Wan-Hui, Q. Yu-Hui, and L. Guang-Yuan, "Electrocardiography Recording, Feature Extraction and Classification for Emotion Recognition," in WRI World Congress on Computer Science and Information Engineering Los Angeles, CA, 2009.
45. J. Kim, "Bimodal Emotion Recognition using Speech and Physiological Changes," Robust Speech Recognition and Understanding, pp. 265-280, 2007.
46. H. Gunes, "Automatic Dimensional and Continuous Emotion Recognition " International Journal of Synthetic Emotions, vol. 1, pp. 68-99, 2010.