An investigation on visual and audiovisual stimulus based emotion recognition using EEG

International Journal of Medical Engineering and Informatics

Volumn 1, Issue 3, 2009, Pages 342-356

  Murugappan, M ^a   Juhari, Mohd Rizon Bin Mohammed ^a,b   Nagarajan, Ramachandran ^a,b   Yaacob, Sazali ^a,b  

^a UNIVERSITY MALAYSIA PERLIS   (Malaysia)

^b School of Mechatronics Engineering   (Malaysia)

Author keywords

EEG; Electroencephalogram; Human emotions; Neural network; Wavelet transform; WT

Indexed keywords

ADULT; ANGER; ARTICLE; AUDITORY STIMULATION; BIOSENSOR; ELECTROENCEPHALOGRAM; EMOTION; FEMALE; HAPPINESS; HUMAN; HUMAN EXPERIMENT; MALE; NERVE CELL NETWORK; NORMAL HUMAN; SIGNAL PROCESSING; VISUAL STIMULATION; WAVEFORM;

EID: 70349658287     PISSN: 17550653     EISSN: 17550661     Source Type: Journal    
DOI: 10.1504/IJMEI.2009.022645     Document Type: Article

References (42)

1. Barreto, A.B., Scargle, S.D. and Adjouadi, M. (2000) 'A practical EMG based human-computer interface for users with motor disabilities', Journal of Rehabilitation Research and Development, Vol.37, No.1, pp.53-64.
2. Caifeng, S., Shaoganh, G. and Peter, W.M. (2007) 'Beyond facial expression: learning human emotion from body gestures', CD ROM Proceedings of British Machine Vision Conference.
3. Carlos, B., Zhigang, D., Serdar, Y., Murtaza, B., Chul, M.L., Abe, K., Sungbok, L., Ulrich, N. and Shrikanth, N. (2004) 'Analysis of emotion recognition using facial expressions, speech and multimodal information', Proceedings of International Conference on Multimodal Interfaces, Pennsylvania, USA.
4. Chanel, G., Karim, A.A. and Pun, T. (2007) 'Valence-arousal evaluation using physiological signals in an emotion recall paradigm', IEEE Proceedings on Systems, Man and Cybernetics, pp.2662-2667.
5. Charles, W.A. and Zlatko, S. (1997) 'Classification of EEG signals from four subjects during five mental tasks', IEEE Proceedings on Engineering Application in Neural Networks, pp.407-414.
6. Chethan, P. and Cox, M. (2002) 'Frequency characteristics of wavelets', IEEE Transactions on Power Delivery, Vol.17, No.3, pp.800-804.
7. Chih, F.C., Joe, A.J., Ming, J.C. and Ren, G.L. (2006) 'Wavelet-based processing and adaptive fuzzy clustering for automated long-term polysomnography analysis', IEEE Proceedings on Acoustics, Speech, and Signal Processing, Vol.2, pp.1176-1179.
8. Christine, L. and Fatma, N. (2004) 'Using non-invasive wearable computers to recognize human emotions from physiological signals', Journal on Applied Signal Processing, EURASIP, pp. 1672-1687.
9. Curran, E., Sykacek, P., Stokes, M., Roberts, S.J., Penny, W., Johnsrude, I. and Owen, A.M. (2003) 'Cognitive tasks for driving a brain-computer interfacing system: a pilot study', IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol.12, No.1, pp.48-54. (Pubitemid 38332781)
10. Davidson, R.J. and Tomarken, A.J. (1989) 'Laterality and emotion: an electrophysiological approach', in F. Boiler and J. Grafman (Eds.): Handbook of Neurophysiology, Amsterdam, Elsevier, Vol.3, pp.419-441.
11. DA-Zeng and Ming-Hu, H. (2004) 'Applications of wavelet transform in medical image processing', IEEE Proce on Machine Learning and Cybernatics, Vol.3, pp.1816-1821.
12. Fabiani, G.E., McFarland, DJ., Wolpaw, J.R. and Pfurtscheller, G. (2004) 'Conversion of EEG activity into cursor movement by a brain-computer interface (BCI)', IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol.12, No.3, pp.331-338.
13. Fukuda, O., Tsuji, T., Kaneko, M. and Otsuka, A. (2003) 'A human-assisting manipulator teleoperated by EMG signals and arm motions', IEEE Transactions on Robotics and Automation, Vol.19, No.2, pp.210-222.
14. Glassman, E.L. (2005) 'A wavelet-like filter based on neuron action potentials for analysis of human scalp electroencephalographs', IEEE Transactions on Biomedical Engineering, Vol.52,No. 11, pp. 1851-1862.
15. He Sheng, L., Xiaorong, G., Fusheng, Y. and Shangkai, G. (2003) 'Imagined hand movement identification based on Spatio-Temporak pattern recognition of EEG', IEEE Proceedings on EMBS, pp.599-602.
16. Kazuhiko, T. (2004) 'Remarks on emotion recognition from bio-potential signals', 2nd International Conference on Autonomous Robots and Agents, New Zealand, pp. 186-191.
17. Kazuhiko, T. and Kashiyama, T. (2005) 'Remarks on multimodal non-verbal interface and its application to controlling mobile roboť, Proceedings of the 2005 IEEE International Conference on Mechatronics and Automation, pp.999-1004.
18. Kazuhiko, T., Takashi, N. and Masafumi, H. (2006) Remarks on Hands-Free Manipulation System Using Simple Brain-Computer Interface, pp.295-300.
19. Kuno, Y., Yagi, T. and Uchikawa, Y. (1997) 'The development of the robot controlling system using EOG', Proceedings of 7th International Conference on Human-Computer Interaction, p.44.
20. Kyoung, C. and Sasaki, M. (2003) 'Brain-wave bio potentials based mobile robot control: wavelet neural network pattern recognition approach', Proceedings of IEEE Systems, Man, and Cybernetics, pp.322-328.
21. LaCourse, J.R. and Wilson, E. (1995) 'Brainiac: a brain-computer link', Proceedings of the IEEE Instrumentation and Measurement Technology Conference, pp.587-592.
22. Mahdi, K. and Mehran, J. (2007) 'Real-time intelligent pattern recognition algorithm for surface EMG signals', Transactions on Biomedical Engineering, pp. 1-12.
23. Millan, J.R., Mourino, J., Marciani, M.G., Babiloni, F., Topani, F., Canale, L., Heikkonen, J. and Kaski, K. (1998) 'Adaptive brain interfaces for physically-disabled people', Proceedings of 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.
24. Murugappan, M., Rizon, M., Nagarajan, R., Sazali, Y., Hazry, D. and Zunaidi, I. (2008a) 'Time-frequency analysis of EEG signals for human emotion detection', Book Chapter, IFMBE Proceedings, Vol.21, pp.262-265, Springer.
25. Murugappan, M., Rizon, M., Nagarajan, R., Sazali, Y., Hazry, D. and Zunaidi, I. (2008b) 'Lifting scheme for human emotion recognition using EEG', Int. Symposium on Information Technology, Vol.2, pp. 1-7.
26. Oliver, R. and Vetterli, M. (1991) 'Wavelets and signal processing', IEEE Signal Processing Magazine, pp.14-38.
27. Palaniappan, R. (2005) 'Brain computer interface design using band powers extracted during mental tasks', IEEE Proceedings on EMBS, Vol.5, pp.321-324.
28. Qin, S. and Ji, Z. (2004) 'Multi-resolution time-frequency analysis for detection of rhythms of EEG signals', IEEE Proceedings on Signal Processing, Vol.4, pp.338-341.
29. Robert, H., Dragos, D. and Leon, J.M.R. (2008) 'Emotion recognition using brain activity', Int. Conference on Computer Systems and Technologies, pp.II. 1.1-II. 1.5.
30. Roussell, C.A. and Gustafson, S.G. (2001) 'Selecting salient features of psychophysiological measures', AFRL-HE-WP-TR.
31. Rumelhart, D.E. and MccCelland, J.L. (1986) Parallel Distributed Processing: Exploration in the Microstructure of Cognition, Vol.1, MIT Press, Cambridge, MA.
32. Science Daily (2002) Designing a Robot that Can Sense Human Emotions, Technical report on Science Daily, 16 December 2002.
33. Science Daily (2008) Emotional Robots: Software Empowers Robots To Learn When a Person is Sad, Happy or Angry, Technical report on Science Daily, 28 July 2008.
34. Stephane, G.M. (1989) 'A theory for multiresolution signal decomposition: the wavelet representation', IEEE Transactions on Pattern Anal. & Mach. Intelligence, Vol.11, No.7, pp.674-693.
35. Wagner, J., Kim, J. and Andre, E. (2005) 'From physiological signals to emotions: implementing and comparing selected methods for feature extraction and classification', IEEE Signal Processing Magazine, pp.32-35.
36. Walpaw, J.R. and McFarland, D.J. (1994) 'Multichannel EEG-based brain computer communication', Electrocephalography and Clinical Neurophysiology, Vol.90, pp.444-449.
37. Wei-Xing, H., Xiang-Guo, Y., Xiao-Ping, C and Hui, L. (2005) 'Non-linear feature extraction of sleeping EEG signals', Proceedings of Engineering in Medicine and Biology, pp.4614-4617.
38. Williams, M. and Kirsch, R (2005) 'Feasibility of electroculography as a command interface for a high tetraplegia neural prosthesis', The 10th Annual Conference of the International Functional Electrical Stimulation Society.
39. Yang, Y. and Zhou, J. (2005) 'Recognition and analyses of EEG & ERP signals related to emotion: from the perspective of psychology', IEEE Proceedings on Neural Interface and Control, pp.96-99.
40. Danny, O.B. (2008) EEG-based Emotion Recognition, available at http://www.home.ewi.utwente.nl
41. Nervus® available at www.nervus.nl
42. WRC available at http://www.wordsworthcentre.co.uk.