EEG-based emotion recognition in music listening

IEEE Transactions on Biomedical Engineering

Volumn 57, Issue 7, 2010, Pages 1798-1806

  Lin, Yuan Pin ^a   Wang, Chi Hong ^b   Jung, Tzyy Ping ^c   Wu, Tien Lin ^a   Jeng, Shyh Kang ^a   Duann, Jeng Ren ^d,e   Chen, Jyh Horng ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b CARDINAL TIEN HOSPITAL   (Taiwan)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF CALIFORNIA SAN DIEGO   (United States)

^e CHINA MEDICAL UNIVERSITY HOSPITAL   (Taiwan)

Author keywords

EEG; emotion; machine learning; music

Indexed keywords

BRAIN; ELECTRODES; ELECTROENCEPHALOGRAPHY; LEARNING SYSTEMS;

BRAIN ACTIVITY; CLASSIFICATION ACCURACY; CLINICAL APPLICATION; EMOTION RECOGNITION; EMOTIONAL STATE; MACHINE LEARNING ALGORITHMS; MACHINE-LEARNING; NON-INVASIVE ASSESSMENTS; PRACTICAL SYSTEMS; SUPPORT VECTOR;

LEARNING ALGORITHMS;

ACCURACY; ADULT; ANGER; ARTICLE; CONTROLLED STUDY; ELECTRODE; ELECTROENCEPHALOGRAPHY; EMOTION; FEMALE; FRONTAL LOBE; HUMAN; HUMAN EXPERIMENT; LEARNING ALGORITHM; MACHINE LEARNING; MALE; MUSIC; NORMAL HUMAN; PARIETAL LOBE; SUPPORT VECTOR MACHINE; ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BAYES THEOREM; EVOKED AUDITORY RESPONSE; PHYSIOLOGY; PROCEDURES; PSYCHOLOGY; SIGNAL PROCESSING;

ADULT; ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; ELECTRODES; ELECTROENCEPHALOGRAPHY; EMOTIONS; EVOKED POTENTIALS, AUDITORY; FEMALE; HUMANS; MALE; MUSIC; PATTERN RECOGNITION, AUTOMATED; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 77953784197     PISSN: 00189294     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBME.2010.2048568     Document Type: Article

References (38)

1. D. Wu, C. Y. Li, and D. Z. Yao, "Scale-free music of the brain," PLoS One, vol.4, no.6, p. e5915, Jun. 15, 2009.
2. J.Kim and E.Andre, "Emotion recognition using physiological and speech signal in short-term observation," in Proc. Percept. Interactive Technol., 2006, vol.4021, pp. 53-64.
3. J. Kim and E. Andre, "Emotion recognition based on physiological changes in music listening," IEEE Trans. Pattern Anal. Mach. Intell., vol.30, no.12, pp. 2067-2083, Dec. 2008.
4. K. H. Kim, S. W. Bang, and S. R. Kim, "Emotion recognition system using short-term monitoring of physiological signals," Med. Biol. Eng. Comput., vol.42, no.3, pp. 419-427, May 2004.
5. R. W. Picard, E. Vyzas, and J. Healey, "Toward machine emotional intelligence: Analysis of affective physiological state," IEEE Trans. Pattern Anal. Mach. Intell., vol.23, no.10, pp. 1175-1191, Oct. 2001.
6. D.Mantini, M. G. Perrucci, C. Del Gratta, G. L. Romani, and M. Corbetta, "Electrophysiological signatures of resting state networks in the human brain," Proc. Nat. Acad. Sci. USA, vol.104, no.32, pp. 13170-13175, Aug. 2007.
7. J. J. B. Allen, J. A. Coan, andM. Nazarian, "Issues and assumptions on the road from raw signals to metrics of frontal EEG asymmetry in emotion," Biol. Psychol., vol. 67, no. 1/2, pp. 183-218, Oct. 2004.
8. L. A. Schmidt and L. J. Trainor, "Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions," Cognit. Emotion, vol.15, no.4, pp. 487-500, 2001.
9. W. Heller, "Neuropsychological mechanisms of individual differences in emotion, personality and arousal," Neuropsychology, vol.7, pp. 476-489, 1993.
10. M. Sarlo, G. Buodo, S. Poli, and D. Palomba, "Changes in EEG alpha power to different disgust elicitors: The specificity of mutilations," Neurosci. Lett., vol.382, no.3, pp. 291-296, Jul. 2005.
11. L. I. Aftanas, N. V. Reva, A. A. Varlamov, S. V. Pavlov, and V. P.Makhnev, "Analysis of evoked EEG synchronization and desynchronization in conditions of emotional activation in humans: Temporal and topographic characteristics," Neurosci. Behav. Physiol., vol.34, no.8, pp. 859-867, 2004.
12. D. Sammler, M. Grigutsch, T. Fritz, and S. Koelsch, "Music and emotion: Electrophysiological correlates of the processing of pleasant and unpleasant music," Psychophysiology, vol.44, no.2, pp. 293-304, Mar. 2007.
13. D. J. L. Schutter, P. Putman, E. Hermans, and J. van Honk, "Parietal electroencephalogram beta asymmetry and selective attention to angry facial expressions in healthy human subjects," Neurosci. Lett., vol. 314, no. 1/2, pp. 13-16, Nov. 2001.
14. M. Balconi and C. Lucchiari, "Consciousness and arousal effects on emotional face processing as revealed by brain oscillations. A gamma band analysis," Int. J. Psychophysiol., vol.67, no.1, pp. 41-46, Jan. 2008.
15. E. Basar, C. Basar-Eroglu, S. Karakas, and M. Schurmann, "Oscillatory brain theory: A new trend in neuroscience-The role of oscillatory processes in sensory and cognitive functions," IEEE Eng. Med. Biol. Mag., vol.18, no.3, pp. 56-66, May/Jun. 1999.
16. K. Ishino and M. Hagiwara, "A feeling estimation system using a simple electroencephalograph," in Proc. IEEE Int. Conf. Syst., Man Cybern., 2003, vol.5, pp. 4204-4209.
17. K. Takahashi, "Remarks on emotion recognition from bio-potential signals," in Proc. 2nd Int. Conf. Auton. Robots Agents, Dec. 13-15, 2004, pp. 186-191.
18. G. Chanel, J. Kronegg, D. Grandjean, and T. Pun, "Emotion assessment: Arousal evaluation using EEG's and peripheral physiological signals," Multimedia Content Representation, Classification Secur., vol.4105, pp. 530-537, 2006.
19. A. Heraz, R. Razaki, and C. Frasson, "Using machine learning to predict learner emotional state from brainwaves," in Proc. 7th IEEE Int. Conf. Adv. Learning Technol., 2007, pp. 853-857.
20. G. Chanel, J. J. M. Kierkels, M. Soleymani, and T. Pun, "Short-term emotion assessment in a recall paradigm," Int. J. Human-Comput. Stud., vol.67, no.8, pp. 607-627, Aug. 2009.
21. K. E. Ko, H. C. Yang, and K. B. Sim, "Emotion recognition using EEG signals with relative power values and bayesian network," Int. J. Control Autom. Syst., vol.7, no.5, pp. 865-870, Oct. 2009.
22. Q. Zhang and M. H. Lee, "Analysis of positive and negative emotions in natural scene using brain activity and GIST," Neurocomputing, vol.72, no.4-6, pp. 1302-1306, Jan. 2009.
23. J. A. Russell, "A circumplex model of affect," J. Pers. Soc. Psychol., vol.39, no.6, pp. 1161-1178, 1980.
24. T. L.Wu and S.K. Jeng, "Probabilistic estimation of a novelmusic emotion model," in Proc. 14th Int. Multimedia Model. Conf., Kyoto, Japan, 2008, pp. 487-497.
25. R. Cowie, E. Douglas-Cowie, S. Savvidou, E. McMahon, M. Sawey, and M. Schröder, "'FEELTRACE': An instrument for recording perceived emotion in real time," in Proc. ISCA Workshop Speech Emotion, 2000, pp. 19-24.
26. Y. P. Lin, C. H. Wang, T. L. Wu, S. K. Jeng, and J. H. Chen, "Multilayer perceptron for EEG signal classification during listening to emotional music," in Proc. IEEE Int. Region 10 Conf., Taipei, Taiwan, 2007, pp. 1- 3.
27. Y. P. Lin, C. H. Wang, T. L. Wu, S. K. Jeng, and J. H. Chen, "Support vector machine for EEG signal classification during listening to emotional music," in Proc. IEEE Int. Workshop Multimedia Signal Process., Queensland, Australia, 2008, pp. 127-130.
28. Weka, Data Mining: Practical Machine Learning Tools and Techniques, 2nd ed. San Francisco, CA: Morgan Kaufmann, 2005.
29. C. C. Chang and C. J. Lin. (2001). LIBSVM: A library for support vector machines [Online]. Available: Software available at http://www.csie.ntu.edu.tw/? cjlin/libsvm
30. Y.W. Chen andC. J.Lin, "CombiningSVMswith various feature selection strategies," in Feature Extraction, Foundations and Applications. New York: Springer-Verlag, 2006.
31. R. Palaniappan, "Utilizing gamma band to improve mental task based brain-computer interface design," IEEE Trans. Neural Syst. Rehabil. Eng., vol.14, no.3, pp. 299-303, Sep. 2006.
32. E. Altenmuller, K. Schurmann, V. K. Lim, and D. Parlitz, "Hits to the left, flops to the right: Different emotions during listening to music are reflected in cortical lateralisation patterns," Neuropsychologia, vol.40, no.13, pp. 2242-2256, 2002.
33. S. K. Sutton and R. J. Davidson, "Prefrontal brain electrical asymmetry predicts the evaluation of affective stimuli," Neuropsychologia, vol.38, no.13, pp. 1723-1733, 2000.
34. R. J. Davidson, "What does the prefrontal cortex "Do" in affect: Perspectives on frontal EEG asymmetry research," Biol. Psychol., vol. 67, no. 1/2, pp. 219-233, Oct. 2004.
35. P. E. Andrade and J. Bhattacharya, "Brain tuned to music," J. R. Soc. Med., vol.96, no.6, pp. 284-287, Jun. 2003.
36. J. Bhattacharya and H. Petsche, "Phase synchrony analysis of EEG during music perception reveals changes in functional connectivity due to musical expertise," Signal Process., vol.85, no.11, pp. 2161-2177, Nov. 2005.
37. C. D. Tsang, L. J. Trainor, D. L. Santesso, S. L. Tasker, and L. A. Schmidt, "Frontal EEG responses as a function of affective musical features," Biol. Found. Music, vol.930, pp. 439-442, 2001.
38. S. Khalfa, D. Schon, J. L. Anton, and C. Liegeois-Chauvel, "Brain regions involved in the recognition of happiness and sadness in music," Neuroreport, vol.16, no.18, pp. 1981-1984, Dec. 2005.