Emotion recognition system using short-term monitoring of physiological signals

Medical and Biological Engineering and Computing

Volumn 42, Issue 3, 2004, Pages 419-427

  Kim, Kyung Hwan ^a   Bang, S W ^b   Kim, S R ^b  

^a Yonsei University   (South Korea)

^b Samsung Advanced Institute of Technology (SAIT)   (South Korea)

Author keywords

Autonomic nervous system; Emotion recognition; Physiological signal processing; Support vector machine

Indexed keywords

BIOELECTRIC PHENOMENA; DATABASE SYSTEMS; ELECTROCARDIOGRAPHY; FEATURE EXTRACTION; PHYSIOLOGY; SKIN; TEMPERATURE MEASUREMENT;

EMOTION RECOGNITION SYSTEMS; PHYSIOLOGICAL SIGNALS;

BIOMEDICAL ENGINEERING;

ANALYSIS OF VARIANCE; ANGER; ARTICLE; AUTONOMIC NERVOUS SYSTEM; BODY SURFACE; CHILD; CLUSTER ANALYSIS; COMPUTER SYSTEM; CONTROLLED STUDY; ELECTROCARDIOGRAM; ELECTRODERMAL RESPONSE; EMOTION; EXCITEMENT; EXTRACTION; FEMALE; HUMAN; HUMAN COMPUTER INTERACTION; HUMAN EXPERIMENT; LONELINESS; MALE; MATHEMATICAL COMPUTING; MONITORING; NORMAL HUMAN; PHYSIOLOGY; SIGNAL PROCESSING; SKIN TEMPERATURE; STATISTICAL DISTRIBUTION; STRESS;

AUTONOMIC NERVOUS SYSTEM; CHILD; CHILD, PRESCHOOL; EMOTIONS; HUMANS; MONITORING, PHYSIOLOGIC; RECOGNITION (PSYCHOLOGY); SIGNAL PROCESSING, COMPUTER-ASSISTED; USER-COMPUTER INTERFACE;

EID: 2942731250     PISSN: 01400118     EISSN: None     Source Type: Journal    
DOI: 10.1007/BF02344719     Document Type: Article

References (34)

1. Andreassi, J. L. (2000): 'Psychophysiology: human behavior and physiological response' (Lawrence Erlbaum Associates, New Jersey, 2000)
2. Ark, W., Dryer, D. C., and Lu, D. J. (1999): 'The emotion mouse'. 8th Int. Conf. Human-computer Interaction, pp. 818-823
3. Arkin, R. C., Fujita, M., Takagi, T., and Hasegawa R. (2001): 'Ethological modeling and architecture for an entertainment robot'. IEEE Int. Conf, Robotics & Automation, pp. 453-458
4. Berger, R. D., Akselrod, S., Gordon, D., and Cohen, R. J. (1986): 'An efficient algorithm for spectral analysis of heart rate variability', IEEE Trans. Biomed. Eng., 33, pp. 900-904
5. Bing-Hwang, J., and Furui S. (2000): 'Automatic recognition and understanding of spoken language - a first step toward natural human-machine communication', Proc. IEEE, 88, pp. 1142-1165
6. Boucsein, W. (1992): 'Electrodermal activity' (Plenum Press, New York, 1992)
7. Broersen, P. M. T. (2000a): 'Facts and fiction in spectral analysis', IEEE Trans. Instrum. Meas., 49, pp. 766-772
8. Broersen, P. M. T. (2000b): 'Finite sample criteria for autoregressive order selection', IEEE Trans. Signal Process., 48, pp. 3550-3558
9. Burges, C. J. C. (1998): 'A tutorial on support vector machines for pattern recognition', Knowledge Discov. Data Mining, 2, pp. 1-43
10. Chapelle, O., Haffner, P., and Vapnik, V. N. (1999): 'Support vector machines for histogram-based image classification', IEEE Trans. Neural Netw., 10, pp. 1055-1064
11. Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W, and Taylor, J. G. (2001): 'Emotion recognition in human-computer interaction', IEEE Signal Process. Mag., 18, pp. 32-80
12. Drummond, P. D., and Quah S. H. (2001): 'The effect of expressing anger on cardiovascular reactivity and facial blood flow in Chinese and Caucasians', Psychophysiology, 38, pp. 190-196
13. Duda, R. O., Hart, P. E., and Stork, D. G. (2001): 'Pattern classification', 2nd edn (Wiley, New York, 2001)
14. Fernandez, R., and Picard, R. W (1998): 'Signal processing for recognition of human frustration'. IEEE Int. Conf. Acoustic Speech. Signal Processing, pp. 3773-3776
15. Friedman, B. H., and Thayer, J. F. (1998): 'Autonomic balance revisited: panic anxiety and heart rate variability', J. Psychosom. Res., 44, pp. 133-151
16. Garcia-Gonzales, M. A., and Pallas-Areny, R. A. (2001): 'Novel robust index to assess beat-to-beat variability in heart rate time-series analysis', IEEE Trans. Biomed. Eng., 48, pp. 617-621
17. Haykin, S. (1999): 'Neural networks', 2nd edn (Prentice Hall, New Jersey, 1999)
18. Hirsh, H., Coen, M. H., Mozer, M. C., Hasha, R., and Flanagan, J. L. (1999): 'Room service, AI-style', IEEE Intell. Syst., 14, pp. 8-19
19. Jiang, L., Qing, Z., and Wenyuan, W. (2000): 'A novel approach to analyze the result of polygraph'. IEEE Int. Conf. Systens Man Cybernetics, pp. 2884-2886
20. Kataoka, H., Kano, H., Yoshina, H., Saijo, A., Yasuda, M., and Osumi, M. (1998): 'Development of a skin temperature measuring system for non-contact stress evaluation'. IEEE Ann. Conf. Engineering Medicine Biology Society, pp. 940-943
21. Knerr, S., Personnaz, L., and Dreyfus, G. (1990): 'Single-layer learning revisited: a stepwise procedure for building and training a neural network' in Fogelman, J. (Ed.): 'Neurocomputing: algorithms, archtectures and applications' (Springer-Verlag, Heidelberg, 1990)
22. Lang, P. J., Ohman, A., and Vaitl, D. (1988): 'The international affective picture system (photographic slides)'. Center for Research in Psychophysiology, University of Florida, Gainesville, USA
23. Maragos, R, Kaiser, J. E, and Quatieri T. E (1993): 'On amplitude and frequency demodulation using energy operators', IEEE Trans. Signal Process, 41, pp. 1532-1550
24. McCraty, R., Atkinson, M., Tiller, W. A., Rein, G., and Watkins, A. D. (1995): 'The effects of emotions on short-term power spectrum analysis of heart rate variability', Am. J. Cardiol., 76, pp. 1089-1093
25. Phan, K. L., Wagner, T., Taylor, S. F., and Liberzon, I. (2002): 'Functional neuroanatomy of emotion: a meta-analysis of emotion activation studies in PET and fMRI', Neuroimage, 16, pp. 331-348
26. Picard, R. W (1995): Affective computing' (MIT Press, Cambridge, 1995)
27. Picard, R. W., and Healey, J. (1998): 'Digital processing of affective signals', IEEE Int. Conf. Acoustic Speech Signal Processing, pp. 3749-3752
28. Picard, R. W., Vyzas, E., and Healey, J. (2001): 'Toward machine emotional intelligence: analysis of affective physiological state', IEEE Trans, Pattern Anal. Mach. Intell., 23, pp. 1175-1191
29. Pinna, G. D., Maestri, R., and Sanarico, M. (1996): 'Effects of record length selection on the accuracy of spectral estimates of heart rate variability', IEEE Trans. Biomed. Eng., 43, pp. 754-757
30. Shusterman, V., and Barnea, O. (1995): 'Analysis of skin-temperature variability compared to variability of blood pressure and heart rate', IEEE Ann. Conf. Engineering Medicine Biology Society, pp. 1027-1028
31. Tefas, A., Kotropoulos, C., and Pitas, I. (2001): 'Using support vector machines to enhance the performance of elastic graph matching for frontal face authentication', IEEE Trans. Pattern Anal. Mach. Intell., 23, pp. 735-746
32. Vapnik, V. N. (1999): 'An overview of statistical learning theory', IEEE Trans. Neural Netw., 10, pp. 988-999
33. Wang, F., Sagawa, K., and Inooka, H. (1998): 'Time domain heart rate variability index for assessment of dynamic stress', Comput. Cardiol., pp. 97-100
34. Yang, G., Lee, K., Lee, J., Choi, J., Bang, S., Kim, J., Lee, H., and Sohn, J. (2000): 'Development of emotion induction protocol for children', Ann. Conf. Society for Emotion and Sensibility of Korea, pp. 20-25