Physiological signals and their use in augmenting emotion recognition for human–machine interaction

Cognitive Technologies

Volumn , Issue 9783642151835, 2011, Pages 133-159

  Knapp, R Benjamin ^a   Kim, Jonghwa ^b   André, Elisabeth ^b  

^a QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

^b UNIVERSITY OF AUGSBURG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

PATTERN RECOGNITION; PHYSIOLOGY;

CENTRAL NERVOUS SYSTEMS; EMOTION RECOGNITION; EMOTIONAL STATE; HUMAN PHYSIOLOGY; MULTI-MODAL; PHYSIOLOGICAL MEASUREMENT; PHYSIOLOGICAL SIGNALS; STATE OF THE ART;

BIOMEDICAL SIGNAL PROCESSING;

EID: 84860682326     PISSN: 16112482     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-642-15184-2_9     Document Type: Chapter

References (47)

1. Bradley MM, Lang PJ (2007) “Emotion and motivation#x201D; in handbook of psychophysiology. Cambridge University Press, Cambridge, MA, pp 582-607
2. Cacioppo JT, Berntson GG, Larsen JT, Poehlmann KM, Ito TA (2000) The psychophysiology of emotion. In: Lewis M, Haviland-Jones JM (eds) Handbook of emotions. Guilford Press, New York, NY, pp 173-191
3. Cacioppo JT, Bush LK, Tassinary LG (1992) Microexpressive facial actions as a function of affective stimuli: replication and extension. Pers Soc Psychol Bull 18:515-526
4. Cacioppo JT, Gardner WL (1999) Emotion. Annu Rev Psychol 50:191-214
5. Cacioppo JT, Tassinary LG, Bernston GG (eds) (2007) Handbook of psychophysiology, 3rd edn. Cambridge University Press, Cambridge, MA
6. Cannon WB (1927) The James-Lange theory of emotions: a critical examination and an alternative theory. Am J Psychol 39:106-127
7. Center for the Study of Emotion and Attention [CSEA-NIMH] (1995) The international affective picture system: digitized photographs. Center for Research in Psychophysiology, University of Florida, Gainesville, FL
8. Chanel G, Kronegg J, Grandjean D, Pun T (2006) Emotion assessment: arousal evaluation using EEG’s and peripheral physiological signals. In: MRCS06, Istanbul, pp 530-537
9. Conati C, Chabbal R, Maclaren H (2003) A study on using biometric sensors for detecting user emotions in educational games. In: 3rd workshop on affective and attitude user modeling, Pittsburgh, PA, Jun 2003
10. Costaa T, Rognonib E, Galati D (2006) EEG phase synchronization during emotional response to positive and negative film stimuli.Neurosci Lett 406(3):159-164
11. Cowie R, Douglas-Cowie E, Tsapatsoulis N, Votsis G, Kollias S, Fellenz W, Taylor JG (2001) Emotion recognition in human-computer interaction. IEEE Signal Process Mag 18:32-80
12. Ebner-Priemer UW, Kubiak T (2007) Psychological and psychophysiological ambulatory monitoring, a review of hardware and software solutions. Eur J Psychol Assess 23(4):214-227
13. Haag A, Goronzy S, Schaich P, Williams J (2004) Emotion recognition using bio-sensors: first steps towards an automatic system. In: Affective dialogue systems. Lecture Notes in Computer Science, 2004, vol 3068/2004, pp 36-48, DOI: 10.1007/978-3-540-24842-24
14. Harata K, Kawakami M, O’Rourke M (2006) Pulse wave analysis and pulse wave velocity: a review of blood pressure interpretation 100 years after Korotkov.Circ J 70(10):1231-1239
15. Holmes A, Vuilleumierb P, Eimera M (2003) The processing of emotional facial expression is gated by spatial attention: evidence from event-related brain potentials. Cogn Brain Res 16: 174-184
16. Hudlicka E (2003) To feel of not to feel: the role of affect in human-computer interaction. Int J Hum Comput Stud 59:1-32
17. James W (1890) The principles of psychology. Holt, New York, NY
18. Jennett S (1989) Human physiology. Churchill Livingstone, Edinburgh
19. Karekla M, Forsyth JP, Kelly MM (2004) Emotional avoidance and panicogenic responding to a biological challenge procedure. Behav Ther 35(4):725-746
20. Kim J, André E (2006) Emotion recognition using physiological and speech signal in shortterm observation. In: Perception and interactive technologies, LNCS, Springer-Verlag, Berlin Heidelberg, vol 4021/2006, pp 53-64
21. Kim J, André E, Rehm M, Vogt T, Wagner J (2005) Integrating information from speech and physiological signals to achieve emotional sensitivity. In: Proceedings of the 9th European conference on speech communication and technology, Lisbon, Portugal, 4-8 September 2005
22. Kim KH, Bang SW, Kim SR (2004) Emotion recognition system using short-term monitoring of physiological signals. Med Biol Eng Comput 42:419-427
23. Knapp RB, Cook PR (2005) The integral music controller: introducing a direct emotional interface to gestural control of sound synthesis. In: Proceedings of the international computer music conference (ICMC), Barcelona, Spain, 4-9 Sept 2005
24. Knapp RB, Lusted HS (1990) A bioelectric controller for computer music applications. Comput Music J 14(1):42-47
25. Knapp RB, Lusted HS (2005) Designing a biocontrol interface for commercial and consumer mobile applications: effective control within ergonomic and usability constraints. In: Proceedings of the 11th international conference on human computer interaction, Las Vegas, NV, 22-27 Jul 2005
26. Kreibig SD, Wilhelm FH, Roth WT, Gross JJ (2007) Cardiovascular, electrodermal, and respiratory response patterns to fear-and sadness-inducing films. Psychophysiology 44:787-806
27. Kunzmann U, Gruhn D (2005) Age differences in emotional reactivity: the sample case of sadness. Psychol Aging 20:47-59
28. LaCourse JR, Hludik FC (1990) An eye movement communication-control system for the disabled. IEEE Trans Biomed Eng 37:1215-1220
29. Lusted HS, Knapp RB (1996) Controlling computers with neural signals. Sci Am 275(4):82-87
30. Lykken DT (1998) A tremor in the blood: uses and abuses of the lie detector. McGraw-Hill, New York, NY
31. Morris M, Dishongh T, Guilak F (2008) Apparatus for monitoring physiological, activity, and environmental data. USPTO Application #: 2008 0154098.2006
32. Nakra TM (2000) Inside the conductor’s jacket: analysis, interpretation, and musical synthesis of expressive gesture. MIT Media Laboratory Perceptual Computing Section Technical report no. 518
33. Nasoz F, Alvarez K, Lisetti C, Finkelstein N (2003) Emotion recognition from physiological signals for presence technologies. Int J Cogn Technol Work Spec Issue Presence 6:1
34. National Research Council (2003) The polygraph and lie detection. Committee to review the scientific evidence on the polygraph. Division of Behavioural and Social Science and Education. The National Academic Press, Washington, DC
35. Noh YS, Park SJ, Park SB, Yoon HR (2007) A novel approach to classify significant ECG data based on heart instantaneous frequency and ECG-derived respiration using conductive textiles. In: Proceedings of the 29th annual international conference of the IEEE EMBS, 22-26 Aug 2007, pp 1503-1506
36. Patmore DW, Knapp RB (1995) A cursor controller using evoked potentials and EOG. In: Proceedings of the RESNA ‘95 annual conference, Vancouver, 9-14 Jun 1995, pp 702-704
37. Phan KL, Wager TD, Taylor SF, Liberzon I (2004) Functional neuroimaging studies of human emotions. CNS Spectr 9:258-266
38. Picard RW, Healey J (1997) Affective wearables.Pers Technol 1(4):231-240
39. Picard R, Vyzas E, Healy J (2001) Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans Pattern Anal Mach Intell 23(10):1175-1191
40. Putnam WL, Knapp RB (1993) Real-time computer control using pattern recognition of the electromyogram. In: Proceedings of the IEEE international conference on biomedical engineering, San Diego, CA, 27-29 Oct 1993, pp 1236-1237
41. Russell JA (2003) Core affect and the psychological construction of emotion. Psychol Rev 110(1):145-172
42. Sebastiani L, Simoni A, Gemignani A, Ghelarducci B, Santarcangelo EL (2003) Human hypnosis: autonomic and electroencephalographic correlates of a guided multimodal cognitive-emotional imagery. Neurosci Lett 338(1):41-44
43. Schupp HT, Junghofer M, Weike AI, Hamm AO (2003) The selective processing of briefly presented affective pictures: an ERP analysis. Psychophysiology 41:441-449
44. Sloan DM (2004 November) Emotion regulation in action: emotional reactivity in experiential avoidance. Behav Res Therapy 42(11):1257-1270
45. Wagner J, Kim J, André E (2005) From physiological signals to emotions: implementing and comparing selected methods for feature extraction and classification. In: ICME’05, Amsterdam, Jul 2005
46. Webster JG (eds) (1998) Medical instrumentation, application and design, 3rd edn. Wiley, New York, NY
47. Wolpaw JR, Ramoser H, McFarland DJ, Pfurtscheller G (1998) EEG-based communication: improved accuracy by response verification. IEEE Trans Rehabil Eng 6(3):326-333