Emotion recognition in human-computer interaction

IEEE Signal Processing Magazine

Volumn 18, Issue 1, 2001, Pages 32-80

  Corive, R ^a   Douglas Cowie, E ^a   Tsapatsoulis, N ^a   Votsis, G ^a   Kollias, S ^a   Fellenz, W ^a   Taylor, J G ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER SIMULATION; DATABASE SYSTEMS; HYBRID COMPUTERS; NUMERICAL METHODS; SPEECH ANALYSIS; SPEECH RECOGNITION;

EMOTION DETECTION SYSTEMS;

HUMAN COMPUTER INTERACTION;

EID: 85032751766     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/79.911197     Document Type: Article

References (202)

1. Speakers and hearers are people: Reflections on speech deterioration as a consequence of acquired deafness
2. Accommodation theory: Optimal levels of convergence
3. Prosody and conversation
4. Prosodic signs of emotion in speech: Preliminary results from a new technique for automatic statistical analysis
5. Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies
6. Automatic statistical analysis of the signal and prosodic signs of emotion in speech
7. Acoustic profiles in vocal emotion expression
8. International settings as markers of discourse units in telephone conversations
9. Synthesizing emotions in speech: Is it time to get excited?
10. Improvising linguistic style: Social and affect bases for agent personality
11. Communicative theory of emotions: Empirical tests, mental models & implications for social interaction
12. Vocal affect expression: A review and a model for future research
13. On the nature and function of emotion: A component process approach
14. Towards a cognitive theory of emotions
15. Basic Emotions
16. The dictionary of affect in language
17. Affect theory
18. If it's not left it's right
19. Acquisition of emotions in adulthood
20. A Japanese emotion: Amae
21. Emotion talk across times
22. Pitch and intensity characteristics of stage speech
23. An experimental study of the pitch characteristics of the voice during the expression of emotion
24. A phonophotographic study of trained and untrained voices reading factual and dramatic material
25. Communicating emotion: The role of prosodic features
26. Toward the simulation of emotion in synthetic speech: A review of the literature on human vocal emotion
27. Some aspects of fundamental frequency, envelope amplitude and the emotional content of speech
28. Attitudinal meanings conveyed by intonational contours
29. Evidence for independent function of intonation contour type, voice quality, and F0 in signaling speaker affect
30. Vocal cues to speaker affect: Testing two models
31. The communication of meanings by content-free speech
32. Vocal pitch during simulated emotion
33. Recent experimental investigations of pitch in speech
34. An experimental study of the durational characteristics of the voice during the expression of emotion
35. Content-free speech as a source of information about the speaker
36. Transcriptions of prosodic and paralinguistic features of emotional speech
37. Prosodic signs of emotion in speech: Preliminary results from a new technique for automatic statistical analysis
38. Multiresolution techniques and emotional speech
39. Hybrid systems for feature to symbol extraction
40. A comparison of recent several methods of fundamental frequency estimation
41. Extraction of precise fundamental frequency based on harmonic structure of speech
42. Comparison of fundamental frequency and perturbation measurements among 3 analysis systems
43. Model based speech pause detection
44. Syllable detection in read and spontaneous speech
45. Syllable segmentation of continuous speech with artificial neural networks
46. PhoneticaUy motivated acoustic parameters for continuos speech recognition using neural networks
47. Preprocessing and neural classification of the English stops [b, d, g, p, t, k]
48. A Rasta-PLP and TDNN based automatic system for recognizing stop consonants: Performance studies
49. Perceptual and acoustic correlates of voice qualities
50. A novel approach to the estimation of voice source and vocal tract parameters from speech signals
51. Objective voice parameters to characterise the emotional content in speech
52. On stress and linguistic rhythm
53. A statistical timing model for French
54. Role of fundamental frequency in signalling linguistic stress and affect: Evidence for a dissociation
55. On the analysis of prosodic turn-taking cues
56. The role of the left prefontal cortex in language and memory
57. Measuring facial expressions by computer image analysis
58. Subtly different facial expression recognition and emotion expression intensity estimation
59. An iterative image registration technique with an application to stereo vision
60. A specific neural substrate for perceiving facial expressions of disgust
61. A vision system for observing and extracting facial action parameters
62. Impaired auditory recognition of fear and anger following bilateral amygdala lesions
63. Face recognition using a hybrid supervised/unsupervised neural network
64. Image warping using few anchor points and radial functions
65. Categorical perception and semantic information processing of facial expressions
66. Analysis and synthesis of facial image sequences using physical and anatomical models
67. 3-D motion estimation in model-based facial image coding
68. Recognition of facial expression from optical flow
69. Representing face images for emotion classification
70. Categorical perception in facial emotion classification
71. Sexnet: A neural net identifies sex from human faces
72. Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face
73. Determining optical flow
74. Optical flow using spatiotemporal filters
75. Binocular motion stereo using MAP estimation
76. A computational framework and an algorithm for the measurement of visual motion
77. Computing spatio-temporal representations of human faces
78. On the use of radon transform for facial expression recognition
79. Recognizing human facial expressions from long image sequences using optical flow
80. The robust estimation of optical flow
81. Optical flow estimation using wavlet motion model
82. Facial expression recognition from image sequence using hidden Markov model
83. Recognition of facial expressions using HMM with continuous output probabilities
84. Recognizing multiple persons' facial expressions using HMM based on automatic extraction of frames from image sequences
85. Recognizing human facial expressions
86. Human emotion recognition from motion using a radial basis fianction network architecture
87. Face to virtual face
88. Coding, analysis, interpretation and recognition of facial expressions
89. Tracking facial motion
90. Physically-based modeling for graphics and vision
91. Animating facial expression
92. Facial expression recognition using HMM with observation dependent transition matrix
93. Tracking faces
94. Multi-modal tracking of faces for video communications
95. Multi-modal system for locating heads and faces
96. Listen: A system for locating and tracking individual speakers
97. Face locating and tracking for human computer interaction
98. Motion regulization for model-based head tracking
99. Color-based tracking of image regions with changes in geometry and illumination
100. Automatic face detecxion in natural scene images using a skin color model and moments
101. Tracking and segrnenting people in varying lighting conditions using color
102. Tracking and learning graphs on image sequences of faces
103. Affine face tracking using a wavelet network
104. An investigation into face pose distributions
105. Real-time visual recognition of facial gestures for HCI
106. Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding
107. Face and facial feature extraction from color images
108. Edge and keypoint detection in facial regions
109. An attentional processing strategy to detect and analyse the prominent facial regions
110. Learning pararneterized models of image motion
111. A highly efficient system for automatic face region detection in MPEG video sequences
112. An analytic to holistic approach for face recognition based on a single frontal view
113. Confidence estimation and on-line retraining of neural networks
114. Test material format and availability
115. Pictures of Facial Affect
116. Are artificial neural nets as smart as a rat?
117. A new method of investigating the perception of prosodic features
118. On determining the emotional state of pilots during flight: An exploratory study
119. Ueber beziehung von sprachmelodie und lautstarke
120. Changes of the voice expression during suggestively influenced states of experiencing
121. Acoustic correlates of the emotional content of vocalized speech
122. Experimentelle untersuchungen zur stimmlichen darstellung von gefuehlen
123. Emotions, voice and music
124. Emotions and speech: Some acoustic correlates
125. Emotional patterns in intonation and music
126. The identification of the mood of a speaker by hearing impaired listeners
127. Die melodie als faktor des emotionellen ausdrucks
128. Relations between prosodic variables and emotions in normal American English utterances
129. Identification of emotional states using perceptual and acoustic analyses
130. Communication of affects by single vowels
131. Recognition of emotion from vocal cues
132. Voice quality in depression
133. Relationship between emotional state and fundamental frequency of speech
134. Emotional changes in human voice
135. Voice quality profile and perceived emotion
136. An acoustical/temporal analysis of emotional stress in speech
137. Changing emotional tone in dialogue and its prosodic correlates
138. On defining attitude theory: Once more with feeling
139. Quantitative description and differentiation of fundamental frequency contours
140. Nonlinguistic indicators of emotion and psychopathology
141. Vocal timing in face-to-face interactions of clinically depressed and nondepressed mothers and the 4-month-old infants
142. Speech characteristics as indicators of depressive illness
143. The prosodic correlates of expressive reading
144. The dynamics of facial expression judgment
145. The neuropsychology of facial expression: A review of neurological and psychological mechanisms for producing facial expressions
146. Cognitive determinants of emotion
147. Appraisals of emotion-eliciting events: Testing a theory of discrete emotions
148. What a neural net needs to know about emotion words
149. The validity of polygraph testing: Scientific analysis and public controversy
150. The psychological differentiation between fear and anger in humans
151. ToBI: A standard for labelling English prosody
152. A combination of vocal F0 dynamic and summary features discriminates between pragmatic categories of infant-directed speech
153. The generation of affect in synthesised speech