Multimodal user state recognition in a modern dialogue system

Lecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science)

Volumn 2821, Issue , 2003, Pages 591-605

  Adelhardt, J ^a   Shi, R ^a   Frank, C ^a   Zeissler V ^a   Batliner, A ^a   Noth E ^a   Niemann, H ^a  

^a NONE   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION; DEMODULATION; EIGENVALUES AND EIGENFUNCTIONS; INFORMATION ANALYSIS; MATHEMATICAL MODELS; NEURAL NETWORKS; ARTIFICIAL INTELLIGENCE; DATA MINING; FACE RECOGNITION; HIDDEN MARKOV MODELS; HUMAN COMPUTER INTERACTION; MARKOV PROCESSES; SEMANTICS; SPEECH PROCESSING;

DIALOGUE SYSTEM; HUMAN-MACHINE DIALOGUE; MODALITIES; MODALITY FUSION; DISCRETE HIDDEN MARKOV MODEL; FACIAL EXPRESSION CLASSIFICATION; GESTURE ANALYSIS; INPUT MODALITIES; NON-VERBAL INFORMATION; SEMANTIC CONTENT; STATE RECOGNITION;

HUMAN COMPUTER INTERACTION; SPEECH RECOGNITION;

EID: 9444265238     PISSN: 03029743     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1007/978-3-540-39451-8_43     Document Type: Conference Paper

References (27)

1. Batliner, A., Fischer, K., Huber, R., Spilker, J., Nöth, E.: How to Find Trouble in Communication. Speech Communication 40 (2003) 117-143
2. Pieraccini, R., Caskey, S., Dayanidhi, K., Carpenter, B., Phillips, M.: Etude, A Recursive Dialog Manager with Embedded User Interface Patterns. In: Automatic Speech Recognition and Understanding Workshop. (2001)
3. Lemon, O., Bracy, A., Gruenstein, A., Peters, S.: Information States in a Multimodal Dialouge System for Human-Robot Conversation Bi-Dialog. In: 5th Workshop on Formal Semantics and Pragmatics of Dialogue. (2001) 57-67
4. Wahlster, W., Reithinger, N., Blocher, A.: Smartkom: Multimodal Communication with a Life-Like Character. In: Eurospeech 2001. (2001) 1547-1550
5. Chai, D., Ngan, K.: Locating Facial Regions of a Head-and-Shoulders Color Image. In: Automatic Face and Gesture Recognition 2000. (1998) 124-129
6. Heisele, B., Poggio, T., Pontil, M.: Face Detection in Still Gray Images. In: MIT AI Memo, AIM-1687. (2000)
7. Yang, M., Ahuja, M., Kriegman, D.: Face Detection using a Mixture of Factor Analyzers. In: Proceedings of the International Conference on Image Processing. Volume 3. (1999) 612-616
8. Jones, M., Rehg, J.: Statistical Color Models with Application to Skin Detection. In: Proceedings of Computer Vision and Pattern Recognition. (1999) 1:274-280
9. Ekman, P., Friesen, W.: The Facial Action Coding System: A technique for the measurement of facial movement. In: Consulting Psychologists Press, Palo Alto, CA. (1978)
10. Tian, Y., Kanade, T., Cohn, J.: Recognizing Action Units for Facial Expression Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 23 (2001) 97-115
11. Essa, I., Pentland, A.: Facial Expression Recognition Using a Dynamic Model and Motion Energy. In: Proceedings of the Fifth International Conference on Computer Vision. (1995) 360-367
12. Turk, M., Pentland, A.: Face Recognition Using Eigenfaces. In: Proceedings of Computer Vision and Pattern Recognition. (1991) 586-591
13. Yambor, W., Draper, B., Beveridge, J.: Analyzing PCA-based Face Recognition Algorithms: Eigenvector Selection and Distance Measures. In: Second Workshop on Empirical Evaluation Methods in Computer Vision. (2000)
14. Moghaddam, B., Pentland., A.: Face Recognition Using View-Based and Modular Eigenspaces. In: Vismod, TR-301. (1994)
15. Li, Y., Zhao, Y.: Recognizing Emotions in Speech Using Short-term and Long-term Features. In: Proceedings of the International Conference on Spoken Language Processing. Volume 6., Sydney (1998) 2255-2258
16. 0-Contours in Emotional Speech. In: Proc. 14th Int. Congress of Phonetic Sciences. Volume 2., San Francisco (1999) 929-932
17. Batliner, A., Huber, R., Niemann, H., Nöth, E., Spilker, J., Fischer, K.: The Recognition of Emotion. [27] 122-130
18. Batliner, A., Buckow, A., Niemann, H., Nöth, E., Warnke, V.: The Prosody Module. [27] 106-121
19. Kompe, R.: Prosody in Speech Understanding Systems. Lecture Notes for Artificial Intelligence. Springer-Verlag, Berlin (1997)
20. Riedmiller, M., Braun, H.: A Direct Adaptive Method for Faster Backpropagation Learning: The RPROP Algorithm. In: Proc. of the IEEE Intl. Conf. on Neural Networks, San Francisco, CA (1993) 586-591
21. Huber, R., Nöth, E., Batliner, A., Buckow, A., Warnke, V., Niemann, H.: You BEEP Machine - Emotion in Automatic Speech Understanding Systems. In: TSD98, Brno (1998) 223-228
22. Maggioni, C.: Gesture computer-new ways of operating a computer. In: Proceedings of the International Conference on Automatic Face and Gesture Recognition. (1995) 166-171
23. Rabiner, L., Juang, B.: An Introduction to Hidden Markov Models. ASSP 3 (1986) 4-16
24. Rabiner, L., Juang, B.: Fundamentals of Speech Recognition, first edn. Prentice Hall PTR (1993)
25. Rabiner, L.: A Tutorial on Hidden Markov Models and selected applications in speech recognition. In: Proceedings of IEEE. Volume 77. (1989) 257-286
26. Martinez, A., Benavente., R.: The AR Face Database. In: CVC Technical Report Nr. 24. (1998)
27. Wahlster, W., ed.: Verbmobil: Foundations of Speech-to-Speech Translations. Springer, Berlin (2000)