On the use of multimodal cues for the prediction of degrees of involvement in spontaneous conversation

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2011, Pages 1541-1544

  Oertel, Catharine ^a   Scherer, Stefan ^b   Campbell, Nick ^a  

^a TRINITY COLLEGE DUBLIN   (Ireland)

^b UNIVERSITY OF ULM   (Germany)

Author keywords

Blinking; Gaze; Involvement; Multimodality; Spontaneous speech

Indexed keywords

BLINKING; GAZE; INVOLVEMENT; MULTI-MODALITY; SPONTANEOUS SPEECH;

SUPPORT VECTOR MACHINES;

FORECASTING;

EID: 84865727950     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. C. Oertel, C. De Looze, S. Scherer, A. Windmann, and P. Wagner, "Towards the automatic detection of involvement in conversation," in accepted at: The Proceedings of the SSPnet-COST 2102 PINK International Conference. Springer, 2011.
2. C. Yu, P. M. Aoki, and A. Woodruff, "Detecting user engagement in everyday conversations," in 8th International Conference on Spoken Language Processing (ICSLP ' 04), 2004, pp. 1329-1332.
3. B. Wrede and E. Shriberg, "Spotting "Hot Spots" in Meetings: Human Judgements and Prosodic Cues." in Proceedings of Eurospeech 2003, Geneva, 2003, pp. 2805-2808.
4. J. Carletta, "Unleashing the killer corpus: experiences in creating the multi-everything AMI Meeting Corpus," in Language Resources and Evaluation, 2007, pp. 181-190.
5. R. Betrand, P. Blache, R. Espesser, G. Ferre, C. Meunier, B. Priego-Valverde, and S. Rauzy, "Le CID- Corpus of Interactional Data- Annotation et Exploitation Multimodale de Parole Conversationelle." Phonétique et Phonologie, vol. 49, no. 3, 2008.
6. C. Oertel, F. Cummins, N. Campbell, J. Edlund, and P. Wagner, "D64: a corpus of richly recorded conversational interaction," in Proceedings of Language Resources and Evaluation Conference (LREC'10), 2010, pp. 2992-2995.
7. R. Dillon, In: Lecture Notes in Computer Science: A Possible Model for Predicting Listener's Emotional Engagement, R. Kronland-Martinet, T. Voinier, and S. Ystad, Eds. Heidelberg: Springer, 2006.
8. A. Kendon, "Some functions of gaze-direction in social interaction," Acta Psychologica, vol. 26, pp. 22-63, 1967.
9. M. Argyle and J. Graham, "The central Europe experiment: Looking at persons and looking at objects," Environmental Psychology & Nonverbal Behavior, vol. 1, no. 1, pp. 6-16, 1967.
10. R. Vertegaal, R. Slagter, G. van Der Veer, and A. Nijholt, "Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes," in SIGCHI Conference on Human Factors in Computing Systems, 2001, pp. 301-308.
11. F. Cummins, "Gaze and Blinking in Dyadic Conversation: A study in Coordinated Behavior Among Individuals," submitted.
12. C. Oertel, "Identification of Cues for the Automatic Detection of Hotspots," Master's Thesis, Bielefeld University, 2010.
13. F. Cummins, "Annotating Blinks and Gaze." [Online]. Available: http://cspeech.ucd.ie/ fred/Blinking/
14. K. P. Bennett and C. Campbell, "Support vector machines: hype or hallelujah?" ACM SIGKDD Explorations Newsletter, vol. 2, no. 2, pp. 1-13, 2000.
15. B. Schölkopf and A. J. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA, USA: MIT Press, 2001.
16. F. Schwenker, S. Scherer, M. Schmidt, M. Schels, and M. Glodek, "Multiple classifier systems for the recognition of human emotions," in 9th International Workshop on Multiple Classifier Systems (MCS 2010), N. El Gayar, J. Kittler, and F. Roli, Eds. Springer, 2010, pp. 315-324.
17. L. Kuncheva, Combining pattern classifiers: methods and algorithms. Wiley, 2004.
18. C.-C. Lee, S. Lee, and S. S. Narayanana, "An Analysis od Multimodal Cues of Interruption in Dyadic Spoken Interaction," in Interspeech, Brisbane, Australia, 2008, pp. 1678-1681.
19. C. Thiel, S. Scherer, and F. Schwenker, "Fuzzy-input fuzzy-output one-against-all support vector machines," in 11th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems (KES 2007), ser. Lecture Notes in Artificial Intelligence, vol. 3. Springer, 2007, pp. 156-165.