Learning models of speaker head nods with affective information

Proceedings - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009

Volumn , Issue , 2009, Pages

  Lee, Jina ^a   Neviarouskaya, Alena ^b   Prendinger, Helmut ^c   Marsella, Stacy ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSITY OF TOKYO   (Japan)

^c NATIONAL INSTITUTE OF INFORMATICS   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

AFFECT RECOGNITION; COMMUNICATIVE FUNCTIONS; FACE-TO-FACE CONVERSATION; FEATURE SELECTION; HEAD MOVEMENTS; HUMAN INTERACTIONS; INDEPENDENT MODEL; LEARNING MODELS; LEARNING PROCESS; MACHINE-LEARNING; TRAINING PROCESS; VIRTUAL AGENT;

FACE RECOGNITION; INTELLIGENT COMPUTING;

INFORMATION USE;

EID: 77949364510     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACII.2009.5349543     Document Type: Conference Paper

References (23)

1. W. Breitfuss, H. Prendinger, and M. Ishizuka. Automated generation of non-verbal behavior for virtual embodied characters. In ICMI '07: Proceedings of the 9th international conference on Multimodal interfaces, pages 319-322, New York, NY, USA, 2007. ACM.
2. C. Busso, Z. Deng, M. Grimm, U. Neumann, and S. Narayanan. Rigid head motion in expressive speech animation: Analysis and synthesis. IEEE Transactions on Audio, Speech and Language Processing, 15(3):1075-1086, 2007.
3. J. Carletta. Unleashing the killer corpus: experiences in creating the multi-everything AMI meeting corpus. Language Resources and Evaluation Journal, 41(2):181-190, 2007.
4. J. Cassell, H. H. Vilhjálmsson, and T. Bickmore. BEAT: the behavior expression animation toolkit. In SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pages 477-486, New York, NY, USA, 2001. ACM.
5. E. Charniak. Statistical Language Learning. MIT Press, Cambridge, Massachusetts, 1993.
6. E. Charniak. A maximum-entropy-inspired parser. In Proceedings of the first conference on North American chapter of the Association for Computational Linguistics, pages 132-139, San Francisco, CA, USA, 2000. Morgan Kaufmann Publishers Inc.
7. U. Hadar, T. J. Steiner, E. C. Grant, and F. C. Rose. Kinematics of head movements accompanying speech during conversation. Human Movement Science, 2:35-46, 1983.
8. U. Hadar, T. J. Steiner, and F. C. Rose. Head movement during listening turns in conversation. Journal of Nonverbal Behavior, 9(4):214-228, 1985.
9. D. Heylen. Challenges ahead: Head movements and other social acts in conversations. In AISB 2005, Social Presence Cues Symposium, 2005.
10. B. H. Hwang and L. R. Rabiner. Hidden markov models for speech recognition, August 1991.
11. A. Kendon. Some uses of the head shake. Gesture, 2:147-182(36), 2002.
12. F. L. A. Knoppel, A. S. Tigelaar, D. O. Bos, T. Alofs, and Z. Ruttkay. Trackside DEIRA: a dynamic engaging intelligent reporter agent. In AAMAS '08: Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems, pages 112-119, Richland, SC, 2008. International Foundation for Autonomous Agents and Multiagent Systems.
13. J. Lee and S. Marsella. Nonverbal behavior generator for embodied conversational agents. In Proceedings of the 6th International Conference on Intelligent Virtual Agents, Marina del Rey, CA, pages 243-255. Springer, 2006.
14. J. Lee and S. Marsella. Learning a model of speaker head nods using gesture corpora. In AAMAS '09: Proceedings of the 8th international joint conference on Autonomous agents and multiagent systems. International Foundation for Autonomous Agents and Multiagent Systems, 2009.
15. M. Mancini, R. Bresin, and C. Pelachaud. A virtual head driven by music expressivity. IEEE Transactions on Audio, Speech and Language Processing, 15(6):1833-1841, 2007.
16. E. Z. McClave. Linguistic functions of head movements in the context of speech. Journal of Pragmatics, 32:855-878(24), June 2000.
17. A. Mignault and A. Chaudhuri. The many faces of a neutral face: Head tilt and perception of dominance and emotion. Journal of Nonverbal Behavior, 2(27):111-132, June 2003.
18. L.-P. Morency, I. de Kok, and J. Gratch. Predicting listener backchannels: A probabilistic multimodal approach. In Proceedings of the 8th International Conference on Intelligent Virtual Agents, Marina del Rey, CA, pages 176-190, 2008.
19. K. G. Munhall, J. A. Jones, D. E. Callan, T. Kuratate, and E. Vatikiotis-Bateson. Visual prosody and speech intelligibility: Head movement improves auditory speech perception. Psychological Science, 15:133-137(5), February 2004.
20. A. Neviarouskaya, H. Prendinger, and M. Ishizuka. Textual affect sensing for sociable and expressive online communication. In ACII '07: Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction, pages 218-229, Berlin, Heidelberg, 2007. Springer-Verlag.
21. L. R. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2):257-286, 1989.
22. M. Strauss and M. Kipp. Eric: a generic rule-based framework for an affective embodied commentary agent. In L. Padgham, D. C. Parkes, J. Mller, and S. Parsons, editors, AAMAS '08: Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems, pages 97-104, Richland, SC, 2008. International Foundation for Autonomous Agents and Multiagent Systems.
23. A. D. Wilson and A. F. Bobick. Parametric hidden markov models for gesture recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(9):884-900, 1999.