Real-time adaptive behaviors in multimodal human-avatar interactions

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010

Volumn , Issue , 2010, Pages

  Zhang, Hui ^a   Fricker, Damian ^a   Smith, Thomas G ^a   Yu, Chen ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

embodied agent; multimodal interaction; virtual human; visualization

Indexed keywords

ADAPTIVE BEHAVIOR; AVATAR INTERACTION; BEHAVIORAL PATTERNS; BODILY MOVEMENT; EMBODIED AGENT; EYE-GAZE; HAND MOVEMENT; HEAD MOVEMENTS; HIGHLY SENSITIVE; HUMAN USERS; HUMAN-COMPUTER; INTELLIGENT MULTIMODAL INTERFACES; INTERACTING AGENTS; JOINT ATTENTION; MULTI-MODAL; MULTI-MODAL INTERACTIONS; MULTIMODAL DATA STREAMS; MULTIPLE LEVELS; REAL TIME; USER BEHAVIORS; VIRTUAL AGENT; VIRTUAL ENVIRONMENTS; VIRTUAL HUMANS;

COORDINATION REACTIONS; COUPLINGS; EYE MOVEMENTS; INTERACTIVE COMPUTER GRAPHICS; INTERACTIVE COMPUTER SYSTEMS; LEARNING SYSTEMS; USER INTERFACES; VIRTUAL REALITY; VISUALIZATION;

BEHAVIORAL RESEARCH;

EID: 78650928781     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1891903.1891909     Document Type: Conference Paper

References (15)

1. Hudson, S., Fogarty, J., Atkeson, C., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J., and Yang, J. 2003. Predicting human interruptibility with sensors: a Wizard of Oz feasibility study. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA, April 05-10, 2003). CHI '03. ACM, New York, NY, 257-264.
2. Lee, J., Chai, J., Reitsma, P. S., Hodgins, J. K., and Pollard, N. S. 2002. Interactive control of avatars animated with human motion data. ACM Trans. Graph. 21, 3 (Jul. 2002), 491-500.
3. Ishii, R., Nakano, Y.I.: Estimating user's conversational engagement based on gaze behaviors. In: IVA '08: Proceedings of the 8th international conference on Intelligent Virtual Agents, Berlin, Heidelberg, Springer-Verlag (2008) 200-207.
4. Lee, J., Marsella, S., Traum, D., Gratch, J., Lance, B.: The rickel gaze model: A window on the mind of a virtual human. In: IVA '07: Proceedings of the 7th international conference on Intelligent Virtual Agents, Berlin, Heidelberg, Springer-Verlag (2007) 296-303.
5. Ward, N.: Prosodic features which cue backchannel responses in English and Japanese. Pragmatics 32, 1177-1207 (2000)
6. Marsella, S.C., Morency, L.-P, Gratch, J., Okhmatovskaia, A., Lamothe, F., Morales, M., van der Werf, R.J.: Virtual Rapport. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS(LNAI), vol. 4133, pp. 14-27. Springer, Heidelberg (2006)
7. Kipp, M., Gebhard, P.: Igaze: Studying reactive gaze behavior in semi-immersive human-avatar interactions. In: IVA '08: Proceedings of the 8th international conference on Intelligent Virtual Agents, Berlin, Heidelberg, Springer-Verlag (2008) 191-199.
8. Morency, L.P., Kok, I., Gratch, J.: Predicting listener backchannels: A probabilistic multimodal approach. In: IVA '08: Proceedings of the 8th international conference on Intelligent Virtual Agents, Berlin, Heidelberg, Springer-Verlag (2008) 176-190.
9. Cassell, J.: Body Language: Lessons from the Near-Human. In: Riskin, J. (ed.) The Sistine Gap: History and Philosophy of Artificial Life, University of Chicago Press, Chicago.
10. Thorisson, K.R.: Modeling multimodal communication as a complex system. In: Wachsmuth, I., Knoblich, G. (eds.) ZiF Research Group International Workshop. LNCS (LNAI), vol. 4930, pp. 143-168. Springer, Heidelberg (2008)
11. Kopp, S., Allwood, J., Grammer, K., Ahlsen, E., & Stocksmeier, T. (2008): Modeling Embodied Feedback With Virtual Humans. In I. Wachsmuth & G. Knoblich (Eds.), Modeling embodied communication in agents and virtual humans, LNAI 4930. Springer-Verlag.
12. Ou, J., Oh, L. M., Fussell, S. R., Blum, T., and Yang, J. 2005. Analyzing and predicting focus of attention in remote collaborative tasks. In Proceedings of the 7th international Conference on Multimodal interfaces (Torento, Italy, October 04-06, 2005). ICMI '05. ACM, New York, NY, 116-123.
13. Z. Griffin, "Why look? Reasons for eye movements related to language production," The interface of language, vision, and action: Eye movements and the visual world, pp. 213-247, 2004
14. Yu, C., Zhong, Y., Smith, T., Park, I., Huang,W.: Visual data mining of multimedia data for social and behavioral studies. Information Visualization 8 (2009) 56-70.
15. Yu, C., Scheutz, M., Schermerhorn, P.: Investigating multimodal real-time patterns of joint attention in an hri word learning task. In: HRI '10: Proceeding of the 5th ACM/IEEE international conference on Human-agent interaction, New York, NY, USA, ACM (2010) 309-316.