Facilitating multiparty dialog with gaze, gesture, and speech

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010

Volumn , Issue , 2010, Pages

  Bohus, Dan ^a   Horvitz, Eric ^a  

^a MICROSOFT RESEARCH   (United States)

Author keywords

behavioral models; floor management; gaze; gesture; multimodal systems; multiparty interaction; multiparty turn taking; situated interaction; speech; spoken dialog

Indexed keywords

BEHAVIORAL MODEL; FLOOR MANAGEMENT; GAZE; GESTURE; MULTIMODAL SYSTEM; MULTIPARTY INTERACTION; SITUATED INTERACTION; SPOKEN DIALOG; TURN-TAKING;

FLOORS; GESTURE RECOGNITION; INTERACTIVE COMPUTER SYSTEMS; LEARNING SYSTEMS; MAN MACHINE SYSTEMS; SPEECH;

MATHEMATICAL MODELS;

EID: 78650955484     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1891903.1891910     Document Type: Conference Paper

References (19)

1. Bennewitz, M., Faber, F., Joho, D., Schreiber, M., and Behnke, S., 2005. Integrating vision and speech for Conversations with Multiple Persons, in Proceedings of IROS'05
2. Bohus, D., and Horvitz, E., 2009. Dialog in the Open World: Platform and Applications, in Proc. ICMI'09, Boston, MA
3. Bohus, D., and Horvitz, E., 2009. Models for Multiparty Engagement in Open-World Dialog, in Proc. SIGdial'09, London, UK
4. Bohus, D., and Horvitz, E., 2010. Computational Models for Multiparty Turn Taking, MSR-TR-2010-115, Microsoft Research
5. Cassell, J., Torres, O., and Prevost, S., 1998. Turn taking vs Discourse Structure: How Best to Model Multimodal Conversation, Machine Conversations, 1998, pp. 143-154, Kluwer.
6. Clark, H., and Carlson, T., 1982. Hearers and speech acts, Language, 58, 332-373.
7. Duncan, S. 1972. Some Signals and Rules for Taking Speaking Turns in Conversation, Journal of Personality and Social Psychology 23, 283-292.
8. Goodwin, C. 1980. Restarts, pauses and the achievement of mutual gaze at turn-beginning, Sociological Inquiry, 50(3-4), 272-302.
9. th Annual International Symposium on Optical Science and Technology, 2003, San Diego, CA.
10. Mutlu, B., Shiwa, T., Kanda, T., Ishiguro, H., and Hagita, N., 2009. Footing in Human-Robot Conversation: How Robots Might Shape Participant Roles Using Gaze Cues, in Proceedings of HRI-2009, San Diego, CA.
11. Picot, A., Bailly, G., Elisei, F., and Raidt, S., 2007. Scrutinizing natural scenes: controlling the gaze of an embodied conversational agent, Intelligent Virtual Agents, 272-282, Springer Berlin.
12. Raux, A. and Eskenazi, M., 2008. A Finite-State Turn-Taking Model for Spoken Dialog Systems, in Proc. HLT'09, Boulder, CO.
13. Sacks, H., Schegloff. E., and Jefferson, G. 1974. A simplest systematics for the organization of turn-taking in conversation, Language, 50, 696-735.
14. Schegloff, E. 2000a. Accounts of Conduct in Interaction: Interruption, Overlap and Turn-Taking, The handbook of sociological theory, 287-321, New York: Plenum.
15. Schegloff, E. 2000b. Overlapping talk and the organization of turn-taking in conversation, Language in Society, 29, 1-63.
16. Situated Interaction Website, 2010 - http://research.microsoft.com/ ~dbohus/si.html
17. Thorisson, K.R. 2002. Natural Turn-Taking Needs No Manual: Computational Theory and Model, from Perceptions to Action, Multimodality in Language and Speech Systems, Kluwer Academic Publishers, 173-207.
18. Traum, D., and Rickel, J., 2002. Embodied Agents for Multi-party Dialogue in Immersive Virtual World, in Proceedings of AAMAS'02, 766-773.
19. Wiemann, J., and Knapp, M., 1975. Turn-taking in conversation, Journal of Communication, 25, 75-92.