Attentional Behaviors as Nonverbal Communicative Signals in Situated Interactions with Conversational Agents

Conversational Informatics: An Engineering Approach

Volumn , Issue , 2007, Pages 85-102

  Nakano, Yukiko I ^a   Nishida, Toyoaki ^b  

^a TOKYO UNIVERSITY OF AGRICULTURE AND TECHNOLOGY   (Japan)

^b KYOTO UNIVERSITY   (Japan)

Author keywords

Direction giving strategy; Face to face conversation communicative signals; Face to face learning interactions; Human Conversation Attentional Behaviors Functions; Mimic human conversational gaze behavior; Mission Rehearsal Experience (MRE) project; Nonverbal status (NV status); Shared Workspace Serving; Utterance units (UU); Video mediated communication (VMC) research

Indexed keywords

EID: 70350643337     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9780470512470.ch5     Document Type: Chapter

References (43)

1. Allen J. and Core M. (1997) Draft of DMSL: Dialogue act markup in several layers. Available from: http://www.cs.rochester.edu/research/speech/damsl/RevisedManual/
2. Anderson A.H. et al. (1997) The effects of face-to-face communication on the intelligibility of speech. Perception and Psychophysics 59, pp. 580-592.
3. André E., Rist T. and Muller J. (1999) Employing AI methods to control the behavior of animated interface agents. Applied Artificial Intelligence, 13 (4-5): pp. 415-448, Taylor & Francis, Philadelphia, PA.
4. Argyle M. et al. (1973) The different functions of gaze. Semiotica 7, pp. 19-32.
5. Argyle M. and Cook M (1976) Gaze and Mutual Gaze. Cambridge University Press.
6. Argyle M. and Graham J. (1977) The Central Europe experiment: looking at persons and looking at things. Journal of Environmental Psychology and Nonverbal Behaviour 1, 6-16.
7. Boyle E., Anderson A. and Newlands A. (1994) The effects of visibility on dialogue and performance in a cooperative problem solving task. Language and Speech 37 (1), 1-20.
8. Brennan S. (2000) Processes that shape conversation and their implications for computational linguistics. In Proceedings of 38th Annual Meeting of the ACL, pp. 1-11.
9. Clark H.H. (1996) Using Language. Cambridge University Press, Cambridge.
10. Clark H.H. (2003) Pointing and placing. In S. Kita (ed.), Pointing: Where language, culture, and cognition meet., Erlbaum, Hillsdale, NJ, pp. 243-268.
11. Clark H.H. and Brennan S.E. (1991) Grounding in communication. In L.B. Resnick, J.M. Levine and S.D. Teasley, (eds), Perspectives on Socially Shared Cognition. American Psychological Association, Washington, DC, pp. 127-149.
12. Clark H.H. and Schaefer E.F. (1989) Contributing to discourse. Cognitive Science 13, 259-294.
13. Dillenbourg P. (1996) Some Technical Implications of Distributed Cognition on the Design of Interactive Learning Environments. Journal of Artificial Intelligence in Education 7 (2), 161-179.
14. Duncan S. (1972) Some signals and rules for taking speaking turns in conversations. Journal of Personality and Social Psychology 23 (2), 283-292.
15. Duncan S. (1974) On the structure of speaker-auditor interaction during speaking turns. Language in Society 3, 161-180.
16. Goodwin C. (1981) Achieving mutual orientation at turn beginning, In Conversational Organization: Interaction between speakers and hearers. Academic Press, New York, pp. 55-94.
17. Johnson W.L., Rickel J.W. and Lester J.C. (2000) Animated pedagogical agents: face-to-face interaction in interactive learning environments. International Journal of Artificial Intelligence in Education 11, 47-78.
18. Kapoor A. and Picard R.W. (2001) A real-time head nod and shake detector. In Proceedings ofWorkshop on Perceptive User Interfaces.
19. Kendon A. (1967) Some functions of gaze direction in social interaction. Acta Psychologica 26, pp. 22-63.
20. Kraut R., Miller M. and Siegel J. (1996) Communication in performance of physical tasks: effects on outcomes and performance. In Proceedings of Conference on Computer Supported CooperativeWork, ACM NewYork, pp. 57-66.
21. Kurohashi S. and Nagao M. (1994) A syntactic analysis method of long Japanese sentences based on the detection of conjunctive structures. Computational Linguistics 20 (4), 507-534.
22. Lee A., Kawahara T. and Shikano K. (2001) Julius: an open source real-time large vocabulary recognition engine. In Proceedings of European Conference on Speech Communication and Technology (EUROSPEECH), pp. 169-1694.
23. Lester J.C. et al. (1999) Deictic believability: coordinated gesture, locomotion, and speech in lifelike pedagogical agents. Applied Artificial Intelligence 13 (4-5), 383-414.
24. Matheson C., Poesio M. and Traum D. (2000) Modelling grounding and discourse obligations using update rules. In Proceedings of 1st Annual Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL2000).
25. Morency L.P., Rahimi A. and Darrell T. (2003) A view-based appearance model for 6 DOF tracking. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.
26. Nakano Y.I. et al. (2003) Towards a Model of Face-to-Face Grounding. In Proceedings of 41st Annual Meeting of the Association for Computational Linguistics (ACL03), pp. 533-561.
27. Nakano Y.I. et al. (2004). Converting text into agent animations: assigning gestures to text. In Proceedings of Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL 2004), Companian Volume, pp. 153-156.
28. Nakatani C. and Traum D. (1999) Coding Discourse Structure in Dialogue (version 1.0). University of Maryland, Institute for Advanced Computer Studies Technical Report UMIACS-TR-99-03.
29. Noma T. and Badler N. (1997) A virtual human presenter. In Proceedings IJCAI Workshop on Animated Interface Agents: Making Them Intelligent, pp. 45-51.
30. Novick D.G., Hansen B. and Ward K. (1996) Coordinating turn-taking with gaze. In Proceedings of ICSLP-96, pp. 1888-1891.
31. Olson J.S., Olson G.M. and Meader D.K. (1995). What mix of video and audio is useful for remote real-time work? In Proceedings of CHI95, ACM, pp. 362-368.
32. Pierrehumbert J.B. (1980) The Phonology and Phonetics of English Intonation. Ph.D. thesis Massachusetts Institute of Technology.
33. Rickel J. and Johnson W.L. (1999) Animated agents for procedural training in virtual reality: perception, cognition and motor control. Applied Artificial Intelligence 13 (4-5), 343-382.
34. Sato Y. et al. (2004) Video-based tracking of user's motion and its use for augmented desk interface. In Proceedings of IEEE Conference Automatic Face and Gesture Recognition (FG 2004), pp. 805-809.
35. Shaw E., Johnson W.L. and Ganeshan R. (1999) Pedagogical agents on the web. In Proceedings of Third International Conference on Autonomous Agents, pp. 283-290.
36. Sidner C.L. and Lee C. (2003) Engagement rules for human-robot collaborative interactions. In Proceedings of IEEE International Conference on Systems, Man & Cybernetics (CSMC), vol. 4, pp. 3957-3962.
37. Stone B. and Lester J. (1996) Dynamically sequencing an animated pedagogical agent. In Proceedings of Thirteenth National Conference on Artificial Intelligence, pp. 424-431.
38. Swartout W. et al. (2001) Toward the holodeck: integrating graphics, sound, character and story. In Proceedings of 5th International Conference on Autonomous Agents, 2001, pp. 409-416.
39. Traum D. and Heeman P. (1996) Utterance units and grounding in spoken dialogue. In Proceedings of ICSLP, pp. 1884-1887.
40. Traum D. and Rickel J. (2002) Embodied agents for multi-party dialogue in immersive virtual worlds. In Proceedings of The First International Joint Conference on Autonomous Agents and Multi-agent Systems (AAMAS 2002), pp. 766-773.
41. Wahlster W., Reithinger N. and Blocher A. (2001) SmartKom: multimodal communication with a life-like character. In Proceedings of Eurospeech 2001, vol. 3, pp. 1547-1550.
42. Whittaker S. (2003) Theories and Methods in Mediated Communication. In Graesser A., Gernsbacher M. and Goldman S. (eds.), Handbook of Discourse Processes. Erlbaum, NJ, pp. 243-286.
43. Whittaker S. and O'Conaill B. (1993) Evaluating videoconferencing. In Companion Proceedings of CHI93: Human Factors in Computing Systems. ACM Press, pp. 135-136.