Coordination and context-dependence in the generation of embodied conversation

INLG 2000 - Proceedings of the 1st International Conference on Natural Language Generation

Volumn , Issue , 2000, Pages 171-178

  Casseli, Justine ^a   Stone, Matthew ^b   Yan, Hao ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS;

AGENT PLAN; COMMUNICATIVE ACTIONS; COMPOSITE ACTION; CONTEXT DEPENDENCES; EMBODIED CONVERSATIONAL AGENT; FUNCTION SEMANTIC;

SEMANTICS;

EID: 85121204007     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. Elisabeth Andre, Thomas Rist, and Jochen Müller. 1999. Employing AJ methods to control the behavior of animated interface agents. Applied Artificial Intelligence. 13:415-448.
2. Douglas Appelt. 1985, Planning English Sentences. Cambridge University Press, Cambridge England.
3. R. A. Bolt and E. Herranz. 1992. Two-handed gesture in multi-modal natural dialog. In UIST92: Fifth Annual Symposium on User Interface Software and Technology.
4. R. A. Bolt. 1980. Put-that-there: voice and gesture at the graphics interface. Computer Graphics. 14 (3) :262-270.
5. J. Cassell and K. Thórisson. 1999. The power of a nod and a glance: Envelope vs. emotional feedback in animated conversational agents. Applied Artificial Intelligence, 13 (3).
6. Justine Cassell, Catherine Pelachaud, Norm Badler, Mark Steedman, Brett Achorn, Tripp Becket, Brett Douville, Scott Prevost, and Matthew Stone. 1994. Animated conversation: Rule-based generation of facial expression, gesture and spoken intonationfor multiple conversational agents. In SIGGRAPH, pages 413-420.
7. J. Cassell, D. McNeill, and K. E. McCullough. 1999. Speech-gesture mismatches: evidence for one underlying representation of linguistic and nonlinguistic information. Pragmatics and Cognition, 6 (2).
8. Justine Cassell. 2000a. Embodied conversational interface agents. Communications of the ACM, 43 (4) :70-78.
9. Justine Cassell. 2000b. Nudge nudge wink wink: Elements of face-to-face conversation for embodied conversational agents. In J. Cassell, J. Sullivan, S. Prevost, and E. Churchill, editors, Embodied Conversational Agents, pages 1-28. MIT Press, Cambridge, MA.
10. Robert Dale. 1992. Generating Referring Expressions: Constructing Descriptions in a Domain of Objects and Processes. MIT Press, Cambridge MA.
11. S. Feiner and K. McKeown. 1991. Automating the generation of coordinated multimedia explanations. IEEE Computer, 24(10):33-41.
12. Nancy Green, Giuseppe Carenini, Stephan Kerpedjiev, Steven Roth, and Johanna Moore. 1998. A media-independent content language for integrated text and graphics generation. In CVIR '98- Workshop on Content Visualization and Intermedia Representations.
13. Jeanette K. Gundel, Nancy Hedberg, and Ron Zacharski. 1993. Cognitive status and the form of referring expressions in discourse. Language, 69 (2) :274-307.
14. M. Johnston, P. R. Cohen, D. McGee, J. Pittman, S. L. Oviatt, and I. Smith. 1997. Unification-based multimodal integration. In ACLIEACL 97: Proceedings of the Annual Meeting of the Assocation for Computational Linguistics.
15. Michael Johnston. 1998. Unification-based multimodal parsing. In COLWG1ACL.
16. Aravind K. Joshi, L. Levy, and M. Takahashi. 1975. Tree adjunct grammars. Journal of the Computer and System Sciences. 10:136-163.
17. S. D. Kelly, J. D. Barr, R. B. Church, and K. Lynch. 1999. Offering a hand to pragmatic understanding: The role of speech and gesture incomprehension and memory. Journal of Memory and Language. 40:577-592.
18. A. Kendon. 1974. Movement coordinaiion in social interaction: somem examples described. In S. Weitz, editor. Nonverbal Communication. Oxford. New York.
19. D. B. Koons. C. J. Sparrell, and K. R. Thorisson. 1993. integrating simultaneous input from speech, gaze and hand gestures. In M. T. Maybury, editor, Intelligent Multimedia Interfaces. MIT Press, Cambridge.
20. James Lester. Stuart Towns. Charles Calloway, and Patrick FitzGerald. 1998. Deictic and emotive com munication in animated pedagogical agents. In Work shop on Embodied Conversational Characters.
21. David McNeill. 1992. Hand and Mind: What Gesture Reveal about Thought. University of Chicago Press Chicago.
22. Johanna Moore. 1994. Participating in Explanatory Di alogues. MIT Press, Cambridge MA.
23. S. L. Oviatt. 1995. Predicting spoken language disflu encies during human-computer interaction. Compute Speech and Language, 9(1):19-35.
24. Ellen Prince. 1986. On the syntactic marking of pre supposed open propositions. In Proceedings of the 22nd Annual Meeting of the Chicago Linguistic Soci ety, pages 208-222, Chicago. CLS.
25. Ellen F. Prince. 1992. The ZPG letter: Subjects, definite ness and information status. In William C. Mann anc Sandra A. Thompson, editors, Discourse Description. Diverse Analyses of a Fund-raising Text, pages 295-325. John Benjamins, Philadelphia.
26. Jeff Rickel and W. Lewis Johnson. 1999. Animated agents for procedural training in virtual reality: Perception, cognition and motor control. Applied Artifi cial Intelligence, 13:343-382.
27. W. T. Rogers. 1978. The contribution of kinesic illustrators towards the comprehension of verbal behavioi within utterances. Human Communication Research, 5:54-62.
28. Yves Schabes. 1990. Mathematical and Computational Aspects of Lexicalized Grammars. Ph. D. thesis, Computer Science Department, University of Pennsylvania.
29. Mark Steedman. 1991. Structure and intonation. Language, 67:260-296.
30. Matthew Stone and Christine Doran. 1997. Sentence planning as description using tree-adjoining grammar. In Proceedings of ACL, pages 198-205.
31. Matthew Stone, Tonia Bleam. Christine Doran, and Martha Palmer. 2000. Lexicalized grammar and the description of motion events. In TAG+: Workshop on Tree-Adjoining Grammar and Related Formalisms.
32. Michael Strube. 1998. Never look back: An alternative to centering. In Proceedings of COLING-ACL.
33. L. A. Thompson and D. W. Massaro. 1986. Evaluation and integration of speech and pointing gestures during referential understanding. Journal of Experimental Child Psychology, 42:144-168.
34. David R. Traum and James F. Allen. 1994. Discourse obligations in dialogue processing. In ACL. pages 1-8.
35. W. Wahlster, E. Andre. W. Graf, and T. Rist. 1991. Designing illustrated texts. In Proceedings of EACL, pages 8-14.
36. Hao Yam. 2000. Paired speech.and gesture generation in embodied conversational agents. Master's thesis. Media Lab, MIT.