Salience in the generation of multimodal referring acts

ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces

Volumn , Issue , 2009, Pages 207-210

  Piwek, Paul ^a  

^a OPEN UNIVERSITY   (United Kingdom)

Author keywords

Incremental algorithm; Pointing gestures; Referring expressions; Salience

Indexed keywords

COMPUTATIONAL MODEL; EMPIRICAL FINDINGS; INCREMENTAL ALGORITHM; MULTI-DIMENSIONAL MODEL; MULTI-MODAL; MULTIMODAL BEHAVIOUR;

INTERACTIVE COMPUTER SYSTEMS; LEARNING SYSTEMS;

COMPUTATIONAL EFFICIENCY;

EID: 74049089959     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1647314.1647351     Document Type: Conference Paper

References (16)

1. R.J. Beun and A. Cremers. Object reference in a shared domain of conversation. Pragmatics & Cognition, 6(1/2):121-152, 1998.
2. G. Butterworth. Pointing is the royal road to language for babies. In S. Kita, editor, Pointing: Where Language, Culture and Cognition Meet, pages 9-34. Lawrence Erlbaum Associates, Mahwah, NJ, 2003.
3. Ali Choumane and Jacques Siroux. Knowledge and Data Flow Architecture for Reference Processing in Multimodal Dialogue Systems. In 2008 Conference on Multimodal Interfaces (ICMI'08), Crete, Greece, 2008. ACM.
4. W. Claassen. Generating referring expressions in a multimodal environment. In R. Dale et al., editor, Aspects of Automated Natural Language Generation. Springer Verlag, Berlin, 1992.
5. R. Dale and E. Reiter. Computational interpretations of the gricean maxims in the generation of referring expressions. Cognitive Science, 18:233-263, 1995.
6. J.P. de Ruiter. Gesture and Speech Production. PhD thesis, Max Planck Institute, Nijmegen, 1998.
7. D. Kahneman. A perspective on judgement and choice: Mapping bounded rationality. American Psychologist, 58(9):697-720, 2003.
8. J. Kelleher, F. Costello, and J. van Genabith. Dynamically structuring, updating and interrelating representations of visual and linguistic discourse context. Artificial Intelligence, 167:62-102, 2005.
9. E. Krahmer and M. Theune. Efficient context-sensitive generation of referring expressions. In K. van Deemter and R. Kibble, editors, Information Sharing, pages 223-264, Stanford University, 2002. CSLI.
10. E. Krahmer and I. van der Sluis. A new model for the generation of multimodal referring expressions. In Proceedings European Workshop on Natural Language Generation (ENLG2003), Budapest, Hungary, 2003.
11. J. Lester, J. Voerman, S. Towns, and C. Callaway. Deictic Believability: Coordinating gesture, locomotion, and speech in lifelike pedagogical agents. Applied Artificial Intelligence, 13(4-5):383Ucombining double acute accent414, 1999.
12. W.J. Levelt, G. Richardson, and L. Heij. Pointing and voicing in deictic expressions. Journal of Memory and Language, 24:133-164, 1995.
13. P. Piwek. Modality choice for generation of referring acts: Pointing versus describing. In Proceedings of Workshop on Multimodal Output Generation (MOG 2007), pages 129-139, Aberdeen, Scotland, January 2007.
14. M. Theune. From Data to Speech: Language Generation in Context. PhD thesis, Eindhoven University of Technology, 2000.
15. K. van Deemter and E. Krahmer. Graphs and Booleans: on the generation of referring expressions. In H. Bunt and R. Muskens, editors, Computing Meaning, volume 3. Kluwer, Dordrecht, 2006.
16. I. van der Sluis and E. Krahmer. Generating Referring Expressions in a Multimodal Context: An empirically motivated approach. In Selected Papers from the 11th CLIN Meeting. Rodopi, Amsterdam, 2001.