Towards mediating shared perceptual basis in situated dialogue

SIGDIAL 2012 - 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference

Volumn , Issue , 2012, Pages 140-149

  Liu, Changsong ^a   Fang, Rui ^a   Chai, Joyce Y ^a  

^a Michigan State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

GRAPHIC METHODS; PATTERN MATCHING; ROBOTS;

COMPUTER VISION ALGORITHMS; EMPIRICAL STUDIES; ERROR TOLERANCE; GRAPH-BASED REPRESENTATIONS; INEXACT GRAPH MATCHING; SITUATED HUMAN; SITUATED INTERACTIONS;

COMPUTER VISION;

EID: 84988001528     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (37)

1. A.H. Anderson, M. Bader, E.G. Bard, E. Boyle, G. Doherty, S. Garrod, S. Isard, J. Kowtko, J. McAllister, J. Miller, et al. 1991. The hcrc map task corpus. Language and speech, 34(4):351-366.
2. S. Bird, E. Klein, and E. Loper. 2009. Natural language processing with Python. O'Reilly Media.
3. T. Brick and M. Scheutz. 2007. Incremental natural language processing for hri. In Proceeding of the ACM/IEEE international conference on Human-Robot Interaction (HRI-07), pages 263-270.
4. S. Carpin, M. Lewis, J. Wang, S. Balakirsky, and C. Scrapper. 2007. USARSim: a robot simulator for research and education. In Proceedings of the 2007 IEEE Conference on Robotics and Automation.
5. J.Y. Chai, P. Hong, and M.X. Zhou. 2004a. A probabilistic approach to reference resolution in multimodal user interfaces. In Proceedings of the 9th international conference on Intelligent user interfaces, pages 70-77. ACM.
6. J.Y. Chai, P. Hong, M.X. Zhou, and Z. Prasov. 2004b. Optimization in multimodal interpretation. In Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics, page 1. Association for Computational Linguistics.
7. S. Chernova, J. Orkin, and C. Breazeal. 2010. Crowdsourcing hri through online multiplayer games. AAAI Symposium on Dialogue with Robots.
8. H. H. Clark and D. Wilkes-Gibbs. 1986. Referring as a collaborative process. In Cognition, number 22, pages 1-39.
9. H. H. Clark. 1996. Using language. Cambridge University Press, Cambridge, UK.
10. D. Conte, P. Foggia, C. Sansone, and M. Vento. 2004. Thirty years of graph matching in pattern recognition. International journal of pattern recognition and artificial intelligence, 18(3):265-298.
11. M. A. Eshera and K. S. Fu. 1984. A graph distance measure for image analysis. IEEE transactions on systems, man, and cybernetics, 14(3):398-410.
12. M.E. Foster, E.G. Bard, R.L. Hill, M. Guhe, J. Oberlander, and A. Knoll. 2008. Generating haptic-ostensive referring expressions in cooperative, task-based human-robot dialogue. Proceedings of ACM/IEEE Human-Robot Interaction.
13. B. Fransen, V. Morariu, E. Martinson, S. Blisard, M. Marge, S. Thomas, A. Schultz, and D. Perzanowski. 2007. Using vision, acoustics, and natural language for disambiguation. In Proceedings of HRI07, pages 73-80.
14. P. Gorniak and D. Roy. 2004a. Grounded semantic composition for visual scenes. In Journal of Artificial Intelligence Research, volume 21, pages 429-470.
15. P. Gorniak and D. Roy. 2004b. Grounded semantic composition for visual scenes. J. Artif. Intell. Res. (JAIR), 21:429-470.
16. P. Gorniak and D. Roy. 2007. Situated language understanding as filtering perceived affordances. In Cognitive Science, volume 31(2), pages 197-231.
17. A. Green and K. Severinson Eklundh. 2001. Taskoriented dialogue for CERO: a user centered approach. In Proceedings of 10th IEEE international workshop on robot and human interactive communication, September.
18. Sonja Huwel and Britta Wrede. 2006. Situated speech understanding for robust multi-modal humanrobot communication. In Proceedings of the International Conference on Computational Linguistics (COLING/ACL).
19. P. Kahn, N. Greier, T. Kanda, H. Ishiguro, J. Ruckert, R. Severson, and S. Kane. 2008. Design patterns for sociality in human-robot interaction. In Proceedings of HRI, pages 97-104.
20. Geert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henrik Jacobsson, and Nick Hawes. 2007. Incremental, multi-level processing for comprehending situated dialogue in human-robot interaction. In Symposium on Language and Robots.
21. C. Liu, J. Walker, and J.Y. Chai. 2010. Disambiguating frames of reference for spatial language understanding in situated dialogue. In AAAI Fall Symposium on Dialogue with Robots.
22. C. Liu, D. Kay, and J.Y. Chai. 2011. Awareness of partners eye gaze in situated referential grounding: An empirical study. In 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction.
23. N. Otsu. 1975. A threshold selection method from graylevel histograms. Automatica, 11:285-296.
24. Z. Prasov and J.Y. Chai. 2008. What's in a gaze?: the role of eye-gaze in reference resolution in multimodal conversational interfaces. In Proceedings of the 13th international conference on Intelligent user interfaces, pages 20-29. ACM.
25. Z. Prasov and J.Y. Chai. 2010. Fusing eye gaze with speech recognition hypotheses to resolve exophoric references in situated dialogue. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pages 471-481. Association for Computational Linguistics.
26. T. Regier and L.A. Carlson. 2001. Grounding spatial language in perception: an empirical and computational investigation. Journal of Experimental Psychology: General, 130(2):273.
27. D.K. Roy. 2002. Learning visually grounded words and syntax for a scene description task. Computer Speech & Language, 16(3):353-385.
28. A. Sanfeliu and K. S. Fu. 1983. A distance measure between attributed relational graphs for pattern recognition. IEEE transactions on systems, man, and cybernetics, 13(3):353-362.
29. M. Scheutz, P. Schermerhorn, J. Kramer, and D. Anderson. 2007a. First steps toward natural human-like HRI. In Autonomous Robots, volume 22.
30. M. Scheutz, P. Schermerhorn, J. Kramer, and D. Anderson. 2007b. Incremental natural language processing for hri. In Proceedings of HRI.
31. M. Shiomi, T. Kanda, S. Koizumi, H. Ishiguro, and N. hagita. 2007. Group attention control for communication robots with wizard of OZ approach. In Proceedings of HRI, pages 121-128.
32. M. Skubic, D. Perzanowski, S. Blisard, A. Schultz, W. Adams, M. Bugajska, and D. Brock. 2004. Spatial language for human-robot dialogs. IEEE Transactions on Systems, Man and Cybernetics, Part C, 34(2):154-167.
33. A. Steinfeld, O. C. Jenkins, and B. Scassellati. 2009. The oz of wizard: Simulating the human for interaction research. In Proceedings of HRI, pages 101-107.
34. W.H. Tsai and K.S. Fu. 1979. Error-correcting isomorphisms of attributed relational graphs for pattern analysis. Systems, Man and Cybernetics, IEEE Transactions on, 9(12):757-768.
35. W.H. Tsai and K.S. Fu. 1983. Subgraph error-correcting isomorphisms for syntactic pattern. year: 1983, 13:48-62.
36. D. Zhang and G. Lu. 2002. An integrated approach to shape based image retrieval. In Proc. of 5th Asian conference on computer vision (ACCV), pages 652-657.
37. W. Zhang. 1999. State-space search: Algorithms, complexity, extensions, and applications. Springer-Verlag New York Inc.