Probabilistic grounding of situated speech using plan recognition and reference resolution

Proceedings of the Seventh International Conference on Multimodal Interfaces, ICMI'05

Volumn , Issue , 2005, Pages 138-143

  Gorniak, Peter ^a   Roy, Deb ^a  

^a MIT MEDIA LAB   (United States)

Author keywords

Grounding; Language; Plan recognition; Situated; Speech; Understanding

Indexed keywords

COMPUTER SIMULATION; LINGUISTICS; SEMANTICS; SPEECH ANALYSIS;

GROUNDING; LANGUAGE; PLAN RECOGNITION; SITUATED; UNDERSTANDING;

SPEECH RECOGNITION;

EID: 32344442600     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1088463.1088489     Document Type: Conference Paper

References (19)

1. J. Allen and R. Perrault. Analyzing intention in utterances. Artificial Intelligence, 15:143-178, 1980.
2. J. Barwise and J. Perry. Situations and Attitudes, MIT Press, Cambridge, MA, 1983.
3. A. F. Bobick and Y. A. Ivanov. Action recognition using probabilistic parsing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1998.
4. P. Cohen and C. Perrault, Elements of a plan-based theory of speech acts. Cognitive Science, 1979.
5. J. Barley. An efficient context-free parsing algorithm. Communications of the ACM, 6(8):451-455, 1970.
6. P. Gorniak and D. Roy. Speaking with your sidekick: Understanding situated speech in computer role playing games. In Proceedings of Artificial Intelligence and Digital Entertainment, 2005.
7. P. J. Gorniak and D. Roy. Grounded semantic composition for visual scenes. Journal of Artificial Intelligence Research, 21:429-470, 2004.
8. N. Haddock. Computational models of incremental semantic interpretation. Language and Cognitive Processes, 4:337-368, 1989.
9. D. Hakkani-Tur and G. Riccardi, A general algorithm for word graph matrix decomposition, In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2003), 2003.
10. D. Klein and C. D. Manning. Accurate unlexicalized parsing. In Proceedings of teh 41st Meeting of the Association of Computational Linguistics, 2003.
11. L. Mangu, E. Brill, and A. Stolcke. Finding consensus among words: Lattice-based word error minimization. In Proceedings of EUROSPEECH'99, volume 1, pages 495-498, Budapest, 1999.
12. S. Narayanan. KARMA: Knowledge-based Action Representations for Metaphor and Aspect, PhD thesis, University of California, Berkeley, 1997.
13. D. V. Pynadath and M. P. Wellman. Probabilistic state-dependent grammars for plan recognition. In Proceedings of the Conference on Uncertainty in Artificial Intelligence, UAI2000, Morgan Kaufmann Publishers, 2000.
14. L. Rabiner, A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE, 77:257-286, February 1989.
15. D. Roy and N. Mukherjee, Towards situated speech understanding: Visual context priming of language models. Computer Speech and Language, 19(2):227-248, 2005.
16. W. Schuler, Using model-theoretic semantic interpretation to guide statistical parsing and word recognition in a spoken language interface. In Proceedings of the Association for Computational Linguistics, 2003.
17. A. Stolcke. An efficient probabilistic context-free parsing algorithm that computes prefix probabilities. Computational Linguistics, 21(2):165-201, 1995.
18. J. B. Tenenbaum and F. Xu. Word learning as bayesian inference. In Proceedings of the Send Annual Conference of the Cognitive Science Society, 2000.
19. N. Yoshida. Utterance segmenation for spontaneous speech recognition. Master's thesis, Massachusetts Institute of Technology, 2002.