A joint model of language and perception for grounded attribute learning

Proceedings of the 29th International Conference on Machine Learning, ICML 2012

Volumn 2, Issue , 2012, Pages 1671-1678

  Matuszek, Cynthia ^a   FitzGerald, Nicholas ^a   Zettlemoyer, Luke ^a   Bo, Liefeng ^a   Fox, Dieter ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CATEGORIAL GRAMMAR; JOINT MODELS; LANGUAGE GROUNDING; LANGUAGE MODEL; NATURAL LANGUAGES; PERCEPTION MODEL; PHYSICAL CHARACTERISTICS; PHYSICAL WORLD; TASK PERFORMANCE;

COMPUTATIONAL LINGUISTICS;

LEARNING SYSTEMS;

EID: 84867118595     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Barnard, K., Duygulu, P., Forsyth, D., De Freitas, N., Blei, D.M., and Jordan, M.I. Matching words and pictures. The Journal of Machine Learning Research, 3: 1107-1135, 2003.
2. Bo, L., Ren, X., and Fox, D. Kernel descriptors for visual recognition. In Neural Information Processing Systems (NIPS), 2010.
3. Bo, L., Ren, X., and Fox, D. Depth kernel descriptors for object recognition. In IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems (IROS), 2011.
4. Chen, D.L. and Mooney, R.J. Learning to interpret natural language navigation instructions from observations. In Proc. of the 25th AAAI Conf. on Artificial Intelligence (AAAI-2011), pp. 859-865, August 2011.
5. Clarke, J., Goldwasser, D., Chang, M., and Roth, D. Driving semantic parsing from the world's response. In Proc. of the Conf. on Computational Natural Language Learning, 2010.
6. Farhadi, A., Endres, I., Hoiem, D., and Forsyth, D. Describing objects by their attributes. In IEEE Conf. on Computer Vision and Pattern Recognition, 2009.
7. Felzenszwalb, P., Girshick, R., McAllester, D., and Ramanan, D. Object detection with discriminatively trained part based models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(9):1627-1645, 2009.
8. Goldwasser, D., Reichart, R., Clarke, J., and Roth, D. Confidence driven unsupervised semantic parsing. In Proceedings. of the Association of Computational Linguistics, 2011.
9. Gorniak, P. and Roy, D. Understanding complex visually referring utterances. In Proc. of the HLT-NAACL 2003 Workshop on Learning Word Meaning from Non-Linguistic Data, 2003.
10. He, Y. and Young, S. Spoken language understanding using the hidden vector state model. Speech Communication, 48(3-4), 2006.
11. Johnson, A. and Hebert, M. Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(5), 1999.
12. Kwiatkowski, T., Zettlemoyer, L.S., Goldwater, S., and Steedman, M. Inducing probabilistic CCG grammars from logical form with higher-order unification. In Proc. of the Conf. on Empirical Methods in Natural Language Processing, 2010.
13. Kwiatkowski, T., Zettlemoyer, L.S., Goldwater, S., and Steedman, M. Lexical generalization in CCG grammar induction for semantic parsing. In Proc. of the Conf. on Empirical Methods in Natural Language Processing, 2011.
14. Lee, H., Grosse, R., Ranganath, R., and Ng, A. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In Proc. of the Int'l Conf. on Machine Learning (ICML), 2009.
15. Liang, P., Jordan, M.I., and Klein, D. Learning dependency-based compositional semantics. In Proc. of the Association for Computational Linguistics, 2011.
16. Lowe, D. Distinctive image features from scale-invariant keypoints. Int'l Journal of Computer Vision (IJCV), 60:91-110, 2004.
17. Matuszek, C., Herbst, E., Zettlemoyer, L., and Fox, D. Learning to parse natural language commands to a robot control system. In Proc. of the 13th Int'l Symposium on Experimental Robotics (ISER), June 2012.
18. Mavridis, N. and Roy, D. Grounded situation models for robots: Where words and percepts meet. In IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems, 2006.
19. Parikh, D. and Grauman, K. Relative attributes. In Int'l Conf. on Computer Vision, 2011.
20. Quattoni, A., Wang, S., p Morency, L., Collins, M., Darrell, T., and Csail, Mit. Hidden-state conditional random fields. In IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007.
21. Reckman, H., Orkin, J., and Roy, D. Learning meanings of words and constructions, grounded in a virtual game. In Proc. of the 10th Conf. on Natural Language Processing (KONVENS), 2010.
22. Tellex, S., Kollar, T., Dickerson, S., Walter, M.R., Banerjee, A.G., Teller, S., and Roy, N. Understanding natural language commands for robotic navigation and mobile manipulation. In Proc. of the National Conf. on Artificial Intelligence (AAAI), August 2011.
23. Wong, Y.W. and Mooney, R.J. Learning synchronous grammars for semantic parsing with lambda calculus. In Proc. of the Ass'n for Computational Linguistics, 2007.
24. Yang, J., Yu, K., Gong, Y., and Huang, T. Linear spatial pyramid matching using sparse coding for image classification. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2009.
25. Yu, K. and Zhang, T. Improved local coordinate coding using local tangents. In Proc. of the Int'l Conf. on Machine Learning (ICML), 2010.
26. Zelle, J.M. and Mooney, R.J. Learning to parse database queries using inductive logic programming. In Proc. of the National Conf. on Artificial Intelligence, 1996.
27. Zettlemoyer, L.S. and Collins, M. Learning to map sentences to logical form: Structured classification with probabilistic categorial grammars. In Proc. of the Conf. on Uncertainty in Artificial Intelligence, 2005.