Annotation tools and knowledge representation for a text-to-scene system

24th International Conference on Computational Linguistics - Proceedings of COLING 2012: Technical Papers

Volumn , Issue , 2012, Pages 679-694

  Coyne, Bob ^a   Klapheke, Alex ^a   Rouhizadeh, Masoud ^b   Sproat, Richard ^c   Bauer, Daniel ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^c GOOGLE INC   (United States)

Author keywords

Crowdsourcing; Frame semantics; Linguistic annotation; Text to scene conversion; Visual semantics; World knowledge

Indexed keywords

CROWDSOURCING; FRAME SEMANTICS; LINGUISTIC ANNOTATIONS; TEXT TO SCENES; VISUAL SEMANTICS; WORLD KNOWLEDGE;

DATA MINING; KNOWLEDGE REPRESENTATION; SEMANTICS;

COMPUTATIONAL LINGUISTICS;

EID: 84876814237     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Bangalore, S., Boullier, P., Nasr, A., Rambow, O., and Sagot, B. (2009). Mica: A probabilistic dependency parser based on tree insertion grammars application note. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers, pages 185-188. Association for Computational Linguistics.
2. Coyne, B., Bauer, D., and Rambow, O. (2011a). VigNet: Grounding Language in Graphics using Frame Semantics. In Workshop on Relational Models of Semantics (RELMS) at ACL.
3. Coyne, B., Schudel, C., Bitz, M., and Hirschberg, J. (2011b). Evaluating a Text-to-Scene Generation System as an Aid to Literacy. In Workshop on Speech and Language Technology in Education (SlaTE) at Interspeech 2011.
4. Coyne, B. and Sproat, R. (2001). Wordseye: An automatic text-to-scene conversion system. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pages 487- 496, Los Angeles, CA, USA.
5. Coyne, B., Sproat, R., and Hirschberg, J. (2010). Spatial relations in text-to-scene conversion. In Computational Models of Spatial Language Interpretation, Workshop at Spatial Cognition 2010, pages 9-16, Mt. Hood, OR, USA.
6. Fellbaum, C. (1998). WordNet: An electronic lexical database. MIT Press.
7. Gibson, J. (1977). The Theory of Affordances. In Shaw, R. and Bransford, J., editor, Perceiving, acting, and knowing: Toward an ecological psychology, pages 67-82. Erlbaum, Hillsdale, NJ.
8. Haugeland, J. (1995). Mind embodied and embedded. In Houng, Y. and Ho, J., editors, Mind and Cognition. Academia Sinica, Taipei.
9. Jackendoff, R. (1985). Semantics and cognition, volume 8. The MIT Press.
10. Kipper, K., Dang, H. T., and Palmer, M. (2000). Class-Based Construction of a Verb Lexicon. In Proceedings of AAAI 2000, Austin, TX.
11. Miller, G. and Johnson-Laird, P. (1976). Language and perception. Belknap Press.
12. Norman, D. A. (1988). The Psychology of Everyday Things. Basic Books.
13. Rosch, E. (1973). Natural categories. Cognitive psychology, 4(3):328-350.
14. Rouhizadeh, M., Bauer, D., Coyne, B., Rambow, O., and Sproat, R. (2011a). Collecting spatial information for locations in a text-to-scene conversion system. In Proceedings of the Workshop on Computational Models of Spatial Language Interpretation and Generation (CoSLI 2011), Boston, MA.
15. Rouhizadeh, M., Bowler, M., Sproat, R., and Coyne, B. (2010). Data collection and normalization for building the scenario-based lexical knowledge resource of a text-to-scene conversion system. In Proceedings of SMAP 2010: 5th International Workshop on Semantic Media Adaptation and Personalization, pages 25 -30.
16. Limassol, Cyprus., Rouhizadeh, M., Bowler, M., Sproat, R., and Coyne, B. (2011b). Collecting semantic data by Mechanical Turk for the lexical knowledge resource of a text-to-picture generating system. In Bos, J. and Pulman, S., editors, Proceedings of the Ninth International Conference on Computational Semantics (IWCS 2011), The University of Oxford.
17. Rouhizadeh, M., Coyne, B., and Sproat, R. (2011c). Collecting semantic information for locations in the scenario-based lexical knowledge resource of a text-to-scene conversion system. In König, A., Dengel, A., Hinkelmann, K., Kise, K., Howlett, R., and Jain, L., editors, Knowledge-Based and Intelligent Information and Engineering Systems, volume 6884 of Lecture Notes in Computer Science, pages 378-387. Springer Berlin/Heidelberg.
18. Ruppenhofer, J., Ellsworth, M., Petruck, M., Johnson, C. R., and Scheffczyk, J. (2010). Framenet II: Extended Theory and Practice. ICSI Berkeley.
19. Schank, R. C. and Abelson, R. (1977). Scripts, Plans, Goals, and Understanding. Earlbaum, Hillsdale, NJ.
20. Sproat, R. (2001). Inferring the environment in a text-to-scene conversion system. In Proceedings of The First International Conference on Knowledge Capture, pages 147-154, Victoria, BC, Canada.