Learning common sense through visual abstraction

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2015 International Conference on Computer Vision, ICCV 2015, Issue , 2015, Pages 2542-2550

  Vedantam, Ramakrishna ^a   Lin, Xiao ^a   Batra, Tanmay ^b   Zitnick, C Lawrence ^c   Parikh, Devi ^a  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ABSTRACTING; INTELLIGENT BUILDINGS; SEMANTICS;

COMMON SENSE; COMMONSENSE KNOWLEDGE; INTELLIGENT MACHINE; PHOTOREALISM; PIXEL INFORMATION; SEMANTIC FEATURES; VISUAL CONTENT; VISUAL WORLD;

COMPUTER VISION;

EID: 84973926486     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2015.292     Document Type: Conference Paper

References (38)

1. S. Antol, A. Agrawal, J. Lu, M. Mitchell, D. Batra, C. L. Zitnick, and D. Parikh. VQA: visual question answering. CoRR, abs/1505. 00468, 2015. 4
2. S. Antol, C. L. Zitnick, and D. Parikh. Zero-shot learning via visual abstraction. In ECCV, 2014. 3, 6
3. A. C. Berg, T. L. Berg, H. Daume, J. Dodge, A. Goyal, X. Han, A. Mensch, M. Mitchell, A. Sood, K. Stratos, and K. Yamaguchi. Understanding and predicting importance in images. In CVPR, 2012. 2
4. K. Bollacker, C. Evans, P. Paritosh, T. Sturge, and J. Taylor. Freebase: A collaboratively created graph database for structuring human knowledge. In ACM SIGMOD, pages 1247-1250. ACM, 2008. 1, 2
5. A. Carlson, J. Betteridge, B. Kisiel, B. Settles, E. R. Hruschka Jr, and T. M. Mitchell. Toward an architecture for never-ending language learning. In AAAI, 2010. 1, 2
6. Y.-W. Chao, Z. Wang, R. Mihalcea, and J. Deng. Mining semantic affordances of visual object categories. In CVPR, 2015. 2
7. X. Chen, A. Shrivastava, and A. Gupta. Neil: Extracting visual knowledge from web data. In ICCV, 2013. 2
8. R. Davis, H. Shrobe, and P. Szolovits. What is a knowledge representation? AI magazine, 14 (1): 17, 1993. 1
9. S. Divvala, A. Farhadi, and C. Guestrin. Learning everything about anything: Webly-supervised visual concept learning. In CVPR, 2014. 2
10. S. K. Divvala, D. Hoiem, J. H. Hays, A. A. Efros, and M. Hebert. An empirical study of context in object detection. In CVPR, 2009. 2
11. X. Dong, E. Gabrilovich, G. Heitz, W. Horn, N. Lao, K. Murphy, T. Strohmann, S. Sun, andW. Zhang. Knowledge vault: A web-scale approach to probabilistic knowledge fusion. In ACM SIGKDD, pages 601-610. ACM, 2014. 2
12. O. Etzioni, A. Fader, J. Christensen, S. Soderland, and M. Mausam. Open information extraction: The second generation. In IJCAI, volume 11, pages 3-10, 2011. 2, 3
13. D. Ferrucci, E. Brown, J. Chu-Carroll, J. Fan, D. Gondek, A. A. Kalyanpur, A. Lally, J. W. Murdock, E. Nyberg, J. Prager, N. Schlaefer, and C. Welty. Building watson: An overview of the deepqa project. AI magazine, 31 (3): 59-79, 2010. 2
14. D. F. Fouhey, V. Delaitre, A. Gupta, A. A. Efros, I. Laptev, and J. Sivic. People watching: Human actions as a cue for single view geometry. In ECCV, 2012. 2
15. D. F. Fouhey and C. L. Zitnick. Predicting object dynamics in scenes. In CVPR, 2014. 3
16. J. Gordon and B. Van Durme. Reporting bias and knowledge acquisition. In Proceedings of the 2013 Workshop on Automated Knowledge Base Construction, AKBC '13, pages 25-30, New York, NY, USA, 2013. ACM. 1
17. H. Grabner, J. Gall, and L. Van Gool. What makes a chair a chair? In CVPR, 2011. 2
18. A. Gupta and L. S. Davis. Beyond nouns: Exploiting prepositions and comparative adjectives for learning visual classifiers. In ECCV, 2008. 2
19. J. Hays and A. A. Efros. Im2gps: estimating geographic information from a single image. In CVPR, 2008. 2
20. V. Hedau, D. Hoiem, and D. Forsyth. Recovering free space of indoor scenes from a single image. In CVPR, 2012. 2
21. J. Hoffart, F. M. Suchanek, K. Berberich, and G. Weikum. Yago2: A spatially and temporally enhanced knowledge base from wikipedia. Artificial Intelligence, 194: 28-61, 2013. 1
22. J. Johnson, R. Krishna, M. Stark, L.-J. Li, D. A. Shamma, M. Bernstein, and L. Fei-Fei. Image retrieval using scene graphs. In CVPR, 2015. 2
23. A. Khosla, B. An, J. J. Lim, and A. Torralba. Looking beyond the visible scene. In CVPR, 2014. 2
24. J. Lehmann, R. Isele, M. Jakob, A. Jentzsch, D. Kontokostas, P. N. Mendes, S. Hellmann, M. Morsey, P. van Kleef, S. Auer, and C. Bizer. DBpedia-a large-scale, multilingual knowledge base extracted from wikipedia. Semantic Web Journal, 2014. 1
25. T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. L. Zitnick. Microsoft coco: Common objects in context. In ECCV. 2014. 3
26. X. Lin and D. Parikh. Don't just listen, use your imagination: Leveraging visual common sense for non-visual tasks. In CVPR, 2015. 2, 3
27. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. Distributed representations of words and phrases and their compositionality. In NIPS, 2013. 2, 5
28. G. A. Miller. Wordnet: A lexical database for english. Communications of the ACM, 38 (11): 39-41, 1995. 1
29. J. Pennington, R. Socher, and C. D. Manning. Glove: Global vectors for word representation. EMNLP, 12, 2014. 2
30. L. Pickup, Z. Pan, D. Wei, Y. Shih, C. Zhang, A. Zisserman, B. Scholkopf, and W. Freeman. Seeing the arrow of time. In CVPR, 2014. 2
31. H. Pirsiavash, C. Vondrick, and A. Torralba. Inferring the why in images. CoRR, abs/1406. 5472, 2014. 2
32. F. Sadeghi, S. K. Divvala, and A. Farhadi. Viske: Visual knowledge extraction and question answering by visual verification of relation phrases. In CVPR, pages 1456-1464, 2015. 2
33. P. Singh, T. Lin, E. T. Mueller, G. Lim, T. Perkins, and W. L. Zhu. Open mind common sense: Knowledge acquisition from the general public. In On the Move to Meaningful Internet Systems 2002: CoopIS, DOA, and ODBASE, pages 1223-1237. Springer, 2002. 1
34. R. Speer and C. Havasi. Conceptnet 5: A large semantic network for relational knowledge. In The Peoples Web Meets NLP, pages 161-176. Springer, 2013. 1, 8
35. Y. Zhu, A. Fathi, and L. Fei-Fei. Reasoning about object affordances in a knowledge base representation. In ECCV, 2014. 2
36. C. Zitnick, R. Vedantam, and D. Parikh. Adopting abstract images for semantic scene understanding. PAMI, 2014. 3
37. C. L. Zitnick and D. Parikh. Bringing semantics into focus using visual abstraction. In CVPR, 2013. 3
38. C. L. Zitnick, D. Parikh, and L. Vanderwende. Learning the visual interpretation of sentences. In ICCV, 2013. 3, 6