The more you know: using knowledge graphs for image classification

Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017

Volumn 2017-January, Issue , 2017, Pages 20-28

  Marino, Kenneth ^a   Salakhutdinov, Ruslan ^a   Gupta, Abhinav ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTER VISION; GRAPHIC METHODS; IMAGE ENHANCEMENT;

COMPUTER VISION ALGORITHMS; GRAPH SEARCH; KNOWLEDGE GRAPHS; MULTI LABEL CLASSIFICATION; PRIOR KNOWLEDGE; STANDARD NEURAL; VISUAL CONCEPT; VISUAL WORLD;

IMAGE CLASSIFICATION;

EID: 85041905615     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2017.10     Document Type: Conference Paper

References (39)

1. K. M. Borgwardt and H.-P. Kriegel. Shortest-path kernels on graphs. ICDM, 2005.
2. J. Bruna, W. Zaremba, A. Szlam, and Y. LeCun. Spectral networks and locally connected networks on graphs. arXiv preprint arXiv:1312.6203, 2013.
3. A. Carlson, J. Betteridge, B. Kisiel, B. Settles, E. R. Hruschka, and T. M. Mitchell. Toward an architecture for neverending language learning. AAAI, 2010.
4. X. Chen, A. Shrivastava, and A. Gupta. Neil: Extracting visual knowledge from web data. CVPR, 2013.
5. K. Duan, D. Parikh, D. Crandall, and K. Grauman. Discovering localized attributes for fine-grained recognition. CVPR, 2012.
6. D. K. Duvenaud, D. Maclaurin, J. Iparraguirre, R. Bombarell, T. Hirzel, A. Aspuru-Guzik, and R. P. Adams. Convolutional networks on graphs for learning molecular fingerprints. NIPS, 2015.
7. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results. http://www.pascalnetwork.org/challenges/VOC/voc2012/wortahop/index.html.
8. A. Farhadi, I. Endres, D. Hoiem, and D. Forsyth. Describing objects by their attributes. CVPR, 2009.
9. M. Gori, G. Monfardini, and F. Scarselli. A new model for learning in graph domains. IEEE International Joint Conference on Neural Networks, 2, 2005.
10. K. Guu, J. Miller, and P. Liang. Traversing knowledge graphs in vector space. In Empirical Methods in Natural Language Processing (EMNLP), 2015.
11. M. Henaff, J. Bruna, and Y. LeCun. Deep convolutional networks on graph-structured data. arXiv preprint arXiv:1506.05163, 2015.
12. J. Johnson, R. Krishna, M. Stark, L.-J. Li, D. A. Shamma, M. S. Bernstein, and L. Fei-Fei. Image retrieval using scene graphs. CVPR, 2015.
13. D. P. Kingma and J. L. Ba. Adam: A method for stochastic optimization. ICLR, 2015.
14. R. I. Kondor and J. Lafferty. Diffusion kernels on graphs and other discrete input spaces. ICML, 2, 2002.
15. R. Krishna, Y. Zhu, O. Groth, J. Johnson, K. Hata, J. Kravitz, S. Chen, Y. Kalantidis, L.-J. Li, D. A. Shamma, M. Bernstein, and L. Fei-Fei. Visual genome: Connecting language and vision using crowdsourced dense image annotations. 2016.
16. C. H. Lampert, H. Nickisch, and S. Harmeling. Attributebased classification for zero-shot visual object categorization. TPAMI, 2014.
17. N. Lao, T. Mitchell, and W. W. Cohen. Random walk inference and learning in a large scale knowledge base. NIPS, 2011.
18. Y. Li and R. Zemel. Gated graph sequence neural networks. ICLR, 2016.
19. T. Lin, M. Maire, S. J. Belongie, R. B. Girshick, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. L. Zitnick. Microsoft COCO: common objects in context. ECCV, 2014.
20. T. Malisiewicz and A. Efros. Beyond categories: The visual memex model for reasoning about object relationships. NIPS, 2009.
21. V. D. Massa, G. Monfardini, L. Sarti, F. Scarselli, M. Maggini, and M. Gori. A comparison between recursive neural networks and graph neural networks. IEEE International Joint Conference on Neural Network Proceedings, 2006.
22. A. Micheli. Neural network for graphs: A contextual constructive approach. IEEE Transactions on Neural Networks, 2009.
23. G. A. Miller. Wordnet: A lexical database for english. ACM, 38, 1995.
24. I. Misra, C. L. Zitnick, M. Mitchell, and R. Girshick. Seeing through the Human Reporting Bias: Visual Classifiers from Noisy Human-Centric Labels. In CVPR, 2016.
25. M. Niepert, M. Ahmed, and K. Kutzkov. Learning convolutional neural networks for graphs. arXiv preprint arXiv:1605.05273, 2016.
26. F. Orsini, P. Frasconi, and L. D. Raedt. Graph invariant kernels. IJCAI, 2015.
27. Pinar, Yanardag, and S. V N. Vishwanathan. Deep graph kernels. KDDM, 2015.
28. S. Ren, K. He, R. Girshick, and J. Sun. Faster R-CNN: Towards real-time object detection with region proposal networks. NIPS, 2015.
29. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. ImageNet Large Scale Visual Recognition Challenge. IJCV, 115 (3) : 211-252, 2015.
30. F. Sadeghi, S. K. Divvala, and A. Farhadi. Viske: Visual knowledge extraction and question answering by visual verification of relation phrases. CVPR, 2015.
31. F. Scarselli, M. Gori, A. C. Tsoi, and G. Monfardini. The graph neural network model. IEEE Transactions on Neural Networks, 2009.
32. N. Shervashidze, P. Schweitzer, E. J. van Leeuwen, K. Mehlhorn, and K. M. Borgwardt. Weisfeiler-lehman graph kernels. JMLR, 2011.
33. N. Shervashidze, S. V. N. Vishwanathan, T. H. Petri, K. Mehlhorn, and K. M. Borgwardt. Efficient graphlet kernels for large graph comparison. AISTATS, 5, 2009.
34. A. Shrivastava, S. Singh, and A. Gupta. Constrained semisupervised learning using attributes and comparative attributes. ECCV, 2012.
35. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv. 1409.1556, 2014.
36. S. V N. Vishwanathan, N. N. Schraudolph, R. Kondor, and K. M. Borgwardt. Graph kernels. JMLR, 2010.
37. X. Zhu, D. Anguelov, and D. Ramanan. Capturing long-tail distributions of object subcategories. CVPR, 2014.
38. Y. Zhu, A. Fathi, and L. Fei-Fei. Reasoning about Object Affordances in a Knowledge Base Representation. In European Conference on Computer Vision, 2014.
39. Y. Zhu, C. Zhang, C. R, and L. Fei-Fei. Building a largescale multimodal knowledge base system for answering visual queries. 2015.