Visual Relationship Detection with Internal and External Linguistic Knowledge Distillation

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2017-October, Issue , 2017, Pages 1068-1076

  Yu, Ruichi ^a   Li, Ang ^a   Morariu, Vlad I ^a   Davis, Larry S ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; DISTILLATION; PROBABILITY DISTRIBUTIONS; SEMANTICS;

CONDITIONAL PROBABILITY DISTRIBUTIONS; EXTERNAL KNOWLEDGE; LINGUISTIC KNOWLEDGE; SEMANTIC SPACE; STATE-OF-THE-ART METHODS; STRONG CORRELATION; TRAINING DATA; VISUAL MODEL;

LINGUISTICS;

EID: 85041910221     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2017.121     Document Type: Conference Paper

References (31)

1. A. Culotta and J. Sorensen. Dependency tree kernels for relation extraction. In ACL, Stroudsburg, PA, USA, 2004. Association for Computational Linguistics
2. B. Dai, Y. Zhang, and D. Lin. Detecting visual relationships with deep relational networks. CoRR, abs/1704.03114, 2017
3. J. Deng, N. Ding, Y. Jia, A. Frome, K. Murphy, S. Bengio, Y. Li, H. Neven, and H. Adam. Large-scale object classification using label relation graphs. In ECCV, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part I, pages 48-64, 2014
4. C. Galleguillos and S. Belongie. Context based object categorization: A critical survey. Comput. Vis. Image Underst., 114(6):712-722, June 2010
5. C. Galleguillos, A. Rabinovich, and S. Belongie. Object categorization using co-occurrence, location and appearance. In IEEE Conference on Computer Vision and Pattern Recognition, June 2008
6. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014
7. R. B. Girshick. Fast R-CNN. CoRR, abs/1504.08083, 2015
8. Z. GuoDong, S. Jian, Z. Jie, and Z. Min. Exploring various knowledge in relation extraction. In ACL, pages 427-434, Stroudsburg, PA, USA, 2005. Association for Computational Linguistics
9. G. E. Hinton, O. Vinyals, and J. Dean. Distilling the knowledge in a neural network. CoRR, abs/1503.02531, 2015
10. Z. Hu, X. Ma, Z. Liu, E. H. Hovy, and E. P. Xing. Harnessing deep neural networks with logic rules. In ACL, August 7-12, 2016, Berlin, Germany, Volume 1: Long Papers, 2016
11. Z. Hu, Z. Yang, R. Salakhutdinov, and E. P. Xing. Deep neural networks with massive learned knowledge. In EMNLP, Austin, Texas, USA, November 1-4, 2016, pages 1670-1679, 2016
12. M. Johnson, D. K. Duvenaud, A. Wiltschko, R. P. Adams, and S. R. Datta. Composing graphical models with neural networks for structured representations and fast inference. In D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon, and R. Garnett, editors, NIPS, pages 2946-2954. Curran Associates, Inc., 2016
13. R. Krishna, Y. Zhu, O. Groth, J. Johnson, K. Hata, J. Kravitz, S. Chen, Y. Kalantidis, L.-J. Li, D. A. Shamma, M. Bernstein, and L. Fei-Fei. Visual genome: Connecting language and vision using crowdsourced dense image annotations. 2016
14. L. Ladicky, C. Russell, P. Kohli, and P. H. S. Torr. Graph cut based inference with co-occurrence statistics. In Proceedings of the 11th European Conference on Computer Vision: Part V, ECCV'10, pages 239-253, Berlin, Heidelberg, 2010. Springer-Verlag
15. A. Li, J. Sun, J. Y. Ng, R. Yu, V. I. Morariu, and L. S. Davis. Generating holistic 3d scene abstractions for text-based image retrieval. CoRR, abs/1611.09392, 2016
16. J. Li, D. Jurafsky, and E. H. Hovy. When are tree structures necessary for deep learning of representations CoRR, abs/1503.00185, 2015
17. Y. Li, W. Ouyang, and X. Wang. ViP-CNN: A Visual Phrase Reasoning Convolutional Neural Network for Visual Relationship Detection, Feb. 2017
18. X. Liang, L. Lee, and E. P. Xing. Deep Variation-structured Reinforcement Learning for Visual Relationship and Attribute Detection, Mar. 2017
19. C. Lu, R. Krishna, M. Bernstein, and L. Fei-Fei. Visual relationship detection with language priors. In European Conference on Computer Vision, 2016
20. C. D. Manning, P. Raghavan, and H. Schütze. Introduction to Information Retrieval. Cambridge University Press, New York, NY, USA, 2008
21. T. Mensink, E. Gavves, and C. Snoek. Costa: Co-occurrence statistics for zero-shot classification. In Conference on Computer Vision and Pattern Recognition (CVPR), 2014
22. T. Mikolov, K. Chen, G. Corrado, and J. Dean. Efficient estimation of word representations in vector space. CoRR, abs/1301.3781, 2013
23. V. K. Nagaraja, V. I. Morariu, and L. S. Davis. Modeling context between objects for referring expression understanding. In European Conference on Computer Vision (ECCV), 2016
24. M. Pataki, M. Vajna, and A. C. Marosi. Wikipedia as text. ECRIM News, Special theme: Big Data:48-48, 04/2012 2012
25. B. A. Plummer, A. Mallya, C. M. Cervantes, J. Hockenmaier, and S. Lazebnik. Phrase localization and visual relationship detection with comprehensive linguistic cues. CoRR, abs/1611.06641, 2016
26. M. A. Sadeghi and A. Farhadi. Recognition using visual phrases. 2011
27. R. Salakhutdinov, A. Torralba, and J. B. Tenenbaum. Learning to share visual appearance for multiclass object detection. In CVPR, pages 1481-1488, 2011
28. S. Schuster, R. Krishna, A. Chang, L. Fei-Fei, and C. D. Manning. Generating semantically precise scene graphs from textual descriptions for improved image retrieval. In ACLWorkshop on Vision and Language (VL15), Lisbon, Portugal, September 2015
29. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409.1556, 2014
30. R. Yu, X. Chen, V. I. Morariu, and L. S. Davis. The role of context selection in object detection. In British Machine Vision Conference (BMVC), 2016
31. G. Zhou, M. Zhang, D. Hong, and J. Q. Zhu. Tree kernelbased relation extraction with context-sensitive structured parse tree information.