From red wine to red tomato: Composition with context

Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017

Volumn 2017-January, Issue , 2017, Pages 1160-1169

  Misra, Ishan ^a   Gupta, Abhinav ^a   Hebert, Martial ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; FRUITS; WINE;

BUILDING BLOCKES; COMPOSITIONALITY; CONTEXTUALITY; GENERALIZATION PERFORMANCE; LABELED DATA; SIMPLE METHOD; TRADITIONAL LEARNING; VISUAL CONCEPT;

PATTERN RECOGNITION;

EID: 85044323744     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2017.129     Document Type: Conference Paper

References (69)

1. M. Abeles, M. Diesmann, T. Flash, T. Geisel, M. Herrmann, and M. Teicher. Compositionality in neural control: an interdisciplinary study of scribbling movements in primates. Frontiers in computational neuroscience, 7, 2013.
2. Z. Akata, F. Perronnin, Z. Harchaoui, and C. Schmid. Label-embedding for attribute-based classification. In CVPR, 2013.
3. J. Almazán, A. Gordo, A. Fornés, and E. Valveny. Word spotting and recognition with embedded attributes. TPAMI, 36(12), 2014.
4. J. Andreas, M. Rohrbach, T. Darrell, and D. Klein. Learning to compose neural networks for question answering. In NAACL, 2016.
5. J. Andreas, M. Rohrbach, T. Darrell, and D. Klein. Neural module networks. In CVPR, pages 39-48, 2016.
6. I. Biederman. Recognition-by-components: a theory of human image understanding. Psychological review, 94(2):115, 1987.
7. R. Caruana. Multitask learning. In Learning to learn, pages 95-133. Springer, 1998.
8. J. Choi, M. Rastegari, A. Farhadi, and L. S. Davis. Adding unlabeled samples to categories by learned attributes. In CVPR, 2013.
9. J. Deng, N. Ding, Y. Jia, A. Frome, K. Murphy, S. Bengio, Y. Li, H. Neven, and H. Adam. Large-scale object classification using label relation graphs. In ECCV. Springer, 2014.
10. M. Elhoseiny, B. Saleh, and A. Elgammal. Write a classifier: Zero-shot learning using purely textual descriptions. In ICCV, pages 2584-2591, 2013.
11. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The PASCAL Visual Object Classes Challenge 2007 (VOC2007).
12. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin. Liblinear: A library for large linear classification. JMLR, 2008.
13. A. Farhadi, I. Endres, D. Hoiem, and D. Forsyth. Describing objects by their attributes. In CVPR. IEEE, 2009.
14. L. Fei-Fei, R. Fergus, and P. Perona. One-shot learning of object categories. TPAMI, 28(4), 2006.
15. P. Felzenszwalb, D. McAllester, and D. Ramanan. A discriminatively trained, multiscale, deformable part model. In Computer Vision and Pattern Recognition, 2008.
16. A. Ferencz, E. G. Learned-Miller, and J. Malik. Building a classification cascade for visual identification from one example. In ICCV, Volume 1. IEEE, 2005.
17. M. Fink. Object classification from a single example utilizing class relevance metrics. NIPS, 17, 2005.
18. J. A. Fodor. The language of thought, Volume 5. Harvard University Press, 1975.
19. J. A. Fodor and Z. W. Pylyshyn. Connectionism and cognitive architecture: A critical analysis. Cognition, 28(1-2):3-71, 1988.
20. G. Frege. Sense and reference. The philosophical review, 57(3):209-230, 1948.
21. A. Frome, G. S. Corrado, J. Shlens, S. Bengio, J. Dean, T. Mikolov, et al. Devise: A deep visual-semantic embedding model. In NIPS, pages 2121-2129, 2013.
22. X. Glorot and Y. Bengio. Understanding the difficulty of training deep feedforward neural networks. In Aistats, Volume 9, pages 249-256, 2010.
23. U. Grenander. General pattern theory-A mathematical study of regular structures. Clarendon Press, 1993.
24. S. Guadarrama, N. Krishnamoorthy, G. Malkarnenkar, S. Venugopalan, R. Mooney, T. Darrell, and K. Saenko. Youtube2text: Recognizing and describing arbitrary activities using semantic hierarchies and zero-shot recognition. In ICCV, pages 2712-2719, 2013.
25. F. Han and S.-C. Zhu. Bottom-up/top-down image parsing with attribute grammar. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1):59-73, 2009.
26. K. He, X. Zhang, S. Ren, and J. Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In ICCV, pages 1026-1034, 2015.
27. D. D. Hoffman and W. A. Richards. Parts of recognition. Cognition, 18(1):65-96, 1984.
28. P. Isola, J. J. Lim, and E. H. Adelson. Discovering states and transformations in image collections. In CVPR, 2015.
29. D. Jayaraman, F. Sha, and K. Grauman. Decorrelating semantic visual attributes by resisting the urge to share. In CVPR, 2014.
30. A. Karpathy, A. Joulin, and F. F. F. Li. Deep fragment embeddings for bidirectional image sentence mapping. In NIPS, 2014.
31. V. Krishnan and D. Ramanan. Tinkering under the hood: Interactive zero-shot learning with net surgery. arXiv preprint arXiv:1612.04901, 2016.
32. B. M. Lake, R. Salakhutdinov, J. Gross, and J. B. Tenenbaum. One shot learning of simple visual concepts. In Proceedings of the 33rd Annual Conference of the Cognitive Science Society, Volume 172, page 2, 2011.
33. B. M. Lake, R. Salakhutdinov, and J. B. Tenenbaum. Concept learning as motor program induction: A large-scale empirical study. In Proceedings of the 34th Annual Conference of the Cognitive Science Society, pages 659-664, 2012.
34. B. M. Lake, T. D. Ullman, J. B. Tenenbaum, and S. J. Gershman. Building machines that learn and think like people. arXiv preprint arXiv:1604.00289, 2016.
35. C. H. Lampert, H. Nickisch, and S. Harmeling. Learning to detect unseen object classes by between-class attribute transfer. In CVPR. IEEE, 2009.
36. Q. V. Le, N. Jaitly, and G. E. Hinton. A simple way to initialize recurrent networks of rectified linear units. arXiv preprint arXiv:1504.00941, 2015.
37. Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel. Backpropagation applied to handwritten zip code recognition. Neural computation, 1, 1989.
38. J. Lei Ba, K. Swersky, S. Fidler, et al. Predicting deep zero-shot convolutional neural networks using textual descriptions. In CVPR, 2015.
39. C. Lu, R. Krishna, M. Bernstein, and L. Fei-Fei. Visual relationship detection with language priors. In ECCV, 2016.
40. J. Mao, X. Wei, Y. Yang, J. Wang, Z. Huang, and A. L. Yuille. Learning like a child: Fast novel visual concept learning from sentence descriptions of images. In ICCV, pages 2533-2541, 2015.
41. T. Mensink, E. Gavves, and C. G. Snoek. Costa: Cooccurrence statistics for zero-shot classification. In CVPR, 2014.
42. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. Distributed representations of words and phrases and their compositionality. In NIPS, 2013.
43. I. Misra, C. L. Zitnick, M. Mitchell, and R. Girshick. Seeing through the Human Reporting Bias: Visual Classifiers from Noisy Human-Centric Labels. In CVPR, 2016.
44. E. Mjolsness. Connectionist grammars for high-level vision. Artificial Intelligence and Neural Networks: Steps Toward Principled Integration, pages 423-451, 1994.
45. S. J. Pan and Q. Yang. A survey on transfer learning. IEEE Transactions on knowledge and data engineering, 22(10):1345-1359, 2010.
46. D. Parikh and K. Grauman. Relative attributes. In ICCV. IEEE, 2011.
47. N. Patricia and B. Caputo. Learning to learn, from transfer learning to domain adaptation: A unifying perspective. In CVPR, pages 1442-1449, 2014.
48. G. Patterson and J. Hays. Coco attributes: Attributes for people, animals, and objects. In ECCV, 2016.
49. S. Reed, Z. Akata, B. Schiele, and H. Lee. Learning deep representations of fine-grained visual descriptions. arXiv preprint arXiv:1605.05395, 2016.
50. B. Romera-Paredes and P. Torr. An embarrassingly simple approach to zero-shot learning. In ICML, 2015.
51. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. ImageNet Large Scale Visual Recognition Challenge. IJCV, 115, 2015.
52. F. Sadeghi, C. L. Zitnick, and A. Farhadi. Visalogy: Answering visual analogy questions. In NIPS, 2015.
53. M. A. Sadeghi and A. Farhadi. Recognition using visual phrases. In CVPR. IEEE, 2011.
54. Z. Si and S.-C. Zhu. Learning and-or templates for object recognition and detection. IEEE transactions on pattern analysis and machine intelligence, 35(9):2189-2205, 2013.
55. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
56. K. Tang, V. Ramanathan, L. Fei-Fei, and D. Koller. Shifting weights: Adapting object detectors from image to video. In NIPS, 2012.
57. J. Thomason, S. Venugopalan, S. Guadarrama, K. Saenko, and R. J. Mooney. Integrating language and vision to generate natural language descriptions of videos in the wild. In COLING, Volume 2, page 9, 2014.
58. S. Thrun and T. M. Mitchell. Learning one more thing. Technical report, DTIC Document, 1994.
59. Z. Tu, X. Chen, A. L. Yuille, and S.-C. Zhu. Image parsing: Unifying segmentation, detection, and recognition. International Journal of computer vision, 63(2):113-140, 2005.
60. Y.-X. Wang and M. Hebert. Learning to learn: Model regression networks for easy small sample learning. In ECCV. Springer, 2016.
61. T. Wu and S.-C. Zhu. A numerical study of the bottom-up and top-down inference processes in and-or graphs. International journal of computer vision, 93(2):226-252, 2011.
62. Y. Yang and D. Ramanan. Articulated pose estimation with flexible mixtures-of-parts. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 1385-1392.
63. A. Yuille and R. Mottaghi. Complexity of representation and inference in compositional models with part sharing. Journal of Machine Learning Research, 17(11):1-28, 2016.
64. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In ECCV, pages 818-833. Springer, 2014.
65. Z. Zhang and V. Saligrama. Zero-shot learning via semantic similarity embedding. In ICCV, 2015.
66. L. Zhu, Y. Chen, Y. Lu, C. Lin, and A. Yuille. Max margin and/or graph learning for parsing the human body. In Computer Vision and Pattern Recognition, 2008.
67. L. Zhu, Y. Chen, A. Yuille, and W. Freeman. Latent hierarchical structural learning for object detection. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 1062-1069.
68. L. L. Zhu, Y. Chen, and A. Yuille. Recursive compositional models for vision: Description and review of recent work. Journal of Mathematical Imaging and Vision, 41(1-2):122-146, 2011.
69. S.-C. Zhu and D. Mumford. A stochastic grammar of images. Now Publishers Inc, 2007.