Unsupervised visual representation learning by context prediction

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2015 International Conference on Computer Vision, ICCV 2015, Issue , 2015, Pages 1422-1430

  Doersch, Carl ^a,b   Gupta, Abhinav ^a   Efros, Alexei A ^b  

^a Carnegie Mellon University   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SCIENCE; COMPUTERS; ELECTRICAL ENGINEERING;

CONTEXT PREDICTIONS; FEATURE REPRESENTATION; IMAGE COLLECTIONS; SPATIAL CONTEXT; STATE-OF-THE-ART PERFORMANCE; TRAINING SETS; VISUAL REPRESENTATIONS; VISUAL SIMILARITY;

COMPUTER VISION;

EID: 84973916088     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2015.167     Document Type: Conference Paper

References (56)

1. E. H. Adelson. On seeing stuff: The perception of materials by humans and machines. In Photonics West 2001-Electronic Imaging, 2001. 2
2. P. Agrawal, R. Girshick, and J. Malik. Analyzing the performance of multilayer neural networks for object recognition. In ECCV. 2014. 5, 6
3. R. K. Ando and T. Zhang. A framework for learning predictive structures from multiple tasks and unlabeled data. JMLR, 2005. 1
4. Y. Bengio, E. Thibodeau-Laufer, G. Alain, and J. Yosinski. Deep generative stochastic networks trainable by backprop. ICML, 2014. 2
5. D. Brewster and A. D. Bache. Treatise on optics. Blanchard and Lea, 1854. 3
6. O. Chum, M. Perdoch, and J. Matas. Geometric min-hashing: Finding a (thick) needle in a haystack. In CVPR, 2009. 3
7. O. Chum, J. Philbin, J. Sivic, M. Isard, and A. Zisserman. Total recall: Automatic query expansion with a generative feature model for object retrieval. In ICCV, 2007. 6
8. R. G. Cinbis, J. Verbeek, and C. Schmid. Segmentation driven object detection with Fisher vectors. In ICCV, 2013. 6
9. R. Collobert and J. Weston. A unified architecture for natural language processing: Deep neural networks with multitask learning. In ICML, 2008. 1, 2
10. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In CVPR, 2009. 4
11. C. Doersch, A. Gupta, and A. A. Efros. Mid-level visual element discovery as discriminative mode seeking. In NIPS, 2013. 3
12. C. Doersch, A. Gupta, and A. A. Efros. Context as supervisory signal: Discovering objects with predictable context. In ECCV. 2014. 2, 7, 8
13. C. Doersch, S. Singh, A. Gupta, J. Sivic, and A. A. Efros. What makes Paris look like Paris? SIGGRAPH, 2012. 3, 6, 7
14. J. Domke, A. Karapurkar, and Y. Aloimonos. Who killed the directed model? In CVPR, 2008. 2
15. M. Everingham, L. Van Gool, C. K. Williams, J. Winn, and A. Zisserman. The pascal visual object classes (voc) challenge. IJCV, 2010. 5
16. A. Faktor and M. Irani. clustering by composition-unsupervised discovery of image categories. In ECCV. 2012. 3
17. P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan. Object detection with discriminatively trained part-based models. PAMI, 2010. 6
18. P. Földiák. Learning invariance from transformation sequences. Neural Computation, 1991. 3
19. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014. 1, 5, 6
20. K. Grauman and T. Darrell. Unsupervised learning of categories from sets of partially matching image features. In CVPR, 2006. 3, 6
21. K. Heath, N. Gelfand, M. Ovsjanikov, M. Aanjaneya, and L. J. Guibas. Image webs: Computing and exploiting connectivity in image collections. In CVPR, 2010. 3
22. G. Hinton, S. Osindero, and Y.-W. Teh. A fast learning algorithm for deep belief nets. Neural computation, 2006. 2
23. G. E. Hinton, P. Dayan, B. J. Frey, and R. M. Neal. The "wakesleep" algorithm for unsupervised neural networks. Proceedings. IEEE, 1995. 2
24. S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. ArXiv preprint arXiv:1502. 03167, 2015. 5
25. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. In ACM-MM, 2014. 4
26. M. Juneja, A. Vedaldi, C. V. Jawahar, and A. Zisserman. Blocks that shout: Distinctive parts for scene classification. In CVPR, 2013. 3
27. G. Kim, C. Faloutsos, and M. Hebert. Unsupervised modeling of object categories using link analysis techniques. In CVPR, 2008. 3
28. D. P. Kingma and M. Welling. Auto-encoding variational bayes. 2014. 2
29. A. Krizhevsky, I. Sutskever, and G. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, 2012. 1, 3
30. H. Larochelle and I. Murray. The neural autoregressive distribution estimator. In AISTATS, 2011. 2
31. Q. V. Le. Building high-level features using large scale unsupervised learning. In ICASSP, 2013. 2
32. H. Lee, A. Battle, R. Raina, and A. Y. Ng. Efficient sparse coding algorithms. In NIPS, 2006. 2
33. Y. J. Lee and K. Grauman. Foreground focus: Unsupervised learning from partially matching images. IJCV, 2009. 3
34. Q. Li, J. Wu, and Z. Tu. Harvesting mid-level visual concepts from large-scale internet images. In CVPR, 2013. 3
35. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. ArXiv preprint arXiv:1411. 4038, 2014. 6
36. T. Malisiewicz and A. Efros. Beyond categories: The visual memex model for reasoning about object relationships. In NIPS, 2009. 2
37. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. Distributed representations of words and phrases and their compositionality. In NIPS, 2013. 1, 2
38. D. Okanohara and J. Tsujii. A discriminative language model with pseudo-negative samples. In ACL, 2007. 1, 2
39. B. A. Olshausen and D. J. Field. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 1996. 2
40. N. Payet and S. Todorovic. From a set of shapes to object discovery. In ECCV. 2010. 3
41. T. Quack, B. Leibe, and L. Van Gool. World-scale mining of objects and events from community photo collections. In CIVR, 2008. 3, 6
42. K. Rematas, B. Fernando, F. Dellaert, and T. Tuytelaars. Dataset fingerprints: Exploring image collections through data mining. In CVPR, 2015. 3, 6
43. D. J. Rezende, S. Mohamed, and D. Wierstra. Stochastic backpropagation and approximate inference in deep generative models. ICML, 2014. 2
44. B. C. Russell, W. T. Freeman, A. A. Efros, J. Sivic, and A. Zisserman. Using multiple segmentations to discover objects and their extent in image collections. In CVPR, 2006. 2, 6
45. R. Salakhutdinov and G. E. Hinton. Deep boltzmann machines. In ICAIS, 2009. 2
46. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. CoRR, 2014. 6
47. S. Singh, A. Gupta, and A. A. Efros. Unsupervised discovery of mid-level discriminative patches. In ECCV, 2012. 3, 6, 7
48. J. Sivic, B. C. Russell, A. A. Efros, A. Zisserman, andW. T. Freeman. Discovering objects and their location in images. In ICCV, 2005. 2, 6
49. J. Sun and J. Ponce. Learning discriminative part detectors for image classification and cosegmentation. In ICCV, 2013. 3
50. L. Theis and M. Bethge. Generative image modeling using spatial lstms. In NIPS, 2015. 2
51. B. Thomee, D. A. Shamma, G. Friedland, B. Elizalde, K. Ni, D. Poland, D. Borth, and L.-J. Li. The new data and new challenges in multimedia research. ArXiv preprint arXiv:1503. 01817, 2015. 6
52. A. Torralba and A. A. Efros. Unbiased look at dataset bias. In CVPR, 2011. 6, 7
53. P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol. Extracting and composing robust features with denoising autoencoders. In ICML, 2008. 2
54. X. Wang and A. Gupta. Unsupervised learning of visual representations using videos. In ICCV, 2015. 3
55. X. Wang, M. Yang, S. Zhu, and Y. Lin. Regionlets for generic object detection. In ICCV, 2013. 6
56. L. Wiskott and T. J. Sejnowski. Slow feature analysis:unsupervised learning of invariances. Neural Computation, 2002. 3