Improvements to Context Based Self-Supervised Learning

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2018, Pages 9339-9348

  Mundhenk, T Nathan ^a   Ho, Daniel ^a,b   Chen, Barry Y ^a  

^a LAWRENCE LIVERMORE NATIONAL LABORATORY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ABERRATIONS; BENCHMARKING; CLASSIFICATION (OF INFORMATION); COMPUTER VISION; NETWORK ARCHITECTURE; SUPERVISED LEARNING;

BASELINE METHODS; CHROMATIC ABERRATION; CLASSIFICATION TESTS; CONTEXT LEARNING; MID-LEVEL FEATURES; PERCENTAGE POINTS; POTENTIAL PROBLEMS; TRANSFER LEARNING;

MACHINE LEARNING;

EID: 85062826302     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2018.00973     Document Type: Conference Paper

References (49)

1. P. Agrawal, J. Carreira, and J. Malik. Learning to see by moving. In ICCV, 2015.
2. P. Bojanowski and A. Joulin. Unsupervised learning by predicting noise. In ICML, 2017.
3. P. Campr and M. Li. Imagenet-21k-inception. https: //github. com/dmlc/ mxnet-model-gallery/blob/ master/imagenet-21k-inception. md.
4. D. Cireşan, U. Meier, and J. Schmidhuber. Multi-column deep neural networks for image classification. In CoRR, 2012.
5. D. C. Cireşan, U. Meier, J. Masci, L. M. Gambardella, and J. Schmidhuber. High-performance neural networks for visual object classification. In CoRR, 2011.
6. Four keys to identifying birds. Cornell Lab of Ornithology: Bird Scope, 23 (2), 2009.
7. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In CVPR, 2009.
8. A. Dodge. Iain mteffect: Wikimedia public domain image. https: //commons. wikimedia. org/ wiki/File: Iain MTeffect. jpg.
9. C. Doersch, A. Gupta, and A. A. Efros. Unsupervised visual representation learning by context prediction. In ICCV, 2015.
10. C. Doersch and A. Zisserman. Multi-task self-supervised visual learning. In ICCV, 2017.
11. J. Donahue, P. Krähenbühl, and T. Darrell. Adversarial feature learning. In ICLR, 2017.
12. A. Dosovitskiy, P. Fischer, J. T. Springenberg, M. Riedmiller, and T. Brox. Discriminative unsupervised feature learning with exemplar convolutional neural networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38 (9): 1734-1747, 2015.
13. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The pascal visual object classes (voc) challenge. International Journal of Computer Vision, 88 (2): 303-338, June 2010.
14. R. Girshick. Fast r-cnn. In ICCV, 2015.
15. L. Gomez, Y. Patel, M. Rusiñol, D. Karatzas, and C. V. Jawahar. Self-supervised learning of visual features through embedding images into text topic spaces. In CVPR, 2017.
16. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In arXiv preprint arXiv: 1512. 03385, 2015.
17. G. Huang, Z. Liu, K. Q. Weinberger, and L. van der Maaten. Densely connected convolutional networks. In CVPR, 2017.
18. S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In ICML, 2015.
19. D. Jayaraman and K. Grauman. Learning image representation tied to ego-motion. In ICCV, 2015.
20. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. ArXiv preprint arXiv: 1408. 5093, 2014.
21. D. Kim, D. Cho, D. Yoo, and I. S. Kweon. Learning image representation by completing damaged jigsaw puzzles. In WACV, 2018.
22. P. Krähenbühl, C. Doersch, J. Donahue, and T. Darrell. Datadependent initializations of convolutional neural networks. In ICLR, 2016.
23. A. Krizhevsky, I. Sutskever, and G. E. Hinton. ImageNet classification with deep convolutional neural networks. In NIPS, 2013.
24. G. Larsson, M. Maire, and G. Shakhnarovich. Colorization as a proxy task for visual understanding. In CVPR, 2017.
25. H.-Y. Lee, J.-B. Huang, M. Singh, and M.-H. Yang. Unsupervised representation learning by sorting sequences. In ICCV, 2017.
26. D. Li, W.-C. Hung, J.-B. Huang, S. Wang, N. Ahuja, and M.-H. Yang. Unsupervised visual representation learning by graph-based consistent constraints supplementary material. In ECCV, 2016.
27. M. Livingstone. The First Stages of Processing Color and Luminance: Where and What., pages 46-67. Harry N. Abrams, New York, 2002.
28. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. In CVPR, 2015.
29. I. Misra, C. L. Zitnick, and M. Hebert. Shuffle and learn: Unsupervised learning using temporal order verification. In ECCV, 2016.
30. T. N. Mundhenk, G. Konjevod, W. A. Sakla, and K. Boakye. A large contextual dataset for classification, detection and counting of cars with deep learning. In ECCV, 2016.
31. M. Noroozi and P. Favaro. Unsupervised learning of visual representations by solving jigsaw puzzles. In ECCV, 2016.
32. M. Noroozi and P. Favaro. Unsupervised learning of visual representations by solving jigsaw puzzles. CoRR, abs/1603. 09246, 2016.
33. M. Noroozi, H. Pirsiavash, and P. Favaro. Representation learning by learning to count. In ICCV, 2017.
34. A. Owens, J. Wu, J. H. McDermott, W. T. Freeman, and A. Torralba. Ambient sound provides supervision for visuallearning. In ECCV, 2016.
35. D. Pathak, R. Girshick, P. Dollár, T. Darrell, and B. Hariharan. Learning features by watching objects move. In CVPR, 2017.
36. D. Pathak, P. Krähenbühl, J. Donahue, T. Darrell, and A. Efros. Context encoders: Feature learning by inpainting. In CVPR, 2016.
37. P. Simard, D. Steinkraus, and J. Platt. Best practices for convolutional neural networks applied to visual document analysis. In Proceedings of the Seventh International Conference on Document Analysis and Recognition, 2003.
38. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scaleimage recognition. In CoRR, 2014.
39. C. Szegedy, S. Ioffe, and V. Vanhoucke. Inception-v4, inception-resnet and the impact of residual connections on learning. In arXiv: 1602. 07261, 2016.
40. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In CVPR, 2015.
41. P. Thompson. Margaret thatcher: A new illusion. Perception, 9 (4): 483-484, 1980.
42. Umbert. Kolora aberacio: Wikimedia public domain image. https: //commons. wikimedia. org/wiki/ File: Kolora aberacio, transversa %C5%9Dovo, 1. svg.
43. X. Wang and A. Gupta. Unsupervised learning of visual representations using videos. In ICCV, 2015.
44. X. Wang, K. He, and A. Gupta. Transitive invariance for selfsupervised visual representation learning. In ICCV, 2017.
45. P. Welinder, S. Branson, T. Mita, C. Wah, F. Schroff, S. Belongie, and P. Perona. Caltech-UCSD Birds 200. Technical Report CNS-TR-2010-001, California Institute of Technology, 2010.
46. L. Yang, P. Luo, C. C. Loy, and X. Tang. A large-scale car dataset for fine-grained categorization and verification. In CVPR, 2015.
47. R. Zhang, P. Isola, and A. A. Efros. Colorful image colorization. In ECCV, 2016.
48. R. Zhang, P. Isola, and A. A. Efros. Split-brain autoencoders: Unsupervised learning by cross-channel prediction. In CVPR, 2017.
49. B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva. Learning deep features for scene recognition using places database. In NIPS, 2014.