Revisiting self-supervised visual representation learning

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2019-June, Issue , 2019, Pages 1920-1929

  Kolesnikov, Alexander ^a   Zhai, Xiaohua ^a   Beyer, Lucas ^a  

^a GOOGLE   (Switzerland)

Author keywords

Deep Learning; Low level Vision; Representation Learning

Indexed keywords

BENCHMARKING; COMPUTER VISION; CONVOLUTIONAL NEURAL NETWORKS;

LARGE MARGINS; LARGE-SCALE STUDIES; LOW-LEVEL VISION; REPRESENTATION LEARNING; STATE OF THE ART; UNSOLVED PROBLEMS; VISUAL REPRESENTATIONS;

DEEP LEARNING;

EID: 85075533888     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2019.00202     Document Type: Conference Paper

References (49)

1. J. Behrmann, D. Duvenaud, and J.-H. Jacobsen. Invertible residual networks. ArXiv preprint arXiv: 1811. 00995, 2018.
2. M. Caron, P. Bojanowski, A. Joulin, and M. Douze. Deep clustering for unsupervised learning of visual features. European Conference on Computer Vision (ECCV), 2018.
3. T. Chen, X. Zhai, M. Ritter, M. Lucic, and N. Houlsby. Selfsupervised generative adversarial networks. In Conference on Computer Vision and Pattern Recognition (CVPR). 2019.
4. Y. Chen, W. Li, C. Sakaridis, D. Dai, and L. Van Gool. Domain adaptive faster R-CNN for object detection in the wild. In Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
5. D. Dai and L. Van Gool. Dark model adaptation: Semantic image segmentation from daytime to nighttime. ArXiv preprint arXiv: 1810. 02575, 2018.
6. L. Dinh, J. Sohl-Dickstein, and S. Bengio. Density estimation using real NVP. In International Conference on Learning Representations (ICLR), 2017.
7. C. Doersch, A. Gupta, and A. A. Efros. Unsupervised visual representation learning by context prediction. In International Conference on Computer Vision (ICCV), 2015.
8. C. Doersch and A. Zisserman. Multi-task self-supervised visual learning. In International Conference on Computer Vision (ICCV), 2017.
9. A. Dosovitskiy, J. T. Springenberg, M. Riedmiller, and T. Brox. Discriminative unsupervised feature learning with convolutional neural networks. In Advances in Neural Information Processing Systems (NIPS), 2014.
10. F. Ebert, S. Dasari, A. X. Lee, S. Levine, and C. Finn. Robustness via retrying: Closed-loop robotic manipulation with self-supervised learning. Conference on Robot Learning (CoRL), 2018.
11. S. Gidaris, P. Singh, and N. Komodakis. Unsupervised representation learning by predicting image rotations. In International Conference on Learning Representations (ICLR), 2018.
12. A. N. Gomez, M. Ren, R. Urtasun, and R. B. Grosse. The reversible residual network: Backpropagation without storing activations. In Advances in neural information processing systems (NIPS), 2017.
13. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In Advances in neural information processing systems, 2014.
14. K. He, G. Gkioxari, P. Dollár, and R. Girshick. Mask r-cnn. In International Conference on Computer Vision (ICCV). IEEE, 2017.
15. K. He, X. Zhang, S. Ren, and J. Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In International conference on computer vision (ICCV), pages 1026-1034, 2015.
16. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
17. K. He, X. Zhang, S. Ren, and J. Sun. Identity mappings in deep residual networks. In European conference on computer vision (ECCV). Springer, 2016.
18. A. Hermans, L. Beyer, and B. Leibe. In Defense of the Triplet Loss for Person Re-Identification. ArXiv preprint arXiv: 1703. 07737, 2017.
19. S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. International Conference on Machine Learning (ICML), 2015.
20. J. Jacobsen, A. W. M. Smeulders, and E. Oyallon. i-RevNet: Deep invertible networks. In International Conference on Learning Representations (ICLR), 2018.
21. E. Jang, C. Devin, V. Vanhoucke, and S. Levine. Grasp2Vec: Learning object representations from self-supervised grasping. In Conference on Robot Learning, 2018.
22. D. Kim, D. Cho, D. Yoo, and I. S. Kweon. Learning image representations by completing damaged jigsaw puzzles. Winter Conference on Applications of Computer Vision (WACV), 2018.
23. B. Korbar, D. Tran, and L. Torresani. Cooperative learning of audio and video models from self-supervised synchronization. ArXiv preprint arXiv: 1807. 00230, 2018.
24. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems (NIPS), 2012.
25. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems (NIPS), 2012.
26. M. A. Lee, Y. Zhu, K. Srinivasan, P. Shah, S. Savarese, L. Fei-Fei, A. Garg, and J. Bohg. Making sense of vision and touch: Self-supervised learning of multimodal representations for contact-rich tasks. ArXiv preprint arXiv: 1810. 10191, 2018.
27. D. C. Liu and J. Nocedal. On the limited memory bfgs method for large scale optimization. Mathematical programming, 45 (1-3): 503-528, 1989.
28. T. Mikolov, K. Chen, G. Corrado, and J. Dean. Efficient estimation of word representations in vector space. ArXiv preprint arXiv: 1301. 3781, 2013.
29. T. N. Mundhenk, D. Ho, and B. Y. Chen. Improvements to context based self-supervised learning. In Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
30. V. Nair and G. E. Hinton. Rectified linear units improve restricted boltzmann machines. In International conference on machine learning (ICML), 2010.
31. M. Noroozi and P. Favaro. Unsupervised learning of visual representations by solving jigsaw puzzles. In European Conference on Computer Vision (ECCV), 2016.
32. M. Noroozi, H. Pirsiavash, and P. Favaro. Representation learning by learning to count. In International Conference on Computer Vision (ICCV), 2017.
33. M. Noroozi, A. Vinjimoor, P. Favaro, and H. Pirsiavash. Boosting self-supervised learning via knowledge transfer. Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
34. A. v. d. Oord, Y. Li, and O. Vinyals. Representation learning with contrastive predictive coding. ArXiv preprint arXiv: 1807. 03748, 2018.
35. A. Owens and A. A. Efros. Audio-visual scene analysis with self-supervised multisensory features. European Conference on Computer Vision (ECCV), 2018.
36. D. Pathak, R. B. Girshick, P. Dollár, T. Darrell, and B. Hariharan. Learning features by watching objects move. In Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
37. D. Pathak, P. Krähenbühl, J. Donahue, T. Darrell, and A. Efros. Context encoders: Feature learning by inpainting. In Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
38. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, et al. Imagenet large scale visual recognition challenge. International Journal of Computer Vision (IJCV), 115 (3): 211-252, 2015.
39. N. Sayed, B. Brattoli, and B. Ommer. Cross and learn: Cross-modal self-supervision. ArXiv preprint arXiv: 1811. 03879, 2018.
40. F. Schroff, D. Kalenichenko, and J. Philbin. Facenet: A unified embedding for face recognition and clustering. In Computer Vision and Pattern Recognition (CVPR), 2015.
41. P. Sermanet, C. Lynch, Y. Chebotar, J. Hsu, E. Jang, S. Schaal, and S. Levine. Time-contrastive networks: Self-supervised learning from video. ArXiv preprint arXiv: 1704. 06888, 2017.
42. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. ArXiv preprint arXiv: 1409. 1556, 2014.
43. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
44. O. Wiles, A. Koepke, and A. Zisserman. Self-supervised learning of a facial attribute embedding from video. In British Machine Vision Conference (BMVC), 2018.
45. S. Xie, R. Girshick, P. Dollár, Z. Tu, and K. He. Aggregated residual transformations for deep neural networks. In Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2017.
46. S. Zagoruyko and N. Komodakis. Wide residual networks. British Machine Vision Conference (BMVC), 2016.
47. R. Zhang, P. Isola, and A. A. Efros. Colorful image colorization. In European Conference on Computer Vision (ECCV), 2016.
48. R. Zhang, P. Isola, and A. A. Efros. Split-brain autoencoders: Unsupervised learning by cross-channel prediction. In Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
49. B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva. Learning deep features for scene recognition using places database. In Advances in Neural Information Processing Systems (NIPS). 2014.