Learning features by watching objects move

Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017

Volumn 2017-January, Issue , 2017, Pages 6024-6033

  Pathak, Deepak ^a,b   Girshick, Ross ^a   Dollár, Piotr ^a   Darrell, Trevor ^b   Hariharan, Bharath ^a  

^a FACEBOOK AI RESEARCH   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

OBJECT DETECTION;

CONVOLUTIONAL NETWORKS; HUMAN VISUAL SYSTEM; LOW-LEVEL MOTIONS; MOTION BASED SEGMENTATION; TRANSFER LEARNING; UNSUPERVISED APPROACHES; UNSUPERVISED FEATURE LEARNING; VISUAL REPRESENTATIONS;

COMPUTER VISION;

EID: 85041908735     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2017.638     Document Type: Conference Paper

References (52)

1. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Süsstrunk. SLIC superpixels compared to state-of-the-art superpixel methods. TPAMI, 2012. 5
2. P. Agrawal, J. Carreira, and J. Malik. Learning to see by moving. ICCV, 2015. 3, 6, 7
3. C. Arteta, V. Lempitsky, and A. Zisserman. Counting in the wild. In ECCV, 2016. 6
4. Y. Bengio. Learning deep architectures for AI. Foundations and trends in Machine Learning, 2009. 1, 2
5. Y. Bengio, A. Courville, and P. Vincent. Representation learning: A review and new perspectives. TPAMI, 35(8), 2013. 2
6. N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. CVPR, 2005. 5
7. V. R. de Sa. Learning classification with unlabeled data. NIPS, 1994. 2
8. C. Doersch, A. Gupta, and A. A. Efros. Unsupervised visual representation learning by context prediction. ICCV, 2015. 1, 2, 3, 4, 6, 7, 8
9. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, and T. Darrell. Decaf: A deep convolutional activation feature for generic visual recognition. ICML, 2014. 1
10. J. Donahue, P. Krähenbühl, and T. Darrell. Adversarial Feature Learning. ICLR, 2017. 2, 6, 7, 8
11. V. Dumoulin, I. Belghazi, B. Poole, A. Lamb, M. Arjovsky, O. Mastropietro, and A. Courville. Adversarially learned inference. ICLR, 2017. 2
12. A. Faktor and M. Irani. Video Segmentation by Non-Local Consensus voting. BMVC, 2014. 5
13. F. Galasso, N. Nagaraja, T. Cardenas, T. Brox, and B. Schiele. A unified video segmentation benchmark: Annotation, metrics and analysis. ICCV, 2013. 6
14. R. Garg, V. K. B.G., G. Carneiro, and I. Reid. Unsupervised cnn for single view depth estimation: Geometry to the rescue. ECCV, 2016. 3
15. R. Girshick. Fast R-CNN. ICCV, 2015. 1, 3, 4
16. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. NIPS, 2014. 2
17. R. Goroshin, M. Mathieu, and Y. LeCun. Learning to lin-earize under uncertainty. NIPS, 2015. 1, 3
18. B. Hariharan, P. Arbeláez, L. Bourdev, S. Maji, and J. Malik. Semantic contours from inverse detectors. ICCV, 2011. 8
19. B. Hariharan, P. Arbeláez, R. Girshick, and J. Malik. Hyper-columns for object segmentation and fine-grained localization. CVPR, 2015. 1
20. G. E. Hinton and R. R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 2006. 1, 2
21. D. Jayaraman and K. Grauman. Learning image representations tied to ego-motion. ICCV, 2015. 3
22. P. Kohli, P. H. Torr, et al. Robust higher order potentials for enforcing label consistency. IJCV, 2009. 6
23. P. Krähenbühl, C. Doersch, J. Donahue, and T. Darrell. Data-dependent initializations of convolutional neural networks. ICLR, 2016. 7
24. A. Krizhevsky, I. Sutskever, and G. E. Hinton. ImageNet classification with deep convolutional neural networks. NIPS, 2012. 3
25. G. Larsson, M. Maire, and G. Shakhnarovich. Learning representations for automatic colorization. ECCV, 2016. 2
26. Y. Li, M. Paluri, J. M. Rehg, and P. Dollár. Unsupervised learning of edges. CVPR, 2016. 3
27. T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ra-manan, P. Dollár, and C. L. Zitnick. Microsoft COCO: Common objects in context. ECCV, 2014. 2, 3
28. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. CVPR, 2015. 8
29. I. Misra, C. L. Zitnick, and M. Hebert. Shuffle and Learn: Unsupervised Learning using Temporal Order Verification. ECCV, 2016. 1, 3
30. M. Noroozi and P. Favaro. Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles. ECCV, 2016. 1, 2, 3, 6, 7
31. P. Ochs, J. Malik, and T. Brox. Segmentation of moving objects by long term video analysis. TPAMI, 36(6), 2014. 6
32. Y. Ostrovsky, E. Meyers, S. Ganesh, U. Mathur, and P. Sinha. Visual parsing after recovery from blindness. Psychological Science, 2009. 1
33. A. Owens, J. Wu, J. H. McDermott, W. T. Freeman, and A. Torralba. Ambient sound provides supervision for visual learning. ECCV, 2016. 2, 6, 7
34. S. E. Palmer. Vision science: Photons to phenomenology. MIT press, 1999. 1
35. D. Pathak, P. Krähenbühl, J. Donahue, T. Darrell, and A. Efros. Context Encoders: Feature Learning by Inpainting. CVPR, 2016. 2, 6, 7
36. F. Perazzi, J. Pont-Tuset, B. McWilliams, L. V. Gool, M. Gross, and A. Sorkine-Hornung. A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation. CVPR, 2016. 6
37. P. O. Pinheiro, R. Collobert, and P. Dollr. Learning to Segment Object Candidates. NIPS, 2015. 3
38. P. O. Pinheiro, T.-Y. Lin, R. Collobert, and P. Dollár. Learning to Refine Object Segments. ECCV, 2016. 3
39. L. Z. Piotr Dollár. Structured forests for fast edge detection. ICCV, 2013. 5
40. D. Potapov, M. Douze, Z. Harchaoui, and C. Schmid. Category-specific video summarization. ECCV, 2014. 5
41. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. ImageNet Large Scale Visual Recognition Challenge. IJCV, 2015. 1
42. E. S. Spelke. Principles of object perception. Cognitive science, 14(1), 1990. 1
43. B. Thomee, D. A. Shamma, G. Friedland, B. Elizalde, K. Ni, D. Poland, D. Borth, and L.-J. Li. YFCC100M: The new data in multimedia research. Communications of the ACM, 59(2), 2016. 2, 5
44. P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol. Extracting and composing robust features with denoising autoencoders. ICML, 2008. 1, 2
45. J. Walker, C. Doersch, A. Gupta, and M. Hebert. An uncertain future: Forecasting from static images using variational autoencoders. ECCV, 2016. 3
46. X. Wang and A. Gupta. Unsupervised learning of visual representations using videos. ICCV, 2015. 1, 2, 6, 7, 8
47. M. Wertheimer. Laws of organization in perceptual forms. 1938. 1
48. B. Yao, X. Jiang, A. Khosla, A. L. Lin, L. Guibas, and L. Fei-Fei. Human action recognition by learning bases of action attributes and parts. ICCV, 2011. 8
49. J. Yosinski, J. Clune, Y. Bengio, and H. Lipson. How transferable are features in deep neural networks? NIPS, 2014. 4
50. N. Zhang, J. Donahue, R. Girshick, and T. Darrell. Part-based R-CNNs for fine-grained category detection. ECCV, 2014. 1
51. R. Zhang, P. Isola, and A. A. Efros. Colorful Image Colorization. ECCV, 2016. 2, 6, 7, 8
52. R. Zhang, P. Isola, and A. A. Efros. Split-brain autoencoders: Unsupervised learning by cross-channel prediction. CVPR, 2017. 2, 7