Slow and Steady Feature Analysis: Higher Order Temporal Coherence in Video

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 3852-3861

  Jayaraman, Dinesh ^a   Grauman, Kristen ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; NEURAL NETWORKS;

ACTION RECOGNITION; CONVOLUTIONAL NEURAL NETWORK; FEATURE ANALYSIS; FEATURE CHANGES; HIGHER ORDER DERIVATIVES; SLOW FEATURE ANALYSIS; TEMPORAL COHERENCE; VISUAL LEARNING;

PATTERN RECOGNITION;

EID: 84986272538     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.418     Document Type: Conference Paper

References (47)

1. Cuda-convnet. https://code.google.com/p/cuda-convnet/.
2. P. Agrawal, J. Carreira, and J. Malik. Learning to see by moving. ICCV, 2015.
3. J. Bergstra and Y. Bengio. Slow, decorrelated features for pretraining complex cell-like networks. In NIPS, 2009.
4. P. Berkes and L. Wiskott. Slow feature analysis yields a rich repertoire of complex cell properties. Journal of vision, 5(6), 2005.
5. Y. Burda, R. Grosse, and R. Salakhutdinov. Importance weighted autoencoders. In ICLR, 2016.
6. J. Deng, W. Dong, R. Socher, L.J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In CVPR, 2009.
7. Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell. Decaf: A deep convolutional activation feature for generic visual recognition. arXiv preprint arXiv:1310.1531, 2013.
8. A. Dosovitskiy, J.T. Springenberg, M. Riedmiller, and T. Brox. Discriminative Unsupervised Feature Learning with Convolutional Neural Networks. NIPS, 2014.
9. M. Everingham, L. Van Gool, C. Williams, J. Winn, and A. Zisserman. The pascal visual object classes (voc) challenge. IJCV, 2010.
10. A. Geiger, P. Lenz, and R. Urtasun. Are we ready for autonomous driving? the KITTI vision benchmark suite. CVPR, 2012.
11. R. Girshick, J. Donahue, T. Darrell, and J.Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014.
12. R. Goroshin, J. Bruna, J. Tompson, D. Eigen, and Y. LeCun. Unsupervised Learning of Spatiotemporally Coherent Metrics. ICCV, 2014.
13. Ross Goroshin, Michael F Mathieu, and Yann LeCun. Learning to linearize under uncertainty. In NIPS, 2015.
14. R. Hadsell, S. Chopra, and Y. LeCun. Dimensionality Reduction by Learning an Invariant Mapping. CVPR, 2006.
15. G. Hinton, A. Krizhevsky, and S.D. Wang. Transforming Auto-Encoders. ICANN, 2011.
16. J. Hurri and A. Hyvarinen. Simple-cell-like receptive fields maximize temporal coherence in natural video. Neural Computation, 15(3), 2003.
17. D. Jayaraman and K. Grauman. Learning image representations tied to ego-motion. ICCV, 2015.
18. D. Jayaraman and K. Grauman. Slow and Steady Feature Analysis: Higher Order Temporal Coherence in Video. CoRR, abs/1506.04714, June 2015.
19. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, Sergio S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv, 2014.
20. S. Karayev, M. Trentacoste, H. Han, A. Agarwala, T. Darrell, A. Hertzmann, and H. Winnemoeller. Recognizing image style. BMVC, 2014.
21. A. Krizhevsky. Learning multiple layers of features from tiny images, 2009.
22. A. Krizhevsky, I. Sutskever, and G. Hinton. ImageNet classification with deep convolutional neural networks. In NIPS, 2012.
23. H. Kuehne, H. Jhuang, E. Garrote, T. Poggio, and T. Serre. HMDB: a large video database for human motion recognition. ICCV, 2011.
24. Y. LeCun, F. J. Huang, and L. Bottou. Learning methods for generic object recognition with invariance to pose and lighting. CVPR, 2004.
25. Karel Lenc and Andrea Vedaldi. Understanding image representations by measuring their equivariance and equivalence. CVPR, 2015.
26. N. Li and J. DiCarlo. Unsupervised natural experience rapidly alters invariant object representation in visual cortex. Science, 321, 2008.
27. S. Liwicki, S. Zafeiriou, and M. Pantic. Incremental slow feature analysis with indefinite kernel for online temporal video segmentation. In ACCV, 2012.
28. R. Memisevic. Learning to relate images. PAMI, 2013.
29. V. Michalski, R. Memisevic, and K. Konda. Modeling Deep Temporal Dependencies with Recurrent Grammar Cells. NIPS, 2014.
30. H. Mobahi, R. Collobert, and J.Weston. Deep Learning from Temporal Coherence in Video. ICML, 2009.
31. F. Nater, H. Grabner, and L. Van Gool. Temporal relations in videos for unsupervised activity analysis. In BMVC, 2011.
32. M. Oquab, L. Bottou, I. Laptev, and J.Sivic. Learning and transferring mid-level image representations using convolutional neural networks. CVPR, 2014.
33. M. Ranzato, A. Szlam, J. Bruna, M. Mathieu, R. Collobert, and S. Chopra. Video (language) modeling: a baseline for generative models of natural videos. arXiv, 2014.
34. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. Berg, and L. Fei-Fei. Imagenet large scale visual recognition challenge. IJCV, 2015.
35. U. Schmidt and S. Roth. Learning rotation-aware features: From invariant priors to equivariant descriptors. CVPR, 2012.
36. P. Simard, D. Steinkraus, and J.C. Platt. Best practices for convolutional neural networks applied to visual document analysis. ICDAR, 2003.
37. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. ICLR, 2014.
38. P. Vincent, H. Larochelle, Y. Bengio, and P.A. Manzagol. Extracting and composing robust features with denoising autoencoders. ICML, 2008.
39. C. Vondrick, H. Pirsiavash, and A. Torralba. Anticipating the future by watching unlabeled video. CoRR, abs/1504.08023, 2015.
40. J. Walker, A. Gupta, and M. Hebert. Dense optical flow prediction from a static image. In ICCV, 2015.
41. X.Wang and A. Gupta. Unsupervised learning of visual representations using videos. ICCV, 2015.
42. L. Wiskott and T. J. Sejnowski. Slow feature analysis: unsupervised learning of invariances. Neural computation, 2002.
43. J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba. SUN database: Large-scale scene recognition from abbey to zoo. CVPR, 2010.
44. L. Zafeiriou, M. Nicolaou, S. Zafeiriou, S. Nikitidis, and M. Pantic. Learning slow features for behaviour analysis. In ICCV, 2013.
45. Z. Zhang and D. Tao. Slow feature analysis for human action recognition. PAMI, 2012.
46. W. Zou, S. Zhu, K. Yu, and A. Ng. Deep learning of invariant features via simulated fixations in video. NIPS, 2012.
47. Will Y Zou, Andrew Y Ng, and Kai Yu. Unsupervised learning of visual invariance with temporal coherence. In NIPS Workshop on Deep Learning, 2011.