Learning end-to-end video classification with rank-pooling

33rd International Conference on Machine Learning, ICML 2016

Volumn 3, Issue , 2016, Pages 1823-1832

  Fernando, Basura ^a   Gould, Stephen ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CONVOLUTION; NETWORK ARCHITECTURE; NEURAL NETWORKS; OPTIMIZATION; SEMANTICS; VIDEO STREAMING;

ACTIVITY RECOGNITION; BILEVEL OPTIMIZATION PROBLEMS; CLASSIFICATION PARAMETERS; CONVOLUTIONAL NEURAL NETWORK; OPTIMIZATION PROBLEMS; TEMPORAL SEMANTICS; VECTOR REPRESENTATIONS; VIDEO CLASSIFICATION;

LEARNING SYSTEMS;

EID: 84998887168     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. Bard, Jonathan F. Practical Bilevel Optimization: Algorithms and Applications. Kluwer Academic Press, 1998.
2. Bilen, Hakan, Fernando, Basura, Gavves, Efstratios, Vedaldi, Andrea, and Gould, Stephen. Dynamic image networks for action recognition. In CVPR, 2016.
3. Bousquet, Olivier and Elisseeff, André. Stability and generalization. JMLR, 2:499-526, 2002.
4. Dempe, S and Franke, S. On the solution of convex bilevel optimization problems. Computational Optimization and Applications, pp. 1-19, 2015.
5. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. ImageNet: A large-scale hierarchical image database. In CVPR, 2009.
6. Do, Chuong B., Foo, Chuan-Sheng, and Ng, Andrew Y. Efficient multiple hyperparameter learning for log-linear models. In NIPS, 2007.
7. Domke, Justin. Generic methods for optimization-based modeling. In AISTATS, 2012.
8. Donahue, Jeffrey, Anne Hendricks, Lisa, Guadarrama, Sergio, Rohrbach, Marcus, Venugopalan, Subhashini, Saenko, Kate, and Darrell, Trevor. Long-term recurrent convolutional networks for visual recognition and description. In CVPR, 2015.
9. Du, Yong, Wang, Wei, and Wang, Liang. Hierarchical recurrent neural network for skeleton based action recognition. In CVPR, 2015.
10. Fernando, Basura, Gavves, Efstratios, Oramas, Jose, Ghodrati, Amir, and Tuytelaars, Tinne. Modeling video evolution for action recognition. In CVPR, 2015.
11. Fernando, Basura, Anderson, Peter, Hutter, Marcus, and Gould, Stephen. Discriminative hierarchical rank pooling for activity recognition. In CVPR, 2016a.
12. Fernando, Basura, Gavves, Efstratios, Oramas, Jose, Ghodrati, Amir, and Tuytelaars, Tinne. Rank pooling for action recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016b.
13. Girshick, Ross, Donahue, Jeff, Darrell, Trevor, and Malik, Jagannath. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014.
14. Golub, Gene H. and Loan, Charles F. Van. Matrix Computations. Johns Hopkins University Press, 3 edition, 1996.
15. Ji, Shuiwang, Xu, Wei, Yang, Ming, and Yu, Kai. 3d convolutional neural networks for human action recognition. PAMI, 35(1):221-231, 2013.
16. Jia, Yangqing, Shelhamer, Evan, Donahue, Jeff, Karayev, Sergey, Long, Jonathan, Girshick, Ross, Guadarrama, Sergio, and Darrell, Trevor. Caffe: Convolutional architecture for fast feature embedding. In Proceedings of the ACM International Conference on Multimedia, pp. 675-678. ACM, 2014.
17. Karpathy, Andrej, Toderici, George, Shetty, Sanketh, Leung, Thomas, Sukthankar, Rahul, and Fei-Fei, Li. Largescale video classification with convolutional neural networks. In CVPR, 2014.
18. Klatzer, Teresa and Pock, Thomas. Continuous hyperparameter learning for support vector machines. In Computer Vision Winter Workshop (CVWW), 2015.
19. Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E. Imagenet classification with deep convolutional neural networks. In NIPS. 2012.
20. Kunisch, Karl and Pock, Thomas. A bilevel optimization approach for parameter learning in variational models. SIAM Journal on Imaging Sciences, 6(2):938-983, 2013.
21. Laptev, Ivan, Marszalek, Marcin, Schmid, Cordelia, and Rozenfeld, Benjamin. Learning realistic human actions from movies. In CVPR, 2008.
22. Liu, Tie-Yan. Learning to rank for information retrieval. Foundations and Trends in Information Retrieval, 3(3):225-331, 2009.
23. Ochs, P., Ranftl, R., Brox, T., and Pock, T. Bilevel optimization with nonsmooth lower level problems. In International Conference on Scale Space and Variational Methods in Computer Vision (SSVM), 2015.
24. Perronnin, Florent, Liu, Yan, Sánchez, Jorge, and Poirier, Hervé. Large-scale image retrieval with compressed fisher vectors. In CVPR, 2010.
25. Rodriguez, Mikel D, Ahmed, Javed, and Shah, Mubarak. Action mach a spatio-temporal maximum average correlation height filter for action recognition. In CVPR, 2008.
26. Simonyan, Karen and Zisserman, Andrew. Two-stream convolutional networks for action recognition in videos. In NIPS, pp. 568-576, 2014.
27. Soomro, Khurram, Zamir, Amir Roshan, and Shah, Mubarak. Ucf101: A dataset of 101 human actions classes from videos in the wild. arXiv preprint arXiv: 1212.0402, 2012.
28. Srivastava, Nitish, Mansimov, Elman, and Salakhutdinov, Ruslan. Unsupervised learning of video representations using Istms. arXiv preprint arXiv: 1502.04681, 2015.
29. Tran, Du, Bourdev, Lubomir, Fergus, Rob, Torresani, Lorenzo, and Paluri, Manohar. Learning spatiotemporal features with 3d convolutional networks. arXiv preprint arXiv: 1412.0767, 2014.
30. Vedaldi, A. and Lenc, K. Matconvnet - convolutional neural networks for matlab. In Proceeding of the ACM Int. Conf. on Multimedia, 2015.
31. Wang, Heng and Schmid, Cordelia. Action recognition with improved trajectories. In ICCV, 2013.
32. Yue-Hei Ng, Joe, Hausknecht, Matthew, Vijayanarasimhan, Sudheendra, Vinyals, Oriol, Monga, Rajat, and Toderici, George. Beyond short snippets: Deep networks for video classification. In CVPR, 2015.
33. Zha, Shengxin, Luisier, Florian, Andrews, Walter, Srivastava, Nitish, and Salakhutdinov, Ruslan. Exploiting image-trained CNN architectures for unconstrained video classification. In BMVC, 2015.