Zero-shot action recognition with error-correcting output codes

Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017

Volumn 2017-January, Issue , 2017, Pages 1042-1051

  Qin, Jie ^a,b   Liu, Li ^c,d   Shao, Ling ^d   Shen, Fumin ^e   Ni, Bingbing ^f   Chen, Jiaxin ^a   Wang, Yunhong ^a  

^a BEIHANG UNIVERSITY   (China)

^b ETH ZURICH   (Switzerland)

^c Malong Technologies Co Ltd   (China)

^d UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^e UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

^f SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

SEMANTICS;

ACTION RECOGNITION; EMBEDDINGS; ERROR CORRECTING OUTPUT CODE; EXPLOSIVE GROWTH; INTRINSIC DATA STRUCTURE; OLYMPICS; STATE-OF-THE-ART METHODS; TRANSFER STRATEGIES;

COMPUTER VISION;

EID: 85040705457     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2017.117     Document Type: Conference Paper

References (65)

1. J. K. Aggarwal and M. S. Ryoo. Human activity analysis: A review. CSUR, 43(3):16:1-16:43, 2011.
2. Z. Akata, S. Reed, D. Walter, H. Lee, and B. Schiele. Evaluation of output embeddings for fine-grained image classification. In CVPR, 2015.
3. E. L. Allwein, R. E. Schapire, and Y. Singer. Reducing multiclass to binary: A unifying approach for margin classifiers. JMLR, 1:113-141, Sept. 2001.
4. A. Beck and L. Tetruashvili. On the convergence of block coordinate descent type methods. SIAM Journal on Optimization, 23(4):2037-2060, 2013.
5. X. Chang, Y. Yang, G. Long, C. Zhang, and A. Hauptmann. Dynamic concept composition for zero-example event detection. In AAAI, 2016.
6. C. Chen, R. Jafari, and N. Kehtarnavaz. Improving human action recognition using fusion of depth camera and inertial sensors. IEEE Transactions on Human-Machine Systems, 45(1):51-61, 2015.
7. C. Chen, M. Liu, B. Zhang, J. Han, J. Jiang, and H. Liu. 3d action recognition using multi-temporal depth motion maps and fisher vector. In IJCAI, 2016.
8. T. G. Dietterich and G. Bakiri. Solving multiclass learning problems via error-correcting output codes. JAIR, 2(1):263-286, Jan. 1995.
9. S. Escalera, O. Pujol, and P. Radeva. Boosted landmarks of contextual descriptors and forest-ecoc: A novel framework to detect and classify objects in cluttered scenes. PRL, 28(13):1759 - 1768, 2007.
10. S. Escalera, O. Pujol, and P. Radeva. Error-correcting output codes library. JMLR, 11(Feb):661-664, 2010.
11. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.J. Lin. Liblinear: A library for large linear classification. JMLR, 9:1871-1874, June 2008.
12. A. Farhadi, I. Endres, D. Hoiem, and D. Forsyth. Describing objects by their attributes. In CVPR, 2009.
13. Y. Fu, T. M. Hospedales, T. Xiang, Z. Fu, and S. Gong. Transductive multi-view embedding for zero-shot recognition and annotation. In ECCV, 2014.
14. Y. Fu, T. M. Hospedales, T. Xiang, and S. Gong. Transductive multi-view zero-shot learning. IEEE TPAMI, 37(11):2332-2345, Nov 2015.
15. Z. Fu, T. Xiang, E. Kodirov, and S. Gong. Zero-shot object recognition by semantic manifold distance. In CVPR, 2015.
16. C. Gan, M. Lin, Y. Yang, Y. Zhuang, and A. G. Hauptmann. Exploring semantic inter-class relationships (sir) for zero-shot action recognition. In AAAI, 2015.
17. C. Gan, T. Yang, and B. Gong. Learning attributes equals multi-source domain generalization. In CVPR, 2016.
18. N. Garcia-Pedrajas and C. Fyfe. Evolving output codes for multiclass problems. IEEE Transactions on Evolutionary Computation, 12(1):93-106, Feb 2008.
19. Y. Gong and S. Lazebnik. Iterative quantization: A pro-crustean approach to learning binary codes. In CVPR, 2011.
20. D. Jayaraman and K. Grauman. Zero shot recognition with unreliable attributes. In NIPS, 2014.
21. Z. Ji, Y. Yu, Y. Pang, J. Guo, and Z. Zhang. Manifold regularized cross-modal embedding for zero-shot learning. Information Sciences, 378:48 - 58, 2017.
22. Y.-G. Jiang, J. Liu, A. Roshan Zamir, I. Laptev, M. Pic-cardi, M. Shah, and R. Sukthankar. THUMOS challenge: Action recognition with a large number of classes. /ICCV13-Action-Workshop/, 2013.
23. E. Kodirov, T. Xiang, Z. Fu, and S. Gong. Unsupervised domain adaptation for zero-shot learning. In ICCV, 2015.
24. H. Kuehne, H. Jhuang, E. Garrote, T. Poggio, and T. Serre. HMDB: a large video database for human motion recognition. In ICCV, 2011.
25. C. H. Lampert, H. Nickisch, and S. Harmeling. Learning to detect unseen object classes by between-class attribute transfer. In CVPR, 2009.
26. C. H. Lampert, H. Nickisch, and S. Harmeling. Attribute-based classification for zero-shot visual object categorization. IEEE TPAMI, 36(3):453-465, March 2014.
27. I. Laptev. On space-time interest points. IJCV, 64(2):107-123, 2005.
28. J. Liu, B. Kuipers, and S. Savarese. Recognizing human actions by attributes. In CVPR, 2011.
29. J. Liu, B. Kuipers, and S. Savarese. Technical report: Recognizing human actions by attributes, 2011.
30. L. Liu, Z. Lin, L. Shao, F. Shen, G. Ding, and J. Han. Sequential discrete hashing for scalable cross-modality similarity retrieval. IEEE TIP, 2016.
31. L. Liu, M. Yu, and L. Shao. Projection bank: From high-dimensional data to medium-length binary codes. In ICCV, 2015.
32. W. Liu, C. Mu, S. Kumar, and S.-F. Chang. Discrete graph hashing. In NIPS, 2014.
33. W. Liu, J. Wang, and S.-F. Chang. Hashing with graphs. In ICML, 2011.
34. Y. Long, L. Liu, and L. Shao. Attribute embedding with visual-semantic ambiguity removal for zero-shot learning. In BMVC, 2016.
35. Y. Long, L. Liu, and L. Shao. Towards fine-grained open zero-shot learning: Inferring unseen visual features from attributes. In WACV, 2017.
36. L. v. d. Maaten and G. Hinton. Visualizing data using t-sne. JMLR, 9:2579-2605, Nov 2008.
37. T. Mikolov, I. Sutskever, and K. Chen. Distributed representations of words and phrases and their compositionality. In NIPS, 2013.
38. D. Milajevs, D. Kartsaklis, M. Sadrzadeh, and M. Purver. Evaluating neural word representations in tensor-based compositional settings. EMNLP, 2014.
39. J. C. Niebles, C.-W. Chen, and L. Fei-Fei. Modeling temporal structure of decomposable motion segments for activity classification. In ECCV, 2010.
40. M. Palatucci, D. Pomerleau, G. Hinton, and T. M. Mitchell. Zero-shot learning with semantic output codes. In NIPS, 2009.
41. F. Perronnin, J. Sánchez, and T. Mensink. Improving the fisher kernel for large-scale image classification. In ECCV, 2010.
42. O. Pujol, P. Radeva, and J. Vitria. Discriminant ecoc: a heuristic method for application dependent design of error correcting output codes. IEEE TPAMI, 28(6):1007-1012, June 2006.
43. J. Qin, L. Liu, M. Yu, Y. Wang, and L. Shao. Fast action retrieval from videos via feature disaggregation. CVIU, 156:104-116, 2017.
44. J. Qin, L. Liu, Z. Zhang, Y. Wang, and L. Shao. Compressive sequential learning for action similarity labeling. IEEE TIP, 25(2):756-769, Feb 2016.
45. J. Qin, Y. Wang, L. Liu, J. Chen, and L. Shao. Beyond semantic attributes: Discrete latent attributes learning for zero-shot recognition. IEEE SPL, 23(11):1667-1671, Nov 2016.
46. B. Romera-Paredes and P. H. S. Torr. An embarrassingly simple approach to zero-shot learning. In ICML, 2015.
47. P. H. Schönemann. A generalized solution of the orthogonal procrustes problem. Psychometrika, 31(1):1-10, 1966.
48. F. Shen, W. Liu, S. Zhang, Y. Yang, and H. Tao Shen. Learning binary codes for maximum inner product search. In ICCV, 2015.
49. F. Shen, C. Shen, W. Liu, and H. T. Shen. Supervised discrete hashing. In CVPR, 2015.
50. F. Shen, C. Shen, Q. Shi, A. van den Hengel, and Z. Tang. Inductive hashing on manifolds. In CVPR, 2013.
51. F. Shen, X. Zhou, Y. Yang, J. Song, H. T. Shen, and D. Tao. A fast optimization method for general binary code learning. IEEE TIP, 25(12):5610-5621, Dec 2016.
52. K. Simonyan and A. Zisserman. Two-stream convolutional networks for action recognition in videos. In NIPS, pages 568-576, 2014.
53. K. Soomro, A. R. Zamir, and M. Shah. UCF101: A dataset of 101 human actions classes from videos in the wild. CRCV-TR-12-01, 2012.
54. D. Tran, L. Bourdev, R. Fergus, L. Torresani, and M. Paluri. Learning spatiotemporal features with 3d convolutional networks. In ICCV, 2015.
55. H. Wang and C. Schmid. Action recognition with improved trajectories. In ICCV, 2013.
56. J. Wang, S. Kumar, and S. F. Chang. Semi-supervised hashing for large-scale search. IEEE TPAMI, 34(12):2393-2406, 2012.
57. Y. Weiss, A. Torralba, and R. Fergus. Spectral hashing. In NIPS, 2009.
58. Y. Xian, Z. Akata, G. Sharma, Q. Nguyen, M. Hein, and B. Schiele. Latent embeddings for zero-shot classification. arXiv preprint arXiv:1603.08895, 2016.
59. X. Xu, T. Hospedales, and S. Gong. Semantic embedding space for zero-shot action recognition. In ICIP, pages 63-67, 2015.
60. X. Xu, T. Hospedales, and S. Gong. Multi-task zero-shot action recognition with prioritised data augmentation. In ECCV, 2016.
61. F. X. Yu, L. Cao, R. S. Feris, J. R. Smith, and S. F. Chang. Designing category-level attributes for discriminative visual recognition. In CVPR, 2013.
62. X. Yu and Y. Aloimonos. Attribute-based transfer learning for object categorization with zero/one training example. In ECCV, 2010.
63. X. Zhang, L. Liang, and H.-Y. Shum. Spectral error correcting output codes for efficient multiclass recognition. In ICCV, 2009.
64. Z. Zhang and V. Saligrama. Zero-shot learning via joint latent similarity embedding. In CVPR, 2016.
65. B. Zhao and E. P. Xing. Sparse output coding for scalable visual recognition. IJCV, 119(1):60-75, 2016.