They are Not Equally Reliable: Semantic Event Search Using Differentiated Concept Classifiers

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 1884-1893

  Chang, Xiaojun ^a   Yu, Yao Liang ^b   Yang, Yi ^a   Xing, Eric P ^b  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^b Carnegie Mellon University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; IMAGE RETRIEVAL; SEMANTICS;

COMPLEX EVENT DETECTION; EXAMPLE VIDEOS; INTERNET VIDEO; SCALABLE ALGORITHMS; SEARCH PROBLEM; STATE OF THE ART; STATE-OF-THE-ART PERFORMANCE; WARPING TECHNIQUES;

SEMANTIC WEB;

EID: 84986300674     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.208     Document Type: Conference Paper

References (57)

1. Trecvid MED 2013. http://nist.gov/itl/iad/mig/med13.cfm.
2. Trecvid MED 2014. http://nist.gov/itl/iad/mig/med14.cfm.
3. The YFCC dataset. http://webscope. sandbox.yahoo.com/catalog.php? datatype=i&did=67.
4. Z. Akata, F. Perronnin, Z. Harchaoui, and C. Schmid. Label-embedding for attribute-based classification. In CVPR, 2013.
5. H. Bay, T. Tuytelaars, and L. J. V. Gool. SURF: speeded up robust features. In ECCV, 2006.
6. S. Bhattacharya, M. M. Kalayeh, R. Sukthankar, and M. Shah. Recognition of complex events: Exploiting temporal dynamics between underlying concepts. In CVPR, 2014.
7. Y. Boureau, F. Bach, Y. LeCun, and J. Ponce. Learning mid-level features for recognition. In CVPR, 2010.
8. L. Cao, Y. Mu, A. Natsev, S. Chang, G. Hua, and J. R. Smith. Scene aligned pooling for complex video recognition. In ECCV, pages 688-701, 2012.
9. X. Chang, Z. Ma, Y. Yang, Z. Zeng, and A. G. Hauptmann. Bi-Level Semantic Representation Analysis for Multimedia Event Detection. IEEE Transactions on Cybernetics, 2016.
10. X. Chang, Y. Yang, A. G. Hauptmann, E. P. Xing, and Y. Yu. Semantic concept discovery for large-scale zero-shot event detection. In IJCAI, 2015.
11. X. Chang, Y. Yang, G. Long, C. Zhang, and A. G. Hauptmann. Dynamic concept composition for zeroexample event detection. In AAAI, 2016.
12. X. Chang, Y. Yang, E. P. Xing, and Y. Yu. Complex event detection using semantic saliency and nearlyisotonic SVM. In ICML, 2015.
13. X. Chang, Y. Yu, Y. Yang, and A. G. Hauptmann. Searching persuasively: Joint event detection and evidence recounting with limited supervision. In ACM MM, 2015.
14. J. Chen, Y. Cui, G. Ye, D. Liu, and S. Chang. Event-driven semantic concept discovery by exploiting weakly tagged internet images. In ICMR, 2014.
15. Y. Cheng, Q. Fan, S. Pankanti, and A. N. Choudhary. Temporal sequence modeling for video event detection. In CVPR, 2014.
16. J. Dalton, J. Allan, and P. Mirajkar. Zero-shot video retrieval using content and concepts. In CIKM, 2013.
17. A. P. Dawid and A. M. Skene. Maximum likelihood estimation of observer error-rates using the em algorithm. Applied Statistics, 28(1):20-28, 1979.
18. C. Dwork, R. Kumar, M. Naor, and D. Sivakumar. Rank aggregation methods for the web. In WWW, 2001.
19. H. P. Graf, E. Cosatto, L. Bottou, I. Durdanovic, and V. Vapnik. Parallel support vector machines: The cascade SVM. In NIPS, 2004.
20. A. Habibian, T. Mensink, and C. G. M. Snoek. Composite concept discovery for zero-shot video event detection. In ICMR, 2014.
21. A. Habibian, K. E. A. van de Sande, and C. G. M. Snoek. Recommendations for video event recognition using concept vocabularies. In ICMR, 2013.
22. A. Jaffe, B. Nadler, and Y. Kluger. Estimating the accuracies of multiple classifiers without labeled data. In AISTATS, 2015.
23. D. Jayaraman and K. Grauman. Zero-shot recognition with unreliable attributes. In NIPS, 2014.
24. L. Jiang, D. Meng, S. Yu, Z. Lan, S. Shan, and A. G. Hauptmann. Self-paced learning with diversity. In NIPS, 2014.
25. L. Jiang, T. Mitamura, S. Yu, and A. G. Hauptmann. Zero-example event search using multimodal pseudo relevance feedback. In ICMR, page 297, 2014.
26. Y. Jiang, S. Bhattacharya, S. Chang, and M. Shah. High-level event recognition in unconstrained videos. IJMIR, 2(2):73-101, 2013.
27. Y. Jiang, G. Ye, S. Chang, D. P. W. Ellis, and A. C. Loui. Consumer video understanding: a benchmark database and an evaluation of human and machine performance. In ICMR, 2011.
28. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In CVPR, 2014.
29. K. Lai, F. X. Yu, M. Chen, and S. Chang. Video event detection by inferring temporal instance labels. In CVPR, 2014.
30. C. H. Lampert, H. Nickisch, and S. Harmeling. Learning to detect unseen object classes by between-class attribute transfer. In CVPR, 2009.
31. W. Li, Q. Yu, A. Divakaran, and N. Vasconcelos. Dynamic pooling for complex event recognition. In ICCV, 2013.
32. W. Li, Q. Yu, H. S. Sawhney, and N. Vasconcelos. Recognizing activities via bag of words for attribute dynamics. In CVPR, 2013.
33. J. Liu, S. McCloskey, and Y. Liu. Local expert forest of score fusion for video event classification. In ECCV, 2012.
34. D. G. Lowe. Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision, 60(2):91-110, 2004.
35. M. Mazloom, E. Gavves, K. E. A. van de Sande, and C. Snoek. Searching informative concept banks for video event detection. In ICMR, 2013.
36. T. Mensink, E. Gavves, and C. G. M. Snoek. COSTA: co-occurrence statistics for zero-shot classification. In CVPR, 2014.
37. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. Distributed representations of words and phrases and their compositionality. In NIPS, 2013.
38. M. Norouzi, T. Mikolov, S. Bengio, Y. Singer, J. Shlens, A. Frome, G. S. Corrado, and J. Dean. Zeroshot learning by convex combination of semantic embeddings. In ICLR, 2014.
39. M. Palatucci, D. Pomerleau, G. E. Hinton, and T. M. Mitchell. Zero-shot learning with semantic output codes. In NIPS, 2009.
40. F. Parisi, F. Strino, B. Nadler, and Y. Kluger. Ranking and combining multiple predictors without labeled data. Proceedings of the National Academy of Sciences, 111:1253-1258, 2014.
41. F. Perronnin, J. Sánchez, and T. Mensink. Improving the Fisher kernel for large-scale image classification. In ECCV, 2010.
42. E. A. Platanios, A. Blum, and T. Mitchell. Estimating accuracy from unlabeled data. In UAI, 2014.
43. M. Rastegari, A. Diba, D. Parikh, and A. Farhadi. Multi-attribute queries: To merge or not to merge? In CVPR, 2013.
44. V. C. Raykar, S. Yu, L. H. Zhao, G. H. Valadez, C. Florin, L. Bogoni, and L. Moy. Learning from crowds. Journal of Machine Learning Research, 11:1297-1322, 2010.
45. E. Roach and B. B. Lloyd. Cognition and categorization. 1978.
46. K. Soomro, A. R. Zamir, and M. Shah. UCF101: A dataset of 101 human actions classes from videos in the wild, 2012.
47. C. Sun and R. Nevatia. DISCOVER: discovering important segments for classification of video events and recounting. In CVPR, 2014.
48. K. D. Tang, F. Li, and D. Koller. Learning latent temporal structure for complex event detection. In CVPR, 2012.
49. K. D. Tang, B. Yao, F. Li, and D. Koller. Combining the right features for complex event recognition. In ICCV, 2013.
50. A. Vahdat, K. J. Cannons, G. Mori, S. Oh, and I. Kim. Compositional models for video event detection: A multiple kernel learning latent variable approach. In ICCV, 2013.
51. K. E. A. van de Sande, T. Gevers, and C. G. M. Snoek. Evaluating color descriptors for object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell., 32(9):1582-1596, 2010.
52. H. Wang and C. Schmid. Action recognition with improved trajectories. In ICCV, 2013.
53. S. Wu, S. Bondugula, F. Luisier, X. Zhuang, and P. Natarajan. Zero-shot event detection using multimodal fusion of weakly supervised concepts. In CVPR, 2014.
54. Z. Xu, Y. Yang, and A. G. Hauptmann. A discriminative CNN video representation for event detection. In CVPR, 2015.
55. G. Ye, D. Liu, I. Jhuo, and S. Chang. Robust late fusion with rank minimization. In CVPR, 2012.
56. S. Yu, L. Jiang, and A. G. Hauptmann. Instructional videos for unsupervised harvesting and learning of action examples. In ACM MM, 2015.
57. X. Zhang, Y. Yu, and D. Schuurmans. Accelerated training for matrix-norm regularization: A boosting approach. In NIPS, 2012.