Bridging the ultimate Semantic gap: A Semantic search engine for internet videos

ICMR 2015 - Proceedings of the 2015 ACM International Conference on Multimedia Retrieval

Volumn , Issue , 2015, Pages 27-34

  Jiang, Lu ^a   Yu, Shoou I ^a   Meng, Deyu ^b   Mitamura, Teruko ^a   Hauptmann, Alexander G ^a  

^a Carnegie Mellon University   (United States)

^b XI'AN JIAOTONG UNIVERSITY   (China)

Author keywords

0ex; Content based retrieval; Multimedia event detection; Semantic search; Video search; Video understanding

Indexed keywords

EID: 84962449644     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2671188.2749399     Document Type: Conference Paper

References (46)

1. S. Banerjee and T. Pedersen. An adapted lesk algorithm for word sense disambiguation using wordnet. In CICLing, 2002.
2. Y. Bengio, J. Louradour, R. Collobert, and J. Weston. Curriculum learning. In ICML, 2009.
3. S. Bhattacharya, F. X. Yu, and S.-F. Chang. Minimally needed evidence for complex event recognition in unconstrained videos. In ICMR, 2014.
4. C.-C. Chang and C.-J. Lin. LIBSVM: A library for support vector machines. ACM TIST, 2:27:1-27:27, 2011.
5. K. W. Church and P. Hanks. Word association norms, mutual information, and lexicography. Computational linguistics, 16(1):22-29, 1990.
6. J. Dalton, J. Allan, and P. Mirajkar. Zero-shot video retrieval using content and concepts. In CIKM, 2013.
7. J. Davidson, B. Liebald, J. Liu, et al. The youtube video recommendation system. In RecSys, 2010.
8. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In CVPR, 2009.
9. N. Gkalelis and V. Mezaris. Video event detection using generalized subclass discriminant analysis and linear support vector machines. In ICMR, 2014.
10. A. Habibian, T. Mensink, and C. G. Snoek. Composite concept discovery for zero-shot video event detection. In ICMR, 2014.
11. A. Habibian, K. E. van de Sande, and C. G. Snoek. Recommendations for video event recognition using concept vocabularies. In ICMR, 2013.
12. A. Hauptmann, R. Yan, W.-H. Lin, M. Christel, and H. Wactlar. Can high-level concepts fill the semantic gap in video retrieval? a case study with broadcast news. TMM, 9(5):958-966, 2007.
13. N. Inoue and K. Shinoda. n-gram models for video semantic indexing. In MM, 2014.
14. L. Jiang, A. Hauptmann, and G. Xiang. Leveraging high-level and low-level features for multimedia event detection. In MM, 2012.
15. L. Jiang, D. Meng, T. Mitamura, and A. G. Hauptmann. Easy samples first: Self-paced reranking for zero-example multimedia search. In MM, 2014.
16. L. Jiang, D. Meng, S.-I. Yu, Z. Lan, S. Shan, and A. G. Hauptmann. Self-paced learning with diversity. In NIPS, 2014.
17. L. Jiang, D. Meng, Q. Zhao, S. Shan, and A. G. Hauptmann. Self-paced curriculum learning. In AAAI, 2015.
18. L. Jiang, T. Mitamura, S.-I. Yu, and A. G. Hauptmann. Zero-example event search using multimodal pseudo relevance feedback. In ICMR, 2014.
19. L. Jiang, W. Tong, D. Meng, and A. G. Hauptmann. Towards efficient learning of optimal spatial bag-of-words representations. In ICMR, 2014.
20. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In CVPR, 2014.
21. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097-1105, 2012.
22. M. Kumar, B. Packer, and D. Koller. Self-paced learning for latent variable models. In NIPS, 2010.
23. H. Lee. Analyzing complex events and human actions in" in-the-wild" videos. In UMD Ph. D Theses and Dissertations, 2014.
24. O. Levy and Y. Goldberg. Dependency-based word embeddings. In ACL, 2014.
25. C. D. Manning, P. Raghavan, and H. Schütze. Introduction to information retrieval, volume 1. Cambridge university press Cambridge, 2008.
26. M. Mazloom, X. Li, and C. G. Snoek. Few-example video event retrieval using tag propagation. In ICMR, 2014.
27. Y. Miao, L. Jiang, H. Zhang, and F. Metze. Improvements to speaker adaptive training of deep neural networks. In SLT, 2014.
28. Y. Miao and F. Metze. Improving low-resource cd-dnn-hmm using dropout and multilingual dnn training. In INTERSPEECH, 2013.
29. Y. Miao, F. Metze, and S. Rawat. Deep maxout networks for low-resource speech recognition. In ASRU, 2013.
30. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. Distributed representations of words and phrases and their compositionality. In NIPS, 2013.
31. S. Oh, S. McCloskey, I. Kim, A. Vahdat, K. J. Cannons, H. Hajimirsadeghi, G. Mori, A. A. Perera, M. Pandey, and J. J. Corso. Multimedia event detection with multimodal feature fusion and temporal concept localization. Machine vision and applications, 25(1):49-69, 2014.
32. P. Over, G. Awad, M. Michel, J. Fiscus, G. Sanders, W. Kraaij, A. F. Smeaton, and G. Quéenot. TRECVID 2014 - an overview of the goals, tasks, data, evaluation mechanisms and metrics. In TRECVID, 2014.
33. D. Povey, A. Ghoshal, G. Boulianne, et al. The kaldi speech recognition toolkit. In ASRU, 2011.
34. B. Safadi, M. Sahuguet, and B. Huet. When textual and visual information join forces for multimedia retrieval. In ICMR, 2014.
35. B. Thomee, D. A. Shamma, G. Friedland, B. Elizalde, K. Ni, D. Poland, D. Borth, and L.-J. Li. The new data and new challenges in multimedia research. arXiv preprint arXiv:1503.01817, 2015.
36. W. Tong, Y. Yang, L. Jiang, et al. E-lamp: integration of innovative ideas for multimedia event detection. Machine Vision and Applications, 25(1):5-15, 2014.
37. A. Vedaldi and A. Zisserman. Efficient additive kernels via explicit feature maps. PAMI, 34(3):480-492, 2012.
38. F. Wang, Z. Sun, Y. Jiang, and C. Ngo. Video event detection using motion relativity and feature selection. In TMM, 2013.
39. H. Wang and C. Schmid. Action recognition with improved trajectories. In ICCV, 2013.
40. S. Wu, S. Bondugula, F. Luisier, X. Zhuang, and P. Natarajan. Zero-shot event detection using multi-modal fusion of weakly supervised concepts. In CVPR, 2014.
41. Z. Wu and M. Palmer. Verbs semantics and lexical selection. In ACL, 1994.
42. E. Younessian, T. Mitamura, and A. Hauptmann. Multimodal knowledge-based analysis in multimedia event detection. In ICMR, 2012.
43. S.-I. Yu, L. Jiang, and A. Hauptmann. Instructional videos for unsupervised harvesting and learning of action examples. In MM, 2014.
44. S.-I. Yu, L. Jiang, Z. Xu, et al. Cmu-informedia@trecvid 2014. In TRECVID, 2014.
45. C. Zhai and J. Lafferty. A study of smoothing methods for language models applied to information retrieval. TOIS, 22(2), 2004.
46. Q. Zhao, D. Meng, L. Jiang, Q. Xie, Z. Xu, and A. G. Hauptmann. Self-paced learning for matrix factorization. In AAAI, 2015.