Fast and accurate content-based semantic search in 100M Internet Videos

MM 2015 - Proceedings of the 2015 ACM Multimedia Conference

Volumn , Issue , 2015, Pages 49-58

  Jiang, Lu ^a   Yu, Shoou I ^a   Meng, Deyu ^b   Yang, Yi ^c   Mitamura, Teruko ^a   Hauptmann, Alexander G ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b XI'AN JIAOTONG UNIVERSITY   (China)

^c UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Big Data; Contentbased Retrieval; Internet Video Search; Multimedia Event Detection; Semantic Search; Zero Example

Indexed keywords

CONTENT BASED RETRIEVAL; IMAGE RETRIEVAL; INDEXING (OF INFORMATION); INTERNET; SEMANTIC WEB; SEMANTICS;

INTERNET VIDEO; MULTI-MEDIA ANALYSIS; MULTIMEDIA EVENT DETECTIONS; OPTIMIZATION FRAMEWORK; SCALABLE SOLUTION; SEARCH PERFORMANCE; SEMANTIC SEARCH; ZERO EXAMPLE;

BIG DATA;

EID: 84962796449     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2733373.2806237     Document Type: Conference Paper

References (46)

1. E. Apostolidis, V. Mezaris, M. Sahuguet, B. Huet, B.Cervenková, D. Stein, S. Eickeler, J. L. Redondo Garcia, R. Troncy, and L. Pikora. Automatic fine-grained hyperlinking of videos within a closed collection using scene segmentation. In MM, 2014.
2. S. Bhattacharya, F. X. Yu, and S.-F. Chang. Minimally needed evidence for complex event recognition in unconstrained videos. In ICMR, 2014.
3. E. F. Can and R. Manmatha. Modeling concept dependencies for event detection. In ICMR, 2014.
4. J. Deng, N. Ding, Y. Jia, A. Frome, K. Murphy, S. Bengio, Y. Li, H. Neven, and H. Adam. Large-scale object classification using label relation graphs. In ECCV, 2014.
5. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In CVPR, 2009.
6. M. L. Fisher. The lagrangian relaxation method for solving integer programming problems. Management science, 50(12):1861-1871, 2004.
7. N. Gkalelis and V. Mezaris. Video event detection using generalized subclass discriminant analysis and linear support vector machines. In ICMR, 2014.
8. M. Grant, S. Boyd, and Y. Ye. CVX: Matlab software for disciplined convex programming, 2008.
9. A. Habibian, T. Mensink, and C. G. Snoek. Composite concept discovery for zero-shot video event detection. In ICMR, 2014.
10. A. Habibian, T. Mensink, and C. G. Snoek. Videostory: A new multimedia embedding for few-example recognition and translation of events. In MM, 2014.
11. A. Habibian, K. E. van de Sande, and C. G. Snoek. Recommendations for video event recognition using concept vocabularies. In ICMR, 2013.
12. E. Hatcher and O. Gospodnetic. Lucene in action. In Manning Publications, 2004.
13. L. Jiang, A. Hauptmann, and G. Xiang. Leveraging high-level and low-level features for multimedia event detection. In MM, 2012.
14. L. Jiang, D. Meng, T. Mitamura, and A. G. Hauptmann. Easy samples first: Self-paced reranking for zero-example multimedia search. In MM, 2014.
15. L. Jiang, D. Meng, S.-I. Yu, Z. Lan, S. Shan, and A. G. Hauptmann. Self-paced learning with diversity. In NIPS, 2014.
16. L. Jiang, D. Meng, Q. Zhao, S. Shan, and A. G. Hauptmann. Self-paced curriculum learning. In AAAI, 2015.
17. L. Jiang, T. Mitamura, S.-I. Yu, and A. G. Hauptmann. Zero-example event search using multimodal pseudo relevance feedback. In ICMR, 2014.
18. L. Jiang, S.-I. Yu, D. Meng, T. Mitamura, and A. G. Hauptmann. Bridging the ultimate semantic gap: A semantic search engine for internet videos. In ICMR, 2015.
19. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In CVPR, 2014.
20. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, 2012.
21. H. Lee. Analyzing complex events and human actions in" in-The-wild" videos. In UMD Ph.D Theses and Dissertations, 2014.
22. M. Mazloom, X. Li, and C. G. Snoek. Few-example video event retrieval using tag propagation. In ICMR, 2014.
23. Y. Miao, L. Jiang, H. Zhang, and F. Metze. Improvements to speaker adaptive training of deep neural networks. In SLT, 2014.
24. Y. Miao and F. Metze. Improving low-resource cd-dnn-hmm using dropout and multilingual dnn training. In INTERSPEECH, 2013.
25. D. Moise, D. Shestakov, G. Gudmundsson, and L. Amsaleg. Indexing and searching 100m images with map-reduce. In ICMR, 2013.
26. M. Naphade, J. R. Smith, J. Tesic, S.-F. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and J. Curtis. Large-scale concept ontology for multimedia. MultiMedia, IEEE, 13(3):86-91, 2006.
27. M. R. Naphade and J. R. Smith. On the detection of semantic concepts at trecvid. In MM, 2004.
28. S. Oh, S. McCloskey, I. Kim, A. Vahdat, K. J. Cannons, H. Hajimirsadeghi, G. Mori, A. A. Perera, M. Pandey, and J. J. Corso. Multimedia event detection with multimodal feature fusion and temporal concept localization. Machine vision and applications, 25(1):49-69, 2014.
29. P. Over, G. Awad, M. Michel, J. Fiscus, G. Sanders, W. Kraaij, A. F. Smeaton, and G. Qúeenot. TRECVID 2014-An overview of the goals, tasks, data, evaluation mechanisms and metrics. In TRECVID, 2014.
30. D. Povey, A. Ghoshal, G. Boulianne, et al. The kaldi speech recognition toolkit. In ASRU, 2011.
31. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, et al. Imagenet large scale visual recognition challenge. arXiv preprint arXiv:1409.0575, 2014.
32. B. Safadi, M. Sahuguet, and B. Huet. When textual and visual information join forces for multimedia retrieval. In ICMR, 2014.
33. N. Simon, J. Friedman, T. Hastie, and R. Tibshirani. A sparse-group lasso. Journal of Computational and Graphical Statistics, 22(2):231-245, 2013.
34. J. Sivic and A. Zisserman. Video google: Efficient visual search of videos. In Toward Category-Level Object Recognition, 2006.
35. J. R. Smith. Riding the multimedia big data wave. In SIGIR, 2013.
36. C. Snoek, K. van de Sande, D. Fontijne, A. Habibian, M. Jain, S. Kordumova, Z. Li, M. Mazloom, S. Pintea, R. Tao, et al. Mediamill at trecvid 2013: Searching concepts, objects, instances and events in video. In TRECVID, 2013.
37. B. Thomee, D. A. Shamma, G. Friedland, B. Elizalde, K. Ni, D. Poland, D. Borth, and L.-J. Li. The new data and new challenges in multimedia research. arXiv preprint arXiv:1503.01817, 2015.
38. R. Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological), pages 267-288, 1996.
39. W. Tong, Y. Yang, L. Jiang, et al. E-LAMP: integration of innovative ideas for multimedia event detection. Machine Vision and Applications, 25(1):5-15, 2014.
40. F. Wang, Z. Sun, Y. Jiang, and C. Ngo. Video event detection using motion relativity and feature selection. In TMM, 2013.
41. H. Wang and C. Schmid. Action recognition with improved trajectories. In ICCV, 2013.
42. S. Wu, S. Bondugula, F. Luisier, X. Zhuang, and P. Natarajan. Zero-shot event detection using multi-modal fusion of weakly supervised concepts. In CVPR, 2014.
43. X. Wu, A. G. Hauptmann, and C.-W. Ngo. Practical elimination of near-duplicates from web video search. In MM, 2007.
44. S.-I. Yu, L. Jiang, and A. Hauptmann. Instructional videos for unsupervised harvesting and learning of action examples. In MM, 2014.
45. S.-I. Yu, L. Jiang, Z. Xu, et al. Informedia@ trecvid 2014 med and mer. In TRECVID, 2014.
46. M. Yuan and Y. Lin. Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 68(1):49-67, 2006.