Multimodal feature fusion for robust event detection in web videos

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2012, Pages 1298-1305

  Natarajan, Pradeep ^a   Wu, Shuang ^a   Vitaladevuni, Shiv ^a   Zhuang, Xiaodan ^a   Tsakalidis, Stavros ^a   Park, Unsang ^a   Prasad, Rohit ^a   Natarajan, Premkumar ^a  

^a BBN TECHNOLOGIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO-VISUAL; AUTOMATIC SPEECH RECOGNITION; CO-OCCURRENCE PATTERN; DIVERSE FEATURES; EVENT DETECTION; INTERNATIONAL TEAM; LARGE-SCALE ANALYSIS; LOW-LEVEL FEATURES; MULTI-MODAL INFORMATION; MULTIMODAL FEATURES; MULTIPLE KERNEL LEARNING; SCORE-LEVEL FUSION; TRECVID; VIDEO TEXT RECOGNITION; VISUAL FEATURE; VISUAL INFORMATION; WEB VIDEO;

BENCHMARKING; IMAGE RETRIEVAL; SEMANTICS;

COMPUTER VISION;

EID: 84866712341     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2012.6247814     Document Type: Conference Paper

References (34)

1. H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool. Surf: Speeded up robust features. CVIU, 110(3):346-359, 2008.
2. Y. Boureau, F. Bach, Y. Le Cun, and J. Ponce. Learning mid-level features for recognition. In CVPR, pages 2559-2566, 2010.
3. V. Chandrasekhar, G. Takacs, D. M. Chen, S. S. Tsai, R. Grzeszczuk, and B. Girod. Chog: Compressed histogram of gradients a low bitrate feature descriptor. In CVPR, pages 2504-2511, 2009.
4. S.-F. Chang, D. Ellis, W. Jiang, K. Lee, A. Yanagawa, A. C. Loui, and J. Luo. Large-scale multimodal semantic concept detection for consumer video. ACM SIGMM International Workshop on Multimedia Information Retrieval, 2007.
5. C. V. Cotton, D. P.W. Ellis, and A. C. Loui. Soundtrack classification by transient events. In ICASSP, pages 473-476, 2011.
6. G. Csurka, C. R. Dance, L. Fan, J.Willamowski, and C. Bray. Visual categorization with bags of keypoints. In In Workshop on Statistical Learning in Computer Vision, ECCV, pages 1-22, 2004.
7. S. Davis and P. Mermelstein. Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences. In IEEE Transactions on Acoustics, Speech, and Signal Processing, volume 28, pages 357-66, 1980.
8. P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan. Object detection with discriminatively trained part based models. In JAIR, volume 32, 2007.
9. A. Gupta and L. S. Davis. Objects in action: An approach for combining action understanding and object perception. In CVPR, 2007.
10. A. K. Jain, K. Nandakumar, and A. Ross. Score normalization in multimodal biometric systems. Pattern Recognition, 38(12):2270-2285, 2005.
11. I. Laptev. On space-time interest points. International Journal of Computer Vision, 64(2-3):107-123, 2005.
12. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld. Learning realistic human actions from movies. In CVPR, pages 1-8, 2008.
13. S. Lazebnik, C. Schmid, and J. Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In CVPR, pages II: 2169-2178, 2006.
14. L.-J. Li, H. Su, E. P. Xing, and L. Fei-Fei. Object bank: A highlevel image representation for scene classification and semantic feature sparsification. In NIPS, 2010.
15. J. Liu, J. Luo, and M. Shah. Recognizing realistic actions from videos in the wild. In CVPR, 2009.
16. D. G. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 60:91-110, 2004.
17. P. Motlicek, S. Ganapathy, H. Hermansky, and H. Garudadri. Wideband audio coding based on frequency-domain linear prediction. EURASIP J. Audio, Speech and Music Processing, 2010.
18. B. A. Olshausen and D. J. Fieldt. Sparse coding with an overcomplete basis set: a strategy employed by v1. Vision Research, 37:3311-3325, 1997.
19. P. Over, G. Awad, M. Michel, J. Fiscus, W. Kraaij, A. F. Smeaton, and G. Quenot. Trecvid 2011 - an overview of the goals, tasks, data, evaluation mechanisms and metrics. In Proceedings of TRECVID 2011. NIST, USA, 2011.
20. J. C. Platt. Fast training of support vector machines using sequential minimal optimization, pages 185-208. MIT Press, 1999.
21. M. F. Porter. An algorithm for suffix stripping. Program, 14(3):130-137, 1980.
22. W. J. Scheirer, A. Rocha, R. J. Micheals, and T. E. Boult. Robust fusion: Extreme value theory for recognition score normalization. In ECCV (3), pages 481-495, 2010.
23. A. Shankar. Bayesian model combination (baycom) for improved recognition. ICASSP, pages 845-848, 2005.
24. Y. Song, M. Zhao, J. Yagnik, and X. Wu. Taxonomic classification for web-based videos. In CVPR, pages 871-878, 2010.
25. G. Toderici, H. Aradhye, M. Pasca, L. Sbaiz, and J. Yagnik. Finding meaning on youtube: Tag recommendation and category discovery. In CVPR, pages 3447-3454, 2010.
26. M. M. Ullah, S. N. Parizi, and I. Laptev. Improving bag-of-features action recognition with non-local cues. In BMVC, 2010.
27. K. E. A. van de Sande, T. Gevers, and C. G. M. Snoek. Evaluating color descriptors for object and scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(9):1582-1596, 2010.
28. J. C. van Gemert, C. J. Veenman, A. W. M. Smeulders, and J.-M. Geusebroek. Visfual word ambiguity. PAMI, 32(7):1271-1283, 2010.
29. S. V. N. Vishwanathan, N. T.-A. Z. Sun, and M. Varma. Multiple kernel learning and the smo algorithm. NIPS, pages 3311-3325, 2010.
30. S. Vitaladevuni, P. Natarajan, R. Prasad, and P. Natarajan. Efficient orthogonal matching pursuit using sparse random projections for scene and video classification. In ICCV, 2011.
31. H. Wang, M. M. Ullah, A. Kläser, I. Laptev, and C. Schmid. Evaluation of local spatio-temporal features for action recognition. In BMVC, 2009.
32. Z.Wang, M. Zhao, Y. Song, S. Kumar, and B. Li. Youtubecat: Learning to categorize wild web videos. In CVPR, pages 879-886, 2010.
33. I. Witten and T. Bell. The zero-frequency problem: Estimating the probabilities of novel events in adaptive text compression. ieeetit, 37(4):1085-1094, 1991.
34. S. Zanetti, L. Zelnik Manor, and P. Perona. A walk through the web's video clips. In InterNet, pages 1-8, 2008.