SUPER: Towards real-time event recognition in Internet videos

Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, ICMR 2012

Volumn , Issue , 2012, Pages

  Jiang, Yu Gang ^a  

^a FUDAN UNIVERSITY   (China)

Author keywords

Efficiency; Event recognition; Frame selection; Internet videos; Multimodal features

Indexed keywords

AUDIO FRAMES; COMPUTATIONAL COSTS; DATA SETS; EVENT RECOGNITION; FRAME SELECTION; FUSION STRATEGIES; INTERNET VIDEO; MULTI-MODAL; MULTIMODAL FEATURES; PERFORMANCE DEGRADATION; RECOGNITION ACCURACY; RECOGNITION SPEED; REDUNDANT INFORMATIONS; SPATIAL TEMPORALS; STATE-OF-THE-ART SYSTEM; VIDEO EVENTS; VIDEO PROCESSING; VIDEO SEQUENCES; VISUAL CHANNELS;

BENCHMARKING; DEGRADATION; EFFICIENCY; VIDEO SIGNAL PROCESSING;

INTERNET;

EID: 84864116485     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2324796.2324805     Document Type: Conference Paper

References (27)

1. TRECVID multimedia event detection track. http://www.nist.gov/itl/iad/ mig/med.cfm/.
2. H. Bay, A. Ess, T. Tuytelaars, and L. van Gool. SURF: Speeded up robust features. Computer Vision and Image Understanding, 110(3):346-359, 2008.
3. Y. G. Jiang, C. W. Ngo, and J. Yang. Towards optimal bag-of-features for object categorization and semantic video retrieval. In Proc. of ACM International Conference on Image and Video Retrieval, 2007.
4. Y.-G. Jiang, G. Ye, S.-F. Chang, D. Ellis, and A. C. Loui. Consumer video understanding: A benchmark database and an evaluation of human and machine performance. In Proc. of ACM International Conference on Multimedia Retrieval, 2011.
5. Y.-G. Jiang, X. Zeng, G. Ye, S. Bhattacharya, D. Ellis, M. Shah, and S.-F. Chang. Columbia-UCF TRECVID2010 multimedia event detection: Combining multiple modalities, contextual concepts, and temporal matching. In Proc. of NIST TRECVID Workshop, 2010.
6. J. Knopp, M. Prasad, G. Willems, R. Timofte, and L. van Gool. Hough transform and 3D SURF for robust three dimensional classification. In Proc. of the European Conference on Computer Vision, 2010.
7. I. Laptev. On space-time interest points. International Journal of Computer Vision, 64:107-123, 2005. (Pubitemid 41314645)
8. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld. Learning realistic human actions from movies. In IEEE Conf. on Computer Vision and Pattern Recognition, 2008.
9. K. Lee and D. P. W. Ellis. Audio-based semantic concept classification for consumer video. IEEE Transactions on Audio, Speech, and Language Processing, 18(6):1406-1416,2010.
10. J. Liu, J. Luo, and M. Shah. Recognizing realistic actions from videos "in the wild". In Proc. of IEEE Conference on Computer Vision and Pattern Recognition, 2009.
11. D. Lowe. Distinctive image features from scale-invariant keypoints. International Journal on Computer Vision, 60:91-110, 2004.
12. S. Maji, A. C. Berg, and J. Malik. Classification using intersection kernel support vector machines is efficient. In Proc. of IEEE Conference on Computer Vision and Pattern Recognition, 2008.
13. K. Mikoljczyk and C. Schmid. Scale and affine invariant interest point detectors. International Journal of Computer Vision, 60:63-86, 2004.
14. F. Moosmann, E. Nowak, and F. Jurie. Randomized clustering forests for image classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(9):1632-1646, 2008.
15. P. Natarajan and et al. BBN VISER TRECVID 2011 multimedia event detection system. In Proc. of NIST TRECVID Workshop, 2011.
16. D. Nister and H. Stewenius. Scalable recognition with a vocabulary tree. In Proc. of IEEE Conference on Computer Vision and Pattern Recognition, 2006.
17. E. Nowak, F. Jurie, and B. Triggs. Sampling strategies for bag-of-features image classification. In Proc. of European Conference on Computer Vision, 2006.
18. T. Ojala, M. Pietikainen, and T. Maenpaa. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(7):971-987, 2002. (Pubitemid 34835471)
19. A. Oliva and A. Torralba. Modeling the shape of the scene: a holistic representation of the spatial envelope. International Journal of Computer Vision, 42:145-175, 2001. (Pubitemid 32680801)
20. F. Perronnin, J. Sanchez, and T. Mensink. Improving the fisher kernel for large-scale image classification. In Proc. of the European Conference on Computer Vision, 2010.
21. K. Schindler and L. van Gool. Action snippets: How many frames does human action recognition require? In Proc. of IEEE Conference on Computer Vision and Pattern Recognition, 2008.
22. E. Shechtman and M. Irani. Matching local self-similarities across images and videos. In Proc. of IEEE Conference on Computer Vision and Pattern Recognition, 2007.
23. J. Shotton, M. Johnson, and R. Cipolla. Semantic texton forests for image categorization and segmentation. In Proc. of IEEE Conference on Computer Vision and Pattern Recognition, 2008.
24. B. E. Stein and T. R. Stanford. Multisensory integration: current issues from the perspective of the single neuron. Nature Reviews Neuroscience, 9:255-266, 2008. (Pubitemid 351430829)
25. A. Torralba, R. Fergus, and W. T. Freeman. 80 million tiny images: a large database for non-parametric object and scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(11):1958-1970, 2008.
26. J. R. R. Uijlings, A. W. M. Smeulders, and R. J. H. Scha. Real-time visual concept classification. IEEE Transactions on Multimedia, 12(7):665-680, 2010.
27. T.-H. Yu, T.-K. Kim, and R. Cipolla. Real-time action recognition by sptiotemoral semantic and structural forests. In Proc. of British Machine Vision Conference, 2010.