SIFT-bag kernel for video event analysis

MM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops

Volumn , Issue , 2008, Pages 229-238

  Zhou, Xi ^a   Zhuang, Xiaodan ^a   Yan, Shuicheng ^b   Chang, Shih Fu ^b   Hasegawa Johnson, Mark ^a   Huang, Thomas S ^a  

^a ECE   (United States)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Kernel design; SIFT bag; Video event recognition; Within class covariation normalization

Indexed keywords

DISCRIMINATING POWER; FINAL DECISION; GAUSSIAN MIXTURE MODEL; KERNEL COMPONENTS; KERNEL DESIGN; KULLBACK LEIBLER DIVERGENCE; NEWS VIDEO; SIFT FEATURE; SIFT-BAG; TRECVID; VIDEO CLIPS; VIDEO EVENT ANALYSIS; VIDEO EVENT RECOGNITION; VIDEO EVENTS; WITHIN-CLASS COVARIANCE; WITHIN-CLASS COVARIATION NORMALIZATION;

METHOD OF MOMENTS; MULTIMEDIA SYSTEMS; VIDEO CAMERAS;

CONTENT BASED RETRIEVAL;

EID: 70350676914     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1459359.1459391     Document Type: Conference Paper

References (41)

1. A. Amir et al., IBM Research TRECVID-2005 Video Retrieval System, NIST TRECVID Workshop, 2005.
2. O. Boiman and M. Irani, Detecting irregularities in images and in video, IEEE International Conference on Computer Vision, pp. 462-469, 2005.
3. M. Brand, N. Oliver, and A. Pentland, Coupled Hidden Markov Models for Complex ActionRecognition, Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 994-999, 1997.
4. A. Hatch and A. Stolcke, GENERALIZED LINEAR KERNELS FOR ONE-VERSUS-ALL CLASSIFICATION: APPLICATION TO SPEAKER RECOGNITION. ICASSP, vol. V, pp. 585-588, 2006.
5. C. Chang and C. Lin, LIBSVM: A Library for Support Vector Machines, 2001.[Online]http://www.csie.ntu.edu.tw/̃cjlin/libsvm
6. Columbia University's Baseline Detectors for 374 LSCOM Semantic Visual Concepts, http://www.ee.columbia.edu/ln/dvmm/columbia374/.
7. L. David, "Naive (Bayes) at Forty: The Independence Assumption in Information Retrieval", Proceedings of ECML-98, 10th European Conference on Machine Learning: 4-15, 1998.
8. P. Dollar, V. Rabaud, G. Cottrell, and S. Belongie, Behavior Recognition via Sparse Spatio-temporal Features, Proceedings of IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, pp. 65-72, 2005.
9. DTO LSCOM Lexicon Definitions and Annotations, http://www.ee.columbia. edu/dvmm/lscom/.
10. S. Ebadollahi, L. Xie, S. Chang, and J. Smith, Visual Event Detection Using Multi-Dimensional Concept Dynamics, IEEE International Conference on Multimedia and Expo, pp. 881-884, 2006.
11. A. Efros, A. Berg, G. Mori, and J. Malik, Recognizing Action at a Distance, Proceedings of IEEE International Conference on Computer Vision, pp.726-733, 2003.
12. K. Grauman and T. Darrell, The Pyramid Match Kernel: Discriminantive Classification with Sets of Image Features, Proceedings of IEEE International Conference on Computer Vision, pp. 1458-1465, 2005.
13. A. Hauptmann et al., Multi-Lingual Broadcast News Retrieval, In NIST TRECVID Workshop, Gaithersburg, MD, Nov. 2006.
14. C. Harris and M. Stephens, A Combined Corner and Edge Detector, Alvey Vision Confernece, 1988.
15. X. He and P. Niyogi, Locality Preserving Projections, Proceedings of the Conference on Advances in Nerual Information Processing Systems, 2003.
16. F. Jing, M. Li, H. Zhang, and B. Zhang, An Efficient and Effective Region-based Image Retrieval Framework, IEEE Transactions on Image Processing, vol. 13, no. 5, pp. 699-709, 2004.
17. Y. Ke, R. Sukthankar, and M. Hebert, Efficient Visual Event Detection Using Volumetric Features,Proceedings of IEEE International Conference on Computer Vision, pp. 166-173, 2005.
18. L. Laptev and T. Lindeberg, Space-time Interest Points, Proceedings of IEEE International Conference on Computer Vision, pp. 432-439, 2003.
19. S. Lazebnik, C. Schmid, and J. Ponce, Beyond Bags of Features, Spatial Pyramid Matching for Recognizing Natural Scene Categories, Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 2169-2178, 2006.
20. C. Lee, C. Lin, and B. Juang, A study on speaker adaptation of the parameters of continuous density hidden Markov models. tsap, vol. 39, no. 4, pp. 806-814, 1991.
21. E. Levina and P. Bickel, The Earth Mover's Distance is the Mallows Distance: Some Insights from Statistics, Proceedings of IEEE International Conference on Computer Vision, pp. 251-256, 2001.
22. J. Liu et al., University of Central Florida at TRECVID 2006 High-Level Feature Extraction and Video Search, In NIST TRECVID Workshop, Gaithersburg, MD, Nov. 2006.
23. D. Lowe, Object Recognition from Local Scale-Invariant Features, Proceedings of IEEE International Conference on Computer Vision, pp. 1150-1157, 1999.
24. P. Moreno, P. Ho, and N. Vasconcelos, A Kullback-Leibler Divergence Based Kernel for SVM Classification in Multimedia Applications, Proceedings of Neural Information Processing Systems, Dec. 2003.
25. M. Naphade, J. Smith, J. Tesic, S. Chang, W. Hsu, L.Kennedy, A. Hauptmann, and J. Curtis, Large-Scale Concept Ontology for Multimedia, IEEE Multimedia Magazine, vol. 13, no. 3, pp.86-91, 2006.
26. J. Niebles, H. Wang, and L. Feifei, Unsupervised Learning of Human Action Categories Using Spatial Temporal Words, British Machine Vision Conference, 2006.
27. N. Oliver, B. Rosario, and A. Pentland, A Bayesian Computer Vision System for Modeling Human Interactions, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8):831-843, 2000.
28. P. Peursum, S. Venkatesh, G. West, and H. Bui, Object Labelling from Human Action Recognition, Proceedings of IEEE International Conference on Pervasive Computing and Communications, pp. 399-406, 2003.
29. J. Platt, Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods, Advances in Large Margin Classifiers, 1999.
30. D. Reynolds, T. Quatieri, and R. Dunn, Speaker Verification using Adapted Gaussian Mixture Models. Digital Signal Processing, vol. 10, pp. 19-41, 2000.
31. Y. Rubner, C. Tomasi, and L. Guibas, The Earth Mover's Distance as a Metric for Image Retrieval, International Jouranl of Computer Vision, vol. 40, no. 2, pp. 99-121, 2000.
32. C. Schuldt, I. Laptev, and B. Caputo, Recognizing Human Actions, A Local svm Approach, Proceedings of IEEE International Conference on Pattern Recognition, pp. 32-36, 2004.
33. A. Smeaton, P. Over, and W. Kraaij, Evaluation campaigns and TRECVid, Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, pp. 321-330, 2006.
34. TRECVID, http://www-nlpir.nist.gov/projects/trecvid.
35. D. Xu and S. Chang, Visual event recognition in news video using kernel methods with multi-level temporal alignment, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2007.
36. D. Xu and S. Chang, Video Event Recognition using Kernel Methods with Multi-Level Temporal Alignment, Accepted for future publication in IEEE Transactions on Pattern Analysis and Machine Intelligence.
37. D. Zhang, D. Perez, S. Bengio, and I. McCowan, Semi-supervised Adapted HMMs for Unusual Event Detection, Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 611-618, 2005.
38. J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid, Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study, International Journal of Computer Vision, vol. 73, no. 2, pp. 213-238, 2007.
39. J. Sivic and A. Zisserman, Video Google: a text retrieval approach to object matching in videos, Proceedings. Ninth IEEE International Conference on Computer Vision, pp. 1470-1477, 2003.
40. P. Quelhas, F. Monay, J.M. Odobez, D. Gatica-Perez and T. Tuytelaars, A Thousand Words in a Scene, IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, pp. 79-86, 2007.
41. A.D. Bagdanov, L. Ballan, M. Bertini, and A. Del Bimbo, Trademark matching and retrieval in sports video databases, Proceedings of the international workshop on Workshop on multimedia information retrieval, pp. 1575-1589, 2007.