Knowledge adaptation with partially shared features for event detection using few exemplars

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 9, 2014, Pages 1789-1802

  Ma, Zhigang ^a   Yang, Yi ^b   Sebe, Nicu ^c   Hauptmann, Alexander G ^a  

^a Carnegie Mellon University   (United States)

^b UNIVERSITY OF QUEENSLAND   (Australia)

^c UNIVERSITY OF TRENTO   (Italy)

Author keywords

heterogeneous features based structural adaptive regression (HF SAR); heterogenous features; knowledge adaptation; Multimedia event detection (MED)

Indexed keywords

IMAGE RETRIEVAL; SECURITY SYSTEMS;

ABNORMALITY DETECTION; DETECTION ALGORITHM; HETEROGENEOUS FEATURES; HETEROGENOUS FEATURES; KNOWLEDGE ADAPTATIONS; MULTIMEDIA ARCHIVES; MULTIMEDIA CONTENTS; MULTIMEDIA EVENT DETECTIONS;

FEATURE EXTRACTION;

EID: 84905573114     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2306419     Document Type: Article

References (42)

1. http://www.nist.gov/itl/iad/mig/upload/med11-evalplan-v03-20110801a.pdf, 2014
2. http://www.nist.gov/itl/iad/mig/upload/med12-evalplan-v01. pdf, 2014
3. Trec Video Retrieval Evaluation. National Institute of Standards and Technology, http://www-nlpir.nist.gov/projects/trecvid/, 2014
4. A. Adam, E. Rivlin, I. Shimshoni, and D. Reinitz, "Robust Real-Time Unusual Event Detection Using Multiple Fixed-Location Monitors," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 3, pp. 555-560, Mar. 2008 (Pubitemid 351280062)
5. G. Zen and E. Ricci, "Earth Movers Prototypes: A Convex Learning Approach for Discovering Activity Patterns in Dynamic Scenes," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 3225-3232, 2011
6. E. Ricci, G. Zen, N. Sebe, and S. Messelodi, "A Prototype Learning Framework Using EMD: Application to Complex Scenes Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 35, no. 3, pp. 513-526, Mar. 2013
7. A. Argyriou, T. Evgeniou, and M. Pontil, "Convex Multi-Task Feature Learning," Machine Learning, vol. 73, pp. 243-272, 2008
8. G. Obozinski, B. Taskar, and M.I. Jordan, "Joint Covariate Selection and Joint Subspace Selection for Multiple Classification Problems," Statistics and Computing, vol. 20, pp. 231-252, 2010
9. Y. Yang, Z. Ma, A.G. Hauptmann, and N. Sebe, "Feature Selection for Multimedia Analysis by Sharing Information among Multiple Tasks," IEEE Trans. Multimedia, vol. 15, no. 3, pp. 661-669, Apr. 2013
10. L. Bao, L. Zhang, S.-I. Yu, Z. zhong Lan, L. Jiang, A. Overwijk, Q. Jin, S. Takahashi, B. Langner, Y. Li, M. Garbus, S. Burger, F. Metze, and A.G. Hauptmann, "Informedia @ TRECVID2011," Proc. NIST TRECVID Workshop, 2011
11. L. Cao, S.-F. Chang, N. Codella, C. Cotton, D. Ellis, L. Gong, M. Hill, G. Hua, J. Kender, M. Merler, Y. Mu, A. Natsev, and J.R. Smith, "IBM Research and Columbia University TRECVID-2011 Multimedia Event Detection (MED) System," Proc. NIST TRECVID Workshop, 2011
12. L. Duan, D. Xu, I.W.-H. Tsang, and J. Luo, "Visual Event Recognition in Videos by Learning from Web Data," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 9, pp. 1667-1680, Sept. 2012
13. Z. Ma, Y. Yang, Y. Cai, N. Sebe, and A.G. Hauptmann, "Knowledge Adaptation for Ad Hoc Multimedia Event Detection with Few Exemplars," Proc. 20th ACM Intl Conf. Multimedia (MM), pp. 469-478, 2012
14. J. Luo, T. Tommasi, and B. Caputo, "Multiclass Transfer Learning from Unconstrained Priors," Proc. IEEE Intl Conf. Computer Vision (ICCV), pp. 1863-1870, 2011
15. L. Fei-Fei and L.-J. Li, "What, Where and Who? Telling the Story of an Image by Activity Classification, Scene Recognition and Object Categorization," Studies in Computational Intelligence-Computer Vision, vol. 285, pp. 157-171, 2010
16. K.K. Reddy and M. Shah, "Recognizing 50 Human Action Categories of Web Videos," Machine Vision and Applications J., vol. 24, no. 5, pp. 971-981, 2013
17. A.G. Hauptmann, R. Yan, W.-H. Lin, M.G. Christel, and H.D. Wactlar, "Can High-Level Concepts Fill the Semantic Gap in Video Retrieval? A Case Study with Broadcast News," IEEE Trans. Multimedia, vol. 9, no. 5, pp. 958-966, Aug. 2007 (Pubitemid 47171252)
18. Y.-G. Jiang, C.-W. Ngo, and S.-F. Chang, "Semantic Context Transfer across Heterogeneous Sources for Domain Adaptive Video Search," Proc. 17th ACM Intl Conf. Multimedia (MM), pp. 155-164, 2009
19. Z.-Z. Lan, L. Bao, S.-I. Yu, W. Liu, and A.G. Hauptmann, "Multimedia Classification and Event Detection Using Double Fusion," J. Multimedia Tools and Applications, pp. 1-15, Mar. 2013
20. Z. Ma, Y. Yang, Z. Xu, S. Yan, N. Sebe, and A.G. Hauptmann, "Complex Event Detection via Multi-Source Video Attributes," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 2627-2633, 2013
21. Y. Yang, Z. Ma, Z. Xu, S. Yan, and A.G. Hauptmann, "How Related Exemplars Help Complex Event Detection in Web Videos," Proc. IEEE Intl Conf. Computer Vision (ICCV), 2013
22. K.-H. Liu, M.-F. Weng, C.-Y. Tseng, Y.-Y. Chuang, and M.-S. Chen, "Association and Temporal Rule Mining for Post-Filtering of Semantic Concept Detection in Video," IEEE Trans. Multimedia, vol. 10, no. 2, pp. 240-251, Feb. 2008
23. D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Intl J. Computer Vision, vol. 60, no. 2, pp. 91-110, 2004
24. J. Luo, J. Yu, D. Joshi, and W. Hao, "Event Recognition: Viewing the World with a Third Eye," Proc. 16th ACM Intl Conf. Multimedia (MM), pp. 1071-1080, 2008
25. Z. Ma, F. Nie, Y. Yang, J.R.R. Uijlings, and N. Sebe, "Web Image Annotation via Subspace-Sparsity Collaborated Feature Selection," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1021-1030, Aug. 2012
26. Z. Ma, Y. Yang, F. Nie, J.R.R. Uijlings, and N. Sebe, "Exploiting the Entire Feature Space with Sparsity for Automatic Image Annotation," Proc. 19th ACM Intl Conf. Multimedia (MM), pp. 283-292, 2011
27. M.R. Naphade and J.R. Smith, "On the Detection of Semantic Concepts at Trecvid," Proc. 12th Ann. ACM Intl Conf. Multimedia (MM), pp. 660-667, 2004 (Pubitemid 40211843)
28. M.J. Saberian, H. Masnadi-Shirazi, and N. Vasconcelos, "TaylorBoost: First and Second-Order Boosting Algorithms with Explicit Margin Control," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 2929-2934, 2011
29. D.A. Sadlier and N.E. OConnor, "Event Detection in Field Sports Video Using Audio-Visual Features and a Support Vector Machine," IEEE Trans. Circuits and Systems for Video Technology, vol. 15, no. 10, pp. 1225-1233, Oct. 2005 (Pubitemid 41640560)
30. B. Scholkopf, A.J. Smola, and K.-R. Muller, "Nonlinear Component Analysis as a Kernel Eigenvalue Problem," Neural Computation, vol. 10, no. 5, pp. 1299-1319, 1998
31. M.-L. Shyu, Z. Xie, M. Chen, and S.-C. Chen, "Video Semantic Event/Concept Detection Using A Subspace-Based Multimedia Data Mining Framework," IEEE Trans. Multimedia, vol. 10, no. 2, pp. 252-259, Feb. 2008
32. C.G.M. Snoek, M. Worring, J. van Gemert, J.-M. Geusebroek, and A.W.M. Smeulders, "The Challenge Problem for Automated Detection of 101 Semantic Concepts in Multimedia," Proc. 14th Ann. ACM Intl Conf. Multimedia (MM), pp. 421-430, 2006 (Pubitemid 47113558)
33. V.S. Tseng, J.-H. Su, J.-H. Huang, and C.-J. Chen, "Integrated Mining of Visual Features, Speech Features, and Frequent Patterns for Semantic Video Annotation," IEEE Trans. Multimedia, vol. 10, no. 2, pp. 260-267, Feb. 2008
34. K.E.A. van De Sande, T. Gevers, and C.G.M. Snoek, "Evaluating Color Descriptors for Object and Scene Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 9, pp. 1582-1596, Sept. 2010
35. M. Marszalek, C. Schmid, H. Harzallah, and J. van De Weijer, "Learning Object Representations for Visual Object Class Recognition," Proc. Visual Recognition Challenge Workshop, 2007
36. I. Laptev and T. Lindeberg, "Space-Time Interest Points," Proc. IEEE Ninth Intl Conf. Computer Vision (ICCV), pp. 432-439, 2003
37. F. Wang, Y.-G. Jiang, and C.-W. Ngo, "Video Event Detection Using Motion Relativity and Visual Relatedness," Proc. 16th ACM Intl Conf. Multimedia (MM), pp. 239-248, 2008
38. G. Wang, T.-S. Chua, and M. Zhao, "Exploring Knowledge of Sub-Domain in a Multi-Resolution Bootstrapping Framework for Concept Detection in News Video," Proc. 16th ACM Intl Conf. Multimedia (MM), pp. 249-258, 2008
39. C. Xu, J. Wang, K. Wan, Y. Li, and L. Duan, "Live Sports Event Detection Based on Broadcast Video and Web-Casting Text," Proc. 14th Ann. ACM Intl Conf. Multimedia (MM), pp. 221-230, 2006 (Pubitemid 47113537)
40. J. Yang, R. Yan, and A.G. Hauptmann, "Cross-Domain Video Concept Detection Using Adaptive SVMs," Proc. 15th Ann. ACM Intl Conf. Multimedia (MM), pp. 188-197, 2007
41. Y. Yang, F. Nie, D. Xu, J. Luo, Y. Zhuang, and Y. Pan, "A Multimedia Retrieval Framework Based on Semi-Supervised Ranking and Relevance Feedback," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 4, pp. 723-742, Apr. 2012
42. C.H. Lampert, H. Nickisch, and S. Harmeling, "Learning to Detect Unseen Object Classes by between-Class Attribute Transfer," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 951-958, 2009.