Event Oriented Dictionary Learning for Complex Event Detection

IEEE Transactions on Image Processing

Volumn 24, Issue 6, 2015, Pages 1867-1878

  Yan, Yan ^a   Yang, Yi ^b   Meng, Deyu ^c   Liu, Gaowen ^a   Tong, Wei ^d   Hauptmann, Alexander G ^e   Sebe, Nicu ^a  

^a UNIVERSITY OF TRENTO   (Italy)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^c XI'AN JIAOTONG UNIVERSITY   (China)

^d GENERAL MOTORS CORPORATION   (United States)

^e Carnegie Mellon University   (United States)

Author keywords

Complex Event Detection; Concept Selection; Event Oriented Dictionary Learning; Supervised Multi task Dictionary Learning

Indexed keywords

IMAGE RETRIEVAL; LAKES; SEMANTICS;

COMPLEX EVENT DETECTION; CONCEPT SELECTION; DICTIONARY LEARNING; HIGH LEVEL SEMANTICS; HIGH-LEVEL FEATURES; MULTI-MODAL FUSION; MULTIMEDIA EVENT DETECTIONS; SEMANTIC INDEXING;

FEATURE EXTRACTION;

EID: 84926500043     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2413294     Document Type: Article

References (52)

1. A. Tamrakar et al., "Evaluation of low-level features and their combinations for complex event detection in open source videos," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3681-3688.
2. Z. Ma, Y. Yang, Z. Xu, S. Yan, N. Sebe, and A. G. Hauptmann, "Complex event detection via multi-source video attributes," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 2627-2633.
3. Y. Yan, Y. Yang, H. Shen, D. Meng, G. Liu, and N. S. A. Hauptmann, "Complex event detection via event oriented dictionary learning," in Proc. AAAI Conf. Artif. Intell., 2015.
4. M.-Y. Chen and A. Hauptmann, "MoSIFT: Recognizing human actions in surveillance videos," School Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep. CMU-CS-09-161, 2009.
5. C. G. M. Snoek and A. W. M. Smeulders, "Visual-concept search solved?" Computer, vol. 43, no. 6, pp. 76-78, Jun. 2010.
6. C. Sun and R. Nevatia, "ACTIVE: Activity concept transitions in video event classification," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 913-920.
7. SIN. (2013). NIST TRECVID Semantic Indexing. [Online]. Available: http://www-nlpir.nist.gov/projects/tv2013/tv2013.html#sin
8. Z.-Z. Lan et al., "Informedia E-lamp @ TRECVID 2013 multimedia event detection and recounting (MED and MER)," in Proc. NIST TRECVID Workshop, 2013.
9. L. Jiang, A. G. Hauptmann, and G. Xiang, "Leveraging high-level and low-level features for multimedia event detection," in Proc. ACM Int. Conf. Multimedia, 2012, pp. 449-458.
10. P. Natarajan et al., "Multimodal feature fusion for robust event detection in web videos," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 1298-1305.
11. K. Tang, D. Koller, and L. Fei-Fei, "Learning latent temporal structure for complex event detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 1250-1257.
12. Z.-Z. Lan, L. Bao, S.-I. Yu, W. Liu, and A. G. Hauptmann, "Double fusion for multimedia event detection," in Proc. Int. Conf. Multimedia Modeling, 2012, pp. 173-185.
13. S. Oh et al., "Multimedia event detection with multimodal feature fusion and temporal concept localization," Mach. Vis. Appl., vol. 25, no. 1, pp. 49-69, Jan. 2014.
14. L. Brown et al., "IBM Research and Columbia University TRECVID-2013 multimedia event detection (MED), multimedia event recounting (MER), surveillance event detection (SED), and semantic indexing (SIN) systems," in Proc. NIST TRECVID Workshop, 2013.
15. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1794-1801.
16. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, Dec. 2006.
17. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Discriminative learned dictionaries for local image analysis," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
18. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006.
19. H. Lee, A. Battle, R. Raina, and A. Y. Ng, "Efficient sparse coding algorithms," in Proc. Conf. Adv. Neural Inf. Process. Syst., 2006, pp. 801-808.
20. Z. Jiang, Z. Lin, and L. S. Davis, "Learning a discriminative dictionary for sparse coding via label consistent K-SVD," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 1697-1704.
21. th Annu. Int. Conf. Mach. Learn., 2009, pp. 689-696.
22. T. Evgeniou and M. Pontil, "Regularized multi-task learning," in Proc. ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2004, pp. 109-117.
23. A. Argyriou, T. Evgeniou, and M. Pontil, "Multi-task feature learning,"in Proc. Conf. Adv. Neural Inf. Process. Syst., 2007, pp. 1-8.
24. A. Jalali, P. K. Ravikumar, S. Sanghavi, and C. Ruan, "A dirty model for multi-task learning," in Proc. Conf. Adv. Neural Inf. Process. Syst., 2010, pp. 964-972.
25. S. Ji and J. Ye, "An accelerated gradient method for trace norm minimization," in Proc. Int. Conf. Mach. Learn., 2009, pp. 457-464.
26. J. Chen, J. Liu, and J. Ye, "Learning incoherent sparse and low-rank patterns from multiple tasks," in Proc. ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2010, p. 22.
27. L. Jacob, F. R. Bach, and J.-P. Vert, "Clustered multi-task learning: A convex formulation," in Proc. Conf. Adv. Neural Inf. Process. Syst., 2008, pp. 745-752.
28. J. Zhou, J. Chen, and J. Ye, "Clustered multi-task learning via alternating structure optimization," in Proc. Conf. Adv. Neural Inf. Process. Syst., 2011, pp. 702-710.
29. J. Chen, J. Zhou, and J. Ye, "Integrating low-rank and group-sparse structures for robust multi-task learning," in Proc. ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2011, pp. 42-50.
30. A. Maurer, M. Pontil, and B. Romera-Paredes, "Sparse coding for multitask and transfer learning," in Proc. Int. Conf. Mach. Learn., 2013, pp. 343-351.
31. X.-T. Yuan and S. Yan, "Visual classification with multi-task joint sparse representation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 3493-3500.
32. Y. Yan, E. Ricci, R. Subramanian, O. Lanz, and N. Sebe, "No matter where you are: Flexible graph-guided multi-task learning for multi-view head pose classification under target motion," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1177-1184.
33. T. Zhang, B. Ghanem, S. Liu, and N. Ahuja, "Robust visual tracking via multi-task sparse learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2042-2049.
34. Y. Yan, E. Ricci, R. Subramanian, G. Liu, and N. Sebe, "Multitask linear discriminant analysis for view invariant action recognition," IEEE Trans. Image Process., vol. 23, no. 12, pp. 5599-5611, Dec. 2014.
35. Y. Yan, E. Ricci, G. Liu, and N. Sebe, "Recognizing daily activities from first-person videos with multi-task clustering," in Proc. Asian Conf. Comput. Vis., 2014, pp. 1-16.
36. C. Fellbaum, Ed., WordNet: An Electronic Lexical Database. Cambridge, MA, USA: MIT Press, 1998.
37. M. Strube and S. P. Ponzetto, "WikiRelate! Computing semantic relatedness using Wikipedia," in Proc. AAAI Conf. Artif. Intell., 2006, pp. 1-6.
38. NIST. (2013). NIST TRECVID Multimedia Event Detection. [Online]. Available: http://www.nist.gov/itl/iad/mig/med13.cfm
39. th Int. Conf. Mach. Learn., 1998, pp. 296-304.
40. th Int. Joint Conf. Artif. Intell., 1995, pp. 448-453.
41. J. Luo, C. Papin, and K. Costello, "Towards extracting semantically meaningful key frames from personal video clips: From humans to computers," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 2, pp. 289-301, Feb. 2009.
42. H. Zou and T. Hastie, "Regularization and variable selection via the elastic net," J. Roy. Statist. Soc., Ser. B, vol. 67, no. 2, pp. 301-320, Apr. 2005.
43. Q. Zhang and B. Li, "Discriminative K-SVD for dictionary learning in face recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2691-2698.
44. A. Beck and M. Teboulle, "A fast iterative shrinkage-thresholding algorithm for linear inverse problems," SIAM J. Imag. Sci., vol. 2, no. 1, pp. 183-202, 2009.
45. I. F. Gorodnitsky and B. D. Rao, "Sparse signal reconstruction from limited data using FOCUSS: A re-weighted minimum norm algorithm,"IEEE Trans. Signal Process., vol. 45, no. 3, pp. 600-616, Mar. 1997.
46. Y. She, "Thresholding-based iterative selection procedures for model selection and shrinkage," Electron. J. Statist., vol. 3, pp. 384-415, Nov. 2009.
47. D. Krishnan and R. Fergus, "Fast image deconvolution using hyper- Laplacian priors," in Proc. Conf. Adv. Neural Inf. Process. Syst., 2009, pp. 1033-1041.
48. W. Zuo, D. Meng, L. Zhang, X. Feng, and D. Zhang, "A generalized iterated shrinkage algorithm for non-convex sparse coding," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 217-224.
49. L. Cao et al., "IBM Research and Columbia University TRECVID-2011 multimedia event detection (MED) system," in Proc. NIST TRECVID Workshop, Dec. 2011.
50. D. Oneata et al., "AXES at TRECVid 2012: KIS, INS, and MED," in Proc. NIST TRECVID Workshop, 2012.
51. L. Jie, T. Tommasi, and B. Caputo, "Multiclass transfer learning from unconstrained priors," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 1863-1870.
52. A. Vahdat, K. Cannons, G. Mori, S. Oh, and I. Kim, "Compositional models for video event detection: A multiple kernel learning latent variable approach," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1185-1192.