Sparse ensemble learning for concept detection

IEEE Transactions on Multimedia

Volumn 14, Issue 1, 2012, Pages 43-54

  Tang, Sheng ^a   Zheng, Yan Tao ^b   Wang, Yu ^a   Chua, Tat Seng ^c  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Concept detection; ensemble learning; non negative matrix factorization; pattern recognition; sparse coding

Indexed keywords

CONCEPT DETECTION; DATA SETS; DATA SPACE; ENSEMBLE LEARNING; ENSEMBLE MODELS; INDIVIDUAL CLASSIFIERS; LOCAL CLASSIFIER; NON-ZERO COEFFICIENTS; NONNEGATIVE MATRIX FACTORIZATION; SCALE PATTERN; SPARSE CODING; SPARSE NON-NEGATIVE MATRIX FACTORIZATIONS; TESTING SAMPLES; TRECVID; VISUAL CONCEPT;

BLIND SOURCE SEPARATION; FACE RECOGNITION; FACTORIZATION; FEATURE EXTRACTION; PATTERN RECOGNITION;

MATRIX ALGEBRA;

EID: 84862934337     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2168198     Document Type: Article

References (79)

1. Y.-T. Zheng, S.-Y. Neo, T.-S. Chua, and Q. Tian, "Probabilistic optimized ranking for multimedia semantic concept detection via RVM," in Proc. ACM Conf. Image and Video Retrieval (CIVR), Jul. 2008, pp. 161-168.
2. C. G. M. Snoek, M. Worring, J. C. van Gemert, J.-M. Geusebroek, and A. W. Smeulders, "The challenge problem for automated detection of 101 semantic concepts in multimedia," in Proc. ACM Conf. Multimedia, Oct. 2006, pp. 421-430. (Pubitemid 47113558)
3. Y.-G. Jiang, J. Yang, C.-W. Ngo, and A. G. Hauptmann, "Representations of keypoint-based semantic concept detection: A comprehensive study," IEEE Trans. Multimedia, vol. 12, pp. 42-53, 2010.
4. M. R. Naphade and J. R. Smith, "On the detection of semantic concepts at TRECVid," in Proc. ACMInt. Conf. Multimedia, 2004, pp. 660-667. (Pubitemid 40211843)
5. A. Krogh and J. Vedelsby, "Neural network ensembles, cross validation, and active learning," Proc. Advances in Neural Information Processing Systems, pp. 231-238, 1995.
6. D. W. Opitz and J. W. Shavlik, "Generating accurate and diverse members of a neural-network ensemble," Proc. Advances in Neural Information Processing Systems, pp. 535-541, 1996.
7. D. W. Opitz and J. W. Shavlik, "Actively searching for an effective neural network ensemble," Connect. Sci., vol. 8, no. 3, pp. 337-354, 1996. (Pubitemid 127011452)
8. L. I. Kuncheva and C. J. Whitaker, "Controlling the diversity in classifier ensembles through a measure of agreement," Pattern Recognit., vol. 38, no. 11, pp. 2195-2199, 2005.
9. D. Opitz and R. Maclin, "Popular ensemble methods: An empirical study," J. Artif. Intell. Res., vol. 11, pp. 169-198, 1999. (Pubitemid 129628763)
10. L. Zhang and W.-D. Zhou, "Sparse ensembles using weighted combination methods based on linear programming," Pattern Recognit., vol. 44, pp. 97-106, Jan. 2011.
11. T. Graepel, R. Herbrich, and J. Shawe-Taylor, "Generalisation error bounds for sparse linear classifiers," in Proc. 13th Annu. Conf. Computational Learning Theory (COLT '00), 2000, pp. 298-303.
12. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," J. Comput. Syst. Sci., vol. 55, no. 1, pp. 119-139, 1997. (Pubitemid 127433398)
13. M. Szummer and R. W. Picard, "Indoor-outdoor image classification," in Proc. IEEE Int.Workshop Content-Based Access of Image and Video Databases, in Conjunction With ICCV98, 1998.
14. A. K. J. A. Vailaya and H.-J. Zhang, "On image classification: City images vs. landscapes," Pattern Recognit., vol. 31, pp. 1921-1936, 1998.
15. Y.-G. Jiang, "Large scale semantic concept detection, fusion, and selection for domain adaptive video search," Ph.D. dissertation, City University of Hong Kong, Kowloon, 2009.
16. S.-F. Chang, J. He, Y.-G. Jiang, E. E. Khoury, C.-W. Ngo, A. Yanagawa, and E. Zavesky, "Columbia university/vireo-cityu/irit trecvid2008 high-level feature extraction and interactive video search," in Proc. NIST TRECVID Workshop, Nov. 2008.
17. C.-W. Ngo, Y.-G. Jiang, X.-Y.Wei, W. Zhao, Y. Liu, J.Wang, S. Zhu, and S.-F. Chang, "Vireo/dvmm at trecvid 2009: High-level feature extraction, automatic video search, and content-based copy detection," in Proc. NIST TRECVID Workshop, Nov. 2009.
18. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
19. S. Tang, J.-T. Li, and M. Li et al., "Trecvid 2007 high-level feature extraction by MCG-ICT-CAS," in Proc. NIST TRECVID Workshop, Nov. 2007.
20. I. Laptev, "On space-time interest points," Int. J. Comput. Vision, vol. 64, pp. 107-123, Sep. 2005. (Pubitemid 41314645)
21. Y.-G. Jiang et al., "Columbia-UCF TRECVID 2010 Multimedia Event Detection: Combining multiple modalities, contextual concepts, and temporal matching," in Proc. NIST TRECVID Workshop, Nov. 2006.
22. J. Cao, Y. Lan, and J. Li et al., "Intelligent multimedia group of Tsinghua University at trecvid 2006," in Proc. NIST TRECVIDWorkshop, Nov. 2006.
23. A. Amir, M. Berg, and S.-F. Chang et al., "IBM research trecvid-2003 video retrieval system," in Proc. TREC Video Retrieval Evaluation Workshop, Nov. 2003.
24. D. K. B. Pytlik, A. Ghoshal, and S. Khudanpur, "Trecvid-2005 experiments at Johns Hopkins University: Using Hidden Markov Models for Video Retrieval," in Proc. NIST TRECVID Workshop, Nov. 2005.
25. M.Wang, X.-S. Hua, R. Hong, J. Tang, G.-J. Qi, and Y. Song, "Unified video annotation via multi-graph learning," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 5, pp. 733-746, May 2009.
26. M. Wang, X.-S. Hua, J. Tang, and R. Hong, "Beyond distance measurement: Constructing neighborhood similarity for video annotation," IEEE Trans. Multimedia, vol. 11, no. 3, pp. 465-476, Apr. 2009.
27. C. Snoek, M. Worring, and A. Smeulders, "Early versus late fusion in semantic video analysis," in Proc. ACM Int. Conf. Multimedia, Singapore, Nov. 2005, pp. 399-402.
28. G. Q. S. Ayache and J. Gensel, "Classifier fusion for SVM-based multimedia semantic indexing," in Proc. Eur. Conf. Information Retrieval, 2007.
29. S. Tang, J.-T. Li, M. Li, C. Xie, Y. Liu, K. Tao, and S.-X. Xu, "Trecvid 2008 high-level feature extraction by MCG-ICT-CAS," in Proc. NIST TRECVID Workshop, Nov. 2008.
30. G. J. Qi, X. S. Hua, J. T. Y. Rui, T. Mei, and H. J. Zhang, "Correlative multi-label video annotation," in Proc. ACMInt. Conf. Multimedia, 2007.
31. A. Hauptmann, R.Yan, and W.-H. Lin, "Howmany high-level concepts will fill the semantic gap in news video retrieval?," in Proc. 6th ACM Int. Conf. Image and Video Retrieval, 2007, pp. 627-634, ACM. (Pubitemid 350229681)
32. M.-F. Weng and Y.-Y. Chuang, "Multi-cue fusion for semantic video indexing," in Proc. ACM Int. Conf. Multimedia, 2008.
33. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 12, pp. 1349-1380, Dec. 2000. (Pubitemid 32088465)
34. D. Borth, A. Ulges, and T. Breuel, AdaptingWeb-Based Video Concept Detectors for Different Target Domains. Oak Park, IL: Bentham Science, 2010, ch. 6.
35. W. Jiang, E. Zavesky, S.-F. Chang, and A. Loui, "Cross-domain learning methods for high-level visual concept classification," in Proc. Int. Conf. Image Processing, 2008.
36. C. G. Snoek, K. E. van de Sande, and O. de Rooij et al., "The mediamill trecvid 2010 semantic video search engine," in Proc. NIST TRECVID Workshop, Nov. 2010.
37. C. G. M. Snoek and M. Worring, "Concept-based video retrieval," Found. Trends Inf. Retr., vol. 2, no. 4, pp. 215-322, 2009.
38. A. F. Smeaton, P. Over, and W. Kraaij, "Evaluation campaigns and trecvid," in Proc. 8th ACM Int. Workshop Multimedia Information Retrieval, 2006, pp. 321-330, ACM Press. (Pubitemid 47168230)
39. A. F. Smeaton, P. Over, and W. Kraaij, "High-level feature detection from video in TRECVid: A 5-year retrospective of achievements," in Multimedia Content Analysis, Theory and Applications, A. Divakaran, Ed. Berlin, Germany: Springer-Verlag, 2009, pp. 151-174.
40. NIST, Trecvid Workshop Papers, 2001-2010. [Online]. Available: http://www-nlpir.nist.gov/projects/tvpubs/tv.pubs.org.html.
41. L. I. Kuncheva, Combining Pattern Classifiers: Methods and Algorithms. New York: Wiley, 2004.
42. L. Rokach, Pattern Classification Using Ensemble Methods. Singapore: World Scientific, 2010.
43. T. G. Dietterich, "Ensemble methods in machine learning," Multiple Classifiers Syst., vol. 1857, pp. 1-15, 2000.
44. L. Breiman, "Bagging predictors," Mach. Learn., vol. 24, pp. 123-140, Aug. 1996. (Pubitemid 126724382)
45. F. Y. and S. R. E. , "Experiments with a new boosting algorithm," in Proc. 13th Int. Conf. Machine Learning, 1996, pp. 325-332.
46. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent dirichlet allocation," J. Mach. Learn. Res., 2003.
47. H. Zhang, A. C. Berg, M. Maire, and J. Malik, "SVM-KNN: Discriminative nearest neighbor classification for visual category recognition," in Proc. Conf. Computer Vision and Pattern Recognition (CVPR), 2006, pp. 2126-2136. (Pubitemid 44931577)
48. M. Tipping, "The relevance vector machine," Adv. Neural Inf. Process. Syst., 2000.
49. G. Martínez-Muñoz, D. Hernández-Lobato, and A. Suárez, "An analysis of ensemble pruning techniques based on ordered aggregation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 245-259, Feb. 2009.
50. G. Tsoumakas, L. Angelis, and I. Vlahavas, "Selective fusion of heterogeneous classifiers," Intell. Data Anal., vol. 9, pp. 511-525, Nov. 2005.
51. D. D. Lee and H. S. Seung, "Learning the parts of objects by non-negative matrix factorization.," Nature, vol. 401, pp. 788-791, Oct. 1999.
52. P. O. Hoyer, "Non-negative matrix factorization with sparseness constraints," J. Mach. Learn. Res., vol. 5, pp. 1457-1469, Dec. 2004.
53. J. Mairal, F. Bach, J. Ponce, and G. Sapiro, "Online learning for matrix factorization and sparse coding," J. Mach. Learn. Res., vol. 11, pp. 19-60, Mar. 2010.
54. C. Févotte, N. Bertin, and J.-L. Durrieu, "Nonnegative matrix factorization with the Itakura-Saito divergence: With application to music analysis," Neural Computat., vol. 21, no. 3, pp. 793-830, 2009.
55. A. Adler, Y. Hel-Or, and M. Elad, "A weighted discriminative approach for image denoising with overcomplete representations," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), 2010, pp. 782-785.
56. M. Elad, Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing. NewYork: Springer, Aug. 2010.
57. S. Farsiu, M. Elad, and P. Milanfar, "Multiframe demosaicing and super-resolution of color images," IEEE Trans. Image Process., vol. 15, no. 1, pp. 141-159, Jan. 2006. (Pubitemid 43051464)
58. J. Mairal, M. Elad, and G. Sapiro, "Sparse representation for color image restoration," IEEE Trans. Image Process., vol. 17, no. 1, pp. 53-69, Jan. 2008.
59. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Discriminative learned dictionaries for local image analysis," in Proc. Conf. Computer Vision and Pattern Recognition (CVPR), 2008.
60. J. Yang, K. Yu, Y. Gong, and T. S. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. Conf. Computer Vision and Pattern Recognition (CVPR), 2009, pp. 1794-1801.
61. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
62. A. Wagner, J. Wright, A. Ganesh, Z. Zhou, and Y. Ma, "Towards a practical face recognition system: Robust registration and illumination by sparse representation," in Proc. Conf. Computer Vision and Pattern Recognition (CVPR), 2009, pp. 597-604.
63. J. Wright, Y. Ma, J. Mairal, G. Sapiro, T. Huang, and S. Yan, "Sparse representation for computer vision and pattern recognition," Proc. IEEE, vol. 98, no. 6, pp. 1031-1044, Jun. 2009.
64. V. N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
65. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," in Proc. 13th Advances in Neural Information Processing, 2001, pp. 556-562.
66. R. Tibshirani, "Regression shrinkage and selection via the lasso," Statist. Soc.. Series B, vol. 58, no. 1, pp. 267-288, 1996.
67. J. Friedman, T. Hastie, H. Hofling, and R. Tibshirani, "Pathwise coordinate optimization," Ann. Appl. Statist., vol. 1, no. 2, pp. 302-332, 2007.
68. T. T.Wu and K. Lange, "Coordinate descent algorithms for lasso penalized regression," Ann. Appl. Statist., vol. 2, no. 1, pp. 224-244, 2008.
69. T. J. I. Efron, Bradley, Hastie, and R. Tibshirani, "Least angle regression," Ann. Appl. Statist., vol. 32, no. 2, pp. 407-499, 2004. (Pubitemid 41250302)
70. A. Bordes, S. Ertekin, J. Weston, and L. Bottou, "Fast kernel classifiers with online and active learning," J. Mach. Learn. Res., vol. 6, pp. 1579-1619, Dec. 2005.
71. P. Over, G. Awad, R. T. Rose, J. G. Fiscus, W. Kraaij, and A. F. Smeaton, "Trecvid 2008-Goals, tasks, data, evaluation mechanisms and metrics," in Proc. NIST TRECVID Workshop, 2008.
72. P. Over, G. Awad, J. Fiscus, and A. Smeaton, "Trecvid 2009-Goals, tasks, data, evaluation mechanisms and metrics," in Proc. NIST TRECVID Workshop, Nov. 2009.
73. S. Ayache and G. Quénot, "Video corpus annotation using active learning," in Proc. IR Research, 30th Eur. Conf. Advances in Information Retrieval (ECIR'08), 2008, pp. 187-198. (Pubitemid 351499069)
74. E. Yilmaz and J. A. Aslam, "Estimating average precision with incomplete and imperfect judgments," in Proc. 15th ACMInt. Conf. Information and Knowledge Management (CIKM '06), 2006, pp. 102-111. (Pubitemid 47203557)
75. B. Efron and R. Tibshirani, An Introduction to the Bootstrap. London, U.K.: Chapman & Hall, 1993.
76. N. Cai, M. Li, S. Lin, Y. Zhang, and S. Tang, "AP-based adaboost in high level feature extraction at trecvid," in Proc. 2nd Int. Conf. Pervasive Computing and Applications, Jul. 2007.
77. R. E. Schapire and Y. Singer, "Improved boosting algorithms using confidence-rated predictions," Mach. Learn., vol. 37, pp. 297-336, Dec. 1999. (Pubitemid 32210620)
78. K. Mikolajczyk and C. Schmid, "Scale and affine invariant interest point detectors," Int. J. Comput. Vis., vol. 60, no. 1, pp. 63-86, 2004.
79. J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust wide baseline stereo from maximally stable extremal regions," in Proc. British Machine Vision Conf. 2002, Sep. 2-5, 2002.