Effective transfer tagging from image to video

ACM Transactions on Multimedia Computing, Communications and Applications

Volumn 9, Issue 2, 2013, Pages

  Yang, Yang ^a   Yang, Yi ^b   Shen, Heng Tao ^a  

^a UNIVERSITY OF QUEENSLAND   (Australia)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Cross media; Semi supervised learning; Transfer learning; Video tagging

Indexed keywords

CROSS-MEDIA; LABELED AND UNLABELED DATA; RELIABLE PERFORMANCE; SEMI-SUPERVISED LEARNING; STATE-OF-THE-ART ALGORITHMS; TRANSFER LEARNING; USER-GENERATED VIDEO; VIDEO TAGGING;

ALGORITHMS; OPTIMIZATION; SEMANTICS; SUPERVISED LEARNING;

ITERATIVE METHODS;

EID: 84878475233     PISSN: 15516857     EISSN: 15516865     Source Type: Journal    
DOI: 10.1145/2457450.2457456     Document Type: Article

References (42)

1. BELKIN, M., NIYOGI, P., AND SINDHWANI, V. 2006. Manifold regularization: A geometric framework for learning from labeled and unlabeled examples. J. Mach. Learn. Res. 7, 2399-2434. (Pubitemid 44708005)
2. BORGWARDT, K. M., GRETTON, A., RASCH, M. J., KRIEGEL, H.-P., SCHOLKOPF, B., AND SMOLA, A. J. 2006. Integrating structured biological data by kernel maximum mean discrepancy. Bioinf. 22, e49-e57. (Pubitemid 44288272)
3. CHUA, T.-S., TANG, J., HONG, R., LI, H., LUO, Z., AND ZHENG, Y. 2009. Nus-Wide: A real-world web image database from national university of singapore. In Proceeedings of the ACM International Conference on Image and Video Retrieval (CIVR'09). 48:1- 48:9.
4. CORTES, C.,MOHRI, M., AND ROSTAMIZADEH, A. 2009. L2 regularization for learning kernels. In Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI'09). 109-116.
5. DAI, W., YANG, Q., XUE, G., AND YU, Y. 2007. Boosting for transfer learning. In Proceedings of the International Conference on Machine Learning (ICML'07). 193-200.
6. DUAN, L., XU, D., TSANG, I. W.-H., AND LUO, J. 2010. Visual event recognition in videos by learning from web data. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'10). 1959-1966.
7. FAN, J.,SHEN, Y.,ZHOU, N., AND GAO, Y. 2010. Harvesting large-scale weakly-tagged image databases from the web. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recogntion (CVPR'10). 802-809.
8. GRANT, M. AND BOYD, S. 2011. CVX: Matlab software for disciplined convex programming, version 1.21. http://cvxr.com/cvx/.
9. HUISKES, M. J. AND LEW, M. S. 2008. The mir flickr retrieval evaluation. In Proceedings of the ACM International Conference on Multimedia Information Retrieval (MIR'08). 39-43.
10. JIANG, W., ZAVESKY, E., CHANG, S., AND LOUI, A. 2008. Cross-Domain learning methods for high-level visual concept classification. In Proceedings of the International Conference on Image Processing (ICIP'08). 161-164.
11. JIANG, Y.-G., NGO, C.-W., AND CHANG, S.-F. 2009a. Semantic context transfer across heterogeneous sources for domain adaptive video search. In Proceedings of the ACM Multimedia Conference. 155-164.
12. JIANG, Y.-G., WANG, J., CHANG, S.-F., AND NGO, C.-W. 2009b. Domain adaptive semantic diffusion for large scale context-based video annotation. In Proceedings of the IEEE International Conference on Computer Vision (ICCV'09). 1420-1427.
13. LIU, X., YAO, H., JI, R., XU, P., SUN, X., AND TIAN, Q. 2011. Learning heterogeneous data for hierarchical web video classification. In Proceedings of the ACM Multimedia Conference. 433-442.
14. LOUI, A. C., CHANG, S.-F., ELLIS, D., JIANG, W.,KENNEDY, L., LEE, K., AND YANAGAWA, A. 2008. Kodak's consumer video benchmark data set: concept definition and annotation. http://www.ee.columbia.edu/?wjiang/references/ datamir07.pdf.
15. OJALA, T.,PIETIKAINEN, M., ANDHARWOOD, D. 1996. A comparative study of texture measures with classification based on featured distributions. Pattern Recogn. 29, 51-59.
16. PAN, S. J.,KWOK, J. T., AND YANG, Q. 2008. Transfer learning via dimensionality reduction. In Proceedings of the AAAI Conference on Artificial Intelligence. 677-682.
17. RAKOTOMAMONJY, A., BACH, F. R., CANU, S., AND GRANDVALET, Y. 2008. Simplemkl. J. Mach. Learn. Res. 9, 2491-2521.
18. ROCKAFELLAR, R. AND ROGER, J. 2005. Variational Analysis. Springer
19. TANG, J., HUA, X.-S., QI, G.-J., SONG, Y., AND WU, X. 2008. Video annotation based on kernel linear neighborhood propagation. IEEE Trans. Multimedia 10, 4, 620-628. (Pubitemid 351711238)
20. TANG, J., HUA, X.-S., QI, G.-J., WANG, M., MEI, T., AND WU, X. 2007. Structure-Sensitive manifold ranking for video concept detection. In Proceedings of the ACM Multimedia Conference. 852-861.
21. TANG, J., YAN, S., HONG, R.,QI, G.-J., AND CHUA, T.-S. 2009. Inferring semantic concepts from community-contributed images and noisy tags. In Proceedings of the ACM Multimedia Conference. 223-232.
22. TORRALBA, A., FERGUS, R., AND FREEMAN, W. 2008. 80 million tiny images: A large data set for nonparametric object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 30, 11, 1958-1970.
23. TRECVID. 2007. Trec video retrieval evaluation. http://www.nlpir.nist. gov/projects/trecvid.
24. WANG, M., HONG, R., LI, G., ZHA, Z., YAN, S., AND CHUA, T. 2011. Event driven web video summarization by tag localization and key-shot identification. IEEE Trans. Multimedia 14, 99, 1-1.
25. WANG, M., HUA, X., MEI, T., HONG, R., QI, G., SONG, Y., AND DAI, L. 2009a. Semi-Supervised kernel density estimation for video annotation. J. Comput. Vis. Image Understand. 113, 3, 384-396.
26. WANG, M., HUA, X., TANG, J., AND HONG, R. 2009b. Beyond distance measurement: Constructing neighborhood similarity for video annotation. IEEE Trans. Multimedia 11, 3, 465-476.
27. WANG, M, HUA, X.-S., HONG, R., TANG, J., QI, G.-J., AND SONG, Y. 2009c. Unified video annotation via multigraph learning. IEEE Trans. Circ. Syst. Video Technol. 19, 5, 733-746.
28. WANG, M., YANG, K., HUA, X., AND ZHANG, H. 2010. Towards a relevant and diverse search of social images. IEEE Trans. Multimedia 12, 8, 829-842.
29. YANG, J., YAN, R., AND HAUPTMANN, A. G. 2007. Cross-Domain video concept detection using adaptive svms. In Proceedings of the ACM Multimedia Conference. 188-197.
30. YANG, Y., HUANG, Z., SHEN, H. T., AND ZHOU, X. 2011a. Mining multi-tag association for image tagging. World Wide Web 14, 2, 133-156.
31. YANG, Y., XU, D., NIE, F., LUO, J., AND ZHUANG, Y. 2009. Ranking with local regression and global alignment for cross media retrieval. In Proceedings of the ACM Multimedia Conference. 175-184.
32. YANG, Y., YANG, Y., HUANG, Z., AND MA, Z. 2012. Robust cross-media transfer for visual event detection. In Proceedings of the ACM Multimedia Conference.
33. YANG, Y., YANG, Y.,HUANG, Z., AND SHEN, H. 2011b. Transfer tagging from image to video. In Proceedings of the ACM Multimedia Conference. 1137-1140.
34. YANG, Y., YANG, Y., HUANG, Z., SHEN, H., AND NIE, F. 2011c. Tag localization with spatial correlations and joint group sparsity. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'11). 881-888.
35. YAO, Y. AND DORETTO, G. 2010. Boosting for transfer learning with multiple sources. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'10). 1855-1862.
36. ZHA, Z.-J., HUA, X.-S., MEI, T., WANG, J., QI, G.-J., AND WANG, Z. 2008. Joint multi-label multi-instance learning for image classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'08). 1-8.
37. ZHA, Z.-J., WANG, M., ZHENG, Y.-T., YANG, Y., HONG, R., AND CHUA, T.-S. 2012. Interactive video indexing with statistical active learning. IEEE Trans. Multimedia 14, 1, 17-27.
38. ZHA, Z.-J., YANG, L., MEI, T., WANG, M., AND WANG, Z. 2009. Visual query suggestion. In Proceedings of the ACM Multimedia Conference. 15-24.
39. ZHA, Z.-J., YANG, L., MEI, T., WANG, M., WANG, Z., CHUA, T.-S., AND HUA, X.-S. 2010. Visual query suggestion: Towards capturing user intent in internet image search. ACM Trans. Multimedia Comput. Comm. Appl. 6, 3, 1-19.
40. ZHU, X. 2008. Semi-Supervised learning literature survey. http://pages.cs.wisc.edu/?jerryzhu/pub/ssl survey 7 19 2008.pdf.
41. ZHU, X., HUANG, Z., AND SHEN, H. T. 2011a. Video-to-Shot tag allocation by weighted sparse group lasso. In Proceedings of the ACM Multimedia Conference. 1501-1504.
42. ZHU, Y., CHEN, Y., LU, Z., PAN, S., XUE, G., YU, Y., AND YANG, Q. 2011b. Heterogeneous transfer learning for image classification. In Proceedings of the AAAI Conference on Artificial Intelligence. 1304-1309. .