Collaborative video reindexing via matrix factorization

ACM Transactions on Multimedia Computing, Communications and Applications

Volumn 8, Issue 2, 2012, Pages

  Weng, Ming Fang ^a   Chuang, Yung Yu ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Concept detection; Multimedia content analysis; Semantic video indexing; TRECVID; Unsupervised learning

Indexed keywords

COLLABORATIVE FILTERING; CONCEPT DETECTION; CONCEPT-BASED; DATA SETS; EXTERNAL KNOWLEDGE; LOCAL MODEL; MATRIX FACTORIZATIONS; MULTIMEDIA CONTENT ANALYSIS; NOISY MATRIX; RE-INDEXING; RELATIVE PERFORMANCE; SEMANTIC VIDEO INDEXING; TRECVID; UNSUPERVISED METHOD; USER ANNOTATIONS; VIDEO INDEXING; VIDEO SHOTS;

INDEXING (OF INFORMATION); SEMANTICS; UNSUPERVISED LEARNING;

REFINING;

EID: 84861607626     PISSN: 15516857     EISSN: 15516865     Source Type: Journal    
DOI: 10.1145/2168996.2169003     Document Type: Article

References (33)

1. ADAMS, W. H., IYENGAR, G., LIN, C.-Y., NAPHADE, M. R., NETI, C., NOCK, H. J., AND SMITH, J. R. 2003. Semantic indexing of multimedia content using visual, audio, and text cues. Eurasip J. Appl. Signal Process. 2, 170-185.
2. AMIR, A., ARGILLANDER, J., CAMPBELL, M., HAUBOLD, A., IYENGAR, G., EBADOLLAHI, S., KANG, F., AND NAPHADE, M. R. 2005. IBM research TRECVID-2005 video retrieval system. In Online Proceedings of the TRECVID Workshop.
3. AYTAR, Y., SHAH, M., AND LUO, J. 2008. Utilizing semantic word similarity measures for video retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1-8.
4. CANDÈS, E. J., LI, X., MA, Y., AND WRIGHT, J. 2009. Robust principal component analysis? Tech. rep., Stanford University.
5. CHUA, T.-S., TANG, J., HONG, R., LI, H., LUO, Z., AND ZHENG, Y.-T. 2009. NUS-WIDE: A real-world web image database from National University of Singapore. In Proceedings of the ACM International Conference on Image and Video Retrieval.
6. JI, H., LIU, C., SHEN, Z., AND XU, Y. 2010. Robust video denoising using low rank matrix completion. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
7. JIANG, W., CHANG, S.-F., AND LOUI, A. C. 2007. Context-based concept fusion with boosted conditional random fields. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing. Vol. 1, 949-952.
8. JIANG, Y.-G., NGO, C.-W., AND YANG, J. 2007. Towards optimal bag-of-features for object categorization and semantic video retrieval. In Proceedings of the ACM International Conference on Image and Video Retrieval.
9. JIANG, Y.-G., WANG, J., CHANG, S.-F., AND NGO, C.-W. 2009. Domain adaptive semantic diffusion for large scale context-based video annotation. In Proceedings of the IEEE International Conference on Computer Vision.
10. JIANG, Y.-G., YANAGAWA, A., CHANG, S.-F., AND NGO, C.-W. 2008. CU-VIREO374: Fusing Columbia374 and VIREO374 for large scale semantic concept detection. Tech. rep., Columbia University.
11. JIANG, Y.-G., YANG, J., NGO, C.-W., AND HAUPTMANN, A. G. 2010. Representations of keypoint-based semantic concept detection: A comprehensive study. IEEE Trans. Multimedia 12, 1, 42-53.
12. KENNEDY, L. AND HAUPTMANN, A. 2006. LSCOM lexicon definitions and annotations version 1.0, DTO challenge workshop on large scale concept ontology for multimedia. Tech. rep., Columbia University.
13. KENNEDY, L. S. AND CHANG, S.-F. 2007. A reranking approach for context-based concept fusion in video indexing and retrieval. In Proceedings of the ACM International Conference on Image and Video Retrieval. 333-340. (Pubitemid 350229644)
14. KOREN, Y., BELL, R., AND VOLINSKY, C. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8, 30-37.
15. LEW, M. S., SEBE, N., DJERABA, C., AND JAIN, R. 2006. Content-based multimedia information retrieval: State of the art and challenges. ACM Trans. Multimedia Comput. Commun. Appl. 2, 1, 1-19. (Pubitemid 43890693)
16. LIU, K.-H., WENG, M.-F., TSENG, C.-Y., CHUANG, Y.-Y., AND CHEN, M.-S. 2008. Association and temporal rule mining for post-filtering of semantic concept detection in video. IEEE Trans. Multimedia 10, 2, 240-251.
17. LIU, Y., MEI, T., AND HUA, X.-S. 2009. CrowdReranking: Exploring multiple search engines for visual search reranking. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval. 500-507.
18. NAPHADE, M. R. AND HUANG, T. S. 2001. A probabilistic framework for semantic video indexing, filtering, and retrieval. IEEE Trans. Multimedia 3, 1, 141-151. (Pubitemid 32248394)
19. NAPHADE, M. R., KOZINTSEV, I. V., AND HUANG, T. S. 2002. Factor graph framework for semantic video indexing. IEEE Trans. Circuits Syst. Video Technol. 12, 1, 40-52. (Pubitemid 34291662)
20. NAPHADE, M. R., SMITH, J. R., TEŠIĆ, J., CHANG, S.-F., HSU, W., KENNEDY, L., HAUPTMANN, A., AND CURTIS, J. 2006. Large-scale concept ontology for multimedia. IEEE Multimedia 13, 3, 86-91. (Pubitemid 44263760)
21. QI, G.-J., HUA, X.-S., RUI, Y., TANG, J., MEI, T., WANG, M., AND ZHANG, H.-J. 2008. Correlative multilabel video annotation with temporal kernels. ACM Trans. Multimedia Comput. Comm. Appl. 5, 1, 1-27.
22. QI, G.-J., HUA, X.-S., RUI, Y., TANG, J., MEI, T., WANG, M., AND ZHANG, H.-J. 2007. Correlative multi-label video annotation. In Proceedings of the ACM International Conference on Multimedia. 17-26.
23. RENNIE, J. D. M. AND SREBRO, N. 2005. Fast maximum margin matrix factorization for collaborative prediction. In Proceedings of the International Conference on Machine Learning. 713-719.
24. ROWEIS, S. T. AND SAUL, L. K. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science 290, 5500, 2323-2326. (Pubitemid 32041578)
25. SMEATON, A. F., OVER, P., AND KRAAIJ, W. 2006. Evaluation campaigns and TRECVid. In Proceedings of the ACM International Workshop on Multimedia Information Retrieval. 321-330. (Pubitemid 47168230)
26. SNOEK, C. G. M., VAN DE SANDE, K. E. A., DE ROOIJ, O., HUURNINK, B., GAVVES, E., ODIJK, D., DE RIJKE, M., GEVERS, T., WORRING, M., KOELMA, D. C., AND SMEULDERS, A. W. M. 2009. The MediaMill TRECVID 2009 semantic video search engine. In Online Proceedings of the TRECVID Workshop.
27. SNOEK, C. G. M. AND WORRING, M. 2009. Concept-based video retrieval. Foundations and Trends Infor. Retrieval 2, 4, 215-322.
28. SNOEK, C. G. M., WORRING, M., VAN GEMERT, J. C., GEUSEBROEK, J.-M., AND SMEULDERS, A. W. M. 2006. The challenge problem for automated detection of 101 semantic concepts in multimedia. In Proceedings of the ACM International Conference on Multimedia. 421-430. (Pubitemid 47113558)
29. SU, X. AND KHOSHGOFTAAR, T. M. 2009. A survey of collaborative filtering techniques. Adv. Artif. Intell. 1-19.
30. WENG, M.-F. AND CHUANG, Y.-Y. 2008. Multi-cue fusion for semantic video indexing. In Proceedings of the ACM International Conference on Multimedia. 71-80.
31. YANAGAWA, A., CHANG, S.-F., KENNEDY, L., AND HSU, W. 2007. Columbia University's baseline detectors for 374 LSCOM semantic visual concepts. Tech. rep., Columbia University.
32. YANG, Y.-H., HSU, W. H., AND CHEN, H. H. 2009. Online reranking via ordinal informative concepts for context fusion in concept detection and video search. IEEE Trans. Circuits Syst. Video Technol. 19, 12, 1880-1890.
33. YILMAZ, E. AND ASLAM, J. A. 2006. Estimating average precision with incomplete and imperfect judgments. In Proceedings of the ACM International Conference on Information and Knowledge Management. 102-111. (Pubitemid 47203557)