Contextual video recommendation by multimodal relevance and user feedback

ACM Transactions on Information Systems

Volumn 29, Issue 2, 2011, Pages

  Mei, Tao ^a   Yang, Bo ^b   Hua, Xian Sheng ^a   Li, Shipeng ^a  

^a MICROSOFT RESEARCH ASIA   (China)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Image retrieval; Relevance feedback; Video recommendation

Indexed keywords

AUDIO TRACK; INTERNET DELIVERY; MULTI-MODAL; ONLINE VIDEO; RELEVANCE FEEDBACK; UNIFIED FRAMEWORK; USER FEEDBACK; USER PROFILE; VIDEO CONTENTS; VIDEO DATA; VIDEO RECOMMENDATION;

IMAGE RETRIEVAL; VIDEO RECORDING;

FEEDBACK;

EID: 80051538000     PISSN: 10468188     EISSN: 15582868     Source Type: Journal    
DOI: 10.1145/1961209.1961213     Document Type: Article

References (47)

1. ADOMAVICIUS, G. AND TUZHILIN, A. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Engin. 17, 6, 734-749. (Pubitemid 40860454)
2. BAEZA-YATES, R. AND RIBEIRO-NETO, B. 1999. Modern Information Retrieval. Addison Wesley.
3. BALABANOVIC, M. 1998. Exploring versus exploiting when learning user models for text recommendation. User Model. User-Adapt. Interact. 8, 4, 71-102. (Pubitemid 128513054)
4. BALUJA, S., SETH, R., SIVAKUMAR, D., ET AL. 2008. Video suggestion and discovery for youtube, taking random walks through the view graph. In Proceedings of the International World Wide Web Conference.
5. BOLL, S. 2007. Multitube-Where multimedia and web 2.0 could meet. IEEE Multimedia Mag. 14, 1, 9-13.
6. BOLLEN, J., NELSON, M. L., ARAUJO, R., AND GEISLER, G. 2005. Video recommendations for the open video project. In Proceedings of the ACM/IEEE-CS Joint Conference on Digital Libraries. 369-369.
7. BURKE, R. 2002. Hybrid recommender systems: Survey and experiments. User Model. User-Adapt. Interact. 12, 4, 331-370.
8. CHANG, S.-F., MA, W.-Y., AND SMEULDERS, A. 2007. Recent advances and challenges of semantic image/video search. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
9. CHRISTAKOU, C. AND STAFYLOPATIS, A. 2005. A hybrid movie recommender system based on neural networks. In Proceedings of the 5th International Conference on Intelligent Systems Design and Applications.
10. DATTA, R., JOSHI, D., LI, J., AND WANG, J. Z. 2008. Image retrieval: Ideas, influences, and trends of the new age. ACM Comput. Surv. 40, 65.
11. ENCYCLOPEDIA. 2011. Encyclopedia. http://www.encyclopedia.com/.
12. FOUSS, F., PIROTTE, A., RENDERS, J. M., AND SAERENS, M. 2007. Random-Walk computation of similarities between nodes of a graph, with application to collaborative recommendation. IEEE Trans. Knowl. Data Engin. 19, 3, 355-369. (Pubitemid 46374533)
13. GIBAS, M., CANAHUATE, G., AND FERHATOSMANOGLU, H. 2008. Online index recommendations for highdimensional databases using query workloads. IEEE Trans. Knowl. Data Engin. 20, 2, 246-260.
14. GU, Z., MEI, T., HUA, X.-S., TANG, J., AND WU, X. 2008. Multi-Layer multi-instance learning for video concept detection. IEEE Trans. Multimedia 10, 8, 1605-1616.
15. HAUPTMANN, A. G., CHRISTEL, M. G., AND YAN, R. 2008. Video retrieval based on semantic concepts. Proc. IEEE 96, 4, 602-622.
16. HU, J., ZENG, H.-J., LI, H., NIU, C., AND CHEN, Z. 2007. Demographic prediction based on user's browsing behavior. In Proceedings of the International World Wide Web Conference.
17. HUA, X.-S., LU, L., AND ZHANG, H.-J. 2004a. Optimization-Based automated home video editing system. IEEE Trans. Circ. Syst. Video Tech. 14, 5, 572-583.
18. HUA, X.-S. AND ZHANG, H.-J. 2004b. An attention-based decision fusion scheme for multimedia information retrieval. In Proceedings of the IEEE Pacific-Rim Conference on Multimedia.
19. IWATA, T., SAITO, K., AND YAMADA, T. 2008. Recommendation method for improving customer lifetime value. IEEE Trans. Knowl. Data Engin. 20, 9, 1254-1263.
20. KENNEDY, L., CHANG, S.-F., AND NATSEV, A. 2008. Query-Adaptive fusion for multimodal search. Proc. IEEE 96, 4, 567-588.
21. LEW, M. S., SEBE, N., DJERABA, C., AND JAIN, R. 2006. Content-Based multimedia information retrieval: State of the art and challenges. ACM Trans. Multimedia Comput. Comm. Appl. 2, 1, 1-19. (Pubitemid 43890693)
22. LIU, Y., MEI, T., AND HUA, X.-S. 2009. CrowdReranking: Exploring multiple search engines for visual search reranking. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval. 500-507.
23. MEI, T., HUA, X.-S., LAI, W., YANG, L., ET AL. 2007a. MSRA-USTC-SJTU at TRECVID 2007: High-Level feature extraction and search. In Proceedings of TREC Video Retrieval Evaluation Online.
24. MEI, T., HUA, X.-S., YANG, L., AND LI, S. 2007b. VideoSense: Towards effective online video advertising. In Proceedings of ACM Multimedia. 1075-1084.
25. MEI, T., YANG, B., HUA, X.-S., YANG, L., YANG, S.-Q., AND LI, S. 2007c. VideoReach: An online video recommendation system. In Proceedings of ACM SIGIR Conference on Research and Development in Information Retrieval. 767-768. (Pubitemid 350165060)
26. MOXLEY, E., MEI, T., AND MANJUNATH, B. S. 2010. Video annotation through search and graph reinforcement mining. IEEE Trans. Multimedia 12, 3, 184-193.
27. MSN VIDEO. 2011. MSN video. http://video.msn. com/video.aspx?mkt=en- us&tab=soapbox/.
28. NAPHADE, M., SMITH, J. R., TESIC, J., CHANG, S.-F., HSU, W., KENNEDY, L., HAUPTMANN, A., AND CURTIS, J. 2006. Large-Scale concept ontology for multimedia. IEEE Multimedia Mag. 13, 3, 86-91. (Pubitemid 44263760)
29. RESNICK, P. AND VARIAN, H. R. 1997. Recommender systems. Comm. ACM 40, 3, 56-58. (Pubitemid 127441130)
30. RUI, Y., HUANG, T. S., ORTEGA, M., AND MEHROTRA, S. 1998. Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Trans. Circ. Video Tech. 8, 5, 644-655. (Pubitemid 128743730)
31. SETTEN, M. V. AND VEENSTRA, M. 2003. Prediction strategies in a TV recommender system-Method and experiments. In Proceedings of the International World Wide Web Conference.
32. SHEN, D., PAN, R., SUN, J.-T., PAN, J. J., WU, K., YIN, J., AND YANG, Q. 2006a. Query enrichment for web-query classification. ACM Trans. Inf. Syst. 24, 3, 320-352. (Pubitemid 44547832)
33. SHEN, D., SUN, J.-T., YANG, Q., AND CHEN, Z. 2006b. Building bridges for web query classification. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval. 131-138.
34. SHEN, J., SHEPHERD, J., CUI, B., AND TAN, K.-L. 2009. A novel framework for efficient automated singer identification in large music databases. ACM Trans. Inf. Syst. 27, 3.
35. SHEN, J., TAO, D., AND LI, X. 2008. Modality mixture projections for semantic video event detection. IEEE Trans. Circ. Syst. Video Tech. 18, 11, 1587-1596.
36. SIERSDORFER, S., PEDRO, J. S., AND SANDERSON, M. 2009. Automatic video tagging using content redundancy. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval. 395-402.
37. SNOEK, C. G. M. AND WORRING, M. 2009. Concept-based video retrieval. Found. Trends Inf. Retr. 4, 2, 215-322.
38. SNOEK, C., WORRING, M., VAN GEMERT, J., GEUSEBROEK, J.-M., AND SMEULDERS, A. W. M. 2006. The challenge problem for automated detection of 101 semantic concepts in multimedia. In Proceedings of the ACM International Conference on Multimedia. 421-430. (Pubitemid 47113558)
39. TAO, D., TANG, X., LI, X., AND WU, X. 2006. Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. IEEE Trans. Patt. Anal. Mach. Intell. 28, 7, 1088-1099.
40. TRECVID. 2011. TRECVID. http://www-nlpir.nist.gov/projects/trecvid/.
41. WEI, Y. Z., MOREAU, L., AND JENNINGS, N. R. 2005. Learning users interests by quality classification in market-based recommender systems. IEEE Trans. Knowl. Data Engin. 17, 12, 1678-1688. (Pubitemid 43060417)
42. YAHOO! 2011. Yahoo. http://www.yahoo.com/.
43. YANG, B., MEI, T., HUA, X.-S., YANG, L., YANG, S.-Q., AND LI, M. 2007. Online video recommendation based on multimodal fusion and relevance feedback. In Proceedings of the ACM International Conference on Image and Video Retrieval. 73-80. (Pubitemid 350229604)
44. YANG, Y. AND LIU, X. 1999. A re-examination of text categorization methods. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval.
45. YOUTUBE. 2011. YouTube. http://www.youtube.com/.
46. YU, B., MA, W.-Y., NAHRSTEDT, K., AND ZHANG, H.-J. 2003. Video summarization based on user log enhanced link analysis. In Proceedings of the ACM International Conference on Multimedia. 382-391.
47. ZHOU, D., ZHU, S., YU, K., SONG, X., TSENG, B. L., ZHA, H., AND GILES, C. L. 2008. Learning multiple graphs for document recommendations. In Proceedings of the International World Wide Web Conference. 141-150.