Effective annotation and search for video blogs with integration of context and content analysis

IEEE Transactions on Multimedia

Volumn 11, Issue 2, 2009, Pages 272-285

  Zhang, Xiaoyu ^a,b   Xu, Changsheng ^a,b   Cheng, Jian ^a,b   Lu, Hanqing ^a,b   Ma, Songde ^a  

^a INSTITUTE OF AUTOMATION   (China)

^b China Singapore Institute of Digital Media   (Singapore)

Author keywords

Annotation expansion; Ranking; Saliency based matching; Vlog annotation; Vlog search

Indexed keywords

INFORMATION THEORY; SEMANTICS;

ANNOTATION EXPANSION; RANKING; SALIENCY-BASED MATCHING; VLOG ANNOTATION; VLOG SEARCH;

INTERNET;

EID: 59049099439     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2008.2009689     Document Type: Article

References (36)

1. J. C. Dvorak, The Blog Phenomena 2002 [Online]. Available: http://www.pcmag.com/article2/0,1895,81500,00.asp, Online Essay in PC Mag.
2. A. Rosenbloom, "The blogosphere: Introduction," Commun. ACM, pp. 31-33, 2004.
3. B. A. Nardi, D. J. Schiano, M. Gumbrecht, and L. Swartz, "The blogosphere: Why we blog," Commun. ACM, pp. 41-46, 2004.
4. B. A. Nardi, D. J. Schiano, and M. Gumbrecht, "Communities: Blogging as social activity, or, would you let 900 million people read your diary?," in Proc. 2004 ACM Conf. Computer Supported Cooperative Work, Chicago, IL, 2004, pp. 222-231.
5. J. Hoem, "Videoblogs as 'collective documentary'," in BlogTalks 2.0: The European Conf. on Weblogs, 2004, pp. 237-270.
6. C. Parker and S. Pfeiffer, "Video blogging: Content to the max," in Proc. IEEE Multimedia, Los Alamitos, CA, 2005, pp. 4-8.
7. A. King, "Vlogging: Video Weblogs," WebReference, 2003 [Online]. Available: http://www.webreference.com/new/030306.html
8. D. Stolarz and L. Felix, "Creating your own media empire with podcasts & video-blogs," Streaming Media West, 2005 [Online]. Available: http://www.streamingmedia.com/west2005/Damien-Stolarz-Workshop.ppt
9. G. J. Qi, X. S. Hua, Y. Rui, J. Tang, T. Mei, and H. J. Zhang, "Correlative multi-label video annotation," in Proc. 15th Int. Conf. Multimedia, Augsburg, Germany, 2007, pp. 17-26.
10. X. J. Wang, L. Zhang, F. Jing, and W. Y. Ma, "AnnoSearch: Image auto-annotation by search," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, Washington, DC, 2006, pp. 1483-1490.
11. C. Wang, F. Jing, L. Zhang, and H. J. Zhang, "Scalable search-based image annotation of personal images," in Proc. 8th ACM Int. Workshop on Multimedia Information Retrieval, Santa Barbara, CA, 2006, pp. 269-278, ACM.
12. X. Rui, M. Li, Z. Li, W. Y. Ma, and N. Yu, "Bipartite graph reinforcement model for web image annotation," in Proc. 15th Int. Conf. Multimedia, Augsburg, Germany, 2007, pp. 585-594.
13. J. Liu, B. Wang, M. Li, Z. Li, W. Y. Ma, H. Lu, and S. Ma, "Dual cross-media relevance model for image annotation," in Proc. 15th Int. Conf. Multimedia, Augsburg, Germany, 2007, pp. 605-614.
14. X. Zhang, C. Xu, J. Cheng, H. Lu, and S. Ma, "Automatic semantic annotation for video blogs," in Proc. 2008 IEEE Int. Conf. Multimedia & Expo, Hannover, Germany. 2008.
15. P. D. Tumey, "Thumbs up or thumbs down? semantic orientation applied to unsupervised classification of reviews," in Proc. 40th Annu. Meeting on Associationfor Computational Linguistics (ACL), Philadelphia, PA, 2001, pp. 417-124.
16. S. F. Chang, R. Manmatha, and T. S. Chua, "Combining text and audio-visual features in video indexing," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Philadelphia, PA, 2005, pp. 1005-1008.
17. E. M. Voorhees, "Query expansion using lexical-semantic relations," in Proc. 17th Annu. Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Dublin, Ireland, 1994, pp. 61-69.
18. G. A. Miller, "WordNet: A lexical database for english," Commun. ACM, pp. 39-41, 1995.
19. A. Natsev, A. Haubold, J. Tesic, L. Xie, and R. Yan, "Semantic concept-based query expansion and re-ranking for multimedia retrieval," in Proc. 15th Int. Conf. Multimedia, Augsburg, Germany, 2007, pp. 991-1000.
20. H. Schutze and J. O. Pedersen, "A cooccurrence-based thesaurus and two applications to information retrieval," in Info. Process. and Manag.: An Int. J., 1997, pp. 307-318.
21. Y. Jing and W. B. Croft, "An association thesaurus for information retrieval," in Proc. RIAO-94, 4th Int. Conf., 1994, pp. 146-160.
22. R. Cilibrasi and P. Vitanyi, "Automatic extraction of meaning from the web," in Proc. IEEE Int. Symp. Information Theory, Seoul, Korea, 2006, pp. 2309-2313.
23. K. W. Church and P. Hanks, "Word association norms, mutual information, and lexicography," in Proc. 27th Annu. Conf. Association for Computational Linguistics (ACL), BC, Canada, 1989, pp. 76-83.
24. T. Hofmann, "Unsupervised learning by probabilistic latent semantic analysis," Mach. Learn., vol. 42, pp. 177-196, 2001.
25. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, 2003.
26. J. Bai, J. Y. Nie, and G. Cao, "Context-dependent term relations for information retrieval," in Proc. 2006 Conf. Empirical Methods in Natural Language Processing, Sydney, Australia, 2006, pp. 551-559.
27. J. Bai, J. Y. Nie, G. Cao, and H. Bouchard, "Using query contexts in information retrieval," in Proc. 50th Annu. Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Amsterdam, The Netherlands, 2007, pp. 15-22.
28. J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid, "Local features and kernels for classification of texture and object categories: A comprehensive study," in Proc. IEEE Conf. Computer Vision and Pattern Recognition Workshop, New York, 2006, pp. 13-20.
29. J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust wide baseline stereo from maximally stable extremal regions," in Proc. 13th British Machine Vision Conf., Cardiff, Wales, 2002, pp. 384-393.
30. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, pp. 91-110, 2004.
31. K. Grauman and T. Darrell, "The pyramid match kernel: Discriminative classification with sets of image features," in Proc. 10th IEEE Int. Conf. Computer Vision, Beijing, China, 2005, pp. 1458-1465.
32. B. Santorini, Part-of-Speech Tagging Guidelines for the Penn Treebank Project (3rd Revision, 2nd Printing) Dept. Comput. Inform. Sci., Univ. Pennsylvania, Philadelphia, Tech. Rep., 1995.
33. R. L. Goldstone, "Similarity, interactive activation, and mapping," J. Experim. Psych.: Learn., Mem., Cogn., pp. 3-28, 1994.
34. Y. Meng, E. Chang, and B. Li, "Enhancing DPF for near-replica image recognition," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, Madison, WI, 2003, pp. 416-423.
35. K. Barnard, P. Duygulu, D. Forsyth, N. Freitas, D. M. Blei, and M. I. Jordan, "Matching words and pictures," J. Mach. Learn. Res., pp. 1107-1135, 2003.
36. X. Y. Wei and C. W. Ngo, "Ontology-enriched semantic space for video search," in Proc. 15th Int. Conf. Multimedia, Augsburg, Germany, 2007, pp. 981-990.