Can high-level concepts fill the semantic gap in video retrieval? A case study with broadcast news

IEEE Transactions on Multimedia

Volumn 9, Issue 5, 2007, Pages 958-966

  Hauptmann, Alexander ^b   Yan, Rong ^a,b   Lin, Wei Hao ^b   Christel, Michael ^a,b   Wactlar, Howard ^b  

^a IEEE   (United States)

^b Carnegie Mellon University   (United States)

Author keywords

Concept based video retrieval; High level semantic concepts; Semantic gap

Indexed keywords

CONCEPT DETECTION; HIGH LEVEL SEMANTIC CONCEPTS; SEMANTIC GAPS;

CONTENT BASED RETRIEVAL; INFORMATION SERVICES; MULTIMEDIA SERVICES; TELEVISION BROADCASTING;

SEMANTICS;

EID: 34547469390     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2007.900150     Document Type: Article

References (31)

1. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval: The end of the early years," IEEE Trans. Pattern Anal Machine Intell., vol. 22, pp. 1349-1380, 2000.
2. M. Lew, Ed., in Proc. Int. Conf. on Image and Video Retrieval, The Brunei Gallery, SOAS, Russell Square, London, U.K., 2002.
3. J. R. Smith, C. Y. Lin, M. R. Naphade, P. Natsev, and B. Tseng, "Advanced methods for multimedia signal processing," in Proc. Int. Workshop for Digital Communications IWDC, Capri, Italy, 2002.
4. M. Markkula and E. Sormunen, "End-user searching challenges indexing practices inthe digital newspaper photo archive," Inf. Retrieval, vol. 1, no. 4, pp. 259-285, 2000.
5. K. Rodden, W. Basalaj, D. Sinclair, and K. Wood, "Does organisation by similarity assist image browsing?," in Proc. CHI'01: Proc. SIGCHI Conf. Human Factors in Computing Systems, New York, 2001, pp. 190-197.
6. S. F. Chang, R. Manmatha, and T. S. Chua, "Combining text and audiovisual features in video indexing," in Proc. IEEE ICASSP 2005.
7. K. Barnard, P. Duygulu, D. Forsyth, N. de Freitas, D. Blei, and M. Jordan, "Matching words and pictures," J. Mach. Learn. Res., vol. 3, 2002.
8. M. R. Naphade and J. R. Smith, "On the detection of semantic concepts at TRECVID," in Proc. 12th ACM Int. Conf. Multimedia, 2004.
9. S.-F. Chang, W. Hsu, L. Kennedy, L. Xie, A. Yanagawa, E. Zavesky, and D.-Q. Zhang, "Columbia university trecvid-2005 video search and high-level feature extraction," in Proc. NIST TRECVID, 2005.
10. J. Jeon, V. Lavrenko, and R. Manmatha, "Automatic image annotation and retrieval using cross-media relevance models," in Proc. 26th Annu. Int. ACM SIGIR Conf. Research and Development in Informaron Retrieval, 2003, pp. 119-126.
11. C. G. M. Snoek, M. Worring, J.-M. Geusebroek, F. J. Seinstra, and A. W. M. Smeulders, "The semantic pathfinder: Using an authoring metaphor for generic multimedia indexing," IEEE Trans. Pattern Anal. Machine Intell., vol. 28, no. 10, pp. 1678-1689, 2006.
12. J. Yuan, L. Xiao, D. Wang, D. Ding, Y. Zuo, Z. Tong, X. Liu, S. Xu, W. Zheng, X. Li, Z. Si, J. Li, F. Lin, and B. Zhang, "Tsinghua University at TRECVID 2005," NIST TRECVID 2005, Nov. 2005.
13. A. Natsev, M. R. Naphade, and J. Tešić, "Learning the semantics of multimedia queries and concepts from a small number of examples," in Proc. 13th ACM Int. Conf. Multimedia, 2005.
14. M. Naphade, J. R. Smith, J. Tesic, S.-F. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and J. Curtis, "Large-scale concept ontology for multimedia," IEEE Multimedia, vol. 13, no. 3, pp. 86-91, 2006.
15. A. F. Smeaton and P. Over, "TRECVID: Benchmarking the effectiveness of information retrieval tasks on digital video," in Proc. Int. Conf. Image and Video Retrieval, 2003.
16. C. G. M. Snoek, M. Worring, J. C. van Gemert, J.-M. Geusebroek, and A. W. M. Smeulders, "The challenge problem, for automated detection of 101 semantic concepts in multimedia," ACM Multimedia, 2006.
17. P. Over, T. Laneva, W. Kraaij, and A. F. Smeaton, "Trecvid200'5 - An overview," in Proc. TRECVID 2005.
18. R. Yan and A. G. Hauptmann, "The combination limit in multimedia retrieval," in Proc. 11th ACM Int. Conf. Multimedia, 2003, pp. 339-342.
19. Overview of TRECVID 2006, , 2006 [Online]. Available: http://www-nlpir.nist.gov/projects/tv2006/tv2006.html, NIST
20. R. Yan, "Probabilistic Models for Combining Diverse Knowledge Sources in Multimedia Retrieval," Ph.D. dissertation, Carnegie Mellon Univ., Pittsburgh, PA, 2006.
21. S. M. Beitzel, E. C. Jensen, O. Frieder, A. Chowdhury, and G. Pass, "Surrogate scoring for improved metasearch precision," in Proc. 28th Annu. Int. ACM SIGIR Conf. Research and Development in Information Retrieval, New York, 2005, pp. 583-584.
22. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, "Face recognition.: A literature survey," ACM Comput. Surv., vol. 35, no. 4, pp. 399-458, Dec. 2003.
23. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
24. G. K. Zipf, Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology. New York: Hafner, 1972.
25. J. R. Render and M. R. Naphade, "Visual concepts for news story tracking: Analyzing and exploiting the NIST TRECVID video annotation experiment," in Proc, Conf. Computer Vision and Pattern Recognition, 2005, pp. 1174-1181.
26. Y. Qiu and H.-P. Frei, "Concept based query expansion," in Proc. 16th Annu. Int. ACM SIGIR Conf., New York, 1993, pp. 160-169.
27. C. Fellbaum, WordNet: An Electronic Lexical Database. Cambridge, MA: MIT Press, 1998.
28. T. Volkmer and A. Natsev, "Exploring automatic query refinement for text-based video retrieval," in Proc. IEEE Int. Conf. Multimedia and Expo (ICME), Jul. 2006, pp. 765-768.
29. S. R. Y. Neo, J. Zhao, M.-Y. Kan, and T.-S. Chua, "Video retrieval using high level features: Exploiting query matching and confidence-based weighting," in Proc. Conf. Image and Video Retrieval (CIVR), 2006.
30. A. Amir, W. Hsu, G. Iyengar, C.-Y. Lin, M. Naphade, A. Natsev, C. Neti, H. J. Nock, J. R. Smith, B. L. Tseng, Y. Wu, and D. Zhang, "IBM research TRECVID-2003 video retrieval system," in Proc. NIST TRECVID-2003, Nov. 2003.
31. R. Yan, J. Yang, and A. G. Hauptmann, "Learning query-class dependent weights in automatic video retrieval," in Proc. 12th Annu. ACM Int. Conf. Multimedia, 2004, pp. 548-555.