Content-based analysis improves audiovisual archive retrieval

IEEE Transactions on Multimedia

Volumn 14, Issue 4 PART 2, 2012, Pages 1166-1178

  Huurnink, Bouke ^a   Snoek, Cees G M ^a   De Rijke, Maarten ^a   Smeulders, Arnold W M ^b  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b CWI   (Netherlands)

Author keywords

Benchmark testing; content based retrieval; multimedia databases; search problems

Indexed keywords

BENCHMARK TESTING; BROADCAST TELEVISION; CONCEPT-BASED RETRIEVAL; CONTENT-BASED ANALYSIS; CONTENT-BASED METHODS; CONTENT-BASED VIDEO RETRIEVAL; EVALUATION METHODOLOGIES; INFORMATION NEED; MULTIMEDIA CONTENT ANALYSIS; MULTIMEDIA DATABASE; PERFORMANCE GAIN; RELEVANCE JUDGMENT; RETRIEVAL EVALUATION; RETRIEVAL PERFORMANCE; SEARCH PROBLEM; SHOT RETRIEVAL; TELEVISION PROGRAMS; VIDEO RETRIEVAL; VIDEO SEARCH ENGINES;

CONTENT BASED RETRIEVAL; TELEVISION BROADCASTING;

IMAGE RETRIEVAL;

EID: 84864131677     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2012.2193561     Document Type: Article

References (60)

1. A. Allauzen and J.-L. Gauvain, "Open vocabulary asr for audiovisual document indexation," in Proc. ICASSP, 2005, pp. 1013-1016.
2. M. G. Brown, J. T. Foote, G. J. F. Jones, K. Sparck-Jones, and S. J. Young, "Automatic content-based retrieval of broadcast news," in Proc. ACM Multimedia, San Francisco, CA, 1995.
3. J. Carmichael, M. Larson, J. Marlow, E. Newman, P. Clough, J. Oomen, and S. Sav, "Multimodal indexing of electronic audio-visual documents: A case study for cultural heritage data," in Proc. CBMI, 2008, pp. 93-100.
4. S. Carter, C. Monz, and S. Yahyaei, "The QMUL system description for IWSLT 2008," in Proc. IWSLT, 2008, pp. 104-107.
5. L. Chaisorn, K.-W. Wan, Y.-T. Zheng, Y. Zhu, T.-S. Kok, H.-L. Tan, Z. Fu, and S. Bolling, "TRECVID 2010 known-item search (KIS) task by I2R," in Proc. TRECVID, 2010.
6. X. Chen, J.Yuan, L. Nie,Z.-J.Zha,S.Yan, andT.-S.Chua, "TRECVID 2010 known-item search by NUS," in Proc. TRECVID, 2010.
7. F.M.G. de Jong, T.Westerveld, and A. P. deVries, "Multimedia search without visual analysis: The value of linguistic and contextual information," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 3, pp. 365-371, Mar. 2007.
8. O. de Rooij, C. G. M. Snoek, andM.Worring, "Balancing thread based navigation for targeted video search," in Proc. CIVR, NewYork, 2008, pp. 485-494, ACM.
9. J. Despres, P. Fousek, J.-L. Gauvain, S. Gay, Y. Josse, L. Lamel, and A. Messaoudi, "Modeling northern and southern varieties of Dutch for STT," in Proc. Interspeech, Brighton, U.K., 2009.
10. J. Foote, "An overview of audio information retrieval," Multimedia Syst., vol. 7, no. 1, pp. 2-10, 1999.
11. J. Garofolo, C. Auzanne, and E. Voorhees, "The TREC spoken document retrieval track: A success story," in Proc. 9th Text Retrieval Conf. (TREC), 2000, pp. 107-130.
12. C. Hauff, V. Murdock, and R. Baeza-Yates, "Improved query difficulty prediction for the web," in Proc. CIKM, 2008, pp. 439-448, ACM.
13. A. G. Hauptmann and W.-H. Lin, "Assessing effectiveness in video retrieval," in Proc. CIVR, 2005, pp. 215-225, Springer-Verlag.
14. A. G. Hauptmann, R. Yan, and W.-H. Lin, "How many high-level conceptswill fill the semantic gap in news video retrieval?," in Proc. CIVR, New York, 2007, pp. 627-634, ACM.
15. J. He, M. Larson, and M. de Rijke, "Using coherence-based measures to predict query difficulty," in Proc. ECIR, 2008, pp. 689-694.
16. K. Hofmann, B. Huurnink, M. Bron, and M. de Rijke, "Comparing click-Through data to purchase decisions for retrieval evaluation," in Proc. SIGIR, 2010, pp. 761-762.
17. M. Huijbregts, R. Ordelman, and F. de Jong, "Annotation of heterogeneous multimedia content using automatic speech recognition," in Proc. SAMT, Berlin, Germany, 2007, LNCS, Springer Verlag.
18. B. Huurnink andM. de Rijke, "Exploiting redundancy in cross-channel video retrieval," in Proc. MIR, 2007, pp. 177-186, ACM.
19. B.Huurnink,K.Hofmann,M. de Rijke, andM. Bron, "Validating query simulators: An experiment using commercial searches and purchases," in Proc. CLEF, Padova, Italy, 2010, Springer.
20. B. Huurnink, L. Hollink, W. van den Heuvel, and M. de Rijke, "The search behavior of media professionals at an audiovisual archive: A transaction log analysis," JASIST, vol. 61, no. 6, 2010.
21. B. Huurnink, C. G. M. Snoek, M. de Rijke, and A. W. M. Smeulders, "Today's and tomorrow's retrieval practice in the audiovisual archive," in Proc. CIVR, 2010, ACM.
22. Y.-G. Jiang, J. Yang, C.-W. Ngo, and A. G. Hauptmann, "Representations of keypoint-based semantic concept detection: A comprehensive study," IEEE Trans. Multimedia, vol. 12, pp. 42-53, 2010.
23. T. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay, "Accurately interpreting clickthrough data as implicit feedback," in Proc. SIGIR, New York, 2005, pp. 154-161, ACM.
24. L. Kennedy, S. Chang, and A. Natsev, "Query-Adaptive fusion for multimodal search," Proc. IEEE, vol. 96, no. 4, pp. 567-588, Apr. 2008.
25. M. Larson, E. Newman, and G. Jones, "Overview of VideoCLEF 2009: New perspectives on speech-based multimedia content enrichment," in Proc. CLEF, 2009, pp. 354-368.
26. M. Larson, M. Soleymani, P. Serdyukov, V. Murdock, and G. Jones, Eds., in Working Notes of the MediaEval 2010 Workshop, 2010.
27. M. Lux, K. Schoeffmann, M. del Fabro, M. Kogler, and M. Taschwer, "ITEC-UNIKLU known-item search submission," in Proc. TRECVID, 2010.
28. T.Mei, Z.-J. Zha, Y. Liu, M. W. G.-J. Qi, X. Tian, J.Wang, L. Yang, and X.-S. Hua, "MSRA at TRECVID 2008: High-level feature extraction and automatic search," in Proc. TRECVID, Gaithersburg,MD, 2008.
29. C. Monz and M. de Rijke, "Shallow morphological analysis in monolingual information retrieval for Dutch, German, and Italian," in Proc. CLEF, London, U.K., 2002, pp. 262-277, Springer-Verlag.
30. A. P. Natsev, M. R. Naphade, and J. Tešic, "Learning the semantics of multimedia queries and concepts from a small number of examples," in Proc. ACM Multimedia, 2005, pp. 598-607.
31. S.-Y. Neo, J. Zhao,M.-Y. Kan, and T.-S. Chua, "Video retrieval using high level features: Exploiting query matching and confidence-based weighting," in Proc. CIVR, Heidelberg, Germany, 2006, pp. 143-152, Springer-Verlag.
32. J. Oomen and R. Ordelman, "Accessing audiovisual heritage: A roadmap for collaborative innovation," IEEE Multimedia, vol. 18, no. 4, pp. 4-10, 2011.
33. C. Petersohn, "Fraunhofer HHI at TRECVID 2004: Shot boundary detection system," in Proc. TRECVID, Gaithersburg, MD, 2004.
34. J. M. Ponte and W. B. Croft, "A language modeling approach to information retrieval," in Proc. SIGIR, New York, 1998, pp. 275-281, ACM.
35. F. Radlinski, M. Kurup, and T. Joachims, "How does clickthrough data reflect retrieval quality?," in Proc. CIKM, 2008, pp. 43-52.
36. G. Salton, J. Allan, and C. Buckley, "Approaches to passage retrieval in full text information systems," in Proc. SIGIR, New York, 1993, pp. 49-58, ACM.
37. M. Sjöberg, M. Koskela, M. Chechev, and J. Laaksonen, "PicSOM experiments in TRECVID 2010," in Proc. TRECVID, 2010.
38. A. F. Smeaton, P. Over, and W. Kraaij, "Evaluation campaigns and TRECVID," in Proc. MIR, New York, 2006, pp. 321-330, ACM.
39. J. R. Smith and S.-F. Chang, "Visually searching the web for content," IEEE MultiMedia, vol. 4, no. 3, pp. 12-20, 1997.
40. C. G. M. Snoek and A. W. M. Smeulders, "Visual-concept search solved?," IEEE Comput., vol. 43, no. 6, pp. 76-78, 2010.
41. C. G. M. Snoek and M. Worring, "Concept-based video retrieval," Found. Trends Inf. Retriev., vol. 4, no. 2, pp. 215-322, 2009.
42. C. G. M. Snoek, M. Worring, O. de Rooij, K. E. A. van de Sande, R. Yan, and A. G. Hauptmann, "VideOlympics: Real-Time evaluation of multimedia retrieval systems," IEEE MultiMedia, vol. 15, no. 1, pp. 86-91, 2008.
43. C. G. M. Snoek et al., "TheMediaMill TRECVID 2008 semantic video search engine," in Proc. TRECVID, Gaithersburg, MD, 2008.
44. H. Tan and C. Ngo, "Fusing heterogeneous modalities for video and image re-ranking," in Proc. ICMR, 2011, p. 15, ACM.
45. O. Terris, "There was this film about : The case for the shotlist," J. Film Preserv., vol. 56, pp. 54-57, 1998.
46. X. Tian, L. Yang, J. Wang, X. Wu, and X.-S. Hua, "Bayesian visual reranking," IEEE Trans.Multimedia, vol. 13, no. 4, pp. 639-652, 2011.
47. T. Tsikrika, C. Diou, A. de Vries, and A. Delopoulos, "Reliability and effectiveness of clickthrough data for automatic image annotation," Multimedia Tools Appl., vol. 55, pp. 1-26, 2011.
48. K. E. A. van de Sande, T. Gevers, and C. G. M. Snoek, "Evaluating color descriptors for object and scene recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, pp. 1582-1596, 2010.
49. J. C. vanGemert, C. J.Veenman, A.W. M. Smeulders, and J.M. Geusebroek, "Visual word ambiguity," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 7, pp. 1271-1283, Jul. 2010.
50. E. M. Voorhees, "The philosophy of information retrieval evaluation," in Proc. CLEF, London, U.K., 2002, pp. 355-370, Springer-Verlag.
51. H. D. Wactlar, M. G. Christel, Y. Gong, and A. G. Hauptmann, "Lessons learned from building a terabyte digital video library," IEEE Comput., vol. 32, no. 2, pp. 66-73, 1999.
52. X.-Y.Wei, C.-W. Ngo, andY.-G. Jiang, "Selection of concept detectors for video search by ontology-enriched semantic spaces," IEEE Trans. Multimedia, vol. 10, no. 6, pp. 1085-1096, 2008.
53. T. Westerveld, "Using generative probabilistic models for multimedia retrieval," Ph.D. dissertation, Univ. Twente, Enschede , The Netherlands, 2004.
54. P. Wilkins, "An investigation into weighted data fusion for contentbased multimedia information retrieval," Ph.D. dissertation, Dublin City Univ., Dublin, Ireland, 2009.
55. R. Wilkinson, "Effective retrieval of structured documents," in Proc. SIGIR, New York, 1994, pp. 311-317, Springer-Verlag.
56. R. Wright, "Broadcast archives: Preserving the future," in Proc. ICHIM, 2001, pp. 47-55.
57. R. Yan and A. Hauptmann, "A review of text and image retrieval approaches for broadcast news video," Inf. Retriev., vol. 10, no. 4, pp. 445-484, 2007.
58. J. Yang and A. G. Hauptmann, "Exploring temporal consistency for video analysis and retrieval," in Proc. MIR, New York, 2006, pp. 33-42, ACM.
59. J. Yang, M. Chen, and A. G. Hauptmann, "Finding person X: Correlating names with visual appearances," in Proc. CIVR,NewYork, 2004, pp. 270-278, ACM.
60. C. Zhai and J. Lafferty, "A study of smoothing methods for language models applied to information retrieval," ACM Trans. Inf. Syst., vol. 22, no. 2, pp. 179-214, 2004.