Mutual relevance feedback for multimodal query formulation in video retrieval

MIR 2005 - Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval, Co-located with ACM Multimedia 2005

Volumn , Issue , 2005, Pages 17-24

  Amir, Arnon ^a   Berg, Marco ^b   Permuter, Haim ^c  

^a IBM ALMADEN RESEARCH CENTER   (United States)

^b IBM   (Germany)

^c STANFORD UNIVERSITY   (United States)

Author keywords

Multimedia; Multimodal search; NIST TRECVID; Query formulation; Query refinement; Relevance feedback; Video retrieval

Indexed keywords

CONTENT BASED RETRIEVAL; INDEXING (OF INFORMATION); SEMANTICS;

MULTIMEDIA; MULTIMODAL SEARCH; QUERY FORMULATION; QUERY REFINEMENT; RELEVANCE FEEDBACK; TRECVID; VIDEO RETRIEVAL;

SEARCH ENGINES;

EID: 35348928807     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1101826.1101832     Document Type: Conference Paper

References (28)

1. A. Amir, S. Srinivasan and A. Efrat, "Search The Speech, Browse The Video - A Generic Paradigm for Video Collections", in EURASIP J on Applied Signal Processing, Special Issue on Unstructured Information Management from Multimedia Data Sources, EURASIP JASP 2003:2 (2003) pp. 209-222.
2. A. Amir, J. Argillander, M. Berg, S-F. Chang, M. Franz, W. Hsu, G. Iyengar, J. R Kender, L. Kennedy, C-Y. Lin, M. Naphade, A. Natsev, J. R. Smith, J. Tesic, G. Wu, R. Yan, D. Zhang, "IBM Research TRECVID-2004 Video Retrieval System", Proc. Of TRECVID 2004, NIST, Gaithersburg, MD, Nov. 2004.
3. M. J. Bates, "Where should the person stop and the information search interface start?" Information Processing and Management, 26(5):575-591, 1990.
4. T-S. Chua, S-Y. Neo, K-Y. Li, G. Wang, R. Shi, M. Zhao and H. Xu, "TRECVID 2004 Search and Feature Extraction Task by NUS PRIS", Proc. Of TRECVID 2004, NIST, Gaithersburg, MD, Nov. 2004.
5. W.B. Croft, "Experiments with Representation in a Document Retrieval System," Information Technology: Research and Development, Vol. 2, pp. 1-21, 1982.
6. M. Ferecatu, M. Crucianu and N. Boujemaa, "Relevance feedback for image retrieval: a short survey," in State of the Art in Audiovisual Content-Based Retrieval, Information Universal Access and Interaction, Including Datamodels and Languages, Report of the DELOS2 European Network of Excellence (FP6), 2004.
7. J.L. Gauvain, L. Lamel, and G. Adda, "The LIMSI Broadcast News Transcription System," Speech Communication, 37(1-2):89-108, 2002.
8. th ACM SIGMM Int. workshop on Multimedia Information Retrieval, October 15-16, 2004, New York, NY, USA
9. D. Harman, "Relevance Feedback and other query modification techniques," In W. B. Frakes and R. Baeza-Yates, editors, Information Retrieval: Data structures & algorithms. Prentice Hall, 1992.
10. A. Hauptmann, M.-Y. Chen, M. Christel, C. Huang, W.-H. Lin, T. Ng, N. Papernick, A. Velivelli, J. Yang, R. Yan, H. Yang, and H.D. Wactlar, "Confounded Expectations: Informedia at TRECVID 2004," Proc. Of TRECVID 2004, NIST, Gaithersburg, MD, Nov. 2004.
11. M. A. Hearst, "User Interfaces and visualization," in R. Baeza-Yates and B. Ribeiro-Neto, Modern Information Retrieval, Addison Wesley, New York, May 1999
12. th Int. Conf. on Very Large Data Bases, pp. 218-227, 1998.
13. T. Joachims, Learning to Classify Text using Support Vector Machines, Kluwer, 2002
14. Gerald Kowalski, Mark T. Maybury, Information Retrieval Systems- Theory and Implementation, Kluwer AP, 2000
15. J. Koeneman and N.J. Belkin, "A case for interaction: A study of interactive information retrieval behavior and effectiveness," Proc. Of ACM SIGCHI Conference on Human Factors in Computing Systems 1996, pp.205-212.
16. W. Kraaij, A. F. Smeaton and P. Over, "TRECVID 2004 - An Introduction," Proc. Of TRECVID 2004, NIST, Gaithersburg, MD, Nov. 2004. http://www-nlpir.nist.gov/projects/trecvid/
17. C.-Y. Lin, B. L. Tseng and J. R. Smith, "Video Collaborative Annotation Forum: Establishing Ground-Truth Labels on Large Multimedia Datasets," Proc. of TRECVID-2003, NIST, Gaithersburg, MD, Nov. 2003.
18. H. Permuter, A. Amir and S. Srinivasan, A Multimodal Soft Boolean Search in Speech and Video Databases, submitted.
19. S. E. Robertson and K. Sparck-Jones, "Relevance weighting of search terms," Journal of the American Society for Information Science, 1976, 27 (3), 129-146
20. S. E. Robertson, "On term selection for query expansion," Journal of Documentation, 46 (4), 1990, pp. 359-364.
21. J. J. Rocchio, "Relevance Feedback in Information Retrieval", in G. Salton, editor. The SMART retrieval system: experiments in automatic document processing., Prentice Hall, Inc., 1971, pp. 313-323.
22. I. Ruthven and M. Lalmas, "A survey on the use of relevance feedback in information access systems", Knowledge Engineering Review. Vol 18. Issue 2, 2003, pp. 95-145.
23. G. Salton and C. Buckley, "Improving retrieval performance by Relevance Feedback," J. of the American Society for Information Science, 1990.
24. L. Taycher, M. La Cascia and S. Sclaroff, "Image digestion and relevance feedback in the ImageRover WWW search engine", Int. Conf. on Visual Information, pp 85-92, 1997.
25. R. W. White, I. Ruthven, J.M. Jose and C. J. Van Rijsbergen, "Evaluating Implicit Feedback Models Using Searcher Simulations", ACM T. Information Systems, to appear.
26. Zhao Xu, Xiaowei Xu, KaiYu, and Volker Tresp, "A Hybrid Relevance-Feedback Approach to Text Retrieval," in F. Sebastiani (Ed.): ECIR-03, LNCS 2633, pp. 281-293, 2003.
27. R. Yan, A. Hauptmann, and R. Jin, "Negative Pseudo-Relevance Feedback in Content-based Video Retrieval", ACM-MM 03, Berkeley, CA, USA, 2003
28. X. S. Zhou and T. S. Huang, "Relevance feedback for image retrieval: a comprehensive review," Multimedia Systems, 8(6):536-544, 2003.