Benchmarking image and video retrieval: An overview

Proceedings of the ACM International Multimedia Conference and Exhibition

Volumn , Issue , 2006, Pages 297-300

  Marchand Maillet, Stéphane ^a   Worring, Marcel ^b  

^a UNIVERSITY OF GENEVA   (Switzerland)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Evaluation; Image; Information retrieval; Multimedia; Video

Indexed keywords

BENCHMARKING; CONTEXT SENSITIVE LANGUAGES; IMAGE ANALYSIS; MULTIMEDIA SERVICES; VIDEO STREAMING;

MULTIMEDIA INFORMATION RETRIEVAL; VIDEO RETRIEVAL;

INFORMATION RETRIEVAL;

EID: 34547476024     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1178677.1178718     Document Type: Conference Paper

References (17)

1. Ricardo Baeza-Yates and Berthier Ribeiro-Neto, editors. Modern Information Retrieval. Addison Wesley Longman Publishing Co. Inc., 1999.
2. P. Borlund. The IIR evaluation model: a framework for evaluation of interactive information retrieval systems. Information Research, 8(3), 2003.
3. C. Buckley and E.M. Voorhees. Retrieval evaluation with incomplete information. In Proceedings of SIGIR 2004, New York, NY, USA, 2004.
4. C. W. Cleverdon. The Cranfield tests ion index language devices. ASLib proceedings, 19(6):173-192, 1967.
5. C. Fluhr, P-A Moëllic, and P. Hede. Usage-oriented multimedia information retrieval technological evaluation. In Proceeding of the ACM Workshop on Multimedia Information Retrieval (MIR2006), special session on "Benchmarking Image and Video Retrieval Systems", Santa Barbara, CA, 2006.
6. Cormack G. V. and Lynam T.R. Statistical precision of information retrieval evaluation. In SIGIR. 2006, Seattle, USA, 2006.
7. The International Music Information Retrieval Systems Evaluation Laboratory (IMIRSEL) Project. http://www.music-ir.org/evaluation.
8. G. Marchionini. Human performance measures for video retrieval. In Proceeding of the ACM Workshop on Multimedia Information Retrieval (MIR2006), special session on "Benchmarking Image and Video Retrieval Systems", Santa, Barbara, CA, 2006.
9. ImageCLEF: the image retrieval track within CLEF. http://ir.shef.ac.uk/ imageclef/.
10. MIREX: Music Information Retrieval Evaluation eXchange. http://www.music-ir.org/mirex2006.
11. Henning Müller, Stéphane Marchand-Maillet, and Thierry Pun. The truth about Corel - Evaluation in image retrieval. In Proceedings of CIVR2002, London, UK, July 2002.
12. Henning Müller, Wolfgang Müller, David McG. Squire, Stéphane Marchand-Maillet, and Thierry Pun. Performance evaluation in content-based image retrieval: Overview and proposals. Pattern Recognition Letters (Special Issue on Image and Video Indexing), 22(5):593-601, 2001. H. Bunke and X. Jiang Eds. "
13. G.P. Nguyen and M.Worring. Scenario optimization for interactive category search. In Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval, Singapore, 2005.
14. A. F. Smeaton, P. Over, and W. Kraaij. Evaluation campaigns and TRECVid. In Proceeding of the ACM Workshop on Multimedia Information Retrieval (MIR2006), special session on "Benchmarking Image and Video Retrieval Systems", Santa Barbara, CA, 2006.
15. Ellen M. Voorhees and Donna K. Harman, editors. TREC: Experiment and Evaluation in Information Retrieval. Digital Libraries and Electronic Publishing. MIT Press, 2005.
16. T. Westerveld and R. W. Zwol. Benchmarking multimedia search in structured collections. In Proceeding of the ACM Workshop on Multimedia Information Retrieval (MIR2006), special session on "Benchmarking Image and Video Retrieval Systems", Santa Barbara, CA, 2006.
17. Ryen W. White, Joemon M. Jose, and Ian Ruthven. Adapting to evolving needs: Evaluating a behaviour-based search interface. In 17th Annual Human-Computer Interaction Conference (HCI 2003), New Orleans, U.S.A, 2003.