TRECVID 2011 - An overview of the goals, tasks, data, evaluation mechanisms, and metrics

2011 TREC Video Retrieval Evaluation Notebook Papers

Volumn , Issue , 2011, Pages

  Over, Paul ^a   Awad, George ^a   Fiscus, Jon ^a   Antonishek, Brian ^a   Michel, Martial ^b   Smeaton, Alan F ^c   Kraaij, Wessel ^d,e   Quénot, Georges ^f  

^a NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

^b Systems Plus Inc   (United States)

^c DUBLIN CITY UNIVERSITY   (Ireland)

^d TNO   (Netherlands)

^e RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^f UNIV GRENOBLE ALPES   (France)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84905223557     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. ACC. (2010). http://www.iso.org/iso/catalogue_detail.htm?csnumber=42739.
2. Ayache, S., & Quenot, G. (2008). Video Corpus Annotation using Active Learning. In European Conference on Information Retrieval (ECIR) (pp. 187-198). Glasgow, Scotland.
3. Doerman, D., & Mihalcik, D. (2000). Tools and Techniques for Video Performance Evaluation. In ICPR (pp. 167-170).
4. Fiscus, J., Rose, R., & Michel, M. (2010). 2010 TRECVid Event Detection evaluation plan. http://www.itl.nist.gov/iad/mig//tests/trecvid/2010/doc/EventDet10-EvalPlan-v01.htm.
5. Gauvain, J., Lamel, L., & Adda, G. (2002). The LIMSI Broadcast News Transcription System. Speech Communication, 37(1-2), 89-108.
6. H.264. (2010). http://www.itu.int/rec/T-REC-H.264-201003-I/en
7. Manly, B. F. J. (1997). Randomization, Bootstrap, and Monte Carlo Methods in Biology (2nd ed.). London, UK: Chapman & Hall.
8. Martin, A., Doddington, G., Kamm, T., Ordowski, M., & Przybocki, M. (1997). The DET Curve in Assessment of Detection Task Performance. In Proceedings of Eurospeech'97 (p. 1899-1903). Rhodes, Greece.
9. MPEG-4. (2010). http://mpeg.chiariglione.org/
10. Over, P., Awad, G., Fiscus, J., Antonishek, B., Michel, M., Smeaton, A. F., Kraaij & Quénot, G. W. (2010). TRECVID 2010 - An Overview of the Goals, Tasks, Data, Evaluation Mechanisms and Metrics. http://www-nlpir.nist.gov/projects/tvpubs/tv10.papers/tv10overview.pdf.
11. Over, P., Awad, G., Fiscus, J., Michel, M., Smeaton, A. F., & Kraaij, W. (2009). TRECVID 2009 - Goals, Tasks, Data, Evaluation Mechanisms and Metrics. http://www-nlpir.nist.gov/projects/tvpubs/tv9.papers/tv9overview.pdf.
12. Over, P., Awad, G., Fiscus, J., Rose, R., Kraaij, W., & Smeaton, A. F. (2008). TRECVID 2008 - Goals, Tasks, Data, Evaluation Mechanisms and Metrics. http://www-nlpir.nist.gov/projects/tvpubs/tv8.papers/tv8overview.pdf.
13. Over, P., Ianeva, T., Kraaij, W., & Smeaton, A. F. (2006). TRECVID 2006 Overview. www-nlpir.nist.gov/projects/tvpubs/tv6.papers/tv6overview.pdf.
14. QUAERO. (2010). QUAERO homepage. www.quaero.org/modules/movie/scenes/home/
15. Rose, T., Fiscus, J., Over, P., Garofolo, J., & Michel, M. (2009). The TRECVid 2008 Event Detection Evaluation. In IEEE Workshop on Applications of Computer Vision (WACV). IEEE.
16. UKHO-CPNI. (2007 (accessed June 30, 2009)). Imagery library for intelligent detection systems. http://scienceandresearch.homeoffice.gov.uk/hosdb/cctv-imaging-technology/video-based-detection-systems/i-lids/
17. Yilmaz, E., & Aslam, J. A. (2006). Estimating Average Precision with Incomplete and Imperfect Judgments. In Proceedings of the Fifteenth ACM International Conference on Information and Knowledge Management (CIKM). Arlington, VA, USA.
18. Yilmaz, E., Kanoulas, E., & Aslam, J. A. (2008). A simple and efficient sampling method for estimating AP and NDCG. In SIGIR'08: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 603-610). New York, NY, USA: ACM.