TRECVID 2016: Evaluating video search, video event detection, localization, and hyperlinking

2016 TREC Video Retrieval Evaluation, TRECVID 2016

Volumn , Issue , 2016, Pages

  Awad, George ^a   Fiscus, Jonathan ^a   Joy, David ^a   Michel, Martial ^a   Smeaton, Alan F ^b   Kraaij, Wessel ^c   Quénot, Georges ^d   Eskevich, Maria ^e   Aly, Robin ^f   Ordelman, Roeland ^f   Ritter, Marc ^g   Jones, Gareth J F ^b   Huet, Benoit ^h   Larson, Martha ^e  

^a NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

^b DUBLIN CITY UNIVERSITY   (Ireland)

^c LEIDEN UNIVERSITY   (Netherlands)

^d UNIV GRENOBLE ALPES   (France)

^e RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^f UNIVERSITY OF TWENTE   (Netherlands)

^g CHEMNITZ UNIVERSITY OF TECHNOLOGY   (Germany)

^h EURECOM   (France)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85085785779     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Awad, G., Snoek, C. G., Smeaton, A. F., and Quénot, G. (2016). Trecvid Semantic Indexing of Video: A 6-year retrospective. ITE Transactions on Media Technology and Applications, 4(3):187–208.
2. Banerjee, S. and Lavie, A. (2005). Meteor: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization, volume 29, pages 65–72.
3. Bernd, J., Borth, D., Elizalde, B., Friedland, G., Gallagher, H., Gottlieb, L. R., Janin, A., Karabashlieva, S., Takahashi, J., and Won, J. (2015). The YLI-MED Corpus: Characteristics, Procedures, and Plans. CoRR, abs/1503.04250.
4. Eskevich, M., Larson, M., Aly, R., Sabetghadam, S., Jones, G. J. F., Ordelman, R., and Huet, B. (2017). Multimodal Video-to-Video Linking: Turning to the Crowd for Insight and Evaluation. In 23rd International Conference on Multimedia Modeling(MMM), Reykjavik, Iceland.
5. Han, L., Kashyap, A., Finin, T., Mayfield, J., and Weese, J. (2013). UMBC EBIQUITY-CORE: Semantic Textual Similarity Systems. In Proceedings of the Second Joint Conference on Lexical and Computational Semantics, volume 1, pages 44–52.
6. Kelm, P., Schmiedeke, S., and Sikora, T. (2009). Feature-based Video Key Frame Extraction for Low Quality Video Sequences. In 10th Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 2009, London, United Kingdom, May 6-8, 2009, pages 25–28.
7. Krizhevsky, A., Sutskever, I., and Hinton, G. E. (2012). Imagenet Classification with Deep Convolutional Neural Networks. In Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neural Information Processing Systems 2012. Proceedings of a meeting held December 3-6, 2012, Lake Tahoe, Nevada, United States., pages 1106–1114.
8. Lamel, L. (2012). Multilingual Speech Processing Activities in Quaero: Application to Multimedia Search in Unstructured Data. In Tavast, A., Muischnek, K., and Koit, M., editors, Human Language Technologies - The Baltic Perspective - Proceedings of the Fifth International Conference Baltic HLT 2012, Tartu, Estonia, 4-5 October 2012, volume 247 of Frontiers in Artificial Intelligence and Applications, pages 1–8. IOS Press.
9. Manly, B. F. J. (1997). Randomization, Bootstrap, and Monte Carlo Methods in Biology. Chapman & Hall, London, UK, 2nd edition.
10. Over, P., Fiscus, J., Joy, D., Michel, M., Awad, G., Kraaij, W., Smeaton, A. F., Quénot, G., and Ordelman, R. (2015). TRECVID 2015 – An Overview of the Goals, Tasks, Data, Evaluation Mechanisms and Metrics. In Proceedings of TRECVID 2015. NIST, USA.
11. Over, P., Ianeva, T., Kraaij, W., and Smeaton, A. F. (2006). TRECVID 2006 Overview. www-nlpir.nist.gov/projects/ tvpubs/tv6.papers/tv6overview.pdf.
12. Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J. (2002). BLEU: A Method for Automatic Evaluation of Machine Translation. In Proceedings of the 40th annual meeting on association for computational linguistics, pages 311–318. Association for Computational Linguistics.
13. Racca, D. N. and Jones, G. J. F. (2015). Evaluating Search and Hyperlinking: An Example of the Design, Test, Refine Cycle for Metric Development. In Proceedings of the MediaEval 2015 Workshop, Wurzen, Germany.
14. Rose, T., Fiscus, J., Over, P., Garofolo, J., and Michel, M. (2009). The TRECVid 2008 Event Detection Evaluation. In IEEE Workshop on Applications of Computer Vision (WACV). IEEE.
15. Schmiedeke, S., Xu, P., Ferrané, I., Eskevich, M., Kofler, C., Larson, M. A., Estève, Y., Lamel, L., Jones, G. J. F., and Sikora, T. (2013). Blip10000: A Social video Dataset containing SPUG content for Tagging and Retrieval. In Multimedia Systems Conference 2013 (MMSys’13), pages 96–101, Oslo, Norway.
16. Strassel, S., Morris, A., Fiscus, J., Caruso, C., Lee, H., Over, P., Fiumara, J., Shaw, B., Antonishek, B., and Michel, M. (2012). Creating HAVIC: Heterogeneous Audio Visual Internet Collection. In Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC’12), Istanbul, Turkey. European Language Resources Association (ELRA).
17. Thomee, B., Shamma, D. A., Friedland, G., Elizalde, B., Ni, K., Poland, D., Borth, D., and Li, L.-J. (2016). YFCC100M: The New Data in Multimedia Research. Commun. ACM, 59(2):64–73.
18. TV16Pubs (2016). http: //www-nlpir.nist.gov/projects/tvpubs/tv. pubs.16.org.html.
19. UKHO-CPNI (2007 (accessed June 30, 2009)). Imagery Library for Intelligent Detection Systems. http://scienceandresearch.homeoffice. gov.uk/hosdb/cctv-imaging-technology/ video-based-detection-systems/i-lids/.
20. Vedantam, R., Lawrence Zitnick, C., and Parikh, D. (2015). CIDEr: Consensus-based Image Description Evaluation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4566–4575.
21. Xu, J., Mei, T., Yao, T., and Rui, Y. (2016). MSR-VTT: A Large Video Description Dataset for Bridging Video and Language. In Conference on Computer Vision and Pattern Recognition (CVPR).
22. Yilmaz, E. and Aslam, J. A. (2006). Estimating Average Precision with Incomplete and Imperfect Judgments. In Proceedings of the Fifteenth ACM International Conference on Information and Knowledge Management (CIKM), Arlington, VA, USA.
23. Yilmaz, E., Kanoulas, E., and Aslam, J. A. (2008). A Simple and Efficient Sampling Method for Estimating AP and NDCG. In SIGIR’08: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 603–610, New York, NY, USA. ACM.