The segmented and annotated IAPR TC-12 benchmark

Computer Vision and Image Understanding

Volumn 114, Issue 4, 2010, Pages 419-428

  Escalante, Hugo Jair ^a   Hernández, Carlos A ^a   Gonzalez, Jesus A ^a   Lopez Lopez A ^a   Montes, Manuel ^a   Morales, Eduardo F ^a   Enrique Sucar, L ^a   Villaseñor, Luis ^a   Grubinger, Michael ^b  

^a INSTITUTO NACIONAL DE ASTROFÍSICA   (Mexico)

^b VICTORIA UNIVERSITY   (Australia)

Author keywords

Automatic image annotation; Data set creation; Evaluation metrics; Ground truth collection; Image retrieval

Indexed keywords

AUTOMATIC IMAGE ANNOTATION; DATA SETS; EVALUATION METRICS; GROUND TRUTH; GROUND TRUTH COLLECTION;

IMAGE ANALYSIS; INFORMATION SERVICES; MULTIMEDIA SYSTEMS; THERMAL CONDUCTIVITY;

IMAGE RETRIEVAL;

EID: 77649188328     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2009.03.008     Document Type: Article

References (39)

1. Datta R., Joshi D., Li J., and Wang J.Z. Image retrieval: ideas, influences, and trends of the new age. ACM Computing Surveys 40 2 (2008) 1-60
2. M. Inoue, On the need for annotation-based image retrieval, in: IRiX'04: Proceedings of the ACM-SIGIR Workshop on Information Retrieval in Context, Sheffield, UK, 2004, pp. 44-46.
3. Y. Mori, H. Takahashi, R. Oka, Image-to-word transformation based on dividing and vector quantizing images with words0, MISRM'99 First International Workshop on Multimedia Intelligent Storage and Retrieval Management, Orlando, Florida, USA, 1999.
4. P. Duygulu, K. Barnard, N. de Freitas, D.A. Forsyth. Object recognition as machine translation: learning a lexicon for a fixed image vocabulary, in: ECCV'02: Proceedings of the 7th European Conference on Computer Vision, LNCS vol. 2353, Springer, London, UK, 2002, pp. 97-112.
5. Barnard K., Duygulu P., de Freitas N., Forsyth D.A., Blei D., and Jordan M.I. Matching words and pictures. Journal of Machine Learning Research 3 (2003) 1107-1135
6. J. Jeon, V. Lavrenko, R. Manmatha, Automatic image annotation and retrieval using cross-media relevance models, in: Proceedings of the 26th International ACM-SIGIR Conference on Research and Development on Information Retrieval, Toronto, Canada, 2003, pp. 119-126.
7. D. Blei. Probabilistic Models of Text and Images, PhD Thesis, University of California, Berkeley, California, USA, 2004.
8. P. Carbonetto, N. de Freitas, K. Barnard, A statistical model for general context object recognition, in: ECCV'04: Proceedings of the 8th European Conference on Computer Vision, LNCS vol. 3021, Springer, Prague, Czech Republic, 2004, pp. 350-362.
9. Carneiro G., Chan A.B., Moreno P.J., and Vasconcelos N. Supervised learning of semantic classes for image annotation and retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence 29 3 (2007) 394-410
10. Barnard K., Fan Q., Swaminathan R., Hoogs A., Collins R., Rondot P., and Kaufhold J. Evaluation of localized semantics: data methodology and experiments. International Journal of Computer Vision 77 1-3 (2008) 199-217
11. H.J. Escalante, J.A. González, C.A. Hernández, A. López, M. Montes, E. Morales, L.E. Sucar, L. Villaseñor, Annotation-Based Expansion and Late Fusion of Mixed Methods for Multimedia Image Retrieval, Evaluating Systems for Multilingual and Multimodal Information Access - 9th Workshop of the CLEF, LNCS, Springer, Aarhus, Denmark, 2009, in press.
12. M. Grubinger, Analysis and Evaluation of Visual Information Systems Performance, PhD Thesis, School of Computer Science and Mathematics, Faculty of Health, Engineering and Science, Victoria University, Melbourne, Australia, 2007.
13. P. Clough, M. Grubinger, T. Deselaers, A. Hanbury, H. Müller, Overview of the ImageCLEF 2006 photographic retrieval and object annotation tasks, Evaluation of Multilingual and Multimodal Information Retrieval - 7th Workshop of the CLEF, LNCS vol. 4730, Springer, Alicante, Spain, 2006 (printed in 2007), pp. 579-594.
14. M. Grubinger, P. Clough, A. Hanbury, H. Müller, Overview of the ImageCLEF 2007 photographic retrieval task, Advances in Multilingual and Multimodal Information Retrieval - 8th Workshop of CLEF, LNCS vol. 5152, Springer, Budapest, Hungary, 2007 (printed in 2008), pp. 433-444.
15. M. Everingham, A. Zisserman, C.K.I. Williams, L. Van Gool, The PASCAL Visual Object Classes Challenge 2006 (VOC2006) Results, Tech. rep., University of Oxford, Oxford, UK, 2006.
16. G. Griffin, G. Holub, P. Perona, The Caltech-256, Tech. rep., California Institute of Technology, Pasadena, California, USA, 2007.
17. H.J. Escalante, M. Montes, L.E. Sucar, Word co-occurrence and Markov random fields for improving automatic image annotation, in: Proceedings of the 18th British Machine Vision Conference, vol. 2, Warwick, UK, 2007, pp. 600-609.
18. H.J. Escalante, M. Montes, L.E. Sucar, Multi-Class PSMS for Automatic Image Annotation, Applications on Swarm Intelligence, Springer, 2008.
19. H. Müller, S. Maillet-Marchand, T. Pun, The truth about corel - evaluation in image retrieval, in: CIVR'02: Proceedings of the International Conference on Image and Video Retrieval, LNCS vol. 2383, Springer, London, UK, 2002, pp. 38-49.
20. L. von Ahn, L. Dabbish, Labeling images with a computer game, in: CHI'04: Proceedings of the ACM-SIGCHI Conference on Human Factors in Computing Systems, Vienna, Austria, 2004, pp. 319-326.
21. L. von Ahn, R. Liu, M. Blum, Peekaboom: a game for locating objects in images, in: CHI'06: Proceedings of the ACM-SIGCHI Conference on Human Factors in Computing Systems, Montréal, Québec, Canada, 2006, pp. 55-64.
22. Russell B., Torralba A., Murphy K.P., and Freeman W. LabelMe: a database and web-based tool for image annotation. International Journal of Computer Vision 77 1-3 (2008) 157-173
23. B. Yao, X. Yang, S. Zhu, Introduction to a large-scale general purpose ground truth database: methodology, annotation tool and benchmarks, in: EMMCVPR'07: Proceedings of Energy Minimization Methods in Computer Vision and Pattern Recognition, Hubei, China, 2007, pp. 169-183.
24. Ponce J., Berg T.L., Everingham M., Forsyth D.A., Hebert M., Lazebnik S., Marszalek M., Schmid C., Russell B.C., Torralba A., Williams C.K.I., Zhang J., and Zisserman A. Dataset issues in object recognition. Toward Category-Level Object Recognition LNCS vol. 41 (2006), Springer 29-48 (Chapter 2)
25. L. Fei-Fei, R. Fergus, P. Perona, Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories, CVPR'04: Workshop on Generative-Model Based Vision, Washington, DC, USA, 2004, p. 178.
26. Agarwal S., Awan A., and Roth D. Learning to detect objects in images via a sparse part-based representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 11 (2004) 1475-1490
27. C.K.I. Williams, F. Vivarelli, Using Bayesian neural networks to classify segmented images, in: Proceedings of IEEE International Conference on Artificial Neural Networks, Cambridge, UK, 1997, pp. 268-273.
28. A. Hanbury, A. Tavakoli-Targhi, A dataset of annotated animals, in: Proceedings of the 2nd MUSCLE/ ImageCLEF Workshop on Image and Video Retrieval Evaluation, Alicante, Spain, 2006, pp. 19-27.
29. Vailaya A., Jain A., and Zhang H. On Image classification: city versus landscape. Pattern Recognition 31 (1998) 1921-1936
30. Vogel J., and Schiele B. semantic modeling of natural scenes for content-based image retrieval. International Journal of Computer Vision 72 2 (2007) 133-157
31. J. Winn, A. Criminisi, T. Minka, Object Categorization by Learned Universal Visual Dictionary, in: ICCV'05: Proceedings of IEEE International Conference on Computer Vision, Beijing, China, 2005, pp. 1800-1807.
32. J. Shotton, J. Winn, C. Rother, A. Criminisi, TextonBoost: joint appearance, shape and context modeling for multi-class object recognition and segmentation, in: ECCV'06: Proceedings of the 9th European Conference on Computer Vision, Graz, Austria, 2006, pp. 1-15.
33. D. Martin, C. Fowlkes, D. Tal, J. Malik, A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics, in: ICCV'01: Proceedings of IEEE International Conference on Computer Vision, Vancouver, BC, Canada, 2001, pp. 416-421.
34. T. Deselaers, A. Hanbury, V. Viitaniemi, et al., Oerview of the ImageCLEF 2007 Object Retrieval Task, Advances in Multilingual and Multimodal Information Retrieval - 8th Workshop of the CLEF, LNCS Vol. 5152, Springer, Budapest, Hungary, 2007 (printed in 2008), pp. 445-471.
35. T. Deselaers, A. Hanbury, The Visual Concept Detection Task in ImageCLEF 2008, Evaluating Systems for Multilingual and Multimodal Information Access - 9th Workshop of the CLEF, LNCS, Springer, Aarhus, Denmark, 2009, in press.
36. H.J. Escalante, C. Hernandez, J. Gonzalez, A. Lopez, M. Montes, E. Morales, E. Sucar, L. Villaseñor, Segmenting and Annotating the IAPR TC-12 Benchmark, Tech. rep., Department of Computational Sciences, INAOE, CCC-08-05, Puebla, México, 2008.
37. A. Hanbury, Review of Image Annotation for the Evaluation of Computer Vision Algorithms, Tech. rep., PRIP, Vienna University of Technology, 102, Vienna, Austria, 2006.
38. C. Hernandez, L.E. Sucar, Markov Random Fields and Spatial Information to Improve Automatic Image Annotation, in: Proceedings of the 2007 Pacific-Rim Symposium on Image and Video Technology, LNCS vol. 4872, Springer, Santiago, Chile, 2007, pp. 879-892.
39. Bishop C. Pattern Recognition and Machine Learning (2006), Springer