A survey of methods for image annotation

Journal of Visual Languages and Computing

Volumn 19, Issue 5, 2008, Pages 617-627

  Hanbury, Allan ^a  

^a VIENNA UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

Algorithm evaluation; Computer vision; Image annotation; Object recognition; Ontology

Indexed keywords

EID: 51249103628     PISSN: 1045926X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jvlc.2008.01.002     Document Type: Article

References (54)

1. Barnard K., Duygulu P., de Freitas N., Forsyth D., Blei D., and Jordan M.I. Matching words and pictures. Journal of Machine Learning Research 3 (2003) 1107-1135
2. K. Barnard, P. Duygulu, R. Guru, P. Gabbur, D. Forsyth, The effects of segmentation and feature choice in a translation model of object recognition, in: Proceedings on Computer Vision and Pattern Recognition, 2003, pp. II:675-682.
3. P. Carbonetto, N. de Freitas, K. Barnard, A statistical model for general contextual object recognition, in: Proceedings of the European Conference on Computer Vision (ECCV), 2004, pp. I:350-362.
4. G. Csurka, C.R. Dance, L. Fan, J. Willamowski, C. Bray, Visual categorization with bags of keypoints, in: Workshop on Statistical Learning in Computer Vision (at ECCV), 2004.
5. R. Datta, W. Ge, J. Li, J.Z. Wang, Toward bridging the annotation-retrieval gap in image search by a generative modeling approach, in: Proceedings of the ACM Multimedia Conference, 2006.
6. Li J., and Wang J.Z. Automatic linguistic indexing of pictures by a statistical modeling approach. IEEE Transaction on Pattern Analysis and Machine Intelligence 25 9 (2003) 1075-1088
7. J. Li, J.Z. Wang, Real-time computerized annotation of pictures, in: Proceedings of the ACM Multimedia Conference, 2006.
8. Winn J., Criminisi A., and Minka T. Object categorization by learned universal visual dictionary. Proceedings of the International Conference on Computer Vision (ICCV) (2005) 1800-1807
9. Smeulders A.W.M., Worring M., Santini S., Gupta A., and Jain R. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 12 (2000) 1349-1380
10. Leung C.H.C., and Ip H.H.-S. Benchmarking for content-based visual information search. Proceedings of the 4th International Conference on Advances in Visual Information Systems (2000) 442-456
11. Fluhr C., Moëllic P.-A., and Hede P. Usage-oriented multimedia information retrieval technological evaluation. MIR '06: Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval (2006) 301-306
12. del Bimbo A. Visual Information Retrieval (1999), Morgan Kaufmann, Los Altos, CA
13. In: Manjunath B., Salembier P., and Sikora T. (Eds). Introduction to MPEG-7: Multimedia Content Description Interface (2002), Wiley, New York
14. Hyvönen E., Styrman A., and Saarela S. Ontology-based image retrieval. Proceedings of XML Finland Conference (2002) 27-51
15. Gabrilovich E., and Markovitch S. Feature generation for text categorization using world knowledge. Proceedings of the 19th International Joint Conference for Artificial Intelligence (2005), Edinburgh, Scotland 1048-1053
16. A. Doms, M. Schroeder, GoPubMed: exploring PubMed with the gene ontology, Nucleic Acids Research 33.
17. Kutics A., Nakagawa A., Arai S., Tanaka H., and Ohtsuka S. Relating words and image segments on multiple layers for effective browsing and retrieval. Proceedings of the International Conference on Image Processing (2004) 2203-2206
18. Gruber T.R. A translation approach to portable ontology specifications. Knowledge Acquisition 5 2 (1993) 199-220
19. J. Wilkins, An Essay Towards a Real Character and a Philosophical Language, London, 1668.
20. Lakoff G. Women, Fire, and Dangerous Things: What Categories Reveal About the Mind (1987), University of Chicago Press
21. Schreiber A.T.G., Dubbeldam B., Wielemaker J., and Wielinga B. Ontology-based photo annotation. IEEE Intelligent Systems 16 3 (2001) 66-74
22. van de Waal H., et al. Iconclass, An Iconographic Classification System (17 volumes) (1985), North-Holland, Amsterdam
23. Y. Lafon, B. Bos, Describing and retrieving photos using RDF and HTTP, W3C. Note 〈http://www.w3.org/TR/photo-rdf/〉, 2002 (accessed: 17.5.2006).
24. Lin C.-Y., Tseng B.L., and Smith J.R. Videoannex: IBM MPEG-7 annotation tool for multimedia indexing and concept learning. Proceedings of the IEEE International Conference on Multimedia and Expo (ICME) (2003)
25. In: Peters C., Clough P., Gonzalo J., Jones G., Kluck M., and Magnini B. (Eds). Multilingual Information Access for Text, Speech and Images. Lecture Notes on Computer Science vol. 3491 (2004), Springer, Berlin
26. Grubinger M., Clough P., Müller H., and Deselaers T. The IAPR TC-12 benchmark-a new evaluation resource for visual information systems. Proceedings of the International Workshop OntoImage'2006 (2006) 13-23
27. M. Grubinger, C. Leung, P. Clough, The IAPR benchmark for assessing image retrieval performance in cross language evaluation tasks, in: Proceedings of the MUSCLE/ImageCLEF Workshop on Image and Video Retrieval Evaluation, 2005, Vienna, Austria, pp. 17-23.
28. Chen Y., and Wang J.Z. Image categorization by learning and reasoning with regions. Journal of Machine Learning Research 5 (2004) 913-939
29. Szummer M., and Picard R.W. Indoor-outdoor image classification. Proceedings of the IEEE International Workshop on Content-based Access of Image and Video Databases (1998) 42-51
30. Vailaya A., Figueiredo M.A.T., Jain A.K., and Zhang H.-J. Image classification for content-based indexing. IEEE Transactions on Image Processing 10 1 (2001) 117-130
31. Wang J.Z., Li J., and Wiederhold G. SIMPLIcity: semantics-sensitive integrated matching for picture libraries. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 9 (2001) 947-963
32. In: Ponce J., Hebert M., Schmid C., and Zisserman A. (Eds). Toward Category-Level Object Recognition. Lecture Notes in Computer Science vol. 4170 (2006), Springer, Berlin
33. M. Everingham, A. Zisserman, C. Williams, L. Van Gool, The Pascal visual object classes challenge 2006 (VOC 2006) results, Technical Report, PASCAL Network of Excellence, 2006.
34. Fei-Fei L., Fergus R., and Perona P. Learning generative visual models from few training examples an incremental Bayesian approach tested on 101 object categories. Proceedings of the Workshop on Generative-Model Based Vision (2004)
35. Moëllic P.-A., Hède P., Grefenstette G., and Millet C. Evaluating content based image retrieval techniques with the one million images clic testbed. Proceedings of the Second World Enformatika Congress, WEC'05 (2005) 171-174
36. Jörgenson C., and Jörgenson P. Testing a vocabulary for image indexing and ground truthing. Proceedings of Internet Imaging III (2002) 207-215
37. Miller G.A., Beckwith R., Fellbaum C., Gross D., and Miller K. Introduction to WordNet: an on-line lexical database. International Journal of Lexicography 3 4 (1990) 235-244
38. K. Barnard, Q. Fan, R. Swaminathan, A. Hoogs, R. Collins, P. Rondot, J. Kaufhold, Evaluation of localized semantics: data, methodology, and experiments, Technical Report TR-05-08, Computing Science, University of Arizona, 2005.
39. S. Zinger, C. Millet, B. Mathieu, G. Grefenstette, P. Hède, P.-A. Moëllic, Extracting an ontology of portrayable objects from WordNet, in: Proceedings of the MUSCLE/ImageCLEF Workshop on Image and Video Retrieval Evaluation, 2005, Vienna, Austria, pp. 17-23.
40. Hauptmann A.G. Towards a large scale concept ontology for broadcast video. Proceedings of the 3rd International Conference on Image and Video Retrieval (2004) 674-675
41. L. Kennedy, A. Hauptmann, M. Naphade, J. R. Smith, S.-F. Chang, Lscom lexicon definitions and annotations version 1.0, Technical Report ADVENT #217-2006-3, Columbia University, March 2006.
42. Collins D., Wright W.A., and Greenway P. The Sowerby image database. Proceedings of the 7th International Conference on Image Processing and its Applications vol. 1 (1999) 306-310
43. K. Barnard, P. Duygulu, D. Forsyth, Clustering art, in: Proceedings of Computer Vision and Pattern Recognition, 2001, pp. II:434-441.
44. Müller H., Marchand-Maillet S., and Pun T. The truth about Corel-evaluation in image retrieval. Proceedings of the Conference on Image and Video Retrieval (CIVR) (2002) 38-49
45. Everingham M., Zisserman A., Williams C., Van Gool L., Allan M., Bishop C., Chapelle O., Dalal N., Deselaers T., Dorko G., Duffner S., Eichhorn J., Farquhar J., Fritz M., Garcia C., Griffiths T., Jurie F., Keysers D., Koskela M., Laaksonen J., Larlus D., Leibe B., Meng H., Ney H., Schiele B., Schmid C., Seemann E., Shawe-Taylor J., Storkey A., Szedmak S., Triggs B., Ulusoy I., Viitaniemi V., and Zhang J. The 2005 PASCAL visual object classes challenge. Selected Proceedings of the 1st PASCAL Challenges Workshop (2006), Springer, Berlin
46. B.C. Russell, A. Torralba, K.P. Murphy, W.T. Freeman, LabelMe: a database and web-based tool for image annotation, Technical Report AIM-2005-025, MIT AI Lab, September 2005.
47. von Ahn L., and Dabbish L. Labeling images with a computer game. Proceedings of ACM CHI (2004) 319-326
48. von Ahn L., Liu R., and Blum M. Peekaboom: a game for locating objects in images. Proceedings of ACM CHI (2006)
49. Berg T.L., and Forsyth D.A. Animals on the web. Proceedings of the Conference on Computer Vision and Pattern Recognition vol. 2 (2006) 1463-1470
50. Ponce J., Berg T.L., Everingham M., Forsyth D., Hebert M., Lazebnik S., Marszalek M., Schmid C., Russell B., Torralba A., Williams C.K.I., Zhang J., and Zisserman A. Dataset issues in object recognition. In: Ponce J., Hebert M., Schmid C., and Zisserman A. (Eds). Toward Category-Level Object Recognition (2006), Springer, Berlin 30-50
51. F. Perronnin, C. Dance, G. Csurka, M. Bressan, Adapted vocabularies for generic visual categorization, in: Proceedings of the European Conference on Computer Vision (ECCV), 2006, pp. IV:464-475.
52. J. Shotton, J. Winn, C. Rother, A. Criminisi, TextonBoost: joint appearance, shape and context modeling for multi-class object recognition and segmentation, in: Proceedings of the European Conference on Computer Vision (ECCV), 2006, pp. I:1-15.
53. Hardoon D.R., Saunders C., Szedmak S., and Shawe-Taylor J. A correlation approach for automatic image annotation. Proceedings of 2nd International Conference on Advanced Data Mining and Applications (2006) 681-692
54. Frigui H., and Caudill J. Building a multi-modal thesaurus from annotated images. Proceedings of the International Conference on Pattern Recognition ICPR vol. 4 (2006) 198-201