Mind the Gap: Another look at the problem of the semantic gap in image retrieval

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 6073, Issue , 2006, Pages

  Hare, Jonathon S ^a   Lewis, Paul H ^a   Enser, Peter G B ^b   Sandom, Christine J ^b  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b UNIVERSITY OF BRIGHTON   (United Kingdom)

Author keywords

Automatic Annotation; Cross Language Latent Semantic Indexing; Image Retrieval; Ontologies; Semantic Gap

Indexed keywords

IMAGE RETRIEVAL; INDEXING (OF INFORMATION); INFORMATION RETRIEVAL SYSTEMS; PROBLEM SOLVING; QUERY LANGUAGES; STATE SPACE METHODS;

AUTOMATIC ANNOTATION; CROSS LANGUAGE LATENT SEMANTIC INDEXING; ONTOLOGIES; SEMANTIC GAP;

SEMANTICS;

EID: 33646012930     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.647755     Document Type: Conference Paper

References (45)

1. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years," IEEE Trans. Pattern Anal. Mach. Intell. 22(12), pp. 1349-1380, 2000.
2. P. G. B. Enser and C. G. McGregor, "Analysis of visual information retrieval queries," in British Library Research and Development Report, (6104), p. 55, British Library, London, 1992.
3. C. J. Sandom and P. G. B. Enser, "Virami - visual information retrieval for archival moving imagery.," in Library and Information Commission Report 129, p. 159, Re:source: The Council for Museums, Archives and Libraries, 2002.
4. L. H. Armitage and P. G. B. Enser. "Analysis of user need in image archives." Journal of Information Sciences 23(4), pp. 287-299, 1997.
5. E. Panofsky, Studies in Iconology: Humanistic Themes in the Art of the Renaissance, Harper & Rowe, 1962.
6. S. Shatford, "Analyzing the subject of a picture: A theoretical approach," Cataloguing & Classification Quarterly 5(3), pp. 39-61, 1986.
7. C. Jörgensen, Image Retrieval: Theory and Research : Theory and Research, Scarecrow Press, Lanham, MA and Oxford, July 2003.
8. L. Hollink, A. T. Schreiber, B. J. Wielinga, and M. Worring, "Classification of user image descriptions," Int. J. Hum.-Comput. Stud. 61(5), pp. 601-626, 2004.
9. J. Eakins and M. Graham, "Content-based image retrieval," Tech. Rep. JTAP-039, JISC, 2000.
10. P. G. B. Enser, C. J. Sandom, and P. H. Lewis, "Surveying the reality of semantic image retrieval," in 8th International Conference on Visual Information Systems, VISUAL2005, (Amsterdam, Netherlands), July 2005.
11. 44 pp. 497-506.
12. Edina, "Education image gallery." http://edina.ac.uk/eig.
13. Y. Mori, H. Takahashi, and R. Oka, "Image-to-word transformation based on dividing and vector quantizing images with words," in Proceedings of the First International Workshop on Multimedia Intelligent Storage and Retrieval Management (MISRM'99), 1999.
14. P. Duygulu, K. Barnard, J. F. G. de Freitas, and D. A. Forsyth, "Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary," in ECCV '02: Proceedings of the 7th European Conference on Computer Vision-Part IV, pp. 97-112, Springer-Verlag, (London, UK), 2002.
15. J. Jeon, V. Lavrenko, and R. Manmatha, "Automatic image annotation and retrieval using cross-media relevance models," in SIGIR '03: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, pp. 119-126, ACM Press, (New York, NY, USA). 2003.
16. V. Lavrenko, R. Manmatha, and J. Jeon, "A model for learning the semantics of pictures," in Advances in Neural Information Processing Systems 16, S. Thrun, L. Saul, and B. Schölkopf, eds., MIT Press, Cambridge, MA, 2004.
17. 45 pp. 42-50.
18. F. Monay and D. Gatica-Perez, "On image auto-annotation with latent space models," in MULTIMEDIA '03: Proceedings of the eleventh ACM international conference on Multimedia, pp. 275-278, ACM Press, 2003.
19. S. L. Feng, R. Manmatha, and V. Lavrenko, "Multiple bernoulli relevance models for image and video annotation.," in CVPR (2), pp. 1002-1009, 2004.
20. 45 pp. 24-32.
21. D. M. Blei and M. I. Jordan, "Modeling annotated data," in SIGIR '03: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, pp. 127-134, ACM Press, (New York, NY, USA), 2003.
22. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent dirichlet allocation," J. Mach. Learn. Res. 3, pp. 993-1022, 2003.
23. K. Barnard, P. Duygulu, D. Forsyth, N. de Freitas, D. M. Blei, and M. I. Jordan, "Matching words and pictures," J. Mach. Learn. Res. 3, pp. 1107-1135, 2003.
24. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vision 42(3), pp. 145-175, 2001.
25. A. Oliva and A. B. Torralba; ""Scene-centered description from spatial envelope properties," in BMCV '02: Proceedings of the Second International Workshop on Biologically Motivated Computer Vision, pp. 263-272, Springer-Verlag, (London, UK), 2002.
26. J. S. Hare and P. H. Lewis; "Saliency-based models of image content and their application to auto-annotation by semantic propagation," in Proceedings of the Second European Semantic Web Conference (ESWC2005), (Heraklion, Crete), May 2005.
27. 45 pp. 317-325.
28. 44 pp. 540-549.
29. J. Sivic and A. Zisserman, "Video google: A text retrieval approach to object matching in videos," in International Conference on Computer Vision, pp. 1470-1477, October 2003.
30. A. Yavlinsky, E. Schofield, and S. Rüger, "Automated Image Annotation Using Global Features and Robust Nonparametric Density Estimation," in Proceedings of the 4th International Conference on Image and Video Retrieval, D. Polani, B. Browning, A. Bonarini, and K. Yoshida, eds., Lecture Notes in Computer Science 3568, pp. 507-517, Springer-Verlag, (Singapore), July 2005.
31. J. S. Hare, Saliency for Image Description and Retrieval. PhD thesis, University of Southampton, 2005.
32. M. W. Berry, S. T. Dumais, and G. W. O'Brien, "Using linear algebra for intelligent information retrieval," Tech. Rep. UT-CS-94-270, University of Tennessee, 1994.
33. T. K. Landauer and M. L. Littman, "Fully automatic cross-language document retrieval using latent semantic indexing," in Proceedings of the Sixth Annual Conference of the UW Centre for the New Oxford English Dictionary and Text Research, pp. 31-38, (UW Centre for the New OED and Text Research, Waterloo, Ontario, Canada), October 1990.
34. A. T. G. Schreiber, B. Dubbeldam, J. Wielemaker, and B. Wielinga, "Ontology-based photo annotation," IEEE Intelligent Systems 16(3), pp. 66-74, 2001.
35. L. Hollink, A. T. Schreiber, B. Wielemaker. and B. Wielinga, "Semantic annotation of image collections," in In Proceedings of the KCAP'03 Workshop on Knowledge Markup and Semantic Annotation, (Florida, USA), October 2003.
36. L. Hollink, G. Nguyen, A. T. G. Schreiber, J. Wielemaker, B. J. Wielinga, and M. Worring, "Adding spatial semantics to image annotations," in 4th International Workshop on Knowledge Markup and Semantic Annotation at ISWC'04, 2004.
37. A. Jaimes, B. L. Tseng, and J. R. Smith, "Modal keywords, ontologies, and reasoning for video understanding.," in CIVR, E. M. Bakker, T. S. Huang, M. S. Lew, N. Sebe, and X. S. Zhou. eds., Lecture Notes in Computer Science 2728, pp. 248-259, Springer, 2003.
38. J. Hunter, "Adding multimedia to the semantic web: Building an mpeg-7 ontology.," in SWWS, I. F. Cruz, S. Decker, J. Euzenat, and D. L. McGuinness, eds., pp. 261-283, 2001.
39. C. Tsinaraki, P. Polydoros, N. Moumoutzis, and S. Christodoulakis, "Coupling owl with mpeg-7 and tv-anytime for domain-specific multimedia information integration and retrieval," in Proceedings of RIAO 2004, (Avignon, France), April 2004.
40. I. Kompatsiaris, Y. Avrithis, P. Hobson, and M. Strinzis, "Integrating knowledge, semantics and content for user-centred intelligent media services: the acemedia project," in Proceedings of Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '04), (Lisboa, Portugal), April 2004.
41. B. Hu, S. Dasmahapatra, P. Lewis, and N. Shadbolt, "Ontology-based medical image annotation with description logics," in Proceedings of The 15th IEEE International Conference on Tools with Artificial Intelligence, pp. 77-82, IEEE Computer Society Press, 2003.
42. D. Dupplaw, S. Dasmahapatra, B. Hu, P. H. Lewis, and N. Shadbolt, "Multimedia Distributed Knowledge Management in MIAKT," in Knowledge Markup and Semantic Annotation, 3rd International Semantic Web Conference, S. Handshuh and T. Declerck, eds., pp. 81-90, (Hiroshima, Japan), 2004.
43. M. J. Addis, K. Martinez, P. H. Lewis, J. Stevenson, and F. Giorgini. "New Ways to Search, Navigate and Use Multimedia Museum Collections over the Web," in Proceedings of Museums and the Web 2005, J. Trant and D. Bearman. eds., (Vancouver, Canada), 2005.
44. W. K. Leow, M. S. Lew, T.-S. Chua, W.-Y. Ma, L. Chaisorn, and E. M. Bakker, eds. Image and Video Retrieval, 4th International Conference. CIVR 2005, Singapore, July 20-22, 2005, Proceedings, Lecture Notes in Computer Science 3568, Springer, 2005.
45. P. G. B. Enser, Y. Kompatsiaris, N. E. O'Connor, A. F. Smeaton. and A. W. M. Smeulders, eds., Image and Video Retrieval: Third International Conference, CIVR 2004, Dublin, Ireland, July 21-23, 2004. Proceedings, Lecture Notes in Computer Science 3115, Springer, 2004.