Semantic spaces revisited: Investigating the performance of auto-annotation and semantic retrieval using semantic spaces

CIVR 2008 - Proceedings of the International Conference on Content-based Image and Video Retrieval

Volumn , Issue , 2008, Pages 359-368

  Hare, Jonathon S ^a   Samangooei, Sina ^a   Lewis, Paul H ^a   Nixon, Mark S ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Evaluation; Latent semantic analysis; Probabilistic latent semantic analysis; Semantic image retrieval; Semantic spaces; Visual terms

Indexed keywords

FUNCTIONS; IMAGE RETRIEVAL; IMAGE SEGMENTATION; INFORMATION RETRIEVAL; SEMANTICS;

EVALUATION; LATENT SEMANTIC ANALYSIS; PROBABILISTIC LATENT SEMANTIC ANALYSIS; SEMANTIC IMAGE RETRIEVAL; SEMANTIC SPACES; VISUAL-TERMS;

INFORMATION THEORY;

EID: 57549100653     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1386352.1386399     Document Type: Conference Paper

References (33)

1. K. Barnard, P. Duygulu, D. Forsyth, N. de Freitas, D. M. Blei, and M. I. Jordan. Matching words and pictures. J. Mach. Learn. Res., 3:1107-1135, 2003.
2. J. R. Bellegarda. Exploiting latent semantic information in statistical language modeling. Proceedings of the IEEE, 88(8): 1279-1296, Aug. 2000.
3. D. M. Blei and M. I. Jordan. Modeling annotated data. In SIGIR'03: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, pages 127-134, New York, NY, USA, 2003. ACM Press.
4. D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent dirichlet allocation. J. Mach. Learn. Res., 3:993-1022, 2003.
5. G. Carneiro, A. B. Chan, P. J. Moreno, and N. Vasconcelos. Supervised learning of semantic classes for image annotation and retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(3):394-410, 2007.
6. S. C. Deerwester, S. T. Dumais, T. K. Landauer, G. W. Furnas, and R. A. Harshman. Indexing by latent semantic analysis. Journal of the American Society of Information Science, 41(6):391-407, 1990.
7. A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society. Series B (Methodological), 39(1): 1-38, 1977.
8. P. Duygulu, K. Barnard, J. F. G. de Freitas, and D. A. Forsyth. Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In ECCV'02: Proceedings of the 7th European Conference on Computer Vision-Part IV, pages 97-112, London, UK, 2002. Springer-Verlag.
9. P. G. B. Enser, Y. Kompatsiaris, N. E. O'Connor, A. F. Smeaton, and A. W. M. Smeulders, editors. Image and Video Retrieval: Third International Conference, CIVR 2004, Dublin, Ireland, July 21-23, 2004-. Proceedings, volume 3115 of Lecture Notes in Computer Science. Springer, 2004.
10. S. L. Feng, R. Manmatha, and V. Lavrenko. Multiple bernoulli relevance models for image and video annotation. In CVPR (2), pages 1002-1009, 2004.
11. J. S. Hare. Saliency for Image Description and Retrieval. PhD thesis, University of Southampton, 2005.
12. J. S. Hare and P. H. Lewis. Salient regions for query by image content. In Enser et al.
13. J. S. Hare and P. H. Lewis. On image retrieval using salient regions with vector-spaces and latent semantics. In W. K. Leow, M. S. Lew, T.-S. Chua, W.-Y. Ma, L. Chaisorn, and E. M. Bakker, editors, CIVR, volume 3568 of Lecture Notes in Computer Science, pages 540-549. Springer, 2005.
14. J. S. Hare and P. H. Lewis. Saliency-based models of image content and their application to auto-annotation by semantic propagation. In Proceedings of the Second European Semantic Web Conference (ESWC2005), Heraklion, Crete, May 2005.
15. J. S. Hare, P. H. Lewis, P. G. B. Enser, and C. J. Sandom. A Linear-Algebraic Technique with an Application in Semantic Image Retrieval. In H. Sundaram, M. Naphade, J. R. Smith, and Y. Rui, editors, Image and Video Retrieval, 5th International Conference, CIVR 2006, Tempe, AZ, USA, July 2006, Proceedings, volume 4071 of Lecture Notes in Computer Science, pages 31-40. Springer, 2006.
16. J. S. Hare, P. H. Lewis, P. G. B. Enser, and C. J. Sandom. Semantic facets: an in-depth analysis of a semantic image retrieval system. In CIVR'07: Proceedings of the 6th ACM international conference on Image and video retrieval, pages 250-257, New York, NY, USA, 2007. ACM Press.
17. T. Hofmann. Unsupervised learning by probabilistic latent semantic analysis. Mach. Learn., 42(1-2):177-196, 2001.
18. J. Jeon, V. Lavrenko, and R. Manmatha. Automatic image annotation and retrieval using cross-media relevance models. In SIGIR'03: Proceedings of the 26th annual international ACM SIGIR conference on Research and, development in information retrieval, pages 119-126, New York, NY, USA, 2003. ACM Press.
19. J. Jeon and R. Manmatha. Using maximum entropy for automatic image annotation. In Enser et al.
20. T. K. Landauer and M. L. Liftman. Fully automatic cross-language document retrieval using latent semantic indexing. In Proceedings of the Sixth Annual Conference of the UW Centre for the New Oxford English Dictionary and, Text Research, pages 31-38, UW Centre for the New OED and Text Research, Waterloo, Ontario, Canada, October 1990.
21. V. Lavrenko, R. Manmatha, and J. Jeon. A model for learning the semantics of pictures. In S. Thrun, L. Saul, and B. Scholkopf, editors, Advances in Neural Information Processing Systems 16. MIT Press, Cambridge, MA, 2004.
22. D. Metzler and R. Manmatha. An inference network approach to image retrieval. In Enser et al.
23. F. Monay and D. Gatica-Perez. On image auto-annotation with latent space models. In MULTIMEDIA'03: Proceedings of the eleventh ACM international conference on Multimedia, pages 275-278. ACM Press, 2003.
24. F. Monay and D. Gatica-Perez. Modeling semantic aspects for cross-media image indexing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(10):1802-1817, 2007.
25. Y. Mori, H. Takahashi, and R. Oka. Image-to-word transformation based on dividing and vector quantizing images with words. In Proceedings of the First International Workshop on Multimedia Intelligent Storage and Retrieval Management (MISRM'99), 1999.
26. H. Müller, S. Marchand-Maillet, and T. Pun. The truth about corel - evaluation in image retrieval. In M. S. Lew, N. Sebe, and J. P. Eakins, editors, CIVR, volume 2383 of Lecture Notes in Computer Science, pages 38-49. Springer, 2002.
27. A. Oliva and A. Torralba. Modeling the shape of the scene: A holistic representation of the spatial envelope. Int. J. Comput. Vision, 42(3):145-175, 2001.
28. A. Oliva and A. B. Torralba. Scene-centered description from spatial envelope properties. In BMCV'02: Proceedings of the Second International Workshop on Biologically Motivated Computer Vision, pages 263-272, London, UK, 2002. Springer-Verlag.
29. J.-Y. Pan, H.-J. Yang, P. Duygulu, and C. Faloutsos. Automatic image captioning. Multimedia and Expo, 2004. ICME'04. 2004 IEEE International Conference on, 3:1987-1990 Vol.3, 27-30 June 2004.
30. J. Sivic and A. Zisserman. Video google: A text retrieval approach to object matching in videos. In International Conference on Computer Vision, pages 1470-1477, October 2003.
31. J. Tang and P. H. Lewis. A study of quality issues for image auto-annotation with the corel dataset. IEEE Trans. Circuits Syst. Video Techn., 17(3):384-389, 2007.
32. A. Yavlinsky. Image indexing and retrieval using automated annotation. PhD thesis, Imperial College London, Imperial College London, South Kensington Campus, London SW7 2AZ, August 2007.
33. A. Yavlinsky, E. Schofield, and S. Rüger. Automated Image Annotation Using Global Features and Robust Nonparametric Density Estimation. In W. K. Leow, M. S. Lew, T.-S. Chua, W.-Y. Ma, L. Chaisorn, and E. M. Bakker, editors, Image and Video Retrieval, volume 3568 of LNCS, pages 507-517, Singapore, 2005. Springer.