Semantic-associative visual content labelling and retrieval: A multimodal approach

Signal Processing: Image Communication

Volumn 22, Issue 6, 2007, Pages 569-582

  Zhu, Meng ^a   Badii, Atta ^a  

^a School of Systems Engineering   (United Kingdom)

Author keywords

Automatic image annotation; Cross modal indexing; Multi modal data modelling; Semantic level visual content descriptor

Indexed keywords

AUTOMATIC IMAGE ANNOTATION; CROSS-MODAL INDEXING; EUCLIDEAN DISTANCE; MULTI-MODAL DATA MODELING; SEMANTIC-LEVEL VISUAL CONTENT DESCRIPTORS;

GAUSSIAN DISTRIBUTION; IMAGE COMMUNICATION SYSTEMS; MATHEMATICAL MODELS; MODAL ANALYSIS; STATISTICAL METHODS; VOCABULARY CONTROL;

SEMANTICS;

EID: 34447642697     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2007.05.011     Document Type: Article

References (32)

1. S. Anastopoulou, C. Baber, M. Sharples, Multimedia and multimodal systems: commonalities and differences, in: Proceedings of the Fifth Human Centred Technology Postgraduate Workshop, University of Sussex, 2001.
2. Barnard K., Duygulu P., de Freitas N., Forsyth D., Blei D., and Jordan M.I. Matching words and pictures. J. Machine Learning Res. 3 (2003) 1107-1135
3. K. Barnard, D. Forsyth, Learning the Semantics of Words and Pictures, in: Proceedings of International Conference on Computer Vision, 2001, pp. II:408-415.
4. B. Bradshaw, Semantic based image retrieval: a probabilistic approach, in: Proceedings of the Eighth ACM International Conference on Multimedia, 2000, pp. 167-176.
5. Brown P., Pietra S.D., Pietra V.D., and Mercer R. The mathematics of statistical machine translation: parameter estimation. Comput. Linguist. 19 2 (1993) 263-311
6. Carson C., Belongie S., Greenspan H., and Malik J. Blobworld: image segmentation using expectation-maximization and its application to image querying. IEEE Trans. Pattern Anal. Machine Intell. 24 8 (2002) 1026-1038
7. C. Carson, M. Thomas, S. Belongie, J.M. Hellerstein, J. Malik, Blobworld: a system for region-based image indexing and retrieval, in: Proceedings of the Third International Conference on Visual Information Systems, 1999, pp. 509-516.
8. M.L. Cascia, S. Sethi, S. Sclaroff, Combining textual and visual cues for content-based image retrieval on the world wide web, in: Proceedings of IEEE Workshop on Content-Based Access of Image and Video Libraries, 1998.
9. P. Duygulu, K. Barnard, N. Freitas, D. Forsyth, Object recognition as machine translation: learning a lexicon for a fixed image vocabulary, in: Seventh European Conference on Computer Vision, 2002, pp. 97-112.
10. Enser P.G. Query analysis in a visual information retrieval context. Doc. Text Manage. 1 (1993) 25-52
11. M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafine, D. Lee, D. Petkovic, D. Steele, P. Yanker, Query by image and video content: the QBIC system, IEEE Trans. Comput. 1995.
12. M.M. Gorkani, R.W. Picard, Texture orientation for sorting photos 'at a glance', in: Proceedings of the IEEE International Conference on Pattern Recognition, October, 1994.
13. Gupta A., and Jain R. Visual information retrieval. Commun. ACM 40 5 (1997) 71-79
14. Haralick R.M., Shanmugam K., and Dinstein I. Texture features for image classification. IEEE Trans. Sys. Man Cyb. SMC 3 6 (1973) 610-621
15. Jianbo S., and Jitendra M. Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Machine Intell. 22 8 (2000)
16. L.H. Keister, User types and queries: impact on image access systems, challenges in indexing electronic text and images. Learned Inform. 1994.
17. Li J., and Wang J.Z. Automatic linguistic indexing of pictures by a statistical modelling approach. IEEE Trans. Pattern Anal. Machine Intell. 25 9 (2003) 1075-1088
18. Markkula M., and Sormunen E. End-user searching challenges indexing practices in the digital newspaper photo archive. Inform. Retrieval 1 (2000) 259-285
19. Y. Mori, H. Takahashi, R. Oka, Image-to-word transformation based on dividing and vector quantizing images with words, in: MISRM'99 First International Workshop on Multimedia Intelligent Storage and Retrieval Management, 1999.
20. Ornager S. View a picture: theoretical image analysis and empirical user studies on indexing and retrieval. Swedis Library Res. 2 3 (1996) 31-41
21. S. Paek, C.L. Sable, V. Hatzivassiloglou, A. Jaimes, B.H. Schiffman, S.F. Chang, K.R. McKeown, Integration of visual and text based approaches for the content labelling and classification of Photographs, in: ACM SIGIR'99 Workshop on Multimedia Indexing and Retrieval, August, 1999.
22. Y. Rui, T. Huang, S. Mehrotra, M. Ortega, A relevance feedback architecture in content-based multimedia information retrieval systems, in: Proceedings of IEEE Workshop on Content-based Access of Image and Video Libraries, 1997.
23. Rui Y., Huang T.S., and Chang S.F. Image retrieval: current techniques, promising directions and open issues. Visual Commun. Image Representation 10 (1999) 39-62
24. Smeulder A.W.M., Worring M., Anntini S., Gupta A., and Jain R. Content-based image retieval at the end of the early years. IEEE Trans. Pattern Anal. Machine Intell. 22 12 (2000)
25. J. Smith, S. Chang, Chapter query by colour regions using the VisualSEEk content-based visual query system, Intelligent Multimedia Information Retrieval, AAAI, 1997, pp. 23-41.
26. Srihari R., and Zhang Z. Show&Tell: a semi-automated image annotation system. IEEE Trans. Multimedia 7 3 (2000) 61-71
27. Srihari R.K. Use of collateral text in understanding photos. artificial intelligence review. Special Issue Integrating Language Vis. 8 (1995) 409-430
28. Srihari R.K. Computational models for integrating linguistic and visual information: a survey, artificial intelligence review. Special Issue Integrating Language Vis. 8 (1995) 349-369
29. M. Szummer, R.W. Picard, Indoor-outdoor image classification, in: IEEE International Workshop on Content-Based Access of Image and Video Databases, 1998.
30. T. Westerveld, Image retrieval: content versus context, in: Proceedings of Content-Based Multimedia Information Access, 2000, pp. 276-284.
31. Zhou X.S., and Huang S.T. Unifying keywords and visual contents in image retrieval. IEEE Trans. Multimedia 9 2 (2002) 23-33
32. Zhou X.S., and Huang S.T. Image retrieval: feature primitives, feature representation, and relevance feedback. IEEE Workshop Content-based Access Image Video Libraries (2000) 10-13