Combining intra-image and inter-class semantics for consumer image retrieval

Pattern Recognition

Volumn 38, Issue 6, 2005, Pages 847-864

  Lim, Joo Hwee ^a   Jin, Jesse S ^b  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^b UNIVERSITY OF NEWCASTLE   (Australia)

Author keywords

Consumer images; Image indexing; Image retrieval; Image semantics; Image understanding; Unconstrained photographs

Indexed keywords

ALGORITHMS; CONSTRAINT THEORY; DATABASE SYSTEMS; DIGITAL LIBRARIES; FUNCTIONS; IMAGE SEGMENTATION; IMAGE UNDERSTANDING; MAPPING; PROBABILITY; SEMANTICS;

CONSUMER IMAGES; IMAGE INDEXING; IMAGE SEMANTICS; UNCONSTRAINED PHOTOGRAPHS;

IMAGE RETRIEVAL;

EID: 14644418997     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2004.11.002     Document Type: Article

References (47)

1. K. Rodden, K. Wood, How people manage their digital photos? in: Proceedings of the ACM CHI 2003, 2003.
2. A.W.M. Smeulders Content-based image retrieval at the end of the early years IEEE Trans. on PAMI 22 12 2000 1349 1380
3. Y.L. Lu, et al., A unified framework for semantics and feature based relevance feedback in image retrieval systems, in: Proceedings of the ACM Multimedia'2000, 2000, pp. 31-37.
4. W. Liu, Y. Sun, H. Zhang, MiAlbum - A system for home photo management using the semi-automatic image annotation approach, in: Proceedings of the ACM Multimedia, 2000, pp. 479-480.
5. Y. Wu, Q. Tian, T.S. Huang, Discriminant-EM algorithm with application to image retrieval, in: Proceedings of the CVPR'2000, 2000, pp. 1222-1227.
6. C. Town, D. Sinclair, Content-based image retrieval using semantic visual categories, Technical Report 2000.14, AT&T Research, Cambridge, 2000.
7. M.R. Naphade, et al., A framework for moderate vocabulary semantic visual concept detection, in: Proceedings of the IEEE ICME, 2003, pp. 437-440.
8. M.R. Naphade, J.R. Smith, Learning visual models of semantic concepts, in: Proceedings of the IEEE ICIP 2003, 2003.
9. A. Amir, et al., The IBM semantic concept detection framework. Slides presented at TRECVID Workshop 2003, http://www-nlpir.nist.gov/projects/tvpubs/ tv.pubs.org.html, 2003.
10. C. Lin, B. Tseng, J. Smith, VideoAnnEx: IBM MPEG-7 annotation tool for multimedia indexing and concept learning, in: Proceedings of the IEEE ICME 2003, 2003.
11. P. Duygulu, et al., Object recognition as machine translation: learning a lexicon for a fixed image vocabulary, in: Proceedings of the ECCV'2002, 2002, pp. IV: 97-112.
12. K. Barnard, D. Forsyth, Learning the semantics of words and pictures, in: Proceedings of the ICCV, 2001, pp. 408-415.
13. K. Barnard Matching words and pictures J. Mach. Learning Res. 3 2003 1107 1135
14. J. Li, and J.Z. Wang Automatic linguistic indexing of pictures by a statistical modeling approach IEEE Trans. on PAMI 25 10 2003 1 14
15. K. Barnard, et al., The effects of segmentation of feature choices in a translation model of object recognition, in: Proceedings of the CVPR, 2003.
16. B. Bradshaw, Semantic based image retrieval: a probabilistic approach, in: Proceedings of the ACM Multimedia, 2000, pp. 167-176.
17. P. Lipson, E. Grimson, P. Sinha, Configuration base scene classification and image indexing, in: Proceedings of the CVPR'97, 1997, pp. 1007-1013.
18. M. Szummer, R.W. Picard, Indoor-outdoor image classification, in: Proceedings of the IEEE International Work on Content-based Access of Image and Video Databases, January 1998, pp. 42-51.
19. A. Vailaya Bayesian framework for hierarchical semantic classification of vacation images IEEE Trans. on Image Process. 10 1 2001 117 130
20. M.R. Naphade, I.V. Kozintsev, and T.S. Huang A factor graph framework for semantic video indexing IEEE Trans. on CSVT 12 1 2002 40 52
21. K. Tieu, P. Viola, Boosting image retrieval, in: Proceedings of the CVPR'2000, 2000, pp. 1228-1235.
22. J.N. Kapur, and H.K. Kesava Entropy Optimization Principles with Applications 1992 Academic Press New York
23. S.E. Robertson, and K. Sparck Jones Relevance weighting of search terms J. Am. Soc. Info. Sci. 27 1976 129 146
24. J.H. Lim, Explicit query formulation with visual keywords, in: Proceedings of the ACM Multimedia'2000, 2000, pp. 407-409.
25. J.H. Lim Building visual vocabulary for image indexation and query formulation Pattern Analysis and Applications (Special Issue on Image Indexation) 4 2/3 2001 125 139
26. J.H. Lim, J.S. Jin, Learning consumer photo categories for semantic retrieval, in: Proceedings of the IJCAI'2003, 2003, pp. 1413-1414.
27. J.H. Lim, J.S. Jin, Support regions and images for photo event retrieval, in: Proceedings of the IEEE ICIP'2003, II, 2003, pp. 515-518.
28. J.H. Lim, Q. Tian, and P. Mulhem Home photo content modeling for personalized event-based retrieval IEEE Multimedia 10 4 2003 28 37
29. S. Kumar, A.C. Loui, M. Hebert, Probabilistic classification of image regions using an observation-constrained generative approach, First International Workshop on Generative-Model-Based Vision, June 2002.
30. W.H. Adams Semantic indexing of multimedia content using visual audio, and text cues Eurasip J. Appl. Signal Process. 2003 2 2003 170 185
31. W.H.M. Hsu, S.F. Chang, Generative, discriminative, and ensemble learning on multi-modal perceptual fusion toward news video story segmentation, Proceedings of the IEEE ICME 2004, Taipei, Taiwan, 27-30 June 2004.
32. B.S. Manjunath, and W.Y. Ma Texture features for browsing and retrieval of image data IEEE Transactions on PAMI 18 8 1996 837 842
33. M. Ortega, et al., Supporting similarity queries in MARS, in: Proceedings of the ACM Multimedia, 1997, pp. 403-413.
34. K.K. Sung, and T. Poggio Example-based learning for view-based human face detection IEEE Trans. on PAMI 20 1 1998 39 51
35. J.R. Smith, M.R. Naphade, A.P. Natsev, Multimedia semantic indexing using model vectors, in: Proceedings of the IEEE ICME, 2003, pp. II 445-448.
36. P.C. Papageorgiou, M. Oren, T. Poggio, A general framework for object detection, in: Proceedings of the ICCV, 1997, pp. 555-562.
37. C.M. Bishop Neural Networks for Pattern Recognition 1995 Clarendon Press Oxford
38. M.J. Swain, and D.N. Ballard Color indexing. Intl. J. Comput. Vision 7 1 1991 11 32
39. C.E. Brodley, et al., Content-based retrieval from medical image databases: a synergy of human interaction, machine learning and computer vision, in: Proceedings of the AAAI, 1999, pp. 760-767.
40. A. Mojsilovic, J. Gomes, Semantic based categorization, browsing and retrieval in medical image databases, in: Proceedings of the IEEE ICIP, 2002.
41. J.Z. Wang, J. Li, and G. Wiederhold SIMPLIcity semantics-sensitive integrated matching for picture libraries IEEE Transactions on PAMI 23 9 2001 947 963
42. T. Joachims Making large-scale SVM learning practical B. Scholkopf C. Burges A. Smola Advances in Kernel Methods - Support Vector Learning 1999 MIT-Press Cambridge, MA
43. J.R. Smith, et al., Integrating features, models, and semantics for TREC video, in: NIST Special Publication 500-200: The Tenth Text REtrieval Conference (TREC 2001), 2001, pp. 240-249.
44. T. Maenpaa, M. Pietikainen, J. Viertola, Separating color and pattern information for color texture discrimination, in: Proceedings of the ICPR 2002, August 11-15, Quebec City, Canada, 2002, pp. 668-671.
45. R.A. Johnson, and D.W. Wichern Applied Multivariate Statistical Analysis 1988 Prentice-Hall Englewood Cliffs, NJ
46. J.R. Smith, and S.-F. Chang Integrated spatial and feature image query Multimedia Systems 7 2 1999 129 140
47. Y. Chen, and J.Z. Wang A region-based fuzzy feature matching approach to content-based image retrieval IEEE Trans. on PAMI 24 9 2002 1252 1267