Region-based image retrieval using an object ontology and relevance feedback

Eurasip Journal on Applied Signal Processing

Volumn 2004, Issue 6, 2004, Pages 886-901

  Mezaris, Vasileios ^a,b   Kompatsiaris, Ioannis ^a,b   Strintzis, Michael G ^a,b  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^b INFORMATICS AND TELEMATICS INSTITUTE   (Greece)

Author keywords

Image databases; Image retrieval; Image segmentation; Ontology; Relevance feedback; Support vector machines

Indexed keywords

ALGORITHMS; DATABASE SYSTEMS; FEATURE EXTRACTION; IMAGE SEGMENTATION; INDEXING (OF INFORMATION); SATELLITE COMMUNICATION SYSTEMS; VECTORS;

IMAGE DATABASES; ONTOLOGY; RELEVANCE FEEDBACK; SUPPORT VECTOR MACHINES;

IMAGE RETRIEVAL;

EID: 4043150094     PISSN: 11108657     EISSN: None     Source Type: Journal    
DOI: 10.1155/S1110865704401188     Document Type: Article

References (48)

1. M. R. Naphade and T. S. Huang, "Extracting semantics from audio-visual content: the final frontier in multimedia retrieval," IEEE Transactions on Neural Networks, vol. 13, no. 4, pp. 793-810, 2002.
2. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 22, no. 12, pp. 1349-1380, 2000.
3. S. Christodoulakis, M. Theodoridou, F. Ho, M. Papa, and A. Pathria, "Multimedia document presentation, information extraction, and document formation in MINOS: a model and a system," ACM Trans. Office Information Systems, vol. 4, no. 4, pp. 345-383, 1986.
4. C. Zhang and T. Chen, "An active learning framework for content-based information retrieval," IEEE Trans. Multimedia, vol. 4, no. 2, pp. 260-268, 2002.
5. S.-F. Chang, W. Chen, H. J. Meng, H. Sundaram, and D. Zhong, "A fully automated content-based video search engine supporting spatiotemporal queries," IEEE Trans. Circuits and Systems for Video Technology, vol. 8, no. 5, pp. 602-615, 1998.
6. C. Faloutsos, R. Barber, M. Flickner, et al., "Efficient and effective querying by image content," Journal of Intelligent Information Systems, vol. 3, no. 3/4, pp. 231-262, 1994.
7. M. Flickner, H. Sawhney, W. Niblack, et al., "Query by image and video content: the QBIC system," IEEE Computer, vol. 28, no. 9, pp. 23-32, 1995.
8. B. S. Manjunath and W. Y. Ma, "Texture features for browsing and retrieval of image data," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 18, no. 8, pp. 837-842, 1996.
9. W. Y. Ma and B. S. Manjunath, "NeTra: a toolbox for navigating large image databases," Multimedia Systems, vol. 7, no. 3, pp. 184-198, 1999.
10. T. S. Huang, S. Mehrotra, and K. Ramchandran, "Multimedia analysis and retrieval system (MARS) project," in Proc. 33rd Annual Clinic on Library Application of Data Processing - Digital Image Access and Retrieval, Urbana-Champaign, Ill, USA, March 1996.
11. A. Pentland, R. Picard, and S. Sclaroff, "Photobook: content-based manipulation of image databases," International Journal of Computer Vision, vol. 18, no. 3, pp. 233-254, 1996.
12. J. R. Smith and S.-F. Chang, "VisualSEEk: a fully automated content-based image query system," in Proc. ACM Multimedia, pp. 87-98, ACM Press, Boston, Mass, USA, November 1996.
13. I. Kompatsiaris, E. Triantafillou, and M. G. Strintzis, "Region-based color image indexing and retrieval," in Proc. 2001 International Conference on Image Processing, vol. 1, pp. 658-661, Thessaloniki, Greece, October 2001.
14. S. Belongie, C. Carson, H. Greenspan, and J. Malik, "Color-and texture-based image segmentation using EM and its application to content-based image retrieval," in Proc. 6th International Conference on Computer Vision, pp. 675-682, Bombay, India, January 1998.
15. C. Carson, S. Belongie, H. Greenspan, and J. Malik, "Blobworld: image segmentation using expectation-maximization and its application to image querying," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 24, no. 8, pp. 1026-1038, 2002.
16. P. Perona and J. Malik, "Scale-space and edge detection using anisotropic diffusion," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 629-639, 1990.
17. E. Tuncel and L. Onural, "Utilization of the recursive shortest spanning tree algorithm for video-object segmentation by 2-D affine motion modeling," IEEE Trans. Circuits and Systems for Video Technology, vol. 10, no. 5, pp. 776-781, 2000.
18. H. Gao, W.-C. Siu, and C.-H. Hou, "Improved techniques for automatic image segmentation," IEEE Trans. Circuits and Systems for Video Technology, vol. 11, no. 12, pp. 1273-1280, 2001.
19. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, 2000.
20. D. Comaniciu and P. Meer, "Mean shift: a robust approach toward feature space analysis," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, 2002.
21. M. R. Naphade, T. Kristjansson, B. Frey, and T. S. Huang, "Probabilistic multimedia objects (multijects): a novel approach to video indexing and retrieval in multimedia systems," in Proc. IEEE International Conference on Image Processing, vol. 3, pp. 536-540, Chicago, Ill, USA, October 1998.
22. Y. Lu, C. Hu, X. Zhu, H. Zhang, and Q. Yang, "A unified framework for semantics and feature based relevance feedback in image retrieval systems," in Proc. 8th ACM Multimedia, pp. 31-37, Los Angeles, Calif, USA, October-November 2000.
23. X. S. Zhou and T. S. Huang, "Unifying keywords and visual contents in image retrieval," IEEE Multimedia, vol. 9, no. 2, pp. 23-33, 2002.
24. A. Yoshitaka and T. Ichikawa, "A survey on content-based retrieval for multimedia databases," IEEE Trans. Knowledge and Data Engineering, vol. 11, no. 1, pp. 81-93, 1999.
25. W. Al-Khatib, Y. F. Day, A. Ghafoor, and P. B. Berra, "Semantic modeling and knowledge representation in multimedia databases," IEEE Trans. Knowledge and Data Engineering, vol. 11, no. 1, pp. 64-80, 1999.
26. G. Tsechpenakis, G. Akrivas, G. Andreou, G. Stamou, and S. Kollias, "Knowledge-assisted video analysis and object detection," in Proc. European Symposium on Intelligent Technologies, Hybrid Systems and Their Implementation on Smart Adaptive Systems, Algarve, Portugal, September 2002.
27. Y. Rui, T. S. Huang, M. Ortega, and S. Mehrotra, "Relevance feedback: a power tool for interactive content-based image retrieval," IEEE Trans. Circuits and Systems for Video Technology, vol. 8, no. 5, pp. 644-655, 1998.
28. N. D. Doulamis, A. D. Doulamis, and S. D. Kollias, "Nonlinear relevance feedback: improving the performance of content-based retrieval systems," in Proc. IEEE International Conference on Multimedia and Expo, vol. 1, pp. 331-334, New York, NY, USA, August 2000.
29. V. Kashyap, K. Shah, and A. P. Sheth, "Metadata for building the multimedia patch quilt," in Multimedia Database Systems: Issues and Research Directions, pp. 297-319, Springer-Verlag, New York, NY, USA, 1995.
30. B. Chandrasekaran, J. R. Josephson, and V. R. Benjamins, "What are ontologies, and why do we need them?," IEEE Intelligent Systems, vol. 14, no. 1, pp. 20-26, 1999.
31. S. Staab, R. Studer, H.-P. Schnurr, and Y. Sure, "Knowledge processes and ontologies," IEEE Intelligent Systems, vol. 16, no. 1, pp. 26-34, 2001.
32. P. Martin and P. W. Eklund, "Knowledge retrieval and the World Wide Web," IEEE Intelligent Systems, vol. 15, no. 3, pp. 18-25, 2000.
33. A. Raouzaiou, N. Tsapatsoulis, V. Tzouvaras, G. Stamou, and S. D. Kollias, "A hybrid intelligence system for facial expression recognition," in Proc. European Symposium on Intelligent Technologies, Hybrid Systems and Their Implementation on Smart Adaptive Systems, Algarve, Portugal, September 2002.
34. J. McQueen, "Some methods for classification and analyis of multivariate observations," in Proc. 5th Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281-296, Berkeley, Calif, USA, 1967.
35. I. Kompatsiaris and M. G. Strintzis, "Spatiotemporal segmentation and tracking of objects for visualization of videoconference image sequences," IEEE Trans. Circuits and Systems for Video Technology, vol. 10, no. 8, pp. 1388-1402, 2000.
36. N. V. Boulgouris, I. Kompatsiaris, V. Mezaris, and M. G. Strintzis, "Content-based watermarking for indexing using robust segmentation," in Proc. 3rd European Workshop on Image Analysis For Multimedia Interactive Services, Tampere, Finland, May 2001.
37. V. Mezaris, I. Kompatsiaris, and M. G. Strintzis, "A framework for the efficient segmentation of large-format color images," in Proc. IEEE International Conference on Image Processing, vol. 1, pp. 761-764, Rochester, NY, USA, September 2002.
38. S. Liapis, E. Sifakis, and G. Tziritas, "Color and/or texture segmentation using deterministic relaxation and fast marching algorithms," in Proc. IEEE 15th International Conference on Pattern Recognition, vol. 3, pp. 621-624, Barcelona, Spain, September 2000.
39. M. Unser, "Texture classification and segmentation using wavelet frames," IEEE Trans. Image Processing, vol. 4, no. 11, pp. 1549-1560, 1995.
40. J. T. Tou and R. C. Gonzalez, Pattern Recognition Principles, Addison-Wesley, Reading, Mass, USA, 1974.
41. R. Jain, R. Kasturi, and B. G. Schunck, Machine Vision, McGraw Hill, New York, NY, USA, 1995.
42. A. T. Schreiber, B. Dubbeldam, J. Wielemaker, and B. Wielinga, "Ontology-based photo annotation," IEEE Intelligent Systems, vol. 16, no. 3, pp. 66-74, 2001.
43. E. Bozsak, M. Ehrig, S. Handschuh, et al., "KAON - towards a large scale semantic web," in Proc. 3rd International Conference on E-Commerce and Web Technologies, pp. 304-313, Aixen-Provence, France, September 2002.
44. G.-D. Guo, A. K. Jain, W.-Y. Ma, and H.-J. Zhang, "Learning similarity measure for natural image retrieval with relevance feedback," IEEE Transactions on Neural Networks, vol. 13, no. 4, pp. 811-820, 2002.
45. V. N. Vapnik, Statistical Learning Theory, John Wiley & Sons, New York, NY, USA, 1998.
46. C.-C. Chang and C.-J. Lin, "LIBSVM: a library for support vector machines," 2001, http://www.csie.ntu.edu.tw/~cjlin/libsvm.
47. X. Marichal, P. Villegas, and A. Salcedo, "Objective evaluation of segmentation masks in video sequences," in Proc. Workshop on Image Analysis for Multimedia Interactive Services, pp. 85-88, Berlin, Germany, May 1999.
48. M. Swain and D. Ballard, "Color indexing," International Journal of Computer Vision, vol. 7, no. 1, pp. 11-32, 1991.