Adaptive image retrieval based on the spatial organization of colors

Computer Vision and Image Understanding

Volumn 112, Issue 2, 2008, Pages 101-113

  Hurtut, Thomas ^a,b   Gousseau, Yann ^a   Schmitt, Francis ^a  

^a INSTITUT TELECOM   (France)

^b ÉCOLE POLYTECHNIQUE DE MONTRÉAL   (Canada)

Author keywords

A contrario method; Color image retrieval; Dead leaves model; Earth Mover's Distance; Image distance; Optimal transport; Spatial organization of colors

Indexed keywords

COLOR; DATABASE SYSTEMS; GLOBAL OPTIMIZATION; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; OPTICAL PROPERTIES;

A CONTRARIO METHOD; COLOR IMAGE RETRIEVAL; DEAD LEAVES MODEL; EARTH MOVER'S DISTANCE; IMAGE DISTANCE; OPTIMAL TRANSPORT; SPATIAL ORGANIZATION OF COLORS;

IMAGE RETRIEVAL;

EID: 54249162267     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2007.12.006     Document Type: Article

References (57)

1. Alvarez L., Gousseau Y., and Morel J.-M. The size of objects in natural and artificial images. Advances in Imaging and Electron Physics vol. 111 (1999), Academic Press pp. 167-242
2. M. Anderson, R. Motta, S. Chandrasekar, M. Stokes, Proposal for a standard default color space for the Internet-sRGB, in: Proceedings, IS&T/SID Fourth Color Imaging Conference: Color Science, Systems, and Applications, 1996, pp. 238-246.
3. I. Assent, A. Wenning, T. Seidl, Approximation techniques for indexing the earth mover's distance in multimedia databases, in: Proceedings of the 22nd International Conference on Data Engineering (ICDE'06), 2006.
4. Berretti S., Del Bimbo A., and Vicario E. Weighted walkthroughs between extended entities for retrieval by spatial arrangement. Multimedia, IEEE Transactions on 5 1 (2003) 52-70
5. Del Bimbo A. Visual Information Retrieval (1999), Morgan Kufman Publishers
6. Bordenave C., Gousseau Y., and Roueff F. The dead leaves model: a general tessellation modeling occlusion. Advances in Applied Probability 38 1 (2006) 31-46
7. Burford B., Briggs P., and Eakins J.P. A taxonomy of the image: on the classification of content for image retrieval. Visual Communication 2 2 (2003) 123
8. Burkard R.E., and Çela E. Linear Assignment Problems and Extensions (1998), Karl-Franzens-Univ. Graz Techn. Univ. Graz
9. R.E. Burkard, M. Dell'Amico, S. Martello, Assignment Problems. SIAM Monographs on Discrete Mathematics and Applications, in preparation.
10. Carson C., Belongie S., Greenspan H., and Malik J. Blobworld: image segmentation using EM and its application to image querying. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 24 8 (2002) 1026-1038
11. Chang S.K., Shi Q.Y., and Yan C.W. Iconic indexing by 2-D strings. IEEE Transactions on Pattern Analysis and Machine Intelligence 9 3 (1987) 413-428
12. Chen H. An analysis of image retrieval tasks in the field of art history. Information Processing and Management 37 5 (2001) 701-720
13. G. Ciocca, R. Schettini, L. Cinque, Image indexing and retrieval using spatial chromatic histograms and signatures, CGIV, 2002, pp. 255-258.
14. Conniss L.R., Ashford A.J., and Graham M.E. Information Seeking Behaviour in Image Retrieval VISOR I Final Report (2000), Institute for Image Data Research, University of Northumbria, Newcastle
15. Desolneux A., Moisan L., and Morel J.-M. Meaningful alignments. International Journal of Computer Vision 40 (2000) 7-23
16. A. Desolneux, L. Moisan, J.-M. Morel, From gestalt theory to image analysis: a probabilistic approach, in: Interdisciplinary Applied Mathematics, vol. 34, Springer-Verlag, Berlin, 2008, 275pp., ISBN: 978-0-387-72635-9.
17. Desolneux A., Moisan L., and Morel J.M. Edge detection by Helmholtz principle. International Journal of Computer Vision 14 (2001) 271-284
18. G. Dvir, H. Greenspan, Y. Rubner, Context-based image modelling, ICPR, 2002, pp. 162-165.
19. G. Dvir, H. Greenspan, Y. Rubner, Context-based image modelling, in: Proceedings of the Internatinal Conference ICPR2002, 2002, pp. 162-165.
20. Eakins J.P., Briggs P., and Burford B. Image retrieval interfaces: a user perspective. Proceedings of the Third International Conference on Image and Video Retrieval (2004), Springer-Verlag, Heidelberg, Dublin, Ireland pp. 628-637
21. Y. Fang, D. Geman, N. Boujemaa, An interactive system for mental face retrieval, in: Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR'05), 2005.
22. Ford L.R., and Fulkerson D.R. Solving the transportation problem. Management Science 3 (1956) 24-32
23. Y. Gousseau, Comparaison de la composition de deux images, et application a la recherche automatique, in: Proceedings of GRETSI 2003, Paris, France, 2003.
24. Gousseau Y., and Roueff F. Modeling occlusion and scaling in natural images. SIAM Multiscale Modeling and Simulations 6 1 (2007) 105-134
25. Grimson W.E.L., and Huttenlocher D.P. On the verification of hypothesized matches in model-based recognition. Pattern Analysis and Machine Intelligence, IEEE Transactions on 13 12 (1991) 1201-1213
26. Heidemann G. Combining spatial and colour information for content based image retrieval. Computer Vision and Image Understanding 94 (2004) 234-270
27. W. Hsu, T.S. Chua, H.K. Phung, An integrated color-spatial approach to color image retrieval, in: Proceedings of the 3rd ACM Multimedia Conference, 1995, pp. 305-313.
28. Huang J., Kumar S.R., Mitra M., Zhu W.J., and Zabih R. Spatial color indexing and applications. International Journal of Computer Vision 35 3 (1999) 245-268
29. T. Hurtut, More results web page. Available from: .
30. T. Hurtut, F. Cheriet, M. Chronopoulos, A novel collaborative website and artworks database management system for artist-run centres, in: International Cultural Heritage Informatics (ICHIM), October, 2007.
31. T. Hurtut, H. Dalazoana, Y. Gousseau, F. Schmitt, Spatial color image retrieval without segmentation using thumbnails and the earth mover's distance, CGIV, Leeds, England, June, 2006.
32. P. Indyk, N. Thaper, Fast image retrieval via embeddings, in: Proceedings of the 3rd International Workshop on Statistical and Computational Theories of Vision, 2003.
33. Jing F., Li M., Zhang H.J., and Zhang B. An effective region-based image retrieval framework. IEEE Transactions on Image Processing 13 5 (2004) 699-709
34. Kuhn H.W. The hungarian method for the assignment problem. Naval Research Logistics Quarterly 2 (1955) 83-97
35. P. Lambert, N. Hervey, H. Grecu, Image retrieval using spatial chromatic histograms, CGIV, 2004, pp. 343-347.
36. Lee A., Mumford D., and Huang J. Occlusion models for natural images: a statistical study of a scale invariant dead leaves model. International Journal of Computer Vision 41 (2001) 35-59
37. E. Levina, P. Bickel, The earth mover's distance is the Mallows distance: some insights from statistics, in: Proceedings of the ICCV, vol. 2, 2001, pp. 251-256.
38. In: Lew M.S. (Ed). Principles of Visual Information Retrieval (2001), Springer, Berlin
39. Lindenbaum M. An integrated model for evaluating the amount of data required for reliable recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 19 11 (1997) 1251-1264
40. Ling H., and Okada K. An efficient earth mover's distance algorithm for robust histogram comparison. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 29 5 (2007) 840-853
41. Lipson P., Grimson E., and Sinha P. Configuration based scene classification and image indexing. IEEE Proceedings of the Computer Vision on Pattern Recognition (1997) 1007-1013
42. Y. Liu, D. Zhang, G. Lu, W.-Y. Ma, Region-based image retrieval with high-level semantic color names, in: IEEE International Multimedia Modelling Conference, 2005, pp. 180-187.
43. G. Matheron, Modèle séquentiel de partition aléatoire, Technical report, CMM, 1968.
44. P.A. Moellic, P. Hede, G. Grefenstette, C. Millet, Evaluating content based image retrieval techniques with the one million images CLIC testbed, in: Proceedings of the PRCV, 2005.
45. Musé P., Sur F., Cao F., Gousseau Y., and Morel J.-M. An a contrario decision method for shape element recognition. International Journal of Computer Vision 69 3 (2006) 295-315
46. Pass G., and Zabih R. Comparing images using joint histograms. Journal of Multimedia Systems 7 3 (1999) 234-240
47. Prasad B.G., Biswas K.K., and Gupta S.K. Region-based image retrieval using integrated color, shape, and location index. Computer Vision and Image Understanding 94 (2004) 193-233
48. Rubner Y., Tomasi C., and Guibas L.J. The earth mover's distance as a metric for image retrieval. International Journal of Computer Vision 40 2 (2000) 99-121
49. J.D. Rugna, H. Konik, Color coarse segmentation and regions selection for similar images retrieval, CGIV, 2002, pp. 241-244.
50. S. Siggelkow, H. Burkhardt, Improvement of histogram-based image retrieval and classification, in: IAPR International Conference on Pattern Recognition, vol. 3, 2002, pp. 367-370.
51. J.R. Smith, S.F. Chang, Tools and techniques for color image retrieval, in: Proceedings of SPIE Storage and Retrieval for Image and Video Databases IV, vol. 2670, 1996, pp. 1630-1639.
52. Smith J.R., and Li C.-S. Image classification and querying using composite region templates. Computer Vision and Image Understanding 75 1/2 (1999) 165-174
53. M. Stricker and A. Dimai, Color indexing with weak spatial constraints, in: Proceedings of SPIE Storage and Retrieval for Image and Video Databases IV, 1996, pp. 29-40.
54. Swain M.J., and Ballard D.H. Color indexing. International Journal on Computer Vision 7 1 (1991) 11-32
55. J. van de Weijer, C. Schmid, Coloring local feature extraction, in: European Conference on Computer Vision, 2006.
56. Wang J.Z., Li J., and Wiederhold G. Simplicity: semantic-sensitive integrated matching for picture libraries. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 23 9 (2001)
57. G. Wyszecki, W.S. Stiles, Color science: concepts and methods, quantitative data and formulae, second ed., in: G. Wyszecki, W.S. Stiles (Eds.), Color Science: Concepts and Methods, Quantitative Data and Formulae, 2000.