Combining spatial and colour information for content based image retrieval

Computer Vision and Image Understanding

Volumn 94, Issue 1-3, 2004, Pages 234-270

  Heidemann, Gunther ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

Colour features; Image indexing; Image retrieval; Local PCA; Neural networks; Object recognition; Salient points; System feedback; Unsupervised learning; Vector quantisation

Indexed keywords

COLOR IMAGE PROCESSING; DATABASE SYSTEMS; EDGE DETECTION; NEURAL NETWORKS; OBJECT RECOGNITION; PRINCIPAL COMPONENT ANALYSIS; PROJECTION SCREENS; SYSTEMS ANALYSIS; VECTOR QUANTIZATION;

COLOR FEATURES; IMAGE INDEXING; SALIENT POINTS; SYSTEM FEEDBACK; UNSUPERVISED LEARNING;

CONTENT BASED RETRIEVAL;

EID: 2342462980     PISSN: 10773142     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cviu.2003.10.009     Document Type: Article

References (74)

1. C. Faloutsos, R. Barber, M. Flickner, J. Hafner, W. Niblack, D. Petkovic, W. Equitz, Efficient and effective querying by image content, J. Intell. Inf. Syst. 3 (3) (1994) 231-262.
2. J.R. Smith, S.-F. Chang, VisualSEEK: a fully automated content-based image query system, Proc. ACM Multimedia 96 (1996) 87-98.
3. A. Pentland, R.W. Picard, S. Sclaroff, Photobook: content-based manipulation for image databases, Int. J. Comput. Vision 18 (1996) 233-254.
4. A. Gupta, R. Jain, Visual information retrieval, Commun. ACM 40 (5) (1997) 70-79.
5. C. Carson, M. Thomas, S. Belongie, J.M. Hellerstein, J. Malik, Blobworld: a system for region-based image indexing and retrieval, Proc. Visual Inf. Syst. (1999) 509-516.
6. T. Gevers, A.W.M. Smeulders, PicToSeek: combining color and shape invariant features for image retrieval, IEEE Trans. Image Process. 9 (1) (2000) 102-119.
7. J.Z. Wang, J. Li, G. Wiederhold, SIMPLIcity: semantics-sensitive integrated matching for picture libraries, IEEE Trans. Pattern Anal. Mach. Intell. 23 (9) (2001) 947-963.
8. I. Jolliffe, Principal Component Analysis, Springer Verlag, New York, 1986.
9. M. Turk, A. Pentland, Eigenfaces for recognition, J. Cognitive Neurosci. 3 (1991) 71-86.
10. N. Kambhatla, T.K. Leen, Fast non-linear dimension reduction, in: J. Cowan, G. Tesauro, J. Alspector (Eds.), Advances in Neural Information Processing Systems 1993, vol. 6, Morgan Kaufmann Publishers, 1994, pp. 152-159.
11. C. Bregler, S.M. Omohundro, Surface learning with applications to lipreading, in: J. Cowan, G. Tesauro, J. Alspector (Eds.), Advances in Neural Information Processing Systems 1993, vol. 6, Morgan-Kaufmann Publishers, 1994, pp. 43-50.
12. N. Kambhatla, T.K. Leen, Dimension reduction by local principal component analysis, Neural Comput. 9 (7) (1997) 1493-1516.
13. C. Bregler, S.M. Omohundro, Nonlinear image interpolation using manifold learning, in: G. Tesauro, D. Touretzky, T. Leen (Eds.), Advances in Neural Information Processing Systems 1994, vol. 7, MIT Press, 1995.
14. R.D. Dony, S. Haykin, Optimally adaptive transform coding, IEEE Trans. Image Process. 4 (10) (1995) 1358-1370.
15. G.E. Hinton, M. Revow, P. Dayan, Recognizing handwritten digits using mixtures of linear models, in: G. Tesauro, D. Touretzky, T. Leen (Eds.), Advances in Neural Information Processing Systems 1994, vol. 7, MIT Press, 1995, pp. 1015-1022.
16. T. Hastie, P. Simard, E. Sackinger, Learning prototype models for tangent distance, in: G. Tesauro, D. Touretzky, T. Leen (Eds.), Advances in Neural Information Processing Systems 1994, vol. 7, MIT Press, 1995, pp. 999-1006.
17. G.E. Hinton, P. Dayan, M. Revow, Modelling the manifolds of images of handwritten digits, IEEE Trans. Neural Networks 8 (1) (1997) 65-74.
18. B. Moghaddam, A. Pentland, Probabilistic visual learning for object representation, IEEE Trans. Pattern Anal. Mach. Intell. 19 (7) (1997) 696-710.
19. M.E. Tipping, C.M. Bishop, Mixtures of probabilistic principal component analyzers, Neural Comput. 11 (2) (1999) 443-482.
20. H. Murase, S.K. Nayar, Visual learning and recognition of 3-D objects from appearance, Int. J. Comput. Vision 14 (1995) 5-24.
21. S. Nayar, H. Murase, S. Nene, General learning algorithm for robot vision, in: Neural & Stochastic Methods in Image & Signal Processing, vol. 2304, SPIE, July (1994).
22. G. Heidemann, H. Ritter, Combining multiple neural nets for visual feature selection and classification, in: ICANN 99, Ninth Internat. Conf. on Artificial Neural Networks, IEE, London, 1999, pp. 365-370.
23. G. Heidemann, D. Lücke, H. Ritter, A system for various visual classification tasks based on neural networks, in: A. Sanfeliu et al. (Ed.), Proc. 15th Internat. Conf. on Pattern Recognition ICPR 2000, Barcelona, vol. I, 2000, pp. 9-12.
24. G. Heidemann, H. Ritter, Combining gestural and contact information for visual guidance of multifinger grasps, in: M. Verleysen (Ed.), Proc. ESANN 02, d-side publications, Bruges, Belgium, 2002, pp. 301-306.
25. G. Heidemann, H. Ritter, Visual checking of grasping positions of a three-fingered robot hand, in: G. Dorffner, H. Bischof, K. Hornik (Eds.), Proc. ICANN 2001, Springer-Verlag, 2001, pp. 891-898.
26. M. Swain, D. Ballard, Color indexing, Int. J. Comput. Vision 7 (1) (1991) 11-32.
27. B.V. Funt, G.D. Finlayson, Color constant color indexing, IEEE Trans. Pattern Anal. Mach. Intell. 17 (5) (1995) 522-529.
28. J.R. Smith, S.-F. Chang, Tools and techniques for color image retrieval, in: Storage and Retrieval for Image and Video Databases (SPIE), 1996, pp. 426-437.
29. M.A. Stricker, M. Orengo, Similarity of color images, in: Proc. SPIE Storage and Retrieval for Image and Video Databases, 1995, pp. 381-392.
30. A. Mojsilovic, J. Kovacevic, J. Hu, R.J. Safranek, S.K. Ganapathy, Matching and retrieval based on the vocabulary and grammar of color patterns, IEEE Trans. Image Process. 9 (1) (2000) 38-54.
31. M. Stricker, A. Dimai, Spectral covariance and fuzzy regions for image indexing, Mach. Vision Appl. 10 (2) (1997) 66-73.
32. S.X. Zhou, Y. Rui, T.S. Huang, Water-filling algorithm: a novel way for image feature extraction based on edge maps. in: Proc. IEEE Internat. Conf. on Image Processing, Japan, 1999.
33. A. del Bimbo, P. Pala, Visual image retrieval by elastic matching of user sketches, IEEE Trans. Pattern Anal. Mach. Intell. 19 (2) (1997) 121-132.
34. C. Schmid, R. Mohr, Local Grayvalue invariants for image retrieval, IEEE Trans. Pattern Anal. Mach. Intell. 19 (5) (1997) 530-535.
35. T. Tuytelaars, L. van Gool, Content-based image retrieval based on local affinely invariant regions, in: 3rd Internat. Conf. on Visual Information Systems, Visual'99, Amsterdam, The Netherlands, 1999, pp. 493-500.
36. B.M. Mehtre, M.S. Kankanhalli, W.F. Lee, Shape measures for content based image retrieval: a comparison, Inf. Process. Manage. 33 (3) (1997) 319-337.
37. A.W.M. Smeulders, M. Worring, S. Santini, A. Gupta, R. Jain, Content-based image retrieval at the end of the early years, IEEE Trans. Pattern Anal. Mach. Intell. 22 (12) (2000) 1349-1380.
38. T. Gevers, A.W.M. Smeulders, Content-based image retrieval by viewpoint-invariant color indexing, Image Vision Comput. 17 (7) (1999) 475-488.
39. Q. Tian, N. Sebe, M.S. Lew, E. Loupias, T.S. Huang, Image retrieval using wavelet-based salient points, J. Electron. Imaging 10 (4) (2001) 835-849.
40. S. Mallat, A theory for multiresolution signal decomposition: the wavelet representation, IEEE Trans. Pattern Anal. Mach. Intell. 11 (7) (1989) 674-693.
41. C. Carson, S. Belongie, H. Greenspan, J. Malik, Region-based image querying, in: Proc. Internat. Workshop on Content-Based Access of Image and Video Libraries, San Juan, Puerto Rico, 1997, pp. 42-49.
42. R.W. Picard, T.P. Minka, Vision texture for annotation, Multimedia Syst. 3 (1995) 3-14.
43. A. Hiroike, Y. Musha, A. Sugimoto, Y. Mori, Visualization of information spaces to retrieve and browse image data, in: Proc. Visual '99: Information and Information Systems, 1999, pp. 155-162.
44. J. Tatemura, Browsing images based on social and content similarity, in: Proc. IEEE Internat. Conf. on Multimedia and Expo(III), 2000, pp. 1567-1570.
45. D. Reisfeld, H. Wolfson, Y. Yeshurun, Context-free attentional operators: the generalized symmetry transform, Int. J. Comput. Vision 14 (1995) 119-130.
46. L. Kaufman, W. Richards, Spontaneous fixation tendencies for visual forms, Percept. Psychophys. 5 (2) (1969) 85-88.
47. V. Bruce, M. Morgan, Violation of symmetry and repetition in visual pathways, Perception 4 (1975) 239-249.
48. P.J. Locher, C.F. Nodine, Symmetry catches the eye, in: A. Levy-Schoen, J.K. O'Reagan (Eds.), Eye Movements: From Physiology to Cognition, Elsevier Science Publishers B.V, North Holland, 1987, pp. 353-361.
49. C.M. Privitera, L.W. Stark, Algorithms for defining visual regions-of- interest: comparison with eye fixations, IEEE Trans. Pattern Anal. Mach. Intell. 22 (9) (2000) 970-982.
50. G. Heidemann, Focus of attention from local color symmetries, IEEE Trans. Pattern Anal. Mach. Intell. (2004), to appear.
51. T.W. Nattkemper, Untersuchung und Erweiterung eines Ansatzes zur modellfreien Aufmerksam-keitssteuerung durch lokale Symmetrien in einem Computer Vision System. Master's thesis, Bielefeld Univ., Technische Fakultät, Jan (1997).
52. C. Harris, M. Stephens, A combined corner and edge detector, in: Proc. 4th Alvey Vision Conf., 1988, pp. 147-151.
53. W. Förstner, A framework for low level feature extraction, in: Proc. 3rd European Conf. on Computer Vision, Stockholm, Sweden, 1994, pp. 383-394.
54. C. Tomasi, T. Kanade, Detection and tracking of point features, Technical Report CMU-CS-91-132, Carnegie Mellon University, Pittsburgh, 1991.
55. H.P. Moravec, Towards automatic visual obstacle avoidance, in: Proc. 5th Internat. Joint Conf. on Artificial Intelligence, Cambridge, MA, USA, 1977, pp. 584-587.
56. G. Medioni, Y. Yasumoto, Corner detection and curve representation using cubic B-splines, Comput. Vision Graph. Image Process. 39 (1987) 267-278.
57. R. Horaud, F. Veillon, T. Skordas, Finding geometric and relational structures in an image, in: Proc. 1st European Conf. on Computer Vision, Antibes, France, 1990, pp. 374-384.
58. E. Shilat, M. Werman, Y. Gdalyahu, Ridge's corner detection and correspondence, in: Proc. Conf. on Computer Vision and Pattern Recognition, Puerto Rico, USA, 1997, pp. 976-981.
59. C. Schmid, R. Mohr, C. Bauckhage, Evaluation of interest point detectors, Int. J. Comput. Vision 37 (2) (2000) 151-172.
60. T. Gevers, Color based image retrieval, in: M. Lew (Ed.), Multimedia Search, Springer Verlag, 2001.
61. J. Buhmann, H. Kühnel, Vector quantization with complexity costs, IEEE Trans. Inf. Theory 39 (4) (1993) 1133-1145.
62. T. Kohonen, Learning vector quantization, in: M.A. Arbib (Ed.), The Handbook of Brain Theory and Neural Networks, MIT Press, 1995, pp. 537-540.
63. S. Grossberg, Competitive learning: from interactive activation to adaptive resonance, Cognitive Sci. 11 (1987) 23-63.
64. T. Martinetz, S.G. Berkovich, K. Schulten, Neural-gas network for vector quantization and its application to time-series prediction, IEEE Trans. Neural Networks 4 (4) (1993) 558-569.
65. J.-H. Wang, C.-P. Hsiao, Representation-burden conservation network applied to learning vq, Neural Process. Lett. 5 (3) (1997) 209-217.
66. S.C. Ahalt, A.K. Krisnamurthy, P. Chen, D.E. Melton, Competitive learning algorithms for vector quantization, Neural Networks 3 (1990) 277-290.
67. A.S. Galanopoulos, R.L. Moses, S.C. Ahalt, Diffusion approximation of frequency sensitive competitive learning, IEEE Trans. Neural Networks 8 (5) (1997) 1026-1030.
68. G. Heidemann, H. Ritter, Efficient vector quantization using the WTA-rule with activity equalization, Neural Process. Lett. 13 (1) (2001) 17-30.
69. J. MacQueen, Some methods for classification and analysis of multivariate observations, in: Proc. 5th Berkeley Symp. Math. Stat. Probab., vol. 1, 1965, pp. 281-297.
70. K. Rose, F. Gurewitz, G. Fox, Statistical mechanics and phase transitions in clustering, Phys. Rev. Lett. 65 (8) (1990) 945-948.
71. T.D. Sanger, Optimal unsupervised learning in a single-layer linear feedforward neural network, Neural Networks 2 (1989) 459-473.
72. S. Haykin, Neural Networks, Prentice Hall, New Jersey, 1999.
73. A.S. Householder, The Theory of Matrices in Numerical Analysis, Dover Publications, New York, 1964.
74. S.A. Nene, S.K. Nayar, H. Murase, Columbia Object Image Library: COIL- 100. Technical Report CUCS-006-96, Dept. Computer Science, Columbia Univ., 1996.