On the efficient evaluation of probabilistic similarity functions for image retrieval

IEEE Transactions on Information Theory

Volumn 50, Issue 7, 2004, Pages 1482-1496

  Vasconcelos, Nuno ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Bayes classifier; Gauss mixture (GM); Image databases; Kullback Leibler (KL) divergence; Maximum a posteriori probability (MAP) similarity; Probabilistic image retrieval; Vector quantizer (VQ)

Indexed keywords

ASYMPTOTIC STABILITY; COMPUTATIONAL COMPLEXITY; MATHEMATICAL MODELS; PROBABILITY; VECTOR QUANTIZATION;

BAYER CLASSIFIER; GAUSS MIXTURE; PROBABILISTIC IMAGE RETRIEVAL;

IMAGE RETRIEVAL;

EID: 3042623400     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2004.830760     Document Type: Article

References (66)

1. J. Bach, "The virage image search engine: An open framework for image management," in Proc. SPIE Storage and Retrieval for Image and Video Databases, San Jose, CA, 1996.
2. S. Belongie, J. Malik, and J. Puzicha, "Matching shapes," in Proc. Int. Conf. Computer Vision, Vancouver, BC, Canada, 2001.
3. D. Bertsekas, Nonlinear Programming. Cambridge, MA: Athena Scientific, 1995.
4. J. De Bonet and P. Viola, "Structure driven image database retrieval," in Proc. Neural Information Processing Systems, vol. 10, Denver, CO, 1997.
5. J. De Bonet, P. Viola, and J. Fisher, "Flexible histograms: A multiresolution target discrimination model," in Proceedings of SPIE, vol. 3370-12, E. G. Zelnio, Ed., 1998.
6. C. Carson, S. Belongie, H. Greenspan, and J. Malik, "Blobworld: Color and texture-based image segmentation using EM and its application to image querying and classification," IEEE Trans. Pattern Anal. Machine Intell., no. 24, pp. 1026-1038, Aug. 2002.
7. A. Dempster, N. Laird, and D. Rubin, "Maximum-likelihood from incomplete data via the EM algorithm," J. Roy. Statist. Soc., vol. B-39, 1977.
8. L. Devroye, L. Gyorfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition. New York: Springer-Verlag, 1996.
9. M. Do and M. Vetterli, "Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance," IEEE Trans. Image Processing, vol. 11, pp. 146-158, Feb. 2002.
10. A. Drake, Fundamentals of Applied Probability Theory. New York: McGraw-Hill, 1987.
11. R. Duda, P. Hart, and D. Stork, Pattern Classification. New York: Wiley, 2001.
12. J. Foote, M. Cooper, and U. Nam, "Audio retrieval by rhythmic similarity," in Proc. 3rd Int. Symp. Musical Information Retrieval, Paris, France, 2002.
13. K. Fukunaga, Introduction to Statistical Pattern Recognition. San Diego, CA: Academic, 1990.
14. A. Gersho and R. Gray, Vector Quantization and Signal Compression. Boston: Kluwer, 1992.
15. R. Gray, Probability, Random Processes, and Ergodic Properties. New York: Springer-Verlag, 1988.
16. R. Gray, D. Neuhoff, and P. Shields, "A generalization of Ornstein's d-bar distance with applications to information theory," Ann. Probab., vol. 3, pp. 315-328, 1975.
17. R. Gray, J. Young, and A. Aiyer, "Minimum discrimination information clustering: Modeling and quantization with Gauss mixtures," in Proc. IEEE Int. Conf. Image Processing, Thesaloniki, Greece, 2001.
18. R. Gray, A. Gray, G. Rebolledo, and J. Shore, "Rate-distortion speech coding with a minimum discrimination information distortion measure," IEEE Trans. Inform. Theory, vol. IT-27, pp. 708-721, Nov. 1981.
19. J. Hafner, H. Sawhney, W. Equitz, M. Flickner, and W. Niblack, "Efficient color histogram indexing for quadratic form distance functions," IEEE Trans. Pattern. Anal. Machine Intell., vol. 17, pp. 729-736, July 1995.
20. J. Huang, S. Kumar, M. Mitra, W. Zhu, and R. Zabih, "Spatial color indexing and applications," Int. J. Computer Vision, vol. 35, pp. 245-268, Dec. 1999.
21. F. Itakura and S. Saito, "A statistical method for estimation of speech spectral density and format frequencies," Electron. Commun. Japan, vol. 53-A, pp. 36-43, 1970.
22. G. Iyengar and A. Lippman, "Clustering images using relative entropy for efficient retrieval," in Proc. Int. Workshop on Very Low Bitrate Video Coding, Urbana, IL, 1998. 1998.
23. A. Jain and A. Vailaya, "Image retrieval using color and shape," Pattern Recogn. J., vol. 29, pp. 1233-1244, Aug. 1996.
24. F. Jensen, An Introduction to Bayesian Networks. New York: Springer-Verlag, 1996.
25. S. Kullback, Information Theory and Statistics. New York: Dover, 1968.
26. M. Kupperman, "Probabilities of hypothesis and information-statistics in sampling from exponential-class populations," Ann. Math. Statist., vol. 29, pp. 571-574, 1958.
27. V. Levenshtein, "Binary codes capable of correcting deletions, insertions, and reversals," Sov. Phys-Dokl., vol. 10, pp. 707-710, 1966.
28. E. Levina and P. Bickel, "The earth mover's distance is the Mallows distance: Some insights from statistics," in Proc. Int. Conf. Computer Vision, vol. 1, Vancouver, BC, Canada, 2001, pp. 251-256.
29. J. Li and A. Barron, "Mixture density estimation," in Proc. Neural Information Processing Systems, Denver, CO, 1999.
30. F. Liu and R. Picard, "Periodicity, directionality, and randomness: Wold features for image modeling and retrieval," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, pp. 722-733, July 1996.
31. B. Logan and A. Salomon, "A music similarity function based on signal analysis," in Proc. IEEE Int. Conf. Multimedia and Expo., Tokyo, Japan, 2001.
32. W. Ma and H. Zhang, "Benchmarking of image features for content-based retrieval," in Proc. 32nd Asilomar Conf. Signals, Systems, and Computers, Asilomar, CA, 1998. Asilomar, CA, 1998.
33. C. Mallows, "A note on asymptotic joint normality," Ann. Math. Statist., vol. 43, pp. 508-515, 1972.
34. B. Manjunath and W. Ma, "Texture features for browsing and retrieval of image data," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, pp. 837-842, Aug. 1996.
35. J. Mao and A. Jain, "Texture classification and segmentation using multiresolution simultaneous autoregressive models," Pattern Recogn., vol. 25, no. 2, pp. 173-188, 1992.
36. G. McLean, "Vector quantization for texture classification," IEEE Trans. Syst., Man, Cybern., vol. 23, pp. 637-649, May/June 1993.
37. H. Neemuchwala, A. Hero, and P. Carson, "Feature coincidence trees for registration of ultrasound breast images," in Proc. IEEE Int. Conf. Image Processing, Thessaloniki, Greece, 2001
38. W. Niblack, R. Barber, W. Equitz, M. Flickner, E. Glasman, D. Pektovic, P. Yanker, C. Faloutsos, and G. Taubin, "The QBIC project: Querying images by content using color, texture, and shape," in Proc. SPIE Storage and Retrieval for Image and Video Databases, San Jose, CA, 1993 pp. 173-181.
39. D. Ornstein, "An application of ergodic theory to probability theory," Ann. Probab., vol. 1, pp. 43-58, 1973.
40. A. Papoulis, The Fourier Integral and its Applications New York: McGraw-Hill, 1962.
41. W. Pennebaker and J. Mitchell, JPEG: Still Image Data Compression Standard New York: Van Nostrand Reinhold, 1993.
42. A. Pentland, R. Picard, and S. Sclaroff, "Photobook: Content-based manipulation of image databases," Int. J. Computer Vision vol. 18, no. 3, pp. 233-254, June 1996.
43. R. Picard, "Light-years from Lena: Video and image libraries of the future," in Proc. Int. Conf. Image Processing, Washington, DC, Oct. 1995
44. R. Picard, T. Kabir, and F. Liu, "Real-time recognition with the entire Brodatz texture database," in Proc. IEEE Conf. Computer Vision, New York, 1993
45. J. Puzicha, Y. Rubner, C. Tomasi, and J. Buhmann, "Empirical evaluation of dissimilarity measures for color and texture," in Proc. Int. Conf. Computer Vision, Korfu, Greece, 1999 pp. 1165-1173.
46. L. Rabiner and B. Juang, Fundamentals of Speech Recognition Englewood Cliffs, NJ: Prentice-Hall, 1993.
47. Y. Rubner, C. Tomasi, and L. Guibas, "A metric for distributions with applications to image databases," in Proc. Int. Conf. Computer Vision, Bombay, India, 1998
48. Y. Rui, T. Huang, M. Ortega, and S. Mehrotra, "Relevance feedback: A power tool for interactive content-based image retrieval," IEEE Trans. Circuits Syst. Video Technology vol. 8, pp. 644-655, Sept. 1998.
49. A. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval: The end of the early years," IEEE Trans. Pattern Anal. Machine Intell., vol. 22, pp. 1349-1380, Dec. 2000.
50. J. Smith, "Integrated spatial and feature image systems: retrieval, compression and analysis," Ph.D. dissertation, Columbia Univ., New York, 1997.
51. J. Smith and S. Chang, "VisualSEEk: A fully automated content-based image query system," in Proc. ACM Multimedia, Boston, MA, 1996 pp. 87-98.
52. M. Stricker and A. Dimai, "Color indexing with weak spatial constraints," in SPIE Storage and Retrieval for Image and Video Databases vol. 2670, San Jose, CA, 1996, pp. 29-40.
53. M. Stricker and M. Orengo, "Similarity of color images," in SPIE Storage and Retrieval for Image and Video Databases, San Jose, CA, 1995
54. M. Stricker and M. Swain, "The capacity of color histogram indexing," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 1994 pp. 704-708.
55. M. Swain and D. Ballard, "Color indexing," Int. J. Computer Vision vol. 7, no. 1, pp. 11-32, 1991.
56. D. Titterington, A. Smith, and U. Makov, Statistical Analysis of Finite Mixture Distributions New York: Wiley, 1985.
57. H. Van Trees, Detection, Estimation, and Modulation Theory New York: Wiley, 1968.
58. K. Valkealahti and E. Oja, "Reduced multidimensional co-occurrence histograms in texture classification," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 90-94, Jan. 1998.
59. S. Vallender, "Calculation of the Wasserstein distance between probability distributions on the line," Theory Probab. Appl., vol. 18, pp. 824-827, 1973.
60. N. Vasconcelos, "Bayesian models for visual information retrieval," Ph.D. dissertation, MIT, Cambridge, MA, 2000.
61. ____, "A unified view of image similarity," in Proc. Int. Conf. Pattern Recognition, Barcelona, Spain, 2000
62. N. Vasconcelos and G. Carneiro, "What is the role of independence for visual recognition?," in Proc. Europ. Conf. Computer Vision, Copenhagen, Denmark, 2002
63. N. Vasconcelos and M. Kunt, "Content-based retrieval from image databases: Current solutions and future directions," in Proc. Int. Conf. Image Processing, Thessaloniki, Greece, 2001
64. N. Vasconcelos and M. Kunt, "Content-based retrieval from image databases: Current solutions and future directions," in Proc. Int. Conf. Image Processing, Thessaloniki, Greece, 2001
65. N. Vasconcelos and A. Lippman, "A probabilistic architecture for content-based image retrieval," in Proc. IEEE Computer Vision and Pattern Recognition Conf., Hilton Head, NC, 2000
66. L. Wasserstein, "Markov processes with countable state space describing large systems of automata," Probl. Pered. Inform., vol. 5, no. 3, pp. 64-73, 1969.