Structural texture similarity metrics for image analysis and retrieval

IEEE Transactions on Image Processing

Volumn 22, Issue 7, 2013, Pages 2545-2558

  Zujovic, Jana ^a,b   Pappas, Thrasyvoulos N ^a   Neuhoff, David L ^a  

^a Northwestern University   (United States)

^b FUTUREWEI TECHNOLOGIES   (United States)

Author keywords

Natural textures; perceptual quality; statistical models

Indexed keywords

HUMAN VISUAL PERCEPTION; LOCAL IMAGE STATISTICS; NATURAL TEXTURES; PEAK SIGNAL-TO-NOISE RATIO; PERCEPTUAL QUALITY; STEERABLE FILTER DECOMPOSITION; STRUCTURAL SIMILARITY; TEXTURE CLASSIFICATION;

IMAGE SEGMENTATION; QUERY PROCESSING;

TEXTURES;

ALGORITHM; FACTUAL DATABASE; HUMAN; IMAGE PROCESSING; PROCEDURES; SURFACE PROPERTY; THEORETICAL MODEL; VISION; ARTICLE; METHODOLOGY;

ALGORITHMS; DATABASES, FACTUAL; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MODELS, THEORETICAL; SURFACE PROPERTIES; VISUAL PERCEPTION;

EID: 84877911339     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2013.2251645     Document Type: Article

References (66)

1. M. P. Eckert and A. P. Bradley, "Perceptual quality metrics applied to still image compression," Signal Process., vol. 70, no. 3, pp. 177-200, Nov. 1998. (Pubitemid 128418935)
2. T. N. Pappas, R. J. Safranek, and J. Chen, "Perceptual criteria for image quality evaluation," in Handbook of Image and Video Processing, 2nd ed., A. C. Bovik, Ed. San Diego, CA, USA: Academic, 2005, pp. 939-959.
3. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
4. Z. Wang and E. P. Simoncelli, "Translation insensitive image similarity in complex wavelet domain," in Proc. IEEE Int. Conf. Acoust. Speech, Signal Process., vol. 2. Philadelphia, PA, USA, Mar. 2005, pp. 573-576.
5. X. Zhao, M. G. Reyes, T. N. Pappas, and D. L. Neuhoff, "Structural texture similarity metrics for retrieval applications," in Proc. 15th IEEE Int. Conf. Image Process., San Diego, CA, USA, Oct. 2008, pp. 1196-1199.
6. J. Zujovic, T. N. Pappas, and D. L. Neuhoff, "Structural similarity metrics for texture analysis and retrieval," in Proc. 16th IEEE Int. Conf. Image Process., Nov. 2009, pp. 2225-2228.
7. D. Cano and T. H. Minh, "Texture synthesis using hierarchical linear transforms," Signal Process., vol. 15, no. 2, pp. 131-148, Sep. 1988.
8. M. Porat and Y. Y. Zeevi, "Localized texture processing in vision: Analysis and synthesis in Gaborian space," IEEE Trans. Biomed. Eng., vol. 36, no. 1, pp. 115-129, Jan. 1989. (Pubitemid 19060689)
9. K. Popat and R. W. Picard, "Novel cluster-based probability model for texture synthesis, classification, and compression," Proc. SPIE, vol. 2094, pp. 756-768, Nov. 1993.
10. D. J. Heeger and J. R. Bergen, "Pyramid-based texture analysis/synthesis," in Proc. Int. Conf. Image Process., vol. 3. Washington, DC, USA, Oct. 1995, pp. 648-651.
11. J. Portilla and E. P. Simoncelli, "A parametric texture model based on joint statictics of complex wavelet coefficients," Int. J. Comput. Vis., vol. 40, no. 1, pp. 49-71, Oct. 2000. (Pubitemid 32083683)
12. E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, "Shiftable multi-scale transforms," IEEE Trans. Inf. Theory, vol. 38, no. 2, pp. 587-607, Mar. 1992.
13. G. Jin, Y. Zhai, T. N. Pappas, and D. L. Neuhoff, "Matched-texture coding for structurally lossless compression," in Proc. Int. Conf. Image Process., Orlando, FL, USA, Oct. 2012, pp. 1065-1068.
14. C. T. Meadow, B. R. Boyce, D. H. Kraft, and C. Barry, Text Information Retrieval Systems, 2nd ed. San Diego, CA, USA: Emerald Group Publishing, 2007.
15. M. N. Do and M. Vetterli, "Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance," IEEE Trans. Image Process., vol. 11, no. 2, pp. 146-158, Feb. 2002. (Pubitemid 34278451)
16. T. Ojala, T. Mäenpää, J. Viertola, J. Kyllönen, and M. Pietikäinen, "Empirical evaluation of MPEG-7 texture descriptors with a large-scale experiment," in Proc. 2nd Int. Workshop Texture Anal. Synthesis, 2002, pp. 99-102.
17. Z. He, X. You, and Y. Yuan, "Texture image retrieval based on nontensor product wavelet filter banks," Signal Process., vol. 89, no. 8, pp. 1501-1510, Aug. 2009.
18. J. Zujovic, T. N. Pappas, D. L. Neuhoff, R. van Egmond, and H. De Ridder, "Subjective and objective texture similarity for image compression," in Proc. Int. Conf. Acoust. Speech, Signal Process., Mar. 2012, pp. 1369-1372.
19. J. Zujovic, T. N. Pappas, D. L. Neuhoff, R. van Egmond, and H. De Ridder, "A new subjective procedure for evaluation and development of texture similarity metrics," in Proc. IEEE 10th IVMSP Workshop, Jun. 2011, pp. 123-128.
20. J. Zujovic, T. N. Pappas, and D. L. Neuhoff, "Perceptual similarity metrics for retrieval of natural textures," in Proc. IEEE Workshop. Multimedia Signal, Oct. 2009, pp. 1-5.
21. J. Zujovic, "Perceptual texture similarity metrics," Ph.D. dissertation, Northwestern Univ., Dept. Elect. Eng. Comput. Sci., Chicago IL, USA, Aug. 2011.
22. M. Tuceryan and A. K. Jain, "Texture analysis," in Handbook Pattern Recognition and Computer Vision, C. H. Chen, L. F. Pau, and P. S. P. Wang, Eds. Singapore: World Scientific, 1993, ch. 2, pp. 235-276.
23. H. Z. Long, W. K. Leow, and F. K. Chua, "Perceptual texture space for content-based image retrieval," in Proc. Int. Conf. Multimedia Model., Nov. 2000, pp. 167-180.
24. R. M. Haralick, K. Shanmugam, and I. Dinstein, "Textural features for image classification," IEEE Trans. Syst. Man, Cybern., vol. 3, no. 6, pp. 610-621, Nov. 1973.
25. S. K. Saha, A. K. Das, and B. Chanda, "CBIR using perception based texture and colour measures," in Proc. 17th Int. Conf. Pattern Recognit., vol. 2. Aug. 2004, pp. 985-988.
26. T. Mita, T. Kaneko, B. Stenger, and O. Hori, "Discriminative feature co-occurrence selection for object detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 7, pp. 1257-1269, Jul. 2008.
27. M. Unser, "Texture classification and segmentation using wavelet frames," IEEE Trans. Image Process., vol. 4, no. 11, pp. 1549-1560, Nov. 1995.
28. P. Chen and T. Pavlidis, "Segmentation by texture using correlation," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-5, no. 1, pp. 64-69, Jan. 1983.
29. B. Julész, E. Gilbert, and J. Victor, "Visual discrimination of textures with identical third-order statistics," Biol. Cybern., vol. 31, no. 3, pp. 137-140, 1978. (Pubitemid 9065753)
30. B. Julesz, "A theory of preattentive texture discrimination based on firstorder statistics of textons," Biol. Cybern., vol. 41, no. 2, pp. 131-138, Aug. 1981. (Pubitemid 11003112)
31. R. L. Kashyap and A. Khotanzad, "A model-based method for rotation invariant texture classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-8, no. 4, pp. 472-481, Jul. 1986. (Pubitemid 16614041)
32. B. S. Manjunath and R. Chellappa, "Unsupervised texture segmentation using Markov random field models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 5, pp. 478-482, May 1991. (Pubitemid 21676522)
33. S. C. Zhu, Y. Wu, and D. Mumford, "Filters, random fields and maximum entropy frame: Toward a unified theory for texture modeling," Int. J. Comput. Vis., vol. 27, no. 2, pp. 107-126, Mar. 1998. (Pubitemid 128529714)
34. P. Ndjiki-Nya, D. Bull, and T. Wiegand, "Perception-oriented video coding based on texture analysis and synthesis," in Proc. Int. Conf. Image Process., Nov. 2009, pp. 2273-2276.
35. M. Clark, A. C. Bovik, and W. S. Geisler, "Texture segmentation using a class of narrowband filters," in Proc. IEEE Int. Conf. Acoust. Speech, Signal Process., Apr. 1987, pp. 571-574. (Pubitemid 17596313)
36. B. S. Manjunath and W. Y. Ma, "Texture features for browsing and retrieval of image data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 8, pp. 837-842, Aug. 1996. (Pubitemid 126772825)
37. V. Wouwer, G. Scheunders, P. Livens, and S. van Dyck, "Wavelet correlation signatures for color texture characterization," Pattern Recognit., vol. 32, no. 3, pp. 443-451, Apr. 1999.
38. M. N. Do and M. Vetterli, "Texture similarity measurement using Kullback-Leibler distance on wavelet subbands," in Proc. Int. Conf. Image Proc., vol. 3. Vancouver, BC, Canada, Sep. 2000, pp. 730-733.
39. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex," J. Physiol., vol. 160, no. 1, pp. 106-154, Jan. 1962.
40. J. G. Daugman, "Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters," J. Opt. Soc. Amer. A, vol. 2, pp. 1160-1169, Jun. 1985.
41. J. P. Jones and L. A. Palmer, "An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex," J. Neurophys., vol. 58, no. 6, pp. 1233-1258, Dec. 1987. (Pubitemid 18023459)
42. D. Dunn and W. E. Higgins, "Optimal Gabor filters for texture segmentation," IEEE Trans. Image Process., vol. 4, no. 7, pp. 947-964, Jul. 1995.
43. J. Ilonen, J. K. Kamarainen, P. Paalanen, M. Hamouz, J. Kittler, and H. Kalviainen, "Image feature localization by multiple hypothesis testing of Gabor features," IEEE Trans. Image Process., vol. 17, no. 3, pp. 311-325, Mar. 2008. (Pubitemid 351386293)
44. S. Arivazhagan, L. Ganesan, and S. Priyal, "Texture classification using Gabor wavelets based rotation invariant features," Pattern Recognit. Lett., vol. 27, no. 16, pp. 1976-1982, Dec. 2006. (Pubitemid 44556814)
45. J. Mathiassen, A. Skavhaug, and K. Bø, "Texture similarity measure using Kullback-Leibler divergence between gamma distributions," in Proc. 7th Eur. Conf. Comput. Vis., May 2002, pp. 19-49.
46. G. Yang and Y. Xiao, "A robust similarity measure method in CBIR system," in Proc. Congr. Image Signal, vol. 2. May 2008, pp. 662-666.
47. B. S. Manjunath, J.-R. Ohm, V. V. Vasudevan, and A. Yamada, "Color and texture descriptors," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 6, pp. 703-715, Jun. 2001. (Pubitemid 32616532)
48. B. S. Manjunath, P. Salembier, and T. Sikora, Texture Descriptors. New York, USA: Wiley, 2002, ch. 14, pp. 213-228.
49. Y. Lu, Q. Zhao, J. Kong, C. Tang, and Y. Li, "A two-stage region-based image retrieval approach using combined color and texture features," in AI 2006: Advances in Artificial Intelligence (Lecture Notes in Computer Science). New York, USA: Springer-Verlag, 2006, pp. 1010-1014.
50. A. C. Brooks, X. Zhao, and T. N. Pappas, "Structural similarity quality metrics in a coding context: Exploring the space of realistic distortions," IEEE Trans. Image Process., vol. 17, no. 8, pp. 1261-1273, Aug. 2008.
51. A. Reibman and D. Poole, "Characterizing packet-loss impairments in compressed video," in Proc. Int. Conf. Image, vol. 5. San Antonio, TX, USA, Sep. 2007, pp. 77-80.
52. E. P. Simoncelli, "Statistical models for images: Compression, restoration and synthesis," in Proc. Conf. Rec. 31st Conf. Signals, Syst. Comput., vol. 1. Nov. 1997, pp. 673-678.
53. D. Hubel and T. Wiesel, "Ferrier lecture: Functional architecture of macaque monkey visual cortex," Proc. Royal Soc. London. Ser. B, Biol. Sci., vol. 198, no. 1130, pp. 1-59, 1977. (Pubitemid 8150472)
54. K. Foster, J. Gaska, S. Marcelja, and D. Pollen, "Phase relationships between adjacent simple cells in the feline visual cortex," J. Phys. (London), vol. 345, p. 22, Dec. 1983.
55. T. Aach, A. Kaup, and R. Mester, "On texture analysis: Local energy transforms versus quadrature filters," Signal Process., vol. 45, no. 2, pp. 173-181, 1995.
56. P. C. Mahalanobis, "On the generalized distance in statistics," in Proc. Nat. Inst. Sci. India, vol. 2. 1936, pp. 49-55.
57. Corbis Stock Photography. (2011, Mar. 23) [Online]. Available: http://www.corbis.com
58. K. J. Dana, B. van Ginneken, S. K. Nayar, and J. J. Koenderink, "Reflectance and texture of real-world surfaces," ACM Trans. Graph., vol. 18, no. 1, pp. 1-34, Jan. 1999. (Pubitemid 129547675)
59. CUReT: Columbia-Utrecht Refelctance and Texture Database. (2002, Aug. 4) [Online]. Available: http://www1.cs.columbia.edu/CAVE/software/curet/
60. E. M. Voorhees, "The TREC-8 question answering track report," in Proc. TREC-8, 1999, pp. 77-82.
61. E. M. Voorhees, "Variations in relevance judgments and the measurement of retrieval effectiveness," Inf. Process. Manage., vol. 36, no. 5, pp. 697-716, Sep. 2000.
62. T. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002. (Pubitemid 34835471)
63. W. G. Cochran, "The combination of estimates from different experiments," Biometrics, vol. 10, no. 1, pp. 101-129, Mar. 1954.
64. M. Friedman, "The use of ranks to avoid the assumption of normality implicit in the analysis of variance," J. Amer. Stat. Assoc., vol. 32, no. 200, pp. 675-701, 1937.
65. J. D. Gibbons, Nonparametric Statistics: An Introduction (Quantitative Applications in Social Sciences), vol. 90. London, U.K.: Sage Publications, 1993.
66. J. W. Tukey, "Quick and dirty methods in statistics," in Proc. Simple Anal. Standard Designs. Qual. Control Conf. Papers, May 1951, pp. 189-197.