Adaptive perceptual color-texture image segmentation

IEEE Transactions on Image Processing

Volumn 14, Issue 10, 2005, Pages 1524-1536

  Chen, Junqing ^a   Pappas, Thrasyvoulos N ^b   Mojsilović, Aleksandra ^c   Rogowitz, Bernice E ^c  

^a UNILEVER RESEARCH   (United Kingdom)

^b Northwestern University   (United States)

^c IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Adaptive clustering algorithm (ACA); Content based image retrieval (CBIR); Gabor transform; Human visual system (HVS) models; Local median energy; Optimal color composition distance (OCCD); Steerable filter decomposition

Indexed keywords

ALGORITHMS; COLOR IMAGE PROCESSING; ESTIMATION; IMAGE RETRIEVAL; MATHEMATICAL MODELS; SEMANTICS; SENSORY PERCEPTION; STATISTICAL METHODS; TEXTURES; VECTORS;

ADAPTIVE CLUSTERING ALGORITHM (ACA); COLOR COMPOSITION TEXTURE; CONTENT-BASED IMAGE RETRIEVAL (CBIR); HUMAN VISUAL SYSTEM (HVS) MODELS; OPTIMAL COLOR COMPOSITION DISTANCE (OCCD); SPATIALLY ADAPTIVE DOMINANT COLORS; STEERABLE FILTER DECOMPOSITION;

IMAGE SEGMENTATION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COLOR; COLORIMETRY; COMPUTER ASSISTED DIAGNOSIS; EVALUATION; FEEDBACK SYSTEM; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; MATHEMATICAL COMPUTING; METHODOLOGY; SIGNAL PROCESSING; THREE DIMENSIONAL IMAGING; VISION;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COLOR; COLORIMETRY; FEEDBACK; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; SIGNAL PROCESSING, COMPUTER-ASSISTED; VISUAL PERCEPTION;

EID: 27744584967     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2005.852204     Document Type: Article

References (72)

1. Y Rui, T. S. Huang, and S.-F. Chang, "Image retrieval: Current techniques, promising directions and open issues," J. Vis. Commun. Image Represen., vol. 10, pp. 39-62, Mar. 1999.
2. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years, IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 12, pp. 1349-1379, Dec. 2000.
3. A. Kundu and J.-L. Chen, "Texture classification using QMF bank-based subband decomposition," Comput. Vis., Graphics, and Image Process., Graph. Models Image Process., vol. 54, pp. 369-384, Sep. 1992.
4. T. Chang and C.-C. J. Kuo, "Texture analysis and classification with tree-structured wavelet transform," IEEE Trans. Image Process., vol. 2, no. 10, pp. 429-441, Oct. 1993.
5. M. Unser, "Texture classification and segmentation using wavelet frames," IEEE Trans. Image Process., vol. 4, no. 11, pp. 1549-1560, Nov. 1995.
6. T. Randen and J. H. Husoy, "Texture segmentation using filters with optimized energy separation," IEEE Trans. Image Process., vol. 8, no. 4, pp. 571-582, Apr. 1999.
7. G. V. de Wourwer, P. Scheunders, and D. Van Dyck, "Statistical texture characterization from discrete wavelet representations," IEEE Trans. Image Process., vol. 8, no. 4, pp. 592-598, Apr. 1999.
8. T. N. Pappas, "An adaptive clustering algorithm for image segmentation," IEEE Trans. Signal Process., vol. SP-40, no. 4, pp. 901-914, Apr. 1992.
9. M. M. Chang, M. I. Sezan, and A. M. Tekalp, "Adaptive Bayesian segmentation of color images," J. Electron. Imag., vol. 3, pp. 404-414, Oct. 1994.
10. D. Comaniciu and P. Meer, "Robust analysis of feature spaces: Color image segmentation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, San Juan, PR, Jun. 1997, pp. 750-755.
11. J. Luo, R. T. Gray, and H.-C. Lee, "Incorporation of derivative priors in adaptive Bayesian color image segmentation," in Proc. Int. Conf Image Processing, vol. III, Chicago, IL, Oct. 1998, pp. 780-784.
12. Y. Deng and B. S. Manjunath, "Unsupervised segmentation of color-texture regions in images and video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 8, pp. 800-810, Aug. 2001.
13. S. Belongie, C. Carson, H. Greenspan, and J. Malik, "Color- and texture-based image segmentation using EM and its application to content based image retrieval," in Proc. ICCV, 1998, pp. 675-682.
14. D. K. Panjwani and G. Healey, "Markov random-field models for unsupervised segmentation of textured color images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 10, pp. 939-954, Oct. 1995.
15. J. Wang, "Stochastic relaxation on partitions with connected components and its application to image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 6, pp. 619-636, Jun. 1998.
16. L. Shafarenko, M. Petrou, and J. Kittler, "Automatic watershed segmentation of randomly textured color images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 6, no. 11, pp. 1530-1544, Nov. 1997.
17. W. Ma and B. S. Manjunath, "Edge flow: A technique for boundary detection and image segmentation," IEEE Trans. Image Process., vol. 9, no. 8, pp. 1375-1388, Aug. 2000.
18. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.
19. A. Mojsilovic and B. Rogowitz, "Capturing image semantics with low-level descriptors," in Proc. Int. Conf. Image Processing, Thessaloniki, Greece, Oct. 2001, pp. 18-21.
20. A. Amir and M. Lindenbaum, "A generic grouping algorithm and its quantitative analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 2, pp. 168-185, Feb. 1998.
21. Y. Gdalyahu, D. Weinshall, and M. Werman, "Self-organization in vision: Stochastic clustering for image segmentation, perceptual grouping, and image database organization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 10, pp. 1053-1074, Oct. 2001.
22. T, P. Minka and R. W. Picard, "Interactive leaming using a society of models," Pattern Recognit., vol. 30, pp. 565-581, Apr. 1997.
23. A. Jaimes and S. F. Chang, "Model-based classification of visual information for content-based retrieval," in Proc. SPIE Storage and Retrieval for Image and Video Databases VII, vol. 3656, San Jose, CA, 1999, pp. 402-414.
24. J. Fan, Z. Zhu, and L. Wu, "Automatic model-based object extraction algorithm," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 10, pp. 1073-1084, Oct. 2001.
25. E. P. Simoncelli and J. Portilla, "Texture characterization via joint statistics of wavelet coefficient magnitudes," in Proc. Int. Conf. Image Process., vol. I, Chicago, IL, Oct. 1998, pp. 62-66.
26. J. Portilla and E. R Simoncelli, "A parametric texture model based on joint statictics of complex wavelet coefficients," Int. J Comput. Vis., vol. 40, pp. 49-71, Oct. 2000.
27. A. Mojsilović, J. Kovačević, J. Hu, R. J. Safranek, and S. K. Ganapathy, "Matching and retrieval based on the vocabulary and grammar of color patterns," IEEE Trans. Image Process., vol. 1, no. 1, pp. 38-54, Jan. 2000.
28. M. Mirmehdi and M. Petrou, "Segmentation of color textures," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 2, pp. 142-159, Feb. 2000.
29. D. Cano and T. H. Minh, "Texture synthesis using hierarchical linear transforms," Signal Process., vol. 15, pp. 131-148, 1988.
30. M. Porat and Y. Y. Zeevi, "Localized texture processing in vision: Analysis and synthesis in gaborian space," IEEE Trans. Biomed. Eng., vol. BE-36, no. 1, pp. 115-129, Jan. 1989.
31. D. J. Heeger and J. R. Bergen, "Pyramid-based texture analysis/ synthesis," in Proc. Int. Conf. Image Processing, vol. III, Washington, DC, Oct. 1995, pp. 648-651.
32. J. Portilla, R. Navarro, O. Nestares, and A. Tabernero, "Texture synthesis-by-analysis based on a multiscale early-vision model," Opt. Eng., vol. 35, no. 8, pp. 2403-2417, 1996.
33. S. Zhu, Y. N. Wu, and D. Mumford, "Filters, random fields and maximum entropy (FRAME): Toward a unified theory for texture modeling," in IEEE Conf. Computer Vision Pattern Recognition, 1996, pp. 693-696.
34. J. S. De Bonet and P. A. Viola, "A nonparametric multi-scale statistical model for natural images," Adv. Neur. Inf. Process. Syst., vol. 9, 1997.
35. M. N. Do and M. Vetterli, "Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance," IEEE Trans. Image Process., vol. 11, no. 2, pp. 146-158, Feb. 2002.
36. W. Y. Ma, Y Deng, and B. S. Manjunath, "Tools for texture/color based search of images," in Proc. SPIE Human Vision and Electronic Imaging II, vol. 3016, B. E. Rogowitz and T. N. Pappas, Eds., San Jose, CA, 1997, pp.496-507.
37. Y. Deng, B. S. Manjunath, C. Kenney, M. S. Moore, and H. Shin, "An efficient color representation for image retrieval," IEEE Trans. Image Process., vol. 10, no. 1, pp. 140-147, Jan. 2001.
38. A. Mojsilović, J. Hu, and E. Soljanin, "Extraction of perceptually important colors and similarity measurement for image matching, retrieval, and analysis," IEEE Trans. Image Process., vol. 11, no. 11, pp. 1238-1248, Nov. 2002
39. M. Swain and D. Ballard, "Color indexing," Int. J. Comput. Vis., vol. 7, no. 1, pp. 11-32, 1991.
40. W. Niblack, R. Berber, W. Equitz, M. Flickner, E. Glaman, D. Petkovic, and P. Yanker, "The QBIC project: Quering images by content using color, texture, and shape," in Proc. SPIE Storage and Retrieval for Image and Video Data Bases, vol. 1908, San Jose, CA, 1993, pp. 173-187.
41. B. S. Manjunath, J.-R. Ohm, V. V. Vasudevan, and A. Yamada, "Color and texture descriptors," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 6, pp. 703-715, Jun. 2001.
42. M. R. Pointer and G. G. Attridge, "The number of discernible colors," Color Res. Appl., vol. 23, no. 1, pp. 52-54, 1998.
43. G. Derefeldt and T. Swartling, "Color concept retrieval by free color naming," Displays, vol. 16, pp. 69-77, 1995.
44. S. N. Yendrikhovskij, "Computing color categories," in Proc. SPIE Human Vision and Electronic Imaging V, vol. 3959, B. E. Rogowitz and T. N. Pappas, Eds., San Jose, CA, 2000.
45. J. Smith and S. F. Chang, "Single color extraction and image query," presented at the IEEE Int. Conf. Image Processing, 1995.
46. Y Linde, A. Buzo, and R. M. Gray, "An algorithm for vector quantizer design," IEEE Trans. Commun., vol. COM-28, no. 1, pp. 84-95, Jan. 1980.
47. Y. Deng, S. Kenney, M. S. Moore, and B. S. Manjunath, "Peer goup, filtering and perceptual color image quantization," in Proc. IEEE Int. Symp. Circuits and Systems VLSI, vol. 4, Orlando, FL, Jun. 1999, pp. 21-24.
48. P. K. Kaiser and R. M. Boynton, Human Color Vision. Washington, DC: Opt. Soc. Amer., 1996.
49. J. T. Ton and R. C. Gonzalez, Pattern Recognition Principles. Reading, MA: Addison-Wesley, 1974.
50. R. M. Gray and Y. Linde, "Vector quantizers and predictive quantizers for Gauss-Markov sources," IEEE Trans. Commun., vol. COM-30, no. 2, pp. 381-389, Feb. 1982.
51. Y. Rubner, C. Tomasi, and L. J. Guibas, "A metric for distributions with applications to image databases," presented at the IEEE Int. Conf. Computer Vision, Bombay, India, 1998.
52. J. R. Bergen and M. S. Landy, "Computational modeling of visual texure segregation," in Computational Models of Visual Processing, M. S. Landy and J. A. Movshon, Eds. Cambridge, U.K.: Cambridge Univ. Press, 1991, pp. 253-271.
53. M. R. Turner, "Texture discrimination by Gabor functions," Biol. Cybern., vol. 55, pp. 71-82, 1986.
54. A. C. Bovik, M. Clark, and W. S. Geisler, "Multichannel texture analysis using localized spatial filters," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 1, pp. 55-73, Jan. 1990.
55. J. Malik and P. Perona, "Preattentive texture discrimination with early vision mechanisms," J. Opt. Soc. Amer. A, vol. 7, pp. 923-932, 1990.
56. D. Dunn and W. E. Higgins, "Optimal Gabor filters for texture segmentation," IEEE Trans. Image Process., vol. 4, no. 7, pp. 947-964, Jul. 1995.
57. B. S. Manjunath and W. Y Ma, "Texture features for browsing and retrieval of image data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 8, pp. 837-842, Aug. 1996.
58. A. B. Watson, "The cortex transform: Rapid computation of simulated neural images," Comput. Vis., Graph., Image Process., vol. 39, pp. 311-327, 1987.
59. J. G. Daugman and D. M. Kammen, "Pure orientation filtering: A scale invariant image-processing tool for perception research and data compression," Behav. Res. Meth., Instrum., Comput., vol. 18, no. 6, pp. 559-564, 1986.
60. W. T. Freeman and E. H. Adelson, "The design and use of steerable filters," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 9, pp. 891-906, Sep. 1991.
61. E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, "Shiftable multi-scale transforms," IEEE Trans. Inf. Theory, vol. 38, no. 3, pp. 587-607, Mar. 1992.
62. E. P. Simoncelli and W. T. Freeman, "The steerable pyramid: A flexible architecture for multi-scale derivative computation," in Proc. Int. Conf. Image Processing, vol. III, Washington, DC, Oct. 1995, pp. 444-447.
63. A. Cohen, I. Daubechies, and J. C. Feauveau, "Biorthogonal bases of compactly supported wavelets," Commun. Pure Appl. Math., vol. 45, pp. 485-560, 1992.
64. I. Daubechies, Ten Lectures on Wavelets. Philadelphia, PA: SIAM, 1992.
65. T. Chang and C.-C. J. Kuo, "Texture segmentation with tree-structured wavelet transform," in Proc. IEEE Int. Symp. Time-Frequency and Time-Scale Analysis, Oct. 1992, pp. 543-546.
66. N. Graham, "Non-linearities in texture segregation," in Proc. CBIA Foundation Symp., vol. 184, G. R. Bock and J. A. Goode, Eds., New York, 1994, pp. 309-329.
67. N. Graham and A. Sutter, "Spatial summation in simple (fourier) and complex (nonfourier) texture channels," Vis. Res., vol. 38, pp. 231-257, 1998.
68. N. Graham and A. Sutter, "Normalization: Contrast-gain control in simple (fourier) and complex (nonfourier) pathways of patter vision," Vis. Res., vol. 40, pp. 2737-2761, 2000.
69. S. Daly, "The visible differences predictor: An algorithm for the assessment of image fidelity," in Digital Images and Human Vision, A. B. Watson, Ed. Cambridge, MA: MIT Press, 1993, pp. 179-206.
70. J. Chen, T. N. Pappas, A. Mcjsilovic, and B. E. Rogowitz, "Perceptual color and texture features for segmentation," in Proc. SPIE Human Vision and Electronic Imaging VIII, vol. 5007, B. E. Rogowitz and T. N. Pappas, Eds., Santa Clara, CA, 2003, pp. 340-351.
71. J. Chen, T.N. Pappas, A. Mojsilovic and B. E. Rogowitz "Adaptive image segmentation based on color and texture," in Proc. Int. Conf. Image Processing, vol, 2, Rochester, NY, Sep. 2002, pp. 789-792.
72. D. Martin, C. Fowlkes, D. Tal, and J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics," presented at the ICCV, Vancouver, BC, Canada, Jul. 2001.