Automatically Evolving Rotation-Invariant Texture Image Descriptors by Genetic Programming

IEEE Transactions on Evolutionary Computation

Volumn 21, Issue 1, 2017, Pages 83-101

  Al Sahaf, Harith ^a   Al Sahaf, Ausama ^a   Xue, Bing ^a   Johnston, Mark ^b   Zhang, Mengjie ^a  

^a VICTORIA UNIVERSITY OF WELLINGTON   (New Zealand)

^b UNIVERSITY OF WORCESTER   (United Kingdom)

Author keywords

Classification; feature extraction; genetic programming (GP); image descriptor; Keypoint detection

Indexed keywords

CLASSIFICATION (OF INFORMATION); EXTRACTION; FEATURE EXTRACTION; GENETIC ALGORITHMS; IMAGE PROCESSING; LEARNING ALGORITHMS; LEARNING SYSTEMS;

BASELINE METHODS; FEATURE DETECTION; IMAGE DESCRIPTOR; IMAGE DESCRIPTORS; KEYPOINT DETECTION; ROTATION INVARIANT; TEXTURE CLASSIFICATION; TRAINING EXAMPLE;

GENETIC PROGRAMMING;

EID: 85011623873     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2016.2577548     Document Type: Article

References (83)

1. B. Bhanu, Y. Lin, and K. Krawiec, Evolutionary Synthesis of Pattern Recognition Systems (Monographs in Computer Science). New York, NY, USA: Springer, 2006.
2. L. Wang, B. Yang, S. Wang, and Z. Liang, "Building image feature kinetics for cement hydration using gene expression programming with similarity weight tournament selection," IEEE Trans. Evol. Comput., vol. 19, no. 5, pp. 679-693, Oct. 2015.
3. G. Karafotias, M. Hoogendoorn, and A. E. Eiben, "Parameter control in evolutionary algorithms: Trends and challenges," IEEE Trans. Evol. Comput., vol. 19, no. 2, pp. 167-187, Apr. 2015.
4. C. Harris and M. Stephens, "A combined corner and edge detector," in Proc. 4th Alvey Vis. Conf., Manchester, U.K., 1988, pp. 147-151.
5. M. Zhang, V. B. Ciesielski, and P. Andreae, "A domain-independent window approach to multiclass object detection using genetic programming," EURASIP J. Adv. Signal Process., vol. 2003, pp. 841-859, Jan. 2003.
6. G. James, T. Hastie, R. Tibshirani, and D. Witten, An Introduction to Statistical Learning: With Applications in R. New York, NY, USA: Springer, 2014.
7. T. Tuytelaars and K. Mikolajczyk, "Local invariant feature detectors: A survey," Found. Trends Comput. Graph. Vis., vol. 3, no. 3, pp. 177-280, 2008.
8. G. Carneiro and A. D. Jepson, "The distinctiveness, detectability, and robustness of local image features," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2. San Diego, CA, USA, 2005, pp. 296-301.
9. K. Juneja, A. Verma, S. Goel, and S. Goel, "A survey on recent image indexing and retrieval techniques for low-level feature extraction in CBIR systems," in Proc. IEEE Int. Conf. Comput. Intell. Commun. Technol., Ghaziabad, India, 2015, pp. 67-72.
10. R. M. Haralick, K. Shanmugam, and I. Dinstein, "Textural features for image classification," IEEE Trans. Syst., Man, Cybern., vol. SMC-3, no. 6, pp. 610-621, Nov. 1973.
11. T. Ojala, M. Pietikäinen, and D. Harwood, "Performance evaluation of texture measures with classification based on Kullback discrimination of distributions," in Proc. 12th Int. Conf. Pattern Recognit., vol. 1. Jerusalem, Israel, 1994, pp. 582-585.
12. D. G. Lowe, "Object recognition from local scale-invariant features," in Proc. Int. Conf. Comput. Vis., 1999, pp. 1150-1157.
13. H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool, "Speeded-up robust features (SURF)," Comput. Vis. Image Understand., vol. 110, no. 3, pp. 346-359, 2008.
14. J. Chen et al., "WLD: A robust local image descriptor," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1705-1720, Sep. 2010.
15. E. Rublee, V. Rabaud, K. Konolige, and G. Bradski, "ORB: An efficient alternative to SIFT or SURF," in Proc. IEEE Int. Conf. Comput. Vis., Barcelona, Spain, 2011, pp. 2564-2571.
16. M. Calonder et al., "BRIEF: Computing a local binary descriptor very fast," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 7, pp. 1281-1298, Jul. 2012.
17. A. Alahi, R. Ortiz, and P. Vandergheynst, "FREAK: Fast retina keypoint," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, 2012, pp. 510-517.
18. P. F. Alcantarilla, A. Bartoli, and A. J. Davison, "KAZE features," in Proc. 12th Eur. Conf. Comput. Vis., Florence, Italy, 2012, pp. 214-227.
19. B. Yang and S. Chen, "A comparative study on local binary pattern (LBP) based face recognition: LBP histogram versus LBP image," Neurocomputing, vol. 120, pp. 365-379, Nov. 2013.
20. M. Lopez-de-la Calleja, T. Nagai, M. Attamimi, M. Nakano-Miyatake, and H. Perez-Meana, "Object detection using SURF and superpixels," J. Softw. Eng. Appl., vol. 6, no. 9, pp. 511-518, 2013.
21. A. Satpathy, X. Jiang, and H.-L. Eng, "LBP-based edge-texture features for object recognition," IEEE Trans. Image Process., vol. 23, no. 5, pp. 1953-1964, May 2014.
22. A. Bouganis and M. Shanahan, "Flexible object recognition in cluttered scenes using relative point distribution models," in Proc. 19th Int. Conf. Pattern Recognit., Tampa, FL, USA, 2008, pp. 1-5.
23. S. Ramamoorthy, R. Kirubakaran, and R. S. Subramanian, "Texture feature extraction using MGRLBP method for medical image classification," in Artificial Intelligence and Evolutionary Algorithms in Engineering Systems (Advances in Intelligent Systems and Computing), vol. 324. New Delhi, India: Springer, 2015, pp. 747-753.
24. S. Saxena and R. K. Singh, "A survey of recent and classical image registration methods," Int. J. Signal Process. Image Process. Pattern Recognit., vol. 7, no. 4, pp. 167-176, 2014.
25. M.-H. Tsai et al., "Feature-based image segmentation," J. Imag. Sci. Technol., vol. 57, no. 1, pp. 1-12, 2013.
26. J. R. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, MA, USA: MIT Press, 1992.
27. R. Poli and S. Cagnoni, "Genetic programming with user-driven selection: Experiments on the evolution of algorithms for image enhancement," in Proc. 2nd Annu. Conf. Genet. Program., Stanford, CA, USA, 1997, pp. 269-277.
28. C. Downey and M. Zhang, "Multiclass object classification for computer vision using linear genetic programming," in Proc. 24th Int. Conf. Image Vis. Comput. New Zealand, Wellington, New Zealand, 2009, pp. 73-78.
29. F. Abdulhamid, K. Neshatian, and M. Zhang, "Image recognition using genetic programming with loop structures," in Proc. 26th Int. Conf. Image Vision Comput. New Zealand, vol. 29. Auckland, New Zealand, 2011, pp. 553-558.
30. H. Al-Sahaf, A. Song, K. Neshatian, and M. Zhang, "Extracting image features for classification by two-tier genetic programming," in Proc. IEEE Congr. Evol. Comput., Brisbane, QLD, Australia, 2012, pp. 1-8.
31. W. A. Albukhanajer, J. A. Briffa, and Y. Jin, "Evolutionary multiobjective image feature extraction in the presence of noise," IEEE Trans. Cybern., vol. 45, no. 9, pp. 1757-1768, Sep. 2015.
32. A. Song and V. Ciesielski, "Texture segmentation by genetic programming," Evol. Comput., vol. 16, no. 4, pp. 461-481, 2008.
33. Y. Liang, M. Zhang, and W. N. Browne, "Image segmentation: A survey of methods based on evolutionary computation," in Proc. 10th Int. Conf. (SEAL), Dunedin, New Zealand, Dec. 2014, pp. 847-859.
34. Y. Liang, M. Zhang, and W. N. Browne, "A supervised figure-ground segmentation method using genetic programming," in Proc. 18th Eur. Conf. Appl. Evol. Comput., vol. 9028. Copenhagen, Denmark, 2015, pp. 491-503.
35. S. Chicotay, O. E. David, and N. S. Netanyahu, "Image registration of very large images via genetic programming," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, Columbus, OH, USA, 2014, pp. 329-334.
36. M. Ebner and A. Zell, "Evolving a task specific image operator," in Proc. 1st Eur. Workshops EvoIASP and EuroEcTel, Gothenburg, Sweden, May 1999, pp. 74-89.
37. L. Trujillo and G. Olague, "Synthesis of interest point detectors through genetic programming," in Proc. 8th Annu. Conf. Genet. Evol. Comput., Seattle, WA, USA, 2006, pp. 887-894.
38. L. Trujillo and G. Olague, "Automated design of image operators that detect interest points," Evol. Comput., vol. 16, no. 4, pp. 483-507, 2008.
39. G. Olague and L. Trujillo, "A genetic programming approach to the design of interest point operators," in Bio-Inspired Hybrid Intelligent Systems for Image Analysis and Pattern Recognition (Studies in Computational Intelligence), vol. 256. Heidelberg, Germany: Springer, 2009, pp. 49-65.
40. C. B. Perez and G. Olague, "Evolutionary learning of local descriptor operators for object recognition," in Proc. 11th Annu. Conf. Genet. Evol. Comput., Montreal, QC, Canada, 2009, pp. 1051-1058.
41. L. Liu, L. Shao, X. Li, and K. Lu, "Learning spatio-temporal representations for action recognition: A genetic programming approach," IEEE Trans. Cybern., vol. 46, no. 1, pp. 158-170, Jan. 2016, doi: 10.1109/TCYB.2015.2399172.
42. L. Shao, L. Liu, and X. Li, "Feature learning for image classification via multiobjective genetic programming," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 7, pp. 1359-1371, Jul. 2014.
43. H. Al-Sahaf, A. Song, K. Neshatian, and M. Zhang, "Two-tier genetic programming: Towards raw pixel-based image classification," Expert Syst. Appl., vol. 39, no. 16, pp. 12291-12301, 2012.
44. H. Al-Sahaf, M. Zhang, M. Johnston, and B. Verma, "Image descriptor: A genetic programming approach to multiclass texture classification," in Proc. IEEE Congr. Evol. Comput., Sendai, Japan, 2015, pp. 2460-2467.
45. L. Nanni, S. Brahnam, and A. Lumini, "A simple method for improving local binary patterns by considering non-uniform patterns," Pattern Recognit., vol. 45, no. 10, pp. 3844-3852, 2012.
46. T. Ojala, M. Pietikäinen, and T. Mäenpää, "Gray scale and rotation invariant texture classification with local binary patterns," in Proc. 6th Eur. Conf. Comput. Vis., vol. 1842. Dublin, Ireland, 2000, pp. 404-420.
47. T. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
48. Z. Guo, L. Zhang, and D. Zhang, "A completed modeling of local binary pattern operator for texture classification," IEEE Trans. Image Process., vol. 19, no. 6, pp. 1657-1663, Jun. 2010.
49. Y. Zhao, D.-S. Huang, and W. Jia, "Completed local binary count for rotation invariant texture classification," IEEE Trans. Image Process., vol. 21, no. 10, pp. 4492-4497, Oct. 2012.
50. A. Song, T. Loveard, and V. Ciesielski, "Towards genetic programming for texture classification," in Proc. 14th Aust. Joint Conf. Artif. Intell., vol. 2256. Adelaide, SA, Australia, 2001, pp. 461-472.
51. A. Song and V. Ciesielski, "Texture analysis by genetic programming," in Proc. IEEE Congr. Evol. Comput., Portland, OR, USA, 2004, pp. 2092-2099.
52. W. A. Tackett, "Genetic programming for feature discovery and image discrimination," in Proc. 5th Int. Conf. Genet. Algorithms, Champaign, IL, USA, 1993, pp. 303-311.
53. M. Zhang and V. Ciesielski, "Genetic programming for multiple class object detection," in Proc. 12th Aust. Joint Conf. Artif. Intell., vol. 1747. Sydney, NSW, Australia, 1999, pp. 180-192.
54. T. Loveard and V. Ciesielski, "Representing classification problems in genetic programming," in Proc. IEEE Congr. Evol. Comput., vol. 2. Seoul, South Korea, 2001, pp. 1070-1077.
55. P. Brodatz, Textures: A Photographic Album for Artists and Designers. New York, NY, USA: Dover, 1999.
56. W. R. Smart and M. Zhang, "Classification strategies for image classification in genetic programming," in Proc. 18th Int. Conf. Image Vis. Comput. New Zealand, Palmerston North, New Zealand, 2003, pp. 402-407.
57. M. Zhang, U. Bhowan, and B. Ny, "Genetic programming for object detection: A two-phase approach with an improved fitness function," Electron. Lett. Comput. Vis. Image Anal., vol. 6, no. 1, pp. 27-43, 2007.
58. M. Zhang and M. Johnston, "A variant program structure in treebased genetic programming for multiclass object classification," in Evolutionary Image Analysis and Signal Processing (Studies in Computational Intelligence), vol. 213. Heidelberg, Germany: Springer, 2009, pp. 55-72.
59. D. Atkins, K. Neshatian, and M. Zhang, "A domain independent genetic programming approach to automatic feature extraction for image classification," in Proc. IEEE Congr. Evol. Comput., New Orleans, LA, USA, 2011, pp. 238-245.
60. H. Al-Sahaf, M. Zhang, and M. Johnston, "Genetic programming evolved filters from a small number of instances for multiclass texture classification," in Proc. 29th Int. Conf. Image Vis. Comput. New Zealand, Hamilton, New Zealand, 2014, pp. 84-89.
61. W. Fu, M. Johnston, and M. Zhang, "Automatic construction of invariant features using genetic programming for edge detection," in Proc. 25th Aust. Joint Conf., Sydney, NSW, Australia, Dec. 2012, pp. 144-155.
62. W. Fu, M. Johnston, and M. Zhang, "Distribution-based invariant feature construction using genetic programming for edge detection," Soft Comput., vol. 19, no. 8, pp. 2371-2389, 2015.
63. J. Canny, "A computational approach to edge detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 8, no. 6, pp. 679-698, Nov. 1986.
64. A. Kadyrov and M. Petrou, "The trace transform and its applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 8, pp. 811-828, Aug. 2001.
65. D. J. Montana, "Strongly typed genetic programming," Evol. Comput., vol. 3, no. 2, pp. 199-230, 1995.
66. G. J. McLachlan, Discriminant Analysis and Statistical Pattern Recognition. New York, NY, USA: Wiley, 2004.
67. S.-H. Cha, "Comprehensive survey on distance/similarity measures between probability density functions," Int. J. Math. Models Methods Appl. Sci., vol. 1, no. 4, pp. 300-307, 2007.
68. S. Johnson, Stephen Johnson on Digital Photography. Beijing, China: O'Reilly, 2006.
69. G. Kylberg, "The Kylberg texture dataset V. 1.0," Centre Image Anal., Swedish Univ. Agricult. Sci. Uppsala Univ., Uppsala, Sweden, Tech. Rep. 35, 2011.
70. T. Ojala et al., "Outex-new framework for empirical evaluation of texture analysis algorithms," in Proc. 16th Int. Conf. Pattern Recognit., vol. 1. Quebec City, QC, Canada, 2002, pp. 701-706.
71. T. Ahonen, A. Hadid, and M. Pietikäinen, "Face recognition with local binary patterns," in Proc. 8th Eur. Conf. Comput. Vis., vol. 3021. Prague, Czech Republic, 2004, pp. 469-481.
72. M. Hall et al., "The WEKA data mining software: An update," SIGKDD Explor. Newslett., vol. 11, no. 1, pp. 10-18, 2009.
73. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques, 2nd ed. Amsterdam, The Netherlands: Morgan Kaufmann, 2005.
74. T. Rassem and B. E. Khoo, "Completed local ternary pattern for rotation invariant texture classification," Sci. World J., vol. 2014, Apr. 2014, Art. no. 373254.
75. S. Trenn, "Multilayer perceptrons: Approximation order and necessary number of hidden units," IEEE Trans. Neural Netw., vol. 19, no. 5, pp. 836-844, May 2008.
76. S. S. Keerthi and C.-J. Lin, "Asymptotic behaviors of support vector machines with Gaussian kernel," Neural Comput., vol. 15, no. 7, pp. 1667-1689, 2003.
77. Y. Freund and R. E. Schapire, "Experiments with a new boosting algorithm," in Proc. 13th Int. Conf. Mach. Learn., Bari, Italy, 1996, pp. 148-156.
78. G. Holmes, B. Pfahringer, R. Kirkby, E. Frank, and M. Hall, "Multiclass alternating decision trees," in Proc. 13th Eur. Conf. Mach. Learn., Helsinki, Finland, 2002, pp. 161-172.
79. J. Derrac, S. García, D. Molina, and F. Herrera, "A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms," Swarm Evol. Comput., vol. 1, no. 1, pp. 3-18, 2011.
80. F. Wilcoxon, "Individual comparisons by ranking methods," Biometrics Bull., vol. 1, no. 6, pp. 80-83, 1945.
81. J. Demšar, "Statistical comparisons of classifiers over multiple data sets," J. Mach. Learn. Res., vol. 7, pp. 1-30, Jan. 2006.
82. T. Tommasi and B. Caputo, "The more you know, the less you learn: From knowledge transfer to one-shot learning of object categories," in Proc. Brit. Mach. Vis. Conf., London, U.K., 2009, pp. 1-11.
83. K. R. Canini, M. M. Shashkov, and T. L. Griffiths, "Modeling transfer learning in human categorization with the hierarchical Dirichlet process," in Proc. 27th Int. Conf. Mach. Learn., Haifa, Israel, 2010, pp. 151-158.