A generic multi-dimensional feature extraction method using multiobjective genetic programming

Evolutionary Computation

Volumn 17, Issue 1, 2009, Pages 89-115

  Zhang, Yang ^a   Rockett, Peter I ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Feature extraction; Genetic programming; Multi dimensional mapping; Multiobjective optimization; Optimal dimensionality; Pattern recognition; Search

Indexed keywords

ALGORITHM; ARTICLE; BIOLOGICAL MODEL; CONFIDENCE INTERVAL; DATA BASE; HUMAN; METHODOLOGY; MOLECULAR COMPUTER; MUTATION; REPRODUCIBILITY; RESEARCH; STATISTICAL MODEL; THEORETICAL MODEL;

ALGORITHMS; COMPUTERS, MOLECULAR; CONFIDENCE INTERVALS; DATABASES AS TOPIC; HUMANS; MODELS, GENETIC; MODELS, STATISTICAL; MODELS, THEORETICAL; MUTATION; REPRODUCIBILITY OF RESULTS; RESEARCH; RESEARCH DESIGN;

EID: 62249094556     PISSN: 10636560     EISSN: 15309304     Source Type: Journal    
DOI: 10.1162/evco.2009.17.1.89     Document Type: Article

References (49)

1. Addison, D., Wermter, S., and Arevian, G. (2003). A comparison of feature extraction and selection techniques. In O. Kaynak, E. Alpaydin, E. Oja, and L. Xu (Eds.), Proceedings of International Conference on Artificial Neural Networks (Supplementary Proceedings), pp. 212-215, Berlin: Springer-Verlag.
2. Aeberhard, S., Coomans, D., and de Vel, O. (1992). The classification performance of RDA. Technical Report 92-01, Department of Computer Science and Department of Mathematics and Statistics, lames Cook University, North Queensland.
3. Alpaydin, E. (1999). Combined 5 x 2 cv F-test for comparing supervised classification learning algorithms. Neural Computation, 11(8):1885-1892.
4. Bailey, A. (2001). Class-dependent features and multi-category classification. PhD Thesis. Department of Electronics & Computer Science, University of Southampton, UK.
5. Blake, C. L., and Merz, C. J. (1998). UCI repository of machine learning databases, Irvine, CA. University of California, Department of Information & Computer Science. Available at http://www.ics.uci.edu/~mlearn/MLrepository. html.
6. Bot, M. J. C. (2001). Feature extraction for the k-nearest neighbour classifier with genetic programming. Proceedings of EuroGP 2001, pp. 256-267.
7. th Belgium/Netherlands Conference on Artificial Intelligence (BNAIC'99), pp. 107-114.
8. Burges, C. J. C. (1998). A tutorial on support vector machines for pattern recognition. Data Mining & Knowledge Discovery, 2:121-167.
9. Coello, C. A. C. (2000). An updated survey of GA-based multiobjective optimization techniques. ACM Computing Surveys, 32:109-143.
10. Coomans, D., and Broeckaert, I. (1988). Potential pattern recognition in chemical and medical decision making. Letchworth, UK: Research Studies Press.
11. Dietterich, T. G. (1998). Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation, 10:1895-1923.
12. Duda, R. O., Hart, P. E., and Stork, D. G. (2001). Pattern recognition. New York: lohn Wiley & Sons.
13. Ebner, M. (1998). On the evolution of interest operators using genetic programming. In W. Banzhaf and T. C. Fogarty (Eds.), Proceedings of Late Breaking Papers in V European Workshop on Genetic Programming, pp. 6-10. Berlin: Springer-Verlag.
14. Ebner, M., and Zell, A. (1999). Evolving a task specific image operator. Proceedings of Joint Proceedings of the V European Workshop on Evolutionary Image Analysis, Signal Processing and Telecommunications (EvoIASP'99 and EuroEcTel'99), pp. 74-89. Berlin: Springer-Verlag.
15. Ekárt, A., and Németh, S. Z. (2001). Selection based on the Pareto nondomination criterion for controlling code growth in genetic programming. Genetic Programming and Evolvable Machines, 2:61-73.
16. Guo, H., Jack, L. B., and Nandi, A. K. (2005). Feature generation using genetic programming with application to fault classification. IEEE Transactions on Systems, Man & Cybernetics-Part B, 35:89-99.
17. Guo, H., and Nandi, A. K. (2006). Breast cancer diagnosis using genetic programming generated feature. Pattern Recognition, 39:980-987.
18. th International Conference on Neural Information Processing and Intelligent Information Systems (ICONIP'97), pp. 855-858. Berlin: Springer-Verlag.
19. Harris, C. (1997). An investigation into the application of genetic programming techniques to signal analysis and feature detection. PhD Thesis. Department of Computer Science, University College London.
20. Harvey, N. R., Theiler, J., Brumby, S. P., Perkins, S., Szymanski, J. J., Bloch, J. J., Porter, R. B., Mark, G., and Young, A. C. (2002). Comparison of genie and conventional supervised classifiers for multispectral image feature extraction. IEEE Transactions on Geoscience & Remote Sensing, 40:393-404.
21. Howley, T., and Madden, M. G. (2005). The genetic kernel support vector machine: Description and evaluation. Artificial Intelligence Review, 24:379-395.
22. st European Workshop on Genetic Programming, pp. 14-15.
23. Jolliffe, I. T. (1986). Principal component analysis. Berlin: Springer.
24. Kotani, M., Nakai, M., and Azakawa, K. (1999). Feature extraction using evolutionary computation. Proceedings of Congress on Evolutionary Computation, pp. 1230-1236. Piscataway, NJ: IEEE Press.
25. Koza, J. R. (1994). Genetic programming II: Automatic discovery of reusable programs. Cambridge, MA: MIT Press.
26. Krawiec, K. (2002). Genetic programming-based construction of features for machine learning and knowledge discovery tasks. Genetic Programming and Evolvable Machines, 3:329-343.
27. Kumar, R., and Rockett, P. I. (2002). Improved sampling of the Pareto-front in multiobjective genetic optimizations by steady-state evolution: A Pareto converging genetic algorithm. Evolutionary Computation, 10:283-314.
28. Langdon, W. B. (1998). Programming and data structures: Genetic programming + data structures = automatic programming. London: Kluwer Academic Publishers.
29. Leiva-Murillo, J. M., Santiago-Mozos, R., Pérez-Cruz, F., and Artés-Rodriguez, A. (2002). Comparison of supervised feature extraction methods for multispectral images. Proceedings of Learning '02.
30. Lim, T., Loh, W., and Shih, Y. (2000). A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms. Machine Learning, 40:203-228.
31. Loveard, T., and Ciesielski, V. (2001). Representing classification problems in genetic programming. Congress of Evolutionary Computing (CEC'01), pp. 1070-1077.
32. Mangasarian, O. L., and Wolberg, W. H. (1990). Cancer diagnosis via linear programming. SIAM News, 23:1-18.
33. Mangasarian, O. L., Street, W. N., and Wolberg, W. H. (1995). Breast cancer diagnosis and prognosis via linear programming. Operations Research, 43:570-577.
34. Michie, D., Spiegelhalter, D. J., and Taylor, C. C. (1994). Machine learning, neural and statistical classification. Englewood Cliffs, NJ: Prentice Hall.
35. Muni, D. P., Pal, N. R., and Das, J. (2004). A novel approach to design classifiers using genetic programming. IEEE Transactions on Evolutionary Computation, 8:183-196.
36. th IEEE International Conference on Data Mining (ICDM'04), pp. 495-498. Piscataway, NJ: IEEE Computer Society Press.
37. Quinlan, J. R. (1993). C4.5: Programs for machine learning. San Mateo, CA: Morgan Kaufmann.
38. Schiffmann, W., Joost, M., and Werner, R. (1992). Synthesis and performance analysis of multilayer neural network architectures. Technical Report 16/1992, Institute fur Physics, University of Koblenz.
39. th Annual Conference on Genetic Programming, pp. 304-312.
40. Smith, M. G., and Bull, L. (2005). Genetic programming with a genetic algorithm for feature construction and selection. Genetic Programming and Evolvable Machines, 6(3):265-281.
41. Sullivan, K., and Luke, S. (2007). Evolving kernels for support vector machine classification. Proceedings of Genetic and Evolutionary Computation Conference (GECCO 2007), pp. 1702-1707.
42. th International Conference on Genetic Algorithms, pp. 303-309. San Mateo, CA: Morgan Kaufmann.
43. Witten, I. H., and Frank, E. (2005). Data mining: Practical machine learning tools. San Mateo, CA: Morgan Kaufmann.
44. th World Conference on Soft Computing (WSC6).
45. Zhang, Y., and Rockett, P. I. (2005a). Evolving optimal feature extraction using multi-objective genetic programming: A methodology and preliminary study on edge detection. In H.-G. Beyer, U.-M. O'Reilly, D. V. Arnold, W. Banzhaf, C. Blum, et al. (Eds.), Proceedings of Genetic and Evolutionary Computation Conference (GECCO 2005), pp. 795-802.
46. Zhang, Y., and Rockett, P. I. (2005b). A generic optimal feature extraction method using multi-objective genetic programming: Methodology and applications. Submitted to Applied Soft Computing.
47. Zhang, Y., and Rockett, P. I. (2006). Feature extraction using multi-objective genetic programming. In Y. Jin (Ed.), Multi-objective machine learning (pp. 75-99). Berlin: Springer.
48. Zhang, Y., and Rockett, P. I. (2007). Domain-independent approaches to optimize feature extraction for multi-classification using multi-objective genetic programming. Submitted to Pattern Analysis & Its Applications.
49. Zhang, Y., and Zhang, M. (2004). A multiple output program tree structure in genetic programming. Technical Report CS-TR-04/14, Department of Computer Science, School of Mathematical and Computing Sciences, Victoria University, Wellington, New Zealand.