Pareto front feature selection: Using genetic programming to explore feature space

Proceedings of the 11th Annual Genetic and Evolutionary Computation Conference, GECCO-2009

Volumn , Issue , 2009, Pages 1027-1034

  Neshatian, Kourosh ^a   Zhang, Mengjie ^a  

^a VICTORIA UNIVERSITY OF WELLINGTON   (New Zealand)

Author keywords

Feature subset selection; Filter approach; Genetic programming; Pareto front

Indexed keywords

BINARY CLASSIFICATION; CLASSIFICATION PERFORMANCE; CONTROL MECHANISM; FEATURE SELECTION; FEATURE SPACE; FEATURE SUBSET SELECTION; FILTER APPROACH; FILTER METHOD; LINEAR SEARCH; MATHEMATICAL EXPRESSIONS; OVERFITTING; PARETO FRONT; RUNTIMES; SEARCH SPACES;

COMPUTER SOFTWARE SELECTION AND EVALUATION; FEATURE EXTRACTION; MATHEMATICAL TRANSFORMATIONS; PARETO PRINCIPLE; SET THEORY;

GENETIC PROGRAMMING;

EID: 72749084593     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1569901.1570040     Document Type: Conference Paper

References (27)

1. A. Agresti and A. Agresti. Categorical Data Analysis. Wiley, 2003.
2. A. Asuncion and D. Newman. UCI ML repository. http://archive.ics.uci.edu/ ml/index.html, 2007.
3. Q. Cheng, P. Varshney, and M. Arora. Logistic regression for feature selection and soft classification of remote sensing data. Geoscience and Remote Sensing Letters, IEEE, 3:491-494, 2006.
4. R. A. Davis, A. J. Charlton, S. Oehlschlager, and J. C. Wilson. Novel feature selection method for genetic programming using metabolomic 1h nmr data. Chemometrics and Intelligent Laboratory Systems, 81:50-59, Mar. 2006.
5. H. F. Gray. Genetic programming for classification and feature selection: analysis of 1h nuclear magnetic resonance spectra from human brain tumour biopsies. NMR in Biomedicine, 11:217-224, 1998.
6. M. A. Hall. Correlation-based feature selection for discrete and numeric class machine learning. In Proceedings of the Seventeenth International Conference on Machine Learning, pages 359-366. Morgan Kaufmann Publishers Inc., USA, 2000.
7. F. V. Jensen and T. D. Nielsen. Bayesian Networks and Decision Graphs. 2007.
8. G. John and P. Langley. Estimating continuous distributions in bayesian classifiers. In Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence pp. 338-345, 1995.
9. S. S. Keerthi, S. K. Shevade, C. Bhattacharyya, and K. R. K. Murthy. Improvements to platt's smo algorithm for svm classifier design. Neural Comp., 13:637-649, Mar. 2001.
10. R. Kohavi and G. John. Wrappers for feature subset selection. Artificial Intelligence, 97:273-324, 1997.
11. J. R. Koza. Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge, MA, USA, 1992.
12. J. R. Koza. Genetic Programming II: Automatic Discovery of Reusable Programs. MIT Press, Cambridge Massachusetts, May 1994.
13. J. A. Landry, L. D. Costa, and T. Bernier. Discriminant feature selection by genetic programming: Towards a domain independent multi-class object detection system. Systemics, Cybernetics and Informatics, 3:76-81, 2006.
14. M. Last, A. K, and O. Maimon. Information-theoretic algorithm for feature selection. Pattern Recognition Letters, 22:799-811, 2001.
15. J.-Y. Lin, H.-R. Ke, B.-C. Chien, and W.-P. Yang. Classifier design with feature selection and feature extraction using layered genetic programming. Expert Syst. Appl., 34:1384-1393, 2008.
16. D. P. Muni, N. R. Pal, and J. Das. Genetic programming for simultaneous feature selection and classifier design. IEEE Transactions on Systems, Man and Cybernetics, Part B, 36:106-117, Feb. 2006.
17. K. Neshatian and M. Zhang. Genetic programming for feature ranking in classification problems. In Proceedings of the seventh International Conference on Simulated Evolution and Learning (SEAL'08), volume 5361 of Lecture Notes in Computer Science, Australia, 2008. Springer.
18. I. S. Oh, J. S. Lee, and B. R. Moon. Hybrid genetic algorithms for feature selection. IEEE Transactions on Pattern Analysis and Machine Intellignece, pages 1424-1437, 2004.
19. J. R. Quinlan. C4.5: Programs for Machine Learning. Morgan Kaufmann, 1993.
20. S. J. Russell and P. Norvig. Artificial Intelligence: A Modern Approach (Second Edition). Pearson Education, 2003.
21. S. Silva and E. Costa. Dynamic limits for bloat control: Variations on size and depth. In K. D. et al, editor, Genetic and Evolutionary Computation - GECCO-2004, Part II, volume 3103 of Lecture Notes in Computer Science, pages 666-677, Seattle, WA, USA, 2004. Springer-Verlag.
22. M. G. Smith and L. Bull. Genetic programming with a genetic algorithm for feature construction and selection. Genetic Programming and Evolvable Machines, 6:265-281, Sept. 2005. Published online: 17 August 2005.
23. G. Smits, A. Kordon, K. Vladislavleva, E. Jordaan, and M. Kotanchek. Variable selection in industrial datasets using pareto genetic programming. Genetic Programming, 9:79-92. Springer, Ann Arbor, 2005.
24. G. Smits and M. Kotanchek. Pareto-front exploitation in symbolic regression. page 283-299. Springer, Ann Arbor, 2004.
25. W. A. Tackett. Recombination, selection, and the genetic construction of computer programs. PhD thesis, University of Southern California, 1994.
26. I. H. Witten and E. Frank. Data Mining: Practical Machine Learning Tools and Techniques (Second Edition). Morgan Kaufmann, 2005.
27. L. Yu and H. Liu. Efficient feature selection via analysis of relevance and redundancy. Journal of Machine Learning Research, 5: 1205-1224, 2004.