Genetic programming for simultaneous feature selection and classifier design

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 36, Issue 1, 2006, Pages 106-117

  Muni, Durga Prasad ^a   Pal, Nikhil R ^a   Das, Jyotirmoy ^a  

^a INDIAN STATISTICAL INSTITUTE   (India)

Author keywords

Classification; Classifier design; Evolutionary algorithm; Feature selection; Genetic programming

Indexed keywords

GENETIC ALGORITHMS; ONLINE SYSTEMS; PROBABILITY; STATISTICS;

CLASSIFICATION; CLASSIFIER DESIGN; FEATURE SELECTION; GENETIC PROGRAMMING;

EVOLUTIONARY ALGORITHMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; INFORMATION RETRIEVAL; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; INFORMATION STORAGE AND RETRIEVAL; MODELS, GENETIC; PATTERN RECOGNITION, AUTOMATED;

EID: 31744443319     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2005.854499     Document Type: Article

References (53)

1. M. Dash and H. Liu, "Feature selection for classification," Intel. Data Anal., vol. 1, no. 3, pp. 131-156, 1997.
2. K. Kira and L. A. Rendell, "The feature selection problem: Traditional methods and a new algorithms," in Proc. 9th Nat. Conf. Artificial Intelligence, 1992, pp. 129-134.
3. P. M. Narendra and K. Fukunaga, "A branch and bound algorithm for feature selection," IEEE Trans. Comput., vol. C-26, no. 9, pp. 917-922, Sep. 1977.
4. M. Last, A. Kandel, and O. Maimon, "Information-theoretic algorithm for feature selection," Patt. Recognit. Lett., vol. 22, pp. 799-811, 2001.
5. N. Kwak and C.-H. Choi, "Input feature selection for classification problems," IEEE Trans. Neural Netw., vol. 13, no. 1, pp. 143-159, Jan. 2002.
6. A. N. Mucciardi and E. E. Gose, "A comparison of seven techniques for choosing subsets of pattern recognition," IEEE Trans. Comput., vol. C-20, pp. 1023-1031, Sep. 1971.
7. M. Dash and H. Liu, "Consistency-based search in feature selection," Artif. Intell., vol. 151, pp. 155-176, 2003.
8. G. V. Lashkia and L. Anthony, "Relevant, irredundant feature selection and noisy example elimination," IEEE Trans. Syst., Man, Cybern. B, vol. 34, no. 2, pp. 888-897, Apr. 2004.
9. R. Kohavi and G. H. John, "Wrappers for feature subset selection," Artif. Intell., vol. 97, pp. 273-324, 1997.
10. A. L. Blum and P. Langley, "Selection of relevant features and examples in machine learning," Artif. Intell. Special Issue on Relevance, vol. 97, pp. 245-271, 1997.
11. M. Kudo and J. Sklansky, "Comparison of algorithms that select features for pattern classifiers," Patt. Recognit., vol. 33, pp. 25-41, 2000.
12. N. R. Pal, "Soft computing for feature analysis," Fuzzy Sets and Syst., vol. 103, pp. 201-221, 1999.
13. I. Guyon and A. Elisseeff, "An introduction to variables and feature selection," J. Mach. Learn. Res., vol. 3, pp. 1157-1182, 2003.
14. A. Jain and D. Zongker, "Feature selection: Evaluation, application, and small sample performance," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 2, pp. 153-158, Feb. 1997.
15. R. K. De, N. R. Pal, and S. K. Pal, "Feature analysis: Neural network and fuzzy set theoretic approaches," Patt. Recognit., vol. 30, pp. 1579-1590, 1997.
16. G. Forman, "An extensive empirical study of feature selection metrics for text classification," J. Mach. Res., vol. 3, pp. 1289-1305, 2003.
17. P. A. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach. Englewood Cliffs, NJ: Prentice-Hall, 1982.
18. P. Pudil, J. Novovicova, and J. Kittler, "Floating search methods in feature selection," Patt. Recognit. Lett., vol. 15, pp. 1119-1125, 1994.
19. H. Zhang and G. Sun, "Feature selection using tabu search method," Patt. Recognit., vol. 35, pp. 701-711, 2002.
20. N. R. Pal and K. Chintalapudi, "A connectionist system for feature selection," Neural, Parallel, and Sci. Comput., vol. 5, pp. 359-381, 1997.
21. R. Setiono and H. Liu, "Neural-network feature selector," IEEE Trans. Neural Netw., vol. 8, no. 3, May 1997.
22. A. Verikas and M. Bacauskiene, "Feature selection with neural networks," Patt. Recognti. Lett., vol. 23, pp. 1323-1335, 2002.
23. K. Z. Mao, "Feature subset selection for support vector machines through discriminative function pruning analysis," IEEE Trans. Syst., Man, Cybern. B, vol. 34, no. 1, pp. 60-67, Feb. 2004.
24. J. Bi, K. P. Bennett, M. Embrechts, C. M. Breneman, and M. Song, "Dimensionality reduction via sparse support vector machines," J. Mach. Learn. Res., vol. 1, pp. 1-48, 2002.
25. W. Siedlecki and J. Sklansky, "A note on genetic algorithms for large-scale feature selection," Patt. Recognit. Lett., vol. 10, pp. 335-347, 1989.
26. W. Siedlecki and J. Sklansky, "On automatic feature selection," Int. J. Pattern Recognit. Artif. Intell., vol. 2, no. 2, pp. 197-220, 1988.
27. J. Casillas, O. Cordon, M. J. Del Jesus, and F. Herrera, "Genetic feature selection in a fuzzy rule-based classification system learning process for high-dimensional problems," Inform. Sci., vol. 136, pp. 135-157, 2001.
28. M. Richeldi and P. Lanzi, "Performing effective feature selection by investigating the deep structure of the data," in Proc. 2nd Int. Conf. Knowledge Discovery and Data Mining. Menlo Park, CA, 1996, pp. 379-383.
29. N. R. Pal, S. Nandi, and M. K. Kundu, "Self-crossover: A new genetic operator and its application to feature selection," Int. J. Syst. Sci., vol. 29, no. 2, pp. 207-212, 1998.
30. M. Ahluwalia and L. Bull, "Coevolving functions in genetic programming," J. Syst. Architect., vol. 47, no. 7, pp. 573-585, July 2001.
31. J. Sherrah, R. E. Bogner, and A. Bouzerdoum, "Automatic selection of features for classification using genetic programming," in Proc. 1996 Australian New Zealand Conf. Intelligent Information Systems, pp. 284-287.
32. J. R. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, MA: MIT Press, 1992.
33. W. Banzhaf, P. Nordin, R. E. Keller, and F. D. Francone, Genetic Programming: An Introduction. New York: Morgan Kaufmann, 1998.
34. 1H nuclear magnetic resonance spectra from human brain tumor biopsies," NMR Biomed., vol. 11, pp. 217-224, 1998.
35. H. Guo, L. B. Jack, and A. K. Nandi, "Feature generation using genetic programming with application to fault classification," IEEE Trans. Syst., Man, Cybern. B, vol. 35, no. 1, pp. 89-99, 2005.
36. D. Chakraborty and N. R. Pal, "A neuro-fuzzy scheme for simultaneous feature selection and fuzzy rule-based classification," IEEE Trans. Neural Netw., vol. 15, no. 1, pp. 110-123, 2004.
37. D. Chakraborty and N. R. Pal, "Integrated feature analysis and fuzzy rule-based system identification in a neuro-fuzzy paradigm," IEEE Trans. Syst., Man, Cybern. B, vol. 31, no. 3, pp. 391-400, 2001.
38. D. P. Muni, N. R. Pal, and J. Das, "A novel approach for designing classifiers using genetic programming," IEEE Trans. Evolut. Comput., vol. 8, no. 2, pp. 183-196, Apr. 2004.
39. J. K. Kishore, L. M. Patnaik, V. Mani, and V. K. Agrawal, "Application of genetic programming for multicategory pattern classification," IEEE Transaction on Evolutionary Computation, vol. 4, pp. 242-258, Sept. 2000.
40. P. Domingos, "Context-sensitive feature selection for lazy learners," Artif. Intell. Rev., vol. 11, pp. 227-253, 1997.
41. E. Anderson, "The irises of the gaspe peninsula," Bulletin of the Amer. IRIS Soc., vol. 59, pp. 2-5, 1935.
42. C. L. Blake and C. J. Merz, UCI Repository of Machine Learning Databases: Univ. of California, Dept. of Inform. Comput. Sci., 1998.
43. O. L. Mangasarian, W. N. Street, and W. H. Wolberg, "Breast cancer diagnosis and prognosis via linear programming," Oper. Res., vol. 43, no. 4, pp. 570-577, 1995.
44. R. P. Gorman and T. J. Sejnowski, "Analysis of hidden units in a layered network trained to classify sonar targets," Neural Netw., vol. 1, pp. 75-89, 1988.
45. S.-B. Cho and J. Ryu, "Classifying gene expression data of cancer using classifier ensemble with mutually exclusive features," Proc. IEEE, vol. 19, no. 11, pp. 1744-1753, Nov. 2002.
46. T. R. Golub, D. K. Slonim, P. Tamayo, C. Huard, M. Gaasenbeek, J. P. Mesirov, H. Coller, M. L. Loh, J. R. Downing, M. A. Caligiuri, C. D. Bloomfield, and E. S. Lander, "Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring," Science, vol. 286, pp. 531-537, 1999.
47. D. Zongker and W. F. Punch. Lilgp 1.0 User's Manual. MSU Genetic Algorithms and Research Application Group (GARAGe). [Online]. Available: http://garage.cps.msu.edu
48. K. W. Bauer Jr., S. G. Alsing, and K. A. Greene, "Feature screening using signal-to-noise ratios," Neurocomputing, vol. 31, pp. 29-44, 2000.
49. T. S. Furey, N. Cristianini, N. Duffy, D. W. Bednarski, M. Schummer, and D. Haussler, "Support vector machine classification and validation of cancer tissue samples using microarray expression data," Bioinformatics, vol. 16, no. 10, pp. 906-914, 2000.
50. A. Ben-Dor, L. Bruhn, N. Friedman, I. Nachman, M. Schummer, and N. Yakhini, "Tissue classification with gene expression profiles," J. Comput. Biol., vol. 7, pp. 559-584, 2000.
51. D. V. Nguyen and D. M. Rocke, "Tumor classification by partial least squares using microarray gene expression data," Bioinformatics, vol. 18, no. 1, pp. 39-50, 2002.
52. J. J. Rowland, "Model selection methodology in supervised learning with evolutionary computation," Biosystems, vol. 72, pp. 187-196, 2003.
53. T. G. Dietterich, "Approximate statistical tests for comparing supervised classification learning algorithms," Neural Comput., vol. 10, no. 7, pp. 1895-1923, 1998.