Feature extraction and dimensionality reduction by genetic programming based on the Fisher criterion

Expert Systems

Volumn 25, Issue 5, 2008, Pages 444-459

  Guo, Hong ^a   Zhang, Qing ^a   Nandi, Asoke K ^a  

^a UNIVERSITY OF LIVERPOOL   (United Kingdom)

Author keywords

Dimensionality reduction; Feature extraction; Fisher discriminant analysis; Genetic programming; Pattern classification

Indexed keywords

COMPUTER PROGRAMMING; DISCRIMINANT ANALYSIS; FISHER INFORMATION MATRIX; GENETIC ALGORITHMS; GENETIC PROGRAMMING; PATTERN RECOGNITION; PRINCIPAL COMPONENT ANALYSIS; VECTORS;

DIMENSIONAL SPACES; DIMENSIONALITY REDUCTION; DIMENSIONALITY REDUCTIONS; DISCRIMINANT FUNCTIONS; FEATURE EXTRACTION METHODS; FEATURE SPACES; FEATURE VECTORS; FISHER CRITERIONS; FISHER DISCRIMINANT ANALYSIS; FITNESS VALUES; GENERALIZED DISCRIMINANT ANALYSES; IMPROVED PERFORMANCES; KERNEL PRINCIPAL COMPONENT ANALYSES; LINEAR FEATURE EXTRACTIONS; LINEAR FEATURES; MULTICLASS RECOGNITIONS; PATTERN CLASSIFICATION; PATTERN RECOGNITION PROBLEMS;

FEATURE EXTRACTION;

EID: 54849430430     PISSN: 02664720     EISSN: 14680394     Source Type: Journal    
DOI: 10.1111/j.1468-0394.2008.00451.x     Document Type: Article

References (30)

1. Aladjem, M.E. (1998) Nonparametric discriminant analysis via recursive optimization of Patrick-Fisher distance, IEEE Transactions on Systems, Man and Cybernetics, Part B, 28 (2), 292 299.
2. Baudat, G. F. Anouar (2000) Generalized discriminant analysis using a kernel approach, Neural Computation, 10, 2385 2404.
3. Brameier, M. W. Banzhaf (2001) A comparison of linear genetic programming and neural networks in medical data mining, IEEE Transactions on Evolutionary Computation, 5 (1), 17 26.
4. Brunzell, H. J. Eriksson (2000) Feature extraction for classification of multidimensional data, Pattern Recognition, 33, 1741 1748.
5. Chang, M.J. A.K. Jain (1995) Artificial neural networks for feature extraction and multivariate data projection, IEEE Transactions on Neural Networks, 5 (2), 296 317.
6. Chen, S. X. Yang (2004) Alternative linear discriminant classifier, Pattern Recognition, 37, 1545 1547.
7. Chien, B.C., J.Y. Lin T.P. Hong (2002) Learning discriminant functions with fuzzy attributes for classification using genetic programming, Expert Systems with Applications, 23, 31 37.
8. Chien, B.C., J.Y. Lin W.P. Yang (2004) Learning effective classifiers with Z-value measure based on genetic programming, Pattern Recognition, 37, 1957 1972.
9. Cooke, T. (2002) Two variations on Fisher's linear discriminant for pattern recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 268 273.
10. Devroye, L., L. Gyrfi G. Lugosi (1996) A Probabilistic Theory of Pattern Recognition, New York : Springer.
11. Guo, H., L.B. Jack A.K. Nandi (2005) Feature generation using genetic programming with application to fault classification, IEEE Transactions on Systems, Man and Cybernetics, Part B, 35 (1), 89 99.
12. Heerman, P.D. N. Khazenie (1992) Classification of multispectral remote sensing data using a back propagation neural network, IEEE Transactions on Geoscience and Remote Sensing, 30 (1), 81 88.
13. Jack, L.B. A.K. Nandi (2000) Genetic algorithms for feature selection in machine condition monitoring with vibration signals, IEE Proceedings on Vision, Image and Signal Processing, 147 (3), 205 212.
14. Kishore, J.K., L.M. Patnaik, V. Mani V.K. Arawal (2000) Application of genetic programming for multicategory pattern classification, IEEE Transactions on Evolutionary Computation, 4 (3), 242 258.
15. Kotani, M., S. Ozawa, M. Nasak K. Akazawa (1997) Emergence of feature extraction function using genetic programming, in Knowledge-Based Intelligent Information Engineering Systems, 3rd International Conference, ISBN 0-7803-5578-4, 194 152.
16. Koza, J.R. (1992) Genetic Programming: On the Programming of Computers by Means of Natural Selection, Cambridge, MA : MIT Press.
17. Loog, M., R.P.W. Duin R. Haeb-Umbach (2001) Multiclass linear dimension reduction by weighted pairwise Fisher criteria, IEEE Transactions on Pattern Analysis and Machine Intelligence, 23, 762 766.
18. Merz, C.J. P.M. Murphy (1996) UCI repository of machine learning databases.
19. Mika, S., G. Ratsch, J. Weston, B. Scholkopf, A. Smola K. Muller (2003) Constructing descriptive and discriminative non-linear features: Rayleigh coefficients in kernel feature spaces, IEEE Transactions on Pattern Analysis and Machine Intelligence, 25 (5), 623 628.
20. Muller, K.R., S. Mika, G. Ratsch, K. Tsuda B. Scholkopf (2001) An introduction to kernel-based learning algorithms, IEEE Transactions on Neural Networks, 12 (2), 181 201.
21. Muni, D.P., N.R. Pal J. Das (2004) A novel approach to design classifiers using genetic programming, IEEE Transactions on Evolutionary Computation, 8, 183 196.
22. Osuna, E., R. Freund F. Girosi (1997) Support vector machines: training and applications, Technical Report, Massachusetts Institute of Technology.
23. Philip, K.P., E.L. Dove, D.D. McPherson, N.L. Gotteiner, W. Stanford K.B. Chandran (1994) The fuzzy Hough transform feature extraction in medical images, IEEE Transactions on Medical Imaging, 13 (2), 235 240.
24. Raymer, M.L., W.F. Punch, E.D. Goodman, L.A. Kuhn A.K. Jain (2000) Dimensionality reduction using genetic algorithms, IEEE Transactions on Evolutionary Computation, 4, 164 171.
25. Ripley, B.D. (2004) Pattern Recognition and Neural Networks, Cambridge : Cambridge University Press.
26. Scholkopf, B., A. Smola K.R. Muller (1998) Non-linear component analysis as a kernel eigenvalue problem, Neural Computation, 10, 1299 1309.
27. Shawe-Taylor, J. N. Cristianini (2004) Kernel Methods for Pattern Analysis, Cambridge : Cambridge University Press.
28. Sherrah, J.R., R.E. Bogner A. Bouzerdoum (1997) The evolutionary pre-processor: automatic feature extraction, for supervised classification using genetic programming, in Proceedings of the 2nd International Conference on Genetic Programming (GP-97), San Francisco, CA: Morgan Kaufmann, 304 312.
29. Yang, J. V. Honvar (1998) Feature subset selection using a genetic algorithm, IEEE Intelligent Systems, 13, 44 49.
30. Yang, J., Z. Jin, J.Y. Yang, D. Zhang A.F. Frangi (2004) Essence of kernel Fisher discriminant: KPCA plus LDA, Pattern Recognition, 37, 2097 2100.