Linear feature extraction by integrating pairwise and global discriminatory information via sequential forward floating selection and kernel QR factorization with column pivoting

Pattern Recognition

Volumn 41, Issue 4, 2008, Pages 1373-1383

  Chang, Chin Chun ^a   Lin, Tzung Ying ^a  

^a NATIONAL TAIWAN OCEAN UNIVERSITY   (Taiwan)

Author keywords

Feature extraction; Kernel methods; Linear discriminant analysis

Indexed keywords

DISCRIMINANT ANALYSIS; FUNCTION EVALUATION; INFORMATION ANALYSIS; LINEAR SYSTEMS; ROBUSTNESS (CONTROL SYSTEMS);

GLOBAL DISCRIMINATORY INFORMATION; KERNEL METHODS; LINEAR DISCRIMINANT ANALYSIS; SEQUENTIAL FORWARD FLOATING SELECTION;

FEATURE EXTRACTION;

EID: 36749067810     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.09.008     Document Type: Article

References (27)

1. Fisher R.A. The use of multiple measurements in taxonomic problems. Ann. Eugenics 7 (1936) 179-188
2. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. second ed. (2001), Wiley, New York
3. Fukunaga K. Introduction to Statistical Pattern Recognition. second ed. (1990), Academic Press, Boston, MA
4. Loog M., Duin R.P.W., and Haeb-Umbach R. Multiclass linear dimension reduction by weighted pairwise Fisher criteria. IEEE Trans. Pattern Anal. Mach. Intell. 23 7 (2001) 762-766
5. Loog M., and Duin R.P.W. Linear dimensionality reduction via a heteroscedastic extension of LDA: The Chernoff criterion. IEEE Trans. Pattern Anal. Mach. Intell. 26 6 (2004) 732-739
6. Qin A.K., Suganthan P.N., and Loog M. Uncorrelated heteroscedastic LDA based on the weighted pairwise Chernoff criterion. Pattern Recognition 38 (2005) 613-616
7. Li H., Jian T., and Zhang K. Efficient and robust feature extraction by maximum margin criterion. Proceedings of the Advances in Neural Information Processing System (2004), MIT Press, Vancouver, Canada
8. Brunzell H., and Eriksson J. Feature reduction for classification of multidimensional data. Pattern Recognition 33 (2000) 1741-1748
9. Tubbs J.D., Coberly W.A., and Young D.M. Linear dimension reduction and Bayes classification with unknown population parameters. Pattern Recognition 15 3 (1982) 167-172
10. Hsieh P.F., Wang D.S., and Hsu C.W. A linear feature extraction for multiclass classification problems based on class mean and covariance discriminant information. IEEE Trans. Pattern Anal. Mach. Intell. 28 2 (2006) 223-235
11. P.F. Hsieh, D.A. Landgrebe, Linear feature extraction for multiclass problems, in: Proceedings of IEEE International Geoscience and Remote Sensing Symposium, vol. 4, 1998, pp. 2050-2052.
12. Zhu M., and Martinez A.M. Subclass discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell. 28 8 (2006) 1274-1286
13. Devijver P.A., and Kittler J. Pattern Recognition A Statistical Approach (1982), Prentice-Hall, London
14. Jain A., and Zongker D. Feature selection: Evaluation, application, and small sample performance. IEEE Trans. Pattern Anal. Mach. Intell. 19 2 (1997) 153-158
15. Kudo M., and Sklansky J. Comparison of algorithms that select features for pattern classifiers. Pattern Recognition 33 (2000) 25-41
16. Guyon I., and Elisseeff A. An introduction to variable, feature selection. J. Mach. Learn. Res. 3 (2003) 1157-1182
17. G. John, R. Kohavi, K. Pfleger, Irrelevant features and the subset selection problem, in: Machine Learning: Proceedings of the Eleventh International Conference, Morgan Kaufmann, 1994, Los Altos, CA, pp. 121-129.
18. Kohavi R., and John G. Wrappers for feature selection. Artif. Intell. 97 (1997) 273-324
19. Narendra P.M., and Fukunaga K. A branch and bound algorithm for feature subset selection. IEEE Trans. Comput. c-26 9 (1977) 912-917
20. Siedlecki W., and Sklansky J. A note on genetic algorithms for large-scale feature selection. Pattern Recognition Lett. 10 (1989) 335-347
21. Yang J., and Honavar V. Feature subset selection using a genetic algorithm. IEEE Intell. Systems 13 2 (1998) 44-49
22. P. Pudil, F.J. Ferri, J. Novovičová, J. Kittler, Floating search methods for feature selection with nonmonotonic criterion functions, in: 12th International Conference on Pattern Recognition, 1994, pp. 279-283.
23. Mucciardi A.N., and Gose E.E. A comparison of seven techniques for choosing subsets of pattern recognition properties. IEEE Trans. Computers c-20 9 (1971) 1023-1031
24. Golub G.H., and Loan C.F.V. Matrix Computations. third ed. (1996), The John and Hopkins University Press, London
25. Schölkopf B., and Smola A.J. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond (2002), The MIT Press, Cambridge, MA
26. Shawe-Taylor J., and Cristianini N. Kernel Methods for Pattern Analysis (2004), Cambridge University Press, Cambridge
27. ∼mlearn/MLRepository.html〉, 1998.