Input variable selection for feature extraction in classification problems

Signal Processing

Volumn 92, Issue 3, 2012, Pages 636-648

  Choi, Sang Il ^a   Oh, Jiyong ^b   Choi, Chong Ho ^b   Kim, Chunghoon ^c  

^a Dankook University   (South Korea)

^b Seoul National University   (South Korea)

^c Qualcomm Korea R and D Center   (South Korea)

Author keywords

Feature extraction; Input variable selection; Linear discriminant analysis; Pattern classification

Indexed keywords

CLASSIFICATION PERFORMANCE; DATA SETS; FEATURE EXTRACTION METHODS; FEATURE SPACE; INPUT SPACE; INPUT VARIABLE SELECTION; INPUT VARIABLES; LINEAR DISCRIMINANT ANALYSIS;

COVARIANCE MATRIX; DISCRIMINANT ANALYSIS; SIGNAL TO NOISE RATIO;

FEATURE EXTRACTION;

EID: 80755132210     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2011.08.023     Document Type: Article

References (46)

1. P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman Eigenfaces vs. fisherfaces: recognition using class specific linear projection IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 1997 711 720 (Pubitemid 127762263)
2. A.K. Jain, R.P.W. Duin, and J. Mao Statistical pattern recognition: a review IEEE Transactions on Pattern Analysis and Machine Intelligence 22 1 2000 4 37 (Pubitemid 32132953)
3. M. Turk, and A. Pentland Eigenfaces for recognition Journal of Cognitive Neuroscience 3 1 1991 71 86
4. H. Cevikalp, M. Neamtu, M. Wilkes, and A. Barkana Discriminative common vectors for face recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 27 1 2005 914 919
5. M. Ding, Z. Tian, and H. Xu Adaptive kernel principal component analysis Original Research Article Signal Processing 90 5 2010 1542 1553
6. W. Zuo, H. Zhang, D. Zhang, and K. Wang Post-processed LDA for face and palmprint recognition: what is the rationale Signal Processing 90 8 2010 2344 2352
7. J. Lu, and Y. Zhao Dominant singular value decomposition representation for face recognition Signal Processing 90 6 2010 2087 2093
8. X. Zhou, and T. Huang Small sample learning during multimedia retrieval using biasmap Proceedings of the IEEE International Conference on Computer Vision 2001 11 17
9. S. Chen, Y. Zhu, and D. Zhang Feature extraction approaches based on matrix pattern: MatPCA and Mat FLDA Pattern Recognition Letters 26 8 2005 1157 1167 (Pubitemid 40556483)
10. H. Xiong, M. Swamy, and M. Ahmad Two-dimensional FLD for face recognition Pattern Recognition 38 7 2005 1121 1124 (Pubitemid 40537033)
11. C. Kim, and C.H. Choi A discriminant analysis using composite features for classification problems Pattern Recognition 40 7 2007 2118 2125
12. C. Kim, Pattern Recognition Using Composite Features, Ph.D. Thesis, Seoul National University, 2007.
13. M. Sikonja, and I. Kononenko Theoretical and empirical analysis of ReliefF and RReliefF Machine Learning 53 1 2003 23 69
14. R. Kohavi, and G. John Wrappers for feature subset selection Artificial Intelligence (Special Issue on Relevance) 97 1 1996 273 324 (Pubitemid 127401107)
15. I. Guyon, and A. Elisseeff An introduction to variable and feature selection Journal of Machine Learning Research 3 2003 1157 1182
16. D. Ververidis, and C. Kotropoulos Fast and accurate sequential floating forward feature selection with the Bayes classifier applied to speech emotion recognition Signal Processing 88 12 2008 2956 2970
17. J. Pacheco, S. Casado, and L. Nunez A variable selection method based on Tabu search for logistic regression models European Journal of Operational Research 199 2 2009 506 511
18. G.-M. Jeong, H.-S. Ahn, S.-I. Choi, N. Kwak, C. Moon, Pattern Recognition Using Feature Feedback: Application to Face Recognition, 2010.
19. S.-I. Choi, C.-H. Choi, G.-M. Jeong, Pixel selection in a face image based on discriminant features for face recognition, in: Proceedings of the International Conference on Automatic Face and Gesture Recognition, 2008, pp. 16.
20. S.-I. Choi, Face Recognition Based on 2D Images Under Various Conditions, Ph.D. Thesis, Seoul National University, 2010.
21. K. Fukunaga Pattern Recognition: A Statistical Approach 1982 Prentice-Hall
22. R. Caruana, D. Freitag, Greedy attribute selection, in: Proceedings of the International Conference on Machine Learning, 1994, pp. 2236.
23. D. Aha, R. Bankert, A comparative evaluation of sequential feature selection algorithms, in: Proceedings of the International Workshop on Artificial Intelligence and Statistics, 1995, pp. 17.
24. J. Doak, An evaluation of feature selection methods and their application to computer security, CSE Technical Report 92-18, University of California at Davis, 1992.
25. J. Liang, S. Yang, and A. Winstanley Invariant optimal feature selection: a distance discriminant and feature ranking based solution Pattern Recognition 41 5 2008 1429 1439
26. C. Bishop Neural Networks for Pattern Recognition 1995 Oxford University Press
27. M. Yang, Y.-J. Chen, G.-L. Ji, Semi-fisher score: a semi-supervised method for feature selection, in: Proceedings of the International Conference on Machine Learning and Cybernetics, 2010, pp. 527532.
28. X. He, D. Cai, and P. Niyogi Laplacian score for feature selection Advances in Neural Information Processing Systems 18 2006 507 514
29. Y. Jiang, J. Ren, Eigenvalue sensitive feature selection, in: Proceedings of the International Conference on Machine Learning, 2011.
30. C. Boutsidis, M. Mahoney, P. Drineas, Unsupervised feature selection for the k-means clustering problem, in: Proceedings of the International Conference on Neural Information Processing Systems, 2009.
31. N. Kwak, and C.-H. Choi Input feature selection by mutual information based on Parzen window IEEE Transactions on Pattern Analysis and Machine Intelligence 23 12 2002 1667 1671
32. T. Chow, and D. Huang Estimating optimal feature subsets using efficient estimation of high-dimensional mutual information IEEE Transactions on Neural Networks 16 1 2005 213 224 (Pubitemid 40241922)
33. S. Gunal, and R. Edizkan Subspace based feature selection for pattern recognition Information Science 178 19 2008 3716 3726
34. M. Tan, L. Wang, I. Tsang, Learning sparse SVM for feature selection on very high dimensional datasets, in: Proceedings of the International Conference on Machine Learning, 2010.
35. G.-B. Ye, Y. Chen, X. Xie, Efficient variable selection in support vector machines via the alternating direction method of multipliers, in: Proceedings of the International Conference on Artificial Intelligence and Statistics, 2011.
36. R. Kumar, V. Jayaraman, and B. Kulkarni An SVM classifier incorporating simultaneous noise reduction and feature selection: illustrative case examples Pattern Recognition 38 1 2005 41 49
37. Y. Lui, and Y. Zheng FS-SFS: a novel feature selection method for support vector machine Pattern Recognition 39 7 2006 1333 1345
38. H. Peng, F. Long, and C. Ding Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy IEEE Transactions on Pattern Analysis and Machine Intelligence 27 8 2005 1226 1238 (Pubitemid 41245053)
39. A. Unler, A. Murat, R. Chinnam, mr2PSO: a maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification, Information Science 181.
40. D. Newmanm, S. Hettich, C. Blake, C. Merz, UCI Repository of Machine Learning Databases, 1998, 〈 http://www.ics.uci.edu/mlearn/MLRepository.html 〉.
41. K. Fukunaga Introduction to Statistical Pattern Recognition second ed. 1990 Academic Press
42. P. Phillips, H. Moon, S. Rizvi, and P. Rauss The FERET evaluation methodology for face-recognition algorithms IEEE Transactions on Pattern Analysis and Machine Intelligence 22 10 2000 1090 1104
43. A.M. Martnez, R. Benevente, The AR face database, CVC Technical Report #24, Computer Vision Center (CVC), Barcelona, Spain.
44. X. Jiang, B. Mandal, and A. Kot Eigenfeature regularization and extraction in face recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 30 3 2008 1 12
45. M. Loong, and R. Duin Linear dimensionality reduction via a heteroscedastic extension of LDA: the Chrnoff criterion IEEE Transactions on Pattern Analysis and Machine Intelligence 26 6 2004 732 739
46. N. Kwak, and J. Oh Feature extraction for one-class classification problems: enhancements to biased discriminant analysis Pattern Recognition 42 1 2009 17 26