Unsupervised feature selection using incremental least squares

International Journal of Information Technology and Decision Making

Volumn 10, Issue 6, 2011, Pages 967-987

  Liu, Rong ^a   Rallo, Robert ^a,b   Cohen, Yoram ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITAT ROVIRA I VIRGILI   (Spain)

Author keywords

data mining; Feature selection; filter; kernel method; least squares

Indexed keywords

EID: 82455192705     PISSN: 02196220     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219622011004671     Document Type: Article

References (68)

1. Y. Shi, The research trend of information technology and decision making in 2009, International Journal of Information Technology and Decision Making 9(1) (2010) 1-8.
2. Y. Peng, G. Kou, Y. Shi and Z. X. Chen, A descriptive framework for the field of data mining and knowledge discovery, International Journal of Information Technology and Decision Making 7(4) (2008) 639-682.
3. M. Arakawa, K. Hasegawa and K. Funatsu, The recent trend in QSAR modeling - Variable selection and 3D-QSAR methods, Current Computer-Aided Drug Design 3(4) (2007) 254-262. (Pubitemid 350268173)
4. Z. X. Chen, From data mining to behavior mining, International Journal of Information Technology and Decision Making 5(4) (2006) 703-711.
5. Y. Shi, Y. Peng, W. Xu and X. Tang, Data mining via multiple criteria linear programming: Applications in credit card portfolio management, International Journal of Information Technology and Decision Making 1(1) (2002) 131-151.
6. Y. Liu, J. Li, W. K. Liao, A. Choudhary and Y. Shi, High utility itemsets mining, International Journal of Information Technology and Decision Making 9(6) (2010) 905-934.
7. Y. Peng, G. Kou, G. X. Wang, W. S. Wu and Y. Shi, Ensemble of software defect predictors: An AHP-based evaluation method, International Journal of Information Technology and Decision Making 10(1) (2011) 187-206.
8. Y. Peng, G. Kou, G. X. Wang, H. G. Wang and F. I. S. Ko, Empirical evaluation of classifiers for software risk management, International Journal of Information Technology and Decision Making 8(4) (2009) 749-767.
9. Y. Shi, Y. Peng, G. Kou and Z. X. Chen, Classifying credit card accounts for business intelligence and decision making: A multiple-criteria quadratic programming approach, International Journal of Information Technology and Decision Making 4(4) (2005) 581-599. (Pubitemid 44099616)
10. L. Chen, Z. F. Zhou, Y. Peng and G. Kou, Structural model for determining enterprise group's integrated lines of credit, International Journal of Information Technology and Decision Making 10(2) (2011) 269-285.
11. F. W. Glover and G. Kochenberger, New optimization models for data mining, International Journal of Information Technology and Decision Making 5(4) (2006) 605-609. (Pubitemid 44917237)
12. C. Y. Tsai, C. C. Lo and C. W. Lin, A time-interval sequential pattern change detection method, International Journal of Information Technology and Decision Making 10(1) (2011) 83-108.
13. Q. Yang and X. D. Wu, 10 challenging problems in data mining research, International Journal of Information Technology and Decision Making 5(4) (2006) 597-604.
14. A. Dove, Screening for content-the evolution of high throughput, Nature Biotechnology 21(8) (2003) 859-64. (Pubitemid 36936186)
15. K. V. R. Kanth, D. Agrawal and A. Singh, Dimensionality reduction for similarity searching in dynamic databases, SIGMOD Record 27(2) (1998) 166-176. (Pubitemid 128655966)
16. F. Korn, B. U. Pagel and C. Faloutsos, On the 'Dimensionality Curse' and the 'Self- Similarity Blessing', IEEE Transactions on Knowledge and Data Engineering 13(1) (2001) 96-111. (Pubitemid 32301046)
17. B. U. Pagel, F. Korn and C. Faloutsos, Deflating the dimensionality curse using multiple fractal dimensions, 16th International Conference on Data Engineering, 2000, pp. 589-598. (Pubitemid 30585710)
18. A. L. Blum and P. Langley, Selection of relevant features and examples in machine learning, Artificial Intelligence 97(1-2) (1997) 245-271. (Pubitemid 127401106)
19. I. Guyon and A. Elisseeff, An introduction to variable and feature selection, Journal of Machine Learning Research 3(7-8) (2003) 1157-1182.
20. E. P. M. de Sousa, C. Traina, A. J. M. Traina, L. J. Wu and C. Faloutsos, A fast and effective method to find correlations among attributes in databases, Data Mining and Knowledge Discovery 14(3) (2007) 367-407. (Pubitemid 46582606)
21. J. B. Tenenbaum, V. de Silva and J. C. Langford, A global geometric framework for nonlinear dimensionality reduction, Science 290(5500) (2000) 2319-2323. (Pubitemid 32041577)
22. S. T. Roweis and L. K. Saul, Nonlinear dimensionality reduction by locally linear embedding, Science 290(5500) (2000) 2323-2326. (Pubitemid 32041578)
23. G. H. John, R. Kohavi and K. Pfleger, Irrelevant features and the subset selection problem, 11th International Conference on Machine Learning, 1994, pp. 121-129.
24. H. Liu and L. Yu, Toward integrating feature selection algorithms for classification and clustering, IEEE Transactions on Knowledge and Data Engineering 17(4) (2005) 491-502. (Pubitemid 40495592)
25. A. R. Webb, Statistical Pattern Recognition, 2nd edn. (Wiley, 2002).
26. A. K. Jain, R. P.W. Duin and M. Jianchang, Statistical pattern recognition: A review, IEEE Transactions on Pattern Analysis and Machine Intelligence 22(1) (2000) 4-37. (Pubitemid 32132953)
27. I. T. Jolliffe, Principle Component Analysis, 2nd edn. (Springer, 2002).
28. H. Hoffmann, Kernel PCA for novelty detection, Pattern Recognition 40(3) (2007) 863-874. (Pubitemid 44667761)
29. X. Yong, D. Zhang, J. Yang, J. Zhong and J. Y. Yang, Evaluate dissimilarity of samples in feature space for improving KPCA, International Journal of Information Technology and Decision Making 10(3) (2011) 479-495.
30. J. P. Ye, Generalized low rank approximations of matrices, Machine Learning 61(1-3) (2005) 167-191.
31. H. L. Wei and S. A. Billings, Feature subset selection and ranking for data dimensionality reduction, IEEE Transactions on Pattern Analysis and Machine Intelligence 29(1) (2007) 162-166. (Pubitemid 46415953)
32. H. W. Liu, J. Sun, L. Liu and H. J. Zhang, Feature selection with dynamic mutual information, Pattern Recognition 42(7) (2009) 1330-1339.
33. R. Kohavi and G. H. John,Wrappers for feature subset selection, Artificial Intelligence 97(1-2) (1997) 273-324. (Pubitemid 127401107)
34. L. Huan and R. Setiono, A probabilistic approach to feature selection-a filter solution, 13th International Conference on Machine Learning, 1996, pp. 319-327.
35. J. Loughrey and P. Cunningham, Overfitting in wrapper-based feature subset selection: The harder you try the worse it gets, 24th SGAI Int. Conf. on Innovative Techniques and Applications of Artificial Intelligence (2004), pp. 33-43.
36. L. Yu and H. Liu, Redundancy based feature selection for microarray data, 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2004, pp. 737-742. (Pubitemid 40115000)
37. T. Jebara and T. Jaakkola, Feature selection and dualities in maximum entropy discrimination, 16th Conference on Uncertainty in Artificial Intelligence, 2000, pp. 291-300.
38. M. Robnik-Sikonja and I. Kononenko, Theoretical and empirical analysis of ReliefF and RReliefF, Maching Learning 53(1-2) (2003) 23-69.
39. P. Pudil and J. Novovicova, Novel methods for subset selection with respect to problem knowledge, IEEE Intelligent Systems and Their Applications 13(2) (1998) 66-74.
40. M. Dash and V. Gopalkrishnan, Distance based feature selection for clustering microarray data, in 13th Int. Conf. on Database Systems for Advanced Applications (2008), pp. 512-519.
41. H. Almuallim and T. G. Dietterich, Learning Boolean concepts in the presence of many irrelevant features, Artificial Intelligence 69(1-2) (1994) 279-305.
42. M. Dash and H. Liu, Consistency-based search in feature selection, Artificial Intelligence 151(1-2) (2003) 155-176.
43. M. A. Hall, Correlation-based feature selection for discrete and numeric class machine learning, 17th International Conference on Machine Learning, 2000, pp. 359-366.
44. M. Modrzejewski, Feature selection using rough sets theory, European Conference on Machine Learning, 1993, pp. 213-226.
45. S. Das, Filters, wrappers and a boosting-based hybrid for feature selection, 18th International Conference on Machine Learning, 2001, pp. 74-81.
46. E. P. Xing, M. I. Jordan and R. M. Karp, Feature selection for high-dimensional genomic microarray data, 18th International Conference on Machine Learning, 2001, pp. 601-608.
47. Y. Li and Z. F. Wu, Fuzzy feature selection based on min-max learning rule and extension matrix, Pattern Recognition 41(1) (2008) 217-226. (Pubitemid 47284220)
48. D. Huang and T. W. S. Chow, Efficiently searching the important input variables using Bayesian discriminant, IEEE Transactions on Circuits and Systems Part I: Regular Papers 52(4) (2005) 785-793. (Pubitemid 40608440)
49. J. P. Li, Z. Y. Chen, L. W. Wei and W. X. Xu, Feature selection via least squares support feature machine, International Journal of Information Technology and Decision Making 6(4) (2007) 671-686.
50. M. Dash, K. Choi, P. Scheuermann and H. Liu, Feature selection for clustering - A filter solution, IEEE International Conference on Data Mining, 2002, pp. 115-122.
51. P. Mitra, C. A. Murthy and S. K. Pal, Unsupervised feature selection using feature similarity, IEEE Transactions on Pattern Analysis and Machine Intelligence 24(3) (2002) 301-312. (Pubitemid 35289348)
52. L. Wolf and A. Shashua, Feature selection for unsupervised and supervised inference: The emergence of sparsity in a weight-based approach, Journal of Machine Learning Research 6 (2005) 1855-1887.
53. X. He, D. Cai and P. Niyog, Laplacian score for feature selection, Advances in Neural Information Processing Systems 18 (2005) 507-514.
54. Z. Zhao and H. Liu, Spectral feature selection for supervised and unsupervised learning, 24th International Conference on Machine learning, 2007, pp. 1151-1157. (Pubitemid 47275183)
55. K. Z. Mao, Identifying critical variables of principal components for unsupervised feature selection, IEEE Transactions on Systems Man and Cybernetics Part B: Cybernetics 35(2) (2005) 339-344. (Pubitemid 40535916)
56. W. J. Krzanowski, Selection of variables to preserve multivariate data structure, using principal components, Journal of the Royal Statistical Society: Series C (Applied Statistics) 36(1) (1987) 22-33.
57. Y. M. Cheung and H. Zeng, Local kernel regression score for selecting features of highdimensional data, IEEE Transactions on Knowledge and Data Engineering 21(12) (2009) 1798-1802.
58. C. T. Jr., A. Traina, L. Wu and C. Faloutsos, Fast feature selection using the fractal dimension, XV Brazilian Symp. on Databases, 2000, pp. 158-171.
59. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods, 1st edn. (Cambridge University Press, 2000).
60. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis, 1st edn. (Cambridge University Press, 2004).
61. C. M. Bishop, Pattern recognition and machine learning, 2nd edn., Information Science and Statistics, eds. M. Jordan, J. Kleinberg and B. Scholkopf (Springer, 2006).
62. M. H. Dunham, Data Mining: Introductory and Advanced Topics (Prentice Hall, 2002).
63. D. Yan, L. Huang and M. I. Jordan, Fast approximate spectral clustering, 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2009, pp. 907-916.
64. A. Frank and A. Asuncion, UCI Machine Learning Repository (2010), http://archive. ics.uci.edu/ml.
65. USPS, http://www-stat-class.stanford.edu/~tibs/ElemStatLearn/data.html.
66. PIE, http://www.ri.cmu.edu/projects/project 418.html.
67. UMist, http://www.sheffield.ac.uk/eee/research/vie/research/face.html.
68. C. W. Hsu, C. C. Chang and C. J. Lin, A practical guide to support vector classification, Department of Computer Science, National Taiwan University (2010).