Ensemble feature weighting based on local learning and diversity

Proceedings of the National Conference on Artificial Intelligence

Volumn 2, Issue , 2012, Pages 1019-1025

  Li, Yun ^a   Gao, Suyan ^a   Chen, Songcan ^b  

^a NANJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^b NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION ACCURACY; DATA SETS; ENSEMBLE FEATURE SELECTIONS; ENSEMBLE METHODS; FEATURE WEIGHTING; LOCAL LEARNING; SAMPLE COMPLEXITY; SAMPLE WEIGHTING; SMALL SAMPLES;

ARTIFICIAL INTELLIGENCE;

EID: 84868285653     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (34)

1. Abeel, T.; Helleputte, T.; de Peer, Y. V.; Dupont, P.; and Saeys, Y. 2010. Robust biomarker identification for cancer diagnosis with ensemble feature selection methods. Bioinformatics 26:392-398.
2. Alon, U.; Barkai, N.; Notterman, D. A.; Gish, K.; Ybarra, S.; Mack, D.; and Levine, A. J. 1999. Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon cancer tissues probed by oligonucleotide arrays. In Proceedings of the National Academy of Sciences of the United States of America, 6745-6750.
3. Anthony, M., and Bartlett, P. L. 1999. Neural Network Learning: Theoretical Foundations. Cambridge, UK: Cambridge University Press.
4. Chang, C. C., and Lin, C. J. 2002. Libsvm: a library for support vector machines. In http://www.csie.ntu.edu.tw/cjlin/papers/libsvm.ps.gz.
5. Cortes, C., and Vapnik, V. 1995. Support-vector networks. Machine Learning 20:273-297.
6. Crammer, K.; Bachrach, R. G.; Navot, A.; and Tishby, N. 2002. Margin analysis of the lvq algorithm. In Advances in Neural Information Processing Systems, 462-469.
7. Forman, G. 2003. An extensive empirical study of feature selection metrics for text classification. Journal of Machine Learning Research 3:1289-1305.
8. Frank, A., and Asuncion, A. 2010. UCI machine learning repository. In http://archive.ics.uci.edu/ml.
9. Guyon, I., and Elisseeff, A. 2003. An introduction to variable and feature selection. Journal of Machine Learning Research 31:1157-1182.
10. Guyon, I.; Weston, J.; Barnhill, S.; and Vapnik, V. 2002. Gene selection for cancer classification using support vector machines. Machine Learning 46:389-422.
11. Guyon, I.; Gunn, S.; Nikravesh, M.; and Zadeh, L. 2006. Feature Extraction, Foundations and Applications. Physica-Verlag, New York: Springer.
12. Han, Y., and Yu, L. 2010. A variance reduction for stable feature selection. In Proceedings of the International Conference on Data Mining, 206-215.
13. Inza, I.; Larranaga, P.; Blanco, R.; and Cerrolaza, A. J. 2004. Filter versus wrapper gene selection approaches in dna microarray domains. Artificial Intelligence in Medicine 31:91-103.
14. Kalousis, A.; Prados, J.; and Hilario, M. 2007. Stability of feature selection algorithms: a study on high dimensional spaces. Knowledge and Information Systems 12:95-116.
15. Kira, K., and Rendell, L. 1992. A practical approach to feature selection. In Proceedings of International Conference on Machine Learning, 249-256.
16. Kononenko, I. 1994. Estimating attributes: Analysis and extension of relief. In Proceedings of European Conference on Machine Learning, 171-182.
17. Li, Y., and Lu, B. L. 2009. Feature selection based on loss margin of nearest neighbor classification. Pattern Recognition 42:1914-1921.
18. Liu, H., and Yu, L. 2005. Toward integrating feature selection algorithms for classification and clustering. IEEE Trans. Knowledge and Data Engineering 17:494-502.
19. Loscalzo, S.; Yu, L.; and Ding, C. 2009. Consensus group stable feature selection. In Proceedings of ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 567-575.
20. Ng, A. Y. 2004. Feature selection, 11 vs. 12 regularization, and rotational invariance. In Proceedings of International Conference on Machine Learning.
21. Pollard, D. 1984. Convergence of stochastic processes. New York: Springer-Verlag.
22. Robnik-Sikonja, M., and Kononenko, I. 2003. Theoretical and empirical analysis of relieff and rrelieff. Machine Learning 53:23-69.
23. Saeys, Y.; Abeel, T.; and de Peer, Y. V. 2008. Robust feature selection using ensemble feature selection techniques. In Proceedings of the 25th European Conference on Machine Learning and Knowledge Discovery in Databases, 313-325.
24. Saeys, Y.; Inza, I.; and Larranaga, P. 2007. A review of feature selection techniques in bioinformatics. Bioinformatics 23:2507-2517.
25. Schapire, R. E.; Freud, Y.; Bartlett, P.; and Lee, W. S. 1998. Boosting the margin: A new explanation for the effectiveness of voting methods. The Annals of Statistics 26:1651-1686.
26. Sun, Y. J.; Todorovic, S.; and Goodison, S. 2010. Local learning based feature selection for high dimensional data analysis. IEEE Trans. Pattern Analysis and Machine Intelligence 32:1-18.
27. Sun, Y. J. 2007. Iterative relief for feature weighting: Algorithms, theories, and applications. IEEE Trans. on Pattern Analysis and Machine Intelligence 29:1035-1051.
28. Takeuchi, I., and Sugiyama, M. 2011. Target neighbor consistent feature weighting for nearest neighbor classification. In Advances in Neural Information Processing Systems, 1-9.
29. Vapnik, V. 1998. Statistical Learning Theory. New York: Wiley.
30. Wasikowski, M., and Chen, X. 2010. Combating the small sample class imbalance problem using feature selection. IEEE Trans. on Knowledge and Data Engineering 22:1388-1400.
31. Yu, Y.; Li, Y. F.; and Zhou, Z. H. 2011. Diversity regularized machine. In Proceedings of the 22nd International Joint Conference on Artificial Intelligence, 1603-1608.
32. Zhang, T. 2002. Covering number bounds of certain regularized linear function classes. Journal of Machine Learning Research 2:527-550.
33. Zhao, Z.; Wang, L.; and Liu, H. 2010. Efficient spectral feature selection with minimum redundancy. In AAAI Conference on Artificial Intelligence, 673-678.
34. Zhao, Z. 2010. Spectral Feature Selection for Mining Ultrahigh Dimensional Data. Ph.D. Dissertation, Arizona State University.