Bagging Constraint Score for feature selection with pairwise constraints

Pattern Recognition

Volumn 43, Issue 6, 2010, Pages 2106-2118

  Sun, Dan ^a   Zhang, Daoqiang ^a  

^a NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

Author keywords

Bagging; Constraint Score; Ensemble learning; Feature selection; Pairwise constraints

Indexed keywords

CARDINALITIES; CONSTRAINT SET; DATA SETS; ENSEMBLE LEARNING; FEATURE SELECTION; FEATURE SELECTION METHODS; FISHER SCORE; HIGH-DIMENSIONAL; MULTIPLE CONSTRAINT; PAIRWISE CONSTRAINTS; RESAMPLING; SINGLE CONSTRAINT; UCI REPOSITORY;

FEATURE EXTRACTION;

EID: 76749107911     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2009.12.011     Document Type: Article

References (51)

1. K. Kira, L. Rendell, The feature selection problem: traditional methods and a new algorithm, in: Proceedings of Ninth National Conference on Artificial Intelligence, 1992, pp. 129-134.
2. Guyon I., and Elisseeff A. An introduction to variable and feature selection. Journal of Machine Learning Research 3 (2003) 1157-1182
3. Hua J., Tembe W., and Dougherty E. Performance of feature-selection methods in the classification of high-dimension data. Pattern Recognition 42 3 (2009) 409-424
4. Yu L., and Liu H. Efficient feature selection via analysis of relevance and redundancy. Journal of Machine Learning Research 5 (2004) 1205-1224
5. Dy J., Brodley C., Kak A., Broderick L., and Aisen A. Unsupervised feature selection applied to content-based retrieval of lung images. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 (2003) 373-378
6. Dy J., and Brodley C.E. Feature selection for unsupervised learning. Journal of Machine Learning Research 5 (2004) 845-889
7. Z. Zhao, H. Liu, Semi-supervised feature selection via spectral analysis, in: Proceedings of the Seventh SIAM International Conference on Data Mining, Minneapolis, MN, 2007.
8. X. He, D. Cai, P. Niyogi, Laplacian score for feature selection, in: Advances in Neural Information Processing Systems, vol. 17, MIT Press, Cambridge, MA, 2005, pp. 507-514.
9. X. He, P. Niyogi, Locality preserving projections, in: Advances in Neural Information Processing Systems, vol. 16, MIT Press, Cambridge, MA, 2004, pp. 153-160.
10. Jain A., and Zongker D. Feature selection: evaluation, application, and small sample performance. IEEE Transactions on Pattern Analysis and Machine Intelligence 19 2 (1997) 153-158
11. Wang J., Plataniotis K., Lu J., and Venetsanopoulos A. Kernel quadratic discriminant analysis for small sample size problem. Pattern Recognition 41 5 (2008) 1528-1538
12. Bar-Hillel A., Hertz T., Shental N., and Weinshall D. Learning a mahalanobis metric from equivalence constraints. Journal of Machine Learning Research 6 (2005) 937-965
13. D. Zhang, Z. Zhou, S. Chen, Semi-supervised dimensionality reduction, in: Proceedings of the Seventh SIAM International Conference on Data Mining, Minneapolis, MN, 2007, pp. 629-634.
14. Zhang D., Chen S., and Zhou Z. Constraint score: a new filter method for feature selection with pairwise constraints. Pattern Recognition 41 5 (2008) 1440-1451
15. K. Wagstaff, Value, cost, and sharing: open issues in constrained clustering, in: International Workshop on Knowledge Discovery in Inductive Databases, 2007, pp. 1-10.
16. D. Opitz, Feature selection for ensembles, in: Proceedings of the 16th National Conference on Artificial Intelligence, AAAI, 1999, pp. 379-384.
17. A. Tsymbal, S. Puuronen, I. Skrypnyk, Ensemble feature selection with dynamic integration of classifiers, in: Proceedings of the International ICSC Congress on Computational Intelligence Methods and Applications CIMA'2001, Bangor, Wales, UK, 2001, pp. 558-564.
18. Tsymbal A., Puuronen S., and Patterson D.W. Ensemble feature selection with simple Bayesian classification. Information Fusion 4 (2003) 87-100
19. D. Zhang, S. Chen, Z. Zhou, Q. Yang, Constraint projections for ensemble learning, in: Proceedings of the 23rd AAAI Conference on Artificial Intelligence, Chicago, IL, 2008, pp. 758-763.
20. H. Almuallim, T. Dietterich, Learning with many irrelevant features, in: Proceedings of the Ninth National Conference on Artificial Intelligence, San Jose, 1991, pp. 547-552.
21. Kohavi R., and John G. Wrappers for feature subset selection. Artificial Intelligence 97 1-2 (1997) 273-324
22. L. Yu, H. Liu, Feature selection for high-dimensional data: a fast correlation-based filter solution, in: Proceedings of the 20th International Conferences on Machine Learning, Washington DC, 2003, pp. 601-608.
23. Liu H., Sun J., Liu L., and Zhang H. Feature selection with dynamic mutual information. Pattern Recognition 42 7 (2009) 1330-1339
24. Ziou D., Hamri T., and Boutemedjet S. A hybrid probabilistic framework for content-based image retrieval with feature weighting. Pattern Recognition 42 7 (2009) 1511-1519
25. Anand A., Pugalenthi G., and Suganthan P. Predicting protein structural class by SVM with class-wise optimized features and decision probabilities. Journal of Theoretical Biology 253 2 (2008) 375-380
26. Li Y., and Lu B. Feature selection based on loss-margin of nearest neighbor classification. Pattern Recognition 42 9 (2009) 1914-1921
27. Nakariyakul S., and Casasent D. An improvement on floating search algorithms for feature subset selection. Pattern Recognition 42 9 (2009) 1932-1940
28. Yoon H., Yang K., and Shahabi C. Feature subset selection and feature ranking for multivariate time series. IEEE Transactions on Knowledge and Data Engineering 17 (2005) 1186-1198
29. Peng H., Long F., and Ding C. Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 8 (2005) 1226-1238
30. Yap K. A soft relevance framework in content-based image retrieval systems. IEEE Transactions on Circuits and Systems for Video Technology 15 (2005) 1557-1568
31. Wu K. Fuzzy SVM for content-based image retrieval-A pseudo-label support vector machine framework. IEEE Computational Intelligence Magazine 1 (2006) 10-16
32. E. Xing, A.Y. Ng, M. Jordan, S. Russell, Distance metric learning, with application to clustering with side-information, in: Advances in Neural Information Processing Systems, vol. 15, MIT Press, Cambridge, MA, 2003, pp. 505-512.
33. X. Zhu, Semi-supervised learning literature survey, Technique Report 1530, Department of Computer Sciences, University of Wisconsin at Madison, Madison, WI, 2006. 〈http://www.cs.wisc.edu/∼jerryzhu/pub/ssl_survey.pdf〉.
34. K. Wagstaff, C. Cardie, Constrained k-means clustering with background knowledge, in: Proceedings of the 17th International Conference on Machine Learning, 2000, pp. 1103-1110.
35. R. Yan, J. Zhang, J. Yang, A. Hauptmann, A discriminative learning framework with pairwise constraints for video object classification, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, 2004, pp. 284-291.
36. I. Davidson, K. Wagstaff, S. Basu, Measuring constraint-set utility for partitional clustering algorithms, in: Proceedings of the 10th European Conference on Principles and Practice of Knowledge Discovery in Databases, 2006, pp. 115-126.
37. S. Basu, A. Banerjee, R. Mooney, Active semi-supervision for pairwise constrained clustering, in: Proceedings of the Fourth SIAM International Conference on Data Mining, 2004, pp. 333-344.
38. P. Melville, R. Mooney, Diverse ensembles for active learning, in: Proceedings of the 21st International Conferences on Machine Learning, 2004, pp. 584-591.
39. D. Greene, P. Cunningham, Constraint selection by committee: an ensemble approach to identifying informative constraints for semi-supervised clustering, in: Proceedings of the 18th European Conference on Machine Learning, Warsaw, Poland, 2007, pp. 17-21.
40. T. Dietterich, Ensemble methods in machine learning, in: Proceedings of the First International Workshop on Multiple Classifier Systems, Springer, Berlin, 2000, pp. 1-15.
41. Liu K. Ensemble component selection for improving ICA based microarray data prediction models. Pattern Recognition 42 7 (2009) 1274-1283
42. Breiman L. Bagging predictors. Machine Learning 24 2 (1996) 123-140
43. Y. Freund, R. Schapire, Experiments with a new boosting algorithm, in: Proceedings of the 13th International Conference on Machine learning, 1996, pp. 148-156.
44. Ho T. The random subspace method for construction decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence (1998) 832-844
45. Strehl A., and Ghosh J. Cluster ensembles-a knowledge reuse framework for combining multiple partitions. Journal of Machine Learning Research 3 (2002) 583-618
46. Topchy A., Jain A., and Punch W. Clustering ensembles: models of consensus and weak partitions. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 12 (2005) 1866-1881
47. C. Blake, E. Keogh, C. Merz, UCI repository of machine learning databases, 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉, Department of Information and Computer Science, University of California, Irvine, 1998.
48. Alon U., Barkai N., Notterman D., Gish K., Ybarra S., Mack D., and Levine A. Broad patterns of gene expression revealed by clustering of tumor and normal colon tissues probed by oligonucleotide arrays. Proceedings of the National Academy of Sciences 96 12 (1999) 6745-6750
49. C. Chang, C. Lin, LIBSVM: a library for support vector machines, 2001, software available at 〈http://www.csie.ntu.edu.tw/∼cjlin/libsvm〉.
50. Golub T., Slonim D., Tamayo P., Huard C., Gaasenbeek M., Mesirov J., Coller H., Loh M., Downing J., Caligiuri M., Bloomfield C., and Lander E. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286 (1999) 531-537
51. Rodríguez J., Kuncheva L., and Alonso C. Rotation forest: a new classifier ensemble method. IEEE Transactions on Pattern Analysis and Machine Intelligence 28 10 (2006) 1619-1630