Ensemble pruning via constrained eigen-optimization

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2012, Pages 715-724

  Xu, Linli ^a   Li, Bo ^a   Chen, Enhong ^a  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

Ensemble pruning; Optimization

Indexed keywords

BASE LEARNERS; COMBINATORIAL OPTIMIZATION PROBLEMS; COMPUTATIONAL COSTS; ENSEMBLE LEARNING; ENSEMBLE PRUNING; GENERALIZATION PERFORMANCE; MEMORY CONSUMPTION; PREDICTION PERFORMANCE;

ALGORITHMS; COMBINATORIAL OPTIMIZATION; CONSTRAINED OPTIMIZATION; DATA MINING; OPTIMIZATION;

PROBLEM SOLVING;

EID: 84874074293     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2012.97     Document Type: Conference Paper

References (27)

1. A. Krogh and J. Vedelsby, "Neural network ensembles, cross validation, and active learning," in Advances in Neural Information Processing Systems, 1995.
2. L. Breiman, "Bagging predictors," Machine Learning, 1996.
3. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," Journal of Computer and System Sciences, 1997.
4. L. Breiman, "Random forests," Machine Learning, 2001.
5. D. D. Margineantu and T. G. Dietterich, "Pruning adaptive boosting," in Proceedings of the 14th International Conference on Machine Learning, 1997.
6. A. Prodromidis and S. Stolfo, "Cost complexity-based pruning of ensemble classifiers," Knowledge and Information Systems, vol. 3, 2001.
7. Z.-H. Zhou and W. Tang, "Selective ensemble of decision trees," in Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing, ser. Lecture Notes in Computer Science, 2003, vol. 2639.
8. N. Li and Z.-H. Zhou, "Selective ensemble under regularization framework," in Proceedings of the 8th International Workshop on Multiple Classifier Systems, ser. Lecture Notes in Computer Science, 2009.
9. C. Tamon and J. Xiang, "On the boosting pruning problem," in Proceedings of the 11th European Conference on Machine Learning, 2000.
10. R. Caruana, A. Niculescu-Mizil, G. Crew, and A. Ksikes, "Ensemble selection from libraries of models," in Proceedings of the 21st international conference on Machine learning, 2004.
11. B. Bakker and T. Heskes, "Clustering ensembles of neural network models," Neural Networks, vol. 16, 2003.
12. G. Giacinto, F. Roli, and G. Fumera, "Design of effective multiple classifier systems by clustering of classifiers," in Proceedings of the 15th International Conference on pattern recognition, 2000.
13. G. Martínez-Muñoz, D. Hernández-Lobato, and A. Suárez, "An analysis of ensemble pruning techniques based on ordered aggregation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, 2009.
14. G. Martínez-Muñoz and A. Suárez, "Aggregation ordering in bagging," in Proceedings of the IASTED International Conference on Artificial Intelligence and Applications, 2004.
15. G. Martínez-Muñoz and A. Suárez, "Pruning in ordered bagging ensembles," in Proceedings of the 23rd International Conference on Machine Learning, 2006.
16. Z. Lu, X. Wu, X. Zhu, and J. Bongard, "Ensemble pruning via individual contribution ordering," in Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2010.
17. Z.-H. Zhou, J. Wu, and W. Tang, "Ensembling neural networks: Many could be better than all," Artificial Intelligence, vol. 137, 2002.
18. Y. Zhang, S. Burer, and W. N. Street, "Ensemble pruning via semi-definite programming," Journal of Machine Learning Research, vol. 7, 2006.
19. T. G. Dietterich, "Ensemble methods in machine learning," in Proceedings of the 1st International Workshop on Multiple Classifier Systems, 2000.
20. L. Xu, W. Li, and D. Schuurmans, "Fast normalized cut with linear constraints," in Proceedings of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2009.
21. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge U. Press, 2004.
22. Y. Nesterov and A. Nemirovskii, "Interior-point polynomial algorithms in convex programming," SIAM, 1994.
23. A. Frank and A. Asuncion, "UCI machine learning repository," 2010. [Online]. Available: http://archive.ics.uci.edu/ml
24. R. Caruana and A. Niculescu-Mizil, "An empirical comparison of supervised learning algorithms," in Proceedings of the 23rd international conference on Machine learning, 2006.
25. J. R. Quinlan, C4.5: programs for machine learning. Morgan Kaufmann Publishers Inc., 1993.
26. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, "The weka data mining software: an update," SIGKDD Explorations Newsletter, vol. 11, no. 1, 2009.
27. J. Sturm, "Using SeDuMi 1.02, a Matlab toolbox for optimization over symmetric cones." Optimization Methods and Software, vol. 11-12, 1999