An efficient ensemble pruning algorithm using One-Path and Two-Trips searching approach

Knowledge-Based Systems

Volumn 51, Issue , 2013, Pages 85-92

  Dai, Qun ^a  

^a NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

Author keywords

Backtracking algorithm; Ensemble pruning; Ensemble Pruning via BackTracking algorithm (EnPBT); One Path and Two Trips searching algorithm (OPTT); Pruning efficiency

Indexed keywords

BACKTRACKING ALGORITHM; CLASSIFICATION PERFORMANCE; COMBINATORIAL PROBLEM; DEPTH FIRST; EFFECTIVENESS AND EFFICIENCIES; ENSEMBLE PRUNING; ENSEMBLE SYSTEMS; SEARCHING ALGORITHMS;

ARTIFICIAL INTELLIGENCE; SOFTWARE ENGINEERING;

ALGORITHMS;

EID: 84883053573     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2013.07.006     Document Type: Article

References (38)

1. R. Caruana, A. Niculescu-Mizil, G. Crew, A. Ksikes, Ensemble selection from libraries of models, Presented at Proceedings of the 21st International Conference on Machine Learning, 2004.
2. T.G. Dietterich, Ensemble methods in machine learning, Presented at Proceedings of the 1st International Workshop in Multiple Classifier Systems, Cagliari, Italy, 2000.
3. L. Breiman Bagging predictors Machine Learning 24 1996 123 140
4. L. Breiman Pasting small votes for classification in large databases and on-line Machine Learning 36 1999 85 103
5. T. Dietterich An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization Machine Learning 40 2000 139 158
6. L. Breiman Random forests Machine Learning 45 2001 5 32
7. Y. Freund, R.E. Schapire, Experiments with a new boosting algorithm, Presented at 13th International Conference on Machine Learning, 1996.
8. F.J. Huang, Z.-H. Zhou, H.-J. Zhang, T.H. Chen, Pose invariant face recognition, Presented at 4th IEEE International Conference on Automatic Face and Gesture Recognition, Grenoble, France, 2000.
9. L.K. Hansen, L. Liisberg, P. Salamon, Ensemble methods for handwritten digit recognition, Presented at IEEE Workshop on Neural Networks for Signal Processing, Helsingoer, Denmark, 1992.
10. Y. Zhao, J. Gao, X. Yang, A survey of neural network ensemble, Presented at International Conference on Neural Networks and Brain, Beijing, China, 2005.
11. K.J. Cherkauer, Human expert level performance on a scientific image analysis task by a system using combined artificial neural networks, Presented at Proc. AAAI-96 Workshop on Integrating Multiple Learned Models for Improving and Scaling Machine Learning Algorithms, Portland, OR, 1996.
12. P. Cunningham, J. Carney, and S. Jacob Stability problems with artificial neural networks and the ensemble solution Artificial Intelligence in Medicine 20 2000 217 225
13. Z.-H. Zhou, Y. Jiang, Y.-B. Yang, and S.-F. Chen Lung cancer cell identification based on artificial neural network ensembles Artificial Intelligence in Medicine 24 2002 25 36
14. K.-P. Lin, and K.-C. Hung An efficient fuzzy weighted average algorithm for the military UAV selecting under group decision-making Knowledge-Based Systems 24 2011 877 889
15. B. Kavitha, D.S. Karthikeyan, and P.S. Maybell An ensemble design of intrusion detection system for handling uncertainty using Neutrosophic Logic Classifier Knowledge-Based Systems 28 2012 88 96
16. G. Martinez-Munoz, D. Hernandez-Lobato, and A. Suarez An analysis of ensemble pruning techniques based on ordered aggregation IEEE Transactions on Pattern Analysis and Machine Intelligence 31 2009 245 259
17. D. Margineantu, T. Dietterich, Pruning adaptive boosting, Presented at Proceedings of the 14th International Conference on, Machine Learning, 1997.
18. A.L. Prodromidis, and S.J. Stolfo Cost complexity-based pruning of ensemble classifiers Knowledge and Information Systems 3 2001 449 469
19. Z.-H. Zhou, J. Wu, and W. Tang Ensembling neural networks: many could be better than all Artificial Intelligence 137 2002 239 263
20. Z. Zhou, W. Tang, Selective ensemble of decision trees, Presented at Proceedings of the 9th International Conference on Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing, Chongqing, China, 2003.
21. G. Martinez-Munoz, A. Suarez, Aggregation ordering in bagging, Presented at International Conference on Artificial Intelligence and Applications, 2004.
22. R.E. Banfield, L.O. Hall, K.W. Bowyer, and W.P. Kegelmeyer Ensemble diversity measures and their application to thinning Information Fusion 6 2005 49 62
23. G. Martinez-Munoz, A. Suarez, Pruning in ordered bagging ensembles, Presented at 23rd International Conference in, Machine Learning, 2006.
24. G. Martinez-Munoz, and A. Suarez Using boosting to prune bagging ensembles Pattern Recognition Letters 28 2007 156 165
25. I. Partalas, G. Tsoumakas, and I. Vlahavas Pruning an ensemble of classifiers via reinforcement learning Neurocomputing 72 2009 1900 1909
26. Y. Zhang, S. Burer, and W.N. Street Ensemble pruning via semi-definite programming Journal of Machine Learning Research 7 2006 1315 1338
27. Q. Fu, S.-x. Hu, and S.-y. Zhao Clustering-based selective neural network ensemble Journal of Zhejiang University Science 6A 2005 387 392
28. Q. Dai, Z. Liu, ModEnPBT: A Modified Backtracking Ensemble Pruning Algorithm, Applied Soft Computing, 2013. < http://www.dx.doi.org/10.1016/j. asoc.2013.06.023 >.
29. M.H. Alsuwaiyel Algorithms Design Techniques and Analysis 2003 World Scientific Publishing Co. Pte. Ltd. Singapore
30. X.D. Wang Computer Algorithms Design and Analysis 2001 Publishing House of Electronics Industry Beijing, China
31. Q.-L. Zhao, Y.-H. Jiang, and M. Xu A fast ensemble pruning algorithm based on pattern mining process Machine Learning and Knowledge Discovery in Databases 19 2009 277 292
32. A. Weijters The BP-SOM architecture and learning rule Neural Processing Letters 2 1995 13 16
33. A. Weijters, V.D. Bosch, and H.J. Herik Intelligible neural networks with BP-SOM Marcke and Daelemans 1997 27 36
34. J. Eggermont, Rule-extraction and learning in the BP-SOM architecture, in: Computer Science Department: Leiden University, 1998.
35. UCI, "UCI repository of machine learning databases".
36. Q. Dai, and N.Z. Liu The build of n-Bits Binary Coding ICBP Ensemble System Neurocomputing 74 2011 3509 3519
37. Q. Dai, S.C. Chen, and B.Z. Zhang Improved CBP neural network model with applications in time series prediction Neural Processing Letters 18 2003 197 211
38. I. Partalas, G. Tsoumakas, and I. Vlahavas An ensemble uncertainty aware measure for directed hill climbing ensemble pruning Machine Learning 81 2010 257 282