An entropy-based approach to enhancing Random Forests

Intelligent Decision Technologies

Volumn 7, Issue 4, 2013, Pages 319-327

  Gaber, Mohamed Medhat ^a   Atwal, Harinder Singh ^a  

^a UNIVERSITY OF PORTSMOUTH   (United Kingdom)

Author keywords

Data classification; entropy; information gain; Random Forests

Indexed keywords

DATA CLASSIFICATION; HISTORICAL DATA; INFORMATION GAIN; INFORMATION-THEORETIC APPROACH; NUMBER OF TREES; PREDICTIVE POWER; RANDOM FORESTS; TWO PARAMETER;

DECISION TREES; ENTROPY; FORESTRY;

CLASSIFICATION (OF INFORMATION);

CLASSIFICATION; DATA; ENTROPY; FORESTRY;

EID: 84888587807     PISSN: 18724981     EISSN: 18758843     Source Type: Journal    
DOI: 10.3233/IDT-130171     Document Type: Article

References (17)

1. L. Breiman, J. Friedman, C.J. Stone and R.A. Olshen, Classification and regression trees. Chapman and Hall/CRC, 1984.
2. L. Breiman, Random forests, Machine Learning 45(1) (2001), 5-32.
3. L. Breiman, Bagging predictors, Machine Learning 24(2) (1996), 123-140.
4. H.N. Cuong-Nguyen and W. Yong, Improving Classification Accuracy in Random Forest by Using Feature Impurity and Bayesian Probability.
5. C. Dahinden, An improved Random Forests approach with application to the performance prediction challenge datasets. Hands on Pattern Recognition. Microtome, 2009.
6. K. Jearanaitanakij and O. Pinngern, An Information Gain Technique for Acceleration of Convergence of Artificial Neural Networks. In Information, Communications and Signal Processing, 2005 Fifth International Conference on (pp. 349-352). IEEE, 2005.
7. J. Thongkam, G. Xu and Y. Zhang, AdaBoost algorithm with random forests for predicting breast cancer survivability. In Neural Networks, 2008. IJCNN 2008.(IEEE World Congress on Computational Intelligence). IEEE International Joint Conference on (pp. 3062-3069). IEEE, (2008, June).
8. M. Robnik-ikonja, Improving random forests, Machine Learning: ECML (2004), 359-370.
9. M. Gaber and M. Bader, Optimisation of ensemble classification using genetic algorithm, in International Conference on Knowledge-Based and Intelligent Information and Engineering Systems, San Sebastian, Spain, 2012.
10. N. Pater, Enhancing random forest implementation in WEKA. In Machine learning conference paper for ECE591Q, (2005, November).
11. B. Sun, J. Luo, S. Shu and E. Xue, Improve the Performance of Random Forests by Introducing Weight Update Technique. InIntelligent Human-Machine Systems and Cybernetics (IHMSC), 2010 2nd International Conference on?Vol. 1, pp. 34-37). IEEE, August, 2010.
12. T.K. Ho, Random decision forest. In: Proceedings of the Third International Conference on Document Analysis and Recognition, 1995, 278-282.
13. Y. Amit and D. Geman, Shape quantization and recognition with randomized trees, Neural Computation 9(7) (1997), 1545-1588.
14. T.K. Ho, The random subspace method for constructing decision forests, IEEE Transactions on Pattern Analysis and Machine Intelligence 20(8) (1998), 832-844.
15. T.N. Do, P. Lenca, S. Lallich and N.K. Pham, Classifying very-high dimensional data with random forests of oblique decision trees. In: Advances in Knowledge Discovery and Management. Volume 292 of Studies in Computational Intelligence. Springer-Verlag Berlin Heidelberg, 2010, 3955.
16. M.S. Chen, J. Han and P.S. Yu, Data mining: an overview from a database perspective. Knowledge and data Engineering, IEEE Transactions on 8(6) (1996), 866-883.
17. C.E. Shannon, A Mathematical Theory of Communication, Bell System Technical Journal 27 (July and October, 1948), pp. 379423 and 623656.