Theoretical comparison between the Gini Index and Information Gain criteria

Annals of Mathematics and Artificial Intelligence

Volumn 41, Issue 1, 2004, Pages 77-93

  Raileanu, Laura Elena ^a   Stoffel, Kilian ^a  

^a UNIVERSITY OF NEUCHÂTEL   (Switzerland)

Author keywords

Classification; Decision trees; Gini Index; Information Gain; Theoretical comparison

Indexed keywords

EID: 3943113604     PISSN: 10122443     EISSN: None     Source Type: Journal    
DOI: 10.1023/B:AMAI.0000018580.96245.c6     Document Type: Article

References (22)

1. A. Babic, E. Krusinska and J.E. Stromberg, Extraction of diagnostic rules using recursive partitioning systems: A comparison of two approches, Artificial Intelligence in Medicine 20(5) (1992) 373-387.
2. E. Baker and A.K. Jain, On feature ordering in practice and some finite sample effects, in: Proceedings of the Third International Joint Conference on Pattern Recognition, San Diego, CA (1976) pp. 45-49.
3. M. Ben-Bassat, Myopic policies in sequential classification, IEEE Transactions on Computing 27(2) (1978) 170-174.
4. L. Breiman, J. Friedman, R. Olshen and C. Stone, Classification and Regression Trees (Wadsworth International Group, 1984).
5. Lopez de Mantaras, A distance-based attribute selection measure for decision tree induction, Machine Learning 6(1) (1991) 81-92.
6. J. Gama and P. Brazdil, Characterization of classification algorithms, in: EPIA-95: Progress in Artificial Intelligence, 7th Portuguese Conference on Artificial Intelligence, eds. C. Pinto-Ferreira and N. Mamede (Springer, 1995) pp. 189-200.
7. I. Kononenko, On biases in estimating multi-valued attributes, in: IJCAI-95: Proceedings of the 14th International Joint Conference on Artificial Intelligence, Montreal, Canada, ed. C. Mellish (Morgan Kaufmann, San Mateo, CA, 1995) pp. 1034-1040.
8. T.-S. Lim, W.-Y. Loh and Y.-S. Shih, A comparison of prediction accuracy, complexity and training time of thirty-three old and new classification algorithms, Machine Learning (1999).
9. J. Mingers, Expert systems-rule induction with statistical data, Journal of the Operational Research Society 38(1) (1987) 39-47.
10. J. Mingers, An empirical comparison of selection measures for decision tree induction, Machine Learning 3 (1989) 319-342.
11. M. Miyakawa, Criteria for selecting a variable in the construction of efficient decision trees, IEEE Transactions on Computers 35(1) (1929) 133-141.
12. B.M. Moret, Decision trees and diagrams, Computing Surveys 14(4) (1982) 593-623.
13. K.V.S. Murthy, On growing better decision trees from data, Ph.D. thesis, The John Hopkins University, Baltimore, MD (1995).
14. G. Pagallo, Adaptive decision tree algorithms for learning from examples, Ph.D. thesis, University of California, Santa Cruz, CA (1990).
15. J.R. Quinlan, Simplifying decision trees, International Journal of Man-Machine Studies 27 (1987) 221-234.
16. J.R. Quinlan, C4.5 Programs for Machine Learning (Morgan Kaufmann, 1993).
17. L.E. Raileanu, Formalization and comparison of split criteria for decision trees, Ph.D. thesis, University of Neuchâtel, Switzerland (May 2002).
18. S.R. Safavin and D. Langrebe, A survey of decision tree classifier methodology, IEEE Transactions on Systems, Man and Cybernetics 21(3) (1991) 660-674.
19. M. Sahami, Learning non-linearly separable Boolean functions with linear threshold unit trees and madaline-style networks, in: Proceedings of the Eleventh National Conference on Artificial Intelligence (AAAI Press, 1993) pp. 335-341.
20. K. Stoffel and L.E. Raileanu, Selecting optimal split-functions for large datasets, in: Research and Development in Intelligent Systems XVII, BCS Conference Series (2000).
21. R. Vilalta and D. Oblinger, A quantification of distance-bias between evaluation metrics in classification, in: Proceedings of the 17th International Conference on Machine Learning, Stanford University (2000).
22. A.P. White and W.Z. Liu, Bias il information-based measures in decision tree induction, Machine Learning 15(3) (1997) 321-328.