Automated diagnosis of diseases based on classification: Dynamic determination of the number of trees in random forests algorithm

IEEE Transactions on Information Technology in Biomedicine

Volumn 16, Issue 4, 2012, Pages 615-622

  Tripoliti, Evanthia E ^a   Fotiadis, Dimitrios I ^a   Manis, George ^a  

^a UNIVERSITY OF IOANNINA   (Greece)

Author keywords

Classification of diseases; random forests

Indexed keywords

ALZHEIMER; AUTOMATED DIAGNOSIS; BASE CLASSIFIERS; BIOMEDICAL PROBLEMS; BREAST CANCER; CLASSIFICATION ALGORITHM; DATA SETS; DYNAMIC DETERMINATION; ENSEMBLE CLASSIFIERS; FITTING PROCEDURE; HEART DISEASE; OPTIMUM NUMBER; PREVALENCE RATES; RANDOM FORESTS; TEST CASE;

ALGORITHMS; DECISION TREES; DISEASES; FORESTRY;

DIAGNOSIS;

ALGORITHMS; AUTOMATION; BIOMETRICS; CLASSIFICATION; DATA PROCESSING; DECISION THEORY; DIAGNOSIS; DISEASES; RANDOM PROCESSES;

ALGORITHM; ARTICLE; CLASSIFICATION; COMPUTER ASSISTED DIAGNOSIS; DECISION TREE; DISEASES; FACTUAL DATABASE; HUMAN;

ALGORITHMS; DATABASES, FACTUAL; DECISION TREES; DIAGNOSIS, COMPUTER-ASSISTED; DISEASE; HUMANS;

EID: 84863516915     PISSN: 10897771     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITB.2011.2175938     Document Type: Article

References (26)

1. I. Kononenko, "Machine learning for medical diagnosis: History, state of the art and perspective," Artif. Intell. Med., vol. 23, no. 1, pp. 89-109, 2001. (Pubitemid 32677979)
2. G. D. Magoulas and A. Prentza, "Machine learning in medical applications," Mach. Learning Appl. (Lecture Notes Comput. Sci.), Berlin/Heidelberg, Germany: Springer, vol. 2049, pp. 300-307, 2001.
3. L. Breiman, "Bagging predictors," Mach. Learning, vol. 24, no. 2, pp. 123-140, 1996. (Pubitemid 126724382)
4. Y. Freud and R. E. Schapire, "A decision-Theoretic generalization of online learning and an application to boosting," J. Comput. Syst. Sci., vol. 55, no. 1, pp. 119-139, 1997. (Pubitemid 127433398)
5. T.K.Ho, "The random subspace method for constructing decision forests," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 8, pp. 832-844, 1998. (Pubitemid 128741345)
6. L. Breiman, "Random forests," Mach. Learning, vol. 45, pp. 5-32, 2001. (Pubitemid 32933532)
7. L. Rokach and O. Maimon, Data Mining with Decision Trees Theory and Applications (Machine Perception and Artificial Intelligence Series 69). H. Bunke and P. S. P. Wang, Eds. Singapore: World Scientific, 2008.
8. A. L. Prodromidis, S. J. Stolfo, and P. K. Chan, "Effective and efficient pruning of metaclassifiers in a distributed data mining system,", Columbia Univ., New York, Tech. Rep. CUCS-017-99, 1999.
9. M. Robnik-Sikonja, "Improving random forests," in Proc. Eur. Conf. Mach. Learning, 2004, pp. 359-369.
10. A. Tsymbal, M. Pechenizkiy, and P. Cunningham, "Dynamic integration with random forests," in Proc. Eur. Conf. Mach. Learning, vol. 4212, Berlin/Heidelberg, Germany: Springer, 2006.
11. P. Cunningham, "A taxonomy of similarity mechanisms for case-based reasoning,", University College Dublin, Dublin, Ireland, Tech. Rep. UCDCSI-2008-01, 2008.
12. H. Hu, J. Li, H. Wang, G. Daggard, and M. Shi, "A maximally diversified multiple decision tree algorithm for microarray data classification,", presented at the Workshop Intell. Syst. Bioinformat., Hobart, Australia 2006.
13. S. Gunter and H. Bunke, "Optimization of weights in a multiple classifier handwritten word recognition system using a genetic algorithm," Electron. Letters Comput. Vision Image Anal., pp. 25-41, 2004.
14. E. E. Tripoliti, D. I. Fotiadis, M. Argyropoulou, and G. Manis, "A six stage approach for the diagnosis of the Alzheimer's disease based on fMRI data," J. Biomed. Informat., vol. 43, pp. 307-310, 2010.
15. S. Bernard, L. Heutte, and S. Adam, "On the selection of decision trees in random forests," in Proc. IEEE-ENNS Int. Joint Conf. Neural Netw., 2009, pp. 302-307.
16. E. E. Tripoliti, D. I. Fotiadis, and G. Manis, "Modifications of random forests algorithm," Data Knowl. Eng., to be published.
17. E. Gatnar, "A diversity measure for tree-based classifier ensembles," in Data Analysis and Decision Support, D. Baier, et al.., Eds. Heidelberg, Germany: Springer, pp. 30-38, 2005.
18. G. Giacinto, F. Roli, and G. Fumera, "Design of effective multiple classifiers systems by clustering of classifiers," in Proc. 15th Int. Conf. Pattern Recog., 2000, pp. 160-163.
19. G. Martinez-Munoz and A. Suarez, "Pruning in ordered bagging ensembles," in Proc. 23rd Int. Conf. Mach. Learning, 2006, pp. 609-616.
20. C. Orrite, M. Rodriquez, F. Martinez, and M. Fairhurst, "Classifier ensemble generation for the majority vote rule," in Lecture Notes on Computer Science, J. Ruiz-Shulcloper et al., Eds. Berlin\Heidelberg, Germany: Springer-Verlag, pp. 340-347, 2008.
21. P. Letinne, O. Bebeir, and C. Decaestecker, "Limiting the number of trees in random forests," in Lecture Notes on Computer Science. Berlin\Heidelberg, Germany: Springer-Verlag, 2001, pp. 178-187.
22. J. Xiao and Ch. He, "Dynamic classifier ensemble selection based on GMDH," in Proc. Int. Joint Conf. Comput. Sci. Optimization, 2009, pp. 731-734.
23. R. E. Banfield, L. O. Hall, K. W. Bowyer, and W. P. Kegelmeyer, "A comparison of decision tree ensemble creation techniques," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1, pp. 173-180, Jan. 2007. (Pubitemid 46415955)
24. S. Bernard, L. Heutte, and S. Adam, "Forest-RK: A new random forest induction method," in Proc. Int. Conf. Intell. Comput. 2008. Lecture Notes in Artificial Intelligence 5227, D.-S. Huang, et al., Eds. Heidelberg, Germany: Springer, 2008a, pp. 430-437.
25. E. E. Tripoliti, D. I. Fotiadis, and G. Manis, "Dynamic construction of random forests: Evaluation using biomedical engineering problems,", presented at the 10th Int. Conf. Inf. Technol. Appl. Biomed. Corfu, Greece, 2010.
26. G. W. Brier, "Verification of forecasts expressed in terms of probability," Monthly Weather Review, vol. 78, pp. 1-3, 1950.