Data classification with binary response through the Boosting algorithm and logistic regression

Expert Systems with Applications

Volumn 69, Issue , 2017, Pages 62-73

  de Menezes, Fortunato S ^a   Liska, Gilberto R ^a   Cirillo, Marcelo A ^a   Vivanco, Mário J F ^a  

^a FEDERAL UNIVERSITY OF LAVRAS   (Brazil)

Author keywords

AIC; BIC; Boosting algorithm; Data classification; Information criteria; Logistic regression; Monte Carlo Simulation; Selection of models

Indexed keywords

BINS; INTELLIGENT SYSTEMS; MAXIMUM LIKELIHOOD; MAXIMUM LIKELIHOOD ESTIMATION; MONTE CARLO METHODS; REGRESSION ANALYSIS;

BOOSTING ALGORITHM; CLASSIFICATION ALGORITHM; CORONARY HEART DISEASE; DATA CLASSIFICATION; FUNCTIONAL ESTIMATIONS; INFORMATION CRITERION; LOGISTIC REGRESSION MODELING; LOGISTIC REGRESSIONS;

CLASSIFICATION (OF INFORMATION);

EID: 84994013671     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2016.08.014     Document Type: Article

References (25)

1. Akaike, H., A new look at the statistical model identification. IEEE Transactions on Automatic Control 19:6 (1974), 716–723.
2. Atkinson, A.C., Plots, Transformations and Regression. Technical Report, 1985, Oxford: Oxford University Press.
3. Bartlett, M., Traskin, P., Adaboost is consistent. Journal of Machine Learning Resources 8 (2007), 2347–2368.
4. Buhlmann, T., Hothorn, P., Boosting algorithms: Regularization, prediction and model fitting. Statistical Science 22:4 (2007), 477–505.
5. Cai, Y.D., Using logitboost classifier to predict protein structural classes. Journal of Theoretical Biology 238 (2006), 172–176.
6. Cao, D.S., et al. The boosting: A new idea of building models. Chemometrics and Intelligent Laboratory Systems 100 (2010), 1–11.
7. Dettling, P., Buhlmann, M., Boosting for tumor classification with gene expression data. Bioinformatics 19:9 (2003), 1061–1069.
8. Dietterich, T., An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization. Machine Learning 40 (2000), 139–157.
9. Emiliano, M.J.M.F.S., Vivanco, P.C., Information criteria: How do they behave in different models?. Computational Statistics and Data Analysis 69 (2014), 141–153.
10. Emiliano, M.J.M.F.S.A.F.G., Vivanco, P.C., Foundations and comparison of information criteria: Akaike and bayesian. Biometric Brazilian Journal 27 (2009), 394–411 Eletronic ISSN 1983-0823.
11. Frank, A., Asuncion, A., Machine learning repository. 2010 http://archive.ics.uci.edu/ml.
12. Friedman, J., Greedy function aproximation: A gradient boosting machine. The Annals of Statistics 29 (2001), 1189–1232.
13. Friedman, T.J.T.R.J., Hastie, J.H., Additive logistic regression: A statistical view of boosting (with discussion). Ann. Statist 28 (2000), 337–407.
14. Friedman, T.J.T.R.J., Hastie, J.H., The Elements of Statistical Learning. 2001, Basel: Springer Verlag.
15. Gey, J., Poggi, S., Boosting and instability for regression trees. Computational Statistics and Data Analysis 50 (2006), 533–560.
16. Hanley, J.A., Receiver operating characteristic (roc) methodology: the state of the art. Critical Reviews in Diagnostic Imaging 29 (1989), 307–335.
17. Hosmer, S., Lemeshow, D.W., Applied Logistic Regression. 2nd, 1989, John Wiley.
18. Kalai, A.T.S.R.A., Boosting in the presence of noise. Journal of Computation and System Sciences 71 (2005), 266–290.
19. R core team, R: A language and environment for statistical computing. 2011, R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0.
20. Rodrigues, J.L.R.M.E.C., Macrini, T.B., Seleção de variáveis e classificação de padrões por redes neurais como auxílio ao diagnóstico de cardiopatia isquêmica. Pesquisa Operacional 28:2 (2008), 285–302.
21. Schapire, R.E., The stength of weak learnability. Machine learning 5 (1990), 197–227.
22. Schonlau, M., Boosted regression (boosting): An introductory tutorial and a stata plugin. The Stata Journal 5:3 (2005), 330–354.
23. Schwarz, G., Estimating the dimensional of a model. Annals of Statistics 6:2 (1978), 461–464.
24. Skruichina, R., Duin, M., Bagging, boosting and the random subspace method for linear classifiers. Pattern Analysis and Applications 5 (2002), 121–135.
25. Zhou, D.K.O.N.A., Mcclish, X.H., Statistical methods in diagnostic medicine. 2008, Wiley Series in Probability and Statistics ISBN 9780471347729.