AUC-Maximizing Ensembles through Metalearning

International Journal of Biostatistics

Volumn 12, Issue 1, 2016, Pages 203-218

  LeDell, Erin ^a   Van Der Laan, Mark J ^a   Peterson, Maya ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

AUC; binary classifiation; class imbalance; ensemble learning; machine learning

Indexed keywords

COMPARATIVE EFFECTIVENESS; HUMAN; HUMAN EXPERIMENT; MACHINE LEARNING; RECEIVER OPERATING CHARACTERISTIC; ALGORITHM; AREA UNDER THE CURVE; THEORETICAL MODEL;

ALGORITHMS; AREA UNDER CURVE; MACHINE LEARNING; MODELS, THEORETICAL;

EID: 84975257948     PISSN: None     EISSN: 15574679     Source Type: Journal    
DOI: 10.1515/ijb-2015-0035     Document Type: Article

References (29)

1. Woods K, Doss C, Bowyer K, Solka J, Priebe C, Kegelmeyer W. Comparative evaluation of pattern recognition techniques for detection of microcalcifications in mammography. Int J Pattern Recognit Artif Intell 1993;7:1417-36.
2. Vander Laan M-J, Polley E-C, Hubbard A-E. Super learner. Stat Appl Genet Mol Biol 2007;6.
3. LeBlanc M, Tibshirani R. Combining estimates in regression and classification, Technical report. J Am Stat Ass 1996;91:1641-50.
4. Breiman L. Stacked regressions. Mach Learn 1996;24:49-64.
5. Wolpert D-H. Stacked generalization. Neural Networks 1992;5:241-59.
6. Breiman L. Random forests. Mach Learn 2001;45:5-32.
7. Lawson CL, Hanson RJ. Solving least squares problems, SIAM, 1974.
8. Polley E, Vander Laan M. SuperLearner: super learner prediction. Available at: http://CRAN.R-project.org/package= SuperLearner, r package version 2.0-9, 2010.
9. Bradley AP. The use of the area under the roc curve in the evaluation of machine learning algorithms. Pattern Recognit 1997;30:1145-59.
10. Hand D. Measuring classifier performance: a coherent alternative to the area under the roc curve. Mach Learn 2009;77:103-23.
11. Hand D, Till R. A simple generalisation of the area under the roc curve for multiple class classification problems. Mach Learn 2001;45:171-86.
12. Provost F, Domingos P. Well-trained pets: improving probability estimation trees, CeDER Working Paper: IS-00-04, Stern School of Business, New York Univ, 2000.
13. Rijsbergen CJV. Information Retrieval, 2 ed. London, UK: Butterworth, 1979.
14. McClish DK. Analyzing a portion of the roc curve. Med Decis Making 1989;9:190-5.
15. Jiang Y, Metz CE, Nishikawa RM. A receiver operating characteristic partial area index for highly sensitive diagnostic tests. Radiology 1996;201:745-50.
16. Ypma J, Borchers H-W, Eddelbuettel D. R interface to NLopt. Available at: http://cran.r-project.org/web/packages/nloptr/index.html, version 1.0.4, 2014.
17. Nelder JA, Mead R. A simplex method for function minimization. The Computer Journal 1965;4:308-13.
18. Belsie CJP. Convergence theorems for a class of simulated annealing algorithms on rd. J Appl Probab 1992;29:885-92.
19. Byrd RH, Lu P, Nocedal J. A limited-memory algorithm for bound-constrained optimization, 1995.
20. Zhu C, Byrd R-H, Lu P-, Nocedal J-. Algorithm 778: L-bfgs-b: Fortran subroutines for large-scale bound-constrained optimization. ACM Trans Math Softw 1997;23:550-60. Available at: http://doi.acm.org/10.1145/279232.279236.
21. Johnson SG. The NLopt nonlinear-optimization package. Available at: http://ab-initio.mit.edu/nlopt, 2014.
22. Broyden CG. The convergence of a class of double-rank minimization algorithms. J Inst Math Appl 1970;6:76-90.
23. Fletcher R. A new approach to variable metric algorithms. Comput J 1970;13:317-22.
24. Goldfarb D. A family of variable metric updates derived by variational means. Math Comput 1970;24:23-6.
25. Shanno DF. Conditioning of quasi-newton methods for function minimization. Math Comput 1970;24:647-56.
26. Vander Laan M-J, Polley E-C. Super learner in prediction, U.C. Berkeley Division of Biostatistics Working Paper Series. Available at: http://biostats.bepress.com/ucbbiostat/paper266, 2010.
27. Baldi P, Sadowski P, Whiteson D. Searching for exotic particles in high-energy physics with deep learning. Nat Commun 2014;5. Available at: http://archive.ics.uci.edu/ml/datasets/HIGGS
28. LeDell E, Petersen M, Vander Laan M. cvAUC: Cross-validated area under the ROC curve confidence intervals. Available at: http://CRAN.R-project.org/package=cvAUC, r package version 1.1.0, 2015.
29. Strack B, DeShazo JP, Gennings C, Olmo JL, Ventura S, Cios KJ, et al. Impact of hba1c measurement on hospital readmission rates: Analysis of 70,000 clinical database patient records. BioMed Res Int 2014. Available at: http://archive.ics.uci.edu/ml/datasets/Diabetes + 130-US + hospitals + for + years + 1999-2008.