Probability Machines: Consistent probability estimation using nonparametric learning machines

Methods of Information in Medicine

Volumn 51, Issue 1, 2012, Pages 74-81

  Malley, J D ^a   Kruppa, J ^b   Dasgupta, A ^c   Malley, K G ^d   Ziegler, A ^b  

^a NATIONAL INSTITUTES OF HEALTH   (United States)

^b UNIVERSITY HOSPITAL SCHLESWIG HOLSTEIN   (Germany)

^c NATIONAL INSTITUTE OF ARTHRITIS AND MUSCULOSKELETAL AND SKIN DISEASES   (United States)

^d Malley Research Programming   (United States)

Author keywords

Brier score; Consistency; K nearest neighbor; Logistic regression; Probability estimation; Random forest

Indexed keywords

ARTICLE; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; HUMAN; LEARNING; METHODOLOGY; NONPARAMETRIC TEST; PROBABILITY; STATISTICAL MODEL; STATISTICS;

ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; HUMANS; LEARNING; LOGISTIC MODELS; MODELS, STATISTICAL; PROBABILITY; STATISTICS AS TOPIC; STATISTICS, NONPARAMETRIC;

EID: 84855764322     PISSN: 00261270     EISSN: None     Source Type: Journal    
DOI: 10.3414/ME00-01-0052     Document Type: Article

References (36)

1. Justice AC, Covinsky KE, Berlin JA. Assessing the generalizability of prognostic information. Ann Intern Med 1999; 130: 515-524.
2. Devroye L, Györfi L, Lugosi G. A Probabilistic Theory of Pattern Recognition. Berlin: Springer; 1996.
3. Györfi L, Kohler M, Krzyak A, Walk H. A Distribution- Free Theory of Nonparametric Regression. New York: Springer; 2002.
4. Kohler M, Máthé K, Pintér M. Prediction from randomly censored data. J Multivariate Anal 2002; 80: 73-100.
5. Breiman L. Bagging predictors. Mach Learn 1996; 24: 123-140.
6. Breiman L. Random Forests. Mach Learn 2001; 45: 5-32.
7. Mease D, Wyner AJ, Buja A. Boosted classification trees and class probability/quantile estimation. J Mach Learn Res 2007; 8: 409-439.
8. Mease D, Wyner A. Evidence contrary to the statistical view of boosting. J Mach Learn Res 2008; 9: 131-156.
9. Bartlett PL, Tewari A. Sparseness vs estimating conditional probabilities: Some asymptotic results. J Mach Learn Res 2007; 8: 775-790.
10. Glasmachers T. Universal consistency of multi-class support vector classifiation. In: Lafferty J, Williams CKI, Shawe-Taylor J, Zemel RS, Culotta A, editors. Advances in Neural Information Processing Systems 23. West Chester: Curran Associates Inc; 2010.pp 739-747.
11. Wang J, Shen X, Liu Y. Probability estimation for large-margin classifiers. Biometrika 2008; 95: 149-167.
12. Chang C-C, Lin C-J. LIBSVM: A library for support vector machines. ACM TIST 2011; 2: 27: 21-27: 27.
13. Schwarz DF, König IR, Ziegler A. On safari to Random Jungle: A fast implementation of Random Forests for high dimensional data. Bioinformatics 2010; 26: 1752-1758.
14. König IR, Malley JD, Pajevic S, Weimar C, Diener HC, Ziegler A. Patient-centered yes/no prognosis using learning machines. Int J Data Min Bioinform 2008; 2: 289-341.
15. Biau G, Devroye L, Lugosi G. Consistency of random forests and other averaging classifiers. J Mach Learn Res 2008; 9: 2039-2057.
16. Biau G. Analysis of a random forests model 2010: Available from: http://www.lsta.upmc.fr/BIAU/b6.pdf.
17. Biau G, Devroye L. On the layered nearest neigh bour estimate, the bagged nearest neighbour estimate and the random forest method in regression and classification. J Multivariate Anal 2010; 101: 2499-2518.
18. Lin Y, Jeon Y. Random forests and adaptive nearest neighbors. J Am Stat Assoc 2006; 101: 578-590.
19. Biau G, Cérou F, Guyader A. Rates of convergence of the functional k-nearest neighbor estimate. IEEE Transactions on Information Theory 2010; 56: 2034-2040.
20. Biau G, Cérou F, Guyader A. On the rate of convergencez of the bagged nearest neighbor estimate. J Mach Learn Res 2010; 11: 687-712.
21. Friedman J, Hastie T, Tibshirani R. Additive logistic regression: a statistical view of boosting. Ann Statist 2000; 28: 337-407.
22. Gorman RP, Sejnowski TJ. Analysis of hidden units in a layered network trained to classify sonar targets. Neural Networks 1988; 1: 75-89.
23. Gneiting T, Raftery AE. Strictly proper scoring rules, prediction, and estimation. J Am Stat Assoc 2007; 102: 359-378.
24. Bradley AA, Schwartz SS, Hashino T. Sampling uncertainty and confidence intervals for the Brier score and Brier skill score. Weather and Forecasting 2008; 23: 992-1006.
25. Gillmann G, Minder CE. On Graphically Checking Goodness-of-fit of Binary Logistic Regression Models. Methods Inf Med 2009; 48: 306-310.
26. Marchand A, Van Lente F, Galen RS. The assessment of laboratory tests in the diagnosis of acute appendicitis. Am J Clin Pathol 1983; 80: 369-374.
27. Malley DJ, Malley KG, Pajevic S. Statistical Learning for Biomedical Data. Cambridge: Cambridge University Press; 2011.
28. Silverstein MD, Ballard DJ. Expert panel assessment of appropriateness of abdominal aortic aneurysm surgery: global judgement versus probability estimation. J Health Serv Res Policy 1998; 3: 134-140.
29. Burnside ES, Rubin DL, Fine JP, Shachter RD, Sisney GA, Leung WK. Bayesian network to predict breast cancer risk of mammographic microcalcifications and reduce number of benign biopsy results: initial experience. Radiology 2006; 240: 666-673.
30. Lebrun G, Charrier C, Lezoray O, Meurie C, Cardot H. A fast and efficient segmentation scheme for cell microscopic image. Cell Mol Biol (Noisy-le-grand) 2007; 53: 51-61.
31. Tanaka T, Komatsu K, Takada G, Miyashita M, Ohno T. Probability estimation of final height. Endocr J. 1998; 45 Suppl: S145-S149.
32. Walsh S, Lindenbergh A, Zuniga SB, Sijen T, de Knijff P, Kayser M, et al. Developmental validation of the IrisPlex system: Determination of blue and brown iris colour for forensic intelligence. Forensic Sci Int Genet 2010.
33. Wu Y, Zhang HH, Liu Y. Robust Model-Free Multiclass Probability Estimation. J Am Stat Assoc 2010; 105: 424-436.
34. Richard MD, Lippmann RP. Neural network classifiers estimate Bayesian a posteriori probabilities. Neural Comput 1991; 3: 461-483.
35. Wu Y, Liu Y. Non-crossing large-margin probability estimation and its application to robust SVM via preconditioning. Stat Methodol 2011; 8: 56-67.
36. Meinshausen N. Quantile regression forests. J Mach Learn Res 2006; 7: 983-999.