Performance of Firth-and logF-type penalized methods in risk prediction for small or sparse binary data

BMC Medical Research Methodology

Volumn 17, Issue 1, 2017, Pages

  Rahman, M Shafiqur ^a   Sultana, Mahbuba ^a  

^a UNIVERSITY OF DHAKA   (Bangladesh)

Author keywords

Overfitting; Performance measures; Prediction model; Separation

Indexed keywords

CARDIOVASCULAR DISEASES; COMPUTER SIMULATION; HUMAN; PROCEDURES; REPRODUCIBILITY; RISK ASSESSMENT; RISK FACTOR; SENSITIVITY AND SPECIFICITY; STATISTICAL MODEL; STATISTICS AND NUMERICAL DATA; STRESS ECHOCARDIOGRAPHY;

CARDIOVASCULAR DISEASES; COMPUTER SIMULATION; ECHOCARDIOGRAPHY, STRESS; HUMANS; LIKELIHOOD FUNCTIONS; REPRODUCIBILITY OF RESULTS; RISK ASSESSMENT; RISK FACTORS; SENSITIVITY AND SPECIFICITY;

EID: 85013747969     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/s12874-017-0313-9     Document Type: Article

References (33)

1. Abu-Hanna A, Lucas PJF. Prognostic models in medicine. Methods Inform Med. 2001; 40:1-5.
2. Moons KGM, Royston P, Vergouwe Y, Grobbee DE, Altman DG. Prognosis and prognostic research: what, why and how?. BMJ. 2009a; 338:1317-20.
3. Altman DG, Royston P. What do you mean by validating a prognostic model?. Stat Med. 2000; 19:453-73.
4. Moons KGM, Altman DG, Vergouwe Y, Royston P. Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ. 2009b; 338:1487-90.
5. Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996; 49:1373-9.
6. Moons KG, de Groot JA, Linnet K, Reitsma JB, Bossuyt PM. Quantifying the added value of a diagnostic test or marker. Clin Chem. 2012; 58(10):1408-17.
7. Bouwmeester W, Zuithoff N, Mallett S, Geerlings MI, Vergouwe Y, Steyerberg EW, Altman DG, Moons KGM. Reporting and methods in clinical prediction research: a systematic review. PLOS Medecine. 2012; 9(5):e1001221.
8. Steyerberg EW, Eijkemans MJC, Harrell FE, Habbema JDF. Prognostic modelling with logistic regression analysis: a comparison of selection and estimation methods in small data sets. Stat Med. 2000; 19(8):1059-79.
9. Ambler G, Seaman S, Omar RZ. An evaluation of penalised survival methods for developing prognostic models with rare events. Stat Med. 2012; 31(11-12, SI):1150-61.
10. Pavlou M, Ambler G, Seaman S, De Iorio M, RZ O. Review and evaluation of penalised regression methods for risk prediction in low-dimensional data with few events. Stat Med. 2016; 35(7):1159-77.
11. Cessie SL, van Houwelingen JC. Ridge estimators in logistic regression. J R Stat Soc Series C. 1992; 41(1):191-201.
12. Tibshirani R. Regression shrinkage and selection via the lasso. J R Stat Soc Series B. 1996; 58:267-88.
13. Zou H, Hastie T. Regularization and variable selection via the elastic net. J R Stat Soc Series B. 2005; 67(2):301-20.
14. Zou H. The adaptive lasso and its oracle properties. J Am Stat Assoc. 2006; 101(476):1418-29.
15. Zou H, Zhang HH. On the adaptive elastic-net with a diverging number of parameters. Ann Stat. 2009; 37(4):1733-51.
16. Albert A, Anderson JA. On the existence of maximum likelihood estimates in logistic regression models. Biometrika. 1984; 71(1):1-10.
17. Heinze G, Scemper M. A solution to the problem of separation in logistic regression. Stat Med. 2002; 21(16):2409-19.
18. Schaefer RL. Bias correction in maximum likelihood logistic regression. Stat Med. 1983; 2:71-8.
19. Firth D. Bias reduction of maximum likelihood estimates. Biomertika. 1993; 80:27-38.
20. Greenland S, Schwartzbaum JA, Finkle WD. Problems due to small samples and sparse data in conditional logistic regression analysis. Am J Epidemiol. 2000; 151(5):531-9.
21. Lipsitz SR, Fitzmaurice G, Regenbogen SE, Sinha D, Ibrahim JG, Gawande AA. Bias correction for the proportional odds logistic regression model with application to a study of surgical complications. J R Stat Soc Series C. 2013; 62(2):233-50.
22. Greenland S, Mansournia MA, Altman DG. Sparse data bias: a problem hiding in plain sight. BMJ. 2016; 352:i1981.
23. Greenland S, Mansournia MA. Penalization, bias reduction, and default priors in logistic and related categorical and survival regressions. Stat Med. 2015; 34(23):3133-43.
24. Greenland S. Prior data for non-normal priors. Stat Med. 2007; 26:3578-90.
25. Greenland S. Generalized conjugate priors for bayesian analysis of risk and survival regressions. Biometrics. 2003; 59:92-9.
26. Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, Pencina MJ, Kattan MW. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2009; 21(1):128-38.
27. Krivokapich J, Child J, Walter DO, Garfinkel A. Prognostic value of dobutamine stress echocardiography in predicting cardiac events in patients with known or suspected coronary artery disease. J Am Coll Cardiol. 1999; 33(3):708-16.
28. Collins GS, Ogundimu EO, Altman DG. Sample size considerations for the external validation of a multivariable prognostic model: a resampling study. Stat Med. 2016; 35(2):214-26.
29. Benner A, Zucknick M, Hielscher T, Ittrich C, Mansmann U. High-dimensional cox models: the choice of penalty as part of the model building process. Biometrical J. 2010; 52:50-69.
30. van Wieringen WN, Kun D, Hampel AL R, Boulesteix. Survival prediction using gene expression data: a review and comparison. Comput Stat Data Anal. 2009; 53:1590-603.
31. Shen J, Gao S. A solution to separation and multicollinearity in multiple logistic regression. J Data Sci. 2008; 6(4):515-31.
32. Goeman J, Meijer R, Chaturvedi N. L1 and L2 penalized regression models. R Package version 0.9-47; 2016. Retrieved from http://CRAN.R-project.org/package=penalized.
33. Ojeda FM, Müller C, D B, A TD, Schillert A, Heinig M, Zeller T, Schnabel RB. Comparison of cox model methods in a low-dimensional setting with few events. Genomics Proteomics Bioinforma. 2016; 14(4):235-43.