Asymptotic properties of a double penalized maximum likelihood estimator in logistic regression

Statistics and Probability Letters

Volumn 77, Issue 9, 2007, Pages 925-930

  Gao, Sujuan ^a   Shen, Jianzhao ^a  

^a INDIANA UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Logistic regression; Maximum likelihood; Penalized maximum likelihood; Ridge regression

Indexed keywords

EID: 34047276652     PISSN: 01677152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.spl.2007.01.004     Document Type: Article

References (22)

1. Albert A., and Anderson J.A. On the existence of maximum likelihood estimates in logistic regression models. Biometrika 71 (1984) 1-10
2. Anderson J.A., and Richardson S.C. Logistic discrimination and bias correction in maximum likelihood estimation. Technometrics 21 (1979) 71-78
3. Bull S.B., Mak C., and Greenwood C.M.T. A modified score function estimator for multinomial logistic regression in small samples. Comput. Statist. Data Anal. 39 1 (2002) 57-74
4. Copas J.B. Binary regression models for contaminated data, with discussuion. J. Roy. Statist. Soc. Ser. B 50 (1988) 225-265
5. Cordeiro G.M., and McCullagh P. Bias correction in generalized linear models. J. Roy. Statist. Soc. Ser. B 53 (1991) 629-643
6. Efron B. How biased is the apparent error rate of a prediction rule?. J. Amer. Statist. Assoc. 81 (1986) 461-470
7. Firth, D., 1992. Bias reduction, the Jeffreys prior and GLIM. In: Fahrmeir, L., Francis, B., Gilchrist, R., Tutz, G., (Eds.), Advances in GLIM and Statistical Modelling. Springer, NY.
8. Firth D. Bias reduction of maximum likelihood estimates. Biometrika 80 1 (1993) 27-38
9. Fort G., and Lambert-Lacroix S. Classification using partial least squares with penalized logistic regression. Bioinformatics 21 7 (2005) 1104-1111
10. Harrell,F.E., Lee, K.L., 1985. The practical value of logistic regression. Proceedings of the Tenth Annual SAS Users Groups International Conference, SAS Institute Inc., Cary, North Carolina, pp. 1031-1036.
11. Heinze G., and Schemper M. A solution to the problem of separation in logistic regression. Statist. Med. 21 16 (2002) 2409-2419
12. Hoerl A.E., and Kennard R.W. Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12 (1970) 55-67
13. Hoerl, A.E., Kennard, R.W. 1988. Ridge Regression. Encyclopedia of Statistical Sciences 9 vols., vol. 8 (Suppl.). Wiley, New York, pp. 129-136.
14. Ibrahim J.G., and Laud P.W. On Bayesian analysis of generalized linear models using Jeffrey's prior. J. Amer. Statist. Assoc. 86 (1991) 981-986
15. Jeffreys H. An invariant form for the prior probability in estimation problems. Proc. Roy. Soc. A. 186 (1946) 453-461
16. Jiang J. Conditional inference about generalized linear mixed models. Ann. Statist. 27 (1999) 1974-2007
17. le Cessie S., and van Houwelingen J.C. Ridge estimators in logistic regression. Appl. Statist.-J. Roy. Statist. Soc. Ser. C 41 1 (1992) 191-201
18. McLachlan G. A note on bias correction in maximum likelihood estimation with logistic discrimination. Technometrics 22 (1980) 621-627
19. McCullagh, P., Nelder, J.A., 1989. Generalized linear models, second ed. Chapman & Hall, London.
20. Schaefer R.L., Roi L.D., and Wolfe R.A. A ridge logistic regression. Comm. Statist. Theory Methods 13 1 (1984) 99-113
21. Schaefer R.L. Bias correction in maximum likelihood logistic regression. Statist. Med. 2 (1983) 71-78
22. Shen, J., Gao, S., 2006. A solution to separation and multicollinearity in multiple logistic regression. J. Data Sci., in press.