On measuring the relative importance of explanatory variables in a logistic regression

Journal of Modern Applied Statistical Methods

Volumn 7, Issue 1, 2008, Pages 21-38

  Thomas, D Roland ^a   Zhu, PengCheng ^b   Zumbo, Bruno D ^c   Dutta, Shantanu ^d  

^a CARLETON UNIVERSITY   (Canada)

^b University of the Pacific Stockton campus ^*  (Canada)

^c UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^d UNIVERSITY OF ONTARIO INSTITUTE OF TECHNOLOGY   (Canada)

Author keywords

Corporate governance; Pseudo R square; Variable importance

Indexed keywords

EID: 77950355286     PISSN: 15389472     EISSN: 15389472     Source Type: Journal    
DOI: 10.22237/jmasm/1209614580     Document Type: Article

References (34)

1. Azen, R., Budescu, D. V., and Reiser, B. (2001). Criticality of predictors in multiple regression. British Journal of Mathematical and Statistical Psychology, 54, 201-225.
2. Azen, R., and Budescu D. V. (2003). The dominance analysis approach for comparing predictors in multiple regression. Psychological Methods, 8, 129-148.
3. Budescu, D. V. (1993). Dominance analysis: A new approach to the problem of relative importance of predictors in multiple regression. Psychological Bulletin, 114, 542-551.
4. Cameron, A. C. and Windmeijer, F. A. G. (1996). R-squared measures for count data regression models with applications to health-care utilization. Journal of business and Economics Statistics, 14, 209-220.
5. Canty, A. and Ripley, B. (2006). Bootstrap R (S-Plus) functions. (http://cran.r-project.org/src/contrib/Descriptions/boot.html)
6. nd Edition, London: Chapman and Hall
7. Cragg, J. G. and Uhler, R. S. (1970). The demand for automobiles. Canadian Journal of Economics, 3, 386-406.
8. Davison, A. C. and Hinkley, D. V. (1997). Bootstrap methods and their application. UK: Cambridge Press.
9. Drasgow, F. (1986). Polychoric and polyserial correlations. The Encyclopedia of Statistics, 7, 68-74.
10. Efron, B. (1978). Regression and ANOVA with zero-one data: measures of residual variation. Journal of the American Statistical Association, 73, 113-121.
11. Efron, B. (1987). Better bootstrap confidence intervals. Journal of the American Statistical Association 82, 171-185.
12. Efron, B. and Tibshrani, R. (1993). An introduction to the bootstrap. NY: Chapman and Hall.
13. Green, P.E., Carroll, J.D., and DeSarbo, W.S. (1978). A new measure of predictor variable importance in multiple regression. Journal of Marketing Research, 15, 356-360.
14. Healy, M.J.R. (1990). Measuring importance. Statistics in Medicine, 9, 633-637.
15. Hoerl, A. E. and Kennard, R. W. (1970). Ridge regression: biased estimation for nonorthogonal problems. Technometrics, 12, 55-67.
16. Hosmer, D.W., Jovanovic, B. and Lemeshow, S. (1989). Best subsets logistic regression. Biometrics, 45, 1265-1270.
17. Hosmer, D. W., and Lemeshow, S. (2000). Applied logistic regression. Second Edition, NY: John Wiley & Sons, Inc.
18. Jog, V., Zhu, P. and Dutta, S. (2006). One share-one vote. Canadian Investment Review, Fall, 9-13.
19. Kruskall, W. (1987). Relative importance by averaging over orderings. The American Statistician, 41, 6-10.
20. Laitila, T. (1993). A pseudo-R2 measure for limited and qualitative dependent variable models. Journal of Econometrics, 56, 341-356.
21. McCullagh, P. and Nelder, J.A. (1989). Generalized linear models, Second Edition. NY: Chapman and Hall.
22. McFadden, D. (1974). Conditional logit analysis of qualitative choice behavior. In P. Zaremka (ed.), Frontiers in Econometrics. NY: Academic Press, p. 105-142.
23. McKelvey, R. D. and Zavoina (1975). A statistical model for the analysis of ordinal level dependent variables. Journal of Mathematical Sociology, 4, 103-120.
24. Mittlbock, M. and Schemper, M. (1996). Explained variation for logistic regression. Statistics in Medicine, 15, 1987-1997.
25. Nagelkerke, N. J. D. (1991). A note on general definition of the coefficient of determination. Biometrika, 78, 691-692.
26. Nordberg, L. (1981) Stepwise selection of explanatory variables in the binary logit model. Scandinavian Journal of Statistics, 8, 17-26.
27. Platt, R. W. Hanley, J. A., and Yang, H (2000). Bootstrap confidence intervals for the sensitivity of a quantitative diagnostic test. Statistics in Medicine, 19, 313-322.
28. Pratt, J.W. (1987). Dividing the indivisible: using simple symmetry to partition variance explained. In T. Pukkila and S. Puntanen (Eds.), Proceedings of the Second International Conference in Statistics (p. 245-260). Tampere, Finland: University of Tampere.
29. Pregibon, D. (1981). Logistic regression diagnostics. Annals of Statistics, 9, 705-724.
30. Thomas, D. R. (1992). Interpreting discriminant functions: a data analytic approach. Multivariate Behavioral Research, 27, 335-362.
31. Thomas, D.R., Hughes, C.E. and Zumbo, B.D. (1998). On variable importance in linear regression. Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, 45, 253-275.
32. Thomas, D. R. and Zumbo, B. D. (1996). Using a measure of variable importance to investigate the standardization of discriminant coefficients. Journal of Educational and Behavioral Statistics, 21, 110-130.
33. Thomas, D. R. Zhu, P. and Decady Y. (2007). Point estimates and confidence intervals for variable importance in multiple linear regression. Journal of Educational and Behavioral Statistics, 32, 61-91.
34. Windmeijer, F.A.G. (1995). Goodness-of-fit measures in binary choice models. Econometric Review, 14, 101-116.