Penalized regression with ordinal predictors

International Statistical Review

Volumn 77, Issue 3, 2009, Pages 345-365

  Gertheiss, Jan ^a   Tutz, Gerhard ^a  

^a UNIVERSITY OF MUNICH   (Germany)

Author keywords

Basis function approach; Classical linear model; Dummy coding; Generalized linear models; Generalized ridge regression; Ordinal predictors; Penalized likelihood estimation

Indexed keywords

EID: 77349114693     PISSN: 03067734     EISSN: 17515823     Source Type: Journal    
DOI: 10.1111/j.1751-5823.2009.00088.x     Document Type: Article

References (32)

1. Albert, J.H. & Chib, S. (2001). Sequential ordinal modeling with applications to survival data. Biometrics, 57, 829-836.
2. Anderson, J.A. (1984). Regression and ordered categorical variables. J. R. Stat. Soc. Ser. B, 46, 1-30.
3. Armstrong, B. & Sloan, M. (1989). Ordinal regression models for epidemiologic data. Amer. J. Epidemiol., 129, 191-204.
4. Barry, D. (1995). A Bayesian analysis for a class of penalized likelihood estimates. Comm. Statist. Theory Methods, 24, 1057-1071.
5. Bühlmann, P. & Yu, B. (2003). Boosting with the L2 loss: Regression and classification. J. Amer. Statist. Assoc., 98, 324-339.
6. Cox, C. (1995). Location-scale cumulative odds models for ordinal data: A generalized non-linear model approach. Stat. Med., 14, 1191-1203.
7. Eilers, P.H.C. & Marx, B.D. (1996). Flexible smoothing with B-splines and penalties. Statist. Sci., 11, 89-121.
8. Fahrmeir, L. & Tutz, G. (2001). Multivariate Statistical Modelling Based on Generalized Linear Models, 2nd ed. New York: Springer.
9. Freund, Y. (1995). Boosting a weak learning algorithm by majority. Inform. Comput., 121, 256-285.
10. Freund, Y. & Schapire, R.E. (1996). Experiments with a new boosting algorithm. In Proceedings of the Thirteenth International Conference on Machine Learning, pp. 148-156. San Francisco, CA: Morgan Kaufmann.
11. Green, D.J. & Silverman, B.W. (1994). Nonparametric Regression and Generalized Linear Models: A Roughness Penalty Approach. London: Chapman & Hall.
12. Hastie, T., Tibshirani, R. & Friedman, J.H. (2001). The Elements of Statistical Learning. New York: Springer.
13. Hoerl, A.E. & Kennard, R.W. (1970). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12, 55-67.
14. Hurvich, C.M., Simonoff, J.S. & Tsai, C. (1998). Smoothing parameter selection in nonparametric regression using an improved Akaike information criterion. J. R. Stat. Soc. Ser. B, 60, 271-293.
15. Jensen, D.R. & Ramirez, D.E. (2008). Anomalies in the foundation of ridge regression. Internat. Statist. Rev., 76, 89-105.
16. Labowitz, S. (1970). The assignment of numbers to rank order categories. Amer. Sociol. Rev., 35, 515-524.
17. Land, S.R. & Friedman, J.H. (1997). Variable fusion: A new adaptive signal regression method. Technical report 656, Department of Statistics, Carnegie Mellon University Pittsburg.
18. Le Cessie, S. & van Houwelingen, J.C. (1992). Ridge estimators in logistic regression. J. R. Stat. Soc. Ser. C, 41, 191-201.
19. Liu, I. & Agresti, A. (2005). The analysis of ordinal categorical data: An overview and a survey of recent developments. Test, 14, 1-73.
20. Mayer, L.S. (1970). Comment on "the assignment of numbers to rank order categories". Amer. Sociol. Rev., 35, 916-917.
21. Mayer, L.S. (1971). A note on treating ordinal data as interval data. Amer. Sociol. Rev., 36, 519-520.
22. McCullagh, P. (1980). Regression models for ordinal data (with discussion). J. R. Stat. Soc. Ser. B, 42, 109-142.
23. McCullagh, P. & Nelder, J.A. (1989). Generalized Linear Models, 2nd ed. New York: Chapman & Hall.
24. Myoken, H. & Uchida, Y. (1977). The generalized ridge estimator and improved adjustments for regression parameters. Metrika, 24, 113-124.
25. Peterson, B. & Harrell, F.E. (1990). Partial proportional odds models for ordinal response variables. J. R. Stat. Soc. Ser. C, 39, 205-217.
26. R Development Core Team (2007). R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing. ISBN 3-900051-07-0.
27. Schapire, R.E. (1990). The strength of weak learnability. Mach. Learn., 5, 197-227.
28. Tibshirani, R., Saunders, M., Rosset, S., Zhu, J. & Kneight, K. (2005). Sparsity and smoothness via the fused lasso. J. R. Stat. Soc. Ser. B, 67, 91-108.
29. Tukey, J. (1977). Explanatory Data Analysis. New York: Addison Wesley.
30. Walter, S.D., Feinstein, A.R. & Wells, C.K. (1987). Coding ordinal independent variables in multiple regression analysis. Amer. J. Epidemiol., 125, 319-323.
31. Winship, C. & Mare, R.D. (1984). Regression models with ordinal variables. Amer. Sociol. Rev., 49, 512-525.
32. Wood, S.N. (2006). Generalized Additive Models: An Introduction with R. London: Chapman & Hall.