Selection of ordinally scaled independent variables with applications to international classification of functioning core sets

Journal of the Royal Statistical Society. Series C: Applied Statistics

Volumn 60, Issue 3, 2011, Pages 377-395

  Gertheiss, Jan ^a   Hogger, Sara ^a   Oberhauser, Cornelia ^a   Tutz, Gerhard ^a  

^a UNIVERSITY OF MUNICH   (Germany)

Author keywords

Boosting; Group lasso; International classification of functioning core sets; Ordinal predictors; Ridge regression; Variable selection

Indexed keywords

EID: 79954618626     PISSN: 00359254     EISSN: 14679876     Source Type: Journal    
DOI: 10.1111/j.1467-9876.2010.00753.x     Document Type: Article

References (51)

1. Albert, J. H. and Chib, S. (2001) Sequential ordinal modeling with applications to survival data. Biometrics, 57, 829-836.
2. Armstrong, B. and Sloan, M. (1989) Ordinal regression models for epidemiologic data. Am. J. Epidem., 129, 191-204.
3. Bacchetti, P. (1989) Additive isotonic models. J. Am. Statist. Ass., 84, 289-294.
4. Barlow, R. E. (ed.) (1978) Statistical Inference under Order Restrictions: the Theory and Application of Isotonic Regression. Chichester: Wiley.
5. Breiman, L. (1998) Arcing classifiers. Ann. Statist., 26, 801-849.
6. Breiman, L. (1999) Prediction games and arcing algorithms. Neur. Computn, 11, 1493-1517.
7. Breiman, L. (2001) Random forests. Mach. Learn., 45, 5-32.
8. Bühlmann, P. (2006) Boosting for high-dimensional linear models. Ann. Statist., 34, 559-583.
9. Bühlmann, P. and Hothorn, T. (2007) Boosting algorithms: regularization prediction and model fitting. Statist. Sci., 22, 477-505.
10. Bühlmann, P. and Yu, B. (2003) Boosting with the L2 loss: regression and classification. J. Am. Statist. Ass., 98, 324-339.
11. Canty, A. and Ripley, B. (2009) boot: bootstrap R (S-Plus) functions. R Package Version 1.2-41.
12. Cieza, A., Ewert, T., Üstün, T. B., Chatterji, S., Kostanjsek, N. and Stucki, G. (2004a) Development of ICF Core Sets for patients with chronic conditions. J. Rehabilitn Med., suppl., 44, 9-11.
13. Cieza, A., Stucki, G., Weigl, M., Kullmann, L., Stoll, T., Kamen, L., Kostanjsek, N. and Walsh, N. (2004b) ICF Core Sets for chronic widespread pain. J. Rehabilitn Med., suppl., 44, 63-68.
14. Cox, C. (1995) Location-scale cumulative odds models for ordinal data: a generalized non-linear model approach. Statist. Med., 14, 1191-1203.
15. Fan, J. and Li, R. (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. J. Am. Statist. Ass., 96, 1348-1360.
16. Freund, Y. and Schapire, R. E. (1996) Experiments with a new boosting algorithm. In Proc. 13th Int. Conf. Machine Learning, pp. 148-156. San Francisco: Morgan Kaufmann.
17. Friedman, J. H., Hastie, T. and Tibshirani, R. (2000) Additive logistic regression: a statistical view of boosting. Ann. Statist., 28, 337-407.
18. Gertheiss, J. and Tutz, G. (2009) Penalized regression with ordinal predictors. Int. Statist. Rev., 77, 345-365.
19. Gertheiss, J. and Tutz, G. (2010) Sparse modeling of categorial explanatory variables. Ann. Appl. Statist., to be published,.
20. Hastie, T., Tibshirani, R. and Friedman, J. H. (2009) The Elements of Statistical Learning, 2nd edn. New York: Springer.
21. Hofner, B., Hothorn, T., Kneib, T. and Schmid, M. (2009) A framework for unbiased model selection based on boosting. J. Computnl Graph. Statist., to be published.
22. Honaker, J., King, G. and Blackwell, M. (2009) Amelia: Amelia II; a program for missing data. R Package Version 1.2-2.
23. Hothorn, T., Bühlmann, P., Kneib, T., Schmid, M. and Hofner, B. (2010) mboost: model-based boosting. R Package Version 2.0-6.
24. Hothorn, T., Hornik, K. and Zeileis, A. (2006) Unbiased recursive partitioning: a conditional inference framework. J. Computnl Graph. Statist., 15, 651-674.
25. Hurvich, C. M., Simonoff, J. S. and Tsai, C.-L. (1998) Smoothing parameter selection in nonparametric regression using an improved Akaike information criterion. J. R. Statist. Soc. B, 60, 271-293.
26. Karatzoglou, A., Smola, A., Hornik, K. and Zeileis, A. (2004) kernlab-an S4 package for kernel methods in R. J. Statist. Softwr., 11, no. 9, 1-20.
27. King, G., Honaker, J., Joseph, A. and Scheve, K. (2001) Analyzing incomplete political science data: an alternative algorithm for multiple imputation. Am. Polit. Sci. Rev., 95, 49-69.
28. Leitenstorfer, F. and Tutz, G. (2007) Generalized monotonic regression based on B-splines with an application to air pollution data. Biostatistics, 8, 654-673.
29. Liu, Q. and Agresti, A. (2005) The analysis of ordinal categorical data: an overview and a survey of recent developments. Test, 14, 1-73.
30. Luan, Y. and Li, H. (2008) Group additive regression models for genomic data analysis. Biostatistics, 9, 100-113.
31. McCullagh, P. (1980) Regression models for ordinal data (with discussion). J. R. Statist. Soc. B, 42, 109-142.
32. McHorney, C. A., Ware, J. E. and Raczek, A. E. (1993) The MOS 36-item short-form health survey (SF-36): II, psychometric and clinical tests of validity in measuring physical and mental health constructs. Med. Care, 31, 247-263.
33. Meier, L., van de Geer, S. and Bühlmann, P. (2008) The group lasso for logistic regression. J. R. Statist. Soc. B, 70, 53-71.
34. Peterson, B. and Harrell, F. E. (1990) Partial proportional odds models for ordinal response variables. Appl. Statist., 39, 205-217.
35. R Development Core Team (2009) R: a Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing.
36. Schapire, R. E. (1990) The strength of weak learnability. Mach. Learn., 5, 197-227.
37. Similä, T. and Tikka, J. (2007) Input selection and shrinkage in multiresponse linear regression. Computnl Statist. Data Anal., 52, 406-422.
38. Stucki, G. and Grimby, G. (2004) Applying the ICF in medicine. J. Rehabilitn Med., suppl., 44, 5-6.
39. Tibshirani, R. (1996) Regression shrinkage and selection via the lasso. J. R. Statist. Soc. B, 58, 267-288.
40. Tibshirani, R., Saunders, M., Rosset, S., Zhu, J. and Kneight, K. (2005) Sparsity and smoothness via the fused lasso. J. R. Statist. Soc. B, 67, 91-108.
41. Turlach, B. A. (2009) quadprog: functions to solve quadratic programming problems. R Package Version 1.4-12.
42. Tutz, G. and Binder, H. (2006) Generalized additive modeling with implicit variable selection by likelihood-based boosting. Biometrics, 62, 961-971.
43. Tutz, G. and Gertheiss, J. (2010) Feature extraction in signal regression: a boosting technique for functional data regression. J. Computnl Graph. Statist., 19, 154-174.
44. Tutz, G. and Leitenstorfer, F. (2007) J. Computnl Graph. Statist., 16, 165-188.
45. Walter, S. D., Feinstein, A. R. and Wells, C. K. (1987) Coding ordinal independent variables in multiple regression analysis. Am. J. Epidem., 125, 319-323.
46. Wang, H. and Leng, C. (2008) A note on adaptive group lasso. Computnl Statist. Data Anal., 52, 5277-5286.
47. Ware, J. E. and Sherbourne, C. (1992) The MOS 36-item short-form health survey (SF-36): I, conceptual framework and item selection. Med. Care, 30, 473-483.
48. World Health Organization (2001) International Classification of Functioning Disability and Health: ICF. Geneva: World Health Organization.
49. Xie, B., Pan, W. and Shen, X. (2008) Variable selection in penalized model-based clustering via regularization on grouped parameters. Biometrics, 64, 921-930.
50. Yuan, M. and Lin, Y. (2006) Model selection and estimation in regression with grouped variables. J. R. Statist. Soc. B, 68, 49-67.
51. Zou, H. and Hastie, T. (2005) Regularization and variable selection via the elastic net. J. R. Statist. Soc. B, 67, 301-320.