Model selection for penalized spline smoothing using Akaike information criteria

Australian and New Zealand Journal of Statistics

Volumn 49, Issue 2, 2007, Pages 173-190

  Wager, Carrie ^a,d   Vaida, Florin ^b,e   Kauermann, Göran ^c  

^a Precision Bioassay ^*  (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c BIELEFELD UNIVERSITY   (Germany)

^d Precision Bioassay   (United States)

^e UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Additive models; Conditional maximum likelihood; Mixed model; Variable selection

Indexed keywords

EID: 34250794605     PISSN: 13691473     EISSN: 1467842X     Source Type: Journal    
DOI: 10.1111/j.1467-842X.2007.00473.x     Document Type: Article

References (41)

1. Agresti, A. (1990). Categorical Data Analysis. New York : John Wiley & Sons.
2. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In International Symposium on Information Theory, eds B.N. Petrov, F. Csaki, pp. 267 81. Budapest : Akademia Kaido.
3. Breiman, L. (2001). Statistical modeling: The two cultures. Statist. Science 16, 199 215.
4. Brumback, B.A. & Rice, J.A. (1998). Smoothing spline models for the analysis of nested and crossed samples of curves. J. Amer. Statist. Assoc. 93, 961 976.
5. Brumback, B.A., Ruppert, D.G. & Wand, M.P. (1999). Comment on Shively, Kohn and Wood. J. Amer. Statist. Assoc. 94, 794 797.
6. Burnham, K. & Anderson, D.R. (2002). Model Selection and Multimodel Inference. New York : Springer-Verlag.
7. Chambers, J.M. & Hastie, T.J. (1993). Statistical Models in S. Pacific Grove : Wadsworth.
8. Coull, B.A., Ruppert, D. & Wand, M.P. (2001). Simple incorporation of interactions into additive models. Biometrics 57, 539 545.
9. Crainiceanu, C. & Ruppert, D. (2004). Likelihood ratio tests in linear mixed models with one variance component. J. Roy. Statist. Soc. Ser. B 66, 165 185.
10. deBoor, C. (2001). A Practical Guide to Splines. New York : Springer-Verlag.
11. Eilers, P.H.C. & Marx, B.D. (1996). Flexible smoothing with b-splines and penalties (disc: P102-121). Statist. Science 11, 89 102.
12. Flaschel, P., Kauermann, G. & Semmler, W. (2007). Testing wage and price Phillips curves for the United States. Metroeconomica 0, 0. (to appear).
13. Hastie, T. (1996). Pseudosplines. J. Roy. Statist. Soc. Ser. B 58, 379 396.
14. Hastie, T.J. & Tibshirani, R.J. (1990). Generalized Additive Models. London : Chapman & Hall.
15. Hodges, J.S. & Sargent, D.J. (2001). Counting degrees of freedom in hierarchical and other richly parameterized models. Biometrika 88, 367 379.
16. Hurvich, C. & Tsai, C. (1989). Regression and time series model selection in small samples. Biometrika 72, 297 307.
17. Hurvich, C.M., Simonoff, J.S. & Tsai, C.-L. (1998). Smoothing parameter selection in nonparametric regression using an improved Akaike information criterion. J. Roy. Statist. Soc. Ser. B 60, 271 293.
18. Kammann, E.E. & Wand, M.P. (2003). Geoadditive models. Appl. Statist. 52, 1 18.
19. Kauermann, G. (2005). A note on smoothing parameter selection for penalized spline smoothing. J. Statist. Planning and Inference 127, 53 69.
20. Kou, S.C. & Efron, B. (2002). Smoothers and the, generalized maximum likelihood, and extended exponential criterial: A geometric approach. J. Amer. Statist. Assoc. 97, 766 782.
21. Kullback, S. & Leibler, R. (1951). On information and sufficiency. Ann. Math. Statist. 22, 79 86.
22. Mallows, C. (1973). Some comments on Cp. Technometrics 15, 661 675.
23. McNemar, O. (1947). Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika 12, 153 157.
24. Nychka, D., Haaland, P., O'Connell, M. & Ellner, S. (1998). FUNFITS, data analysis and statistical tools for estimating functions. In Case Studies in Environmental Statistics. eds D. Nychka, W.W. Piegorsch, L.H. Cox. New York : Springer-Verlag.
25. O'Sullivan, F. (1986). A statistical perspective on ill-posed inverse problems. Statist. Science 1, 502 518.
26. Pinheiro, J.C. & Bates, D.M. (2000). Mixed-effects Models in S and S-PLUS. New York : Springer-Verlag.
27. Ruppert, D. & Carroll, R.J. (2000). Spatially-adaptive penalties for spline fitting. Aust. N. Z. J. Stat. 42, 205 223.
28. Ruppert, D., Wand, M. & Carroll, R.J. (2003). Semiparametric Regression. New York : Wiley.
29. SAS Institute (1999). SAS/STAT® User's Guide, Version 8. Cary : SAS Institute, Inc.
30. Shively, T.S., Kohn, R. & Wood, S. (1999). Variable selection and function estimation in additive nonparametric regression using a data-based prior. J. Amer. Statist. Assoc. 94, 777 794.
31. Simonoff, J.S. & Tsai, C.-L. (1999). Semiparametric and additive model selection using an improved Akaike information criterion. J. Comput. and Graph. Statist. 8, 22 40.
32. Speed, T. (1991). Comment on "That BLUP is a good thing: The estimation of random effects". Statist. Science 6, 42 44.
33. Vaida, F. & Blanchard, S. (2005). Conditional Akaike information for mixed effects models. Biometrika 92, 351 370.
34. Wager, C.G., Coull, B.A. & Lange, N. (2004). Modelling spatial intensity for replicated inhomogeneous point patterns in brain imaging. J. Roy. Statist. Soc. Ser. B 66, 429 446.
35. Wahba, G. (1990). Spline Functions for Observational Data. Philadelphia : SIAM.
36. Wand, M. (2003). Smoothing and mixed models. Comput. Statist. 18, 223 249.
37. Wood, S. (2003). Thin plate regression splines. J. Roy. Statist. Soc. Ser. B 65, 95 114.
38. Wood, S. (2004). Stable and efficient multiple smoothing parameter estimation for generalized additive models. J. Amer. Statist. Assoc. 99, 673 686.
39. Wood, S. & Augustin, N. (2002). GAMs with integrated model selection using penalized regression splines and applications to environmental modelling. Ecol. Model. 157, 157 177.
40. Wood, S.N. (2000). Modelling and smoothing parameter estimation with multiple quadratic penalties. J. Roy. Statist. Soc. Ser. B 62, 413 428.
41. Yao, P., Kohn, R. & Wood, S. (2003). Bayesian variable selection and model averaging in high-dimensional multinomial nonparametric regression. J. Comput. and Graph. Statist. 12, 23 54.