A sign based loss approach to model selection in nonparametric regression

Statistics and Computing

Volumn 20, Issue 4, 2010, Pages 485-498

  Nott, David J ^a   Jialiang, Li ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Bayesian nonparametric regression; Bayesian variable selection; False selection rate; Generalized additive model

Indexed keywords

EID: 77956877360     PISSN: 09603174     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11222-009-9139-6     Document Type: Article

References (49)

1. k-smoothing splines. J. Stat. Plan. Inference 49, 327-341 (1996).
2. Biller, C.: Adaptive Bayesian regression splines in semiparametric generalized linear models. J. Comput. Graph. Stat. 12, 122-140 (2000).
3. Chan, D., Kohn, R., Nott, D., Kirby, C.: Locally adaptive semiparametric estimation of the mean and variance functions in regression models. J. Comput. Graph. Stat. 15, 915-936 (2006).
4. Chaudhuri, P., Marron, S.: SiZer for exploration of structure in curves. J. Am. Stat. Assoc. 94, 807-823 (1999).
5. Cottet, R., Kohn, R., Nott, D.: Variable selection and model averaging in semiparametric overdispersed generalized linear models. J. Am. Stat. Assoc. 103, 661-671 (2008).
6. De Boor, C.: A Practical Guide to Splines. Springer, New York (1978).
7. Denison, D. G. T., Mallick, B. K., Smith, A. F. M.: Automatic Bayesian curve fitting. J. R. Stat. Soc. B 60, 333-350 (1998).
8. Dias, R., Gamerman, D.: A Bayesian approach to hybrid splines non-parametric regression. J. Stat. Comput. Simul. 72, 285-297 (2002).
9. DiMatteo, I., Genovese, C. R., Kass, R. E.: Bayesian curve-fitting with free-knot splines. Biometrika 88, 1055-1071 (2001).
10. Eilers, P. H. C., Marx, B. D.: Flexible smoothing using B-splines and penalties (with discussion). Stat. Sci. 11, 89-121 (1996).
11. Gamerman, D.: Sampling from the posterior distribution in generalized linear mixed models. Stat. Comput. 7, 57-68 (1997).
12. Ganguli, B., Wand, M. P.: Feature significance in generalized additive models. Stat. Comput. 17, 179-192 (2007).
13. Gelman, A.: Prior distributions for variance parameters in hierarchical models. Bayesian Anal. 1, 515-533 (2006).
14. Gelman, A., Tuerlinckx, F.: Type S error rates for classical and Bayesian single and multiple comparison procedures. Comput. Stat. 15, 373-390 (2000).
15. Gelman, A., Carlin, J. B., Stern, H. S., Rubin, D. B.: Bayesian Data Analysis, 2nd edn. CRC Press, Boca Raton (2003).
16. Gilley, O. W., Pace, R. K.: On the Harrison and Rubinfeld data. J. Environ. Econ. Manage. 31, 403-405 (1996).
17. Green, P. J.: Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82, 711-732 (1995).
18. González-Manteiga, W., Martínez-Miranda, M. D., Raya-Miranda, R.: SiZer map for inference with additive models. Stat. Comput. 18, 297-312 (2008).
19. Gu, C., Wahba, G.: Smoothing spline ANOVA with component-wise Bayesian "confidence intervals". J. Comput. Graph. Stat. 2, 97-117 (1993).
20. Gustafson, P.: Bayesian regression modeling with interactions and smooth effects. J. Am. Stat. Assoc. 95, 795-806 (2000).
21. Harrison, D., Rubinfeld, D. L.: Hedonic prices and the demand for clean air. J. Environ. Econ. Manage. 5, 81-102 (1978).
22. Hastie, T.: Pseudosplines. J. R. Stat. Soc. B 58, 379-396 (1996).
23. Hastie, T., Tibshirani, R.: Generalized Additive Models. Chapman and Hall, London (1990).
24. Hastie, T., Tibshirani, R.: Bayesian backfitting (with discussion). Stat. Sci. 15, 196-223 (2000).
25. Jara, A., Hanson, T., Quintana, F., Mueller, P., Rosner, G.: The DPpackage package. Reference manual. Available at http://cran. r-project. org/web/packages/DPpackage/DPpackage. pdf (2008).
26. Jones, L. V., Tukey, J. W.: A sensible formulation of the significance test. Psychol. Methods 5, 411-414 (2000).
27. Kass, R. E., Wasserman, L.: A reference Bayesian test for nested hypotheses and its relationship to the Schwarz criterion. J. Am. Stat. Assoc. 90, 928-934 (1995).
28. Kohn, R., Smith, M., Chan, D.: Nonparametric regression using linear combinations of basis functions. Stat. Comput. 11, 313-322 (2001).
29. Lang, S., Brezger, A.: Bayesian P-splines. J. Comput. Graph. Stat. 13, 183-212 (2004).
30. Lenk, P. J., DeSarbo, W. S.: Bayesian inference for finite mixtures of generalized linear models with random effects. Psychometrika 65, 93-119 (2000).
31. Liu, J. S.: Monte Carlo Strategies in Scientific Computing. Springer, Berlin (2001).
32. Lunn, D. J., Best, N., Whittaker, J. C.: Generic reversible jump MCMC using graphical models. Stat. Comput. (2008, in press).
33. Nott, D.: Semiparametric estimation of mean and variance functions for non-Gaussian data. Comput. Stat. 21, 603-620 (2006).
34. Nott, D. J., Kuk, A. Y. C.: Coefficient sign prediction methods for model selection. J. R. Stat. Soc. B 69, 447-461 (2007).
35. Rigby, R. A., Stasinopoulos, D. M.: Generalized additive models for location, scale and shape. Appl. Stat. 54, 507-554 (2005).
36. Ruppert, D., Wand, M. P., Carroll, R. J.: Semiparametric Regression. Cambridge University Press, Cambridge (2003).
37. Shively, T. S., Kohn, R., Wood, S.: Variable selection and function estimation in additive nonparametric regression using a data-based prior (with discussion). J. Am. Stat. Assoc. 94, 777-806 (1999).
38. Smith, M., Kohn, R.: Nonparametric regression using Bayesian variable selection. J. Econom. 75, 317-344 (1996).
39. Smith, J. W., Everhart, J. E., Dickson, W. C., Knowler, W. C., Johannes, R. S.: Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. In: Proceedings of the Symposium on Computer Applications and Medical Care, pp. 261-265. IEEE Comput. Soc., Los Alamitos (1988).
40. Spiegelhalter, D. J., Thomas, A., Best, N.: WinBUGSVersion 1. 2 User Manual. MRC Biostatistics Unit. Software available at http://www. mrcbsu. cam. ac. uk/bugs/winbugs/contents. shtml (1999).
41. Wood, S. N.: Generalized Additive Models: An Introduction with R. Chapman and Hall/CRC Press, London/Boca Raton (2006).
42. Wood, S., Kohn, R.: A Bayesian approach to robust binary nonparametric regression. J. Am. Stat. Assoc. 93, 203-213 (1998).
43. Wood, S., Kohn, R., Shively, T., Jiang, W.: Model selection in spline nonparametric regression. J. R. Stat. Soc. B 64, 119-139 (2002).
44. Wu, Y., Boos, D., Stefanski, L. A.: Controlling variable selection by the addition of pseudo-variables. J. Am. Stat. Assoc. 102, 235-243 (2007).
45. Yau, P., Kohn, R.: Estimation and variable selection in nonparametric heteroscedastic regression. Stat. Comput. 13, 191-208 (2003).
46. Yau, P., Kohn, R., Wood, S.: Bayesian variable selection and model averaging in high-dimensional multinomial nonparametric regression. J. Comput. Graph. Stat. 12, 23-54 (2003).
47. Zaslavsky, A. M.: From ANOVA to variance components. Discussion of Gelman (2005) Analysis of variance-why it is more important than ever. Ann. Stat. 33, 1-53 (2005).
48. Zheng, X., Loh, W.: Consistent variable selection in linear models. J. Am. Stat. Assoc. 90, 151-156 (1995).
49. Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. J. R. Stat. Soc. B 67, 301-320 (2005).