A variable selection approach to monotonic regression with Bernstein polynomials

Journal of Applied Statistics

Volumn 38, Issue 5, 2011, Pages 961-976

  Curtis, S K ^a   Ghosh, Sujit K ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

Author keywords

Generalized linear models; Gibbs sampling; Markov chain Monte Carlo; Nonparametric regression; Shape restricted inference; Stochastic search

Indexed keywords

EID: 79952713078     PISSN: 02664763     EISSN: 13600532     Source Type: Journal    
DOI: 10.1080/02664761003692423     Document Type: Article

References (56)

1. R. Barlow, D. Bartholomew, J. Bremner, and H. Brunk, Statistical Inference under Order Restrictions, Wiley, New York, 1972.
2. B. Bornkamp and K. Ickstadt, Bayesian nonparametric estimation of continuous monotone functions with applications to dose-response analysis, Biometrics 65 (2009), pp. 198-205.
3. B.M. Brown and S.X. Chen, Beta-Bernstein smoothing for regression curves with compact support, Scand. J. Stat. 26 (1999), pp. 47-59.
4. H.D. Brunk, Maximum likelihood estimates of monotone parameters, Ann. Math. Stat. 26 (1955), pp. 607-616.
5. H.D. Brunk, On the estimation of parameters restricted by inequalities, Ann. Math. Stat. 29 (1958), pp. 437-454.
6. S.T. Buckland, D.R. Anderson, K.P. Burnham, J.L. Laake, D.L. Borchers, and L. Thomas, Introduction to Distance Sampling: Estimating Abundance of Biological Populations, Oxford University Press, Oxford, 2001.
7. J.M. Carnicer and J.M. Peña, Shape preserving representations and optimality of the Bernstein basis, Adv. Comput. Math. 1 (1993), pp. 173-196.
8. G. Casella and E. Moreno, Objective Bayesian variable selection, J. Am. Stat. Assoc. 101 (2006), pp. 157-167.
9. P.M. Chak, N. Madras, and B. Smith, Semi-nonparametric estimation with Bernstein polynomials, Econ. Lett. 89 (2005), pp. 153-156.
10. I. Chang, L. Chien, A.H. Hsiung, C. Wen, and Y.-J. Wu, Shape restricted regression with random Bernstein polynomials, in IMS Lecture Notes -Monograph Series, Vol. 54, 2007, pp. 187-202.
11. I. Chang, C.A. Hsiung, Y.-J. Wu, and C.-C. Yang, Bayesian survival analysis using Bernstein polynomials, Scand. J. Stat. 32 (2005), pp. 447-466.
12. L. Chien, I. Chang, S.S. Jiang, P.K. Gupta, C. Wen, Y. Wu, and C. Hsiung, Profiling time course expression of virus genes: An illustration of Bayesian inference under shape restrictions, Ann. Appl. Stat. 3 (2009), pp. 1542-1565.
13. W.S. Cleveland, E. Grosse, and W.M. Shyu, Local regression models, in Statistical Models in S, J.M. Chambers and T.J. Hastie, Chapman & Hall/CRC, New York, 1992, pp. 309-376.
14. E. Cripps, R. Kohn, and D. Nott, Bayesian subset selection and model averaging using a centred and dispersed prior for the error variance, Aust. N. Z. J. Stat. 48 (2006), pp. 237-252.
15. H. Dette, N. Neumeyer, and K.F. Pilz, A simple nonparametric estimator of a monotone regression function, Bernoulli 12 (2006), pp. 469-490.
16. D. Dunson, Bayesian semiparametric isotonic regression for count data, J. Am. Stat. Assoc. 100 (2005), pp. 618-627.
17. J. Friedman and R. Tibshirani, The monotone smoothing of scatterplots, Technometrics 26 (1984), pp. 243-250.
18. A.R. Gallant and G.H. Golub, Imposing curvature restrictions on exible functional forms, J. Econom. 26 (1984), pp. 295-321.
19. A.E. Gelfand and A.F.M. Smith, Sampling-based approaches to calculating marginal densities, J. Am. Stat. Assoc. 85 (1990), pp. 398-409.
20. A. Gelman and D. Rubin, Inference from iterative simulation using multiple sequences, Stat. Sci. 7 (1992), pp. 457-511.
21. S. Geman and D. Geman, Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images, IEEE Trans. Pattern Anal. Mach. 6 (1984), pp. 721-741.
22. E.I. George and D.P. Foster, Calibration and empirical Bayes variable selection, Biometrika 87 (2000), pp. 731-747.
23. E.I. George and R.E. McCulloch, Variable selection via Gibbs sampling, J. Am. Stat. Assoc. 88 (1993), pp. 881-889.
24. E.I. George and R.E. McCulloch, Approaches for Bayesian variable selection, Stat. Sin. 7 (1997), pp. 339-373.
25. J. Geweke, Variable selection and model comparison in regression, in Bayesian Statistics 5, J.M. Bernardo, J.O. Berger, A.P. Dawid, and A.F.M. Smith, Oxford University Press, Oxford, 1996, pp. 609-620.
26. C.J. Geyer, Constrained maximum likelihood exemplified by isotonic convex logistic regression, J. Am. Stat. Assoc. 86 (1991), pp. 717-724.
27. S. Ghosal, Convergence rates for density estimation with Bernstein polynomials, Ann. Stat. 29 (2001), pp. 1264-1280.
28. P.J. Green, Reversible jump Markov chain Monte Carlo computation and Bayesian model determination, Biometrika 82 (1995), pp. 711-732.
29. P. Hall and L. Huang, Nonparametric kernel regression subject to monotonicity constraints, Ann. Stat. 29 (2001), pp. 624-647.
30. C. Hildreth, Point estimate of ordinates of concave functions, J. Am. Stat. Assoc. 49 (1954), pp. 598-619.
31. C.C. Holmes and N.A. Heard, Generalized monotonic regression using random change points, Stat. Med. 22 (2003), pp. 623-638.
32. R. Ihaka and R. Gentleman, R: A language for data analysis and graphics, J. Comput. Graph. Stat. 5 (1996), pp. 299-314.
33. M. Lavine and A. Mockus, A nonparametric Bayes method for isotonic regression, J. Stat. Plan. Inference 46 (1995), pp. 235-248.
34. E. Mammen, J.S. Marron, B.A. Turlach, and M.P. Wand, A general projection framework for constrained smoothing, Stat. Sci. 16 (2001), pp. 232-248.
35. A.C. McLain and S.K. Ghosh, Estimation of Time Transformation Models with Bernstein Polynomials, Institute of Statistics Mimeo Series #2625, North Carolina State University, Raleigh, North Carolina, 2009.
36. T.J. Mitchell and J.J. Beauchamp, Bayesian variable selection in linear regression, J. Am. Stat. Assoc. 83 (1988), pp. 1023-1032.
37. H. Mukerjee, Monotone nonparametric regression, Ann. Stat. 16 (1988), pp. 741-750.
38. B. Neelon and D.B. Dunson, Bayesian isotonic regression and trend analysis, Biometrics 60 (2004), pp. 398-406.
39. W. Nicholson, Microeconomic Theory, The Dryden Press, FortWorth, Texas, 1992.
40. A. Ongaro and C. Cataneo, Discrete random probability measures: A general framework for nonparametric Bayesian inference, Stat. Probab. Lett. 67 (2004), pp. 33-45.
41. K. Pilz and S. Titoff, monreg: Nonparametric Monotone Regression, R package version 0.1, Earlier developements by Holger Dette and Kay Pilz, 2005.
42. M. Plummer, N. Best, K. Cowles, and K. Vines, coda: Output Analysis and Diagnostics for MCMC, r package version 0.12-1, 2007.
43. R Development Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, 2007, ISBN 3-900051-07-0.
44. J.O. Ramsay, Monotone regression splines in action, Stat. Sci. 3 (1988), pp. 425-461.
45. J.O. Ramsay, Estimating smooth monotone functions, J. R. Stat. Soc. Ser. B 60 (1998), pp. 365-375.
46. L. Reboul, Estimation of a function under shape restrictions. Applications to reliability, Ann. Stat. 33 (2005), pp. 1330-1356.
47. C.P. Robert, Simulation of truncated normal variables, Stat. Comput. 5 (1995), pp. 121-125.
48. M. Smith and R. Kohn, Nonparametric regression using Bayesian variable selection, J. Econom. 75 (1996), pp. 317-343.
49. D.J. Spiegelhalter, A. Thomas, and N.G. Best, WinBUGS Version 1.2 User Manual, MRC Biostatistics Unit, Cambridge, 1999.
50. U. Stadtmüller, Asymptotic properties of nonparametric curve estimates, Period. Math. Hung. 17 (1986), pp. 83-108.
51. S. Sturtz, U. Ligges, and A. Gelman, R2WinBUGS: A package for running Win-BUGS from R, J. Stat. Softw. 12 (2005), pp. 1-16.
52. A. Tenbusch, Two-dimensional Bernstein polynomial density estimators, Metrika 41 (1994), pp. 233-253.
53. A. Tenbusch, Nonparametric curve estimation with Bernstein estimates, Metrika 45 (1997), pp. 1-30.
54. N.K.S. Thalange, P.J. Foster, M.S. Gill, D.A. Price, and P.E. Clayton, Model of normal prepubertal growth, Arch. Dis. Childh. 75 (1996), pp. 427-431.
55. L. Tierney, Markov chains for exploring posterior distributions, Ann. Stat. 22 (1994), pp. 1701-1728.
56. X. Wang and F. Li, Isotonic smoothing spline regression, J. Comput. Graph. Stat. 17 (2008), pp. 21-37.