Locally adaptive bayes nonparametric regression via nested Gaussian processes

Journal of the American Statistical Association

Volumn 108, Issue 504, 2013, Pages 1445-1456

  Zhu, Bin ^a   Dunson, David B ^b  

^a NATIONAL CANCER INSTITUTE   (United States)

^b Duke University   (United States)

Author keywords

Bayesian nonparametric regression; Nested smoothing spline; Penalized sum of square; Reproducing kernel Hilbert space; Stochastic differential equations

Indexed keywords

EID: 84901588366     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.2013.838568     Document Type: Article

References (57)

1. Abramovich, F., and Steinberg, D. M. (1996), "Improved Inference in Nonparametric Regression Using L-Smoothing Splines, " Journal of Statistical Planning and Inference, 49, 327-341. [1446]
2. Aronszajn, N. (1950), "Theory of Reproducing Kernels, " Transactions of the American Mathematical Society, 68, 337-404. [1453]
3. Berlinet, A., and Thomas-Agnan, C. (2004), Reproducing KernelHilbert Spaces in Probability and Statistics, Netherlands: Springer. [1452]
4. Bhattacharya, A., Pati, D., and Dunson, D. B. (2011), "Adaptive Dimension ReductionWith a Gaussian Process Prior, " Arxiv preprint arXiv:1111.1044. [1445]
5. Choi, T., and Schervish, M. J. (2007), "On PosteriorConsistency in Nonparametric Regression Problems, " Journal of Multivariate Analysis, 98, 1969-1987. [1445,1448,1453]
6. Constantine, W., and Percival, D. (2010), wmtsa: Insightful Wavelet Methods for Time Series Analysis. Available at http://CRAN.R-project.org/ package=wmtsa. [1450]
7. Coombes, K., Koomen, J., Baggerly, K., Morris, J., and Kobayashi, R. (2005a), "Understanding the Characteristics of Mass Spectrometry Data Through the Use of Simulation, " Cancer Informatics, 1, 41. [1451]
8. Coombes, K. R., Tsavachidis, S., Morris, J. S., Baggerly, K. A., Hung, M. C., and Kuerer, H. M. (2005b), "Improved Peak Detection and Quantification of Mass Spectrometry Data Acquired From Surface-Enhanced Laser Desorption and Ionization by Denoising Spectra With the Undecimated Discrete Wavelet Transform, " Proteomics, 5, 4107-4117. [1451]
9. Cottrell, J., and London, U. (1999), "Probability-Based Protein Identification by Searching Sequence Databases Using Mass Spectrometry Data, " Electrophoresis, 20, 3551-3567. [1451]
10. Crainiceanu, C. M., Ruppert, D., Carroll, R. J., Joshi, A., andGoodner, B. (2007), "Spatially Adaptive Bayesian Penalized Splines With Heteroscedastic Errors, " Journal of Computational and Graphical Statistics, 16, 265-288. [1446]
11. Denison, D. G. T., Mallick, B. K., and Smith, A. F. M. (1998), "Automatic Bayesian Curve Fitting, " Journal of the Royal Statistical Society, Series B, 60, 333-350. [1445]
12. Dimatteo, I., Genovese, C. R., and Kass, R. E. (2001), "Bayesian Curve-Fitting With Free-Knot Splines, " Biometrika, 88, 1055. [1445]
13. Domon, B., and Aebersold, R. (2006), "Mass Spectrometry and Protein Analysis, " Science, 312, 212. [1451]
14. Donoho, D. L., and Johnstone, I.M. (1995), "Adapting to Unknown Smoothness via Wavelet Shrinkage, " Journal of the American Statistical Association, 1200-1224. [1446,1450]
15. Donoho, D. L., and Johnstone, I.M. (1994), "Ideal Spatial Adaptation by Wavelet Shrinkage, " Biometrika, 81, 425-455. [1450]
16. Durbin, J., and Koopman, S. (2002), "A Simple and Efficient Simulation Smoother for State Space Time Series Analysis, " Biometrika, 89, 603. [1447,1449]
17. Durbin, J., and Koopman, S. (2001), Time Series Analysis by State Space Methods (vol. 24), Oxford: Oxford University Press. [1446,1449]
18. Fan, J., and Gijbels, I. (1995), "Data-Driven Bandwidth Selection in Local Polynomial Fitting: Variable Bandwidth and Spatial Adaptation, " Journal of the Royal Statistical Society, Series B, 57, 371-394. [1446]
19. Friedman, J. H. (1991), "Multivariate Adaptive Regression Splines, " The Annals of Statistics, 19, 1-67. [1445]
20. Friedman, J. H., and Silverman, B.W. (1989), "Flexible Parsimonious Smoothing and Additive Modeling, " Technometrics, 31, 3-21. [1445]
21. George, E. I., and McCulloch, R. E. (1993), "Variable Selection via Gibbs Sampling, " Journal of the American Statistical Association, 88, 881-889. [1445]
22. Ghosal, S., and Roy, A. (2006), "Posterior Consistency of Gaussian Process Prior for Nonparametric Binary Regression, " The Annals of Statistics, 34, 2413-2429. [1445,1453]
23. Green, P. J. (1995), "Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination, " Biometrika, 82, 711. [1445]
24. Heckman, N. E., and Ramsay, J. O. (2000), "Penalized RegressionWith Model-Based Penalties, " Canadian Journal of Statistics, 28, 241-258. [1446]
25. Kloeden, P. E., and Platen, E. (1992), Numerical Solution of Stochastic Differential Equations, New York: Springer Verlag. [1449]
26. Krivobokova, T., Crainiceanu, C. M., and Kauermann, G. (2008), "Fast Adaptive Penalized Splines, " Journal of Computational and Graphical Statistics, 17, 1-20. [1446]
27. Lawrence, N. D., Seeger, M., and Herbrich, R. (2002), "Fast Sparse Gaussian Process Methods: The Informative Vector Machine, " Advances in Neural Information Processing Systems, 15, 609-616. [1449]
28. Luo, Z., and Wahba, G. (1997), "Hybrid Adaptive Splines, " Journal of the American Statistical Association, 92, 107-116. [1445,1450]
29. Morris, J., Coombes, K., Koomen, J., Baggerly, K., and Kobayashi, R. (2005), "Feature Extraction and Quantification for Mass Spectrometry in Biomedical Applications Using the Mean Spectrum, " Bioinformatics, 21, 1764-1775. [1451]
30. Morris, J. S., Brown, P. J., Herrick, R. C., Baggerly, K. A., and Coombes, K. R. (2008), "Bayesian Analysis of Mass Spectrometry Proteomic Data Using Wavelet-Based FunctionalMixed Models, " Biometrics, 64, 479-489. [1451]
31. Neal, R. (1998), "Regression and ClassificationUsing Gaussian Process Priors, " Bayesian Statistics, 6, 475-501. [1445]
32. Pintore, A., Speckman, P., and Holmes, C. C. (2006), "Spatially Adaptive Smoothing Splines, " Biometrika, 93, 113. [1446]
33. Quinonero-Candela, J., and Rasmussen, C. E. (2005), "A Unifying View of Sparse Approximate Gaussian Process Regression, " The Journal of Machine Learning Research, 6, 1939-1959. [1449]
34. R Development Core Team (2011), R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, Available at http://www.R-project.org. [1450]
35. Rasmussen, C. E., Williams, C. K. I. (2006), Gaussian Processes for Machine Learning, Boston: MIT Press. [1445]
36. Ruppert, D., and Carroll, R. J. (2000), "Spatially-Adaptive Penalties for Spline Fitting, " Australian & New Zealand Journal of Statistics, 42, 205-223. [1446]
37. Savitsky, T., Vannucci, M., and Sha, N. (2011), "Variable Selection for Nonparametric Gaussian Process Priors: Models and Computational Strategies, " Statistical Science, 26, 130-149. [1445]
38. Scheipl, F., and Kneib, T. (2009), "Locally Adaptive Bayesian P-splines with a Normal-Exponential-Gamma Prior, " Computational Statistics and Data Analysis, 53, 3533-3552. [1446]
39. Searle, S. R. (1982), Matrix Algebra Useful for Statistics, New York: Wiley. [1454]
40. Shepp, L. A. (1966), "Radon-Nikodym Derivatives of Gaussian Measures, " The Annals of Mathematical Statistics, 37, 321-354. [1454]
41. Shi, J. Q., and Choi, T. (2011), Gaussian Process Regression Analysis for Functional Data, London: Chapman & Hall/CRC Press. [1445]
42. Smith, M., and Kohn, R. (1996), "Nonparametric Regression Using Bayesian Variable Selection, " Journal of Econometrics, 75, 317-343. [1445]
43. Smola, A. J., and Bartlett, P. (2001), "Sparse Greedy Gaussian Process Regression, " in Advances in Neural Information Processing Systems 13, Citeseer, Boston: MIT Press. [1449]
44. Tibshirani, R., Hastie, T., Narasimhan, B., Soltys, S., Shi, G., Koong, A., and Le, Q. T. (2004), "Sample Classification From Protein Mass Spectrometry, by 'Peak Probability Contrasts', " Bioinformatics, 20, 3034-3044. [1451]
45. Van der Vaart, A. W., and Van Zanten, J. H. (2008a), "Rates of Contraction of Posterior Distributions Based on Gaussian Process Priors, " The Annals of Statistics, 36, 1435-1463. [1445]
46. Van der Vaart, A. W., and Van Zanten, J. H. (2008b), "Reproducing Kernel Hilbert Spaces of Gaussian Priors, " Limits of Contemporary Statistics: Contributions in Honor of Jayanta K. Ghosh, 3, 200-222. [1447,1452]
47. Van der Vaart, A. W., and Wellner, J. A. (1996), Weak Convergence and Empirical Processes, New York: Springer Verlag. [1453]
48. Wahba, G. (1990), SplineModels forObservational Data (vol. 59), Philadelphia: Society for Industrial Mathematics. [1450,1453]
49. Wahba, G. (1995), Discussion of "Wavelet Shrinkage: Asymptopia?" by Donoho et al., Journal of the Royal Statistical Society, Series B, 360-361. [1446]
50. West, M., Harrison, J. (1997), Bayesian Forecasting and Dynamic Models, New York: Springer Verlag. [1449]
51. Wolpert, R. L., Clyde M. A., and Tu, C. (2011), "Stochastic Expansions Using Continuous Dictionaries: Lévy Adaptive Regression Kernels, " The Annals of Statistics, 39, 1916-1962. [1446]
52. Wood, S. A., Jiang, W., and Tanner, M. (2002), "Bayesian Mixture of Splines for Spatially Adaptive Nonparametric Regression, " Biometrika, 89, 513. [1446]
53. Wood, S. A., Kohn, R., Cottet, R., Jiang, W., and Tanner, M. (2008), "Locally Adaptive Nonparametric Binary Regression, " Journal of Computational and Graphical Statistics, 17, 352-372. [1446]
54. Wu, J. Q., Sklar, J., Wang, Y. D., and Meiring, W. (2011), bsml: Basis Selection from Multiple Libraries. Available at http://CRAN.R-project.org/ package=bsml. [1450]
55. Zhou, S., and Shen, X. (2001), "Spatially Adaptive Regression Splines and Accurate Knot Selection Schemes, " Journal of the American Statistical Association, 96, 247-259. [1445]
56. Zhu, B., Song, P. X. K., and Taylor, J. M. G. (2011), "Stochastic Functional Data Analysis:ADiffusion Model-BasedApproach, " Biometrics, 67, 1295-1304. [1446]
57. Zou, F., Huang, H., Lee, S., and Hoeschele, I. (2010), "Nonparametric Bayesian Variable Selection With Applications to Multiple Quantitative Trait Loci MappingWith Epistasis andGene-Environment Interaction, " Genetics, 186, 385. [1445]