Distribution-free prediction bands for non-parametric regression

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 76, Issue 1, 2014, Pages 71-96

  Lei, Jing ^a   Wasserman, Larry ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Conformal prediction; Finite sample property; Kernel density; Prediction bands

Indexed keywords

EID: 84891825688     PISSN: 13697412     EISSN: 14679868     Source Type: Journal    
DOI: 10.1111/rssb.12021     Document Type: Article

References (27)

1. Akritas, M. G. and Van Keilegom, I. (2001) Non-parametric estimation of the residual distribution. Scand. J. Statist., 28, 549-567.
2. Audibert, J. and Tsybakov, A. (2007) Fast learning rate for plug-in classifiers. Ann. Statist., 35, 608-633.
3. Cadre, B., Pelletier, B. and Pudlo, P. (2009) Clustering by estimation of density level sets at a fixed probability. Manuscript. Institut de Recherche Mathématique de Rennes, Rennes. (Available from http://hal.archives-ouvertes.fr/hal-00397437/.)
4. Carroll, R. J. and Ruppert, D. (1991) Prediction and tolerance intervals with transformation and/or weighting. Technometrics, 33, 197-210.
5. Davidian, M. and Carroll, R. J. (1987) Variance function estimation. J. Am. Statist. Ass., 82, 1079-1091.
6. DeGroot, M. and Schervish, M. (2012) Probability and Statistics, 4th edn. Reading: Addison-Wesley.
7. Donoho, D. L. (1988) One-sided inference about functionals of a density. Ann. Statist., 16, 1390-1420.
8. Fan, J. and Gijbels, I. (1996) Local Polynomial Modelling and Its Applications. London: Chapman and Hall.
9. Genovese, C. and Wasserman, L. (2008) Adaptive confidence bands. Ann. Statist., 36, 875-905.
10. Giné, E. and Guillou, A. (2002) Rates of strong uniform consistency for multivariate kernel density estimators. Ann. Inst. H. Poincare B, 38, 907-921.
11. Hall, P. and Rieck, A. (2001) Improving coverage accuracy of nonparametric prediction intervals. J. R. Statist. Soc. B, 63, 717-725.
12. Koenker, R. and Hallock, K. (2001) Quantile regression. J. Econ. Perspect., 15, 143-156.
13. Lei, J., Robins, J. and Wasserman, L. (2011) Distribution free prediction sets. J. Am. Statist. Ass, to be published.
14. Loader, C. (1999) Local Regression and Likelihood. New York: Springer.
15. Low, M. (1997) On nonparametric confidence intervals. Ann. Statist., 25, 2547-2554.
16. Polonik, W. (1995) Measuring mass concentrations and estimating density contour clusters-an excess mass approach. Ann. Statist., 23, 855-881.
17. Rigollet, P. and Vert, R. (2009) Optimal rates for plug-in estimators of density level sets. Bernoulli, 14, 1154-1178.
18. Rinaldo, A., Singh, A., Nugent, R. and Wasserman, L. (2012) Stability of density-based clustering. J. Mach. Learn. Res., 13, 905-948.
19. Ruppert, D., Wand, M. and Carroll, R. (2003) Semiparametric Regression. Cambridge: Cambridge University Press.
20. Scott, C. D. and Nowak, R. D. (2006) Learning minimum volume sets. J. Mach. Learn. Res., 7, 665-704.
21. Shafer, G. and Vovk, V. (2008) A tutorial on conformal prediction. J. Mach. Learn. Res., 9, 371-421.
22. Tsybakov, A. (1997) On nonparametric estimation of density level sets. Ann. Statist., 25, 948-969.
23. Tsybakov, A. (2009) Introduction to Nonparametric Estimation. New York: Springer.
24. Tukey, J. (1947) Nonparametric estimation: II, Statistical equivalent blocks and multivariate tolerance regions. Ann. Math. Statist., 18, 529-539.
25. Vovk, V., Gammerman, A. and Shafer, G. (2005) Algorithmic Learning in a Random World. New York: Springer.
26. Vovk, V., Nouretdinov, I. and Gammerman, A. (2009) On-line predictive linear regression. Ann. Statist., 37, 1566-1590.
27. Yu, B. (1997) Assouad, Fano, and Le Cam. In Festschrift for Lucien Le Cam (eds D. Pollard, E. Torgersen and G. L. Yang ), pp. 423-435. New York: Springer.