A simple bootstrap method for constructing nonparametric confidence bands for functions

Annals of Statistics

Volumn 41, Issue 4, 2013, Pages 1892-1921

  Hall, Peter ^a,b   Horowitz, Joel ^c  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Bandwidth; Bias; Bootstrap; Confidence interval; Conservative coverage; Coverage error; Kernel methods; Statistical smoothing

Indexed keywords

EID: 84885059377     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/13-AOS1137     Document Type: Article

References (60)

1. BERAN, R. (1987). Prepivoting to reduce level error of confidence sets. Biometrika 74 457-468.
2. BERRY, S. M., CARROLL, R. J. and RUPPERT, D. (2002). Bayesian smoothing and regression splines for measurement error problems. J. Amer. Statist. Assoc. 97 160-169.
3. BJERVE, S., DOKSUM, K. A. and YANDELL, B. S. (1985). Uniform confidence bounds for regression based on a simple moving average. Scand. J. Stat. 12 159-169.
4. BROWN, L. D. and LEVINE, M. (2007). Variance estimation in nonparametric regression via the difference sequence method. Ann. Statist. 35 2219-2232.
5. BUCKLEY, M. J., EAGLESON, G. K. and SILVERMAN, B. W. (1988). The estimation of residual variance in nonparametric regression. Biometrika 75 189-199.
6. CAI, T. T., LEVINE, M. and WANG, L. (2009). Variance function estimation in multivariate non-parametric regression with fixed design. J. Multivariate Anal. 100 126-136.
7. CAI, T. T. and LOW, M. G. (2006). Adaptive confidence balls. Ann. Statist. 34 202-228. (Pubitemid 43836799)
8. CHEN, S. X. (1996). Empirical likelihood confidence intervals for nonparametric density estimation. Biometrika 83 329-341.
9. CHEN, S. X., HÄRDLE, W. and LI, M. (2003). An empirical likelihood goodness-of-fit test for time series. J. R. Stat. Soc. Ser. B Stat. Methodol. 65 663-678. (Pubitemid 36931861)
10. CLAESKENS, G. and VAN KEILEGOM, I. (2003). Bootstrap confidence bands for regression curves and their derivatives. Ann. Statist. 31 1852-1884. (Pubitemid 38285093)
11. DETTE, H., MUNK, A. and WAGNER, T. (1998). Estimating the variance in nonparametric regression-what is a reasonable choice? J. R. Stat. Soc. Ser. B Stat. Methodol. 60 751-764. (Pubitemid 128656810)
12. EFRON, B. and TIBSHIRANI, R. J. (1993). An Introduction to the Bootstrap. Monographs on Statistics and Applied Probability 57.
13. EUBANK, R. L. and SPECKMAN, P. L. (1993). Confidence bands in nonparametric regression. J. Amer. Statist. Assoc. 88 1287-1301.
14. EUBANK, R. L. and WANG, S. (1994). Confidence regions in non-parametric regression. Scand. J. Stat. 21 147-158.
15. FAN, J. and YAO, Q. (1998). Efficient estimation of conditional variance functions in stochastic regression. Biometrika 85 645-660.
16. GASSER, T., SROKA, L. and JENNEN-STEINMETZ, C. (1986). Residual variance and residual pattern in nonlinear regression. Biometrika 73 625-633.
17. GENOVESE, C. R. and WASSERMAN, L. (2005). Confidence sets for nonparametric wavelet regression. Ann. Statist. 33 698-729. (Pubitemid 41053720)
18. GENOVESE, C. and WASSERMAN, L. (2008). Adaptive confidence bands. Ann. Statist. 36 875-905.
19. GINÉ, E. and NICKL, R. (2010). Confidence bands in density estimation. Ann. Statist. 38 1122-1170.
20. HALL, P. (1986). On the bootstrap and confidence intervals. Ann. Statist. 14 1431-1452.
21. HALL, P. (1992a). Effect of bias estimation on coverage accuracy of bootstrap confidence intervals for a probability density. Ann. Statist. 20 675-694.
22. HALL, P. (1992b). On bootstrap confidence intervals in nonparametric regression. Ann. Statist. 20 695-711.
23. HALL, P. and HOROWITZ, J. (2013). Supplement to "A simple bootstrap method for constructing nonparametric confidence bands for functions.," DOI:10.1214/13-AOS1137SUPP.
24. HALL, P., KAY, J. W. and TITTERINGTON, D. M. (1990). Asymptotically optimal difference-based estimation of variance in nonparametric regression. Biometrika 77 521-528.
25. HALL, P. and MARRON, J. S. (1990). On variance estimation in nonparametric regression. Biometrika 77 415-419.
26. HALL, P. and OWEN, A. B. (1993). Empirical likelihood confidence bands in density estimation. J. Comput. Graph. Statist. 2 273-289.
27. HALL, P. and TITTERINGTON, D. M. (1988). On confidence bands in nonparametric density estimation and regression. J. Multivariate Anal. 27 228-254.
28. HÄRDLE, W. and BOWMAN, A. W. (1988). Bootstrapping in nonparametric regression: Local adaptive smoothing and confidence bands. J. Amer. Statist. Assoc. 83 102-110.
29. HÄRDLE, W., HUET, S. and JOLIVET, E. (1995). Better bootstrap confidence intervals for regression curve estimation. Statistics 26 287-306.
30. HÄRDLE, W. and MARRON, J. S. (1991). Bootstrap simultaneous error bars for nonparametric regression. Ann. Statist. 19 778-796.
31. HÄRDLE, W., HUET, S., MAMMEN, E. and SPERLICH, S. (2004). Bootstrap inference in semipara-metric generalized additive models. Econometric Theory 20 265-300. (Pubitemid 38482884)
32. HOFFMANN, M. and NICKL, R. (2011). On adaptive inference and confidence bands. Ann. Statist. 39 2383-2409.
33. HOROWITZ, J. L. and SPOKOINY, V. G. (2001). An adaptive, rate-optimal test of a parametric mean-regression model against a nonparametric alternative. Econometrica 69 599-631. (Pubitemid 32514244)
34. KOMLÓS, J., MAJOR, P. and TUSNÁDY, G. (1976). An approximation of partial sums of independent RV's, and the sample DF. II. Z. Wahrsch. Verw. Gebiete 34 33-58.
35. LI, K.-C. (1989). Honest confidence regions for nonparametric regression. Ann. Statist. 17 1001-1008.
36. LOH, W.-Y. (1987). Calibrating confidence coefficients. J. Amer. Statist. Assoc. 82 155-162.
37. LOW, M. G. (1997). On nonparametric confidence intervals. Ann. Statist. 25 2547-2554.
38. MASSART, P. (1989). Strong approximation for multivariate empirical and related processes, via KMT constructions. Ann. Probab. 17 266-291.
39. MCMURRY, T. L. and POLITIS, D. N. (2008). Bootstrap confidence intervals in nonparametric regression with built-in bias correction. Statist. Probab. Lett. 78 2463-2469.
40. MENDEZ, G. and LOHR, S. (2011). Estimating residual variance in random forest regression. Comput. Statist. Data Anal. 55 2937-2950.
41. MÜLLER, U. U., SCHICK, A. and WEFELMEYER, W. (2003). Estimating the error variance in nonparametric regression by a covariate-matched U-statistic. Statistics 37 179-188. (Pubitemid 36761243)
42. MÜLLER, H.-G. and STADTMÜLLER, U. (1987). Estimation of heteroscedasticity in regression analysis. Ann. Statist. 15 610-625.
43. MÜLLER, H.-G. and STADTMÜLLER, U. (1993). On variance function estimation with quadratic forms. J. Statist. Plann. Inference 35 213-231.
44. MÜLLER, H.-G. and ZHAO, P. L. (1995). On a semiparametric variance function model and a test for heteroscedasticity. Ann. Statist. 23 946-967.
45. MUNK, A., BISSANTZ, N., WAGNER, T. and FREITAG, G. (2005). On difference-based variance estimation in nonparametric regression when the covariate is high dimensional. J. R. Stat. Soc. Ser. B Stat. Methodol. 67 19-41. (Pubitemid 40167039)
46. NEUMANN, M. H. (1994). Fully data-driven nonparametric variance estimators. Statistics 25 189-212.
47. NEUMANN, M. H. (1995). Automatic bandwidth choice and confidence intervals in nonparametric regression. Ann. Statist. 23 1937-1959.
48. NEUMANN, M. H. and POLZEHL, J. (1998). Simultaneous bootstrap confidence bands in nonpara-metric regression. J. Nonparametr. Stat. 9 307-333. (Pubitemid 128547518)
49. PICARD, D. and TRIBOULEY, K. (2000). Adaptive confidence interval for pointwise curve estimation. Ann. Statist. 28 298-335.
50. RICE, J. (1984). Bandwidth choice for nonparametric regression. Ann. Statist. 12 1215-1230.
51. RUPPERT, D., SHEATHER, S. J. and WAND, M. P. (1995). An effective bandwidth selector for local least squares regression. J. Amer. Statist. Assoc. 90 1257-1270.
52. RUPPERT, D. and WAND, M. P. (1994). Multivariate locally weighted least squares regression. Ann. Statist. 22 1346-1370.
53. RUPPERT, D., WAND, M. P. and CARROLL, R. J. (2003). Semiparametric Regression. Cambridge Series in Statistical and Probabilistic Mathematics 12.
54. SCHUCANY, W. R. and SOMMERS, J. P. (1977). Improvement of kernel type density estimators. J. Amer. Statist. Assoc. 72 420-423.
55. SEIFERT, B., GASSER, T. and WOLF, A. (1993). Nonparametric estimation of residual variance revisited. Biometrika 80 373-383.
56. SUN, J. and LOADER, C. R. (1994). Simultaneous confidence bands for linear regression and smoothing. Ann. Statist. 22 1328-1345.
57. TONG, T. and WANG, Y. (2005). Estimating residual variance in nonparametric regression using least squares. Biometrika 92 821-830. (Pubitemid 41681236)
58. TUSNÁDY, G. (1977). A remark on the approximation of the sample DF in the multidimensional case. Period. Math. Hungar. 8 53-55.
59. WANG, Y. D. and WAHBA, G. (1995). Bootstrap confidence-intervals and for smoothing splines and their comparison to Bayesian confidence-intervals. Comm. Statist. Simulation Comput. 51 263-279.
60. XIA, Y. (1998). Bias-corrected confidence bands in nonparametric regression. J. R. Stat. Soc. Ser. B Stat. Methodol. 60 797-811. (Pubitemid 128656813)