Wavelet estimators in nonparametric regression: A comparative simulation study

Journal of Statistical Software

Volumn 6, Issue , 2001, Pages 1-83

  Antoniadis, Anestis ^a   Bigot, Jeremie ^a   Sapatinas, Theofanis ^b  

^a UNIV GRENOBLE ALPES   (France)

^b UNIVERSITY OF CYPRUS   (Cyprus)

Author keywords

EM algorithm; Empirical Bayes; Monte Carlo experiments; Nonparametric regression; Shrinkage; Smoothing Methods; Thresholding; Wavelets

Indexed keywords

EID: 0012780893     PISSN: 15487660     EISSN: None     Source Type: Journal    
DOI: 10.18637/jss.v006.i06     Document Type: Review

References (103)

1. Abramovich, F., Bailey, T.C. & Sapatinas, T. (2000). Wavelet analysis and its statistical applications. The Statistician, 49, 1-29.
2. Abramovich, F. & Benjamini, Y. (1995). Thresholding of wavelet coefficients as multiple hypotheses testing procedure. In Wavelets and Statistics, Antoniadis, A. & Oppenheim, G. (Eds.), Lecture Notes in Statistics 103, pp. 5-14, New York: Springer-Verlag.
3. Abramovich, F. & Benjamini, Y. (1996). Adaptive thresholding of wavelet coefficients. Comput. Statist. Data Anal., 22, 351-361.
4. Abramovich, F., Besbeas, P. & Sapatinas, T. (2000). Empirical Bayes approach to block wavelet function estimation. Technical Report, Department of Mathematics and Statistics, University of Cyprus, Cyprus.
5. Abramovich, F. & Sapatinas, T. (1999). Bayesian approach to wavelet decomposition and shrinkage. In Bayesian Inference in Wavelet Based Models, Müller, P. & Vidakovic, B. (Eds.), Lect. Notes Statist., 141, pp. 33-50, New York: Springer-Verlag.
6. Abramovich, F. & Silverman, B.W. (1998). The vaguelette-wavelet decomposition approaches to statistical inverse problems. Biometrika, 85, 115-129.
7. Abramovich, F., Sapatinas, T. & Silverman, B.W. (1998).Wavelet thresholding via a Bayesian approach. J. R. Statist. Soc. B, 60, 725-749.
8. Abramovich, F., Benjamini, Y., Donoho, D.L. & Johnstone, I.M. (2000). Adapting to unknown sparsity by controlling the false discovery rate. Technical Report 00-19, Department of Statistics, Stanford University, USA.
9. Amato, U. & Vuza, D.T. (1997). Wavelet approximation of a function from samples affected by noise. Rev. Roumanie Math. Pure Appl., 42, 481-493.
10. Angelini, C., De Canditiis, D. & Leblanc, F. (2000). Wavelet regression estimation in nonparametric mixed effect models. Technical Report, Laboratoire IMAG-LMC, University Joseph Fourier, France.
11. Antoniadis, A. (1996). Smoothing noisy data with tapered coiflets series. Scand. J. Statist., 23, 313-330.
12. Antoniadis, A. (1997).Wavelets in statistics: a review (with discussion). J. Ital. Statist. Soc., 6, 97-144.
13. Antoniadis, A. & Fan, J. (2001) Regularization of wavelets approximations (with discussion). J. Am. Statist. Ass., 96 (to appear).
14. Antoniadis, A. & Oppenheim, G. (Eds.) (1995). Wavelets and Statistics, Lect. Notes Statist., 103, New York: Springer-Verlag.
15. Antoniadis, A. & Pham, D.T. (1998). Wavelet regression for random or irregular design. Computat. Statist. Data Anal., 28, 353-369.
16. Benjamini, Y. & Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Statist. Soc. B, 57, 289-300.
17. Berger, J. (1985). Statistical Decision Theory and Bayesian Analysis. New York: Springer-Verlag
18. Breiman, L. & Peters, S. (1992). Comparing automatic smoothers (a public service enterprise). Int. Statist. Rev., 60, 271-290.
19. Bruce, A.G. & Gao, H.-Y. (1996). Understanding WaveShrink: variance and bias estimation. Biometrika, 83, 727-745.
20. Buckheit, J.B. & Donoho, D.L. (1995). WaveLab and Reproducible Research. In Wavelets and Statistics, Antoniadis, A. & Oppenheim, G. (Eds.), Lect. Notes Statist., 103, pp. 55-81, New York: Springer-Verlag.
21. Buckheit, J.B., Chen, S., Donoho, D.L., Johnstone, I.M. & & Scargle, J. (1995). About WaveLab. Technical Report, Department of Statistics, Stanford University, USA. Available http://www-stat.stanford.edu/~wavelab.
22. Burrus, C.S., Gonipath, R.A. & Guo, H. (1998). Introduction to Wavelets and Wavelet Transforms: A Primer. Englewood Cliffs: Prentice Hall.
23. Cai, T.T. (1999). Adaptive wavelet estimation: a block thresholding and oracle inequality approach. Ann. Statist., 27, 898-924.
24. Cai, T.T.& Brown, L.D. (1998). Wavelet shrinkage for nonequispaced samples. Ann. Statist., 26, 1783-1799.
25. Cai, T.T. & Brown, L.D. (1999). Wavelet estimation for samples with random uniform design. Statist. Probab. Lett., 42, 313-321.
26. Cai, T.T. & Silverman, B.W. (2001). Incorporating information on neighboring coefficients into wavelet estimation. Sankhyā, Series A, 63 (to appear).
27. Chan, C.B., Chan, F.H., Lam, F.K., Lui, P.-W. & Poon, P.W. (1997). Fast detection of venous air embolism in doppler heart sound using the wavelet transform. IEEE Trans. Biomed. Eng., 44, 237-246.
28. Chipman, H.A., Kolaczyk, E.D. & McCulloch, R.E. (1997). Adaptive Bayesian Wavelet Shrinkage. J. Am. Statist. Ass., 92, 1413-1421.
29. Clyde, M. & George, E.I. (1999). Empirical Bayes estimation in wavelet nonparametric regression. In Bayesian Inference in Wavelet Based Models, Müller, P. & Vidakovic, B. (Eds.), Lect. Notes Statist., 141, pp. 309-322, New York: Springer-Verlag.
30. Clyde, M. & George, E.I. (2000). Flexible empirical Bayes estimation for wavelets. J. R. Statist. Soc. B, 62, 681-698.
31. Clyde, M., Parmigiani, G. & Vidakovic, B. (1998). Multiple shrinkage and subset selection in wavelets. Biometrika, 85, 391-401.
32. Coifman, R.R. & Donoho, D.L. (1995). Translation-invariant de-noising. In Wavelets and Statistics, Antoniadis, A. & Oppenheim, G. (Eds.), Lect. Notes Statist., 103, pp. 125-150, New York: Springer-Verlag.
33. Crouse, M.S., Nowak, R.D. & Baraniuk, R.G. (1998). Wavelet-based statistical signal processing using hidden Markov models. IEEE Trans. Sig. Proc., 46, 886-902.
34. Daubechies, I. (1992). Ten Lectures on Wavelets. Philadelphia: SIAM.
35. Delyon, B. & Juditsky, A. (1995). Estimating wavelet coefficients In Wavelets and Statistics, Antoniadis, A. & Oppenheim, G. (Eds.), Lect. Notes Statist., 103, pp. 15-168, New York: Springer-Verlag.
36. Delyon, B. & Juditsky, A. (1996). On minimax wavelet estimators. Appl. Comput. Harm. Anal., 3, 215-228.
37. Dempster, A.P., Laird, N.M. & Rubin, D.B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. R. Statist. Soc. B, 39, 1-38.
38. Dennis, J.E. & Mei, H.H.W. (1979). Two new unconstrained optimization algorithms which use function and gradient values. J. Optimiz. Theory Appl., 28, 453-483.
39. Donoho, D.L. & Johnstone, I.M. (1994). Ideal spatial adaptation by wavelet shrinkage. Biometrika, 81, 425-455.
40. Donoho, D.L. & Johnstone, I.M. (1995). Adapting to unknown smoothness via wavelet shrinkage. J. Am. Statist. Ass., 90, 1200-1224.
41. Donoho, D.L. & Johnstone, I.M. (1998). Minimax estimation via wavelet shrinkage. Ann. Statist., 26, 879-921.
42. Donoho, D.L., Johnstone, I.M., Kerkyacharian, G. & Picard, D. (1995). Wavelet shrinkage: asymptopia? (with discussion). J. R. Statist. Soc. B, 57, 301-337.
43. Efromovich, S. (1999). Quasi-linear wavelet estimation. J. Am. Statist. Ass., 94, 189-204.
44. Efromovich, S. (2000). Sharp linear and block shrinkage wavelet estimation. Statist. Probab. Lett., 49, 323-329.
45. Eubank, R.L. (1999). Nonparametric Regression and Spline Smoothing. 2nd Edition, New York: Marcel Dekker.
46. Fan, J. & Gijbels, I. (1996). Local Polynomial Modelling and its Applications. London: Chapman & Hall.
47. Foster, G. (1996).Wavelets for period analysis of unevenly sampled time series. Astron./J., 112, 1709-1729.
48. Gao, H.-Y. & Bruce, A.G. (1997). WaveShrink with firm shrinkage. Statist. Sinica, 7, 855-874.
49. Gao, H.-Y. (1998). Wavelet shrinkage denoising using the non-negative garrote. J. Comp. Graph. Statist., 7, 469-488.
50. George, E.I. & Foster, D.P. (2000). Calibration and empirical Bayes variable selection. Biometrika (to be published).
51. George, E.I. & McCulloch, R. (1993). Variable selection via Gibbs sampling. J. Am. Statist. Ass., 88, 881-889.
52. Green, P.J. & Silverman, B.W. (1994). Nonparametric regression and generalised linear models. London: Chapman & Hall.
53. Hall, P., Kerkyacharian, G. & Picard, D. (1998). Block threshold rules for curve estimation using kernel and wavelet methods. Ann. Statist., 26, 922-942.
54. Hall, P., Kerkyacharian, G. & Picard, D. (1999). On the minimax optimality of block thresholded wavelet estimators. rules for curve estimation using kernel and wavelet methods. Statist. Sinica., 9, 33-50.
55. Hall, P., Penev, S., Kerkyacharian, G. & Picard, D. (1997). Numerical performance of block thresholded wavelet estimators. Statist. Comput., 7, 115-124.
56. Hall, P. & Nason, G.P. (1997). On choosing a non-integer resolution level when using wavelet methods. Statist. Probab. Lett., 34, 5-11.
57. Hall, P. & Patil, P. (1996a). Effect of threshold rules on performance of wavelet-based curve estimators. Statist. Sinica, 6, 331-345.
58. Hall, P. & Patil, P. (1996b). On the choice of smoothing parameter, threshold and truncation in nonparametric regression by non-linear wavelet methods. J. R. Statist. Soc. B, 58, 361-377.
59. Hall, P. & Turlach, B.A. (1997). Interpolation methods for nonlinear wavelet regression with irregularly spaced design. Ann. Statist., 25, 1912-1925.
60. Härdle, W. (1990). Applied Nonparametric Regression. Cambridge: Cambridge University Press.
61. Härdle, W., Kerkyacharian, G., Pikard, D. & Tsybakov, A. (1998). Wavelets, Approximation, and Statistical Applications. Lecture Notes in Statistics 129, New York: Springer-Verlag.
62. Huang, H.-C. & Cressie, N. (2000). Deterministic/stochastic wavelet decomposition for recovery of signal from noisy data. Technometrics, 42, 262-276.
63. Huang, S.Y. & Lu, H.H.-S. (2000). Bayesian wavelet shrinkage for nonparametr-ic mixedeffects models. Statist. Sinica, 10, 1021-1040.
64. Jansen, M., Malfait, M. & Bultheel, A. (1997). Generalised cross-validation for wavelet thresholding. Sig. Proc., 56, 33-44.
65. Johnstone, I.M. (1994). Minimax Bayes, asymptotic minimax and sparse wavelet priors. In Statistical Decision Theory and Related Topics, V, Gupta, S.S. and Berger, J.O. (Eds.), pp. 303-326, New York: Springer-Verlag.
66. Johnstone, I.M. & Silverman, B.W. (1997). Wavelet threshold estimators for data with correlated noise. J. R. Statist. Soc. B, 59, 319-351.
67. Johnstone, I.M. & Silverman, B.W. (1998). Empirical Bayes approaches to mixture problems and wavelet regression. Technical Report, School of Mathematics, University of Bristol, UK.
68. Khadra, L., Al-Fahoum, A.S. & Al-Nashash, H. (1997). Detection of life-threatening cardiac arrhythmias using the wavelet transformation. Med. Biol. Eng. Comput., 35, 626-632.
69. Kovac, A. & Silverman, B.W. (2000). Extending the scope of wavelet regression methods by coefficient-dependent thresholding. J. Am. Statist. Ass., 95, 172-183.
70. Lang, M., Guo, H., Odegard, J.E., Burrus, C.S. & Wells Jr, R.O. (1996). Noise reduction using an undecimated discrete wavelet transform. IEEE Sig. Proc. Lett., 3, 10-12.
71. Lin, S.T. & McFadden, P.D. (1997). Gear vibration analysis by B-spline wavelet based linear wavelet transform. Mech. Syst. Signal Proc., 11, 603-609.
72. Mallat, S.G. (1989). A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans. Pattn Anal. Mach. Intell., 11, 674-693.
73. Mallat, S.G. (1999). A Wavelet Tour of Signal Processing. 2nd Edition, San Diego: Academic Press.
74. Marron, J.S., Adak, S., Johnstone, I.M., Neumann, M.H. & Patil, P. (1998). Exact risk analysis of wavelet regression. J. Comp. Graph. Statist., 7, 278-309.
75. Meyer, Y. (1992). Wavelets and Operators. Cambridge: Cambridge University Press.
76. Misiti, M., Misiti, Y., Oppenheim, G. & Poggi, J.-M. (1994). D́ecomposition en ondelettes et méthodes comparatives : étude d'une courbe de charge élctrique. Revue de Statistique Appliquée, 17, 57-77.
77. Müller, P. & Vidakovic, B. (Eds.) (1999). Bayesian Inference in Wavelet Based Models. Lect. Notes Statist., 141, New York: Springer-Verlag.
78. Nason, G.P. (1994). Wavelet regression by cross-validation. Technical Report 447, Department of Statistics, Standord University, USA.
79. Nason, G.P. (1995). Wavelet function estimation using cross-validation. In Wavelets and Statistics, Antoniadis, A. & Oppenheim, G. (Eds.), Lect. Notes Statist., 103, pp. 261-280, New York: Springer-Verlag.
80. Nason, G.P. (1996). Wavelet shrinkage using cross-validation. J. R. Statist. Soc. B, 58, 463-479.
81. Nason, G.P. (1999). Fast cross-validatory choice of wavelet smoothness, primary resolution and threshold in wavelet shrinkage using the Kovac-Silverman algorithm. Technical Report, Department of Mathematics, University of Bristol, UK.
82. Nason, G.P. & Silverman, B.W. (1995). The stationary wavelet transform and some statistical applications. In Wavelets and Statistics, Antoniadis, A. & Oppenheim, G. (Eds.), Lect. Notes Statist., 103, pp. 281-300, New York: Springer-Verlag.
83. Neumann, M.H. & Spokoiny, V. (1995). On the efficiency of wavelet estimators under arbitrary error distributions. Math. Meth. Stat., 4, 137-166.
84. Ogden, R.T. (1997). Essential Wavelets for Statistical Applications and Data Analysis. Boston: Birkhäuser.
85. Ogden, R.T. & Parzen, E. (1996a). Change-point approach to data analytic wavelet thresholding. Statist. Comput., 6, 93-99.
86. Ogden, R.T. & Parzen, E. (1996b). Data dependent wavelet thresholding in nonparametric regression with change-point applications. Comput. Statist. Data Anal., 22, 53-70.
87. Percival, D.B. & Walden, A.T. (2000). Wavelet Methods for Time Series Analysis. Cambridge: Cambridge University Press.
88. Ramsay, J.B., Usikov, D. & Zaslavsky, D. (1995). An analysis of U.S. stock price behavior using wavelets. Fractals, 3, 377-389.
89. Staszewski, W.J. & Tomlinson, G.R. (1994). Application of the wavelet transform to fault detection in a spur gear. Mech. Syst. Signal Proc., 8, 289-307.
90. Stein, C. (1981). Estimation of the mean of a multivariate normal distribution. Ann. Statist., 9, 1135-1151.
91. Strang, G. & Nguyen, T. (1996). Wavelets and Filter Banks. Wellesley: Wellesley-Cambridge Press.
92. von Sachs, R. & MacGibbon, B. (2000). Non-parametric curve estimation by wavelet thresholding with locally stationary errors. Scand. J. Statist., 27, 475-499.
93. Vannucci, M. & Corradi, F. (1999). Covariance structure of wavelet coefficients: theory and models in a Bayesian perspective. J. R. Statist. Soc. B, 61, 971-986.
94. Vidakovic, B. (1998a). Non-linear wavelet shrinkage with Bayes rules and Bayes factors. J. Am. Statist. Ass., 93, 173-179.
95. Vidakovic, B. (1998b). Wavelet based nonparametric Bayes methods. In Practical Nonparametric and Semiparametric Bayesian Statistics, Dey, D.D., Müller, P. & Sinha, D. (Eds.), Lecture Notes in Statistics 133, pp. 133-155, New York: Springer-Verlag.
96. Vidakovic, B. (1999). Statistical Modeling by Wavelets. New York: John Wiley & Sons.
97. Vidakovic, B. & Ruggeri, F. (2000). BAMS method: theory and simulations. Discussion Paper, Institute of Statistics and Decision Sciences, Duke University, USA.
98. Wahba, G. (1990). Spline Models for Observational Data. Philadelphia: SIAM.
99. Wang, Y. (1996). Function estimation via wavelet shrinkage for long-memory data. Ann. Statist., 24, 466-484.
100. Wand, M.P. & Jones, M.C. (1995). Kernel Smoothing. London: Chapman & Hall.
101. Weyrich, N. & Warhola, G.T. (1995a). De-noising using wavelets and cross-validation. NATO Adv. Study Inst. C, 454, 523-532.
102. Weyrich, N. &Warhola, G.T. (1995b).Wavelet shrinkage and generalized cross-validation for de-noising with applications to speech. In Wavelets and Multilevel Approximation, Chui, C.K. & Schumaker, L.L. (Eds.), Approximation Theory VIII 2, pp. 407-414, Singapore: World Scientific.
103. Wojtaszczyk, P. (1997). A Mathematical Introduction to Wavelets. Cambridge: Cambridge University Press.