AMlet, RAMlet, and GAMlet: Automatic nonlinear fitting of additive models, robust and generalized, with wavelets

Journal of Computational and Graphical Statistics

Volumn 13, Issue 2, 2004, Pages 283-309

  Sardy, Sylvain ^a   Tseng, Paul ^b  

^a EPFL   (Switzerland)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

(Generalized) additive models; Convex programming; Data mining; Interior point algorithm; Regularized likelihood; Relaxation algorithm; Signal denoising; Univetsal smoothing parameter

Indexed keywords

EID: 3042574880     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/1061860043434     Document Type: Article

References (34)

1. Abramovich, F., Sapatinas, T., and Silverman, B. W. (1998), "Wavelet Thresholding via a Bayesian Approach," Journal of the Royal Statistical Society, Series B. 60, 725-749.
2. Albert, A. (1972), Regression and the Moore-Penrose Pseudoinverse, New York: Academic Press.
3. Amato, U., and Antoniadis, A. (2001), "Adaptive Wavelet Series Estimation in Separable Nonparametric Regression Models," Statistics and Computing, 11, 373-394.
4. Anscombe, F. J. (1948), "The Transformation of Poisson, Binomial and Negative-Binomial Data," Biometrika, 35, 246-254.
5. Antoniadis, A., and Fan, J. (2001), "Regularization of Wavelet Approximations," Journal of the American Statistical Association, 96, 939-967.
6. Antoniadis, A., Gregoire, G., and McKeague, I. W. (1994), "Wavelet Methods for Curve Estimation," Journal of the American Statistical Association, 89, 1340-1353.
7. Breiman, L. (1996), "Heuristics of Instability and Stabilization in Model Selection," The Annals of Statistics, 24, 2350-2383.
8. Buja, A., Hastie, T. J., and Tibshirani, R. J. (1989), "Linear Smoothers and Additive Models" (with discussion), The Annals of Statistics, 17, 453-555.
9. Cantoni, E., and Hastie, T. J. (2002), "Degrees of Freedom Tests for Smoothing Splines," Biometrika, 89, 251-263.
10. Chen, S. S., Donoho, D. L., and Saunders, M. A. (1999), "Atomic Decomposition by Basis Pursuit," SIAM Journal on Scientific Computing, 20, 33-61.
11. Donoho, D. L., and Johnstone, I. M. (1994), "Ideal Spatial Adaptation via Wavelet Shrinkage," Biometrika, 81, 425-455.
12. _ (1995), "Adapting to Unknown Smoothness via Wavelet Shrinkage," Journal of the American Statistical Association, 90, 1200-1224.
13. Donoho, D. L., Johnstone, I. M., Hoch, J. C., and Stern, A. S. (1992), "Maximum Entropy and the Nearly Black Object" (disc: P67-81), Journal of the Royal Statistical Society, Series B, 54, 41-67.
14. Donoho, D. L., Johnstone, I. M., Kerkyacharian, G., and Picard, D. (1995), "Wavelet Shrinkage: Asymptopia?" (with discussion), Journal of the Royal Statistical Society, Series B, 57, 301-369.
15. Friedman, J. H. (1991), "Multivariate Adaptive Regression With Splines" (with discussion), The Annals of Statistics, 19, 1-141.
16. Friedman, J. H., and Silverman, B. W. (1989), "Flexible Parsimonious Smoothing and Additive Modeling" (with discussion), Technometrics, 31, 3-39.
17. Friedman, J. H., and Stuetzle, W. (1981), "Projection Pursuit Regression," Journal of the American Statistical Association, 76, 817-823.
18. Hastie, T. J., and Tibshirani, R. J. (1986), "Generalized Additive Models," Statistical Science, 1, 295-318.
19. _ (1990), Generalized Additive Models, Washington, DC: Chapman and Hall.
20. Huber, P. J. (1981), Robust Statistics, New York: Wiley.
21. Kojima, M., Megiddo, N., and Mizuno, S. (1993), "A Primal-Dual Exterior Point Algorithm for Linear Programming," Mathematical Programming, 61, 261-280.
22. Mallat, S. (1989), "A Theory for Multiresolution Signal Decomposition: The Wavelet Representation," IEEE Transactions on Pattern Analysis and Machine Intelligence, 11, 674-693.
23. Mammen, E., Linton, O., and Nielsen, J. (1999), "The Existence and Asymptotic Properties of a Backfitting Projection Algorithm Under Weak Conditions," The Annals of Statistics, 27, 1443-1490.
24. Nelder, J. A., and Wedderburn, R. W. M. (1972), "Generalized Linear Models," Journal of the Royal Statistical Society, Series A, 135, 370-384.
25. Nychka, D., Bailey, B., Ellner, S., Haaland, P., and O'Connel, P. (1993), "Funfits: Data Analysis and Statistical Tools for Estimating Functions," technical report, Raleigh, North Carolina State University, Raleigh.
26. Opsomer, J. D., and Ruppert, D. (1997), "Fitting a Bivariate Additive Model by Local Polynomial Regression," The Annals of Statistics, 25, 186-211.
27. Rockafellar, R. T. (1984), Nerwork Flows and Monotropic Programming, New-York: Wiley-Interscience: republished by Athena Scientific, Belmont, 1998.
28. Sardy, S., Antoniadis, A., and Tseng, P. (2004), "Automatic Smoothing With Wavelets for a Wide Class of Distributions," Journal of Computational and Graphical Statistics, 13 (this issue), 399-421.
29. Sardy, S., Brace, A. G., and Tseng, P. (2000), "Block Coordinate Relaxation Methods for Nonparametric Wavelet Denoising," Journal of Computational and Graphical Statistics, 9, 361-379.
30. Sardy, S., Percival, D. B., Bruce, A. G., Gao, H.-Y., and Stuetzle, W. (1999), "Wavelet De-noising for Unequally Spaced Data," Statistics and Computing, 9, 65-75.
31. Sardy, S., Tseng, P., and Bruce, A. G. (2001), "Robust Wavelet Denoising," IEEE Transactions on Signal Processing, 49, 1146-1152.
32. Stone, C. J. (1985), "Additive Regression and Other Nonparametric Models," The Annals of Statistics, 13, 689-705.
33. _ (1986), "The Dimensionality Reduction Principle for Generalized Additive Models," The Annals of Statistics, 14, 590-606.
34. Tseng, P. (2001), "Convergence of Block Coordinate Descent Method for Nondifferentiable Minimization," Journal of Optimization Theory and Applications, 109, 475-494.