On the statistical analysis of smoothing by maximizing dirty markov random field posterior distributions

Journal of the American Statistical Association

Volumn 99, Issue 465, 2004, Pages 191-204

  Sardy, Sylvain ^a   Tseng, Paul ^b  

^a EPFL   (Switzerland)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Convex programming; Empirical bayes; ICM; Maximum a posteriori; Nondifferentiable Bayes prior; Total variation

Indexed keywords

EID: 2142722218     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1198/016214504000000188     Document Type: Article

References (38)

1. Abramovich, F., Sapatinas, T., and Silverman, B. W. (1998), “Wavelet Thresholding via a Bayesian Approach,” Journal of the Royal Statistical Society, Ser. B, 60, 725–749.
2. Anscombe, F. J. (1948), “The Transformation of Poisson, Binomial and Negative-Binomial Data,” Biometrika, 35, 246–254.
3. Antoniadis, A., and Fan, J. (2001), “Regularization of Wavelet Approximations” (with discussion), Journal of the American Statistical Association, 96, 939–967.
4. Auslender, A. (1976), Optimisation méthodes numériques, Paris: Masson.
5. Besag, J. (1974), “Spatial Interaction and the Statistical Analysis of Lattice Systems” (with discussion), Journal of the Royal Statistical Society, Ser. B, 36, 192–236.
6. Besag, J. (1986), “On the Statistical Analysis of Dirty Pictures” (with discussion), Journal of the Royal Statistical Society, Ser. B, 48, 192–236.
7. Besag, J. (1989), “Digital Image Processing: Towards Bayesian Image Analysis,” Journal of Applied Statistics, 16, 395–407.
8. Besag, J. (2001), Discussion of “Conditionally Specified Distributions: An Introduction” by B. C. Arnold, E. Castillo, and J. M. Sarabia, Statistical Science, 16, 249–274.
9. Besag, J., and Kooperberg, C. (1995), “On Conditional and Intrinsic Autoregressions,” Biometrika, 84, 733–746.
10. Clifford, P. (1990), “Markov Random Fields in Statistics,” in Disorders in Physical Systems: A Volume in Honor of JohnM. Hammersley, eds. G. R. Grimmet and D. J. A. Welsh, Oxford, U.K.: Oxford University Press.
11. Constantine, W. (1999), “Wavelet Techniques for Chaotic and Fractal Dynamics,” unpublished doctoral thesis, University of Washington, Mechanical Engineering Dept.
12. Davies, P. L., and Kovac, A. (2001), “Local Extremes, Runs, Strings and Multiresolution (Pkg: P1-65),” The Annals of Statistics, 29, 1–48.
13. Donoho, D. L., and Johnstone, I. M. (1994), “Ideal Spatial Adaptation via Wavelet Shrinkage,” Biometrika, 81, 425–455.
14. Donoho, D. L., and Johnstone, I. M. (1995), “Adapting to Unknown Smoothness via Wavelet Shrinkage,” Journal of the American Statistical Association, 90, 1200–1224.
15. Geman, S., and Geman, D. (1984), “Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 61, 721–741.
16. Geman, S., and McClure, D. E. (1987), “Statistical Methods for Tomographic Image Reconstruction,” Bulletin of the International Statistical Institute (Proceedings of the 46th Session), 52, Book 4, 5–21.
17. Good, I. (1965), The Estimation of Probabilities: An Essay onModern Bayesian Methods, Cambridge, MA: MIT Press.
18. Green, P. J. (1990), “Bayesian Reconstructions From Emission Tomography Data Using aModified EM Algorithm,” IEEE Transactions on Medical Imaging, 9, 84–93.
19. Hoerl, A., and Kennard, R. (1970), “Ridge Regression: Biased Estimation for Nonorthogonal Problems,” Technometrics, 12, 55–67.
20. Huber, P. J. (1981), Robust Statistics, New York:Wiley.
21. Johnstone, I., and Silverman, B. (2002), “Empirical Bayes Selection ofWavelet Thresholds,” technical report, University of Bristol.
22. Kitagawa, G., and Gersch, W. (1996), Smoothness Priors Analysis of Time Series, New York: Springer-Verlag.
23. Kuensch, H. R. (1994), “Robust Priors for Smoothing and Image Restoration,” Annals of the Institute of Statistical Mathematics, 46, 1–19.
24. Li, Y., and Santosa, F. (1996), “A Computational Algorithm forMinimizing Total Variation in Image Restoration,” IEEE Transactions on Image Processing, 5, 987–995.
25. Mallat, S. (1989), “A Theory for Multiresolution Signal Decomposition: The Wavelet Representation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 11, 674–693.
26. Mammen, E., and van de Geer, S. (1997), “Locally Adaptive Regression Splines,” The Annals of Statistics, 25, 387–413.
27. Percival, D. B., and Walden, A. T. (1993), Spectral Analysis for Physical Applications, Cambridge, U.K.: Cambridge University Press.
28. Powell, M. J. D. (1973), “On Search Directions for Minimization Algorithms,” Mathematical Programming, 4, 193–201.
29. Riedel, K. S., and Sidorenko, A. (1995), “Minimum Bias Multiple Taper Spectral Estimation,” IEEE Transactions on Signal Processing, 43, 188–195.
30. Rockafellar, R. (1970), Convex Analysis, Princeton, NI: Princeton University Press.
31. Rudin, L., Osher, S., and Fatemi, E. (1992), “Nonlinear Total Variation-Based Noise Removal Algorithms,” Physica D, 60, 259–268.
32. Sardy, S., Antoniadis, A., and Tseng, P. (2004), “Automatic Smoothing With Wavelets for a Wide Class of Distributions,” Journal of Computational and Graphical Statistics, to appear.
33. Shorack, G., and Wellner, J. (1986), Empirical Processes With Applications to Statistics, New York: Wiley.
34. Stone, M. (1974), “Cross-Validatory Choice and Assessment of Statistical Predictions” (with discussion), Journal of the Royal Statistical Society, Ser. B, 36, 111–147.
35. Tibshirani, R. (1995), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Ser. B, 57, 267–288.
36. Timmermann, K. E., and Nowak, R. D. (1999), “Multiscale Modeling and Estimation of Poisson Processes With Application to Photon-Limited Imaging,” IEEE Transactions on Information Theory, 45, 846–862.
37. Tseng, P. (1993), “Dual Coordinate Ascent Methods for Non-Strictly Convex Minimization,” Mathematical Programming, 59, 231–247.
38. Tseng, P. (2001), “Convergence of Block Coordinate Descent Method for Nondifferentiable Minimization,” Journal of Optimization Theory and Applications, 109, 475–494.