Statistical imaging and complexity regularization

IEEE Transactions on Information Theory

Volumn 46, Issue 5, 2000, Pages 1762-1777

  Moulin, Pierre ^a   Liu, Juan ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

IMAGE COMPRESSION; IMAGE RECONSTRUCTION; INVERSE PROBLEMS; MAXIMUM LIKELIHOOD ESTIMATION; SPURIOUS SIGNAL NOISE; STATISTICAL METHODS;

ASYMPTOTIC IMAGING; COMPLEXITY REGULARIZATION PRINCIPLE; MINIMUM DESCRIPTION LENGTH PRINCIPLE; NONLINEAR TRANSFORMATIONS; NONPARAMETRIC ESTIMATION; POISSON NOISE; RATE DISTORTION THEORY; STATISTICAL IMAGING;

IMAGING TECHNIQUES;

EID: 0034245794     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.857789     Document Type: Article

References (39)

1. J. A. O'Sullivan, R. E. Blahut, and D. L. Snyder, "Information-theoretic image formation," IEEE Trans. Inform. Theory, vol. 44, pp. 2094-2123, Oct. 1998.
2. M. R. Banham and A. K. Katsaggelos, "Digital image restoration," IEEE Signal Processing Mag., vol. 14, pp. 2411, Mar. 1997.
3. D. Geman and C. Reynolds, "Constrained restoration and recovery of discontinuités," IEEE Trans. Pattern Anal. Machine Intell, vol. 14, pp. 367-383, Mar. 1992.
4. M. Nikolova, "Regularization functions and estimators," in Proc. IEEE Int. Conf. on Image Processing, Lausanne, Switzerland, Sept. 1996, pp. I. 457-1.460.
5. A. Chambolle, R. A. DeVore, N. Lee, and B. J. Lucier, "Nonlinear wavelet image processing: Variational problems, compression and noise removal through wavelet shrinkage," IEEE Trans. Image Processing, vol. 7, pp. 319-335, Mar. 1998.
6. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
7. J. Rissanen, Stochastic Complexity in Statistical Inquiry. Singapore: World Scientific, 1989.
8. A. R. Barron, J. Rissanen, and B. Yu, "The minimum description length principle in coding and modeling," IEEE Trans. Inform. Theory, vol. 44, pp. 2743-2760, Oct. 1998.
9. N. Saito, "Simultaneous noise suppression and signal compression using a library of orthonormal bases and the MDL criterion," in Wavelets in Geophysics, E. Foufoula-Georgiou and P. Kumar, Eds, New York: Academic, 1994, pp. 299-324.
10. M. A. Figueiredo and J. M. Leitao, "Unsupervised image restoration and edge location using compound Gauss-Markov random fields and the MDL principle," IEEE Trans. Image Processing, vol. 6, pp. 1089-1102, Aug. 1997.
11. H. Krim and I. C. Schick, "Minimax description length for signal denoising and optimized representation," IEEE Trans. Inform. Theory, vol. 45, pp. 898-908, Apr. 1999.
12. P. Moulin and J. Liu, "Analysis of multiresolution image denoising schemes using generalized-Gaussian and complexity priors," IEEE Trans. Inform. Theory, vol. 45, pp. 909-919, Apr. 1999.
13. A. R. Barron and T. M. Cover, "Minimum complexity density estimation," IEEE Trans. Inform. Theory, vol. 37, pp. 1034-1054, July 1991.
14. A. R. Barron, "Complexity regularization with application to artificial neural networks," in Nonparametric Function Estimation and Related Topics, ser. NATO ASI Series, C. Roussas, Ed. Dordrecht, The Netherlands: Kluwer, 1991, pp. 561-576.
15. D. S. Modha and A. Masry, "Minimum complexity regression estimation with weakly dependent observations," IEEE Trans. Inform. Theory, vol. 42, pp. 2133-2145, Nov. 1996.
16. Z. Chi and S. Geman, "On the consistency of minimum-complexity nonparametric estimation," IEEE Trans. Inform. Theory, vol. 44, pp. 1968-1973, Sept. 1998.
17. J. Liu and P. Moulin, "Complexity-regularized image denoising," IEEE Trans. Image Processing, 1999, submitted for publication.
18. "Complexity-regularized image denoising," in Proc. ICIP'97, Santa Barbara, CA, Oct. 1997, pp. II. 370-11.373.
19. D. L. Snyder, A. M. Hammoud, and R. L. White, "Image recovery from data acquired with a charge-coupled-device camera," J. Opt. Soc. Amer. A, vol. 10, pp. 1014-1023, May 1993.
20. J. W. Goodman, "A random walk through the field of speckle," Opt. Eng., vol. 25, pp. 610-612, May 1986.
21. P. Moulin, "A wavelet regularization method for diffuse radar-target imaging and speckle-noise reduction," J. Math. Imaging and Vision, vol. 3, no. 1, pp. 123-134, 1993.
22. T. Simchony, R. Chellappa, and Z. Lichtenstein, "Relaxation algorithms for MAP estimation of gray-level images with multiplicative noise," IEEE Trans. Inform. Theory, vol. 36, pp. 608-613, May 1990.
23. I. Csiszar, "Why least squares and maximum entropy? An axiomatic approach for linear inverse problems," Ann. Statist., vol. 14, pp. 2032-2066, Apr. 1991.
24. C. C. Craig, "On the Tchebychef inequality of Bernstein," Ann. Math. Statist., vol. 4, pp. 94-102, 1933.
25. U. Grenander, Abstract Inference, New York: Wiley, 1981.
26. H. W. Engl, M. Hanke, and A. Neubauer, Regularization of Inverse Problems. Norwell, MA: Kluwer, 1996.
27. A. N. Kolmogorov and V. M. Tihomirov, "ε-entropy and ε-capacity of sets in functional spaces," Amer. Math. Soc. Transi., ser. 2, vol. 17, pp. 277-364, 1961.
28. C. J. Stone, "Optimal rates of convergence for nonparametric estimators," Ann. Statist., vol. 8, no. 6, pp. 1348-1360, 1980.
29. L. L. Schumaker, Spline Functions: Basic Theory. New York: Wiley, 1981.
30. C. K. Chui, "Multivariate splines," in SIAM CBMS-NSF Regional Conference Series in Applied Mathematics. Philadelpha, PA, 1988.
31. L. LeCam, Asymptotic Methods in Statistical Decision Theory. New York: Springer-Verlag, 1986.
32. W. Feller, An Introduction to Probability Theory and Its Applications. New York: Wiley, 1971, vol. 2.
33. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression. Norwell, MA: Kluwer, 1992.
34. A. Rao, D. Miller, K. Rose, and A. Gersho, "A generalized VQ method for combined compression and estimation," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Atlanta, GA, May 1996, pp. 2032-2035.
35. Portable Research Video Group. (1997) JPEG software codec. Stanford Univ. [Online] Available via anonymous ftp: havefun.Stanford. edu:pub/j peg/JPEGvl.l.tar.Z
36. P. Moulin, "A multiscale relaxation algorithm for SNR maximization in nonorthogonal subband coding," IEEE Trans. Image Processing, vol. 4, pp. 1269-1281, Sept. 1995.
37. A. Said and W. A. Pearlman, "A new, fast, and efficient image codec based on set partitioning in hierarchical trees," IEEE Trans. Circuits Syst. Video Technol, vol. 6, pp. 243-250, June 1993.
38. Video coding for low bitrate communication. ITU-T recommendation H.263 version 2, Feb. 1998.
39. G. R. Shorack and J. A. Wellner, Empirical Processes with Applications. New York: Wiley, 1986.