Least squares estimation without priors or supervision

Neural Computation

Volumn 23, Issue 2, 2011, Pages 374-420

  Raphan, Martin ^a   Simoncelli, Eero ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BAYES THEOREM; REGRESSION ANALYSIS;

BAYES THEOREM; LEAST-SQUARES ANALYSIS;

EID: 78651479732     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00076     Document Type: Article

References (37)

1. Andrews, D., & Mallows, C. (1974). Scale mixtures of normal distributions. J. Royal Stat. Soc., 36, 99-102.
2. Benazza-Benyahia, A.,&Pesquet,J.C. (2005). Building robust wavelet estimators for multicomponent images using Stein's principle. IEEE Trans. Image Proc., 14(11), 1814-1830.
3. Berger, J. (1980). Improving on inadmissible estimators in continuous exponential families with applications to simultaneous estimation of gamma scale parameters. Annals of Statistics, 8, 545-571.
4. Berger, J. (1985). Statistical decision theory and Bayesian analysis (2nd ed.). New York: Springer.
5. Blu, T., & Luisier, F. (2007). The SURE-LET approach to image denoising. IEEE Trans. Image Proc., 16, 2778-2786.
6. Buades, A., Coll, B., & Morel, J. M. (2005). A review of image denoising algorithms, with a new one. Multiscale Modeling and Simulation, 4(2), 490-530.
7. Carlin, B. C., & Louis, T. A. (2009). Bayesian methods for data analysis (3rd ed.). Boca Raton, FL: CRC Press and Chapman & Hall.
8. Casella, G. (1985). An introduction to empirical Bayes data analysis. Amer. Statist., 39, 83-87.
9. Chaux, C., Duval, L., Benazza-Benyahia, A., & Pesquet, J.-C. (2008). A nonlinear Stein-based estimator for multichannel image denoising. IEEE Trans. Signal Processing, 56(8), 3855-3870.
10. Comaniciu, D., & Meer, P. (2002). Mean shift: A robust approach toward feature space analysis. IEEE Pat. Anal. Mach. Intell., 24, 603-619.
11. Cressie, N. (1982). A useful empirical Bayes identity. Annals of Statistics, 10(2), 625-629.
12. Donoho, D., & Johnstone, I. (1995). Adapting to unknown smoothness via wavelet shrinkage. J. American Stat. Assoc., 90(432), 1200-1224.
13. Eldar, Y. C. (2009). Generalized SURE for exponential families: Applications to regularization. IEEE Trans. on Signal Processing, 57(2), 471-481.
14. Feller, W. (1970). An introduction to probability theory and its applications. Hoboken, NJ: Wiley.
15. Hager, W. W. (1989). Updating the inverse of a matrix. SIAM Review, 31, 221-239.
16. Hwang, J. T. (1982). Improving upon standard estimators in discrete exponential families with applications to Poisson and negative binomial cases. Annals of Statistics, 10, 857-867.
17. Hyvärinen, A. (2005). Estimation of non-normalized statistical models by score matching. Journal of Machine Learning Research, 6, 695-709.
18. Hyvärinen, A. (2008). Optimal approximation of signal priors. Neural Computation, 20, 3087-3110.
19. Kalman, R. (1960). A new approach to linear filtering and prediction problems. ASME Journal of Basic Engineering, 82 (Series D), 35-45.
20. Loader, C. R. (1996). Local likelihood density estimation. Annals of Statistics, 24(4), 1602-1618.
21. Luisier, F., Blu, T., & Unser, M. (2006). SURE-based wavelet thresholding integrating inter-scale dependencies. In Proc. IEEE Intl. Conf. on Image Proc. (pp. 1457-1460). Piscataway, NJ: IEEE.
22. Maritz, J. S., & Lwin, T. (1989). Empirical Bayes methods (2nd ed.). London: Chapman & Hall.
23. Miyasawa, K. (1961). An empirical Bayes estimator of the mean of a normal population. Bull. Inst. Internat. Statist., 38, 181-188.
24. Morris, C. N. (1983). Parametric empirical Bayes inference: Theory and applications. J. American Statistical Assoc., 78, 47-65.
25. Pesquet, J. C., & Leporini, D. (1997). A new wavelet estimator for image denoising. In 6th International Conference on Image Processing and its Applications (pp. 249-253). Piscataway, NJ: IEEE.
26. Raphan, M. (2007). Optimal estimation: Prior free methods and physiological application. Unpublished doctoral dissertation, New York University.
27. Raphan, M., & Simoncelli, E. P. (2007a). Empirical Bayes least squares estimation without an explicit prior (Tech. Rep. no. TR2007-900). New York: Courant Institute of Mathematical Sciences, New York University.
28. Raphan, M.,&Simoncelli,E.P.(2007b). LearningtobeBayesian without supervision. In B. Schölkopf, J. Platt, & T. Hofmann (Eds.), Advances in neural information processing systems, 19 (pp. 1145-1152). Cambridge, MA: MIT Press.
29. Raphan, M., & Simoncelli, E. P. (2008). Optimal denoising in redundant representations. IEEE Trans. Image Processing, 17(8), 1342-1352.
30. Raphan, M., & Simoncelli, E. P. (2009). Learning least squares estimators without assumed priors or supervision (Tech. Rep. TR2009-923). New York: Courant Institute of Mathematical Sciences, New York University.
31. Raphan, M., & Simoncelli, E. P. (2010). An empirical Bayesian interpretation and generalization of NL-means. (Tech. Rep. TR2010-934). New York: Courant Institute of Mathematical Sciences, New York University.
32. Robbins, H. (1956). An empirical Bayes approach to statistics. Proc. Third Berkley Symposium on Mathematcal Statistics (Vol. 2, pp. 157-163). Berkeley: University of California Press.
33. Scott, D. W. (1992). Multivariate density estimation: Theory, practice, and visualization. Hoboken, NJ: Wiley.
34. Stein, C. M. (1981). Estimation of the mean of a multivariate normal distribution. Annals of Statistics, 9(6), 1135-1151.
35. Wasserman, L. (2004). All of statistics: A concise course in statistical inference. New York: Springer.
36. Weissman, T., Ordentlich, E., Seroussi, G., Verdú, S., & Weinberger, M. (2005). Universal discrete denoising: Known channel. IEEE Trans. Info. Theory, 51(1), 5-28.
37. Wilcox, R. M. (1967). Exponential operators and parameter differentiation in quantum physics. Journal of Mathematical Physics, 8, 962-982.