Multiscale likelihood analysis and complexity penalized estimation

Annals of Statistics

Volumn 32, Issue 2, 2004, Pages 500-527

  Kolaczyk, Eric D ^a,b   Nowak, Robert D ^a,c  

^a BOSTON UNIVERSITY   (United States)

^b Boston University   (United States)

^c University of Wisconsin Madison   (United States)

Author keywords

Factorization; Haar bases; Hellinger distance; Kullback Leibler divergence; Minimax; Model selection; Multiresolution; Recursive partitioning; Thresholding estimators; Wavelets

Indexed keywords

EID: 3042744469     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/009053604000000076     Document Type: Article

References (24)

1. BAR-LEV, S. K. and ENIS, P. (1986). Reproducibility and natural exponential families with power variance functions. Ann. Statist. 14 1507-1522.
2. BARNDORFF-NIELSEN, O. (1978). Information and Exponential Families in Statistical Theory. Wiley, New York.
3. BARRON, A., BIRGÉ, L. and MASSART, P. (1999). Risk bounds for model selection via penalization. Probab. Theory Related Fields 113 301-413.
4. BARRON, A. R. and COVER, T. M. (1991). Minimum complexity density estimation. IEEE Trans. Inform. Theory 37 1034-1054.
5. BREIMAN, L., FRIEDMAN, J., OLSHEN, R. and STONE, C. J. (1984). Classification and Regression Trees. Wadsworth, Belmont, CA.
6. DAUBECHIES, I. (1992). Ten Lectures on Wavelets. SIAM, Philadelphia.
7. DEVORE, R. A. (1998). Nonlinear approximation. In Acta Numerica 7 51-150. Cambridge Univ. Press.
8. DONOHO, D. L. (1993). Unconditional bases are optimal bases for data compression and for statistical estimation. Appl. Comput. Harmon. Anal. 1 100-115.
9. DONOHO, D. L. (1997). CART and best-ortho-basis: A connection. Ann. Statist. 25 1870-1911.
10. DONOHO, D. L., JOHNSTONE, I. M., KERKYACHARIAN, G. and PICARD, D. (1995). Wavelet shrinkage: Asymptopia? (with discussion). J. Roy. Statist. Soc. Ser. B 57 301-369.
11. DONOHO, D. L., LIU, R. and MACGIBBON, B. (1990). Minimax risk over hyperrectangles, and implications. Ann. Statist. 18 1416-1437.
12. p on general measure spaces. J. Fourier Anal. Appl. 3 457-474.
13. JOSHI, S. W. and PATIL, G. P. (1970). A class of statistical models for multiple counts. In Random Counts in Scientific Work (G. P. Patil, ed.) 2 189-203. Pennsylvania State Univ. Press.
14. KOLACZYK, E. D. (1999a). Bayesian multiscale models for Poisson processes. J. Amer. Statist. Assoc. 94 920-933.
15. KOLACZYK, E. D. (1999b). Some observations on the tractability of certain multi-scale models. In Bayesian Inference in Wavelet-Based Models. Lecture Notes in Statist. 141 51-66. Springer, New York.
16. KOLACZYK, E. D. and HUANG, H. (2001). Multiscale statistical models for hierarchical spatial aggregation. Geographical Analysis 33 95-118.
17. LAURITZEN, S. L. (1996). Graphical Models. Oxford Univ. Press.
18. LI, Q. J. (1999). Estimation of mixture models. Ph.D. dissertation, Dept. Statistics, Yale Univ.
19. LI, Q. J. and BARRON, A. R. (2000). Mixture density estimation. In Advances in Neural Information Processing Systems 12 279-285. MIT Press, Cambridge, MA.
20. NOWAK, R. D. (1999). Multiscale hidden Markov models for Bayesian image analysis. In Bayesian Inference in Wavelet-Based Models. Lecture Notes in Statist. 141 243-265. Springer, New York.
21. NOWAK, R. D. and KOLACZYK, E. D. (2000). A statistical multiscale framework for Poisson inverse problems. IEEE Trans. Inform. Theory 46 1811-1825.
22. SWELDENS, W. (1998). The lifting scheme: A construction of second generation wavelets. SIAM J. Math. Anal. 29 511-546.
23. TIMMERMANN, K. E. and NOWAK, R. D. (1999). Multiscale modeling and estimation of Poisson processes with application to photon-limited imaging. IEEE Trans. Inform. Theory 45 846-862.
24. WILKS, S. S. (1962). Mathematical Statistics. Wiley, New York.