The principle of penalized empirical risk in severely ill-posed problems

Probability Theory and Related Fields

Volumn 130, Issue 1, 2004, Pages 18-38

  Golubev, Yu ^a  

^a AIX MARSEILLE UNIVERSITY   (France)

Author keywords

Empirical risk; Ill posed problem; Minimax risk; Partial differential equation; Penalization; Projection estimator; Singular value decomposition

Indexed keywords

EID: 4544253631     PISSN: 01788051     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00440-004-0362-y     Document Type: Article

References (26)

1. Akaike, H.: Information theory and an extension of the maximum likelihood principle. Proc. 2nd Intern. Symp. Inf. Theory, Petrov P.N. and Csaki F. (eds.), Budapest, 1973, pp. 267-281
2. Barron, A., Birge, L., Massart, P.: Risk bounds for model selection via penalization. Probab. Theory Relat. Fields 113, 301-413 (1999)
3. Belitser, E.N., Levit, Ya. B.: On minimax filtering on ellipsoids. Math. Meth. Statist. 4, 259-273 (1995)
4. Cavalier, L., Golubev, G., Lepski, O., Tsybakov, A: (2003) Block thresholding and sharp adaptive estimation in severely ill-posed inverse problems. Probab. Theory Appl. 3 to appear.
5. Cavalier, L., Tsybakov, A.: Sharp adaptation for inverse problems with random noise. Probab. Theory Relat. Fields 123, 323-354 (2002)
6. Cavalier, L., Golubev, G.K., Picard, D., Tsybakov, A.B.: Oracle inequalities for inverse problems. Ann. Stat. 30 (3), 843-874 (2002)
7. Engl, H., Hanke, M., Nuebauer, A.: Regularization of inverse problems. Kluwer academic publishers, 2000
8. Golubev, G.K., Khasminski, R.Z.: Statistical approach to some inverse boundary problems for partial differential equations. Probl. Inform. Transm. 35 (2), 51-66 (1999)
9. Efromovich, S.: Robust and efficient recovery of a signal passed through a filter and then contaminated by non-Gaussian noise. IEEE Trans. Inform. Theory 43, 1184-1191 (1997)
10. Ermakov, M.S.: On optimal solutions of the deconvolution problem. Inverse Probl. 6 (5), 863-872 (1990)
11. Johnstone, I.M.: Wavelet shrinkage for correlated data and inverse problems: adaptivity results. Statistica Sinica 9, 51-83 (1999)
12. Johnstone, I.M., Silverman, B.W.: Wavelet threshold estimators for data with correlated noise. J. Royal Stat. Soc. Ser. B. 59, 319-351 (1997)
13. Kneip, A.: Ordered linear smoothers. Ann. Stat. 22, 835-866 (1994)
14. Landau, H.J., Pollak, H.Q.: Prolate spheroidal wave function, Fourier analysis, and uncertainty - II. Bell System Tech. J. 40, 65-84 (1961)
15. Landau, H.J., Pollak, H.Q.: Prolate spheroidal wave function, Fourier analysis, and uncertainty - III. Bell System Tech. J. 41, 1295-1336 (1962)
16. Lavrentiev, M.M.: Some improperly posed problems of mathematical physics. Springer Verlag, Berlin Heidelberg New-York, 1967
17. Mair, B., Ruymgaart, F.H.: Statistical estimation in Hilbert scale. SIAM J. Appl. Math. 56, 1424-1444 (1996)
18. p. Technometrics 15, 661-675 (1973)
19. Pinsker, M.S.: Optimal filtering of square integrable signals in Gaussian white noise. Probl. Inform. Transm. 16, 120-133 (1980)
20. Shibata, R.: An optimal selection of regression variables. Boimetrika 68, 45-54 (1981)
21. Slepjan, D., Pollak, H.Q.: Prolate spheroidal wave function, Fourier analysis, and uncertainty - I. Bell System Tech. J. 40, 43-64 (1961)
22. Slepjan, D.: Some asymptotic expansions for prolate spheroidal wave functions. J. Math. Rhys. 44, 99-140 (1965)
23. Stein, C.M.: Estimation of the mean of a multivariate normal distribution. Ann. Stat. 9, 1135-1151 (1981)
24. Sudakov, V.N., Khalfin, L.A.: Statistical approach to ill-posed problems in mathematical physics. Soviet Mathematics Doklady 157, 1094-1096 (1964)
25. Sullivan, F.O.: A statistical perspective on ill-posed inverse problems. Stat. Sci. 1, 502-527 (1996)
26. Tsybakov, A.B.: On the best rate of adaptive estimation in some inverse problems. C.R. Acad. Sci. Paris 330 Série I, 835-840 (2000)