Modern statistical estimation via oracle inequalities

Acta Numerica

Volumn 15, Issue , 2006, Pages 257-325

  Candès, Emmanuel J ^a  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33646748681     PISSN: 09624929     EISSN: 14740508     Source Type: Journal    
DOI: 10.1017/S0962492906230010     Document Type: Review

References (73)

1. F. Abramovich and Y. Benjamini (1996), 'Adaptive thresholding of wavelet coefficients', Comput. Statist. Data Anal. 22, 351-361.
2. F. Abramovich, Y. Benjamini, D. L. Donoho and I. M. Johnstone (2000), Adapting to unknown sparsity by controlling the false discovery rate. Technical Report 2000-19, Department of Statistics, Stanford University. To appear in Ann. Statist.
3. H. Akaike (1974), 'A new look at the statistical model identification', IEEE Trans. Automatic Control AC-19, 716-723.
4. Y. Baraud (2000), Model selection for regression on a fixed design, Probab. Theory Rel. Fields 117, 467-493.
5. A. R. Barron (1994), 'Approximation and estimation bounds for artificial neural networks', Machine. Learning 14, 113-143.
6. A. R. Barron and T. M. Cover (1991), 'Minimum complexity density estimation', IEEE Trans. Inform. Theory 37, 1034-1054.
7. Y. Benjamini and Y. Hochberg (1995), 'Controlling the false discovery rate: A practical and powerful approach to multiple testing', J. Roy. Statist. Soc. Ser. B 57, 289-300.
8. M. Bertero and P. Boccacci (1998), Introduction to Inverse. Problems in Imaging. Institute of Physics Publishing, Bristol.
9. L. Birgé and P. Massart (1997), From model selection to adaptive estimation, in Festschrift for Lucien Le Cam, Springer, New York, pp. 55-87.
10. L. Birgé and P. Massart (2001), Gaussian model selection, J. Eur. Math. Soc. 3, 203-268.
11. L. D. Brown and M. G. Low (1996), 'Asymptotic equivalence of nonparametric regression and white noise', Ann. Statist. 24, 2384-2398.
12. T. T. Cai (1999), 'Adaptive wavelet estimation: A block thresholding and oracle inequality approach', Ann. Statist. 27, 898-924.
13. E. J. Candès (2002), Multiscale chirplets and near-optimal recovery of chirps. Technical report, Stanford University.
14. E. J. Candès and D. L. Donoho (1999), 'Ridgelets: The key to higher-dimensional intermittency?', Phil. Trans. R. Soc. Lond. A 357, 2495-2509.
15. E. J. Candès and D. L. Donoho (2000), Curvelets: A surprisingly effective nonadaptive representation for objects with edges, in Curves and Surfaces (C. R. A. Cohen and L. L. Schumaker, eds), Vanderbilt University Press, Nashville, TN, pp. 105-120.
16. E. J. Candès and D. L. Donoho (2002), 'Recovering edges in ill-posed inverse problems: Optimality of curvelet frames', Ann. Statist. 30, 784-842.
17. 2 singularities', Comm. Pure Appl. Math. 57, 219-266.
18. E. J. Candès and F. Guo (2002), 'New multiscale transforms, minimum total variation synthesis: Applications to edge-preserving image reconstruction', Signal Processing 82. 1519-1543.
19. E. J. Candès and T. Tao (2004) Near-optimal signal recovery from random projections and universal encoding strategies. Available on the ArXiv preprint server: math. CA/0410542. To appear in IEEE Trans. Inform Theory.
20. E. J. Candès and T. Tao (2005a), The Dantzig selector: Statistical estimation when p is much larger than n. Technical report, California Institute of Technology, available on the ArXiv preprint server: math.ST/0506081. To appear in Ann. Statist.
21. E. J. Candès and T. Tao (2005b), 'Decoding by linear programming', IEEE Trans. Inform. Theory 51, 4203-4215.
22. E. J. Candès, L. Demanet, D. L. Donoho and L. Ying (2005), Fast discrete curvelet transforms. Technical report, California Institute of Technology. To appear in SIAM J. Multiscale Modeling and Simulations.
23. E. J. Candès, J. Romberg and T. Tao (2006) 'Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information', IEEE Trans. Inform. Theory 52, 489-509.
24. 2)', Amer. J. Math. 121, 587-628.
25. R. R. Coifman and Y. Meyer (1991), 'Remarques sur l'analyse de Fourier àfen̂tre', C. R. Acad. Sci. Paris Sér. I Math. 312, 259-261.
26. R. R. Coifman and M. V. Wickerhauser (1992), 'Entropy-based algorithms for best basis selection', IEEE Trans. Inform. Theory 38, 713-718.
27. D. L. Donoho (1993), 'Unconditional bases are optimal bases for data compression and for statistical estimation', Appl. Comput. Harmon. Anal. 1, 100-115.
28. D. L. Donoho (1995), 'Nonlinear solution of linear inverse problems by wavelet-vaguelette decomposition', Appl. Comput. Harmon. Anal. 2, 101-126.
29. D. L. Donoho (1999), 'Wedgelets: Nearly-minimax estimation of edges', Ann. Statist. 27, 859-897.
30. D. L. Donoho (2001), 'Sparse components of images and optimal atomic decomposition', Constr. Approx. 17, 353-382.
31. D. L. Donoho and I. Johnstone (1994a), 'Ideal spatial adaptation via wavelet shrinkage', Biometrika 81, 425-455.
32. D. L. Donoho and I. M. Johnstone (1994b), 'Ideal denoising in an orthonormal basis chosen from a library of bases', CR Acad. Sci. Paris Sér. I Math. 319, 1317-1322.
33. D. L. Donoho and I. M. Johnstone (1995), Empirical atomic decomposition. Manuscript.
34. D. L. Donoho and I. M. Johnstone (1999), 'Asymptotic minimaxity of wavelet estimators with sampled data', Statist. Sinica 9, 1-32.
35. D. L. Donoho and R. C. Liu (1991), 'Geometrizing rates of convergence II, III', Ann. Statist. 19, 633-667, 668-701.
36. D. L. Donoho and M. Nussbaum (1990), 'Minimax quadratic estimation of a quadratic functional', J. Complexity 6, 290-323.
37. D. L. Donoho, I. M. Johnstone, G. Kerkyacharian and D. Picard (1995), 'Wavelet shrinkage: Asymptopia?', J. Roy. Statist. Soc. Ser. B 57, 301-369.
38. S. Durand and J. Froment (2003), 'Reconstruction of wavelet coefficients using total variation minimization', SIAM J. Sci. Comput. 24, 1754-1767 (electronic)
39. S. Y. Efroǐmovich (1985), 'Nonparametric estimation of a density of unknown smoothness', Tear. Veroyatnost. i Primenen. 30, 524-534.
40. S. Y. Efroǐmovich and M. S. Pinsker (1981), 'Estimation of square-integrable density on the basis of a sequence of observations', Problemy Peredachi Informatsii 17, 50-68.
41. S. Y. Efroǐmovich and M. S. Pinsker (1982), 'Estimation of square-integrable probability density of a random variable', Problems Inform. Transmission 18, 175-189;
42. translated from Problemy Peredachi Informatsii 18, 19-38 (Russian).
43. S. Y. Efroǐmovich and M. S. Pinsker (1984), 'A sell-training algorithm for non-parametric filtering', Avtomat. i Telemekh. (11), 58-65.
44. B. Efron and C. Morris (1971), 'Limiting the risk of Bayes and empirical Bayes estimators I: The Bayes case', J. Amer. Statist. Assoc. 66, 807-815.
45. A. G. Flesia, H. Hel-Or, A. Averbuch, E. J. Candès, R. R. Coifman and D. L. Donoho (2003), Digital implementation of ridgelet packets, in Beyond wavelets, Vol. 10 of Stud. Comput. Math., Academic Press/Elsevier, San Diego, CA, pp. 31-60.
46. D. P. Foster and E. I. George (1994), 'The risk inflation criterion for multiple regression', Ann. Statist. 22, 1947-1975.
47. M. Frazier, B. Jawerth and G. Weiss (1991), Littlewood-Paley Theory and the Study of Function Spaces, Vol. 79 of NSF-CBMS Regional Conf. Ser. in Mathematics, AMS, Providence, RI.
48. H.-Y. Gao (1998), 'Wavelet shrinkage denoising using the non-negative garrote', J. Comput. Graph. Statist. 7, 469-488.
49. P. J. Green and B. W. Silverman (1994), Nonparametric Regression and Generalized Linear Models: A Roughness Penalty Approach, Vol. 58 of Monographs on Statistics and Applied Probability. Chapman & Hall, London.
50. P. Hall, G. Kerkyacharian and D. Picard (1999), 'On the minimax optimality of block thresholded wavelet estimators', Statist. Sinica 9, 33-49.
51. W. James and C. Stein (1961), Estimation with quadratic loss, in Proc. 4th Berkeley Sympos. Math. Statist, and Prob., Vol. I, University of California Press, Berkeley, CA, pp. 361-379.
52. I. M. Johnstone (2002), Function estimation and Gaussian sequence models. Available at: http://www-stat.stanford.edu/~imj.
53. A. P. Korostelëv and A. B. Tsybakov (1993), Minimax Theory of Image, Reconstruction, Vol. 82 of Lecture Notes in Statistics, Springer, New York.
54. L. Le Cam (2000), La statistique mathématique depuis 1950. in Development of Mathematics 1950-2000, Birkäuser, Basel, pp. 735-761.
55. E. L. Lehmann (1997), Theory of Point Estimation, Springer, New York. Reprint of the 1983 original.
56. A. Leon-Garcia (1994), Probability and Random Processes for Electrical Engineering, 2nd edn, Addison-Wesley.
57. F. Malgouyres (2002), 'Minimizing the total variation under a general convex constraint for image restoration', IEEE Trans. Image Process. 11, 1450-1456.
58. S. Mallat (1999), A Wavelet Tour of Signal Processing, 2nd edn. Academic Press, San Diego, CA.
59. p', Technometrics 15, 661-676.
60. Y. Meyer (1992), Wavelets and Operators, Cambridge University Press.
61. B. K. Natarajan (1995), 'Sparse approximate solutions to linear systems', SIAM J. Comput. 24, 227-234.
62. M. Nussbaum (1996), 'Asymptotic equivalence of density estimation and Gaussian white noise', Ann. Statist. 24, 2399-2430.
63. G. Schwarz (1978), 'Estimating the dimension of a model', Ann. Statist. 6, 461-464.
64. D. W. Scott (1992), Multivariate Density Estimation: Theory, Practice, and Visualization, Wiley Series in Probability and Mathematical Statistics, Wiley, New York.
65. B. W. Silverman (1986), Density Estimation for Statistics and Data Analysis, Monographs on Statistics and Applied Probability. Chapman & Hall, London.
66. J.-L. Starck, F. Murtagh and A. Bijaoui (1998), Image Processing and Data Analysis: The Multiscale Approach, Cambridge University Press, Cambridge.
67. C. M. Stein (1981), 'Estimation of the mean of a multivariate normal distribution', Ann. Staust. 9, 1135-1151.
68. S. M. Stigler (1990), The History of Statistics: The Measurement of Uncertainty Before 1900, The Belknap Press of Harvard University Press, Cambridge, MA. Reprint of the 1986 original.
69. R. Tibshirani (1996), 'Regression shrinkage and selection via the lasso', J. Roy. Statist. Soc. Ser. B 58, 267-288.
70. H. Triebel (1992), Theory of Function Spaces II, Vol. 84 of Monographs in Mathematics, Birkhäuser, Basel.
71. G. Wahba (1990), Spline Models for Observational Data, Vol. 59 of CBMS-NSF Regional Conference Series in Applied Mathematics, SIAM, Philadelphia, PA.
72. N. Wiener (1949), Extrapolation. Interpolation, and Smoothing of Stationary Time Series: With Engineering Applications, The Technology Press of the Massachusetts Institute of Technology, Cambridge. MA.
73. D. Williams (1991), Probability with Martingales, Cambridge Mathematical Text-books, Cambridge University Press, Cambridge.