Adaptive noisy clustering

IEEE Transactions on Information Theory

Volumn 60, Issue 11, 2014, Pages 7279-7292

  Chichignoud, Michael ^a   Loustau, Sebastien ^b  

^a ETH ZURICH   (Switzerland)

^b UNIVERSITÉ D'ANGERS   (France)

Author keywords

Adaptivity; deconvolution; errors in variables; fast rates; M estimation; statistical learning

Indexed keywords

DECONVOLUTION; IMAGE ENHANCEMENT; RISK PERCEPTION;

ADAPTIVITY; ERRORS IN VARIABLES; FAST RATE; M-ESTIMATION; STATISTICAL LEARNING;

BANDWIDTH;

EID: 84908257626     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2014.2356577     Document Type: Article

References (44)

1. A. Antos, L. Györfi, and A. György, "Individual convergence rates in empirical vector quantizer design," IEEE Trans. Inf. Theory, vol. 51, no. 11, pp. 4013-4022, Nov. 2005.
2. J. Astola, K. Egiazarian, A. Foi, and V. Katkovnik, "From local kernel to nonlocal multiple-model image denoising," Int. J. Comput. Vis., vol. 86, no. 1, pp. 1-32, 2010.
3. P. L. Bartlett and S. Mendelson, "Empirical minimization," Probab. Theory Rel. Fields, vol. 135, no. 3, pp. 311-334, 2006.
4. P. L. Bartlett, T. Linder, and G. Lugosi, "The minimax distortion redundancy in empirical quantizer design," IEEE Trans. Inf. Theory, vol. 44, no. 5, pp. 1802-1813, Sep. 1998.
5. G. Biau, L. Devroye, and G. Lugosi, "On the performance of clustering in Hilbert spaces," IEEE Trans. Inf. Theory, vol. 54, no. 2, pp. 781-790, Feb. 2008.
6. G. Blanchard, O. Bousquet, and P. Massart, "Statistical performance of support vector machines," Ann. Statist., vol. 36, no. 2, pp. 489-531, 2008.
7. O. Bousquet, "A Bennett concentration inequality and its application to suprema of empirical processes," Comp. Rendus Math., vol. 334, no. 6, pp. 495-500, 2002.
8. L. Brown and M. Low, "A constrained risk inequality with applications to nonparametric functional estimation," Ann. Statist., vol. 24, no. 6, pp. 2524-2535, 1996.
9. C. Brunet and S. Loustau, "Noisy quantization: theory and practice," 2014.
10. M. Chichignoud, "Minimax and minimax adaptive estimation in multiplicative regression: Locally Bayesian approach," Probab. Theory Rel. Fields, vol. 153, nos. 3-4, pp. 543-586, 2012.
11. M. Chichignoud and J. Lederer, "A robust, adaptive M-estimator for pointwise estimation in heteroscedastic regression," Bernoulli, vol. 20, no. 3, pp. 1560-1599, 2013.
12. F. Comte and C. Lacour, "Anisotropic adaptive kernel deconvolution," Ann. Inst. Henri Poincaré Probab. Statist., vol. 49, no. 2, pp. 569-609, 2013.
13. I. Dattner, M. Reiß, and M. Trabs, "Adaptive quantile estimation in deconvolution with unknown error distribution," Bernoulli, to be published.
14. A. Delaigle, P. Hall, and A. Meister, "On deconvolution with repeated measurements," Ann. Statist., vol. 36, no. 2, pp. 665-685, 2008.
15. J. Fan, "On the optimal rates of convergence for nonparametric deconvolution problems," Ann. Statist., vol. 19, no. 3, pp. 1257-1272, 1991.
16. J. Fan and Y. Truong, "Nonparametric regression with errors in variables," Ann. Statist., vol. 21, no. 4, pp. 1900-1925, 1993.
17. C. R. Genovese, M. Perone-Pacifico, I. Verdinelli, and L. A. Wasserman, "Minimax manifold estimation," J. Mach. Learn. Res., vol. 13, no. 1, pp. 1263-1291, 2012.
18. A. Goldenshluger and O. Lepski, "Bandwidth selection in kernel density estimation: Oracle inequalities and adaptive minimax optimality," Ann. Statist., vol. 39, no. 3, pp. 1608-1632, 2011.
19. A. Goldenshluger and A. Nemirovski, "On spatially adaptive estimation of nonparametric regression," Math. Methods Statist., vol. 6, no. 2, pp. 135-170, 1997.
20. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning. New York, NY, USA: Springer-Verlag, 2002.
21. P. J. Huber, "Robust estimation of a location parameter," Ann. Math. Statist., vol. 35, no. 1, pp. 73-101, 1964.
22. V. Katkovnik, "A new method for varying adaptive bandwidth selection," IEEE Trans. Signal Process., vol. 47, no. 9, pp. 2567-2571, Sep. 1999.
23. C. Kervrann and J. Boulanger, "Optimal spatial adaptation for patchbased image denoising," IEEE Trans. Image Process., vol. 15, no. 10, pp. 2866-2878, Oct. 2006.
24. V. Koltchinskii, "Empirical geometry of multivariate data: A deconvolution approach," Ann. Statist., vol. 28 no. 2, pp. 591-629, 2000.
25. V. Koltchinskii, "Local Rademacher complexities and oracle inequalities in risk minimization," Ann. Statist., vol. 34, no. 6, pp. 2593-2656, 2006.
26. O. V. Lepski, E. Mammen, and V. G. Spokoiny, "Optimal spatial adaptation to inhomogeneous smoothness: An approach based on kernel estimates with variable bandwidth selectors," Ann. Statist., vol. 25, no. 3, pp. 929-947, 1997.
27. O. V. Lepski, "On a problem of adaptive estimation in Gaussian white noise," Theory Probab. Appl., vol. 35, no. 3, pp. 454-466, 1990.
28. C. Levrard, "Fast rates for empirical vector quantization," Electron. J. Statist., vol. 7, pp. 1716-1746, 2013.
29. S. Loustau, "Inverse statistical learning," Electron. J. Statist., vol. 7, pp. 2065-2097, 2013.
30. S. Loustau, "Anisotropic oracle inequalities in noisy clustering," 2013.
31. S. Loustau and C. Marteau, "Minimax fast rates for discriminant analysis with errors in variables," Bernoulli, to be published.
32. S. Mallat, Une Exploration des Signaux en Ondelettes. Minneapolis, MN, USA: Ellipses, 2000.
33. E. Mammen and A. B. Tsybakov, "Smooth discrimination analysis," Ann. Statist., vol. 27, no. 6, pp. 1808-1829, 1999.
34. P. Massart, Concentration Inequalities and Model Selection (Lecture Notes in Mathematics), vol. 33. Berlin, Germany: Springer-Verlag, 2007.
35. P. Mathé, "The Lepskii principle revisited," Inverse Problems, vol. 22, no. 3, pp. L11-L15, 2006.
36. A. Meister, Deconvolution Problems in Nonparametric Statistics. New York, NY, USA: Springer-Verlag, 2009.
37. E. Parzen, "On estimation of a probability density function and mode," Ann. Math. Statist., vol. 33, no. 3, pp. 1065-1076, 1962.
38. D. Pollard, "Strong consistency of k-means clustering," Ann. Statist., vol. 9, no. 1, pp. 135-140, 1981.
39. D. Pollard, "A central limit theorem for k-means clustering," Ann. Probab., vol. 10, no. 4, pp. 919-926, 1982.
40. J. Polzehl and V. Spokoiny, "Propagation-separation approach for local likelihood estimation," Probab. Theory Rel. Fields, vol. 135, no. 3, pp. 335-362, 2006.
41. M. Rosenblatt, "Remarks on some nonparametric estimates of a density function," Ann. Math. Statist., vol. 27, no. 3, pp. 832-837, 1956.
42. V. Spokoiny and C. Vial, "Parameter tuning in pointwise adaptation using a propagation approach," Ann. Statist., vol. 37, no. 5B, pp. 2783-2807, 2009.
43. A. B. Tsybakov, Introduction to Nonparametric Estimation. New York, NY, USA: Springer-Verlag, 2008.
44. A. B. Tsybakov, "Optimal aggregation of classifiers in statistical learning," Ann. Statist., vol. 32, no. 1, pp. 135-166, 2004.