Optimal rates for k-NN density and mode estimation

Advances in Neural Information Processing Systems

Volumn 3, Issue January, 2014, Pages 2555-2563

  Dasgupta, Sanjoy ^a   Kpotufe, Samory ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION SCIENCE; OPTIMIZATION; SAMPLING;

DENSITY ESTIMATION; FINITE SAMPLES; HIGH PROBABILITY; MINIMAX; MODE ESTIMATION; OPTIMAL RATE;

NEAREST NEIGHBOR SEARCH;

EID: 84937935788     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Don O Loftsgaarden, Charles P Quesenberry, et al. A nonparametric estimate of a multivariate density function. The Annals of Mathematical Statistics, 36(3):1049-1051, 1965.
2. M. Maier, M. Hein, and U. von Luxburg. Optimal construction of k-nearest neighbor graphs for identifying noisy clusters. Theoretical Computer Science, 410:1749-1764, 2009.
3. Emanuel Parzen et al. On estimation of a probability density function and mode. Annals of mathematical statistics, 33(3):1065-1076, 1962.
4. Yizong Cheng. Mean shift, mode seeking, and clustering. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 17(8):790-799, 1995.
5. Frédéric Chazal, Leonidas J Guibas, Steve Y Oudot, and Primoz Skraba. Persistence-based clustering in riemannian manifolds. Journal of the ACM (JACM), 60(6):41, 2013.
6. David S Moore and James W Yackel. Large sample properties of nearest neighbor density function estimators. Technical report, DTIC Document, 1976.
7. L.P. Devroye and T.J. Wagner. The strong uniform consistency of nearest neighbor density estimates. The Annals of Statistics, 5:536-540, 1977.
8. Gérard Biau, Frédéric Chazal, David Cohen-Steiner, Luc Devroye, Carlos Rodriguez, et al. A weighted k-nearest neighbor density estimate for geometric inference. Electronic Journal of Statistics, 5:204-237, 2011.
9. S. Kpotufe and U. von Luxburg. Pruning nearest neighbor cluster trees. In International Conference on Machine Learning, 2011.
10. Herman Chernoff. Estimation of the mode. Annals of the Institute of Statistical Mathematics, 16(1):31-41, 1964.
11. William F Eddy et al. Optimum kernel estimators of the mode. The Annals of Statistics, 8(4):870-882, 1980.
12. Birgit Grund, Peter Hall, et al On the minimisation of lp error in mode estimation. The Annals of Statistics, 23(6):2264-2284, 1995.
13. Jussi Klemelä. Adaptive estimation of the mode of a multivariate density. Journal of Nonparametric Statistics, 17(1):83-105, 2005.
14. Aleksandr Borisovich Tsybakov. Recursive estimation of the mode of a multivariate distribution. Problemy Peredachi Informatsii, 26(1):38-45, 1990.
15. David L Donoho and Richard C Liu. Geometrizing rates of convergence, iii. The Annals of Statistics, pages 668-701, 1991.
16. Luc Devroye. Recursive estimation of the mode of a multivariate density. Canadian Journal of Statistics, 7(2):159-167, 1979.
17. Ulf Grenander et al. Some direct estimates of the mode. The Annals of Mathematical Statistics, 36(1):131-138, 1965.
18. Christophe Abraham, Gérard Biau, and Benoît Cadre. On the asymptotic properties of a simple estimate of the mode. ESAIM: Probability and Statistics, 8:1-11, 2004.
19. Keinosuke Fukunaga and Larry Hostetler. The estimation of the gradient of a density function, with applications in pattern recognition. Information Theory, IEEE Transactions on, 21(1):32-40, 1975.
20. Dorin Comaniciu and Peter Meer. Mean shift: A robust approach toward feature space analysis. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 24(5):603-619, 2002.
21. Jia Li, Surajit Ray, and Bruce G Lindsay. A nonparametric statistical approach to clustering via mode identification. Journal of Machine Learning Research, 8(8), 2007.
22. Ery Arias-Castro, David Mason, and Bruno Pelletier. On the estimation of the gradient lines of a density and the consistency of the mean-shift algorithm. Unpublished Manuscript, 2013.
23. Christopher Genovese, Marco Perone-Pacifico, Isabella Verdinelli, and Larry Wasserman. Nonparametric inference for density modes. arXiv preprint arXiv:1312.7567, 2013.
24. K. Chaudhuri, S. Dasgupta, S. Kpotufe, and U. von Luxburg. Consistent procedures for cluster tree estimation and pruning. Arxiv, 2014.
25. O. Bousquet, S. Boucheron, and G. Lugosi. Introduction to statistical learning theory. Lecture Notes in Artificial Intelligence, 3176:169-207, 2004.
26. K. Chaudhuri and S. Dasgupta. Rates for convergence for the cluster tree. In Advances in Neural Information Processing Systems, 2010.
27. S. Balakrishnan, S. Narayanan, A. Rinaldo, A. Singh, and L. Wasserman. Cluster trees on manifolds. In Advances in Neural Information Processing Systems, pages 2679-2687, 2013.