Algorithms for maximum-likelihood bandwidth selection in kernel density estimators

Pattern Recognition Letters

Volumn 33, Issue 13, 2012, Pages 1717-1724

  Leiva Murillo, José M ^a   Artés Rodríguez, Antonio ^a  

^a UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

Kernel density estimation; Multivariate density modeling; Pattern recognition

Indexed keywords

BANDWIDTH SELECTIONS; CROSS VALIDATION; FIXED-POINT ALGORITHMS; GAUSSIAN KERNELS; INFORMATION THEORETIC LEARNING; KERNEL DENSITY ESTIMATION; KERNEL DENSITY ESTIMATORS; MULTIVARIATE DATA; MULTIVARIATE DENSITY; OPTIMIZATION PROBLEMS; OVERFITTING; STATISTICAL PROBLEMS;

ALGORITHMS; COVARIANCE MATRIX; INFORMATION THEORY; MAXIMUM LIKELIHOOD; PATTERN RECOGNITION;

BANDWIDTH;

EID: 84863643216     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2012.06.006     Document Type: Article

References (25)

1. I. Ahmad, and P. Lin A nonparametric estimation of the entropy for absolutely continuous distributions IEEE Trans. Inform. Theory 22 3 1976 372 375
2. Bilmes, J.A., 1997. A gentle tutorial of the EM algorithm and its application to parameter estimation for gaussian mixture and hidden markov models. Tech. Rep. tr-97-021, International Computer Science Institute, Berkeley, California, USA.
3. M.S. de Lima, and G.S. Atuncar A bayesian method estimate optimal bandwidth multivariate kernel estimator J. Nonparametric Statist. 23 1 2011 137 148
4. Devroye, L., Lugosi, G., 1996. A universally acceptable smoothing factor for kernel density estimates (24), 2499-2512.
5. R. Duin On the choice of smoothing parameters for Parzen estimators of probability density functions IEEE Trans. Comput. 25 11 1976
6. T. Duong, and M.L. Hazelton Cross-validation bandwidth matrices for multivariate kernel density estimation Scand. J. Statist. 32 2005 485 506 (Pubitemid 41251539)
7. M. Filippone, and G. Sanguinetti Approximate inference of the bandwidth in multivariate kernel density estimation Comput. Statist. Data Anal. 55 12 2011 3104 3122
8. R. Fletcher Practical Methods of Optimization second ed. 1995 John Wiley & Sons New York
9. K. Fukunaga Introduction to Statistical Pattern Recognition 1990 Academic Press New York
10. W. Haerdle, M. Mueller, S. Sperlich, and A. Werwatz Nonparametric and Semiparametric Models 2004 Springer New York
11. P. Hall Cross-validation in density estimation Biometrika 69 2 1982 383 390
12. Leiva-Murillo, J., Artés-Rodríguez, A., 2008. Algorithms for gaussian bandwidth selection in kernel density estimators. Advances in Neural Information Processing System, NIPS, Optimization Workshop. Wistler, Canada.
13. G. McLachlan The EM Algorithm and Extensions 1997 John Wiley & Sons New York
14. J. Peltonen, and S. Kaski Discriminative components of data IEEE Trans. Neural Networks 16 1 2005 68 83 (Pubitemid 40241911)
15. A. Pérez, P. Larrańaga, and I. Inza Bayesian classifiers based on kernel density estimation: flexible classifiers Internat. J. Approx. Reason. 50 2009 341 362
16. J. Principe, D. Xu, and J. Fischer Information-Theoretic Learning Unsupervised Adaptive Filtering vol. 1 2000 John Wiley & Sons New York
17. B. Scholkopf, and A. Smola Learning with Kernels 2002 The MIT Press Cambridge, MA
18. D. Scott Multivariate Density Estimation 1992 John Wiley & Sons New York
19. G. Schwarz Estimating the dimension of a model Ann. Statist. 14 1978 461 464
20. B.W. Silverman Density Estimation for Statistics and Data Analysis 1986 Chapman & Hall Londres
21. Steele, R.J., Raftery, A.E., 2009. Performance of Bayesian model selection criteria for Gaussian mixture models. Technical Report no. 559. Department of Statistics, University of Washington.
22. K. Torkkola Feature extraction by non-parametric mutual information maximization J. Machine Learning Res. 3 2003 1415 1438
23. Turlach, B.A., 1993. Bandwidth selection in kernel density estimation: a review. CORE and Institut de Statistique. pp. 1-33.
24. M.P. Wand, and M.C. Jones Kernel Smoothing 1995 Chapman and Hall London
25. X. Zhang, M.L. King, and R.J. Hyndman A bayesian approach to bandwidth selection for multivariate kernel density estimation Comput. Statist. Data Anal. 50 11 2006 3009 3031 (Pubitemid 43729099)