Online discriminative kernel density estimator with gaussian kernels

IEEE Transactions on Cybernetics

Volumn 44, Issue 3, 2014, Pages 355-365

  Kristan, Matej ^a   Leonardis, Aleš ^a,b  

^a UNIVERSITY OF LJUBLJANA   (Slovenia)

^b UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Gaussian mixture models (GMMs); kernel density estimation; online discriminative models; probability density estimation

Indexed keywords

CLASSIFICATION PERFORMANCE; CLASSIFICATION TASKS; DISCRIMINATIVE MODELS; GAUSSIAN MIXTURE MODEL (GMMS); KERNEL DENSITY ESTIMATION; KERNEL DENSITY ESTIMATORS; NUMBER OF COMPONENTS; PROBABILITY DENSITY ESTIMATION;

COST FUNCTIONS; SUPPORT VECTOR MACHINES;

ESTIMATION;

EID: 84896873474     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2013.2255983     Document Type: Article

References (43)

1. G. McLachlan and D. Peel, Finite Mixture Models. New York: Wiley-Interscience, 2000.
2. M. A. F. Figueiredo and A. K. Jain, "Unsupervised learning of finite mixture models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 3, pp. 381-396, Mar. 2002. (Pubitemid 35289353)
3. N. Nasios and A. Bors, "Variational learning for Gaussian mixture models," IEEE Trans. Syst, Man, Cybern. B, Cybern., vol. 36, no. 4, pp. 849-862, Aug. 2006. (Pubitemid 44178154)
4. Z. Živkovič and F. van der Heijden, "Recursive unsupervised learning of finite mixture models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 5, pp. 651-656, May 2004.
5. E. Parzen, "On estimation of a probability density function and mode," Ann. Math. Statist., vol. 33, no. 3, pp. 1065-1076, 1962.
6. D. Chaudhuri, B. Chaudhuri, and C. Murthy, "A data driven procedure for density estimation with some applications," Pattern Recognit., vol. 29, no. 10, pp. 1719-1736, 1996. (Pubitemid 126393714)
7. P. Vincent and Y. Bengio, "Manifold Parzen windows," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2003, pp. 849-856.
8. F. Hoti and L. Holmström, "A semiparametric density estimation approach to pattern classification," Pattern Recognit., vol. 37, no. 3, pp. 409-419, 2004. (Pubitemid 38003081)
9. E. López-Rubio and J. Ortiz-de Lazcano-Lobato, "Soft clustering for nonparametric probability density function estimation," Pattern Recognit. Lett., vol. 29, no. 16, pp. 2085-2091, 2008.
10. J. M. Leiva-Murillo and A. Artés-Rodríguez, "Algorithms for maximumlikelihood bandwidth selection in kernel density estimators," Pattern Recognit. Lett., vol. 33, no. 13, pp. 1717-1724, 2012.
11. A. Bors and N. Nasios, "Kernel bandwidth estimation for nonparametric modeling," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 6, pp. 1543-1555, Dec. 2009.
12. M. Kristan, A. Leonardis, and D. Skočaj, "Multivariate online kernel density estimation with Gaussian kernels," Pattern Recognit., vol. 44, nos. 10-11, pp. 2630-2642, 2011.
13. M. P. Wand and M. C. Jones, Kernel Smoothing. London, U.K.: Chapman & Hall, 1995.
14. J. Cwik and J. Koronacki, "A combined adaptive-mixtures/plug-in estimator of multivariate probability densities," Comput. Statist. Data Anal., vol. 26, no. 2, pp. 199-218, 1998. (Pubitemid 127427513)
15. S. Chen, X. Hong, and C. Harris, "Probability density estimation with tunable kernels using orthogonal forward regression," IEEE Trans. Syst, Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 1101-1114, Aug. 2010.
16. J. Goldberger and S. Roweis, "Hierarchical clustering of a mixture model," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2005, pp. 505-512.
17. K. Zhang and J. Kwok, "Simplifying mixture models through function approximation," IEEE Trans. Neural Netw., vol. 21, no. 4, pp. 644-658, Apr. 2010.
18. A. Leonardis and H. Bischof, "An efficient MDL-based construction of RBF networks," Neural Netw., vol. 11, no. 5, pp. 963-973, 1998. (Pubitemid 28430567)
19. M. Girolami and C. He, "Probability density estimation from optimally condensed data samples," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 10, pp. 1253-1264, Oct. 2003.
20. S. Chen, X. Hong, and C. Harris, "Sparse kernel density construction using orthogonal forward regression with leave-one-out test score and local regularization," IEEE Trans. Syst, Man, Cybern. B, Cybern., vol. 34, no. 4, pp. 1708-1717, Aug. 2004.
21. Z. Deng, F. Chung, and S. Wang, "FRSDE: Fast reduced set density estimator using minimal enclosing ball approximation," Pattern Recognit., vol. 41, no. 4, pp. 1363-1372, 2008. (Pubitemid 350212974)
22. U. Ozertem, D. Erdogmus, and R. Jenssen, "Mean shift spectral clustering," Pattern Recognit., vol. 41, no. 6, pp. 1924-1938, 2008. (Pubitemid 351191971)
23. C. Diehl and G. Cauwenberghs, "SVM incremental learning, adaptation and optimization," in Proc. Int. Joint Conf. Neural Netw., Jul. 2003, pp. 2685-2690.
24. D. Mansjur and B. Juang, "Incremental learning of mixture models for simultaneous estimation of class distribution and inter-class decision boundaries," in Proc. Int. Conf. Pattern Recognit., Dec. 2008, pp. 1-4.
25. F. Orabona, C. Castellini, B. Caputo, L. Jie, and G. Sandini, "On-line independent support vector machines," Pattern Recognit., vol. 43, no. 4, pp. 1402-1412, 2010.
26. O. Arandjelovic and R. Cipolla, "Incremental learning of temporallycoherent Gaussian mixture models," in Proc. Brit. Mach. Vis. Conf., 2005, pp. 759-768.
27. M. Song and H. Wang, "Highly efficient incremental estimation of Gaussian mixture models for online data stream clustering," Proc. SPIE, vol. 5803, no. 1, pp. 174-183, 2005. (Pubitemid 41537974)
28. B. Han, D. Comaniciu, Y. Zhu, and L. S. Davis, "Sequential kernel density approximation and its application to real-time visual tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 7, pp. 1186-1197, Jul. 2008.
29. W. F. Szewczyk, "Time-evolving adaptive mixtures," National Security Agency, Fort Meade, MD, Tech. Rep., 2005.
30. C. E. Priebe and D. J. Marchette, "Adaptive mixture density estimation," Pattern Recognit., vol. 26, no. 5, pp. 771-785, 1993.
31. K. Tabata, M. Sato, and M. Kudo, "Data compression by volume prototypes for streaming data," Pattern Recognit., vol. 43, no. 9, pp. 3162-3176, 2010.
32. M. Kristan, D. Skočaj, and A. Leonardis, "Online kernel density estimation for interactive learning," Image Vis. Comput., vol. 28, no. 7, pp. 1106-1116, 2010.
33. N. Cristianini and T. J. Shawe, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, U.K.: Cambridge Univ. Press, 2000.
34. Y. Hamamoto, Y. Fujimoto, and S. Tomita, "On the estimation of a covariance matrix in designing Parzen classifiers," Pattern Recognit., vol. 29, no. 10, pp. 1751-1759, 1996. (Pubitemid 126393716)
35. Y. Bar-Shalom, X. R. Li, and T. Kirubarajan, Estimation With Applications to Tracking and Navigation. New York: Wiley, 2001, Ch. 11, pp. 438-440.
36. D. E. Pollard, A User's Guide to Measure Theoretic Probability. Cambridge, U.K.: Cambridge Univ. Press, 2002.
37. S. Julier and J. Uhlmann, "A general method for approximating nonlinear transformations of probability distributions," Dept. Eng. Sci., Univ. Oxford, Oxford, U.K., Tech. Rep., 1996.
38. P. Hall, S. J. Sheater, M. C. Jones, and J. S. Marron, "On optimal databased bandwidth selection in kernel density estimation," Biometrika, vol. 78, no. 2, pp. 263-269, 1991.
39. C. C. Chang and C. J. Lin. (2001). LIBSVM: A library for support vector machines [Online]. Available: http://www.csie.ntu.edu.tw/cjlin/libsvm
40. C. P. Diehl and M. Spüler. (2011). mcpIncSVM-incremental SVM learning with multiclass support and probabilistic output [Online]. Available: http://www-ti.informatik.uni-tuebingen.de/spueler/mcpIncSVM/
41. F. Orabona. (2011). DOGMA-discriminative online (good?) Matlab algorithms [Online]. Available: http://dogma.sourceforge.net/
42. A. Asuncion and D. Newman. (2007). UCI machine learning repository [Online]. Available: http://archive.ics.uci.edu/ml
43. Y. Li, D. de Ridder, R. Duin, and M. Reinders, "Integration of prior knowledge of measurement noise in kernel density classification," Pattern Recognit., vol. 41, no. 1, pp. 320-330, 2008. (Pubitemid 47284207)