Quantization and clustering with Bregman divergences

Journal of Multivariate Analysis

Volumn 101, Issue 9, 2010, Pages 2207-2221

  Fischer, Aurélie ^a  

^a SORBONNE UNIVERSITÉ   (France)

Author keywords

Banach spaces; Bregman divergences; K means clustering; Quantization; Rates of convergence

Indexed keywords

EID: 77955053471     PISSN: 0047259X     EISSN: 10957243     Source Type: Journal    
DOI: 10.1016/j.jmva.2010.05.008     Document Type: Article

References (31)

1. Alber Y., Butnariu D. Convergence of Bregman projection methods for solving consistent convex feasibility problems in reflexive Banach spaces. Journal of Optimization Theory and Applications 1997, 92:33-61.
2. Arendt W., Batty J.K., Hieber M., Neubrander F. Vector-valued Laplace transforms and Cauchy problems. Monographs in Mathematics 2001, Birkhäuser.
3. Banerjee A., Guo X., Wang H. On the optimality of conditional expectation as a Bregman predictor. IEEE Trans. Inform. Theory 2005, 51.
4. Banerjee A., Merugu S., Dhillon I., Ghosh J. Clustering with Bregman divergences. J. Mach. Learn. Res. 2005, 6:1705-1749.
5. Bartlett P.L., Boucheron S., Lugosi G. Model selection and error estimation. Mach. Learn. 2001, 48:85-113.
6. Bauschke H.H., Borwein J.M., Combettes P.L. Essential smoothness, essential strict convexity, and Legendre functions in Banach spaces. Commun. Contemp. Math. 2001, 3:615-647.
7. Biau G., Devroye L., Lugosi G. On the performance of clustering in Hilbert spaces. IEEE Trans. Inform. Theory 2008, 54.
8. Billingsley P. Convergence of Probability Measures. Wiley Series in Probability and Statistics 1999, John Wiley and Sons. second ed.
9. Bregman L.M. The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming. USSR Comp. Math. Math. Phys. 1967, 7:200-217.
10. Brezis H. Functional Analysis, Sobolev Spaces and Partial Differential Equations. Universitext 2010, Springer.
11. Cesa-Bianchi N., Lugosi G. Prediction, Learning, and Games 2006, Cambridge University Press.
12. Csiszár I. Generalized projections for non-negative functions. Acta Math. Hung. 1995, 68:161-185.
13. Devroye L., Györfi L., Lugosi G. A Probabilistic Theory of Pattern Recognition. Applications of Mathematics 1996, Springer.
14. Dudley R.M. Real Analysis and Probability. Cambridge Studies in Advanced Mathematics 2002, Cambridge University Press.
15. Frigyik B.A., Srivastava S., Gupta M.R. Functional Bregman divergence and Bayesian estimation of distributions. IEEE Trans. Inform. Theory 2008, 54:5130-5139.
16. B.A. Frigyik, S. Srivastava, M.R. Gupta, An introduction to functional derivatives, Technical Report UWEETR-2008-0001, Department of Electrical Engineering, University of Washington, Seattle, 2008.
17. Gersho A., Gray R.M. Vector Quantization and Signal Compression 1992, Kluwer Academic Publishers.
18. Graf S., Luschgy H. Foundations of Quantization for Probability Distributions. Lecture Notes in Mathematics 2000, Springer-Verlag, Berlin.
19. Gray R.M., Buzo A., Gray A.H., Matsuyama Y. Distortion measures for speech processing. IEEE Trans. Acoust. Speech Signal Process. 1980, 28:367-376.
20. Jones L., Byrne C. General entropy criteria for inverse problems, with applications to data compression, pattern classification, and cluster analysis. IEEE Trans. Inform. Theory 1990, 36.
21. M.I. Jordan, X. Nguyen, M.J. Wainwright, Estimating divergence functionals and the likelihood ratio by convex risk minimization, Technical Report 764, Department of Statistics, University of California, Berkeley, 2009.
22. T. Laloë, L1-quantization and clustering in Banach spaces, Math. Methods Statist., 2010 (in press).
23. Ledoux M., Talagrand M. Probability in Banach Spaces. Ergebnisse der Mathematik und ihrer Grenzgebiete 1991, Springer.
24. Linder T. Learning-theoretic methods in vector quantization. CISM Lecture Notes 2002, 163-210. Springer. L. Györfi (Ed.).
25. Lloyd S.P. Least squares quantization in PCM. IEEE Trans. Inform. Theory 1982, 28:129-137.
26. Lojasiewicz S. An Introduction to the Theory of Real Functions 1988, John Wiley and Sons.
27. F. Nielsen, J. Boissonnat, R. Nock, Bregman Voronoi diagrams: properties, algorithms and applications, Technical Report 6154, INRIA, 2007.
28. Pollard D. Quantization and the method of k-means. IEEE Trans. Inform. Theory 1982, 28.
29. Ramsay J.O., Silverman B.W. Functional Data Analysis 2006, Springer. second ed.
30. Rockafellar R.T. Convex Analysis 1970, Princeton University Press, Princeton, New Jersey.
31. Sabin M.J., Gray R.M. Global convergence and empirical consistency of the Generalized Lloyd Algorithm. IEEE Trans. Inform. Theory 1986, 32:148-155.