A fast and recursive algorithm for clustering large datasets with k-medians

Computational Statistics and Data Analysis

Volumn 56, Issue 6, 2012, Pages 1434-1449

  Cardot, Hervé ^a   Cénac, Peggy ^a   Monnez, Jean Marie ^b  

^a UNIVERSITÉ DE BOURGOGNE   (France)

^b UNIVERSITÉ HENRI POINCARÉ NANCY 1   (France)

Author keywords

Averaging; High dimensional data; k medoids; Online clustering; Partitioning around medoids; Recursive estimators; RobbinsMonro; Stochastic approximation; Stochastic gradient

Indexed keywords

AVERAGING; HIGH DIMENSIONAL DATA; K-MEDOIDS; ONLINE CLUSTERING; PARTITIONING AROUND MEDOIDS; RECURSIVE ESTIMATORS; ROBBINSMONRO; STOCHASTIC APPROXIMATIONS; STOCHASTIC GRADIENT;

APPROXIMATION THEORY;

CLUSTERING ALGORITHMS;

EID: 84857657125     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2011.11.019     Document Type: Article

References (26)

1. L. Bottou Large-scale machine learning with stochastic gradient descent Y. Lechevallier, G. Saporta, Compstat 2010 2010 Physica Verlag, Springer 177 186
2. P. Bryant, and J.A. Williamson Asymptotic behaviour of classification maximum likelihood estimates Biometrika 65 1978 273 281
3. H. Cardot, P. Cénac, and M. Chaouch Stochastic approximation to the multivariate and the functional median Y. Lechevallier, G. Saporta, Compstat 2010 2010 Physica Verlag, Springer 421 428
4. Cardot, H.; Cénac, P.; Zitt, P.-A.; 2011. Efficient and fast estimation of the geometric median in Hilbert spaces with an averaged stochastic gradient approach. Bernoulli, (in press).
5. P. Chaudhuri On a geometric notion of quantiles for multivariate data Journal of the American Statistical Association 91 434 1996 862 872
6. H. Chipman, and R. Tibshirani Hybrid hierarchical clustering with applications to microarray data Biostatistics 7 2005 286 301
7. C. Croux, E. Gallopoulos, S. VañAelst, and H. Zha Machine learning and robust data mining Computational Statistics and Data Analysis 52 2007 151 154
8. M. Duflo Random iterative models Applications of Mathematics (New York) Vol. 34 1997 SpringerVerlag Berlin
9. E. Forgy Cluster analysis of multivariate data: efficiency vs. interpretability of classifications Biometrics 21 1965 768 769
10. G. Gan, C. Ma, and J. Wu Data Clustering: Theory, Algorithms, and Applications 2007 SIAM Philadelphia
11. L. Garca-Escudero, and A. Godaliza Robustness properties of k-means and trimmed k-means Journal of the American Statistical Association 94 1999 956 969
12. L. Garca-Escudero, A. Godaliza, C. Matrn, and A. Mayo-Iscar A review of robust clustering methods Advances in Data Analysis Classification 4 2010 89 109
13. L. Garca-Escudero, A. Godaliza, C. Matrn, and A. Mayo-Iscar A general trimming approach to cluster analysis Annals of Statistics 36 2008 1324 1345
14. E.S. Garca-Trevio, and J.A. Barria Online wavelet-based density estimation for non-stationary streaming data Computational Statistics and Data Analysis 56 2012 327 344
15. J. Hartigan Clustering Algorithms 1975 John Wiley & Sons New York
16. A. Jain, M. Marty, and P. Flynn Data clustering: a review ACM Computing Surveys 31 1999 264 323
17. L. Kaufman, and P. Rousseeuw Finding Groups in Data: An Introduction to Cluster Analysis 1990 John Wiley & Sons New York
18. L 1-quantization and clustering in Banach spaces Mathematical Methods of Statistics 19 2010 136 150
19. MacQueen, J.; 1967. Some methods for classification and analysis of multivariate observations. in: Proc. Fifth Berkeley Sympos. Math. Statist. and Probability (Berkeley, Calif.; 196566), Vol. I: Statistics, Univ. California Press, Berkeley, Calif.; pp. 281297.
20. J.-M. Monnez Almost sure convergence of stochastic gradient processes with matrix step sizes Statistics & Probability Letters 76 5 2006 531 536
21. R.T. Ng, and J. Han Clarans: a method for clustering objects for spatial data mining IEEE Transactions on Knowledge and Data Engineering 14 2002 1003 1016
22. H.-S. Park, and C.-H. Jun A simple and fast algorithm for k-medoids clustering Expert Systems with Applications 36 2008 3336 3341
23. M. Pelletier Asymptotic almost sure efficiency of averaged stochastic algorithms SIAM Journal on Control and Optimization 39 1 2000 49 72
24. B. Polyak, and A. Juditsky Acceleration of stochastic approximation SIAM Journal of Control and Optimization 30 1992 838 855
25. C.G. Small A survey of multidimensional medians International Statistical Review/Revue Internationale de Statistique 58 3 1990 263 277
26. Q. Zhang, and A. Couloigner A new and efficient k-medoid algorithm for spatial clustering Lecture Notes in Computer Science 3482 2005 181 189