Extending fuzzy and probabilistic clustering to very large data sets

Computational Statistics and Data Analysis

Volumn 51, Issue 1, 2006, Pages 215-234

  Hathaway, Richard J ^a   Bezdek, James C ^b  

^a GEORGIA SOUTHERN UNIVERSITY   (United States)

^b UNIVERSITY OF WEST FLORIDA   (United States)

Author keywords

Clustering; Data mining; Extensibility; Fuzzy c means; Goodness of fit; Progressive sampling; Very large data sets

Indexed keywords

ALGORITHMS; DATA MINING; FUZZY SETS; PROBABILITY; STATISTICAL METHODS; VECTORS;

CLUSTERING; EXTENSIBILITY; FUZZY C-MEANS; GOODNESS-OF-FIT; PROGRESSIVE SAMPLING; VERY LARGE DATA SETS;

DATA STRUCTURES;

EID: 33746912228     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2006.02.008     Document Type: Article

References (33)

1. Baeza-Yates R., and Ribeiro-Neto B. Modern Information Retrieval (1999), Addison Wesley Longman, Reading, MA
2. Bezdek J.C., and Dunn J.C. Optimal fuzzy partitions: a heuristic for estimating the parameters in a mixture of normal distributions. IEEE Trans. Comput. 24 8 (1975) 835-838
3. Bezdek, J.C., Hathaway, R.J., 2002. VAT: a tool for visual assessment of (cluster) tendency. In: Proceedings of the IJCNN 2002, IEEE Press, Piscataway, NJ, pp. 2225-2230.
4. Bezdek J.C., and Hathaway R.J. Convergence of alternating optimization. Neural, Parallel Scient. Comput. 11 (2003) 351-368
5. Bezdek J.C., Hathaway R.J., and Huggins V.J. Parametric estimation for normal mixtures. Pattern Recognition Lett. 3 (1985) 79-84
6. Bezdek J.C., Li W.Q., Attikiouzel Y.A., and Windham M.P. A geometric approach to cluster validity for normal mixtures. Soft Comput. 1 (1997) 166-179
7. Bezdek J.C., Keller J.M., Krishnapuram R., and Pal N.R. Fuzzy Models and Algorithms for Pattern Recognition and Image Processing (1999), Kluwer, Norwell
8. Bradley, P., Fayyad, U., Reina, C., 1998a. Scaling clustering algorithms to large databases, In: Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining, AAAI Press, Menlo Park, CA, pp. 9-15.
9. Bradley, P., Fayyad, U., Reina, C., 1998b. Scaling EM (expectation-maximization) clustering to large databases. Technical Report MSR-TR-98-35, Microsoft Research, Redmond, WA.
10. Cannon R.L., Dave J.V., and Bezdek J.C. Efficient implementation of the fuzzy c-means algorithm. IEEE Trans. PAMI 8 (1986) 248-255
11. Cheng, T.W., Goldgof, D.B., Hall, L.O., 1995. Fast clustering with application to fuzzy rule generation. In: Proceedings of the IEEE International Conference on Fuzzy Systems, Tokyo, Japan, pp. 2289-2295.
12. Cutting, D.R., Karger, D.R., Pederson, J.O., Tukey, J.W., 1992. Scatter/gather: a cluster-based approach to browsing large document collections, In: Proceedings of the ACM SIGIR'92, pp. 318-329.
13. Domingos, P., Hulten, G., 2001. A general method for scaling up machine learning algorithms and its application to clustering. In: Proceedings of the 18th International Conference on Machine Learning, pp. 106-113.
14. Eschrich S., Ke J., Hall L.O., and Goldgof D.B. Fast accurate fuzzy clustering through data reduction. IEEE Trans. Fuzzy Systems 11 (2003) 262-269
15. Farnstrom, F., Lewis, J., Elkan, C., 2000. Scalability for clustering algorithms revisited. SIGKKD Explorations, vol. 2(1). ACM press, New York, pp. 1-7.
16. Fayyad, U., Smyth, P., 1996. From massive data sets to science catalogs: applications and challenges. In: Kettenring, J., Pregibon, D. (Eds.), Proceedings of the Workshop on Massive Data Sets, National Research Council.
17. Fraley C., and Raftery A.E. Model-based clustering, discriminant analysis, and density estimation. J. Amer. Statist. Assoc. 97 458 (2002) 611-631
18. Ganti, V., Gehrke, J., Ramakrishnan, R., 1999a. Mining very large databases, Computer, August, pp. 38-45.
19. Ganti, V., Ramakrishnan, R., Gehrke, J., Powell, A.L., French, J.C., 1999b. Clustering large datasets in arbitrary metric spaces, Proceedings of the 15th International Conference on Data Engineering, IEEE CS Press, Los Alamitos, CA, pp. 502-511.
20. Guha, S., Rastogi, R., Shim, K., 1998. CURE: an efficient clustering algorithm for large databases. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, pp. 73-84.
21. Hathaway R.J., and Bezdek J.C. On the asymptotic properties of fuzzy c-means cluster prototypes as estimators of mixture subpopulation centers. Comm. Statist. (A) 15 2 (1986) 505-513
22. Hathaway R.J., Redner R., and Bezdek J.C. Estimating the parameters of mixture models with modal estimators. Comm. Statist. (A) 16 9 (1987) 2639-2660
23. Huber, P., 1996. Massive Data Sets Workshop: The Morning After, Massive Data Sets. National Academy Press, pp. 169-184.
24. Jain A.K., and Dubes R.C. Algorithms for Clustering Data (1988), Prentice-Hall, Englewood Cliffs, NJ
25. Kolen J.F., and Hutcheson T. Reducing the time complexity of the fuzzy c-means algorithm. IEEE Trans. Fuzzy Systems 10 (2002) 263-267
26. McLachlan G., and Peel D. Finite Mixture Models (2000), Wiley, New York
27. Meek C., Thiesson B., and Heckerman D. The learning curve sampling method applied to model based clustering. J. Mach. Learning Res. 2 (2002) 397-418
28. Ng, R.T., Han, J., 1994. Efficient and effective clustering methods for spatial data mining. In: Proceedings of the 20th International Conference on Very Large Databases, Morgan Kauffman, San Francisco, pp. 144-155.
29. Pal N.R., and Bezdek J.C. Complexity reduction for large image processing. IEEE Trans. Systems, Man, Cybernet. Part B: Cybernet. 32 (2002) 598-611
30. Provost, F., Jensen, D., Oates, T., 1999. Efficient progressive sampling, In: Proceedings of the Fifth KDDM, ACM Press, New York, pp. 23-32.
31. Titterington D., Smith A., and Makov U. Statistical Analysis of Finite Mixture Distributions (1985), Wiley, New York
32. Uma Shankar, B., Pal, N.R., 1994. FFCM: an effective approach for large data sets. In: Proceedings of the Third International Conference on Fuzzy Logic, Neural nets, and Soft Computing, IIZUKA, Fukuoka, Japan, pp. 332-332.
33. Zhang, T., Ramakrishnan, R., Livny, M., 1996. BIRCH: an efficient data clustering method for very large databases. Proceedings of the ACM SIGMOD International Conference on Management of Data, ACM Press, New york, pp. 103-114.