A k-mean clustering algorithm for mixed numeric and categorical data

Data and Knowledge Engineering

Volumn 63, Issue 2, 2007, Pages 503-527

  Ahmad, Amir ^a   Dey, Lipika ^b  

^a SOLID STATE PHYSICS LABORATORY   (India)

^b INDIAN INSTITUTE OF TECHNOLOGY DELHI   (India)

Author keywords

Clustering; Co occurrences; Cost function; Distance measure; k Mean clustering; Significance of attributes

Indexed keywords

CLUSTERING PROCESSES; DISTANCE MEASURE; MEAN CLUSTERING;

COST FUNCTIONS; DATA STRUCTURES; DISTANCE MEASUREMENT;

CLUSTERING ALGORITHMS;

EID: 34447330447     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2007.03.016     Document Type: Article

References (51)

1. Frawley W., Piatetsky-Shapiro G., and Matheus C. Knowledge discovery in databases: an overview. AI Magazine (1992) 213-228
2. Fayyad U.M., Piatesky-Shapiro G., Smyth P., and Uthurusamy R. Advances in Knowledge Discovery and Data Mining (1996), AAAI Press
3. F. Can, E. Ozkarahan, A dynamic cluster maintenance system for information retrieval, in: Proceedings of the Tenth Annual International ACM SIGIR Conference, 1987, pp. 123-131.
4. M. Eissen, P. Spellman, P. Brown, D. Bostein, Cluster analysis and display of genome- wide expression patterns, in: Proceeding of National Academy of Sciences of USA, vol. 95, 1998, pp. 14863-14868.
5. Duda R., and Hart P. Pattern Classification and Scene Analysis (1973), John Wiley and Sons, New York
6. Jain A.K., and Dubes R.C. Algorithms for Clustering Data (1988), Prentice Hall, Englewood Cliff, New Jersey
7. J.B. MacQuuen, Some methods for classification and analysis of multivariate observation, in: Proceedings of the 5th Berkley Symposium on Mathematical Statistics and Probability, 1967, pp. 281-297.
8. Huang Z. Clustering large data sets with mixed numeric and categorical values. Proceedings of the First Pacific-Asia Conference on Knowledge Discovery and Data Mining (1997), World Scientific, Singapore
9. Kaufman L., and Rousseew P.J. Finding Groups in Data: an Introduction to Cluster Analysis (1990), John Wiley & Sons
10. R. Ng, J. Han, Efficient and effective clustering method for spatial data mining, in: Proceedings of the 20th International Conference on Very Large Data Bases, Santiago, Chile, 1994, pp. 144-155.
11. Huang Z. Extensions to the K-modes algorithm for clustering large data sets with categorical values. Data Mining and Knowledge Discovery 2 3 (1998)
12. M. Ester, H.-P. Kriegel, J. Sander, X. Xu, A density-based algorithm for discovering clusters in large spatial databases with noise, in: Proceedings of KDD'96, 1996.
13. Sander J., Ester M., Kriegel H.-P., and Xu X. Density-based clustering in spatial databases: The algorithm GDBSCAN and its applications. Data Mining and Knowledge Discovery 2 2 (1998) 169-194
14. Dunn J.C. Some recent investigations of a new fuzzy partitional algorithm and its application to pattern classification problems. Journal of Cybernetics 4 (1974) 1-15
15. Bezdek J.C. Pattern Recognition with Fuzzy Objective Function Algorithms (1981), Plenum Press, New York
16. Huang Z., and Ng M.K. A fuzzy k-modes algorithm for clustering categorical data. IEEE Transactions on Fuzzy Systems 7 4 (1999) 446-452
17. C. Döring, C. Borgelt, R. Kruse, Fuzzy clustering of quantitative and qualitative data, in: Proceedings of NAFIPS, Banff, Alberta, 2004.
18. Fisher D.H. Knowledge acquisition via incremental conceptual clustering. Machine Learning 2 2 (1987) 139-172
19. Lebowitz M. Experiments with incremental concept formation. Machine Learning 2 2 (1987) 103-138
20. M. Gluck, J. Corter, Information, uncertainty, and the utility of categories, in: Proceedings of Seventh Annual Conference in Cognitive Society, 1985, pp. 283-287.
21. K. McKusick, K. Thomson, COBWEB/3: A portable implementation, Technical Report FIA-90-6-18-2, NASA Ames Research Center, 1990.
22. Reich Y., and Fenves S.J. The formation and use of abstract concepts in design. In: Fisher D.H., Pazzani M.J., and Langley P. (Eds). Concept Formation: Knowledge and Experience in Unsupervised Learning (1991), Morgan Kaufman, Los Altos, Calif 323-352
23. Biswas G., Weingberg J., and Fisher D.H. ITERATE: A conceptual clustering algorithm for data mining. IEEE Transactions on Systems, Man, and Cybernetics 28C (1998) 219-230
24. Cheesman P., and Stutz J. Bayesian classification (AUTO-CLASS): Theory and results. Advances in Knowledge Discovery and Data Mining (1995)
25. S. Guha, R. Rastogi, S. Kyuseok, ROCK: A robust clustering algorithm for categorical attributes, in: Proceedings of 15th International Conference on Data Engineering, Sydney, Australia, 23-26 March 1999, pp. 512-521.
26. V. Ganti, J.E. Gekhre, R. Ramakrishnan, CACTUS-clustering categorical data using summaries, in: Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1999, pp. 73-83.
27. Modha D.S., and Spangler W.S. Feature weighting in k-mean clustering. Machine Learning 52 3 (2003) 217-237
28. T. Zhang, R. Ramakrishnan, M. Livny, BIRCH: An efficient data clustering method for very large databases, in: SIGMOD Conference, 1996, pp. 103-114.
29. Ankerst M., Breunig M.M., Kriegel H.-P., and Sander J. Optics: ordering points to identify the clustering structure. 1999 ACM SIGMOD International Conference on Management of Data (1999), ACM Press 49-60
30. S. Guha, R. Rastogi, K. Shim, CURE: An efficient clustering algorithm for clustering large databases, in: Proceedings of the Symposium on Management of Data (SIGMOD), 1998.
31. Karypis G., Han E.H., and Kumar V. CHAMELEON: A hierarchical clustering algorithm using dynamic modeling. IEEE Computer 32 8 (1999) 68-75
32. Goodall D.W. A new similarity index based on probability. Biometric 22 (1966) 882-907
33. Li C., and Biswas G. Unsupervised learning with mixed numeric and nominal data. IEEE Transactions on Knowledge and Data Engineering 14 4 (2002) 673-690
34. Huang J.Z., Ng M.K., Rong H., and Li Z. Automated variable weighting in k-mean type clustering. IEEE Transactions on PAMI 27 5 (2005)
35. H. Luo, F. Kong, Y. Li, Clustering mixed data based on evidence accumulation, in: X. Li, O.R. Zaiane, Z. Li (Eds.), ADMA 2006, Lecture Notes on Artificial Intelligence 4093.
36. He Z., Xu X., and Deng S. Scalable algorithms for clustering large datasets with mixed type attributes. International Journal of Intelligence Systems 20 (2005) 1077-1089
37. He Z., Xu X., and Deng S. Squeezer: An efficient algorithms for clustering categorical data. Journal of Computer Science and Technology 17 5 (2002) 611-624
38. Stanfill C., and Waltz D. Toward memory based reasoning. Communication of the ACM 29 12 (1986) 1213-1228
39. Witten H.I., and Frank E. Data Mining Practical Machine Learning Tools and Techniques with Java Implementation (2000), Morgon Kaufmann Publishers, San Fransisco, CA
40. P. Andritsos, P. Tsaparas, R.J. Miller, K.C. Sevcik, LIMBO: Scalable clustering of categorical data, in: 9th International Conference on Extending DataBase Technology (EDBT), March 2004.
41. Ahmad A., and Dey L. A method to compute distance between two categorical values of same attributein unsupervised learning for categorical data set. Pattern Recognition Letters 28 1 (2007) 110-118
42. Ahmad A., and Dey L. A feature selection technique for classificatory analysis. Pattern Recognition Letters 26 1 (2005) 43-56
43. Basak J., De R.K., and Pal S.K. Unsupervised feature selection using a neuro-fuzzy approach. Pattern Recognition Letters 19 (1998) 997-1006
44. Yeung D.S., and Wang X.Z. Improving performance of similarity-based clustering by feature weight learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 4 (2002) 556-561
45. Sonbaty Y.E., and Ismail M.A. Fuzzy clustering for symbolic data. IEEE Transaction on Fuzzy Systems 6 2 (1998) 195-204
46. A. Ahmad, L. Dey, A K-mean clustering algorithm for mixed numeric and categorical data set using dynamic distance measure, in: Proceedings of Fifth International Conference on Advances in Pattern Recognition, ICAPR2003, 2003.
47. Won K.D., Lee K., Lee K.D., and Lee K.H. A k-populations algorithm for clustering categorical data. Pattern Recognition 38 7 (2005) 1131-1134
48. Penã J.M., Lozano J.A., and Larra ñaga P. An empirical comparison of four initialization methods for the K-mean algorithm. Pattern Recognition Letters 20 (1999) 1027-1040
49. Bradley P.S., and Fayyad U.M. Refining initial points for K-mean clustering. In: Sharlik J. (Ed). Proceedings of 15th International Conference on Machine Learning (ICML'98) (1998), Morgan Kaufman, San Francisco, CA 91-99
50. Khan S.S., and Ahmad A. Cluster center initialization algorithm for K-mean clustering. Pattern Recognition Letters 25 (2004) 1293-1302
51. Yang Y. An evaluation of statistical approaches to text categorization. Journal of Information Retrieval 1 1-2 (1999) 67-88