Clustering feature vectors with mixed numerical and categorical attributes

International Journal of Computational Intelligence Systems

Volumn 1, Issue 4, 2008, Pages 285-298

  Brouwer, Roelof K ^a  

^a STELLENBOSCH UNIVERSITY   (South Africa)

Author keywords

Categorical; Fuzzy c means; Fuzzy clustering; Gradient descent; Nominal clustering

Indexed keywords

CATEGORICAL; CATEGORICAL ATTRIBUTES; CATEGORICAL FEATURES; CLUSTERING FEATURE; FEATURE VECTORS; FUZZY C MEAN; FUZZY MEMBERSHIP; GRADIENT DESCENT; PROXIMITY MATRIX;

FUZZY CLUSTERING; FUZZY SYSTEMS;

VECTORS;

EID: 77952814989     PISSN: 18756891     EISSN: 18756883     Source Type: Journal    
DOI: 10.2991/ijcis.2008.1.4.1     Document Type: Article

References (62)

1. A. K. Jain and R. C. Dubes, Algorithms for Clustering Data. Upper Saddle River, NJ: Prentice Hall, 1988.
2. W. Klosgen and J. M. Zytkow, "Knowledge discovery in databases terminology," in Advances in Knowledge Discovery and Data Mining, U. M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy, Eds.: The MIT Press, 1996, pp. 573-92.
3. M. R. Anderberg, Cluster Analysis for Applications: Academic Press, 1973.
4. L. Kaufman and P. J. Rousseeuw, Finding Groups in Data: An Introduction to Cluster Analysis. New York: John Wiley and Sons, 1990.
5. R. M. Cormack, "A review of classification," J. Roy. Statist. Soc, vol. Series A, pp. 321-67, 1971.
6. G. J. Williams and Z. Huang, "A case study in knowledge acquisition for insurance risk assessment using a KDD methodology," in Pacific Rim Knowledge Acquisition Workshop, Sydney, Australia, 1996, pp. 117-29.
7. B. Everitt, Cluster Analysis. Heinemann Educational Books Ltd., 1974.
8. R. S. Michalski and R. E. Stepp, "Automated construction of classifications: Conceptual clustering versus numerical taxonomy," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-5, pp. 396-410, July 1983.
9. D. H. Fisher, "Knowledge acquisition via incremental conceptual clustering," in Machine Learning. vol. 2(2), 1987, pp. 139-72.
10. S. S. Stevens, "On the Theory of Scales of Measurement," Science, vol. 103, pp. 677-680, 1946.
11. E. H. Ruspini, "A new approach to clustering ." Information and Control, vol. 15, pp. 22-32, 1969.
12. J. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms: Plenum, 1981.
13. H. Vinod, "Integer programming and theory of grouping," Journal of the american statistical association, vol. 64, pp. 506-17, 1969.
14. E. Ruspini, "Numerical methods for fuzzy clustering," Information Sciences, vol. 2, pp. 319-50, 1970.
15. M. P. Windham, "Numerical classification of proximity data with assignment measures," Journal of Classification, vol. 2, pp. 157-72, 1985.
16. M. Roubens, "Pattern classification problems and fuzzy sets," Fuzzy Sets and Systems, vol. 1, pp. 239-53, 1978.
17. J. C. Bezdek, R. J. Hathaway, and M. P. Windham, "Numerical comparison of the RFCM and AP Algorithms for clustering relational data," Pattern Recognition, vol. 24, pp. 783-91, 1991.
18. D. Barbara, J. Couto, and Y. Li. "COOLCAT:An entropy-based algorithm for categorical clustering," in Information and Knowledge Management, 2002, pp. 582-9.
19. D. Gibson, J. Kleinberg, and P. Raghavan, "Clustering categorical data: An approach based on dynamical systems," in 24rd VLDB Conference 1998, pp. 311-22.
20. Z. Huang, "Extensions to the k-Means Algorithm for Clustering Large Data Sets with Categorical Values," Data Mining and Knowledge Discovery, vol. 2, pp. 283-304, 1998.
21. V. Ganti, J. Gehrke, and R. Ramakrishnan, "CACTUS - clustering categorical data using summaries," in Fifth ACM SIGKDD, 1999, pp. 73-83.
22. S. Guha, R. Rastogi, and K. Shim, "ROCK A robust clustering algorithm for categorical attributes," Information Systems, vol. 25, pp. 345-66, 2000.
23. M. Gyllenberg, Koski, T, & Verlaan, M., "Classification of binary vectors by stochastic complexity," Journal of Multivariate Analysis, pp. 47-72, 1947.
24. K. Gowda and E. Diday, "Symbolic clustering using a new dissimilarity measure," Pattern Recognition, vol. 24, pp. 567-578, 1991.
25. Y. El-Sonbaty and M. A. Ismail, "Fuzzy clustering for symbolic data," Fuzzy Systems, IEEE Transactions on, vol. 6, pp. 195-204, 1998.
26. Z. Huang and M. K. Ng, "A fuzzy k-modes algorithm for clustering categorical data," Fuzzy Systems, IEEE Transactions on, vol. 7, pp. 446-52, 1999.
27. T. Guan and B. Feng, "Fuzzy clustering of incomplete nominal and numerical data," in Fifth World Congress on Intelligent Control and Automation, 2004, pp. 2331-2334.
28. M.-S. Yang, P.-Y. Hwang, and D.-H. Chen, "Fuzzy clustering algorithms for mixed feature variables," Fuzzy Sets and Systems, vol. 141, pp. 301-317, 2004.
29. J. Li, X. Gao, and L. Jiao, "A GA-based clustering algorithm for large data sets with mixed numeric and categorical values," in The International Society for Optical Engineering Multispectral Image Processing and Pattern Recognition,. vol. 5286 Beijing, China, 2003, pp. 171-4.
30. L. Vermeulen-Jourdan, C. Dhaenens, and E. G. Talbi, "Clustering Nominal and Numberical Data: A New Distance Concept for a Hybrid Genetic Algorithm," in EvoCOP, 2004, pp. 220-229.
31. H. Ralambondrainy, "A clustering method for nominal data and mixture of numerical and nominal data," in First Conference International Federation of Classification Sciences, Aachen, 1987, pp. 368-76.
32. K. Honda and H. Ichihashi, "Fuzzy c-means clustering of mixed databases including numerical and nominal variables," 2004, pp. 558-562 vol.1.
33. O. M. San, V.-N. Huynh, and Y. Nakamori, "An alternative extension of the k-means algorithm for clustering categorical data," International Journal of Applied Mathematics and Computing Science, vol. 14, pp. 241-7, 2004.
34. T. Li, S. Ma, and M. Ogihara, "Entropy-based criterion in categorical clustering " in The Twenty-first International conference on Machine learning, 2004, p. 68.
35. E. Rendon and J. S. Sanchez, "Clustering based on compressed data for categorical and mixed attributes," Hong Kong, China, 2006, pp. 817-25.
36. Y. Zhao, B. Li, X. Li, W. Liu, and S. Ren, "Cluster ensemble method for databases with mixed numeric and categorical values," Journal of Tsinghua University (Science and Technology), vol. 46, pp. 1673-6, 2006.
37. R. S. Ramakrishna and K. Minho, "Projected clustering for categorical datasets," Pattern Recognition Letters, vol. 27, pp. 1405-17, 2006.
38. A. Nemalhabib and N. Shiri, "CLUC: a natural clustering algorithm for categorical datasets based on cohesion," Dijon, France, 2006, pp. 637-8.
39. A. Ahmad and L. Dey, "A method to compute distance between two categorical values of same attribute in unsupervised learning for categorical data set," Pattern Recognition Letters, vol. 28, pp. 110-18, 2007.
40. B. Andreopoulos, A. An, and X. Wang, "Bi-level clustering of mixed categorical and numerical biomedical data," International Journal of Data Mining and Bioinformatics, vol. 1, pp. 19-56, 2006.
41. H. Ralambondrainy, "A conceptual version of the K-means algorithm," Pattern Recognition Letters, vol. 16, pp. 1147-57, 1995.
42. J. C. Gower, "A general coefficient of similarity and some of its properties," Biometrics, vol. 27, pp. 857-871, 1971.
43. M. A. Woodbury, and J.Clive, " Clinical pure types as a fuzzy partition," Journal of Cybernetics, vol. 4, pp. 111-121, 1974.
44. F. Hoppner, F. Klawonn, R. Kruse, and T. Runkler, Fuzzy Cluster Analysis: John Wiley and Sons, 1999.
45. Y. Takane, F. Young, and J. De Leeuw, "Nonmetric individual differences multidimensional scaling: an alternative least squares method with optimal scaling features," Psychometrika, vol. 42, pp. 7-67, 1976.
46. W. M. Rand, "Objective Criteria for the Evaluation of Clustering Methods," Journal of the American Statistical Association, vol. 66, pp. 846-50, 1971.
47. G. Saporta and G. Youness, "Comparing two partitions: Some Proposals and Experiments."" in COMPSTAT, 15th Conference on Computational Statistics, 2002, pp. 302-309.
48. H. Li, K. Zhang, and T. Jiang, "Minimum Entropy Clustering and Applications to Gene Expression Analysis," in IEEE Computational Systems Bioinformatics Conference, 2004, pp. 142-151.
49. L. Hubert and P. Arabie, "Comparing partitions," Journal of Classification, vol. 2, pp. 193-8, 1985.
50. D. Graves, "Clustering Quality Measures," Thompson Rivers University, Kamloops TR TRU-CIG-2006-07, July 2006.
51. D.-W. Kim, K. H. Lee, and D. Lee, "Fuzzy clustering of categorical data using fuzzy centroids," Pattern Recognition Letters, vol. 25, pp. 1263-71, 2004.
52. G. W. Milligan and M. C. Cooper, "A study of the comparability of external criteria for hierarchical cluster analysis.," Multivariate Behavioral Research, vol. 21, pp. 441-58, 1986.
53. K. Y. Yeung and W. L. Ruzzo, "Principal component analysis for clustering gene expression data," Bioinformatics, vol. 17, pp. 763-774, 2001
54. A. Asuncion and D. J. Newman, "Machine Learning Repository," University of California, Irvine, School of Information and Computer Sciences, 2007.
55. "UCI Machine Learning Repository," http://mlearn.ics.uci.edu/MLRepository.html.
56. R. Quinlan, "C4.5: Programs for Machine Learning " in Macine Learning: Morgan Kaufmann, 1992.
57. R. Quinlan, "Simplifying decision trees," Int J Man-Machine Studies vol. 27, pp. 221-234, 1987.
58. R. K. Brouwer, "A Method for Obtaining a Fuzzy Set Covering for Ordinal Attributes for Use in Fuzzy Clustering," Thompson Rivers University, Kamloops, Canada, Report BRO 2005 Department of Computing Science, Thompson Rivers University, 2005.
59. L. Mahnhoon and R. K. Brouwer, "Fuzzy Clustering and Mapping of Ordinal Values to Numerical," in FOCI 2007 IEEE Symposium on Foundations of Computational Intelligence, 2007, pp. 538-43.
60. R. K. Brouwer, "A Method for Fuzzy Clustering with Ordinal Attributes Replaced by Fuzzy Set Parameters," in 3rd International IEEE Conference on Intelligent Systems, 2006, pp. 553-8.
61. R. K. Brouwer, "Fuzzy Clustering of Feature Vectors with some Ordinal Valued Attributes Using Gradient Descent for Learning," IJUFKS, vol. 6, pp. 195-218, 2008.
62. R. K. Brouwer, "Clustering without Use of Prototypes," Thompson Rivers University, Kamloops TR TRU-CS-CIG-2006-01, May 1 2006.