Similarity measures for categorical data: A comparative evaluation

Society for Industrial and Applied Mathematics - 8th SIAM International Conference on Data Mining 2008, Proceedings in Applied Mathematics 130

Volumn 1, Issue , 2008, Pages 243-254

  Boriah, Shyam ^a   Chandola, Varun ^a   Kumar, Vipin ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTERING ALGORITHMS;

CATEGORICAL DATA; COMPARATIVE EVALUATIONS; DATA MINING AND KNOWLEDGE DISCOVERY; DATA MINING TASKS; MEASURING SIMILARITIES; RELATIVE PERFORMANCE; SIMILARITY COMPUTATION; SIMILARITY MEASURE;

DATA MINING;

EID: 52649136576     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1137/1.9781611972788.22     Document Type: Conference Paper

References (37)

1. A. Ahmad and L. Dey. A method to compute distance between two categorical values of same attribute in unsupervised learning for categorical data set. Pattern Recogn. Lett., 28(1):110-118, 2007.
2. M. R. Anderberg. Cluster Analysis for Applications. Academic Press, New York, 1973.
3. A. Asuncion and D. J. Newman. UCI machine learning repository, [http://archive.ics.uci.edu/ml]. Irvine, CA: University of California, School of Information and Computer Science, 2007.
4. Y. Biberman. A context similarity measure. In ECML '94: Proceedings of the European Conference on Machine Learning, pages 49-63. Springer, 1994.
5. T. Burnaby. On a method for character weighting a similarity coefficient, employing the concept of information. Mathematical Geology, 2(1):25-38, 1970.
6. V. Chandola, S. Boriah, and V. Kumar. Similarity measures for categorical data - a comparative study. Technical Report 07-022, Department of Computer Science & Engineering, University of Minnesota, October 2007.
7. H. Cramér. The Elements of Probability Theory and Some of its Applications. John Wiley & Sons, New York, NY, 1946.
8. G. Das and H. Mannila. Context-based similarity measures for categorical databases. In PKDD '00: Proceedings of the 4th European Conference on Principles of Data Mining and Knowledge Discovery, pages 201-210, London, UK, 2000. Springer-Verlag.
9. E. Eskin, A. Arnold, M. Prerau, L. Portnoy, and S. Stolfo. A geometric framework for unsupervised anomaly detection. In D. Barbara and S. Jajodia, editors, Applications of Data Mining in Computer Security, pages 78-100. Kluwer Academic Publishers, Norwell, MA, 2002.
10. U. M. Fayyad and K. B. Irani. Multi-interval discretization of continuous-valued attributes for classification learning. In Proceedings of the 13th International Joint Conference on Artificial Intelligence, pages 1022-1029, San Francisco, CA, 1993. Morgan Kaufmann.
11. P. Gambaryan. A mathematical model of taxonomy. Izvest. Akad. Nauk Armen. SSR, 17(12):47-53, 1964.
12. V. Ganti, J. Gehrke, and R. Ramakrishnan. CACTUS-clustering categorical data using summaries. In KDD '99: Proceedings of the 5th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 73-83, New York, NY, USA, 1999. ACM Press.
13. D. Gibson, J. Kleinberg, and P. Raghavan. Clustering categorical data: an approach based on dynamical systems. The VLDB Journal, 8(3):222-236, 2000.
14. D. W. Goodall. A new similarity index based on probability. Biometrics, 22(4):882-907, 1966.
15. S. Guha, R. Rastogi, and K. Shim. ROCK: A robust clustering algorithm for categorical attributes. Information Systems, 25(5):345-366, 2000.
16. J. A. Hartigan. Clustering Algorithms. John Wiley & Sons, New York, NY, 1975.
17. Z. Huang. Extensions to the k-means algorithm for clustering large data sets with categorical values. Data Mining and Knowledge Discovery, 2(3):283-304, 1998.
18. A. K. Jain and R. C. Dubes. Algorithms for Clustering Data. Prentice-Hall, Englewood Cliffs, NJ, 1988.
19. K. S. Jones. A statistical interpretation of term specificity and its application in retrieval. In Document Retrieval Systems, volume 3 of Taylor Graham Series In Foundations Of Information Science, pages 132-142. Taylor Graham Publishing, London, UK, 1988. ISBN 0-947568-21-2.
20. W. P. Jones and G. W. Furnas. Pictures of relevance: a geometric analysis of similarity measures. J. Am. Soc. Inf. Sci., 38(6):420-442, 1987.
21. L. Kaufman and P. J. Rousseeuw. Finding Groups in Data: An Introduction to Cluster Analysis. John Wiley & Sons, New York, NY, 1990.
22. S. Q. Le and T. B. Ho. An association-based dissimilarity measure for categorical data. Pattern Recogn. Lett., 26(16):2549-2557, 2005.
23. D. Lin. An information-theoretic definition of similarity. In ICML '98: Proceedings of the 15th International Conference on Machine Learning, pages 296-304, San Francisco, CA, USA, 1998. Morgan Kaufmann Publishers Inc.
24. K. Maung. Measurement of association in a contingency table with special reference to the pigmentation of hair and eye colours of Scottish school children. Annals of Eugenics, 11:189-223, 1941.
25. T. Noreault, M. McGill, and M. B. Koll. A performance evaluation of similarity measures, document term weighting schemes and representations in a boolean environment. In SIGIR '80: Proceedings of the 3rd annual ACM conference on Research and development in information retrieval, pages 57-76, Kent, UK, 1981. Butterworth & Co.
26. C. R. Palmer and C. Faloutsos. Electricity based external similarity of categorical attributes. In PAKDD '03: Proceedings of the 7th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining, pages 486-500. Springer, 2003.
27. C. P. Pappis and N. I. Karacapilidis. A comparative assessment of measures of similarity of fuzzy values. Fuzzy Sets and Systems, 56(2):171-174, 1993.
28. K. Pearson. On the general theory of multiple contingency with special reference to partial contingency. Biometrika, 11(3):145-158, 1916.
29. S. Ramaswamy, R. Rastogi, and K. Shim. Efficient algorithms for mining outliers from large data sets. In SIGMOD '00: Proceedings of the ACM SIGMOD International Conference on Management of Data, pages 427-438. ACM Press, 2000.
30. SKAION Corporation. SKAION intrusion detection system evaluation data. [http://www.skaion.com/news/rel20031001.html].
31. E. S. Smirnov. On exact methods in systematics. Systematic Zoology, 17(1):1-13, 1968.
32. P. H. A. Sneath and R. R. Sokal. Numerical Taxonomy: The Principles and Practice of Numerical Classification. W. H. Freeman and Company, San Francisco, 1973.
33. C. Stanfill and D. Waltz. Toward memory-based reasoning. Commun. ACM, 29(12):1213-1228, 1986.
34. P.-N. Tan, M. Steinbach, and V. Kumar. Introduction to Data Mining. Addison-Wesley, Boston, MA, 2005.
35. X. Wang, B. De Baets, and E. Kerre. A comparative study of similarity measures. Fuzzy Sets and Systems, 73(2):259-268, 1995.
36. D. R. Wilson and T. R. Martinez. Improved heterogeneous distance functions. J. Artif. Intell. Res. (JAIR), 6:1-34, 1997.
37. R. Zwick, E. Carlstein, and D. V. Budescu. Measures of similarity among fuzzy concepts: A comparative analysis. International Journal of Approximate Reasoning, 1(2):221-242, 1987.