Statistical approach to normalization of feature vectors and clustering of mixed datasets

Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences

Volumn 468, Issue 2145, 2012, Pages 2630-2651

  Suarez Alvarez, Maria M ^a   Pham, Duc Truong ^b   Prostov, Mikhail Y ^c   Prostov, Yuriy I ^d  

^a CARDIFF UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^c MOSCOW STATE UNIVERSITY   (Russian Federation)

^d MIREA RUSSIAN TECHNOLOGICAL UNIVERSITY   (Russian Federation)

Author keywords

Clustering; Minkowski metrics; Normalization; Standardization; Statistics

Indexed keywords

CLUSTER ANALYSIS; STATISTICS;

BENCHMARK DATASETS; CATEGORICAL ATTRIBUTES; CATEGORICAL DATA; CHEBYSHEV; CLUSTERING; DATA SETS; DISTANCE-BASED; EUCLIDEAN; FEATURE VECTORS; MIN-MAX; MINKOWSKI; MINKOWSKI METRICS; MIXED DATABASE; MIXED METRICS; NORMALIZATION; NUMERICAL VALUES; OBJECTIVE FUNCTIONS; STATISTICAL APPROACH; STATISTICAL NORMALIZATION; Z-SCORES;

STANDARDIZATION;

EID: 84864999258     PISSN: 13645021     EISSN: 14712946     Source Type: Journal    
DOI: 10.1098/rspa.2011.0704     Document Type: Article

References (34)

1. Aksoy, S. & Haralick, R. M. 2001 Feature normalization and likelihood-based similarity measures for image retrieval. Pattern Recognit. Lett. 22, 563-582. (doi:10.1016/S0167-8655(00)00112-4) (Pubitemid 32376373)
2. Amorim, R. C. & Mirkin, B. 2012 Minkowski metric, feature weighting and anomalous cluster initializing in K-means clustering. Pattern Recognit. 45, 1061-1075. (doi:10.1016/ j.patcog.2011.08.012)
3. Asuncion, A. & Newman, D. J. 2007 UCI Machine learning repository. University of California, CA: School of Information and Computer Science. See http://www.ics. uci.edu/mlearn/MLRepository.html.
4. Bachner, J. 2000 A probabilistic clustering model for variables of mixed type. Qual. Quant. 34, 223-235. (doi:10.1023/A:1004759101388)
5. Bezdek, J. C. 1980 A convergence theorem for the Fuzzy ISODATA clustering algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 2, 1-8. (doi:10.1109/TPAMI.1980.4766964)
6. Bock, H. H. 1996 Probabilistic models in cluster analysis. Comput. Stat. Data Anal. 23, 5-28. (doi:10.1016/0167-9473(96)88919-5)
7. Chen, C.-H. 1973 Statistical pattern recognition. Rochelle Park, NJ: Hayden Book Company.
8. Cios, K. J., Pedrycz, W., Swiniarski, R. W. & Kurgan, L. A. 2007 Data mining: A knowledge discovery approach. New York, NY: Springer.
9. Dempster, A., Laird, N. & Rubin, D. 1977 Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. B 39, 1-38. Doherty, K., Adams, R. & Davey, N. 2004 Non-Euclidean norms and data normalization. In Proc. 12th Euro. Symp. Artificial Neural Networks (ed. M. Verleysen), Bruges, Belgium, 28-30 April 2004, pp. 181-186. Bruges, Belgium: D-side publications.
10. Fraley, C. & Raftery, A. E. 2002 Model-based clustering, discriminant analysis, and density estimation. J. Am. Stat. Assoc. 97, 611-631. (doi:10.1198/016214502760047131)
11. Gan, G., Ma, Ch. &Wu, J. 2007 Data clustering: Theory, algorithms, and applications. Philadelphia, PA: SIAM.
12. Gibert, K. & Cortés, U. 1997Weighing quantitative and qualitative variables in clustering methods. Mathware Soft Comput. 4, 251-266. (Pubitemid 128025484)
13. Hathaway, R. J., Bezdek, J. C. & Hu, Y.-K. 2000 Generalized fuzzy c-means clustering strategies using Lp norm distances. IEEE Trans. Fuzzy Syst. 8, 576-582. (doi:10.1109/91.873580)
14. Hastie, T., Tibshirani, R. & Friedman, J. 2001 The elements of statistical learning. Data mining, inference, and prediction. Berlin, Germany: Springer.
15. Huang, Z. 1997 Clustering large data sets with mixed numeric and categorical values. In Proc. the First Pacific Asia Knowledge Discovery and Data Mining Conference, pp. 21-34. Singapore: World Scientific.
16. Huang, Z. 1998 Extensions to the k-means algorithm for clustering large data sets with categorical values. Data Mining Knowl. Discov. 2, 283-304. (doi:10.1023/A:1009769707641) (Pubitemid 128695480)
17. Huang, J. Z., Ng, M. K., Rong, H. & Li, Z. 2005 Automated variable weighting in k-means type clustering. IEEE Trans. Pattern Anal. Mach. Intell. 27, 657-668. (doi:10.1109/TPAMI.2005.95) (Pubitemid 40608400)
18. Jain, A. K. & Dubes, R. C. 1988 Algorithms for clustering data. Englewood Cliffs, NJ: Prentice Hall.
19. Kamath, C. 2009 Scientific data mining: A practical perspective, Philadelphia, PA: SIAM.
20. Kaufman, L. & Rousseeuw, P. J. 2005 Finding groups in data: An introduction to cluster analysis. New York, NY: Wiley.
21. Larose, D. T. 2005 Discovering knowledge in data: An introduction to data mining. Hoboken, NJ: Wiley.
22. MacQueen, J. B. 1967 Some methods for classification and analysis of multivariate observations. In Proc. 5th Berkeley Symp. Math. Stat. Probab., pp. 281-297. Berkeley, CA: University of California Press. See http://projecteuclid. org/DPubS?service=UI&version=1.0& verb=Display&handle=euclid.bsmsp/ 1200512992.
23. Michalski, R. S. & Stepp, R. E. 1983 Automated construction of classifications: Conceptual clustering versus numerical taxonomy. IEEE Trans. Pattern Anal. Mach. Intell. 5, 396-410. (doi:10.1109/TPAMI.1983.4767409)
24. Milligan, G. W. & Cooper, M. C. 1988 A study of variable standardization in cluster analysis. J. Classif. 5, 181-204. (doi:10.1007/BF01897163)
25. Mirkin, B. 1996 Mathematical classification and clustering. Dordrecht, The Netherlands: Kluwer Academic Press.
26. Mirkin, B. 1997 L1 and L2 approximation clustering for mixed data: Scatter decompositions and algorithms L1. Stat. Proc. Related Top. 31, 473-486.
27. Mirkin, B. 1998 Least-squares structuring, clustering, and data processing issues. Comput. J. 41, 518-536. (doi:10.1093/comjnl/41.8.518)
28. Mirkin, B. 2005 Clustering for data mining: A data recovery approach. Boca Raton FL: Chapman and Hall/CRC. Miyamoto, S. & Agusta, Y. 1998 Algorithms for L1 and Lp fuzzy c-means and their convergence. In Studies in classification, data analysis, and knowledge organization; data science, classification, and related Methods (eds C. Hayashi, N. Ohsumi, K. Yajima, Y. Tamaka, H. H. Bock & Y. Baba), pp. 295-302. Tokyo, Japan: Springer.
29. Pham, D. T., Prostov, Y. I. & Suarez-Alvarez, M. M. 2006 Statistical approach to numerical databases: Clustering using normalised Minkowski metrics. In Intelligent Production Machines and Systems. Proc. of 2nd I*PROMS Virtual Conference, 3-14 July 2006, pp. 356-361. Amsterdam, The Netherlands: Elsevier.
30. Pham, D.-T., Suarez-Alvarez, M. M. & Prostov, Y. I. 2011 Random search with k-prototypes algorithm for clustering mixed datasets. Proc. R. Soc. A 467, 2387-2403. (doi:10.1098/ rspa.2010.0594)
31. Ralambondrainy, H. 1995 A conceptual version of the K-means algorithm. Pattern Recognit. Lett. 16, 1147-1157. (doi:10.1016/0167-8655(95)00075-R) (Pubitemid 26442196)
32. Rand, W. M. 1971 Objective criteria for the evaluation of clustering methods. J. Am. Stat. Assoc. 66, 846-850. (doi:10.2307/2284239)
33. Suarez-Alvarez, M. M. 2010 Design and analysis of clustering algorithms for numerical, categorical and mixed data. PhD thesis, Cardiff University, Cardiff, UK.
34. Zhigljavsky, A. A. & Zilinskas, A. G. 2008 Stochastic global optimization. Berlin, Germany: Springer.