A survey of clustering algorithms for big data: Taxonomy and empirical analysis

IEEE Transactions on Emerging Topics in Computing

Volumn 2, Issue 3, 2014, Pages 267-279

  Fahad, Adil ^a,d   Alshatri, Najlaa ^a   Tari, Zahir ^a   Alamri, Abdullah ^a   Khalil, Ibrahim ^a   Zomaya, Albert Y ^b   Foufou, Sebti ^c   Bouras, Abdelaziz ^c  

^a RMIT UNIVERSITY   (Australia)

^b UNIVERSITY OF SYDNEY   (Australia)

^c QATAR UNIVERSITY   (Qatar)

^d AL BAHA UNIVERSITY   (Saudi Arabia)

Author keywords

big data; Clustering algorithms; unsupervised learning

Indexed keywords

BIG DATA; CLUSTER ANALYSIS; LEARNING ALGORITHMS; SURVEYS; UNSUPERVISED LEARNING;

BODY OF KNOWLEDGE; CATEGORIZING FRAMEWORKS; EMPIRICAL ANALYSIS; EXTERNAL VALIDITIES; METALEARNING; MODERN APPLICATIONS; RUNTIMES; SCALABILITY TEST;

CLUSTERING ALGORITHMS;

EID: 84908602473     PISSN: None     EISSN: 21686750     Source Type: Journal    
DOI: 10.1109/TETC.2014.2330519     Document Type: Article

References (40)

1. A. A. Abbasi and M. Younis, "A survey on clustering algorithms for wireless sensor networks, " Comput. Commun., vol. 30, nos. 14-15, pp. 2826-2841, Oct. 2007.
2. C. C. Aggarwal and C. Zhai, "A survey of text clustering algorithms, " in Mining Text Data. New York, NY, USA: Springer-Verlag, 2012, pp. 77-128.
3. A. Almalawi, Z. Tari, A. Fahad, and I. Khalil, "A framework for improving the accuracy of unsupervised intrusion detection for SCADA systems, " in Proc. 12th IEEE Int. Conf. Trust, Security Privacy Comput. Commun. (TrustCom), Jul. 2013, pp. 292-301.
4. A. Almalawi, Z. Tari, I. Khalil, and A. Fahad, "SCADAVT-A framework for SCADA security testbed based on virtualization technology, " in Proc. IEEE 38th Conf. Local Comput. Netw. (LCN), Oct. 2013, pp. 639-646.
5. M.Ankerst, M. M.Breunig, H.-P. Kriegel, andJ.Sander, "Optics: Ordering points to identify the clustering structure, " in Proc. ACM SIGMOD Rec., 1999, vol. 28, no. 2, pp. 49-60.
6. J. C. Bezdek, R. Ehrlich, and W. Full, "FCM: The fuzzyc-means clustering algorithm, " Comput. Geosci., vol. 10, nos. 2-3, pp. 191-203, 1984.
7. J. Brank, M.Grobelnik, andD. Mladenic, "A survey of ontology evaluation techniques, " in Proc. Conf. Data Mining Data Warehouses (SiKDD), 2005.
8. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the em algorithm, " J. Roy. Statist. Soc., Ser. B, vol. 39, no. 1, pp. 1-38, 1977.
9. M. Ester, H.-P. Kriegel, J. Sander, and X. Xu, "A density-based algorithm for discovering clusters in large spatial databases with noise, " in Proc. ACM SIGKDD Conf. Knowl. Discovery Ad Data Mining (KDD), 1996, pp. 226-231.
10. A. Fahad, Z. Tari, A. Almalawi, A. Goscinski, I. Khalil, and A. Mahmood, "PPFSCADA: Privacy preserving framework for SCADA data publishing, " Future Generat. Comput. Syst., vol. 37, pp. 496-511, Jul. 2014.
11. A. Fahad, Z. Tari, I. Khalil, I. Habib, and H. Alnuweiri, "Toward an efficient and scalable feature selection approach for internet traffic classification, " Comput. Netw., vol. 57, no. 9, pp. 2040-2057, Jun. 2013.
12. D. H. Fisher, "Knowledge acquisition via incremental conceptual clustering, " Mach. Learn., vol. 2, no. 2, pp. 139-172, Sep. 1987.
13. J. H. Gennari, P. Langley, and D. Fisher, "Models of incremental concept formation, " Artif. Intell., vol. 40, nos. 1-3, pp. 11-61, Sep. 1989.
14. S. Guha, R. Rastogi, and K. Shim, "Cure: An efficient clustering algorithm for large databases, " in Proc. ACM SIGMOD Rec., Jun. 1998, vol. 27, no. 2, pp. 73-84.
15. S. Guha, R. Rastogi, and K. Shim, "Rock: A robust clustering algorithm for categorical attributes, " Inform. Syst., vol. 25, no. 5, pp. 345-366, 2000.
16. J. Han and M. Kamber, Data Mining: Concepts and Techniques, 2nd ed. San Mateo, CA, USA: Morgan Kaufmann, 2006.
17. A. Hinneburg and D. A. Keim, "An efficient approach to clustering in large multimedia databases with noise, " in Proc. ACM SIGKDD Conf. Knowl. Discovery Ad Data Mining (KDD), 1998, pp. 58-65.
18. A. Hinneburg and D. A. Keim, "Optimal grid-clustering: Towards breaking the curse of dimensionality in high-dimensional clustering, " in Proc. 25th Int. Conf. Very Large Data Bases (VLDB), 1999, pp. 506-517.
19. Z. Huang, "A fast clustering algorithm to cluster very large categorical data sets in data mining, " in Proc. SIGMOD Workshop Res. Issues Data Mining Knowl. Discovery, 1997, pp. 1-8.
20. L. Hubert and P. Arabie, "Comparing partitions, " J. Classification, vol. 2, no. 1, pp. 193-218, 1985.
21. A. K. Jain and R. C. Dubes, Algorithms for Clustering Data. Upper Saddle River, NJ, USA: Prentice-Hall, 1988.
22. G. Karypis, E.-H. Han, and V. Kumar, "Chameleon: Hierarchical clustering using dynamic modelling, " IEEE Comput., vol. 32, no. 8, pp. 68-75, Aug. 1999.
23. L. Kaufman and P. J. Rousseeuw, Finding Groups in Data: An Introduction to Cluster Analysis. New York, NY, USA: Wiley, 2009.
24. T. Kohonen, "The self-organizing map, " Neurocomputing, vol. 21, no. 1, pp. 1-6, 1998.
25. J. MacQueen, "Some methods for classification and analysis of multi-variate observations, " in Proc. 5th Berkeley Symp. Math. Statist. Probab., Berkeley, CA, USA, 1967, pp. 281-297.
26. A. Mahmood, C. Leckie, and P. Udaya, "An efficient clustering scheme to exploit hierarchical data in network traffic analysis, " IEEE Trans. Knowl. Data Eng., vol. 20, no. 6, pp. 752-767, Jun. 2007.
27. A. N. Mahmood, C. Leckie, and P. Udaya, "ECHIDNA: Efficient clustering of hierarchical data for network traffic analysis, " in Proc. 5th Int. IFIP-TC6 Conf. Netw. Technol., Services, Protocols Perform. Comput. Commun. Netw. Mobile Wireless Commun. Syst. (NETWORKING), 2006, pp. 1092-1098.
28. M. Meila and D. Heckerman, "An experimental comparison of several clustering and initialization methods, " in Proc. 14th Conf. Uncertainty Artif. Intell. (UAI), 1998, pp. 386-395.
29. A. Moore, J. Hall, C. Kreibich, E. Harris, and I. Pratt, "Architecture of a network monitor, " in Proc. Passive Active Meas. Workshop (PAM), LaJolla, CA, USA, Apr. 2003.
30. A. Moore and D. Zuev, "Internet traffic classification using Bayesian analysis techniques, " in Proc. ACM Int. Conf. Meas. Model. Comput. Syst. (SIGMETRICS), 2005, pp. 50-60.
31. R. T. Ng and J. Han, "Efficient and effective clustering methods for spatial data mining, " in Proc. Int. Conf. Very Large Data Bases (VLDB), 1994, pp. 144-155.
32. R. T. Ng and J. Han, "CLARANS: A method for clustering objects for spatial data mining, " IEEE Trans. Knowl. Data Eng. (TKDE), vol. 14, no. 5, pp. 1003-1016, Sep./Oct. 2002.
33. H.-S. Park and C.-H. Jun, "A simple and fast algorithm for K-medoids clustering, " Expert Syst. Appl., vol. 36, no. 2, pp. 3336-3341, Mar. 2009.
34. G. Sheikholeslami, S. Chatterjee, and A. Zhang, "Wavecluster: A multi-resolution clustering approach for very large spatial databases, " in Proc. Int. Conf. Very Large Data Bases (VLDB), 1998, pp. 428-439.
35. S. J. Stolfo, W. Fan, W. Lee, A. Prodromidis, and P. Chan, "Cost-based modeling for fraud and intrusion detection: Results from the JAM project, " in Proc. DARPA Inform. Survivability Conf. Exposit. (DISCEX), 2000, pp. 130-144.
36. S. Suthaharan, M. Alzahrani, S. Rajasegarar, C. Leckie, and M. Palaniswami, "Labelled data collection for anomaly detection in wireless sensor networks, " in Proc. 6th Int. Conf. Intell. Sensors, Sensor Netw. Inform. Process. (ISSNIP), Dec. 2010, pp. 269-274.
37. W. Wang, J. Yang, and R. R. Muntz, "Sting: A statistical information grid approach to spatial data mining, " in Proc. 23rd Int. Conf. Very Large Data Bases (VLDB), 1997, pp. 186-195.
38. R. Xu and D. Wunsch, "Survey of clustering algorithms, " IEEE Trans. Neural Netw., vol. 16, no. 3, pp. 645-678, May 2005.
39. X. Xu, M. Ester, H.-P. Kriegel, and J. Sander, "A distribution-based clustering algorithm for mining in large spatial databases, " in Proc. 14th IEEE Int. Conf. Data Eng. (ICDE), Feb. 1998, pp. 324-331.
40. T. Zhang, R. Ramakrishnan, and M. Livny, "BIRCH: An efficient data clustering method for very large databases, " in Proc. ACM SIGMOD Rec., Jun. 1996, vol. 25, no. 2, pp. 103-114.