Incremental clustering of dynamic data streams using connectivity based representative points

Data and Knowledge Engineering

Volumn 68, Issue 1, 2009, Pages 1-27

  Lühr, Sebastian ^a   Lazarescu, Mihai ^a  

^a CURTIN UNIVERSITY   (Australia)

Author keywords

Data mining; Incremental graph based clustering; Knowledge acquisition; Recurrent change; Stream data clustering

Indexed keywords

CLUSTERING ALGORITHMS; DATA MINING; DATA PROCESSING; DECISION SUPPORT SYSTEMS; FLOW OF SOLIDS; GRAPH THEORY; INFORMATION MANAGEMENT; KNOWLEDGE ACQUISITION; KNOWLEDGE BASED SYSTEMS; RIVERS;

DATA STREAMS; DYNAMIC DATUMS; FINANCIAL TRANSACTIONS; INCREMENTAL CLUSTERING; INCREMENTAL GRAPH-BASED CLUSTERING; KNOWLEDGE REPOSITORIES; LARGE SCALE SURVEILLANCES; NETWORK PACKETS; RECURRENT CHANGE; RECURRENT PATTERNS; STREAM DATA CLUSTERING;

CLUSTER ANALYSIS;

EID: 56249119506     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2008.08.006     Document Type: Article

References (56)

1. Aggarwal C.C. Re-designing distance functions and distance-based applications for high dimensional data. ACM SIGMOD Record 30 1 (2001) 13-18
2. Aggarwal C.C. Towards systematic design of distance functions for data mining applications. Proceedings of the Ninth ACM SIGKDD International Conference Knowledge Discovery and Data Mining (2003), ACM Press, Washington, District of Columbia, USA
3. Aggarwal C.C. A human-computer interactive method for projected clustering. IEEE Transactions on Knowledge and Data Engineering 16 4 (2004) 448-460
4. C.C. Aggarwal, J. Han, J. Wang, P. Yu, A framework for clustering evolving data streams, in: Proceedings of the 29th International Conference on Very Large Data Bases, Berlin, Germany, 2003.
5. Aggarwal C.C., Han J., Wang J., and Yu P.S. A framework for projected clustering of high dimensional data streams. In: Nascimento M.A., Özsu M.T., Kossmann D., Miller R.J., Blakeley J.A., and Schiefer K.B. (Eds). Proceedings of the 30th International Conference on Very Large Data Bases (2004), Morgan Kaufmann, Toronto, Canada
6. Aggarwal C.C., Han J., and Yu P.S. On demand classification of data streams. Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2004), ACM Press, Seattle, Washington, USA
7. C.C. Aggarwal, P.S. Yu, A framework for clustering uncertain data streams, in: IEEE 24th International Conference on Data Engineering, Cancún, México, 2008.
8. Agrawal R., Gehrke J., Gunopulos D., and Raghaven P. Automatic subspace clustering of high dimensional data for data mining applications. ACM SIGMOD Record 27 2 (1998) 94-105
9. Ankerst M., Breunig M.M., Kriegel H.-P., and Sander J. OPTICS: ordering points to identify the clustering structure. In: Delis A., Faloutsos C., and Ghandeharizadeh S. (Eds). Proceedings of the ACM SIGMOD International Conference on Management of Data (1999), ACM Press, Montreal, Canada
10. Arasu A., Babcock B., Babu S., Cieslewicz J., Datar M., Ito K., Motwani R., Srivastava U., and Widom J. STREAM: The Stanford Data Stream Management System. Data-Stream Management: Processing High-Speed Data Streams (2005), Springer-Verlag
11. A. Asuncion, D.J. Newman, UCI machine learning repository, 2007. .
12. Babcock B., Babu S., Datar M., Motwani R., and Widom J. Models and issues in data stream systems. Proceedings of the 21st ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems (2002), ACM Press, Madison, Wisconsin, USA
13. Bandyopadhyay S., Giannella C., Maulik U., Kargupta H., Liu K., and Datta S. Graph clustering and minimum cut trees. Information Sciences 176 14 (2006) 1952-1985
14. Bentley J.L. Mutlidimensional binary search trees used for associative searching. Communications of the ACM 18 9 (1975) 509-517
15. Beringer J., and Hüllermeier E. Online clustering of parallel data streams. Data and Knowledge Engineering 58 2 (2006) 180-204
16. Blackard J.A., and Dean D.J. Comparative accuracies of artificial neural networks and discriminant analysis in predicting forest cover types from cartographic variables. Computers and Electronics in Agriculture 24 3 (1999) 131-151
17. Y.D. Cai, D. Clutter, G. Pape, J. Han, M. Welge, L. Auvil, MAIDS: mining alarming incidents from data streams, in: Proceedings of the ACM SIGMOD International Conference on Management of Data, Paris, France, 2003.
18. Cao F., Ester M., Qian W., and Zhou A. Density-based clustering over an evolving data stream with noise. In: Ghosh J., Lambert D., Skillicorn D.B., and Srivastava J. (Eds). Proceedings of the Sixth SIAM International Conference on Data Mining (2006), SIAM, Bethesda, Maryland, USA
19. D. Carney, U. Çetintemel, M. Cherniack, C. Convey, S. Lee, G. Seidman, M. Stonebraker, N. Tatbul, S. Zdonik, Monitoring streams: a new class of data management applications, in: Proceedings of the 28th International Conference on Very Large Data Bases, 2002.
20. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Çetintemel, Y. Xing, S.B. Zdonik, Scalable distributed stream processing, in: Proceedings of the First Biennia Conference on Innovative Data Systems Research, 2003.
21. Choo J., Jiamthapthaksin R., Chen C.-S., Celepcikay O.U., Giusti C., and Eick C.F. MOSAIC: a proximity graph approach for agglomerative clustering. In: Song I.Y., Eder J., and Nguyen T.M. (Eds). Ninth International Conference on Data Warehousing and Knowledge Discovery. Lecture Notes in Computer Science vol. 4654 (2007), Springer, Regensburg, Germany
22. P. Domingos, G. Hulten, Catching up with the data: research issues in mining data streams, in: ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery, Santa Barbara, California, USA, 2001.
23. Ester M., Kriegel H.-P., Sander J., Wimmer M., and Xu X. Incremental clustering for mining in a data warehousing environment. In: Gupta A., Shmueli O., and Widom J. (Eds). Proceedings of the 24th International Conference on Very Large Data Bases (1998), Morgan Kaufman, New York City, New York, USA
24. Ester M., Kriegel H.-P., Sander J., and Xu X. A density-based algorithm for discovering clusters in large spatial databases with noise. In: Simoudis E., Han J., and Fayyad U.M. (Eds). Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (1996), AAAI Press, Portland, Oregon, USA
25. Flake G.W., Tarjan R.E., and Tsioutsiouliklis K. Graph clustering and minimum cut trees. Internet Mathematics 1 4 (2003) 385-408
26. Gaber M.M., Zaslavsky A.B., and Krishnaswamy S. Mining data streams: a review. SIGMOD Record 34 2 (2005) 18-26
27. Ganti V., Gehrke J., and Ramakrishnan R. DEMON: mining and monitoring evolving data. IEEE Transactions on Knowledge and Data Engineering 13 1 (2001) 50-63
28. Gao J., Li J., Zhang Z., and Tan P.-N. An incremental data stream clustering algorithm based on dense units detection. In: Ho T.B., Cheung D.W.-L., and Liu H. (Eds). Proceedings of the Ninth Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining. Lecture Notes in Computer Science vol. 3518 (2005), Springer
29. Guha S., Meyerson A., Mishra N., Motwani R., and O'Callaghan L. Clustering data streams: theory and practice. IEEE Transactions on Knowledge and Data Engineering 15 3 (2003) 515-528
30. Hagen L., and Kahng A.B. A new approach to effective circuit clustering. Proceedings of the IEEE/ACM International Conference on Computer-Aided Design (1992), IEEE Computer Society, Santa Clara, California, USA
31. Harel D., and Koren Y. On clustering using random walks. In: Hariharan R., Mukund M., and Vinay V. (Eds). Proceedings of the 21st Conference on Foundations of Software Technology and Theoretical Computer Science. Lecture Notes in Computer Science vol. 2245 (2001), Springer
32. Hartigan J.A. Clustering Algorithms (1975), John Wiley & Sons, New York City, New York, USA
33. He J., Tan A.-H., Tan C.L., and Sung S.Y. On quantitative evaluation of clustering systems. In: Wu W., Xiong H., and Shekhar S. (Eds). Clustering and Information Retrieval (2003), Kluwer 105-134
34. S. Hettich, S.D. Bay, The UCI KDD archive, 1999. .
35. Hinneburg A., Aggarwal C.C., and Keim D.A. What is the nearest neighbor in high dimensional spaces?. In: Abbadi A.E., Brodie M.L., Chakravarthy S., Dayal U., Kamel N., Schlageter G., and Whang K.-Y. (Eds). Proceedings of the 26th International Conference on Very Large Data Bases (2000), Morgan Kaufman, Cairo, Egypt
36. Jain A.K., and Dubes R.C. Algorithms for Clustering Data (1988), Prentice-Hall
37. Jain A.K., Murty M.N., and Flynn P.J. Data clustering: a review. ACM Computing Surveys 31 3 (1999) 264-323
38. Kannan R., Vempala S., and Vetta A. On clusterings: good, bad and spectral. Proceedings of the 41st Annual Symposium Foundations of Computer Science (2000), IEEE Computer Society, Redondo Beach, California, USA
39. Kannan R., Vempala S., and Vetta A. On clusterings: good, bad and spectral. Journal of the ACM 51 3 (2004) 497-515
40. Karypis G., Aggarwal R., Kumar V., and Shekhar S. Multilevel hypergraph partitioning: application in VLSI domain. IEEE Transactions on Very Large Scale Integration (VLSI) Systems 7 1 (1999) 69-79
41. Karypis G., Han E.-H., and Kumar V. Chameleon: hierarchical clustering using dynamic modeling. Computer 32 8 (1999) 68-75
42. Knuth D. The Art of Computer Programming. third ed. vol. 3 (1997), Addison-Wesley
43. S. Lühr, M. Lazarescu, Connectivity based stream clustering using localised density exemplars, in: Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining, Lecture Notes in Computer Science, vol. 5012, Osaka, Japan, 2008.
44. MacQueen J.B. Some methods for classification and analysis of multivariate observations. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability vol. 1 (1967), University of California
45. A.W. Moore, Efficient memory-based learning for robot control, Ph.D. thesis, Cambridge University, 1990.
46. Nasraoui O., Rojas C., and Cardona C. A framework for mining evolving trends in web streams using dynamic learning and retrospective validation. Computer Networks 50 10 (2006) 1488-1512
47. Nasraoui O., Uribe C.C., Coronel C.R., and Gonzalez F. TECNO-STREAMS: tracking evolving clusters in noisy data streams with a scalable immune system learning model. IEEE International Conference on Data Mining (2003), IEEE Computer Society, Washington, District of Columbia, USA
48. O'Callaghan L., Mishra N., Meyerson A., and Guha S. Streaming-data algorithms for high-quality clustering. Proceedings of the 18th International Conference on Data Engineering (2002), IEEE Computer Society, Washington, District of Columbia, USA
49. Park N.H., and Lee W.S. Cell trees: an adaptive synopsis structure for clustering multi-dimensional on-line data streams. Data and Knowledge Engineering 63 2 (2007) 528-549
50. S.J. Stolfo, W. Fan, W. Lee, A. Prodromidis, P.K. Chan, Cost-based modeling for fraud and intrusion detection: results from the JAM project, in: Proceedings of the DARPA Information Survivability Conference and Exposition, vol. 2, Hilton Head, South Carolina, USA, 2000.
51. Tasoulis D.K., Ross G., and Adams N.M. Visualising the cluster structure of data streams. In: Berthold M.R., Shawe-Taylor J., and Lavrac N. (Eds). Proceedings of the Seventh International Symposium on Intelligent Data Analysis. Lecture Notes in Computer Science vol. 4723 (2007), Springer
52. S. van Dongen, Graph clustering by flow simulation, Ph.D. thesis, University of Utrecht, 2000.
53. Xu R., and Wunsch II D. Survey of clustering algorithms. IEEE Transactions on Neural Networks 16 3 (2005) 645-678
54. Zhang T., Ramakrishnan R., and Livny M. BIRCH: an efficient data clustering method for very large databases. In: Jagadish H.V., and Mumick I.S. (Eds). Proceedings of the ACM SIGMOD International Conference on Management of Data (1996), ACM Press
55. Zhou A., Cao F., Yan Y., Sha C., and He X. Distributed data stream clustering: a fast EM-based approach. Proceedings of the 23rd International Conference on Data Engineering (2007), IEE
56. Y. Zhou, K. Aberer, A. Salehi, K.-L. Tan, Rethinking the design of distributed stream processing systems, in: Proceedings of the 24th International Conference on Data Engineering Workshops, ICDE 2008, Cancún, México, 2008.