A framework to monitor clusters evolution applied to economy and finance problems

Intelligent Data Analysis

Volumn 16, Issue 1, 2012, Pages 93-111

  Oliveira, Márcia ^a   Gama, João ^a  

^a UNIVERSITY OF PORTO   (Portugal)

Author keywords

Bipartite graphs; change mining; clustering evolution; monitoring; transitions

Indexed keywords

ABNORMAL BEHAVIOR; BIPARTITE GRAPHS; CHANGE MINING; CLUSTERING EVOLUTION; CONDITIONAL PROBABILITIES; DATA PAGES; DATA SETS; EUROPEAN COMPANIES; EVOLUTION TREND; FINANCE PROBLEMS; NEW YORK UNIVERSITY; PORTUGAL; RARE EVENT; RESEARCH ISSUES; TEMPORAL EVOLUTION; TIME-STAMPED DATA; TRACKING METHOD; TRANSITION DETECTION;

ELECTRON TRANSITIONS; MONITORING; VISUALIZATION;

GRAPH THEORY;

EID: 84856853817     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/IDA-2011-0512     Document Type: Conference Paper

References (34)

1. C.C.Aggarwal, A framework for diagnosing changes in evolving data streams. In Proceedings of the 2003 ACMSIGMOD International Conference on Management of Data, SIGMOD '03, pages 575-586, New York, NY, USA. ACM, (2003).
2. C.C. Aggarwal, On change diagnosis in evolving data streams, IEEE Transactions on Knowledge and Data Engineering 17 (2005), 587-600. (Pubitemid 40750819)
3. A.N. Albatineh, M. Niewiadomska-Bugaj and D. Mihalko, On similarity indices and correction for chance agreement, Journal of Classification 23 (2006), 301-313. (Pubitemid 44704845)
4. S. Asur, S. Parthasarathy and D. Ucar, An event-based framework for characterizing the evolutionary behavior of interaction graphs, ACM Transactions on Knowledge Discovery from Data 3 (2009), 1-36.
5. S. Baron and M. Spiliopoulou, Monitoring change in mining results, in: Data Warehousing and Knowledge Discovery, Y. Kambayashi and W.W.A. M., eds, volume 2114 of Lecture Notes in Computer Science, Springer Berlin / Heidelberg, 2001, pp. 51-60. (Pubitemid 33332753)
6. S. Baron and M. Spiliopoulou, Monitoring the evolution of web usage patterns, in: Web Mining: FromWeb to SemanticWeb, B. Berendt, A. Hotho, D. Mladenic, M. van Someren, M. Spiliopoulou and G. Stumme, eds, volume 3209 of Lecture Notes in Computer Science, Springer Berlin / Heidelberg, 2004, pp. 181-200. (Pubitemid 41083510)
7. I. Bartolini, P. Ciaccia, I. Ntoutsi, M. Patella and Y. Theodoridis, The panda framework for comparing patterns, Data and Knowledge Engineering 68(2) (2009), 244-260.
8. P. Berkhin, A survey of clustering data mining techniques, in: Grouping Multidimensional Data, J. Kogan and N.C.T.M., eds, Springer Berlin Heidelberg, 2006, pp. 25-71.
9. N. Bolshakova and F. Azuaje, Cluster validation techniques for genome expression data, Signal Processing 83(4) (2003), 825-833.
10. M. Bottcher, F. Hoppner and M. Spiliopoulou, On exploiting the power of time in data mining, SIGKDD Explorations 10 (2008), 3-11.
11. M.G.M.S. Cardoso and A. Ponce de Leon Ferreira de Carvalho, Quality indices for (practical) clustering evaluation, Intelligent Data Analysis 13(5) (2009), 725-740.
12. S.S. Chawathe and H. Garcia-Molina, Meaningful change detection in structured data, SIGMOD Record 26 (1997), 26-37. (Pubitemid 127456771)
13. K. Chen and L. Liu, Detecting the change of clustering structure in categorical data streams, in: Proceedings of the 6th SIAM International Conference on Data Mining, J. Ghosh, D. Lambert, D.B. Skillicorn and J. Srivastava, eds, USA. SIAM, 2006.
14. S. Dudoit and J. Fridlyand, A prediction-based resampling method for estimating the number of clusters in a dataset, Genome Biology 3 (2002), 301-313.
15. S. Elnekave, M. Last and O. Maimon, in: Proceedings of the 23th International Conference on Data Engineering, Data Engineering Workshops. IEEE Computer Society, 2007.
16. T. Falkowski, J. Bartelheimer and M. Spiliopoulou, Mining and visualizing the evolution of subgroups in social networks, In Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence, WI '06, pages 52-58, Washington, DC, USA. IEEE Computer Society, 2006.
17. V. Ganti, J. Gehrke and R. Ramakrishnan, A framework for measuring changes in data characteristics, In Proceedings of the 18th ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, PODS '99, pages 126-137, New York, NY, USA. ACM, 1999.
18. E.R. Hruschka, R.J.G.B. Campello and L.N. Castro, Evolving clusters in gene-expression data, Information Sciences 176 (2006), 1898-1927. (Pubitemid 44321891)
19. A.K. Jain, Data clustering: 50 years beyond k-means, Pattern Recognition Letters 31(8) (2010), 651-666.
20. A.K. Jain, M.N. Murty and P.J. Flynn, Data clustering: A review, ACM Computing Surveys 31 (1999), 264-323.
21. P. Kalnis, N. Mamoulis and S. Bakiras, On discovering moving clusters in spatio-temporal data, in: Advances in Spatial and Temporal Databases, C. Bauzer Medeiros, M. Egenhofer and E. Bertino, eds, volume 3633 of Lecture Notes in Computer Science, pages 364-381. Springer Berlin / Heidelberg, 2005. (Pubitemid 41433175)
22. L. Kaufman, Finding Groups in Data: An Introduction to Cluster Analysis, Wiley, 2005.
23. S. Kaur, V. Bhatnagar, S. Mehta and S. Kapoor, Concept drift in unlabeled data stream. Technical report, University of Delhi, 2009.
24. T. Li, S. Ma and M. Ogihara, Entropy-based criterion in categorical clustering, In Proceedings of the 21th International Conference on Machine Learning, ICML '04, pages 68-, New York, NY, USA. ACM, 2004.
25. L. O'Callaghan, N.Mishra, A.Meyerson, S. Guha andR.Motwani, Streaming-data algorithms for high-quality clustering, In Proceedings of the 18th International Conference on Data Engineering, ICDE '02, 2002, pages 685-694. (Pubitemid 34278780)
26. M. Oliveira and J. Gama, Bipartite graphs for monitoring clusters transitions, in: Advances in Intelligent Data Analysis IX, P. Cohen, N. Adams and M. Berthold, eds, volume 6065 of Lecture Notes in Computer Science, Springer Berlin / Heidelberg, 2010, pp. 114-124.
27. S. Petrovic, A comparison between the silhouette index and the davies-bouldin index in labelling ids clusters, in Proceedings of the 11th Nordic Workshop on Secure IT-systems, NordSec 2006, 2006, pages 53-64.
28. H. Qiao and B. Edwards, A data clustering tool with cluster validity indices, in International Conference on Computing, Engineering and Information, ICC '09, 2009, pages 303-309.
29. P.J. Rousseeuw, Silhouettes: A graphical aid to the interpretation and validation of cluster analysis, Journal of Computational and Applied Mathematics 20 (1987), 53-65.
30. M. Spiliopoulou, I. Ntoutsi and Y. Theodoridis, Tracing cluster transitions for different cluster types, Control and Cybernetics 38 (2009), 239-259.
31. M. Spiliopoulou, I. Ntoutsi, Y. Theodoridis and R. Schult, Monic: Modeling and monitoring cluster transitions, In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '06, pages 706-711, New York, NY, USA. ACM, 2006. (Pubitemid 44535578)
32. E.J. Spinosa, A. Ponce de Leon Ferreira de Carvalho and J. Gama, Olindda: A cluster-based approach for detecting novelty and concept drift in data streams, In Proceedings of the 2007 ACM Symposium on Applied Computing, SAC '07, pages 448-452, New York, NY, USA. ACM, 2007. (Pubitemid 47568332)
33. G. Urga, The econometrics of panel data: A selective introduction, Economics series working papers, University of Oxford, Department of Economics, 1992.
34. H. Yang, S. Parthasarathy and S. Mehta, A generalized framework for mining spatio-temporal patterns in scientific data, In Proceedings of the 11th ACM SIGKDD International Conference on Knowledge Discovery in Data Mining, KDD '05, pages 716-721, New York, NY, USA. ACM, 2005. (Pubitemid 43218345)