A decentralized approach for mining event correlations in distributed system monitoring

Journal of Parallel and Distributed Computing

Volumn 73, Issue 3, 2013, Pages 330-340

  Wu, Gang ^a   Zhang, Huxing ^a   Qiu, Meikang ^b   Ming, Zhong ^c   Li, Jiayin ^b   Qin, Xiao ^d  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b UNIVERSITY OF KENTUCKY   (United States)

^c SHENZHEN UNIVERSITY   (China)

^d AUBURN UNIVERSITY   (United States)

Author keywords

Data mining; Decentralized; Distributed system; Event correlations

Indexed keywords

DATA MINING; FILTRATION;

COMPUTATIONAL RESOURCES; DECENTRALIZED; DECENTRALIZED APPROACH; DISTRIBUTED SYSTEMS; EVENT CORRELATION; FAILURE PREDICTION; LARGE-SCALE DISTRIBUTED SYSTEM; TEMPORAL CORRELATIONS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 84886794659     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2012.09.007     Document Type: Article

References (44)

1. D.J. Abadi, S. Madden, W. Lindner, Reed: robust, efficient filtering and event detection in sensor networks, in: Proceedings of the 31st International Conference on Very Large Data Bases, pp. 769-780.
2. R. Agrawal, J.C. Shafer, Parallel mining of association rules, The IEEE Transactions on Knowledge and Data Engineering 8 (1996) 962-969.
3. J.M. Ale, G.H. Rossi, An approach to discovering temporal association rules, in: Proceedings of the 15th ACM Symposium on Applied Computing, pp. 294-300.
4. E. Al-Shaer, H. Abdel-Wahab, K. Maly, Hifi: a new monitoring architecture for distributed systems management, in: Proceedings of the 19th IEEE International Conference on Distributed Computing Systems, pp. 171-178.
5. A. Boukerche, S. Samarah, A novel algorithm for mining association rules in wireless ad hoc sensor networks, IEEE Transactions on Parallel and Distributed Systems 19 (2008) 865-877.
6. E.Y. Chang, H. Bai, K. Zhu, Parallel algorithms for mining large-scale rich-media data, in: Proceedings of the 17th ACM International Conference on Multimedia, pp. 917-918.
7. X. Chen, I. Petrounias, Mining temporal features in association rules, in: Proceedings of the 3rd European Conference on Principles of Data Mining and Knowledge Discovery, pp. 295-300.
8. D.W. Cheung, J. Han, V.T. Ng, A.W. Fu, Y. Fu, A fast distributed algorithm for mining association rules, in: Proceedings of the 4th International Conference on Parallel and Distributed Information Systems.
9. A. Congiusta, D. Talia, P. Trunfio, Service-oriented middleware for distributed data mining on the grid, Journal of Parallel and Distributed Computing 68 (2008) 3-15.
10. G. Cormode, M. Garofalakis, S. Muthukrishnan, R. Rastogi, Holistic aggregates in a networked world: distributed tracking of approximate quantiles, in: Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, pp. 25-36.
11. J.D. Cryans, S. Ratte, R. Champagne, Adaptation of apriori to mapreduce to build a warehouse of relations between named entities across the web, in: International Conference on Advances in Databases, Knowledge, and Data Applications, pp. 185-189.
12. A. Cuzzocrea, Cams: olaping multidimensional data streams efficiently, in: Proc. of DaWaK, pp. 48-62.
13. J. Dean, S. Ghemawat, Mapreduce: simplified data processing on large clusters, in: Proceedings of the 6th Symposium on Operating Systems Design and Implementation, pp. 137-150.
14. A. Deligiannakis, Y. Kotidis, N. Roussopoulos, Hierarchical in-network data aggregation with quality guarantees, in: Proceedings of the 9th International Conference on Extending DataBase Technology.
15. M. Fisichella, A. Stewart, A. Cuzzocrea, K. Denecke, Detecting epidemic intelligence, in: Proc. of SPIRE, pp. 87-103.
16. S. Fu, C. Xu, Exploring event correlation for failure prediction in coalitions of clusters, in: Proceedings of the 19th ACM/IEEE Conference on Supercomputing, pp. 41:1-41:12.
17. S. Fu, C. Xu, Quantifying event correlations for proactive failure management in networked computing systems, Journal of Parallel and Distributed Computing 70 (2010) 1100-1109.
18. S. Hammoud, MapReduce network enabled algorithms for classification based on association rules, Ph.D. Thesis, Brunel University, 2011.
19. E.H. Han, G. Karypis, V. Kumar, Scalable parallel data mining for association rules, in: ACM SIGMOD International Conference on Management of Data, pp. 277-288.
20. R. Huebsch, B. Chun, J.M. Hellerstein, B.T. Loo, P. Maniatis, T. Roscoe, S. Shenker, I. Stoica, A.R. Yumerefendi, The architecture of pier: an Internet-scale query processor, in: Proceedings of the 2nd Biennial Conference on Innovative Data Systems Research, pp. 28-43.
21. G. Khanna, P. Varadharajan, S. Bagchi, Automated online monitoring of distributed applications through external monitors, IEEE Transactions on Dependable and Secure Computing 3 (2006) 115-129.
22. Y. Li, P. Ning, X.S. Wang, S. Jajodia, Discovering calendar-based temporal association rules, Data & Knowledge Engineering 44 (2003) 193-218.
23. H. Li, Y. Wang, D. Zhang, M. Zhang, E.Y. Chang, PFP: parallel FP-growth for query recommendation, in: Proceedings of the 2008 ACM Conference on Recommender Systems.
24. J. Li, M. Qiu, Z. Ming, G. Quan, X. Qin, Z. Gu, Online optimization for scheduling preemptable tasks on IaaS cloud systems, Journal of Parallel and Distributed Computing (JPDC) 72 (5) (2012) 666-677. (Most Download Paper of JPDC in 2012).
25. Y. Liang, Y. Zhang, A. Sivasubramaniam, M. Jette, R. Sahoo, Bluegene/l failure analysis and prediction models, in: Proceedings of the 2006 International Conference on Dependable Systems and Networks, pp. 425-434.
26. X.Y. Yang, Z. Liu, Y. Fu, MapReduce as a programming model for association rules algorithm on Hadoop, in: International Conference on Information Sciences and Interaction Sciences, 2002, pp. 99-102.
27. K.K. Loo, I. Tong, B. Kao, D. Cheung, Online algorithms for mining inter-stream associations from large sensor networks, in: Proceedings of the 9th Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 143-149.
28. S. Madden, M.J. Franklin, J.M. Hellerstein, W. Hong, Tag: a tiny aggregation service for ad-hoc sensor networks, ACM SIGOPS Operating Systems Review 36 (2002) 131-146.
29. S. Meng, S.R. Kashyap, C. Venkatramani, L. Liu, REMO: Resource-aware application state monitoring for large-scale distributed systems, in: Proceedings of the 29th IEEE International Conference on Distributed Computing Systems, pp. 248-255.
30. J.W. Mickens, B.D. Noble, Exploiting availability prediction in distributed systems, in: Proceedings of the 3rd Conference on Networked Systems Design & Implementation-Volume 3, NSDI'06.
31. J.S. Park, M. Chen, P. Yu, Efficient parallel data mining for association rules, in: International Conference on Information and Knowledge Management, pp. 31-36.
32. B.H. Park, H. Kargupta, Distributed data mining: algorithms, systems, and applications, in: Data Mining Handbook, 2002, pp. 341-358.
33. A. Rakesh, S. Ramakrishnan, Fast algorithms for mining association rules in large databases, in: Proceedings of the 20th International Conference on Very Large Data Bases, pp. 487-499.
34. M. Ren, L. Guo, Mining recent approximate frequent items in wireless sensor networks, in: Proceedings of the 6th International Conference on Fuzzy Systems and Knowledge Discovery, pp. 463-467.
35. J.F. Roddick, M. Spiliopoulou, A survey of temporal knowledge discovery paradigms and methods, The IEEE Transactions on Knowledge and Data Engineering 14 (2002) 750-767.
36. K. Römer, Discovery of frequent distributed event patterns in sensor networks, in: Proceedings of the 5th European Conference on Wireless Sensor Networks, pp. 106-124.
37. B. Schroeder, G.A. Gibson, A large-scale study of failures in high-performance computing systems, in: Proceedings of the 2006 International Conference on Dependable Systems and Networks, pp. 249-258.
38. I. Sharfman, A. Schuster, D. Keren, A geometric approach to monitoring threshold functions over distributed data streams, in: ACM SIGMOD International Conference on Management of Data, pp. 301-312.
39. A. Silberstein, R. Braynard, J. Yang, Constraint chaining: on energy-efficient continuous monitoring in sensor networks, in: Proceedings of the 2006 ACM SIGMOD International Conference on Management of Data, pp. 157-168.
40. D. Tang, R.K. Iyer, Analysis and modeling of correlated failures in multicomputer systems, IEEE Transactions on Computers 41 (1992) 567-577.
41. P. Yalagandula, M. Dahlin, A scalable distributed information management system, in: Proceedings of the 2004 Conference on Applications, Technologies, Architectures, and Protocols for Computer communications, pp. 379-390.
42. M.J. Zaki, Scalable algorithms for association mining, The IEEE Transactions on Knowledge and Data Engineering 12 (2000) 372-390.
43. W. Zhou, J. Zhan, D. Meng, D. Xu, Z. Zhang, Logmaster: mining event correlations in logs of large scale cluster systems, The Computing Research Repository abs/1003.0951 (March, 2010).
44. X. Zhu, X. Qin, M. Qiu, QoS-aware fault-tolerant scheduling for real-time tasks on heterogeneous clusters, IEEE Transactions on Computers (TOC) 60 (6) (2011) 800-812.