Unsupervised learning based distributed detection of global anomalies

International Journal of Information Technology and Decision Making

Volumn 9, Issue 6, 2010, Pages 935-957

  Zhou, Junlin ^a   Lazarevic, Aleksandar ^b   Hsu, Kuo Wei ^c   Srivastava, Jaideep ^c   Fu, Yan ^a   Wu, Yue ^a  

^a UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b UNITED TECHNOLOGIES RESEARCH CENTER   (United States)

^c University of Minnesota   (United States)

Author keywords

combining models; Distributed anomaly detection; global anomalies

Indexed keywords

EID: 78149346488     PISSN: 02196220     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219622010004172     Document Type: Article

References (40)

1. P. Chan and S. Stolfo, On the accuracy of meta-learning for scalable data mining, J. Intell. Integr. Inform., 1998.
2. K. J. Cherkauer, Human expert-level performance on a scientific image analysis task by a system using combined artificial neural networks, in Working Notes of the AAAI Workshop on Integrating Multiple Learned Models (1996), pp. 15-21.
3. S. Gunter and H. Bunke, Ensembles of classifiers for handwritten word recognition, Int. J. Doc. Anal. Recognit. 5 (2001) 1433-2833.
4. Z.-H. Zhou and Y. Jiang, Medical diagnosis with C4. 5 rule preceded by artificial neural network ensemble, IEEE Trans. Inf. Technol. Biom ed. 7 (2003) 37-42.
5. Y. Peng, G. Kou, Y. Shi and Z. X. Chen, A descriptive framework for the field of data mining and knowledge discovery, Int. J. Inf. Technol. Decis. Mak. (IJITDM) 7 (2008) 639-682.
6. W. Fan, S. Stolfo and J. Zhang, The application of AdaBoost for distributed, scalable and on-line learning, in Proc. SIGKDD (1999), pp. 362-366.
7. A. Lazarevic and V. Kumar, Feature bagging for outlier detection, in Proc. SIGKDD (2005).
8. G. Deshmeh and M. Rahmati, Distributed anomaly detection, using cooperative learners and association rule analysis, Intell. Data Anal. 12 (2008) 339-357.
9. S. Park, K. Seo and D. Jang, Fuzzy art-based image clustering method for contentbased image retrieval, Int. J. Inf. Technol. Decis. Mak. (IJITDM) 6 (2007) 213-233.
10. V. Chatzigiannakis, S. Papavassiliou, M. Grammatikou and B. Maglaris, Hierarchical anomaly detection in distributed large-scale sensor networks, ISCC (2006), pp. 761-767.
11. N. Srinivasan and V. Vaidehi, Anomaly detection in a distributed environment using neural networks on a cluster, in Proc. Communication, Network, and Information Security (2005).
12. S. Rajasegarar, C. Leckie, M. Palaniswami and J. C. Bezdek, Distributed anomaly detection in wireless sensor networks, in Communication Systems, ICCS (2006), pp. 1-5.
13. Y.-F. Zhang, Z.-Y. Xiong and X.-Q. Wang, Distributed intrusion detection based on clustering, in Proc Int. Conf. on Machine Learning and Cybernetics 4 (2005) 2379-2383.
14. G. Folino, C. Pizzuti and G. Spezzano, GP ensemble for distributed intrusion detection systems in Proc. Int. Conf. on Advanced in Pattern Recognition 36 (2005) 54-62.
15. J. B. D. Cabrera, C. Gutirreza and R. K. Mehraa, Ensemble methods for anomaly detection and distributed intrusion detection in Mobile Ad-Hoc Networks, Inf. Fusion 9 (2008) 96-119.
16. J. A. Hartigan and M. A. Wong, A k-means clustering algorithm, Appl. Stat. 28 (1979) 100-108.
17. T. Kohonen, Self-organizing maps, in Springer Series in Information Sciences, Vol. 30 (2001) 3rd extended edn.
18. L. I. Kuncheva and S. T. Hadjitodorov, Using diversity in cluster ensembles, in IEEE Int. Conf. on Systems, Man and Cybernetics 2 (2004) 1214-1219.
19. S. Dudoit and J. Fridlyand, A prediction-based resampling method for estimating the number of clusters in a dataset, Genome Biol. 3 (2002) 1-21.
20. N. Bolshakova and F. Azuaje, Cluster validation techniques for genome expression data, Signal Process. 8 (2003) 825-833.
21. F. Provost and T. Fawcett, Robust classification for imprecise environments, Mach. Learn. 42 (2001) 203-231.
22. Y. Freund and E. R. Schapire, A decision theoretic generalization of on-line learning and an application to boosting, J. Comput. Syst. Sci. 55 (1997) 119-139.
23. L. Breiman, Bagging predictors, Mach. Learn. 24 (1996) 123-140.
24. L. Breiman, Arcing classifiers, Ann. Statist. 26 (1998) 801-849.
25. L. Breiman, Random forests, Mach. Learn. 45 (2001) 5-32.
26. I. T. Jolliffe, Principal component analysis, in Springer Series in Statistics, 2nd edn., XXIX, Vol. 48 (2002) 20-28.
27. E. Kong and T. Dietterich, Error-correcting output coding corrects bias and variance, in Proc. ICML (1995), pp. 313-321.
28. D. M. J. Tax, One-class classification, Ph. D. thesis, Delft University of Technology, June, (2001).
29. D. Karger, P. Klein and R. Tarjan, A randomized linear-time algorithm to find minimum spanning trees, J. ACM 42 (1995) 321-328.
30. Q. Zhang and R. S. Segal, Web mining: A survey of current research, techniques, and software, Int. J. Inf. Technol. Decis. Mak. (IJITDM) 7 (2008) 683-720.
31. M. Ester, H. Kriegel, J. Sander and X. Xu, A density-based algorithm for discovering clusters in large spatial databases with noise, in Proc. 2nd Int. Conf. on Knowledge Discovery and Data Mining (Portland, OR, 1996), pp. 218-226.
32. V. Chatzigiannakis, A. Lenis, C. Siaterlis, M. Grammatikou, D. Kalogeras, S. Papavassiliou and V. Maglaris, Distributed network monitoring and anomaly detection as a GRID application, in Proc. HPOVUA (2005).
33. N. V. Chawla, A. Lazarevic, Lawrence O. Hall and Kevin Bowyer, SMOTEBoost: Improving the prediction of minority class in boosting, in Proc. PKDD (2003).
34. X. Li, J. He and X. Li, Data mining via minimal spanning tree clustering for prolonging lifetime of wireless sensor networks, Int. J. Inform. Technol. Decis. Mak. (IJITDM) 2 (2007) 235-251.
35. N. M. Maloof, P. Langley, T. Binford, R. Nevatia and S. Sage, Improved rooftop detection in aerial images with machine learning, Mach. Learn. 53 (2003) 157-191.
36. A. Strehl, J. Ghosh and C. Cardie, Cluster ensembles-A knowledge reuse framework for combining multiple partitions, JMLR 3 (2003) 583-617.
37. D. Yu, G. Sheikholeslami and A. Zhang, Findout: Finding outliers in very large datasets, J. Knowl. Inf. Syst. 4 (2002) 387-412.
38. M. F. Jiang, S. S. Tseng and C. M. Su, Tw-phase clustering process for outliers detection, Pattern Recogn. Lett. 22 (2001) 691-700.
39. J. A. Freeman and D. M. Skapura, Backpropagation. Neural Networks Algorithm Applications and Programming Techniques, (1992), pp. 89-125.
40. S. Dehuri and R. Mall, Parallel processing of OLAP queries using a cluster of workstations, Int. J. Inf. Technol. Decis. Mak. (IJITDM) 6 (2007) 279-299.