Detecting anomalous records in categorical datasets

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2007, Pages 220-229

  Das, Kaustav ^a   Schneider, Jeff ^a  

^a Carnegie Mellon University   (United States)

Author keywords

Anomaly detection; Machine learning

Indexed keywords

ANOMALOUS RECORDS; ANOMALY DETECTION; CATEGORICAL ATTRIBUTES;

LEARNING SYSTEMS; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD; PROBLEM SOLVING;

DATA ACQUISITION;

EID: 36849000353     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1281192.1281219     Document Type: Conference Paper

References (33)

1. The third international knowledge discovery and data mining tools competition dataset kdd99-cup, 1999.
2. Bronstein A., Das J., Duro M., Friedrich R., Kleyner G., Mueller M., Singhal S., and Cohen I. Bayesian networks for detecting anomalies in internet-based services. In International Symposium on Integrated Network Management, 2001.
3. Rakesh Agrawal, Tomasz Imielinski, and Arun N. Swami. Mining association rules between sets of items in large databases. In Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data, 1993.
4. Rich Tsui Andrew Moore, Greg Cooper and Mike Wagner. Summary of biosurveillance-relevant technologies.
5. M.-A. Balderas, F. Berzal, J.-C. Cubero, E. Eisman, and N. Marn. Discovering hidden association rules. In Proc. International Workshop on Data Mining Methods for Anomaly Detection (KDD 05), 2005.
6. H. B. Barlow. Unsupervised learning. In Neural Computation, volume 1, page 295311, 1989.
7. R. Borisyuk, M. Denham, F. Hoppensteadt, Y. Kazanovich, and O. Vinogradova. An oscillatory neural network model of sparse distributed memory and novelty detection. In BioSystems, pages 265-272, 2000.
8. P. K. Chan, M. V. Mahoney, and M. H. Arshad. A machine learning approach to anomaly detection.
9. Shih Dong-Her, Chiang Hsiu-Sen, Chan Chun-Yuan, and Binshan Lin. Internet security: malicious e-mails detection and protection. Industrial Management and Data Systems, 104:613-623, Sep 2004.
10. S. Edelman, B. P. Hiles, H. Yang, and N. Intrator. Probabilistic principles in unsupervised learning of visual structure: human data and a model. In Advances in Neural Information Processing Systems 14, 2002.
11. E. Eskin, A. Arnold, M. Prerau, L. Portnoy, and S. Stolfo. A geometric framework for unsupervised anomaly detection: Detecting intrusions in unlabeled data, 2002.
12. Eleazar Eskin. Anomaly detection over noisy data using learned probability distributions. In Proc. 17th International Conf. on Machine Learning, pages 255-262. Morgan Kaufmann, San Francisco, CA, 2000.
13. A. Ghosh and A. Schwartzbard. A study in using neural networks for anomaly and misuse detection. In In Proceedings of the 8th USENIX Security Symposium, 1999.
14. K.A. Heller, K.M. Svore, A. Keromytis, and S.J. Stolfo. One class support vector machines for detecting anomalous windows registry accesses. In Proc. of the workshop on Data Mining for Computer Security.
15. P. Helman and J. Bhangoo. A statistically base system for prioritizing information exploration under uncertainty. In IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, volume 27(4), pages 449-466, 1997.
16. S. A. Hofmeyr, Stephanie Forrest, and A. Somayaji. Intrusion detect using sequences of system calls. In Journal of Computer Security, volume 6, pages 151-180, 1998.
17. E. Keogh, S. Lonardi, and C. A. Ratanamahatana. Towards, parameter-free data mining. In Proc. of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 206-215, 2004.
18. Eamonn Keogh, Stefano Lonardi, and Bill Chiu. Finding surprising patterns in a time series database in linear time and space. In Proc. ACM Knowledge Discovery and Data Mining, pages 550-556, 2002.
19. M. Kulldorff. A spatial scan statistic. pages 1481-1496, 1997.
20. Si Quang Le and Tu Bao Ho. An association-based dissimilarity measure for categorical data. In Pattern Recognition Letters archive, volume 26, pages 2549-2557, 2005.
21. Wenke Lee and Salvatore Stolfo. Data mining approaches for intrusion detection. In Proceedings of the 7th USENIX Security Symposium, 1998.
22. Kingsly Leung and Christopher Leckie. Unsupervised anomaly detection in network intrusion detection using clusters. In Proc. 28th Australasian CS Conf., volume 38 of CRPITV, 2005.
23. Kun-Lun Li, Hou-Kuan Huang, Sheng-Feng Tian, and Wei Xu. Improving one-class svm for anomaly detection. In Proc. of International Conference on Machine Learning and Cybernetics, 2003.
24. Andrew Moore and Mary Soon Lee. Cached sufficient statistics for efficient machine learning with large datasets. Journal of Artificial Intelligence Research, 8:67-91, March 1998.
25. Andrew Moore and Weng-Keen Wong. Optimal reinsertion: A new search operator for accelerated and more accurate bayesian network structure learning. In Proceedings of the 20th International Conference on Machine Learning (ICML '03), pages 552-559, August 2003.
26. P. Patel, E.Keogh, J.Lin, and S.Lonardi. Mining motifs in massive time series databases. In Proceedings of IEEE International Conference on Data Mining (ICDM'02), pages 370-377, December 2002.
27. Dan Pelleg. Scalable and practical probability density estimators for scientific anomaly detection. In Doctoral Thesis, Carnegie Mellon University, 2004.
28. Denning PJ. Working sets past and present. In IEEE Transactions on Software Engineering, volume 6, 1980.
29. T. Shon, Y. Kim, C. Lee, and J. Moon. A machine learning framework for network anomaly detection using svm and ga. In Proc. from the Sixth Annual IEEE Systems, Man and Cybernetics (SMC) Information Assurance Workshop, pages 176-183, 2005.
30. G. Cooper W-K Wong, A. W. Moore and M. Wagner. Rule-based anomaly pattern detection for detecting disease outbreaks. In Proceedings of the 18th National Conference on Artificial Intelligence. MIT Press, 2002.
31. Christina Warrender, Stephanie Forrest, and Barak A. Pearlmutter. Detecting intrusions using system calls: Alternative data models. In IEEE Symposium on Security and Privacy, pages 133-145, 1999.
32. Weng-Keen Wong, Andrew Moore, Gregory Cooper, and Michael Wagner. Bayesian network anomaly pattern detection for disease outbreaks. In Proceedings of the Twentieth International Conference on Machine Learning, pages 808-815. AAAI Press, August 2003.
33. Nong Ye and Mingming Xu. Probabilistic networks with undirected links for anomaly detection. In IEEE Systems, Man, and Cybernetics Information Assurance and Security Workshop, pages 175-179, June 2000.