Isolation-based anomaly detection

ACM Transactions on Knowledge Discovery from Data

Volumn 6, Issue 1, 2012, Pages

  Liu, Fei Tony ^a   Ting, Kai Ming ^a   Zhou, Zhi Hua ^b  

^a UNIVERSITY OF BALLARAT   (Australia)

^b NANJING UNIVERSITY   (China)

Author keywords

Algorithms; Design; Experimentation

Indexed keywords

ANOMALY DETECTION; DATA POINTS; EMPIRICAL EVALUATIONS; EXPERIMENTATION; HIGH-DIMENSIONAL PROBLEMS; ONE CLASS-SVM; PROCESSING TIME; RANDOM FORESTS; TRAINING SAMPLE;

ALGORITHMS; DECISION TREES; DESIGN;

FORESTRY;

ALGORITHMS; DECISION MAKING; DESIGN; FORESTRY;

EID: 84859412430     PISSN: 15564681     EISSN: 1556472X     Source Type: Journal    
DOI: 10.1145/2133360.2133363     Document Type: Article

References (45)

1. ABE, N., ZADROZNY, B., AND LANGFORD, J. 2006. Outlier detection by active learning. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and DataMining. ACM, 504-509. (Pubitemid 44535546)
2. ANGIULLI, F. AND FASSETTI, F. 2009. Dolphin: An efficient algorithm for mining distance-based outliers in very large datasets. ACM Trans. Knowl. Discov. Data 3, 1, 1-57.
3. ASUNCION, A. AND NEWMAN, D. 2007. UCI machine learning repository. http://mlearn.ics.ucl.edu/MLRepository.html.
4. BAY, S. D. AND SCHWABACHER, M. 2003. Mining distance-based outliers in near linear time with randomization and a simple pruning rule. In Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 29-38.
5. BREIMAN, L. 2001. Random forests. Mach. Learn. 45, 1, 5-32. (Pubitemid 32933532)
6. BREUNIG, M. M., KRIEGEL, H.-P., NG, R. T., AND SANDER, J. 2000. LOF: Identifying density-based local outliers. ACM SIGMOD Record 29, 2, 93-104.
7. CAPUTO, B., SIM, K., FURESJO, F., AND SMOLA, A. 2002. Appearance-based object recognition using SVMs: Which kernel should I use? In Proceedings of the NIPS Workshop on Statitsical Methods for Computational Experiments in Visual Processing and Computer Vision.
8. CHANDOLA, V., BANERJEE, A., AND KUMAR, V. 2009. Anomaly detection: A survey. ACM Comput. Surv. 41, 3, 1-58.
9. CHAUDHARY, A., SZALAY, A. S., SZALAY, E. S., AND MOORE, A. W. 2002. Very fast outlier detection in large multidimensional datasets. In Proceedings of the ACM SIGMOD Workshop on Research Issues on Data Mining and Knowledge Discovery. ACM.
10. FAN, H., ZAÏANE, O. R., FOSS, A., AND WU, J. 2006. A nonparametric outlier detection for effectively discovering top-n outliers from engineering data. In Proceedings of the 10th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD). Lecture Notes in Computer Science, vol. 3918, Springer, 557-566. (Pubitemid 44019459)
11. GHOTING, A., OTEY, M. E., AND PARTHASARATHY, S. 2004. Loaded: Link-based outlier and anomaly detection in evolving datasets. In Proceedings of the 4th IEEE International Conference on Data Mining (ICDM'04). IEEE Computer Society Press, 387-390. (Pubitemid 40731064)
12. HAND, D. J. AND TILL, R. J. 2001. A simple generalisation of the area under the roc curve for multiple class classification problems. Mach. Learn. 45, 2, 171-186. (Pubitemid 33635984)
13. HE, Z., XU, X., AND DENG, S. 2003. Discovering cluster-based local outliers. Patt. Recog. Lett. 24, 9-10, 1641-1650.
14. HE, Z., DENG, S., AND XU, X. 2005. A unified subspace outlier ensemble framework for outlier detection. In Proceedings of the International Conference on Web-Age Information Management (WAIM). W. Fan, Z. Wu, and J. Yang Eds., Lecture Notes in Computer Science, vol. 3739, Springer, 632-637.
15. JOANES, D. N. AND GILL, C. A. 1998. Comparing measures of sample skewness and kurtosis. J. Roy. Stat. Soc. (Series D): Statistician 47, 1, 183-189. (Pubitemid 128469067)
16. KNORR, E. M. AND NG, R. T. 1998. Algorithms for mining distance-based outliers in large datasets. In Proceedings of the 24th International Conference on Very Large Data Bases (VLDB'98). Morgan Kaufmann, 392-403.
17. KNORR, E. M., NG, R. T., AND TUCAKOV, V. 2000. Distance-based outliers: Algorithms and applications. VLDB J. 8, 3-4, 237-253.
18. KNUTH, D. E. 2006. Art of Computer Programming, Volume 4, Fascicle 4: Generating All Trees. Addison- Wesley Professional.
19. LAZAREVIC, A. AND KUMAR, V. 2005. Feature bagging for outlier detection. In Proceedings of the 11th ACM SIGKDD International Conference on Knowledge Discovery in Data Mining (KDD'05). ACM, New York, 157-166. (Pubitemid 43218277)
20. LIU, F. T., TING, K. M., AND ZHOU, Z.-H. 2008a. Isolation forest. In Proceedings of the 8th IEEE International Conference on Data Mining (ICDM'08). IEEE Computer Society Press, 413-422.
21. LIU, F. T., TING, K. M., AND ZHOU, Z.-H. 2008b. Spectrum of variable-random trees. J. Artif. Intel. Res. 32, 355-384.
22. LIU, F. T., TING, K. M., AND ZHOU, Z.-H. 2010a. Can isolation-based anomaly detectors handle arbitrary multi-modal patterns in data? Tech. rep. TR2010/2, Monash University.
23. LIU, F. T., TING, K. M., AND ZHOU, Z.-H. 2010b. On detecting clustered anomalies using SCiForest. In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD'10). 274-290.
24. LIU, R. Y., PARELIUS, J. M., AND SINGH, K. 1999. Multivariate analysis by data depth: Descriptive statistics, graphics and inference. Ann. Stat. 27, 3, 783-840.
25. MURPHY, R. B. 1951. On tests for outlying observations. Ph.D. dissertation, Princeton University.
26. PAPADIMITRIOU, S., KITAGAWA, H., GIBBONS, P., AND FALOUTSOS, C. 2003. Loci: Fast outlier detection using the local correlation integral. In Proceedings of the 19th International Conference on Data Engineering. 315-326.
27. PREISS, B. R. 1999. Data Structures and Algorithms with Object-Oriented Design Patterns in Java. Wiley.
28. QUINLAN, J. R. 1993. C4.5: Programs for Machine Learning 1st Ed. (Series in Machine Learning), Morgan Kaufmann.
29. RAMASWAMY, S., RASTOGI, R., AND SHIM, K. 2000. Efficient algorithms for mining outliers from large datasets. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, 427-438.
30. ROCKE, D. M. AND WOODRUFF, D. L. 1996. Identification of outliers in multivariate data. J. Amer. Statist. Soc. 91, 435, 1047-1061.
31. ROUSSEEUW, P. J. AND LEROY, A. M. 1987. Robust Regression and Outlier Detection. Wiley, New York.
32. RUSKEY, F. 1980. On the average shape of binary trees. SIAM J. Alg. Disc. Meth. 1, 1, 43-50.
33. SCH ÖLKOPF, B., PLATT, J. C., SHAWE-TAYLOR, J. C., SMOLA, A. J., AND WILLIAMSON, R. C. 2001. Estimating the support of a high-dimensional distribution. Neural Comput. 13, 7, 1443-1471. (Pubitemid 33595028)
34. SHI, T. AND HORVATH, S. 2006. Unsupervised learning with random forest predictors. J. Computat. Graph. Stat. 15, 1, 118-138. (Pubitemid 43514414)
35. SING, T., SANDER, O., BEERENWINKEL, N., AND LENGAUER, T. 2005. ROCR: Visualizing classifier performance in r. Bioinformatics 21, 20, 3940-3941. (Pubitemid 41535515)
36. SONG, X., WU, M., JERMAINE, C., AND RANKA, S. 2007. Conditional anomaly detection. IEEE Trans. Knowl. Data Eng. 19, 5, 631-645.
37. TAN, P.-N., STEINBACH, M., AND KUMAR, V. 2005. Introduction to Data Mining. Addison-Wesley.
38. TANG, J., CHEN, Z., FU, A. W.-C., AND CHEUNG, D. W.-L. 2002. Enhancing effectiveness of outlier detections for low density patterns. In Proceedings of the 6th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining (PAKDD). Springer-Verlag, 535-548.
39. TAO, Y., XIAO, X., AND ZHOU, S. 2006. Mining distance-based outliers from large databases in any metric space. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD). ACM, New York, 394-403. (Pubitemid 44535536)
40. TAX, D. M. J. AND DUIN, R. P. W. 2004. Support vector data description. Mach. Learn. 54, 1, 45-66.
41. TUKEY, J. W. 1977. Exploratory Data Analysis. Addison-Wesley.
42. WILLIAMS, G., BAXTER, R., HE, H., HAWKINS, S., AND GU, L. 2002. A comparative study of rnn for outlier detection in data mining. In Proceedings of the IEEE International Conference on Data Mining (ICDM'02). IEEE Computer Society Press, 709-712.
43. WU, M. AND JERMAINE, C. 2006. Outlier detection by sampling with accuracy guarantees. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 767-772. (Pubitemid 44535588)
44. YAMANISHI, K., TAKEUCHI, J.-I.,WILLIAMS, G., AND MILNE, P. 2000. On-line unsupervised outlier detection using finite mixtures with discounting learning algorithms. In Proceedings of the 6th ACMSIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 320-324.
45. YU, X., TANG, L. A., AND HAN, J. 2009. Filtering and refinement: A two-stage approach for efficient and effective anomaly detection. In Proceedings of the 9th IEEE International Conference on Data Mining (ICDM). IEEE Computer Society Press, 617-626.