A decomposition of the outlier detection problem into a set of supervised learning problems

Machine Learning

Volumn 100, Issue 2-3, 2015, Pages 509-531

  Paulheim, Heiko ^a   Meusel, Robert ^a  

^a UNIVERSITY OF MANNHEIM   (Germany)

Author keywords

Machine learning; Outlier detection; Outlier explanations

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLUSTERING ALGORITHMS; DATA HANDLING; DATA MINING; LEARNING SYSTEMS;

EMPIRICAL EVALUATIONS; HIGH DIMENSIONAL DATA; INDIVIDUAL LEARNING; OUTLIER DETECTION; OUTLIER EXPLANATIONS; PREDICTIVE MODELING; SUPERVISED LEARNING PROBLEMS; SYMBOLIC MACHINE LEARNING;

STATISTICS;

EID: 84939270771     PISSN: 08856125     EISSN: 15730565     Source Type: Journal    
DOI: 10.1007/s10994-015-5507-y     Document Type: Article

References (38)

1. Abe, N., Zadrozny, B., & Langford, J. (2006). Outlier detection by active learning. In Proceedings of the 12th ACM SIGKDD international conference on knowledge discovery and data mining (pp. 504–509). ACM.
2. Achtert, E., Kriegel, H. P., & Zimek, A. (2008). ELKI: A software system for evaluation of subspace clustering algorithms. In Scientific and statistical database management. Lecture notes in computer science (Vol. 5069, pp. 580–585). Berlin, Heidelberg: Springer. doi:10.1007/978-3-540-69497-7_41.
3. Aggarwal, C. C. (2013). Outlier analysis. Berlin: Springer.
4. Aggarwal, C. C., Hinneburg, A., & Keim, D. A. (2001). On the surprising behavior of distance metrics in high dimensional space. In J. Van den Bussche & V. Vianu (Eds.), Database theory—ICDT 2001. Lecture notes in computer science (Vol. 1973, pp. 420–434). Berlin, Heidelberg: Springer.
5. Aggarwal, C. C., & Yu, P. S. (2001). Outlier detection for high dimensional data. SIGMOD Record, 30(2), 37–46. doi:10.1145/376284.375668.
6. Aho, T., Zenko, B., & Dzeroski, S. (2009). Rule ensembles for multi-target regression. In ICDM (pp. 21–30).
7. Amer, M., & Goldstein, M. (2012). Nearest-neighbor and clustering based anomaly detection algorithms for rapidminer. In Proceedings of the 3rd RapidMiner community meeting and conference (RCOMM 2012) (pp. 1–12).
8. Amer, M., Goldstein, M., & Abdennadher, S. (2013). Enhancing one-class support vector machines for unsupervised anomaly detection. In Proceedings of the ACM SIGKDD workshop on outlier detection and description (ODD) (pp. 8–15).
9. Angiulli, F., & Pizzuti, C. (2002). Fast outlier detection in high dimensional spaces. In T. Elomaa, H. Mannila, & H. Toivonen (Eds.), Principles of data mining and knowledge discovery (Vol. 2431, pp. 15–27). Berlin, Heidelberg: Springer. doi:10.1007/3-540-45681-3_2.
10. Barlow, R. E., Bartholomew, D. J., Bremner, J., & Brunk, H. D. (1972). Statistical inference under order restrictions: The theory and application of isotonic regression. New York: Wiley.
11. Barnett, V., & Lewis, T. (1994). Outliers in statistical data. New York: Wiley.
12. Breunig, M. M., Kriegel, H. P., Ng, R. T., & Sander, J. (2000). Lof: Identifying density-based local outliers. ACM Sigmod Record, 29(2), 93–104.
13. Chandola, V., Banerjee, A., & Kumar, V. (2009). Anomaly detection: A survey. ACM Computing Surveys (CSUR), 41(3), 15.
14. Demšar, J. (2006). Statistical comparisons of classifiers over multiple data sets. The Journal of Machine Learning Research, 7, 1–30.
15. Elahi, M., Li, K., Nisar, W., Lv, X., & Wang, H. (2008). Efficient clustering-based outlier detection algorithm for dynamic data stream. In Fifth international conference on fuzzy systems and knowledge discovery, FSKD ’08 (Vol. 5, pp. 298–304). doi:10.1109/FSKD.2008.374.
16. Emmott, A. F., Das, S., Dietterich, T., Fern, A., & Wong, W. K. (2013). Systematic construction of anomaly detection benchmarks from real data. In ACM SIGKDD workshop on outlier detection and description (pp. 16–21).
17. Goldstein, M. (2014). Anomaly detection. In M. Hofmann & R. Klinkenberg (Eds.), RapidMiner—Data mining use cases and business analytics applications (pp. 409–436). CRC Press.
18. Hawkins, S., He, H., Williams, G., & Baxter, R. (2002). Outlier detection using replicator neural networks. In Y. Kambayashi, W. Winiwarter, & M. Arikawa (Eds.), Data warehousing and knowledge discovery. Lecture notes in computer science (pp. 170–180). Berlin, Heidelberg: Springer. doi:10.1007/3-540-46145-0_17.
19. He, Z., Xu, X., & Deng, S. (2003). Discovering cluster-based local outliers. Pattern Recognition Letters, 24(9), 1641–1650.
20. He, Z., Xu, X., Huang, Z. J., & Deng, S. (2005). Fp-outlier: Frequent pattern based outlier detection. Computer Science and Information Systems/ComSIS, 2(1), 103–118.
21. Hodge, V. J., & Austin, J. (2004). A survey of outlier detection methodologies. Artificial Intelligence Review, 22(2), 85–126.
22. Knorr, E. M., & Ng, R. T. (1999). Finding intensional knowledge of distance-based outliers. In Proceedings of the 25th international conference on very large data bases, VLDB ’99 (Vol. 99, pp. 211–222). San Francisco, CA: Morgan Kaufmann Publishers Inc.
23. Kriegel, H. P., Kröger, P., Schubert, E., & Zimek, A. (2009). Loop: Local outlier probabilities. In Proceedings of the 18th ACM conference on information and knowledge management (pp. 1649–1652). ACM.
24. Kriegel, H. P., Kröger, P., Schubert, E., & Zimek, A. (2012). Outlier detection in arbitrarily oriented subspaces. In 2012 IEEE 12th international conference on data mining, ICDM ’12 (pp. 379–388). IEEE.
25. Liu, F. T., Ting, K. M., & Zhou, Z. H. (2012). Isolation-based anomaly detection. ACM Transactions on Knowledge Discovery from Data (TKDD), 6(1), 3.
26. Mejía-Lavalle, M., & Sánchez Vivar, A. (2009). Outlier detection with explanation facility. In Machine learning and data mining in pattern recognition. Lecture notes in computer science (Vol. 5632, pp. 454–464). Berlin, Heidelberg: Springer. doi:10.1007/978-3-642-03070-3_34.
27. Müller, E., Schiffer, M., Gerwert, P., Hannen, M., Jansen, T., & Seidl, T. (2010). Sorex: Subspace outlier ranking exploration toolkit. In J. Balcázar, F. Bonchi, A. Gionis, & M. Sebag (Eds.), Machine learning and knowledge discovery in databases. Lecture notes in computer science (pp. 607–610). Berlin, Heidelberg: Springer. doi:10.1007/978-3-642-15939-8_44.
28. Nemenyi, P. (1962). Distribution-free multiple comparisons. Biometrics, 18(2), 263.
29. Padmanabhan, B., & Tuzhilin, A. (2000). Small is beautiful: Discovering the minimal set of unexpected patterns. In Proceedings of the sixth ACM SIGKDD international conference on knowledge discovery and data mining (pp. 54–63). ACM.
30. Pelleg, D., Moore, A. W. (2000). X-means: Extending K-means with efficient estimation of the number of clusters. In Proceedings of the seventeenth international conference on machine learning, ICML ’00 (pp. 727–734). San Francisco, CA: Morgan Kaufmann Publishers Inc.
31. Pokrajac, D., Lazarevic, A., & Latecki, L. J. (2007). Incremental local outlier detection for data streams. In IEEE symposium on computational intelligence and data mining, CIDM ’07 (pp. 504–515). IEEE.
32. Quinlan, J. R., et al. (1992). Learning with continuous classes. In Proceedings of the 5th Australian joint conference on artificial intelligence (Vol. 92, pp. 343–348).
33. Skillings, J. H., & Mack, G. A. (1981). On the use of a friedman-type statistic in balanced and unbalanced block designs. Technometrics, 23(2), 171–177.
34. Teng, C. M. (1999). Correcting noisy data. In Proceedings of the sixteenth international conference on machine learning, ICML ’99 (pp. 239–248). San Francisco, CA: Morgan Kaufmann Publishers Inc.
35. Wagstaff, K. L., Lanza, N. L., Thompson, D. R., Dietterich, T. G., & Gilmore, M. S. (2013). Guiding scientific discovery with explanations using demud. In AAAI conference on artificial intelligence. http://www.aaai.org/ocs/index.php/AAAI/AAAI13/paper/view/6171.
36. Xu, L., Crammer, K., & Schuurmans, D. (2006). Robust support vector machine training via convex outlier ablation. In Proceedings of the 21st national conference on artificial intelligence, AAAI ’06 (Vol. 1, pp. 536–542). Boston, MA: AAAI Press. http://dl.acm.org/citation.cfm?id=1597538.1597625.
37. Yamanishi, K., & Takeuchi, J.i. (2001). Discovering outlier filtering rules from unlabeled data: Combining a supervised learner with an unsupervised learner. In 7th ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 389–394). ACM.
38. Zimek, A., Gaudet, M., Campello, R. J., & Sander, J. (2013). Subsampling for efficient and effective unsupervised outlier detection ensembles. In 19th ACM SIGKDD international conference on knowledge discovery and data mining (pp. 428–436). ACM.