An efficient approach for outlier detection with imperfect data labels

IEEE Transactions on Knowledge and Data Engineering

Volumn 26, Issue 7, 2014, Pages 1602-1616

  Liu, Bo ^a   Xiao, Yanshan ^a   Yu, Philip S ^b,c   Hao, Zhifeng ^a   Cao, Longbing ^d  

^a GUANGDONG UNIVERSITY OF TECHNOLOGY   (China)

^b 1120 Science and Engineering Offices   (United States)

^c KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

^d UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

data of uncertainty; Outlier detection

Indexed keywords

COMPUTATIONAL METHODS; INFORMATION SYSTEMS;

DATA OF UNCERTAINTY; DATA WITH IMPERFECT LABELS; DEGREE OF MEMBERSHIP; LEARNING FRAMEWORKS; NEGATIVE EXAMPLES; OUTLIER DETECTION; REAL LIFE DATASETS; TRAINING DATASET;

STATISTICS;

EID: 84904431080     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2013.108     Document Type: Article

References (50)

1. V. Chandola, A. Banerjee, and V. Kumar, "Anomaly detection: A survey, " ACM CSUR, vol. 41, no. 3, Article 15, 2009.
2. V. J. Hodge and J. Austin, "A survey of outlier detection methodologies, " Artif. Intell. Rev., vol. 22, no. 3, pp. 85-126, 2004.
3. D. M. Hawkins, Identification of Outliers. Chapman and Hall, Springer, 1980.
4. V. Chandola, A. Banerjee, and V. Kumar, "Anomaly detection for discrete sequences: A survey, " IEEE Trans. Knowl. Data Eng., vol. 24, no. 5, pp. 823-839, May 2012.
5. V. Barnett and T. Lewis, Outliers in Statistical Data. Chichester, U.K.: Wiley, 1994.
6. M. M. Breunig, H. P. Kriegel, R. T. Ng, and J. Sander, "LOF: Identifying density-based local outliers, " in Proc. ACM SIGMOD Int. Conf. Manage. Data, New York, NY, USA, 2000, pp. 93-104.
7. S. Y. Jiang and Q. B. An, "Clustering-based outlier detection method, " in Proc. ICFSKD, Shandong, China, 2008, pp. 429-433.
8. C. Li and W. H. Wong, "Model-based analysis of oligonucleotide arrays: Expression index computation and outlier detection, " in Proc. Natl. Acad. Sci. USA, 2001, pp. 31-36. (Pubitemid 32095858)
9. D. M. J. Tax and R. P. W. Duin, "Support vector data description, " Mach. Learn., vol. 54, no. 1, pp. 45-66, 2004.
10. D. M. J. Tax, A. Ypma, and R. P. W. Duin, "Support vector data description applied to machine vibration analysis, " in Proc. ASCI, 1999, pp. 398-405.
11. C. C. Aggarwal and P. S. Yu, "A survey of uncertain data algorithms and applications, " IEEE Trans. Knowl. Data Eng., vol. 21, no. 5, pp. 609-623, May 2009.
12. L. Chen and C. Wang, "Continuous subgraph pattern search over certain and uncertain graph streams, " IEEE Trans. Knowl. Data Eng., vol. 22, no. 8, pp. 1093-1109, Aug. 2010.
13. A. Boukerche, R. B. Machado, K. R. L Juca, J. B. M. Sobral, and M. S. M. A. Notare, "An agent based and biological inspired real-time intrusion detection and security model for computer network operations, " Comput. Commun., vol. 30, no. 16, pp. 49-60, 2007.
14. A. O. Tarakanov, "Immunocomputing for intelligent intrusion detection, " IEEE Comput. Intell. Mag., vol. 3, no. 2, pp. 22-30, May 2008.
15. Y. J. Lee, Y. R. Yeh, and Y. C. F. Wang, "Anomaly detection via online over-sampling principal component analysis, " IEEE Trans. Knowl. Data Eng., vol. 25, no. 7, pp. 1460-1470, May 2012.
16. E. Eskin, "Anomaly detection over noisy data using learned probability distributions, " in Proc. ICML, San Francisco, CA, USA, 2000, pp. 255-262.
17. F. Chen, C. T. Lu, and A. P. Boedihardjo, "GLS-SOD: A generalized local statistical approach for spatial outlier detection, " in Proc. ACM SIGKDD Int. Conf. KDD, New York, NY, USA, 2010, pp. 1069-1078.
18. S. Hido, Y. Tsuboi, H. Kashima, M. Sugiyama, and T. Kanamori, "Statistical outlier detection using direct density ratio estimation, " Knowl. Inform. Syst., vol. 26, no. 2, pp. 309-336, 2011.
19. R. Smith, A. Bivens, M. Embrechts, C. Palagiri, and B. Szymanski, "Clustering approaches for anomaly based intrusion detection, " in Proc. Intell. Eng. Syst. Artif. Neural Netw., 2002, pp. 579-584.
20. Y. Shi and L. Zhang, "COID: A cluster-outlier iterative detection approach to multi-dimensional data analysis, " Knowl. Inform. Syst., vol. 28, no. 3, pp. 709-733, 2011.
21. A. Ghoting, S. Parthasarathy, and M. E. Otey, "Fast mining of distance-based outliers in high-dimensional datasets, " Data Min. Knowl. Discov., vol. 16, no. 3, pp. 349-364, 2008.
22. A. Ghoting, S. Parthasarathy, and M. Otey, "Fast mining of distance-based outliers in high-dimensional datasets, " Data Min. Knowl. Discov., vol. 16, no. 3, pp. 349-364, 2008.
23. F. Angiulli and F. Fassetti, "Dolphin: An efficient algorithm for mining distance-based outliers in very large datasets, " ACM Trans. Knowl. Discov. Data, vol. 3, no. 4, pp. 1-57, 2009.
24. V. Niennattrakul, E. J. Keogh, and C. A. Ratanamahatana, "Data editing techniques to allow the application of distance-based outlier detection to streams, " in Proc. IEEE ICDM, Sydney, NSW, USA, 2010, pp. 947-952.
25. K. Bhaduri, B. L. Matthews, and C. Giannella, "Algorithms for speeding up distance-based outlier detection, " in Proc. ACM SIGKDD Int. Conf. KDD, New York, NY, USA, 2011, pp. 859-867.
26. E. M. Jordaan and G. F. Smits, "Robust outlier detection using SVM regression, " in Proc. IJCNN, 2004, pp. 1098-1105.
27. N. Abe, B. Zadrozny, and J. Langford, "Outlier detection by active learning, " in Proc. ACM SIGKDD Int. Conf. KDD, New York, NY, USA, 2006, pp. 504-509. (Pubitemid 44535546)
28. I. Steinwart, D. Hush, and C. Scovel, "A classification framework for anomaly detection, " J. Mach. Learn. Res., vol. 6, pp. 211-232, Dec. 2005.
29. J. Theller and D.M. Cai, "Resampling approach for anomaly detection in multispectral images, " in Proc. SPIE, Orlando, FL, USA, 2003, pp. 230-240.
30. D. Tax and R. Duin, "Outlier detection using classifier instability, " in Proc. Adv. Pattern Recognit., London, U.K., 1998, pp. 593-601, LNCS. (Pubitemid 128117161)
31. B. Liu, Y. Xiao, L. Cao, Z. Hao, and F. Deng, "Svdd-based outlier detection on uncertain data, " Knowl. Inform. Syst., vol. 34, no. 3, pp. 597-618, 2013.
32. C. Elkan, "The foundations of cost-sensitive learning, " in Proc. IJCAI, San Francisco, CA, USA, 2001, pp. 973-978.
33. N. V. Chawla, N. Japkowicz, and A. Kotcz, "Editorial: Special issue on learning from imbalanced data sets, " SIGKDD Explorations, vol. 6, no. 1, pp. 1-6, 2004.
34. M. V. Joshi and V. Kumar, "CREDOS: Classification using ripple down structure (a case for rare classes), " in Proc. SIAM Conf. Data Min., 2004.
35. P. Chan and S. Stolfo, "Toward scalable learning with nonuniform class and cost distributions, " in Proc. ACM SIGKDD Int. Conf. KDD, 1998, pp. 164-168.
36. G. Nakhaeizadeh, U. Knoll, and B. Tausend, "Cost-sensitive pruning of decision trees, " in Proc. ECML, Catania, Italy, 1994, pp. 383-386.
37. G. Fumera and F. Roli, "Cost-sensitive learning in support vector machines, " in Proc. Workshop Mach. Learn. Meth. Appl., 2002.
38. Y. Lin, Y. Lee, and G. Wahba, "Support vector machine for classification in nonstandard situations, " Mach. Learn., vol. 46, no. 1-3, pp. 191-202, 2002. (Pubitemid 34129968)
39. R. Akbani, S. Kwek, and N. Japkowicz, "Applying support vector machines to imbalanced datasets, " in Proc. ECML, Pisa, Italy, 2004, pp. 39-50. (Pubitemid 41050079)
40. B. X. Wang and N. Japkowicz, "Boosting support vector machines for imbalanced data sets, " Knowl. Inform. Syst., vol. 25, no. 1, pp. 1-20, 2010.
41. C. X. Ling, J. Huang, and H. Zhang, "AUC: A statistically consistent and more discriminating measure than accuracy, " in Proc. IJCAI, San Francisco, CA, USA, 2003, pp. 519-526.
42. V. Vapnik, Statistical Learning Theory. London, U.K.: Springer-Verlag, 1998.
43. A. Lazarevic and V. Kumar, "Feature bagging for outlier detection, " in Proc. ACM SIGKDD Int. Conf. KDD, New York, NY, USA, 2005, pp. 157-166. (Pubitemid 43218277)
44. M. Wu and J. Ye, "A small sphere and large margin approach for novelty detection using training data with outliers, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 11, pp. 2088-2092, Nov. 2009.
45. UCI Machine Learning Repository [Online]. Available: http://archive.ics. uci.edu/ml/datasets.html
46. D. M. J. Tax. Outlier Detection Datasets [Online]. Available: http://homepage.tudelft.nl/n9d04/occ/index.html
47. Y. Batistakis, M. Halkidi, and M. Vazirgiannis, "Cluster validity methods: Part i, " in Proc. ACM SIGMOD Rec., vol. 31. New York, NY, USA, pp. 40-45, 2002.
48. C. C. Aggarwal and P. S. Yu, "Outlier detection with uncertain data, " in Proc. SIAM Conf. Data Min., 2008, pp. 483-493.
49. T. Yang, M. Mahdavi, R. Jin, L. Zhang, and Y. Zhou, "Multiple kernel learning from noisy labels by stochastic programming, " in Proc. 29th ICML, Edinburgh, U.K., 2012.
50. W. Li and D. Yeung, "MILD: Multiple-instance learning via disambiguation, " IEEE Trans. Knowl. Data Eng., vol. 22, no. 1, pp. 76-89, Jan. 2010.