Local kernel density ratio-based feature selection for outlier detection

Journal of Machine Learning Research

Volumn 25, Issue , 2012, Pages 49-64

  Azmandian, Fatemeh ^a   Dy, Jennifer G ^a   Aslam, Javed A ^a   Kaeli, David R ^a  

^a NORTHEASTERN UNIVERSITY   (United States)

Author keywords

Anomaly detection; Feature selection; Imbalanced data; Outlier detection

Indexed keywords

ANOMALY DETECTION; FEATURE SELECTION ALGORITHM; IMBALANCED DATA; IMBALANCED DATA-SETS; INHERENT CHARACTERISTICS; OUTLIER DETECTION; OUTLIER DETECTION ALGORITHM; STATE-OF-THE-ART METHODS;

ALGORITHMS; FEATURE EXTRACTION; LEARNING SYSTEMS;

STATISTICS;

EID: 84876830345     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (30)

1. C. Aggarwal and S. Yu. An effective and efficient algorithm for high-dimensional outlier detection. The VLDB Journal, 14:211-221, 2005.
2. F. Azmandian. Learning at the Virtualization Layer: Intrusion Detection and Workload Characterization from within the Virtual Machine Monitor. PhD thesis, Northeastern University, August 2012.
3. M.-F. Balcan and A. Blum. On a theory of learning with similarity functions. In International Conference on Machine Learning (ICML), pages 73-80, 2006.
4. M. M. Breunig, H. P. Kriegel, R. T. Ng, and J. Sander. LOF: Identifying density-based local outliers. ACM SIGMOD Record, 29(2):93-104, 2000.
5. C.-C. Chang and C.-J. Lin. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2:1-27, 2011.
6. X.-W. Chen and M. Wasikowski. FAST: A ROC-based feature selection metric for small samples and imbalanced data classification problems. In KDD, pages 124-132, 2008.
7. M. Dash and H. Liu. Feature selection for classification. Intelligent Data Analysis, 1: 131-156, 1997.
8. P. A. Devijver and J. Kittler. Pattern recognition: A statistical approach. Prentice Hall, 1982.
9. J. H. Friedman, T. Hastie, and R. Tibshirani. Regularization paths for generalized linear models via coordinate descent. Journal of Statistical Software, 33(1):1-22, 2010.
10. K. Fukumizu, F. R. Bach, and M. I. Jordan. Dimensionality reduction for supervised learning with reproducing kernel hilbert spaces. JMLR, 5:73-99, 2004.
11. V. Garcia, E. Debreuve, and M. Barlaud. Fast k nearest neighbor search using gpu. In CVPR Workshop on Computer Vision on GPU, Anchorage, Alaska, USA, June 2008.
12. H. A. Güvenir, B. Acar, G. Demiröz, and A. Çekin. A supervised machine learning algorithm for arrhythmia analysis. In Computers in Cardiology Conference, pages 433-436, 1998.
13. I. Guyon and A. Elisseeff. An introduction to variable and feature selection. Journal of Machine Learning Research, 3:1157-1182, 2003.
14. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten. The WEKA data mining software: an update. SIGKDD Explorations Newsletter, 11:10-18, 2009.
15. D. M. Hawkins. Identification of outliers. Chapman and Hall, London; New York, 1980.
16. S. Hido, Y. Tsuboi, H. Kashima, M. Sugiyama, and T. Kanamori. Statistical outlier detection using direct density ratio estimation. Knowledge and Information Systems, 26(2): 309-336, 2011.
17. R. A. Horn and C. R. Johnson. Matrix Analysis. Cambridge University Press, Cambridge; New York, 1985.
18. K. Kira and L. A. Rendell. A practical approach to feature selection. In International Conference on Machine Learning (ICML), pages 249-256, 1992.
19. R. Kohavi and G. H. John. Wrappers for feature subset selection. Artificial Intelligence, 97 (1-2):273-324, 1997.
20. H. Liu and H. Motoda. Feature Selection for Knowledge Discovery and Data Mining. Kluwer Academic Publishers, 1998.
21. L. M. Manevitz, M. Yousef, N. Cristianini, J. Shawe-Taylor, and B. Williamson. One-class svms for document classification. Journal of Machine Learning Research, 2:139-154, 2001.
22. M. Masaeli, G. Fung, and J. G. Dy. From transformation-based dimensionality reduction to feature selection. In ICML '10, pages 751-758, 2010.
23. H. V. Nguyen and V. Gopalkrishnan. Feature extraction for outlier detection in high dimensional spaces. Journal of Machine Learning Research, 10:66-75, 2010.
24. E. Parzen. On Estimation of a Probability Density Function and Mode. The Annals of Mathematical Statistics, 33(3):1065-1076, 1962.
25. M. Rosenblatt. Remarks on Some Nonparametric Estimates of a Density Function. The Annals of Mathematical Statistics, 27(3):832-837, 1956.
26. B. Schölkopf, A. Smola, and K.-R. Müller. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10:1299-1319, 1998.
27. A. Smola, L. Song, and C. H. Teo. Relative Novelty Detection. In Artificial Intelligence and Statistics (AISTATS), JMLR W&CP 5, 2009.
28. L. Song, J. Bedo, K. M. Borgwardt, A. Gretton, and A. Smola. Gene selection via the BAHSIC family of algorithms. Bioinformatics, 23:490-498, 2007.
29. M. Sugiyama, M. Yamada, P. von Bunau, T. Suzuki, T. Kanamori, and M. Kawanabe. Direct density-ratio estimation with dimensionality reduction via least-squares heterodistributional subspace search. Neural Networks, 24(2):183-198, 2011.
30. R. Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B, 58:267-288, 1994.