GPU-accelerated feature selection for outlier detection using the local kernel density ratio

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2012, Pages 51-60

  Azmandian, Fatemeh ^a   Yilmazer, Ayse ^a   Dy, Jennifer G ^a   Aslam, Javed A ^a   Kaeli, David R ^a  

^a NORTHEASTERN UNIVERSITY   (United States)

Author keywords

Feature selection; GPU acceleration; Imbalanced data; Outlier detection

Indexed keywords

EVALUATION CRITERIA; FEATURE SELECTION ALGORITHM; FILTER-BASED; GPU ACCELERATIONS; GPU IMPLEMENTATION; GPU-ACCELERATED; GRAPHICS PROCESSING UNIT; IMBALANCED DATA; IMBALANCED DATA-SETS; INHERENT CHARACTERISTICS; LOCAL KERNEL; NON-PARAMETRIC; NUMBER OF DATUM; OUTLIER DETECTION; OUTLIER DETECTION ALGORITHM; REAL DATA SETS; SMALL SAMPLES; STATE-OF-THE-ART METHODS;

ALGORITHMS; COMPUTER GRAPHICS; COMPUTER GRAPHICS EQUIPMENT; FEATURE EXTRACTION; PROGRAM PROCESSORS; STATISTICS;

DATA MINING;

EID: 84874042969     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2012.51     Document Type: Conference Paper

References (32)

1. K. Kira and L. A. Rendell, "A practical approach to feature selection," in International Conference on Machine Learning (ICML), 1992, pp. 249-256.
2. H. Liu and H. Motoda, Feature Selection for Knowledge Discovery and Data Mining. Kluwer Academic Publishers, 1998.
3. R. Kohavi and G. H. John, "Wrappers for feature subset selection," Artificial Intelligence, vol. 97, no. 1-2, pp. 273-324, 1997.
4. M. Dash and H. Liu, "Feature selection for classification," Intelligent Data Analysis, vol. 1, pp. 131-156, 1997.
5. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection," Journal of Machine Learning Research, vol. 3, pp. 1157-1182, 2003.
6. R. Tibshirani, "Regression shrinkage and selection via the lasso," Journal of the Royal Statistical Society, Series B, vol. 58, pp. 267-288, 1994.
7. L. Song, J. Bedo, K. M. Borgwardt, A. Gretton, and A. Smola, "Gene selection via the BAHSIC family of algorithms," Bioinformatics, vol. 23, pp. 490-498, 2007.
8. X.-W. Chen and M. Wasikowski, "FAST: A ROC-based feature selection metric for small samples and imbalanced data classification problems," in KDD, 2008, pp. 124-132.
9. C. Aggarwal and S. Yu, "An effective and efficient algorithm for high-dimensional outlier detection," The VLDB Journal, vol. 14, pp. 211-221, 2005.
10. H. V. Nguyen and V. Gopalkrishnan, "Feature extraction for outlier detection in high-dimensional spaces," Journal of Machine Learning Research, vol. 10, pp. 66-75, 2010.
11. S. Hido, Y. Tsuboi, H. Kashima, M. Sugiyama, and T. Kanamori, "Statistical outlier detection using direct density ratio estimation," Knowledge and Information Systems, vol. 26, no. 2, pp. 309-336, 2011.
12. M. Sugiyama, M. Yamada, P. von Bünau, T. Suzuki, T. Kanamori, and M. Kawanabe, "Direct density-ratio estimation with dimensionality reduction via least-squares hetero-distributional subspace search," Neural Networks, vol. 24, no. 2, pp. 183-198, 2011.
13. A. Smola, L. Song, and C. H. Teo, "Relative Novelty Detection," in Artificial Intelligence and Statistics (AISTATS), JMLR W&CP 5, 2009.
14. D. M. Hawkins, Identification of outliers. Chapman and Hall, London; New York, 1980.
15. M. M. Breunig, H. P. Kriegel, R. T. Ng, and J. Sander, "LOF: Identifying density-based local outliers," ACM SIGMOD Record, vol. 29, no. 2, pp. 93-104, 2000.
16. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge University Press, Cambridge; New York, 1985.
17. M.-F. Balcan and A. Blum, "On a theory of learning with similarity functions," in International Conference on Machine Learning (ICML), 2006, pp. 73-80.
18. E. Parzen, "On Estimation of a Probability Density Function and Mode," The Annals of Mathematical Statistics, vol. 33, no. 3, pp. 1065-1076, 1962.
19. M. Rosenblatt, "Remarks on Some Nonparametric Estimates of a Density Function," The Annals of Mathematical Statistics, vol. 27, no. 3, pp. 832-837, 1956.
20. P. A. Devijver and J. Kittler, Pattern recognition: A statistical approach. Prentice Hall, 1982.
21. M. Masaeli, G. Fung, and J. G. Dy, "From transformation-based dimensionality reduction to feature selection," in International Conference on Machine Learning (ICML), 2010, pp. 751-758.
22. Q. Lv, W. Josephson, Z. Wang, M. Charikar, and K. Li, "Multi-probe LSH: efficient indexing for high-dimensional similarity search," in Proceedings of the 33rd International Conference on Very Large Data Bases, ser. VLDB '07, 2007, pp. 950-961.
23. S. Arya, D. M. Mount, N. S. Netanyahu, R. Silverman, and A. Y. Wu, "An optimal algorithm for approximate nearest neighbor searching fixed dimensions," J. ACM, vol. 45, no. 6, pp. 891-923, Nov. 1998.
24. V. Garcia, E. Debreuve, and M. Barlaud, "Fast k nearest neighbor search using gpu," in CVPR Workshop on Computer Vision on GPU, Anchorage, Alaska, USA, June 2008.
25. H. A. Güvenir, B. Acar, G. Demiröz, and A. Çekin, "A supervised machine learning algorithm for arrhythmia analysis," in Computers in Cardiology Conference, 1998, pp. 433-436.
26. A. Frank and A. Asuncion, "UCI machine learning repository," 2010. [Online]. Available: http://archive.ics.uci.edu/ml
27. T. Fawcett, "An introduction to ROC analysis," Pattern Recognition Letters, vol. 27, no. 8, pp. 861-874, 2006.
28. L. M. Manevitz, M. Yousef, N. Cristianini, J. Shawe-Taylor, and B. Williamson, "One-class svms for document classification," Journal of Machine Learning Research, vol. 2, pp. 139-154, 2001.
29. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," ACM Transactions on Intelligent Systems and Technology, vol. 2, pp. 1-27, 2011.
30. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, "The WEKA data mining software: an update," SIGKDD Explorations Newsletter, vol. 11, pp. 10-18, 2009.
31. J. H. Friedman, T. Hastie, and R. Tibshirani, "Regularization paths for generalized linear models via coordinate descent," Journal of Statistical Software, vol. 33, no. 1, pp. 1-22, 2010.
32. F. Azmandian, "Learning at the Virtualization Layer: Intrusion Detection and Workload Characterization from within the Virtual Machine Monitor," Ph.D. dissertation, Northeastern University, August 2012.