Locality sensitive outlier detection: A ranking driven approach

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2011, Pages 410-421

  Wang, Ye ^a   Parthasarathy, Srinivasan ^a   Tatikonda, Shirish ^a  

^a OHIO STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA SETS; DISTANCE-BASED; EMPIRICAL STUDIES; GEOMETRIC APPROACHES; LARGE HIGH-DIMENSIONAL DATA; LIGHT WEIGHT; LOCALITY SENSITIVE HASHING; OUTLIER DETECTION; OUTLIER DISCOVERY; THEORETICAL ARGUMENTS;

CLUSTERING ALGORITHMS; DATA MINING;

STATISTICS;

EID: 79957849567     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2011.5767852     Document Type: Conference Paper

References (47)

1. H. Liu, S. Shah, and W. Jiang, "On-line outlier detection and data cleaning," Computers & Chemical Engineering, vol. 28, no. 9, pp. 1635- 1647, 2004. (Pubitemid 38638287)
2. R. Bolton and D. Hand, "Unsupervised profiling methods for fraud detection," Credit Scoring and Credit Control VII, 1999.
3. Z. He, X. Xu, J. Huang, and S. Deng, "Mining class outliers: concepts, algorithms and applications in CRM," Expert Systems with applications, vol. 27, no. 4, pp. 681-697, 2004.
4. A. Lazarevic, L. Ertoz, V. Kumar, A. Ozgur, and J. Srivastava, "A comparative study of anomaly detection schemes in network intrusion detection," Proc. of the Third SIAM International Conference on Data Mining, pp. 25-36, 2003.
5. K. Penny and I. Jolliffe, "A comparison of multivariate outlier detection methods for clinical laboratory safety data," Journal of the Royal Statistical Society: Series D, vol. 50, no. 3, pp. 295-307, 2001.
6. M. Rubin and A. Chinnaiyan, "Bioinformatics approach leads to the discovery of the TMPRSS2: ETS gene fusion in prostate cancer," Laboratory Investigation, vol. 86, no. 11, pp. 1099-1102, 2006. (Pubitemid 44624146)
7. G. Abecasis, S. Cherny, W. Cookson, and L. Cardon, "GRR: graphical representation of relationship errors," Bioinformatics, vol. 17, no. 8, pp. 742-743, 2001. (Pubitemid 32851384)
8. V. Barnett and T. Lewis, Outliers in Statistical Data, thrid ed. Wiley, 1994.
9. J. Tukey, Exploratory data analysis. Addison-Wesley, 1977.
10. H. Kriegel, P. Kroger, and A. Zimek, "Outlier Detection Techniques," Tutorial at the 13th Pacific-Asia Conference on Knowledge Discovery and Data Mining, 2009.
11. M. M. Breunig, H.-P. Kriegel, R. T. Ng, and J. Sander, "LOF: Identifying density-based local outliers," Proc. of SIGMOD Conf. on Management of Data, pp. 93-104, 2000.
12. S. Papadimitriou, H. Kitagawa, P. Gibbons, and C. Faloutsos, "LOCI: Fast outlier detection using the local correlation integral," Proc. of the 19th Int. Conf. on Data Engineering, pp. 315-326, 2003.
13. E. M. Knorr and R. T. Ng, "Finding intensional knowledge of distancebased outliers," Proc. of the 25th Int. Conf. on Very Large Data Bases, pp. 211-222, 1999.
14. F. Angiulli and C. Pizzuti, "Fast outlier detection in high dimensional spaces," Lecture notes in computer science, pp. 15-26, 2002.
15. S. Bay and M. Schwabacher, "Mining Distance-based Outliers in Near Linear Time with Randomization and a Simple Pruning Rule," Proc. 9th Int'l Conf. on Knowledge Discovery and Data Mining, pp. 29-38, 2003.
16. A. Ghoting, S. Parthasarathy, and M. Otey, "Fast Mining of Distancebased Outliers in High-dimensional Datasets," Data Mining and Knowl- edge Discovery, vol. 16, no. 3, pp. 349-364, 2008.
17. F. Angiulli and F. Fassetti, "Very efficient mining of distance-based outliers," Proc. of the sixteenth ACM conference on Conference on information and knowledge management, pp. 791-800, 2007.
18. A. Chaudhary, A. Szalay, and A. Moore, "Very fast outlier detection in large multidimensional data sets," Proc. of ACM SIGMOD Workshop in Research Issues in Data Mining and Knowledge Discovery, 2002.
19. T. Zhang, R. Ramakrishnan, and M. Livny, "BIRCH: an efficient data clustering method for very large databases," SIGMOD Rec., vol. 25, no. 2, pp. 103-114, 1996. (Pubitemid 126440760)
20. P. Indyk and R. Motwani, "Approximate Nearest Neighbors: Towards Removing the Curse of Dimensionality," Proc. 13th Annual ACM Symposium on Theory of Computing, pp. 604-613, 1998.
21. S. Ramaswamy, R. Rastogi, and K. Shim, "Efficient algorithms for mining outliers from large data sets," ACM SIGMOD Record, vol. 29, no. 2, pp. 427-438, 2000.
22. C. Teixeira, G. Orair, W. M. Jr., and S. Parthasarathy, "An efficient algorithm for outlier detection in high dimensional real databases," Universidade Federal de Minas Gerais, Belo Horizonte, MG, Brazil, Tech. Rep., 2008.
23. M. Datar, N. Immorlica, P. Indyk, and V. Mirrokni, "Locality- sensitive hashing scheme based on p-stable distributions," Proc. of the twentieth annual symposium on Computational geometry, pp. 253-262, 2004.
24. D. Hawkins, Identification of outliers. Chapman and Hall London, 1980.
25. V. Barnett, T. Lewis, and F. Abeles, "Outliers in statistical data," Physics Today, vol. 32, p. 73, 1979.
26. P. Rousseeuw and A. Leroy, Robust regression and outlier detection. John Wiley & Sons Inc, 1987.
27. R. T. Ng and J. Han, "Efficient and effective clustering methods for spatial data mining," 20th Int. Conf. on Very Large Data Bases, 1994, pp. 144-155, 1994.
28. S. Guha, R. Rastogi, and K. Shim, "Rock: A robust clustering algorithm for categorical attributes* 1," Information Systems, vol. 25, no. 5, pp. 345-366, 2000.
29. Z. He, X. Xu, and S. Deng, "Discovering cluster-based local outliers," Pattern Recognition Letters, vol. 24, no. 9-10, pp. 1641-1650, 2003.
30. Y. Tao, X. Xiao, and S. Zhou, "Mining distance-based outliers from large databases in any metric space," Proc. of the 12th international conference on Knowledge discovery and data mining, p. 403, 2006.
31. E. Knorr, R. Ng, and V. Tucakov, "Distance-based outliers: algorithms and applications," The VLDB Journal, vol. 8, no. 3, pp. 237-253, 2000.
32. W. M. J. Gustavo H.Orair, Carlos H., C. Teixeira and S. Parthasarathy, "Exploring the Design Space of Scalable Distance-Based Outlier Algorithms," technical report, 2009.
33. N. H. Vu and V. Gopalkrishnan, "Efficient pruning schemes for distancebased outlier detection," ECML/PKDD (2), pp. 160-175, 2009.
34. M. Wu and C. Jermaine, "A bayesian method for guessing the extreme values in a data set?" Proc. of the 33rd international conference on Very large data bases, pp. 471-482, 2007.
35. G. Orair, C. Teixeira, Y. Wang, W. Meira, Jr., and S. Parthasarathy, "Distance-based outlier detection: Consolidation and renewed bearing," Proc. of the International Conference on Very Large Data Bases, 2010.
36. A. Andoni and P. Indyk, "Near-optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions," Communications of ACM, vol. 51, no. 1, pp. 117-122, 2008.
37. A. Broder, M. Charikar, A. Frieze, and M. Mitzenmacher, "Min-wise independent permutations," Journal of Computer and System Sciences, vol. 60, no. 3, pp. 630-659, 2000.
38. D. Ravichandran, P. Pantel, and E. Hovy, "Randomized algorithms and nlp: using locality sensitive hash function for high speed noun clustering," Proc. of 43th Annual Meeting of the Association for Computational Linguistics, pp. 622-629, 2005.
39. M. Charikar, "Similarity estimation techniques from rounding algorithms," Proc. of the thiry-fourth annual ACM symposium on Theory of computing, p. 388, 2002.
40. A. Gionis, P. Indyk, and R. Motwani, "Similarity Search in High Dimensions via Hashing," Proc. of 25th Internat Conf. on Very Large Data Bases, 1999.
41. M. Karypis and V. Kumar, "A Comparison of Document Clustering Techniques," Proc.of KDD Workshop on Text Mining, 2000.
42. A. Andoni and P. Indyk, "E2LSH 0.1 User Manual," technical report, 2005.
43. "Lsh algo. and impl. (e2lsh), http://web.mit.edu/andoni/www/lsh/
44. M. Bawa, T. Condie, and P. Ganesan, "LSH forest: self-tuning indexes for similarity search," Proc. of the 14th international conference on World Wide Web, pp. 651-660, 2005.
45. W. Dong, Z. Wang, W. Josephson, M. Charikar, and K. Li, "Modeling LSH for performance tuning," Proc. of 17th International Conference on Information and Knowledge Management, pp. 669-678, 2008.
46. R. Weber, H. Schek, and S. Blott, "A quantitative analysis and performance study for similarity-search methods in high-dimensional spaces," Proc. of the 24th International Conf. on Very Large Data Base, pp. 194-205, 1998.
47. http://tamandua.speed.dcc.ufmg.br/, Projeto Tamandua, 2006.