Incremental local outlier detection for data streams

Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Data Mining, CIDM 2007

Volumn , Issue , 2007, Pages 504-515

  Pokrajac, Dragoljub ^a   Lazarevic, Aleksandar ^b   Latecki, Longin Jan ^c  

^a DELAWARE STATE UNIVERSITY   (United States)

^b UNITED TECHNOLOGIES RESEARCH CENTER   (United States)

^c TEMPLE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; ITERATIVE METHODS; PATTERN RECOGNITION; REAL TIME SYSTEMS; STATIC ANALYSIS;

DATA STREAMS; ITERATED STATIC ALGORITHMS; LOCAL OUTLIER FACTOR (LOF); OUTLIER DETECTION;

DATA MINING;

EID: 34548752457     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIDM.2007.368917     Document Type: Conference Paper

References (42)

1. M. Joshi, R. Agarwal, V. Kumar, PNrule, Mining Needles in a Haystack: Classifying Rare Classes via Two-Phase Rule Induction, In Proceedings of the ACM SIGMOD Conference on Management of Data, Santa Barbara, CA, May 2001.
2. N. Chawla, A. Lazarevic, L. Hall, K. Bowyer, SMOTEBoost: Improving the Prediction of Minority Class in Boosting, In Proceedings of the Principles of Knowledge Discovery in Databases, PKDD-2003, Cavtat, Croatia, September 2003.
3. V. Barnett and T. Lewis, Outliers in Statistical Data. New York, NY, John Wiley and Sons, 1994.
4. A Lazarevic, L. Ertoz, A. Ozgur, J. Srivastava, V. Kumar, A comparative study of anomaly detection schemes in network intrusion detection, In Proceedings of the Third SIAM International Conference on Data Mining, San Francisco, CA, May 2003.
5. A. Lazarevic, V. Kumar, Feature Bagging for Outlier Detection, In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Chicago, IL, August 2005.
6. N. Billor, A. Hadi and P. Velleman BACON: Blocked Adaptive Computationally-Efficient Outlier Nominators, Computational Statistics & Data Analysis, Vol. 34, pp. 279-298, 2000.
7. E. Eskin, Anomaly Detection over Noisy Data using Learned Probability Distributions, In Proceedings of the International Conference on Machine Learning, Stanford University, CA, June.2000.
8. Aggarwal, C. C., Yu, P. Outlier detection for high dimensional data. In Proceedings of the ACM SIGMOD International Conference on Management, of Data, 2001.
9. M.M. Breunig, H.P. Kriegel, R.T. Ng and J. Sander, LOF: Identifying Density Based Local Outliers, In Proceedings cf the ACM SIGMOD Conference, Dallas, TX, May 2000.
10. E. Knorr and R. Ng, Algorithms for Mining Distance based Outliers in Large Data Sets, In Proceedings of the Very Large Databases (VLDB) Conference, New York City, NY, August 1998.
11. D. Yu, G. Sheikholeslami and A. Zhang, FindOut: Finding Outliers in Very Large Datasets, The Knowledge and Information Systems (KAIS) journal, vol. 4, 4, October 2002.
12. E. Eskin, A. Arnold, M Prerau, L. Portnoy and S. Stolfo, A Geometric Framework for Unsupervised Anomaly Detection: Detecting Intrusions in Unlabeled Data, in Applications of Data Mining in Computer Security, Advances In Information Security, S. Jajodia D. Barbara, Ed. Boston: Kluwer Academic Publishers, 2002.
13. S. Hawkins, H. He, G. Williams, and, R. Baxter, Outlier Detection Using Replicator Neural Networks, In Proceedings of the 4th International Conference on Data Warehousing and Knowledge Discovery (DaWaK02), Lecture Notes in Computer Science 2454, Aix-en-Provence, France, pp. 170-180, September 2002.
14. G. Medioni, I. Cohen, S. Hongeng, F. Bremond and R. Nevatia. Event Detection and Analysis from Video Streams, IEEE Trans. on Pattern Analysis and Machine Intelligence, 8(23), 873-889, 2001.
15. Shu-Ching Chen, Mei-Ling Shyu, Chengcui Zhang, Jeff Strickrott: Multimedia Data Mining for Traffic Video Sequences. MDM/KDD 2001, pp 78-86.
16. Shu-Ching Chen, Mei-Ling Shyu, Chengcui Zhang, Raogasami L. Kashyap: Video Scene Change Detection Method Using Unsupervised Segmentation And Object Tracking. Proc. ICME 2001
17. Y. Tao, D. Papadias, X. Lian, Reverse kNN Search in arbitrary dimensionality, In Proceedings of the 30th International Conference on Very Large Data Bases, Toronto, Canada, September 2004.
18. Amit Singh, Hakan Ferhatosmanoglu, Ali Tosun, High Dimensional Reverse Nearest Neighbor Queries, In Proceedings of the ACM International Conference on Information and Knowledge Management (CIKM'03), New Orleans, LA, November 2003.
19. Ioana Stanoi, Divyakant Agrawal, Amr El Abbadi, Reverse Nearest Neighbor Queries for Dynamic Databases, ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery, Dalas, TX, May 2000.
20. J. Anderson, Brian, Tjaden, The inverse nearest neighbor problem with astrophysical applications. In Proceedings of the 12th Symposium of Discrete Algorithms (SODA), Washington, DC, January 2001.
21. D. Pokrajac, L. J. Latecki, A. Lazarevic et al. Computational geometry issues of reverse-k nearest neighbors queries, Technical Report TR-CIS5001, Delaware State University 2006.
22. J. Conway, N. H. Sloane, Sphere Packings, Lattices and Groups, Springer, 1998.
23. F. P. Preparata, M. I. Shamos, Computational Geometry: an Introduction, 2nd Printing, Springer-Verlag 1988
24. N. Roussopoulos, S. Kelley and F. Vincent, Nearest neighbor queries, 71-79, Proceedings, of the. ACM SIGMOD Conference, San Jose, CA, 1995
25. N. Beckmann, H.-P. Kriegel, R. Schneider, and B. Seeger. The R*-tree: an efficient and robust access method for points and rectangles. SIGMOD Rec., 19(2):322-331, 1990.
26. S. Berchtold, D. A Keim, and H.-P. Kriegel. The X-tree: An index structure for highdimensional data. In T. M. Vijayaraman, A. P. Buchmann, C. Mohan, and N. L. Sarda, editors, Proceedings of the 22nd International Conference on Very Large Databases, pages 28-39, San Francisco, U.S.A., 1996. Morgan Kaufmann Publishers.
27. R. Weber, H.-J. Schek, and S. Blott. A quantitative analysis and performance study for similarity-search methods in high-dimensional spaces. In VLDB '98: Proceedings of the 24rd International Conference on Very Large Data Bases, pages 194-205, San Francisco, CA, USA, 1998. Morgan Kaufmann Publishers Inc.
28. D. DeMenthon, L. J. Latecki, A. Rosenfeld, and M. Vuilleumier Stückelberg: Relevance Ranking of Video Data using Hidden Markov Model Distances and Polygon Simplification. Proc. of the Int. Conf. on Visual Information Systems, Lyon, France, Springer-Verlag, pp. 49-61, November 2000.
29. L. J. Latecki, R. Miezianko, V. Megalooikonomou, D. Pokrajac, Using Spatiotemporal Blocks to Reduce the Uncertainty in Detecting and Tracking Moving Objects in Video, International Journal of Intelligent Systems Technologies and Applications, 1 (3-4) 2006, pp. 376-392.
30. I. T. Jolliffe. Principal Component Analysis, 2nd edition. Springer Verlag, 2002.
31. R. P. Lippmann, D. J. Fried, I. Graf, J. et al, Evaluating Intrusion Detection Systems: The 1998 DARPA Off-line Intrusion Detection Evaluation, In Proceedings DARPA Information Survivability Conference and Exposition (DISCEX) 2000, Vol 2, pp. 12-26, IEEE Computer Society Press, Los Alamitos, CA, 2000.
32. Tcptrace software tool, www.tcptrace.org.
33. UCI KDD Archive, KDD Cup, 1999 Data Set, www.ics.uci.edu/~kdd/databases/ kddcup99/kddcup99.html
34. J. Tang, Z. Chen, A. Fu, D. Cheung, Enhancing Effectiveness of Outlier Detections for Low Density Patterns, In Proceedings of the Sixth Pacific-Asia Conference on Knowledge Discovery and Data Mining, (PAKDD), Taipei, May, 2002.
35. S. Papadimitriou, H. Kitagawa, P. B. Gibbons, C. Faloutsos: LOCI: Fast Outlier Detection Using the Local Correlation Integral, In Proceedings of the 19th International Conference oh Data Engineering (ICDE'03), Bangalore, India, March 2003.
36. S. D. Bay, M. Schwabacher, Mining distance-based outliers in near linear time with randomization and a simple pruning rule. In Proceedings of the Ninth ACM SIGKDD international conference on Knowledge discovery and data mining, New York, NY, 2003.
37. D.M.V. Sommerville, An Introduction to the Geometry of N Dimensions, Dover Publications, Inc, NY, 1958.
38. T. Fawcett, F. Provost, Activity monitoring: noticing interesting changes in behavior, Proceedings fifth ACM SIGKDD international conference on Knowledge discovery and data mining, August 15-18, 1999, San Diego, California, pp.53-62
39. P. Domingos and G. Hulten, A General Framework for Mining Massive Data Streams, Journal of Computational and Graphical Statistics 12 (4) (2003), pp. 945-949.
40. J.Tang, Z. Chen, AW. Fu, D.W. Cheung, Capabilities of outlier detection schemes in large datasets, framework and methodologies Knowledge and Information Systems 11(1), 2006, pp. 45-84.
41. K. Yamanishi, J. Takeuchi, A unifying framework for detecting outliers and change points from non-stationary time series data. In Proceedings of the Eighth ACM SIGKDD international Conference on Knowledge Discovery and Data Mining, Edmonton, Alberta, Canada, July 23-26, 2002, pp. 676-681.
42. E. Achtert E., C. Böhm, P. Kröger, P. Kunath, A. Pryakhin, M. Renz, Efficient Reverse k-Nearest Neighbor Search in Arbitrary Metric Spaces.In Proceedings ACM SIGMOD Int. Conf. on Management of Data(SIGMOD'06), Chicago (IL), U.S.A., 2006, pp. 515-526.