Anomaly detection in information streams without prior domain knowledge

IBM Journal of Research and Development

Volumn 55, Issue 5, 2011, Pages

  Beigi, M S ^a   Chang, S F ^b   Ebadollahi, S ^a   Verma, D C ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANOMALOUS BEHAVIOR; ANOMALY DETECTION; DATA SETS; DATA STREAM; DISTANCE METRICS; DOMAIN KNOWLEDGE; INFORMATION STREAMS; KNOWLEDGE BASE; NORMAL BEHAVIOR; PRIOR INFORMATION; STATE OF THE ART; SYSTEMS MANAGEMENT; TEMPORAL SCALE; TIME-SCALES;

NETWORK MANAGEMENT; SENSOR NETWORKS;

KNOWLEDGE BASED SYSTEMS;

EID: 81555199703     PISSN: 00188646     EISSN: 21518556     Source Type: Journal    
DOI: 10.1147/JRD.2011.2163280     Document Type: Article

References (19)

1. Intel Lab Data. [Online]. Available: http://db.csail.mit.edu/labdata/ labdata.html
2. Time Series Data Library. [Online]. Available: http://www-personal. buseco.monash.edu.au/~hyndman/TSDL/
3. V. Barnett and T. Lewis, Outliers in Statistical Data. Hoboken, NJ: Wiley, 1994.
4. A. S. Hadi, "A modification of a method for the detection of outliers in multivariate samples," J. Roy. Stat. Soc. Ser. B, vol. 56, no. 2, pp. 393-396, 1994.
5. E. Knorr, R. Ng, and V. Tucakov, "Distance-based outliers: Algorithms and applications," VLDB J., vol. 8, no. 3/4, pp. 237-253, Feb. 2000.
6. C. Aggarwal and P. Yu, "Outlier detection for high dimensional data," in Proc. ACM SIGMOD, T. Sellis, Ed., 2001, pp. 37-46, DOI: 10.1145/375663.375668. [Online]. Available: http://doi.acm. org/10.1145/375663. 375668.
7. K.-S. Goh, K. Miyahara, R. Radhakrishan, A. Xiong, and A. Divakaran, "Audio-visual event detection based on mining of semantic audio-visual labels," in Proc. SPIE Conf. Storage Retrieval Multimedia Databases, 2004, vol. 5307, pp. 292-299.
8. S. Subramaniam, T. Palpanas, D. Papadopoulos, V. Kalogeraki, and D. Gunopulos, "Online outlier detection in sensor data using nonparametric models," in Proc. 32nd Int. Conf. VLDB, 2006, pp. 187-198.
9. A. Haar, "Zur Theorie der orthogonalen Funktionensysteme," Math. Ann., vol. 71, no. 1, pp. 38-53, Mar. 1911.
10. A. P. Witkin, "Scale-space filtering," in Proc. Int. Joint Conf. Artif. Intell., 1983, pp. 1019-1021.
11. M. Beigi, S.-F. Chang, S. Ebadollahi, and D. Verma, "Multi-scale temporal segmentation and outlier detection in sensor networks," in Proc. IEEE ICME, 2009, pp. 306-309.
12. P. Mermelstein, "Distance measures for speech recognition, psychological and instrumental," in Pattern Recognition and Artificial Intelligence, C. H. Chen, Ed. New York: Academic, 1976, pp. 374-388.
13. C. Jutten and J. Herault, "Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture," Signal Process., vol. 24, no. 1, pp. 1-10, 1991. (Pubitemid 21679270)
14. D. Scott, Multivariate Density Estimation: Theory and Practice and Visualization. Hoboken, NJ: Wiley, 1992.
15. N. Hjort, "On frequency polygons and average shifted histograms in higher dimensions," Stanford Univ., Stanford, CA, Tech. Rep. 22, 1986.
16. D. W. Scott and G. R. Terrell, "Biased and unbiased cross-validation in density estimation," J. Amer. Stat. Assoc., vol. 82, no. 400, pp. 1131-1146, Dec. 1987.
17. D. Kifer, S.-B. David, and J. Gehrke, "Detecting change in data streams," in Proc. 30th Int. Conf. VLDB, 2004, vol. 30, pp. 180-191.
18. C. Aggarwal, "A framework for diagnosing changes in evolving data streams," in Proc. ACM SIGMOD, 2003, pp. 575-586, DOI: 10.1145/872757. 872826. [Online]. Available: http://doi.acm.org/10.1145/872757.872826.
19. D. D. Lewis, "NaBve (Bayes) at forty: The independence assumption in information retrieval," in Proc. 10th ECML, 1998, pp. 4-15.