Online anomaly detection over Big Data streams

Proceedings - 2015 IEEE International Conference on Big Data, IEEE Big Data 2015

Volumn , Issue , 2015, Pages 1113-1122

  Rettig, Laura ^a,b   Khayati, Mourad ^b   Cudre Mauroux, Philippe ^b   Piorkowski, Michal ^a  

^a Swisscom AG   (Switzerland)

^b UNIVERSITY OF FRIBOURG   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

CORRELATION METHODS; DATA COMMUNICATION SYSTEMS; MOBILE DEVICES; SCALABILITY; SIGNAL DETECTION; TELECOMMUNICATION NETWORKS;

CATEGORICAL DATA; DATA DISTRIBUTION; DESIGN AND IMPLEMENTATIONS; INFRASTRUCTURE FAILURES; MISCONFIGURATIONS; ONLINE ANOMALY DETECTION; PEARSON CORRELATION; STREAMING APPLICATIONS;

BIG DATA;

EID: 84963775838     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigData.2015.7363865     Document Type: Conference Paper

References (17)

1. T. Dasu, S. Krishnan, S. Venkatasubramanian, and K. Yi, "An information-theoretic approach to detecting changes in multidimensional data streams, " in In Proc. Symp. on the Interface of Statistics, Computing Science, and Applications, 2006.
2. M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, and I. Stoica, "Spark: Cluster Computing with Working Sets, " in Proceedings of the 2Nd USENIX Conference on Hot Topics in Cloud Computing, 2010, pp. 10-10.
3. J. Zhang, M. Lou, T. W. Ling, and H. Wang, "HOS-Miner: A system for detecting outlyting subspaces of high-dimensional data, " in Proceedings of the 30th International Conference on Very Large Databases, Toronto, Canada, 2004, pp. 1265-1268.
4. X. Li and J. Han, "Mining approximate top-k subspace anomalies in multi-dimensional time-series data, " in Proceedings of the 33rd International Conference on Very Large Data Bases, Vienna, Austria, September 23-27, 2007, 2007, pp. 447-458.
5. W. C. Young, J. E. Blumenstock, E. B. Fox, and T. H. Mccormick, "Detecting and classifying anomalous behavior in spatiotemporal network data, " in The 20th ACM Conference on Knowledge Discovery and Mining (KDD '14), Workshop on Data Science for Social Good, New York, NY, 2014.
6. M. Gupta, J. Gao, C. C. Aggarwal, and J. Han, "Outlier detection for temporal data: A survey, " IEEE Transactions on Knowledge and Data Engineering, vol. 25, no. 1, pp. 1-1, 2014.
7. Q. Wu and Z. Shao, "Network Anomaly Detection Using Time Series Analysis, " in Joint International Conference on Autonomic and Autonomous Systems and International Conference on Networking and Services-(icas-isns'05), 2005, p. 42.
8. M. Datar, A. Gionis, P. Indyk, and R. Motwani, "Maintaining stream statistics over sliding windows, " SIAM Journal on Computing, vol. 31, pp. 1794-1813, 2002.
9. O. Papapetrou, M. Garofalakis, and A. Deligiannakis, "Sketch-based querying of distributed sliding-window data streams, " in Proceedings of the VLDB Endowment, vol. 5, 2012, pp. 992-1003.
10. G. Cormode and S. Muthukrishnan, "An improved data stream summary: The count-min sketch and its applications, " Journal of Algorithms, vol. 55, no. 1, pp. 58-75, 2005.
11. G. Cormode and S. Muthukrishnan, "What's new: Finding significant differences in network data streams, " INFOCOM 2004. Twenty-third Annual Joint Conference of the IEEE Computer and Communications Societies, vol. 3, pp. 1534-1545, 2004.
12. S. Kullback and R. A. Leibler, "On information and sufficiency, " Ann. Math. Statist., vol. 22, no. 1, pp. 79-86, 03 1951.
13. M. Zaharia, M. Chowdhury, T. Das, A. Dave, M. McCauley, M. J. Franklin, S. Shenker, and I. Stoica, "Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing, " in NSDI'12 Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation, 2012, pp. 2-2.
14. M. Zaharia, T. Das, H. Li, T. Hunter, S. Shenker, and I. Stoica, "Discretized streams: fault-tolerant streaming computation at scale, " in SOSP '13 Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles, 2013, pp. 423-438.
15. The Apache Software Foundation, "Apache Avro, " 2015. [Online]. Available: https://avro. Apache. org/
16. The Apache Software Foundation, "Apache Kafka, " 2015. [Online]. Available: https://kafka. Apache. org/
17. N. Marz and J. Warren, Big Data: Principles and best practices of scalable realtime data systems. Greenwich, CT: Manning Publications Co., 2013.