Communication-efficient distributed variance monitoring and outlier detection for multivariate time series

Proceedings of the International Parallel and Distributed Processing Symposium, IPDPS

Volumn , Issue , 2014, Pages 37-47

  Gabel, Mohse ^a   Schuster, Assaf ^a   Keren, Daniel ^b  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b UNIVERSITY OF HAIFA   (Israel)

Author keywords

data analysis; distributed computing; distributed processing; fault detection; time series analysis

Indexed keywords

BANDWIDTH; DISTRIBUTED COMPUTER SYSTEMS; DISTRIBUTED PARAMETER NETWORKS; FAULT DETECTION; FUNCTIONS; ONLINE SYSTEMS; STATISTICS; TIME SERIES ANALYSIS; WEB SERVICES;

APPROXIMATION BOUNDS; COMPARISON FUNCTIONS; DISTRIBUTED PROCESSING; MONITORING ALGORITHMS; MULTIVARIATE TIME SERIES; PROCESSING INFRASTRUCTURES; STATISTICAL FRAMEWORK; STATISTICAL GUARANTEE;

DATA REDUCTION;

EID: 84906668980     PISSN: 15302075     EISSN: 23321237     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2014.16     Document Type: Conference Paper

References (35)

1. P. Bodík, M. Goldszmidt, A. Fox, D. B. Woodard, and H. Andersen, "Fingerprinting the datacenter: Automated classification of performance crises," in Proc. EuroSys, 2010.
2. M. Isard, "Autopilot: automatic data center management," SIGOPS Oper. Syst. Rev., 2007.
3. M. Gabel, A. Schuster, R.-G. Bachrach, and N. Bjorner, "Latent fault detection in large scale services," in Proc. DSN, 2012.
4. G. Bronevetsky, I. Laguna, B. De Supinski, and S. Bagchi, "Automatic fault characterization via abnormality-enhanced classification," in Proc. DSN, 2012.
5. S. Zhang, I. Cohen, M. Goldszmidt, J. Symons, and A. Fox, "Ensembles of models for automated diagnosis of system performance problems," in Proc. DSN, 2005.
6. A. J. Oliner, A. Aiken, and J. Stearley, "Alert detection in system logs," in Proc. ICDM, 2008.
7. W. Xu, L. Huang, A. Fox, D. Patterson, and M. I. Jordan, "Detecting large-scale system problems by mining console logs," in Proc. SOSP, 2009.
8. M. P. Kasick, J. Tan, R. Gandhi, and P. Narasimhan, "Blackbox problem diagnosis in parallel file systems," in Proc. FAST, 2010.
9. S. Kavulya, R. Gandhi, and P. Narasimhan, "Gumshoe: Diagnosing performance problems in replicated file-systems," in Proc. SRDS, 2008.
10. S. Kavulya, S. Daniels, K. Joshi, M. Hiltunen, R. Gandhi, and P. Narasimhan, "Draco: Statistical diagnosis of chronic problems in large distributed systems," in Proc. DSN, 2012.
11. G. Cormode and M. Garofalakis, "Sketching probabilistic data streams," in SIGMOD, 2007.
12. S. Muthukrishnan, "Data streams: Algorithms and applications," Foundations and Trends in Theoretical Computer Science, 2005.
13. D. Keren, I. Sharfman, A. Schuster, and A. Livne, "Shape sensitive geometric monitoring," Trans. Knowl. Data Eng., 2012.
14. D. Keren, G. Sagy, A. Abboud, D. Ben-David, A. Schuster, I. Sharfman, and A. Deligiannakis, "Geometric monitoring of heterogeneous streams," Trans. on Knowl. and Data Eng., 2014, to appear.
15. A. S. Izchak Sharfman and D. Keren, "Shape sensitive geometric monitoring," in Proc. PODS, 2008.
16. I. Sharfman, A. Schuster, and D. Keren, "A geometric approach to monitoring threshold functions over distributed data streams," TODS, 2007.
17. G. Cormode, "The continuous distributed monitoring model," SIGMOD Rec., 2013.
18. B. Babcock and C. Olston, "Distributed top-k monitoring," in Proc. SIGMOD, 2003.
19. N. Giatrakos, A. Deligiannakis, M. Garofalakis, I. Sharfman, and A. Schuster, "Prediction-based geometric monitoring over distributed data streams," in Proc. SIGMOD, 2012.
20. G. Cormode, M. Garofalakis, S. Muthukrishnan, and R. Rastogi, "Holistic aggregates in a networked world: distributed tracking of approximate quantiles," in Proc. SIGMOD, 2005.
21. W. Johnson and J. Lindenstrauss, "Extensions of Lipschitz mappings into a Hilbert space," in Conference in Modern Analysis and Probability (New Haven, Conn., 1982), ser. Contemporary Mathematics, 1984.
22. N. Alon, Y. Matias, and M. Szegedy, "The space complexity of approximating the frequency moments," J. Comput. Syst. Sci., 1999.
23. D. Achlioptas, "Database-friendly random projections: Johnson-lindenstrauss with binary coins," J. Comput. Syst. Sci., 2003.
24. J. Matoušek, "On variants of the Johnson-Lindenstrauss lemma," Random Structures & Algorithms, 2008.
25. A. Bar-Or, D. Keren, A. Schuster, and R. Wolff, "Hierarchical decision tree induction in distributed genomic databases," IEEE Trans. on Knowl. and Data Eng., 2005.
26. R. Keralapura, G. Cormode, and J. Ramamirtham, "Communication- efficient distributed monitoring of thresholded counts," in Proc. SIGMOD, 2006.
27. J. Branch, B. Szymanski, C. Giannella, R. Wolff, and H. Kargupta, "In-network outlier detection in wireless sensor networks," in Proc. ICDCS, 2006.
28. S. Subramaniam, T. Palpanas, D. Papadopoulos, V. Kalogeraki, and D. Gunopulos, "Online outlier detection in sensor data using non-parametric models," in Proc. VLDB, 2006.
29. N. Giatrakos, Y. Kotidis, A. Deligiannakis, V. Vassalos, and Y. Theodoridis, "TACO: tunable approximate computation of outliers in wireless sensor networks," in Proc. SIGMOD, 2010.
30. L. Huang, X. Nguyen, M. Garofalakis, J. Hellerstein, M. Jordan, A. Joseph, and N. Taft, "Communication-efficient online detection of network-wide anomalies," in Proc. INFOCOM, 2007.
31. S. Burdakis and A. Deligiannakis, "Detecting outliers in sensor networks using the geometric approach," in Proc. ICDE, 2012.
32. B. Babcock, M. Datar, R. Motwani, and L. O'Callaghan, "Maintaining variance and k-medians over data stream windows," in Proc. PODS, 2003.
33. G. Cormode, S. Muthukrishnan, K. Yi, and Q. Zhang, "Optimal sampling from distributed streams," in Proc. PODS, 2010.
34. I. Sharfman, A. Schuster, and D. Keren, "Aggregate threshold queries in sensor networks," in IPDPS, 2007.
35. M. Gabel, D. Keren, and A. Schuster, "Communicationefficient outlier detection for scale-out systems," in Proc. Workshop on Big Dynamic Distributed Data (BD3), 2013.