RainMon: An integrated approach to mining bursty timeseries monitoring data

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2012, Pages 1158-1166

  Shafer, Ilari ^a   Ren, Kai ^a   Boddeti, Vishnu Naresh ^a   Abe, Yoshihisa ^a   Ganger, Gregory R ^a   Faloutsos, Christos ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

bursty data; PCA; system monitoring

Indexed keywords

ANALYSIS PROCESS; BURSTY DATA; DATA CENTERS; DATA STORAGE; DATA YIELDS; INTEGRATED APPROACH; MONITORING INFORMATION; NETWORK TRAFFIC; PCA; PRODUCTION SYSTEM; REAL-WORLD DATASETS; SYSTEM MONITORING; TIME-PERIODS;

DATA COMPRESSION; DATA MINING; USER INTERFACES;

MONITORING;

EID: 84866050008     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2339530.2339711     Document Type: Conference Paper

References (37)

1. Apache Hadoop, http://hadoop.apache.org/.
2. Apache Mahout: Scalable machine learning and data mining, http://mahout.apache.org/.
3. L. Barroso and U. Hölzle. The datacenter as a computer: An introduction to the design of warehouse-scale machines. Morgan & Claypool Publishers, San Rafael, CA, 2009.
4. K. Bhaduri, K. Das, and B. Matthews. Detecting abnormal machine characteristics in cloud infrastructures. In Proc. ICDMW'11, Vancouver, Canada.
5. M. Breunig, H. Kriegel, R. Ng, and J. Sander. LOF: identifying density-based local outliers. In Proc. SIGMOD'00, Dallas, Texas. ACM.
6. P. J. Brockwell and R. A. Davis. Introduction to time series and forecasting. Springer-Verlag, 2002.
7. V. Chandola, A. Banerjee, and V. Kumar. Anomaly detection: A survey. ACM Comput. Surv., 41(3):15:1-15:58, July 2009.
8. D. Fisher, D. Maltz, A. Greenberg, X. Wang, H. Warncke, G. Robertson, and M. Czerwinski. Using visualization to support network and application management in a data center. In Proc. INM'08, Orlando, FL.
9. D. Gmach, J. Rolia, L. Cherkasova, and A. Kemper. Workload analysis and demand prediction of enterprise data center applications. In Proc. IISWC'07, Boston, MA.
10. V. Guralnik and J. Srivastava. Event detection from time series data. In Proc. KDD'99, San Diego, CA.
11. S. Hirose, K. Yamanishi, T. Nakata, and R. Fujimaki. Network anomaly detection based on eigen equation compression. In Proc. KDD'09, Paris, France.
12. E. Hoke, J. Sun, J. Strunk, G. Ganger, and C. Faloutsos. InteMon: continuous mining of sensor data in large-scale self-infrastructures. ACM SIGOPS Operating Systems Review, 40(3):38-44, 2006.
13. IBM Tivoli, http://www.ibm.com/developerworks/tivoli/.
14. M. P. Kasick, J. Tan, R. Gandhi, and P. Narasimhan. Black-box problem diagnosis in parallel file systems. In Proc. FAST'10, San Jose, CA.
15. A. Lakhina, M. Crovella, and C. Diot. Diagnosing network-wide traffic anomalies. In Proc. SIGCOMM'04, Portland, OR.
16. Z. Lan, Z. Zheng, and Y. Li. Toward automated anomaly identification in large-scale systems. IEEE Transactions on Parallel and Distributed Systems, 21(2):174-187, Feb. 2010.
17. W. Leland, M. Taqqu, W. Willinger, and D. Wilson. On the self-similar nature of Ethernet traffic. In Proc. SIGCOMM'93, San Francisco, CA.
18. L. Li, C. Liang, J. Liu, S. Nath, A. Terzis, and C. Faloutsos. ThermoCast: A cyber-physical forecasting model for data centers. In Proc. KDD'11, San Diego, CA.
19. L. Li, J. McCann, N. Pollard, and C. Faloutsos. DynaMMo: Mining and summarization of coevolving sequences with missing values. In Proc. KDD'09, Paris, France.
20. L. Li, B. A. Prakash, and C. Faloutsos. Parsimonious linear fingerprinting for time series. In Proc. VLDB'10, Singapore.
21. J. Lin, E. Keogh, L. Wei, and S. Lonardi. Experiencing SAX: a novel symbolic representation of time series. Data Min. Knowl. Discov., 15(2):107-144, Oct. 2007.
22. C. Loboz, S. Smyl, and S. Nath. DataGarage: Warehousing massive performance data on commodity servers. In Proc. VLDB'10, Singapore.
23. H. Lutkepohl. New Introduction to Multiple Time Series Analysis. Springer, 2007.
24. M. L. Massie, B. N. Chun, and D. E. Culler. The ganglia distributed monitoring system: design, implementation, and experience. Parallel Computing, 30(7):817-840, July 2004.
25. Nagios, http://www.nagios.org.
26. H. Nguyen, Y. Tan, and X. Gu. PAL: Propagation-aware anomaly localization for cloud hosted distributed applications. In Proc. SLAML'11, Cascais, Portugal.
27. S. Papadimitriou, J. Sun, and C. Faloutsos. Streaming pattern discovery in multiple time-series. In Proc. VLDB'05, Trondheim, Norway.
28. D. Patnaik, M. Marwah, R. Sharma, and N. Ramakrishnan. Sustainable operation and management of data center chillers using temporal data mining. In Proc. KDD'09, Paris, France.
29. J. G. Proakis and M. Salehi. Fundamentals of Communication Systems. Prentice Hall, 2004.
30. G. Reeves, J. Liu, S. Nath, and F. Zhao. Cypress: Managing massive time series streams with multi-scale compressed trickles. In Proc. VLDB'09, Lyon, France.
31. S. Roweis and Z. Ghahramani. A Unifying Review of Linear Gaussian Models. Neural Computation, 11(2):305-345, Feb. 1999.
32. RRDtool, http://www.mrtg.org/rrdtool/.
33. R. K. Sahoo, A. J. Oliner, I. Rish, M. Gupta, J. E. Moreira, S. Ma, R. Vilalta, and A. Sivasubramaniam. Critical event prediction for proactive management in large-scale computer clusters. In Proc. KDD'03, New York, NY.
34. B. Sigoure. OpenTSDB: The distributed, scalable time series database. In Proc. OSCON'11, Portland, OR.
35. J. Sun, S. Papadimitriou, and C. Faloutsos. Distributed pattern discovery in multiple streams. In Proc. PAKDD'06, Singapore.
36. Zenoss, http://www.zenoss.com/.
37. Y. Zhu and D. Shasha. Efficient elastic burst detection in data streams. In Proc. KDD'03, Washington, DC.