A flexible architecture integrating monitoring and analytics for managing large-scale data centers

Proceedings of the 8th ACM International Conference on Autonomic Computing, ICAC 2011 and Co-located Workshops

Volumn , Issue , 2011, Pages 141-150

  Wang, Chengwei ^a   Schwan, Karsten ^a   Talwar, Vanish ^b   Eisenhauer, Greg ^a   Hu, Liting ^a   Wolf, Matthew ^a  

^a Georgia Institute of Technology   (United States)

^b HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

analytics; cloud; data center; monitoring

Indexed keywords

ANALYTICAL MODEL; ANALYTICS; AUTONOMIC MANAGEMENT; BRUTE FORCE; CURRENT SYSTEM; DATA CENTERS; DISTRIBUTED COMPUTATIONS; FLEXIBLE ARCHITECTURES; INTEGRATED MONITORING; MONITORING SYSTEM; ON-LINE ANALYSIS; REAL TIME MONITORING; SMALL SCALE; SYSTEM STATE;

CLOUD COMPUTING; MATHEMATICAL MODELS; SATELLITE COMMUNICATION SYSTEMS;

MONITORING;

EID: 79960190143     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1998582.1998605     Document Type: Conference Paper

References (40)

1. Apache hadoop: http://hadoop.apache.org/.
2. Hp ilo:http://h18000.www1.hp.com/products/servers/management/remotemgmt. html.
3. Hp production team: Personal correspondence, sep. 2010.
4. Ibm systems director:http://www-03.ibm.com/systems/software/director/.
5. S. Agarwala and et. al.. E2eprof: Automated end-to-end performance management for enterprise systems. DSN '07.
6. M. K. Aguilera and et. al.. Performance debugging for distributed systems of black boxes. SOSP '03.
7. M. Al-Fares and et. al.. A scalable, commodity data center network architecture. SIGCOMM '08.
8. E. Anderson and D. Patterson. Extensible, scalable monitoring for clusters of computers. LISA '97.
9. R. Apte and et. al.. Look who's talking: discovering dependencies between virtual machines using cpu utilization. HotCloud'10.
10. P. Bahl and et. al.. Towards highly reliable enterprise network services via inference of multi-level dependencies. SIGCOMM '07.
11. P. Barham and et. al.. Using magpie for request extraction and workload modelling. OSDI'04.
12. F. Can. Incremental clustering for dynamic information processing. ACM Trans. Inf. Syst.
13. J. Cappos and et. al.. San fermin: aggregating large data sets using a binomial swap forest. NSDI'08.
14. E. Cecchet and et. al.. Performance comparison of middleware architectures for generating dynamic web content. Middleware '03.
15. M. Chen and et. al.. Pinpoint: problem determination in large, dynamic internet services. DSN'02.
16. I. Cohen and et. al.. Capturing, indexing, clustering, and retrieving system history. SOSP '05.
17. J. Dean. Designs, lessons and advice from building large distributed systems. In LADIS, 2009.
18. G. Eisenhauer. PhD thesis.
19. N. Friedman and et. al.. Bayesian network classifiers. Machine Learning, 1997.
20. W. Gu and et. al.. Falcon: On-line monitoring and steering of parallel programs. Concurrency: Practice and Experience.
21. R. C. Harlan. Network management with nagios. Linux J.
22. L. Hu and et. al.. Net-cohort: Detecting and managing vm ensembles in data center systems. In Submission.
23. M. Inaba and et. al.. Applications of weighted voronoi diagrams and randomization to variance-based k-clustering: (extended abstract). SCG '94.
24. E. Kiciman and et. al.. Ajaxscope: a platform for remotely monitoring the client-side behavior of web 2.0 applications. SOSP '07.
25. S. Y. Ko and et. al.. Moara: flexible and scalable group-based querying system. Middleware '08.
26. A. Kumar and et. al.. Data streaming algorithms for efficient and accurate estimation of flow size distribution. SIGMETRICS '04/Performance '04.
27. V. Kumar and et. al.. A state-space approach to sla based management. NOMS'08.
28. M. Kutare and et. al.. Monalytics: online monitoring and analytics for managing large scale data centers. ICAC '10.
29. J. Leverich and et. al.. Evaluating impact of manageability features on device performance. CNSM '10.
30. S. R. Madden and et. al. Tag: a tiny aggregation service for ad-hoc sensor networks. OSDI '10.
31. M. L. Massie and et. al.. The ganglia distributed monitoring system: design, implementation, and experience. Parallel Computing.
32. F. Murtagh. Complexities of hierarchic clustering algorithms: the state of the art. Computational Statistics Quarterly, 1984.
33. D. Narayanan and et. al.. Delay aware querying with seaweed. The VLDB Journal.
34. R. Nathuji and et. al.. Coolit: coordinating facility and it management for efficient datacenters. HotPower'08.
35. M. Sottile and et. al.. Supermon: a high-speed cluster monitoring system. Cluster Computing'02.
36. V. Soundararajan and et. al.. The impact of management operations on the virtualized datacenter. ISCA '10.
37. R. Van Renesse and et. al.. Astrolabe: A robust and scalable technology for distributed system monitoring, management, and data mining. ACM Trans. Comput. Syst.
38. C. Wang and et. al.. Online detection of utility cloud anomalies using metric distributions. IM'10.
39. C. Wang and et. al.. Statistical techniques for online anomaly detection in data centers. IM'11.
40. P. Yalagandula and et. al.. A scalable distributed information management system. SIGCOMM '04.