Theius: A streaming visualization suite for hadoop clusters

Proceedings of the IEEE International Conference on Cloud Engineering, IC2E 2013

Volumn , Issue , 2013, Pages 177-182

  Tedesco, Jon ^a   Dudko, Roman ^a   Sharma, Abhishek ^a   Farivar, Reza ^a   Campbell, Roy ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Cloud computing; Cluster computing; Failure detection; Failure prediction; Hadoop; Monitoring; Visualization

Indexed keywords

COMPUTING CLUSTERS; COMPUTING SYSTEM; FAILURE DETECTION; FAILURE PREDICTION; HADOOP; SYSTEM ADMINISTRATORS; VISUALIZATION TOOLS; WEB-BASED VISUALIZATION;

CLOUD COMPUTING; CLUSTER COMPUTING; COMPUTER SYSTEMS; FLOW VISUALIZATION; MONITORING; TOOLS;

VISUALIZATION;

EID: 84881144234     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IC2E.2013.36     Document Type: Conference Paper

References (15)

1. F. Sacerdoti, M. Katz, M. Massie, and D. Culler, "Wide area cluster monitoring with ganglia, " in Cluster Computing, 2003. Proceedings. 2003 IEEE International Conference on, dec. 2003, pp. 289-298.
2. M. Massie, "The ganglia distributed monitoring system: design, implementation, and experience, " Parallel Computing, vol. 30, no. 7, pp. 817-840, Jul. 2004. [Online]. Available: http://dx.doi.org/10.1016/j.parco.2004. 04.001.
3. E. W. Fulp, G. A. Fink, and J. N. Haack, "Predicting computer system failures using support vector machines, " in Proceedings of the First USENIX conference on Analysis of system logs, ser. WASL'08. Berkeley, CA, USA: USENIX Association, 2008, pp. 5-5. [Online]. Available: http://dl.acm.org/ citation.cfm?id=1855886.1855891.
4. Y. Liang, Y. Zhang, H. Xiong, and R. Sahoo, "Failure prediction in ibm bluegene/l event logs, " in Proceedings of the 2007 Seventh IEEE International Conference on Data Mining. Washington, DC, USA: IEEE Computer Society, 2007, pp. 583-588. [Online]. Available: http://dl.acm.org/citation.cfm? id=1441428.1442122.
5. A. W. Williams, S. M. Pertet, and P. Narasimhan, "Tiresias: Black-box failure prediction in distributed systems, " in IPDPS, 2007, pp. 1-8.
6. P. Bodik, G. Friedman, L. Biewald, H. Levine, G. C, K. Patel, G. Tolle, J. Hui, O. Fox, M. I. Jordan, and D. Patterson, "Combining visualization and statistical analysis to improve operator confidence and efficiency for failure detection and localization, " in In Proceedings of the 2nd IEEE International Conference on Autonomic Computing (ICAC 2005. IEEE Computer Society, 2005, pp. 89-100.
7. D. Huang, X. Shi, S. Ibrahim, L. Lu, H. Liu, S. Wu, and H. Jin, "Mrscope: a real-time tracing tool for mapreduce, " in Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, ser. HPDC '10. New York, NY, USA: ACM, 2010, pp. 849-855. [Online]. Available: http://doi.acm.org/10.1145/1851476.1851598.
8. J. Boulon et al., "Chukwa, a large-scale monitoring system, " in Cloud Computing and its Applications, 2008, pp. 1-5. [Online]. Available: http://www.cca08.org/papers/Paper-13-Ariel-Rabkin.pdf.
9. J. Tan, X. Pan, S. Kavulya, R. Gandhi, and P. Narasimhan, "Mochi: visual log-analysis based tools for debugging hadoop, " in Proceedings of the 2009 conference on Hot topics in cloud computing, ser. HotCloud'09. Berkeley, CA, USA: USENIX Association, 2009.[Online]. Available: http://dl.acm.org/citation.cfm?id=1855533.1855551.
10. A. Konwinski and M. Zaharia, "Finding the elephant in the data center: Tracing hadoop, " 2008, pp. 1-27.
11. G. F. Cretu-ciocarlie, M. Budiu, and M. Goldszmidt, "Hunting for problems with artemis.".
12. B. H. Sigelman, L. A. Barroso, M. Burrows, P. Stephenson, M. Plakal, D. Beaver, S. Jaspan, and C. Shanbhag, "Dapper, a large-scale distributed systems tracing infrastructure, " 2010. [Online]. Available: http://research.google.com/archive/papers/dapper-2010-1.pdf.
13. B. Gregg. Visualizing the cloud. [Online]. Available: http://dtrace.org/blogs/brendan/2011/10/04/visualizing-the-cloud/.
14. [Online]. Available: http://meta.rocksclusters.org/ganglia/.
15. d3.js. [Online]. Available: http://d3js.org/.