Mochi: Visual log-analysis based tools for debugging hadoop

Workshop on Hot Topics in Cloud Computing, HotCloud 2009

Volumn , Issue , 2009, Pages

  Tan, Jiaqi ^a   Pan, Xinghao ^a   Kavulya, Soila ^a   Gandhi, Rajeev ^a   Narasimhan, Priya ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLOUD COMPUTING; DATA FLOW ANALYSIS; WELL LOGGING;

DATA FLOW MODELING; DEBUGGING TOOLS; LOG ANALYSIS; PERFORMANCE ISSUES; REAL-WORLD; UNIFIED CONTROL;

PROGRAM DEBUGGING;

EID: 84904441123     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Creating socket in java takes 3 minutes, 2004. http://tinyurl.com/d5p3qr.
2. M. K. Aguilera, J. C. Mogul, J. L. Wiener, P. Reynolds, and A. Muthitacharoen. Performance Debugging for Distributed System of Black Boxes. In SOSP, Oct 2003.
3. P. Barham, A. Donnelly, R. Isaacs, and R. Mortier. Using Magpie for Request Extraction and Workload Modelling. In OSDI, Dec 2004.
4. P. Bodik, G. Friedman, L. Biewald, H. Levine, G. Candea, K. Patel, G. Tolle, J. Hui, A. Fox, M. Jordan, and D. Patterson. Combining Visualization and Statistical Analysis to Improve Operator Confidence and Efficiency for Failure Detection and Localization In ICAC, Jun 2005.
5. M. Y. Chen, E. Kiciman, E. Fratkin, A. Fox, and E. Brewer. Pinpoint: Problem Determination in Large, Dynamic Internet Services. In DSN, Jun 2002.
6. G. Cretu-Ciocarlie, M. Budiu, and M. Goldszmidt. Hunting for problems with artemis. In Workshop on Analysis of System Logs, Dec 2008.
7. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In OSDI, Dec 2004.
8. R. Fonseca, G. Porter, R. Katz, S. Shenker, and I. Stoica. X-Trace: A Pervasive Network Tracing Framework. In NSDI, Apr 2007.
9. The Apache Software Foundation. Hadoop, 2007. http://hadoop.apache.org/core.
10. S. Ghemawat, H. Gobioff, and S. Leung. The Google Filesystem. In SOSP, Oct 2003.
11. Yahoo! Inc. Yahoo! reaches for the stars with M45 supercomputing project, 2007. http://research.yahoo.com/node/1884.
12. U. Kang, C. Tsourakakis, A.P. Appel, C. Faloutsos, and J. Leskovec. HADi: Fast Diameter Estimation and Mining in Massive Graphs with Hadoop. CMU ML Tech Report CMU-ML-08-117, 2008.
13. E. Kiciman and A. Fox. Detecting Application-level Failures in Component-based Internet Services. IEEE Trans. on Neural Networks, 16(5):1027- 1041, Sep 2005.
14. A. Konwinski, M. Zaharia, R. Katz, and I. Stoica. X-tracing Hadoop. Hadoop Summit, Mar 2008.
15. Eric Koskinen and John Jannotti. Borderpatrol: Isolating Events for Black-box Tracing. In Eurosys 2008, Apr 2008.
16. Arun Murthy. Hadoop MapReduce - Tuning and Debugging, 2008. http://tinyurl.com/c9eau2.
17. X. Pan, J. Tan, S. Kavulya, R. Gandhi, and P. Narasimhan. Ganesha: Black-Box Diagnosis of MapReduce Systems. In HotMetrics, Seattle, WA, Jun 2009.
18. J. Tan, X. Pan, S. Kavulya, R. Gandhi, and P. Narasimhan. SALSA: Analyzing Logs as StAte Machines. In Workshop on Analysis of System Logs, Dec 2008.
19. W. Xu, L. Huang, A. Fox, D. Patterson, and M. Jordan. Mining Console Logs for Large-scale System Problem Detection. In SysML, Dec 2008.