Juggling the jigsaw: Towards automated problem inference from network trouble tickets

Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2013

Volumn , Issue , 2013, Pages 127-141

  Potharaju, Rahul ^a,b   Jain, Navendu ^b   Nita Rotaru, Cristina ^a  

^a PURDUE UNIVERSITY   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION MANAGEMENT; KNOWLEDGE REPRESENTATION; MODELING LANGUAGES; SYSTEMS ANALYSIS;

CLOUD PROVIDERS; DEVICE FAILURES; GLOBAL PROBLEMS; NATURAL LANGUAGE TEXT; NATURAL LANGUAGES; NETWORK OPERATIONS; NETWORK REDUNDANCY; STATISTICAL NATURAL LANGUAGE PROCESSING;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 85076686290     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (56)

1. AGUILERA, M., MOGUL, J., WIENER, J., REYNOLDS, P., AND MUTHITACHAROEN, A. Performance debugging for distributed systems of black boxes. In ACM SIGOPS Operating Systems Review (2003), ACM.
2. AHO, A., AND CORASICK, M. Efficient string matching: an aid to bibliographic search. Communications of the ACM (1975).
3. BEHNEL, S., BRADSHAW, R., SELJEBOTN, D., EWING, G., ET AL. Cython: C-extensions for python, 2008.
4. BENSON, M. Collocations and general-purpose dictionaries. International Journal of Lexicography (1990).
5. BETTENBURG, N., PREMRAJ, R., ZIMMERMANN, T., AND KIM, S. Duplicate bug reports considered harmful really? In IEEE International Conference on Software Maintenance (2008).
6. BETTENBURG, N., PREMRAJ, R., ZIMMERMANN, T., AND KIM, S. Extracting structural information from bug reports. In ACM International Working Conference on Mining Software Repositories (2008).
7. BRAUCKHOFF, D., DIMITROPOULOS, X., WAGNER, A., AND SALAMATIAN, K. Anomaly extraction in backbone networks using association rules. In ACM Internet Measurement Conference (2009).
8. BRUGNONI, S., BRUNO, G., MANIONE, R., MONTARIOLO, E., PASCHETTA, E., AND SISTO, L. An expert system for real time fault diagnosis of the italian telecommunications network. In International Symposium on Integrated Network Management (1993).
9. CHURCH, K., AND HANKS, P. Word association norms, mutual information, and lexicography. Journal of Computational Linguistics (1990).
10. COHEN, I., ZHANG, S., GOLDSZMIDT, M., SYMONS, J., KELLY, T., AND FOX, A. Capturing, indexing, clustering, and retrieving system history. In ACM SIGOPS Operating Systems Review (2005), ACM.
11. FIELDING, R. Representational state transfer (rest). Architectural Styles and the Design of Network-based Software Architectures. University of California, Irvine (2000), 120.
12. FORD, D., LABELLE, F., POPOVICI, F., STOKELY, M., TRUONG, V., BARROSO, L., GRIMES, C., AND QUINLAN, S. Availability in globally distributed storage systems. In USENIX Symposium on Operating Systems Design and Implementation (2010).
13. GILL, P., JAIN, N., AND NAGAPPAN, N. Understanding network failures in data centers: measurement, analysis, and implications. In SIGCOMM Computer Communication Review (2011).
14. GOLDSTEIN, J., KANTROWITZ, M., MITTAL, V., AND CARBONELL, J. Summarizing text documents: sentence selection and evaluation metrics. In International ACM SIGIR Conference on Research and Development in Information Retrieval (1999).
15. GORYACHEV, S., SORDO, M., ZENG, Q., AND NGO, L. Implementation and evaluation of four different methods of negation detection. Tech. rep., DSG, 2006.
16. GOYAL, A., DAUMÉ III, H., AND VENKATASUBRAMANIAN, S. Streaming for large scale NLP: Language modeling. In Annual Conference of the Association for Computational Linguistics (2009).
17. GRUBER, T., ET AL. Toward principles for the design of ontologies used for knowledge sharing. International Journal of Human Computer Studies (1995).
18. HEAFIELD, K. Kenlm: Faster and smaller language model queries. In Workshop on Statistical Machine Translation (2011).
19. HOOIMEIJER, P., AND WEIMER, W. Modeling bug report quality. In IEEE/ACM International Conference on Automated Software Engineering (2007).
20. HUANG, Y., FEAMSTER, N., LAKHINA, A., AND XU, J. Diagnosing network disruptions with network-wide analysis. In ACM SIGMETRICS Performance Evaluation Review (2007).
21. JOHNSON, D. Noc internal integrated trouble ticket system. http://goo.gl/eMZxX, January 1992.
22. JUST, S., PREMRAJ, R., AND ZIMMERMANN, T. Towards the next generation of bug tracking systems. In IEEE Symposium on Visual Languages and Human-Centric Computing (2008).
23. JUSTESON, J., AND KATZ, S. Technical terminology: some linguistic properties and an algorithm for identification in text. Journal of Natural language engineering (1995).
24. KANDULA, S., CHANDRA, R., AND KATABI, D. What's going on?: learning communication rules in edge networks. ACM SIGCOMM Computer Communication Review (2008).
25. KHANNA, G., CHENG, M., VARADHARAJAN, P., BAGCHI, S., CORREIA, M., AND VERÍSSIMO, P. Automated rule-based diagnosis through a distributed monitor system. IEEE Transactions on Dependable and Secure Computing (2007).
26. KITTUR, A., CHI, E., AND SUH, B. Crowdsourcing user studies with mechanical turk. In ACM SIGCHI Conference on Human factors in Computing Systems (2008).
27. LABOVITZ, C., AHUJA, A., AND JAHANIAN, F. Experimental study of internet stability and backbone failures. In IEEE International Symposium on Fault-Tolerant Computing (1999).
28. LIM, C., SINGH, N., AND YAJNIK, S. A log mining approach to failure analysis of enterprise telephony systems. In IEEE Dependable Systems and Networks (2008).
29. LOPER, E., AND BIRD, S. Nltk: The natural language toolkit. In Association for Computational Linguistics Workshop on Effective Tools and Methodologies for teaching Natural Language Processing and Computational Linguistics (2002).
30. MANBER, U., AND MYERS, G. Suffix arrays: a new method for on-line string searches. In ACM SIAM Journal on Computing (1990).
31. MANI, I., HOUSE, D., KLEIN, G., HIRSCHMAN, L., FIRMIN, T., AND SUNDHEIM, B. The tipster summac text summarization evaluation. In Association for Computational Linguistics (1999).
32. MANNING, C., RAGHAVAN, P., AND SCHUTZE, H. Introduction to information retrieval, vol. 1. Cambridge University Press Cambridge, 2008.
33. MANNING, C., AND SCHÜTZE, H. Foundations of statistical natural language processing. MIT Press, 1999.
34. MARCUS, M., MARCINKIEWICZ, M., AND SANTORINI, B. Building a large annotated corpus of english: The penn treebank. MIT Press Computational Linguistics (1993).
35. MCCALLUM, A., AND LI, W. Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons. In Association for Computational Linguistics Conference on Natural Language Learning (2003).
36. MEDEM, A., AKODJENOU, M., AND TEIXEIRA, R. Troubleminer: Mining network trouble tickets. In IEEE International Workshop Symposium on Integrated Network Management (2009).
37. MELCHIORS, C., AND TAROUCO, L. Troubleshooting network faults using past experience. In IEEE Network Operations and Management Symposium (2000).
38. MITRAY, M., SINGHALZ, A., AND BUCKLEYYY, C. Automatic text summarization by paragraph extraction. Compare (1997).
39. NAGAO, M., AND MORI, S. A new method of n-gram statistics for large number of n and automatic extraction of words and phrases from large text data of japanese. In ACL Computational Linguistics (1994).
40. NOY, N., MCGUINNESS, D., ET AL. Ontology development 101: A guide to creating your first ontology. Tech. rep., Stanford knowledge systems laboratory technical report KSL-01-05 and Stanford medical informatics technical report SMI-2001-0880, 2001.
41. QIU, T., GE, Z., PEI, D., WANG, J., AND XU, J. What happened in my network: mining network events from router syslogs. In ACM Internet Measurement Conference (2010).
42. ROUGHAN, M., GRIFFIN, T., MAO, Z., GREENBERG, A., AND FREEMAN, B. Ip forwarding anomalies and improving their detection using multiple data sources. In ACM SIGCOMM Workshop on Network Troubleshooting: Research, Theory and Operations Practice meet malfunctioning reality (2004).
43. RUNESON, P., ALEXANDERSSON, M., AND NYHOLM, O. Detection of duplicate defect reports using natural language processing. In IEEE International Conference on Software Engineering (2007).
44. S., D. Sharp NLP. http://goo.gl/Im4BK, December 2006.
45. SMADJA, F. Retrieving collocations from text: Xtract. MIT Press Computational linguistics (1993).
46. TOUTANOVA, K., AND MANNING, C. Enriching the knowledge sources used in a maximum entropy part-of-speech tagger. In ACL SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora (2000).
47. TURNER, D., LEVCHENKO, K., SNOEREN, A., AND SAVAGE, S. California fault lines: understanding the causes and impact of network failures. In ACM SIGCOMM Computer Communication Review (2010).
48. UKKONEN, E. On-line construction of suffix trees. Algorithmica (1995).
49. WELCH, T. Technique for high-performance data compression. Computer 17, 6 (1984), 8-19.
50. WU, F., AND WELD, D. Open information extraction using wikipedia. In Computational Linguistics (2010).
51. XU, W., HUANG, L., FOX, A., PATTERSON, D., AND JORDAN, M. Detecting large-scale system problems by mining console logs. In ACM SIGOPS Symposium on Operating Systems Principles (2009).
52. YAMAMOTO, M., AND CHURCH, K. Using suffix arrays to compute term frequency and document frequency for all substrings in a corpus. Computational Linguistics (2001).
53. YAMANISHI, K., AND MARUYAMA, Y. Dynamic syslog mining for network failure monitoring. In ACM SIGKDD International Conference on Knowledge Discovery in Data Mining (2005).
54. YUAN, D., MAI, H., XIONG, W., TAN, L., ZHOU, Y., AND PASUPATHY, S. Sherlog: error diagnosis by connecting clues from run-time logs. In ACM SIGARCH Computer Architecture News (2010).
55. ZHANG, J., GAO, J., AND ZHOU, M. Extraction of chinese compound words: An experimental study on a very large corpus. In ACL Workshop on Chinese Language Processing (2000).
56. ZHANG, L. N-Gram Extraction Tools. http://goo.gl/ 7gGF1, April 2012.