Mapping Moving Landscapes by Mining Mountains of Logs: Novel Techniques for Dependency Model Generation

VLDB 2006 - Proceedings of the 32nd International Conference on Very Large Data Bases

Volumn , Issue , 2006, Pages 1093-1102

  Steinle, Mirko ^a   Aberer, Karl ^a   Girdzijauskas, Sarunas ^a   Lovis, Christian ^b  

^a EPFL   (Switzerland)

^b GENEVA UNIVERSITY HOSPITALS   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS;

AUTOMATED SUPPORT; DATA MINING ALGORITHM; DEPENDENCY MODEL; DISTRIBUTED SYSTEMS; MINING SYSTEMS; MODEL GENERATION; NOVEL TECHNIQUES; PERFORMANCE; ROOT CAUSE; TOOLS AND TECHNIQUES;

DATA MINING;

EID: 85134429679     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. Manoj K. Agarwal, Manish Gupta, Gautam Kar, Anindya Neogi, and Anca Sailer. Mining activity data for dynamic dependency discovery in e-business systems. Technical report, IBM Research Division, 2004.
2. Manoj K. Agarwal, Manish Gupta, Anindya Neogi, and Gautam Kar. Discovering dynamic dependencies in enterprise environments for problem determination. In Marcus Brunner and Alexander Keller, editors, DSOM, volume 2867 of Lecture Notes in Computer Science, pages 221–233. Springer, 2003.
3. Marcos K. Aguilera, Jeffrey C. Mogul, Janet L. Wiener, Patrick Reynolds, and Athicha Muthitacharoen. Performance debugging for distributed systems of black boxes. In SOSP’03, October 2003.
4. Denis Allard, Anders Brix, and Joel Chadoeuf. Testing local independence between two point processes. Biometrics, 57:508–517, June 2001.
5. S. Bagchi, J.L. Hellerstein, and G. Kar. Dependency analysis in distributed systems using fault injection: Application to problem determination in an e-commerce environment. In 12th Intl. Workshop on Distributed Systems: Operations & Management, 2001.
6. Mark Berman. Testing for spatial association between a point process and another stochastic process. Appplied Statistics, 35(1):54–62, 1986.
7. U. Blumenthal, G. Kar, and A. Keller. Classification and computation of dependencies for distributed management. In Proceedings of the Fifth IEEE Symposium on Computers and Communications (ISCC), pages 78 – 83, July 2000.
8. Bruce Boardman. Map quest. http://www.networkcomputing.com/showitem.jhtml?articleID=169600209, September 2005.
9. Jean-Yves Le Boudec. Performance evaluation of computer and communication systems. Swiss Federal Institute of Technology Lausanne, March 2005. Version 2.0.Beta.1. Available at http://icalwww.epfl.ch/perfeval.
10. E. Brewer, M. Chen, A. Fox, E. Fratkin, and E. Kiciman. Pinpoint: Problem determination in large, dynamic, internet services. In International Conference on Dependable Systems and Networks (IPDS Track), Washington D.C., 2002.
11. A. Brown, G. Kar, and A. Keller. An active approach to characterizing dynamic dependencies for problem determination in a distributed environment. In Seventh IFIP/IEEE International Symposium on Integrated Network Management, 2001.
12. Haifeng Chen, Guofei Jiang, Cristian Ungureanu, and Kenji Yoshihira. Failure detection and localization in component based systems by online tracking. In KDD ’05: Proceeding of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining, pages 750–755, New York, NY, USA, 2005. ACM Press.
13. OpenGroup consortium. Systems management: Application response measurement (arm). OpenGroup Technical Standard C807, UK ISBN 1-85912-211-6, 1998.
14. Ted Dunning. Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1):61–74, 1993.
15. C. Ensel. A scalable approach to automated service dependency modeling in heterogeneous environments. In Proceedings of the Fifth IEEE International Enterprise Distributed Object Computing Conference, pages 128–139, Seattle, WA, US, 2001.
16. C. Ensel. Abhaengigkeitsmodellierung im IT-Management: Erstellung eines neuen, auf Neuronalen Netzen basierenden Ansatzes. PhD thesis, Ludwig-Maximilians-Universitaet Muenchen, 2002.
17. Stefan Evert. The Statistics of Word Cooccurrences: Word Pairs and Collocations. PhD thesis, University of Stuttgart, 2004.
18. Stefan Evert. www.collocations.de. Web resources for collocation mining and coocurrence statistics, 2005.
19. G. Grabarnik, J. Hellerstein, S. Ma, C.-S. Perng, and D. Thoenen. Data-driven validation, completion and construction of event relationship networks. In Proceedings of SIGKDD’03, 2003.
20. Peer Hasselmeyer. Managing dynamic service dependencies. In 12th International Workshop on Distributed Systems: Operations & Management (DSOM 2001), Nancy, France, pages 141–150, 2001.
21. J.L. Hellerstein, J. Riosa, and D. Thoenen. Event relationship networks: A framework for action oriented analysis for event management. In International Symposium on Integrated Network Management, 2001.
22. Java management extensions (jmx). http://java.sun.com/products/JavaManagement/.
23. M.J. Katchabow. Making distributed applications manageable through instrumentation. Journal of Systems and Software, 45, 1999.
24. F. Kon and R.H. Campbell. Dependence management in component-based distributed systems. IEEE Concurrency, 8(1):26–36, 2000.
25. Tao Li and Sheng Ma. Mining temporal patterns without predefined time windows. In ICDM, pages 451–454, 2004.
26. Tao Li, Sheng Ma, and Wei Peng. Mining logs files for computing system management. SIGKDD Explorations, 2005.
27. V. Machiraju, J. Ouyang, A. Sahai, and K. Wurster. Message tracking in soap-based web services. In Proceedings of the Network Operations and Management Symposium, 2002. NOMS 2002. 2002 IEEE/IFIP, pages 33– 47, 2002.
28. Yuko Maruyama and Kenji Yamanishi. Dynamic syslog mining for network failure monitoring. In Proceedings of SIGKDD’05, 2005.
29. Ricardo Silva, James G. Shanahanand, and Jiji Zhang. Probabilistic workflow mining. In KDD’05: Proceeding of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining, pages 275–284, New York, NY, USA, 2005. ACM Press.
30. Jon Stearley. Towards informatic analysis of syslogs. In Proceedings of IEEE International Conference on Cluster Computing, September 2004.
31. M. Steinder and A. Sethi. The present and future of event correlation: A need for end-to-end service fault localization. In Proc. IIIS SCI: World Multi-Conf. Systemics Cybernetics Informatics, Orlando, FL, 2001.
32. Risto Vaarandi. A clustering algorithm for mining patterns from event logs. In Proc. of 2003 IEEE Workshop on IP Operations and Management (IPOM2003), 2003.