Inferring models of concurrent systems from logs of their behavior with CSight

Proceedings - International Conference on Software Engineering

Volumn , Issue CONFCODENUMBER, 2014, Pages 468-478

  Beschastnikh, Ivan ^a   Brun, Yuriy ^b   Ernst, Michael D ^c   Krishnamurthy, Arvind ^c  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b University of Massachusetts Amherst   (United States)

^c UNIVERSITY OF WASHINGTON   (United States)

Author keywords

concurrency; CSight; distributed systems; log analysis; Model inference

Indexed keywords

SOFTWARE ENGINEERING;

CONCURRENCY; CSIGHT; DISTRIBUTED SYSTEMS; LOG ANALYSIS; MODEL INFERENCE;

PROGRAM DEBUGGING;

EID: 84993661835     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2568225.2568246     Document Type: Conference Paper

References (59)

1. Fides Aarts, Faranak Heidarian, Harco Kuppens, Petur Olsen, and Frits W. Vaandrager. Automata learning through counterexample guided abstraction refinement. In the International Symposium on Formal Methods (FM), Paris, France, 2012.
2. Mithun Acharya, Tao Xie, Jian Pei, and Jun Xu. Mining API Patterns as Partial Orders from Source Code: From Usage Scenarios to Specifications. In the Joint Meeting of the European Software Engineering Conference and the International Symposium on the Foundations of Software Engineering (ESEC/FSE), Dubrovnik, Croatia, 2007.
3. Marcos K. Aguilera, Jeffrey C. Mogul, Janet L. Wiener, Patrick Reynolds, and Athicha Muthitacharoen. Performance Debugging for Distributed Systems of Black Boxes. Operating Systems Review (OSR), 37 (5): 74-89, October 2003.
4. Dalal Alrajeh, Jeff Kramer, Alessandra Russo, and Sebastin Uchitel. Learning Operational Requirements from Goal Models. In the International Conference on Software Engineering (ICSE), Vancouver, BC, Canada, 2009.
5. Dana Angluin. Finding Patterns Common to a Set of Strings. Journal of Computer and System Sciences, 21 (1): 46-62, 1980.
6. Paul Barham, Austin Donnelly, Rebecca Isaacs, and Richard Mortier. Using magpie for request extraction and workload modelling. In Networked Systems Design and Implementation (NSDI), San Francisco, CA, USA, 2004.
7. Ivan Beschastnikh, Yuriy Brun, Jenny Abrahamson, Michael D. Ernst, and Arvind Krishnamurthy. Unifying FSM-Inference Algorithms through Declarative Specification. In the International Conference on Software Engineering (ICSE), San Francisco, CA, USA, 2013.
8. Ivan Beschastnikh, Yuriy Brun, Michael D. Ernst, and Arvind Krishnamurthy. Inferring Models of Networked Systems from Logs of their Behavior with CSight. Technical report, http: //hdl. handle. net/2429/46122, Univ. of British Columbia, 2014.
9. Ivan Beschastnikh, Yuriy Brun, Michael D. Ernst, Arvind Krishnamurthy, and Thomas E. Anderson. Mining Temporal Invariants from Partially Ordered Logs. Operating Systems Review (OSR), 45 (3): 39-46, December 2011.
10. Ivan Beschastnikh, Yuriy Brun, Sigurd Schneider, Michael Sloan, and Michael D. Ernst. Leveraging Existing Instrumentation to Automatically Infer Invariant-Constrained Models. In the Joint Meeting of the European Software Engineering Conference and the International Symposium on the Foundations of Software Engineering (ESEC/FSE), Szeged, Hungary, 2011.
11. Alan W. Biermann and Jerome A. Feldman. On the synthesis of finite-state machines from samples of their behavior. IEEE Transactions on Computers (TC), 21 (6): 592-597, June 1972.
12. Lenore Blum and Manuel Blum. Toward a Mathematical Theory of Inductive Inference. Information and Control, 28 (2): 125-155, 1975.
13. Benedikt Bollig, Joost P. Katoen, Carsten Kern, and Martin Leucker. Learning Communicating Automata from MSCs. IEEE Transactions on Software Engineering (TSE), 36 (3): 390-408, May 2010.
14. Daniel Brand and Pitro Zafiropulo. On Communicating Finite-State Machines. Journal of the ACM, 30 (2): 323-342, April 1983.
15. Xiao J. Chen and Hasan Ural. Construction of Deadlock-free Designs of Communication Protocols from Observations. The Computer Journal, 45 (2): 162-173, January 2002.
16. Edmund Clarke, Orna Grumberg, Somesh Jha, Yuan Lu, and Helmut Veith. Counterexample-guided Abstraction Refinement. In Computer Aided Verification, pages 154-169, 2000.
17. Jonathan E. Cook, Zhidian Du, Chongbing Liu, and Alexander L. Wolf. Discovering models of behavior for concurrent workflows. Computers in Industry, 53 (3): 297-319, 2004.
18. Jonathan E. Cook and Alexander L. Wolf. Discovering Models of Software Processes from Event-Based Data. Transactions on Software Engineering and Methodology (TOSEM), 7 (3): 215-249, 1998.
19. Christophe Damas, Bernard Lambeau, and Axel van Lamsweerde. Scenarios, Goals, and State Machines: a Win-Win Partnership for Model Synthesis. In the International Symposium on the Foundations of Software Engineering (FSE), Portland, OR, USA, 2006.
20. Darren Dao, Jeannie Albrecht, Charles Killian, and Amin Vahdat. Live Debugging of Distributed Systems. In the International Conference on Compiler Construction (CC), Boston, MA, USA, 2009.
21. Guido de Caso, Victor Braberman, Diego Garbervetsky, and Sebastian Uchitel. Validation of Contracts Using Enabledness Preserving Finite State Abstractions. In the International Conference on Software Engineering (ICSE), Vancouver, BC, Canada, 2009.
22. Giuseppe DeCandia, Deniz Hastorun, Madan Jampani, Gunavardhan Kakulapati, Avinash Lakshman, Alex Pilchin, Swaminathan Sivasubramanian, Peter Vosshall, and Werner Vogels. Dynamo: Amazon's Highly Available Key-Value Store. In the Symposium on Operating Systems Principles (SOSP), Stevenson, WA, USA, 2007.
23. Brian Demsky, Michael D. Ernst, Philip J. Guo, Stephen Mc-Camant, Jeff H. Perkins, and Martin Rinard. Inference and enforcement of data structure consistency specifications. In the International Symposium on Software Testing and Analysis, pages 233-243, Portland, ME, USA, July 2006.
24. Matthew B. Dwyer, George S. Avrunin, and James C. Corbett. Patterns in Property Specifications for Finite-State Verification. In the International Conference on Software Engineering (ICSE), Los Angeles, CA, USA, 1999.
25. Colin J. Fidge. Timestamps in Message-Passing Systems that Preserve the Partial Ordering. In the Australian Computer Science Conference, pages 55-66, University of Queensland, Australia, 1988.
26. Rodrigo Fonseca, George Porter, Randy H. Katz, Scott Shenker, and Ion Stoica. X-Trace: A Pervasive Network Tracing Framework. In Networked Systems Design and Implementation (NSDI), Cambridge, MA, USA, 2007.
27. Dennis Geels, Gautam Altekar, Petros Maniatis, Timothy Roscoe, and Ion Stoica. Friday: Global Comprehension for Distributed Replay. In Networked Systems Design and Implementation (NSDI), Cambridge, MA, USA, 2007.
28. Carlo Ghezzi, Mauro Pezzè, Michele Sama, and Giordano Tamburrelli. Mining Behavior Models from User-intensive Web Applications. In the International Conference on Software Engineering (ICSE), Hyderabad, India, 2014.
29. Dimitra Giannakopoulou and Jeff Magee. Fluent Model Checking for Event-Based Systems. In the International Symposium on the Foundations of Software Engineering (FSE), Helsinki, Finland, 2003.
30. E. Mark Gold. Language Identification in the Limit. Information and Control, 10 (5): 447-474, 1967.
31. David Harel, Hillel Kugler, and Amir Pnueli. Synthesis Revisited: Generating Statechart Models from Scenario-Based Requirements. Formal Methods in Software and Systems Modeling, 3393, 2005.
32. Alexander Heussner, Tristan Gall, and Grégoire Sutre. Extrapolation-Based Path Invariants for Abstraction Refinement of Fifo Systems. In the International SPIN Workshop on Model Checking of Software, Grenoble, France, 2009.
33. Alexander Heussner, Tristan Le Gall, and Grégoire Sutre. McScM: A General Framework for the Verification of Communicating Machines. In the International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS), Tallinn, Estonia, 2012.
34. Gerard J. Holzmann. The Model Checker SPIN. IEEE Transactions on Software Engineering (TSE), 23 (5): 279-295, May 1997.
35. Guofei Jiang, Haifeng Chen, Cristian Ungureanu, and Kenji Yoshihira. Multi-resolution Abnormal Trace Detection Using Varied-length N-grams and Automata. In the International Conference on Autonomic Computing (ICAC), Seattle, WA, USA, 2005.
36. Ivo Krka, Yuriy Brun, George Edwards, and Nenad Medvidovic. Synthesizing Partial Component-Level Behavior Models from System Specifications. In the International Symposium on the Foundations of Software Engineering (FSE), Amsterdam, The Netherlands, 2009.
37. Sandeep Kumar, Siau-Cheng Khoo, Abhik Roychoudhury, and David Lo. Mining Message Sequence Graphs. In the International Conference on Software Engineering (ICSE), pages 91-100, Honolulu, HI, USA, 2011.
38. Sandeep Kumar, Siau-Cheng Khoo, Abhik Roychoudhury, and David Lo. Inferring Class Level Specifications for Distributed Systems. In the International Conference on Software Engineering (ICSE), Zurich, Switzerland, 2012.
39. Leslie Lamport. Time, Clocks, and the Ordering of Events in a Distributed System. Communications of the ACM, 21 (7): 558-565, July 1978.
40. Lee Lin and Michael D. Ernst. Improving the Adaptability of Multi-mode Systems via Program Steering. In the International Symposium on Software Testing and Analysis, pages 206-216, Boston, MA, USA, 2004.
41. Xuezheng Liu, Zhenyu Guo, Xi Wang, Feibo Chen, Xiaochen Lian, Jian Tang, Ming Wu, M. Frans Kaashoek, and Zheng Zhang. D3S: Debugging Deployed Distributed Systems. In Networked Systems Design and Implementation (NSDI), San Francisco, CA, USA, 2008.
42. David Lo, Leonardo Mariani, and Mauro Pezzè. Automatic Steering of Behavioral Model Inference. In the Joint Meeting of the European Software Engineering Conference and the International Symposium on the Foundations of Software Engineering (ESEC/FSE), Amsterdam, The Netherlands, 2009.
43. Davide Lorenzoli, Leonardo Mariani, and Mauro Pezzè. Automatic generation of software behavioral models. In the International Conference on Software Engineering (ICSE), Leipzig, Germany, 2008.
44. Jian G. Lou, Qiang Fu, Shengqi Yang, Ye Xu, and Jiang Li. Mining Invariants from Console Logs for System Problem Detection. In the USENIX Annual Technical Conference (ATC), Boston, MA, USA, 2010.
45. Friedemann Mattern. Virtual Time and Global States of Distributed Systems. In the International Workshop on Parallel and Distributed Algorithms, pages 215-226, Gers, France, 1989.
46. Tony Ohmann, Kevin Thai, Ivan Beschastnikh, and Yuriy Brun. Mining Precise Performance-Aware Behavioral Models from Existing Instrumentation. In the International Conference on Software Engineering New Ideas and Emerging Results (ICSE NIER) track, Hyderabad, India, 2014.
47. Jeff H. Perkins, Sunghun Kim, Sam Larsen, Saman Amarasinghe, Jonathan Bachrach, Michael Carbin, Carlos Pacheco, Frank Sherwood, Stelios Sidiroglou, Greg Sullivan, Weng-Fai Wong, Yoav Zibin, Michael D. Ernst, and Martin Rinard. Automatically patching errors in deployed software. In the Symposium on Operating Systems Principles (SOSP), pages 87-102, Big Sky, MT, USA, 2009.
48. Leonard Pitt and Manfred K. Warmuth. The Minimum Consistent DFA Problem Cannot be Approximated Within any Polynomial. Journal of the ACM, 40 (1): 95-142, 1993.
49. Steven P. Reiss and Manos Renieris. Encoding Program Executions. In the International Conference on Software Engineering (ICSE), Toronto, ON, Canada, 2001.
50. Patrick Reynolds, Charles Killian, Janet L. Wiener, Jeffrey C. Mogul, Mehul A. Shah, and Amin Vahdat. Pip: Detecting the Unexpected in Distributed Systems. In Networked Systems Design and Implementation (NSDI), San Jose, CA, USA, 2006.
51. Luigi Rizzo. Dummynet: a Simple Approach to the Evaluation of Network Protocols. Computer Communication Review (CCR), 27 (1): 31-41, January 1997.
52. Raja R. Sambasivan, Alice X. Zheng, Michael De Rosa, Elie Krevat, Spencer Whitman, Michael Stroucken, William Wang, Lianghong Xu, and Gregory R. Ganger. Diagnosing Performance Changes by Comparing Request Fows. In Networked Systems Design and Implementation (NSDI), Boston, MA, USA, 2011.
53. Jaspal Subhlok and Qiang Xu. Automatic Construction of Coordinated Performance Skeletons. In the International Parallel & Distributed Processing Symposium (IPDPS), Miami, FL, USA, 2008.
54. Andrew S. Tanenbaum and David J. Wetherall. Computer Networks. Prentice Hall, 5th edition, 2010.
55. Hasan Ural and Hüsnü Yenigün. Towards Design Recovery from Observations, volume 3235, chapter 9, pages 133-149. Springer Berlin Heidelberg, 2004.
56. Voldemort. http: //project-voldemort. com, 2013.
57. Wei Xu, Ling Huang, Armando Fox, David Patterson, and Michael I. Jordan. Detecting Large-Scale System Problems by Mining Console Logs. In the Symposium on Operating Systems Principles (SOSP), Big Sky, MT, USA, 2009.
58. Maysam Yabandeh, Nikola Knezevic, Dejan Kostic, and Viktor Kuncak. CrystalBall: predicting and preventing inconsistencies in deployed distributed systems. In Networked Systems Design and Implementation (NSDI), Boston, MA, USA, 2009.
59. Jinlin Yang, David Evans, Deepali Bhardwaj, Thirumalesh Bhat, and Manuvir Das. Perracotta: Mining Temporal API Rules from Imperfect Traces. In the International Conference on Software Engineering (ICSE), Shanghai, China, 2006.