Predicting and preventing inconsistencies in deployed distributed systems

ACM Transactions on Computer Systems

Volumn 28, Issue 1, 2010, Pages

  Yabandeh, Maysam ^a   Knežević, Nikola ^a   Kostić, Dejan ^a   Kuncak, Viktor ^a  

^a EPFL   (Switzerland)

Author keywords

Consequence prediction; Distributed systems; Enforcing safety properties; Execution steering; Reliability

Indexed keywords

DETECT AND AVOID; DISTRIBUTED SYSTEMS; ENFORCING SAFETY PROPERTIES; NEW APPROACHES; POSSIBLE FUTURES; RUNTIMES; SAFETY PROPERTY; STATE EXPLORATION ALGORITHMS; SYSTEM DEVELOPMENT; THREE SYSTEMS;

FORECASTING;

EID: 77950808422     PISSN: 07342071     EISSN: 15577333     Source Type: Journal    
DOI: 10.1145/1731060.1731062     Document Type: Article

References (63)

1. ARNOLD, M., VECHEV, M., AND YAHAV, E. 2008. Qvm: An efficient runtime for detecting defects in deployed systems. In Proceedings of the 23rd ACM SIGPLAN Conference on Object-Oriented Programming Systems Languages and Applications (OOPSLA'08). ACM, New York, NY, 143-162.
2. BALL, T., PODELSKI, A., AND RAJAMANI, S. K. 2001. Boolean and cartesian abstraction for model checking C programs. In Proceedings of the Workshop on Tools and Algorithms for the Construction and Analysis of Systems.
3. BALL, T. AND RAJAMANI, S. K. 2002. The SLAM project: Debugging system software via static analysis. In Proceedings of the ACM Symposium on Principles of Programming Languages.
4. BARHAM, P., DONNELLY, A., ISAACS, R., AND MORTIER, R. 2004. Using magpie for request extraction and workload modelling. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation.
5. BAYAZIT, A. A. AND MALIK, S. 2005. Complementary use of runtime validation and model checking. In Proceedings of the IEEE/ACM International Conference on Computer-Aided Design (ICCAD'05). IEEE Computer Society, Los Alamitos, CA, 1052-1059.
6. BURCH, J. R., CLARKE, E. M., MCMILLAN, K. L., DILL, D. L., AND HWANG, L. J. 1990. Symbolic model checking: 1020 states and beyond. In Proceedings of the Annual IEEE Symposium on Logic in Computer Science.
7. CASTRO, M., DRUSCHEL, P., KERMARREC, A.-M., NANDI, A., ROWSTRON, A., AND SINGH, A. 2003. Splitstream: High-bandwidth content distribution in cooperative environments. In Proceedings of the ACM Symposium on Operating Systems Principles.
8. CHAKI, S., CLARKE, E., GROCE, A., JHA, S., AND VEITH, H. 2003. Modular verification of software components in C. IEEE Trans. Softw. Engin. 30, 6.
9. CHANDRA, T. D., GRIESEMER, R., AND REDSTONE, J. 2007. Paxos made live: An engineering perspective. In Proceedings of the Annual ACM Symposium on Principles of Distributed Computing.
10. CHANDY, K. M. AND LAMPORT, L. 1985. Distributed snapshots: Determining global states of distributed systems. ACM Trans. Comput. Syst. 3, 1, 63-75.
11. CHANG, H., GOVINDAN, R., JAMIN, S., SHENKER, S., AND WILLINGER, W. 2002. Towards capturing representative AS-level internet topologies. In Proceedings of the ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems.
12. CHU, Y., RAO, S. G., SESHAN, S., AND ZHANG, H. 2002. A case for end system multicast. IEEE J. Sel. Areas Comm. 20, 8, 1456-1471.
13. COSTA, M., CASTRO, M., ZHOU, L., ZHANG, L., AND PEINADO, M. 2007. Bouncer: Securing software by blocking bad input. In Proceedings of the ACM Symposium on Operating Systems Principles.
14. COSTA, M., CROWCROFT, J., CASTRO, M., ROWSTRON, A., ZHOU, L., ZHANG, L., AND BARHAM, P. 2005. Vigilante: End-to-end containment of internet worms. In Proceedings of the ACM Symposium on Operating Systems Principles.
15. DAGAND, P.-E., KOSTÍC, D., AND KUNCAK, V. 2009. Opis: Reliable distributed systems in OCaml. In Proceedings of the ACM SIGPLAN Workshop on Types in Language Design and Implementation.
16. DAO,D.,ALBRECHT, J. R.,KILLIAN, C. E., ANDVAHDAT,A. 2009. Live debugging of distributed systems. In Proceedings of the International Conference on Compiler Construction.
17. DEMSKY, B. AND RINARD, M. 2003. Automatic detection and repair of errors in data structures. In Proceedings of the Conference on Object-Oriented Programming Systems, Languages, and Applications.
18. DUNAGAN, J., HARVEY, N. J. A., JONES, M. B., KOSTÍC, D., THEIMER, M., ANDWOLMAN, A. 2004. FUSE: Lightweight guaranteed distributed failure notification. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation.
19. FISCHER, M., LYNCH, N., AND PATERSON, M. 1985. Impossibility of distributed consensus with one faulty process. J. ACM 32, 2, 374-382.
20. FLANAGAN, C. AND GODEFROID, P. 2005. Dynamic partial-order reduction for model checking software. In Proceedings of the ACM Symposium on Principles of Programming Languages.
21. FONSECA, R., PORTER, G., KATZ, R. H., SHENKER, S., AND STOICA, I. 2007. X-Trace: A pervasive network tracing framework. In Proceedings of the ACM/USENIX Symposium on Networked Systems Design and Implementation.
22. GEELS, D., ALTEKAR, G.,MANIATIS, P., ROSCOE, T., AND STOICA, I. 2007. Friday: Global comprehension for distributed replay. In Proceedings of the ACM/USENIX Symposium on Networked Systems Design and Implementation.
23. GODEFROID, P. AND WOLPER, P. 1994. A partial approach to model checking. Inf. Comput. 110, 2, 305-326.
24. HENZINGER, T. A., JHALA, R., MAJUMDAR, R., AND SUTRE, G. 2002. Lazy abstraction. In Proceedings of the ACM Symposium on Principles of Programming Languages.
25. HOLZMANN, G. J. 1997. The model checker SPIN. IEEE Trans. Softw. Engin. 23, 5, 279-295.
26. JAIN, N., MAHAJAN, P., KIT, D., YALAGANDULA, P., DAHLIN, M., AND ZHANG, Y. 2008. Network imprecision: Anew consistency metric for scalable monitoring. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation.
27. JANJUA, M. U. AND MYCROFT, A. 2006. Automatic correction to safety violations. In Proceedings of the International Conference on Thread Verification (TV'06).
28. JOBSTMANN, B., GRIESMAYER, A., AND BLOEM, R. 2005. Program repair as a game. In Proceedings of the International Conference on Computer Aided Verification. 226-238.
29. JOHN, J. P., KATZ-BASSETT, E., KRISHNAMURTHY, A., ANDERSON, T., AND VENKATARAMANI, A. 2008. Consensus routing: The internet as a distributed system. In Proceedings of the ACM/USENIX Symposium on Networked Systems Design and Implementation.
30. KILLIAN, C. E., ANDERSON, J. W., BRAUD, R., JHALA, R., AND VAHDAT, A. M. 2007a. Mace: Language support for building distributed systems. In Proceedings of the Conference on Programming Language Design and Implementation.
31. KILLIAN, C. E., ANDERSON, J. W., JHALA, R., AND VAHDAT, A. 2007b. Life, death, and the critical transition: Finding liveness bugs in systems code. In Proceedings of the ACM/USENIX Symposium on Networked Systems Design and Implementation.
32. KOSTÍC, D., BRAUD, R., KILLIAN, C., VANDEKIEFT, E., ANDERSON, J. W., SNOEREN, A. C., AND VAHDAT, A. 2005. Maintaining high bandwidth under dynamic network conditions. In Proceedings of the USENIX Annual Technical Conference.
33. KOSTÍC, D., RODRIGUEZ, A., ALBRECHT, J., BHIRUD, A., AND VAHDAT, A. 2003. Using random subsets to build scalable network services. In Proceedings of the USENIX Symposium on Internet Technologies and Systems.
34. LAMPORT, L. 1978. Time, clocks, and the ordering of events in a distributed system. Comm. ACM 21, 7, 558-565.
35. LAMPORT, L. 1998. The part-time parliament. ACM Trans. Comput. Syst. 16, 2, 133-169.
36. LIU, X., GUO, Z., WANG, X., CHEN, F., LIAN, X., TANG, J., WU, M., KAASHOEK, M. F., AND ZHANG, Z. 2008. D3S: Debugging deployed distributed systems. In Proceedings of the ACM/USENIX Symposium on Networked Systems Design and Implementation.
37. LIU, X., LIN, W., PAN, A., AND ZHANG, Z. 2007. WiDS checker: Combating bugs in distributed systems. In Proceedings of the ACM/USENIX Symposium on Networked Systems Design and Implementation.
38. MANIVANNAN, D. AND SINGHAL, M. 2002. Asynchronous recovery without using vector timestamps. J. Parall. Distrib. Comput. 62, 12, 1695-1728.
39. MUSUVATHI, M. AND ENGLER, D. R. 2004. Model checking large network protocol implementations. In Proceedings of the ACM/USENIX Symposium on Networked Systems Design and Implementation.
40. MUSUVATHI, M., PARK, D. Y. W., CHOU, A., ENGLER, D. R., AND DILL, D. L. 2002. CMC: A pragmatic approach to model checking real code. SIGOPS Oper. Syst. Rev. 36, SI, 75-88.
41. MUSUVATHI, M. AND QADEER, S. 2007. Iterative context bounding for systematic testing of multithreaded programs. In Proceedings of the Conference on Programming Language Design and Implementation. 446-455.
42. MUSUVATHI, M., QADEER, S., BALL, T., BASLER, G., NAINAR, P. A., AND NEAMTIU, I. 2008. Finding and reproducing heisenbugs in concurrent programs. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation.
43. NIGHTINGALE, E. B., CHEN, P. M., AND FLINN, J. 2005. Speculative execution in a distributed file system. In Proceedings of the ACM Symposium on Operating Systems Principles.
44. PORTER, D. E., HOFMANN, O. S., ROSSBACH, C. J., BENN, A., AND WITCHEL, E. 2009. Operating systems transactions. In Proceedings of the 22nd ACM SIGOPS Symposium on Operating Systems Principles (SOSP'09). ACM, New York, NY, 161-176.
45. QIN, F., TUCEK, J., ZHOU, Y., AND SUNDARESAN, J. 2007. Rx: Treating bugs as allergies-A safe method to survive software failures. ACM Trans. Comput. Syst. 25, 3.
46. REYNOLDS, P., KILLIAN, C., WIENER, J. L., MOGUL, J. C., SHAH, M. A., AND VAHDAT, A. 2006. Pip: Detecting the unexpected in distributed systems. In Proceedings of the ACM/USENIX Symposium on Networked Systems Design and Implementation.
47. RHEA, S., GODFREY, B., KARP, B., KUBIATOWICZ, J., RATNASAMY, S., SHENKER, S., STOICA, I., AND YU, H. 2005. OpenDHT: A public DHT service and its uses. In Proceedings of the ACM SIGCOMM Conference.
48. RINARD, M. C., CADAR, C., DUMITRAN, D., ROY, D. M., LEU, T., AND BEEBEE, W. S. 2004. Enhancing server availability and security through failure-oblivious computing. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation.
49. RODRIGUEZ, A., KILLIAN, C., BHAT, S., KOSTÍC, D., AND VAHDAT, A. 2004. MACEDON: Methodology for automatically creating, evaluating, and designing overlay networks. In Proceedings of the ACM/USENIX Symposium on Networked Systems Design and Implementation.
50. ROWSTRON, A. AND DRUSCHEL, P. 2001. Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility. In Proceedings of the ACM Symposium on Operating Systems Principles.
51. SCHNEIDER, F. B. 1990. Implementing fault-tolerant services using the state machine approach: a tutorial. ACM Comput. Surv. 22, 4, 299-319.
52. SEN, K. AND AGHA, G. 2006. Automated systematic testing of open distributed programs. In Proceedings of the International Conference on Fundamental Approaches to Software Engineering. 339-356.
53. SINGH, A., MANIATIS, P., ROSCOE, T., AND DRUSCHEL, P. 2006. Using queries for distributed monitoring and forensics. SIGOPS Oper. Syst. Rev. 40, 4, 389-402.
54. SRINIVASAN, S. M., K, S., ANDREWS, C. R., AND ZHOU, Y. 2004. Flashback: A lightweight extension for rollback and deterministic replay for software debugging. In Proceedings of the USENIX Annual Technical Conference.
55. STOICA, I.,MORRIS, R., LIBEN-NOWELL, D., KARGER, D. R., KAASHOEK,M. F., DABEK, F., AND BALAKRISHNAN, H. 2003. Chord: A scalable peer-to-peer lookup protocol for internet applications. IEEE/ACM Trans. Netw. 11, 1, 17-32.
56. VAHDAT, A., YOCUM, K.,WALSH, K.,MAHADEVAN, P., KOSTÍC, D., CHASE, J., AND BECKER, D. 2002. Scalability and accuracy in a large-scale network emulator. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation.
57. WANG,Y.,KELLY, T.,KUDLUR, M., LAFORTUNE, S., ANDMAHLKE, S.A. 2008. Gadara: Dynamic deadlock avoidance for multithreaded programs. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation.
58. WANG, Y., LAFORTUNE, S.,KELLY, T.,KUDLUR, M., ANDMAHLKE, S. 2009. The theory of deadlock avoidance via discrete control. In Proceedings of the ACM Symposium on Principles of Programming Languages.
59. YABANDEH, M., KNEZEVÍC, N., KOSTÍC, D., AND KUNCAK, V. 2009a. CrystalBall: Predicting and preventing inconsistencies in deployed distributed systems. In Proceedings of the ACM/USENIX Symposium on Networked Systems Design and Implementation.
60. YABANDEH, M., VASÍC, N., KOSTÍC, D., AND KUNCAK, V. 2009b. Simplifying distributed system development. In Proceedings of the Workshop on Hot Topics in Operating Systems.
61. YANG, J., CHEN, T., WU, M., XU, Z., LIU, X., LIN, H., YANG, M., LONG, F., ZHANG, L., AND ZHOU, L. 2009. MODIST: Transparent model checking of unmodified distributed systems. In Proceedings of the ACM/USENIX Symposium on Networked Systems Design and Implementation.
62. YANG, J., SAR, C., AND ENGLER, D. 2006a. EXPLODE: A lightweight, general system for finding serious storage system errors. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation.
63. YANG, J., TWOHEY, P., ENGLER, D., AND MUSUVATHI, M. 2006b. Using model checking to find serious file system errors. ACM Trans. Comput. Syst. 24, 4, 393-423.