An empirical evaluation of automated theorem provers in software certification

International Journal on Artificial Intelligence Tools

Volumn 15, Issue 1, 2006, Pages 81-107

  Denney, Ewen ^a   Fischer, Bernd ^a   Schumann, Johann ^a  

^a Research Institute for Advanced Computer Science   (United States)

Author keywords

Automated theorem proving; Hoare logic; Program synthesis; Proof checking; Software certification; Traceability; Verification condition generator

Indexed keywords

EID: 33746253214     PISSN: 02182130     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218213006002576     Document Type: Conference Paper

References (52)

1. M. Whalen, J. Schumann and B. Fischer, AutoBayes/CC - Combining Program Synthesis with Automatic Code Certification (System Description), in Proc. 18th Int. Conf. Automated Deduction, Lect. Notes Artif. Intelligence 2392, ed. A. Voronkov (Springer, Berlin, 2002), pp. 290-294.
2. M. Whalen, J. Schumann and B. Fischer, Synthesizing Certified Code, in Proc. Int. Symp. Formed Methods Europe 2002: Formal Methods - Getting IT Right, Lect. Notes Comp. Sci. 2391, eds. L.-H. Eriksson and P. A. Lindsay (Springer, Berlin, 2002), pp. 431-450.
3. J. Whittle and J. Schumann, Automating the Implementation of Kalman Filter Algorithms. ACM Transactions on Mathematical Software, 2005. To appear.
4. B. Fischer and J. Schumann, AutoBayes: A System for Generating Data Analysis Programs from Statistical Models, J. Functional Programming, 13(2003) 483-508.
5. E. Denney, B. Fischer and J. Schumann, An Empirical Evaluation of Automated Theorem Provers in Software Certification, in Proc. IJCAR 2004 Workshop on Empirically Successful First Order Reasoning (ESFOR), 2004.
6. E. Denney, B. Fischer and J. Schumann, Using Automated Theorem Provers to Certify Auto-Generated Aerospace Software, in Proc. Second Int. Joint Conf. Automated Reasoning, Lect. Notes Artif. Intelligence 3097, eds. D. Basin and M. Rusinowitch (Springer, Berlin, 2004), pp. 198-212.
7. W. Reif, The KIV Approach to Software Verification, in KORSO: Methods, Languages and Tools for the Construction of Correct Software, Lect. Notes Comp. Sci. 1009, eds. M. Broy and S. Jähnichen (Springer, Berlin, 1995), pp. 339-370.
8. W. Reif, G. Schellhorn, K. Stenzel and M. Balser, Structured Specifications and Interactive Proofs with KIV, in (Ref. 52), pp. 13-40.
9. P. Homeier and D. Martin, Trustworthy Tools for Trustworthy Programs: A Verified Verification Condition Generator, in Int. Workshop on Higher Order Logic Theorem Proving and its Applications, Lect. Notes Comp. Sci. 859, eds. T.F. Melham and J. Camilleri (Springer, Berlin, 1994), pp. 269-284.
10. D. von Oheimb and T. Nipkow, Machine-checking the Java Specification: Proving Type-Safety, in Formal Syntax and Semantics of Java, Lect. Notes Comp. Sci. 1523, ed. J. Alves-Foss (Springer, Berlin, 1999), pp. 119-156.
11. C. Flanagan, K. R. M. Leino, M. Lillibridge, G. Nelson, J. B. Saxe and R. Stata, Extended static checking for Java, in Proc. ACM Conf. Programming Language Design and Implementation 2002, ed. L. J. Hendren (ACM Press, New York, 2002), pp. 234-245.
12. C. Flanagan and K. R. M. Leino, Houdini, an Annotation Assistant for ESC/Java, in Proc. Int. Symp. Formal Methods Europe 2001: Formal Methods for Increasing Software Productivity, Lect. Notes Comp. Sci. 2021, eds. J. Oliveira and P. Zave (Springer, Berlin, 2001), pp. 500-517.
13. B. Jacobs and E. Poll, Java program verification at Nijmegen: Developments and perspective, Technical Report NIII-R0318, Dept. of Computer Science, University of Nijmegen, 2003.
14. J. van den Berg and B. Jacobs, The LOOP Compiler for Java and JML, in Proc. 7th Int. Workshop Tools and Algorithms for the Construction and Analysis of Systems, Lect. Notes Comp. Sci. 2031, eds. T. Margaria and W. Yi (Springer, Berlin, 2001), pp. 299-312.
15. G. T. Leavens, A. L. Baker and C. Ruby, JML: A Notation for Detailed Design, in Behavioral Specifications of Businesses and Systems eds. H. Kilov, B. Rumpe and I. Simmonds (Kluwer, Dordrecht, 1999), pp. 175-188.
16. G. C. Necula, Proof-Carrying Code, in Proc. 24th ACM. Symp. Principles of Programming Languages, (ACM Press, New York, 1997), pp. 106-119.
17. G. C. Necula and P. Lee, The Design and Implementation of a Certifying Compiler, in Proc. ACM Conf. Programming Language Design and Implementation 1998, ed. K. D. Cooper (ACM Press, New York, 1998), pp. 333-344.
18. A. W. Appel, N. Michael, A. Stump and R. Virga, A Trustworthy Proof Checker, J. Automated Reasoning, 31(2003) 191-229.
19. G. Sutcliffe and C. Suttner, The CADE-19 ATP System Competition, AI Communications, 17(2004) 103-110.
20. G. Sutcliffe, The CADE-J2 ATP System Competition, 2004. www.tptp. org/CASC/J2/.
21. G. Sutcliffe, C. B. Suttner and T. Yemenis, The TPTP Problem Library, in Proc. 12th Int. Conf. Automated Deduction, Lect. Notes Artif. Intelligence 814, ed. A. Bundy (Springer, Berlin, 1994), pp. 252-266.
22. G. Sutcliffe and C. Suttner, TPTP Home Page, 2003. www.tptp.org.
23. B. Fischer, Deduction-Based Software Component Retrieval, PhD thesis, U Passau, 2001. Available at http://elib.ub.uni-passau.de/opus/volltexte/2002/23/.
24. B. Fischer, J. Schumann and G. Snelting, Deduction-Based Software Component Retrieval, in (Ref. 52), pp. 265-292.
25. G. Brat and A. Venet, Precise and Scalable Static Program Analysis of NASA Flight Software, in Proc. IEEE Aerospace Conf., IEEE Comp. Soc. Press, 2005. To appear.
26. G. J. Holzmann, The Spin Model Checker: Primer and Reference Manual (Addison-Wesley, 2003).
27. E. Denney and B. Fischer, Correctness of Source-Level Safety Policies, in Proc. FM 2003: Formal Methods, Lect. Notes Comp. Sci. 2805, eds. K. Araki, S. Gnesi and D. Mandrioli (Springer, Berlin, 2003), pp. 894-913.
28. W. McCune and O. Shumsky, System description: Ivy, in Proc. 17th Int. Conf. Automated Deduction, Lect. Notes Artif. Intelligence 1831, ed. D. McAllester (Springer, Berlin, 2000), pp. 401-405.
29. B. Fischer, A. Hajian, K. Knuth and J. Schumann, Automatic Derivation of Statistical Data Analysis Algorithms: Planetary Nebulae and Beyond, in Proc. 23rd Int. Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering eds. G. Erickson and Y. Zhai (American Institute of Physics, 2003), pp. 276-291.
30. B. Fischer and J. Schumann, Applying AutoBayes to the Analysis of Planetary Nebulae Images, in Proc. 18th Int. Conf. Automated Software Engineering eds. J. Grundy and J. Penix (IEEE Comp. Soc. Press, 2003), pp. 337-342.
31. J. Schumann, Automated Theorem Proving in Software Engineering (Springer, Berlin, 2001).
32. J. McCarthy, Towards a Mathematical Science of Computation, in Proc. IFIP Congress 1962 (North-Holland, Amsterdam, 1962), pp. 21-28.
33. R. Letz and G. Stenz, DCTP: A Disconnection Calculus Theorem Prover, in Proc. First Int. Joint Conf. Automated Reasoning, Lect. Notes Artif. Intelligence 2083, eds. R. Gore, A. Leitsch and T. Nipkow (Springer, Berlin, 2001), pp. 381-385.
34. M. Moser, O. Ibens, R. Letz, J. Steinbach, C. Goller, J. Schumann and K. Mayr, The Model Elimination Provers SETHEO and E-SETHEO, J. Automated Reasoning, 18(1997) 237-246.
35. C. Weidenbach, SPASS Home Page, 2003. http://spass.mpi-sb.mpg.de.
36. C. Weidenbach, B. Gaede and G. Rock, Spass and Flotter version 0.42, in Proc. 13th Int. Conf. Automated Deduction, Lect. Notes Artif. Intelligence 1104, eds. M. A. McRobbie and J. K. Slaney (Springer, Berlin, 1996), pp. 141-145.
37. S. Schulz, E - A Brainiac Theorem Prover, AI Communications, 15(2002) 111-126.
38. T. Tammet, Gandalf, J. Automated Reasoning, 18(1997) 199-204.
39. A. Riazanov and A. Voronkov, The Design and Implementation of Vampire, AI Communications, 15(2002) 91-110.
40. W. McCune and L. Wos, Otter - The CADE-13 Competition Incarnations, J. Automated Reasoning, 18(1997) 211-220.
41. D. W. Loveland, Automated. Theorem Proving: a Logical. Basis (North-Holland, Amsterdam, 1978).
42. W. Reif and G. Schellhorn, Theorem Proving in Large Theories, in (Ref. 52), pp. 225-242.
43. M. Kaufmann and J S. Moore, An Industrial Strength Theorem Prover for a Logic Based on Common Lisp, Software Engineering, 23(1997) 203-213.
44. AP: Lean Tableau-based Deduction, J. Automated Reasoning, 15(1995) 339-358.
45. RTCA Special Committee 167, Software Considerations in Airborne Systems and Equipment Certification, Technical report, RTCA, Inc., December 1992.
46. S. Nelson and J. Schumann, What makes a Code Review Trustworthy? in Proc. Thirty-Seventh Annual. Hawaii Int. Conf. on System Sciences (HICSS-37). IEEE Comp. Soc. Press, 2004.
47. R. Fraer, Tracing the Origins of Verification Conditions, in Proc. 5th Int. Conf. on Algebraic Methodology and Software Technology, Lect. Notes Comp. Sci. 1101, eds. M. Wirsing and M. Nivat (Springer, Berlin, 1996), pp. 241-255.
48. D. L. Detlefs, G. Nelson and J. B. Saxe. Simplify: A Theorem Prover for Program Checking, Technical Report HPL-2003-148, HP Labs, 2003.
49. E. Denney and R. P. Venkatesan, A Generic Software Safety Document Generator, in Proc. 10th Int. Conf. on Algebraic Methodology and Software Technology, Lect. Notes Comp. Sci. 3097, eds. C. Rattray, S. Maharaj and C. Shankland (Springer, Berlin, 2004), pp. 102-116.
50. E. Denney, B. Fischer and J. Schumann, Adding Assurance to Automatically Generated Code, in Proc. 8th Int. Symp. High-Assurance Systems Engineering, ed. C. V. Ramamoorthy (IEEE Comp. Soc. Press, 2004), pp. 297-299.
51. The Programatica Team, Programatica Tools for Certifiable, Auditable Development of High-assurance Systems in Haskell, in Proc. High Confidence Software and Systems Conf., 2003. Available via www.cse.ogi.edu/PacSoft/ projects/programatica.
52. W. Bibel and P. H. Schmitt (eds.), Automated Deduction - A Basis for Applications (Kluwer, Dordrecht, 1998).