Integrating formal verification and conformance testing for reactive systems

IEEE Transactions on Software Engineering

Volumn 33, Issue 8, 2007, Pages 558-574

  Constant, Camille ^a   Jéron, Thierry ^a   Marchand, Hervé ^a   Rusu, Vlad ^a  

^a INRIA   (France)

Author keywords

Formal methods; Software program verification; Testing strategies

Indexed keywords

BLACK-BOX IMPLEMENTATION; CONFORMATNCE TESTING; VERIFICATION TESTING;

AUTOMATIC TESTING; AUTOMATION; FORMAL METHODS; SOFTWARE DESIGN; VERIFICATION;

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 34547091940     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSE.2007.70707     Document Type: Article

References (33)

1. ISO/IEC 9646, "Conformance Testing Methodology and Framework," 1992.
2. E. Brinskma, A. Alderen, R. Langerak, J. van de Laagemat, and J. Tretmans, "A Formal Approach to Conformance Testing," Proc. Conf. Protocol Secification, Testing, and Verification (PSTV '90), pp. 349-363, 1990.
3. J. Tretmans, "Test Generation with Inputs, Outputs, and Repetitive Quiescence," Software - Concepts and Tools, vol. 17, no. 3, pp. 103-120, 1996.
4. A. Gargantini and C.L. Heitmeyer, "Using Model Checking to Generate Tests from Requirements Specifications," Proc. European Software Eng. Conf. and ACM SIGSOFT Symp. Foundations of Software Eng. (ESEC/FSE '99), pp. 146-162, 1999.
5. C. Jard and T. Jéron, "TGV: Theory, Principles and Algorithms, a Tool for the Automatic Synthesis of Conformance Test Cases for Non-Deterministic Reactive Systems," Software Tools for Technology Transfer, vol. 6, Oct. 2004.
6. J. Blom, A. Hessel, B. Jonsson, and P. Pettersson, "Specifying and Generating Test Cases Using Observer Automata," Proc. Workshop Formal Approaches to Software Testing (FATES '04), J. Grabowski and B. Nielsen, eds., 2004.
7. H.S. Hong, I. Lee, O. Sokolsky, and H. Ural, "A Temporal Logic Based Theory of Test Coverage and Generation," Proc. Conf. Tools and Algorithms for the Construction and Analysis of Systems (TACAS '02), pp. 327-341, Apr. 2002.
8. O. Kupferman and M.Y. Vardi, "Model Checking of Safety Properties," Formal Methods in System Design, vol. 19, no. 3, pp. 291-314, 2001.
9. E. Brinskma, "A Theory for the Derivation of Tests," Proc. Conf. Protocol Specification, Testing, and Verification (PSTV '88), pp. 63-74, 1988.
10. P. Ammann, W. Ding, and D. Xu, "Using a Model Checker to Test Safety Properties," Proc. Int'l Conf. Eng. Complex Computer Systems, 2001.
11. G. Hamon, L. de Moura, and J. Rushby, "Generating Efficient Test Sets with a Model Checker," Proc. Second Int'l Conf. Software Eng. and Formal Methods, pp. 261-270, Sept. 2004.
12. J. Blom, A. Hessel, B. Jonsson, and P. Pettersson, "Specifying and Generating Test Cases Using Observer Automata," Proc. Formal Approaches to Software Testing, J. Grabowski and B. Nielsen, eds., pp. 137-152, 2004.
13. H. Hong, I. Lee, O. Sokolsky, and H. Ural, "A Temporal Logic Based Theory of Test Coverage and Generation," Proc. Conf. Tools and Algorithms for the Construction and Analysis of Systems (TACAS '02), pp. 327-341, 2002.
14. D. Peled, M. Vardi, and M. Yannakakis, "Black-Box Checking," J. Automata, Languages, and Combinatorics, vol. 7, no. 2, pp. 225-246, 2001.
15. J.C. Fernandez, L. Mounier, and C. Pachon, "Property-Oriented Test Generation," Proc. Formal Aspects of Software Testing Workshop, 2003.
16. R. de Vries and J. Tretmans, "Towards Formal Test Purposes," Formal Approaches to Testing of Software (FATES '01), pp. 61-76, 2001.
17. A. Belinfante, J. Feenstra, R. de Vries, J. Tretmans, N. Goga, L. Feijs, and S. Mauw, "Formal Test Automation: A Simple Experiment," Proc. Int'l Workshop Testing of Comm. Systems (IWTCS '99), 1996. pp. 179-196
18. K. Havelund and G. Rosu, "Synthesizing Monitors for Safety Properties," Proc. Int'l Conf. Tools and Algorithms for Construction and Analysis of Systems (TACAS '02), pp. 342-356, 2002.
19. M. Bozga, J.-C. Fernandez, L. Ghirvu, C. Jard, T. Jéron, A. Kerbrat, P. Morel, and L. Mounier, "Verification and Test Generation for the SSCOP Protocol," J. Science of Computer Programming, special issue on formal methods in industry, vol. 36, no. 1, pp. 27-52, Jan. 2000.
20. V. Rusu, H. Marchand, V. Tschaen, T. Je'ron, and B. Jeannet, "From Safety Verifcation to Safety Testing," Proc. Int'l Conf. Testing Comm. Systems (TestCom), 2004.
21. V. Rusu, H. Marchand, and T. Jéron, "Automatic Verification and Conformance Testing for Validating Safety Properties of Reactive Systems," Proc. Symp. Formal Methods Europe (FM), 2005.
22. V. Rusu, L. du Bousquet, and T. Jéron, "An Approach to Symbolic Test Generation," Proc. Int'l Conf. Integrating Formal Methods (IFM'00) pp. 338-357 2000.
23. B. Jeannet, T. Jéron, V. Rusu, and E. Zinovieva, "Symbolic Test Selection Based on Approximate Analysis," Proc. 11th Int'l Conf. Tools and Algorithms for the Construction and Analysis of Systems (TACAS '05), Apr. 2005.
24. P. Cousot and R. Cousot, "Abstract Interpretation: A Unified Lattice Model for Static Analysis of Programs by Construction or Approximation of Fixpoints," Proc. Fourth Symp. Principles of Programming Languages (POPL), pp. 238-252, Jan. 1977.
25. L. Helmink, M.P.A. Sellink, and F. Vaandrager, "Proof-Checking a Data Link Protocol," Proc. Conf. Types for Proofs and Programs (TYPES '94), pp. 127-165, 1994.
26. N. Lynch and M. Tuttle, "Introduction to IO Automata," CWI Quarterly, vol. 3, no. 2, 1999.
27. R.E. Shostak, "A Practical Decision Procedure for Arithmetic with Function Symbols," J. ACM vol. 26, no. 2, pp. 351-360, 1979.
28. J. Tretmans, "Testing Concurrent Systems: A Formal Approach," Proc. Conf. Conccurrency Theory (CONCUR '99) pp. 46-65, 1999.
29. T. Jéron, H. Marchand, and V. Rusu, "Symbolic Determinisation of Extended Automata," Proc. Fourth IFIP Int'l Conf. Theoretical Computer Science, 2006.
30. E. Zinovieva, "Symbolic Test Generation for Reactive Systems," PhD thesis, Univ. of Rennes I, Nov. 2004.
31. E.M. Clarke, O. Grumberg, and D.A. Peled, Model Checking. MIT Press, 1999.
32. D. Clarke, T. Jéron, V. Rusu, and E. Zinovieva, "STG: A Symbolic Test Generation Tool," Proc. Conf. Tools and Algorithms for the Construction and Analysis of Systems (TACAS '02) pp. 470-475, 2002.
33. B. Jeannet, "Dynamic Partitioning in Linear Relation Analysis," Formal Methods in System Design, vol. 23, no. 1, pp. 5-37, 2003.