A framework and tool support for the systematic testing of model-based specifications

ACM Transactions on Software Engineering and Methodology

Volumn 12, Issue 4, 2003, Pages 409-439

  Miller, Tim ^a   Strooper, Paul ^a  

^a UNIVERSITY OF QUEENSLAND   (Australia)

Author keywords

Formal verification; Specification animation; Testgraphs; Testing

Indexed keywords

FORMAL VERIFICATION; MODEL-BASED SPECIFICATIONS; SPECIFICATION ANIMATION; TESTGRAPHS;

AUTOMATION; BOUNDARY CONDITIONS; GRAPH THEORY; SOFTWARE ENGINEERING; SPECIFICATIONS; TESTING; THEOREM PROVING;

ANIMATION;

EID: 2542488419     PISSN: 1049331X     EISSN: None     Source Type: Journal    
DOI: 10.1145/990010.990012     Document Type: Review

References (35)

1. AMMANN, P. AND BLACK, P. 1999. A specification-based coverage metric to evaluate test suites. Int. J. Reliab., Qual. Saf. Engg. 8, 4, pp. 275-300.
2. AMMANN, P., BLACK, P., AND MAJURSKI, W. 1998. Using model checking to generate tests from specifications. In Proceedings of the 2nd IEEE International Conference on Formal Engineering Methods. IEEE Computer Society, pp. 46-54.
3. CALLAHAN, J. S. E., AND MONTGOMERY, T. 1998. Generating test oracles via model checking. Technical Report NASA-IVV-98-015, NASA/West Virginia University Software Research Laboratory.
4. CARRINGTON, D., MACCoLL, L, MCDONALD, J., MURRAY, L., AND STROOPER, P. 2000. From Object-Z specifications to Classbench test suites. J. Softw. Test., Verif. Reliab. 10, 2, pp. 111-137.
5. CARRINGTON, D. AND STOCKS, P. 1994. A tale of two paradigms: Formal methods and software testing. In ZUM'94, Z User Workshop, J.P.Bowen and J. Hall, Eds. Springer-Verlag, pp. 5168.
6. CHANG, K. H., LIAO, S. S., SEIDMAN, S. B., AND CHAPMAN, E. 1998. Testing object-oriented programs: from formal specification to test scenario generation. J. Syst. Softw. 42, 2, pp. 141-151.
7. CLARKE, E., GRUMBERG, O., AND PELED, D. A. 1999. Model Checking. MIT Press, Cambridge, Mass.
8. DEMILLO, R., LIPTON, R., AND SAYWARD, F. 1978. Hints on test data selection: Help for the practicing programmer. IEEE Comput. 11, 4, pp. 34-41.
9. DICK, J. AND FAIVRE, A. 1993. Automating the generation and sequencing of test cases from model-based specifications. In Formal Methods Europe (FME'93): Industrial-Strength Formal Methods. Springer-Verlag, pp. 268-284.
10. DUKE, R. AND ROSE, G. 2000. Formal Object-Oriented Specification Using Object-Z. MacMillan Press Limited, London.
11. HAMILTON, N., HAZEL, D., KEARNEY, P., TRAYNOR, O., AND WILDMAN, L. 1998. A complete formal development using Cogito. In Computer Science '98: Proceedings of the 21st Australasian Computer Science Conference. Springer-Verlag, pp. 319-330.
12. HAZEL, D., STROOPER, P., AND TRAYNOR, O. 1997. Possum: An animator for the SUM specification language. In Proceedings of Asia-Pacific Software Engineering Conference and International Computer Science Conference. IEEE Computer Society, pp. 42-51.
13. HAZEL, D., STEOOPER, P., AND TRAYNOR, O. 1998. Requirements engineering and verification using specification animation. In the 13th IEEE International Conference on Automated Software Engineering. IEEE Computer Society, pp. 302-305.
14. HEITMEYER, C., KIRBY, J., LABAW, B., AND BHAEADWAJ, R. 1998. SCR*: A toolset for specifying and analysing software requirements. In Proceedings of Computer-Aided Verification 10th Annual Conference (CAV'98). Springer-Verlag, pp. 526-531.
15. HEWITT, M., O'HALLORAN, C., AND SENNETT, C. 1997. Experiences with PiZA, an animator for Z. In ZUM'97: The Z Formal Specification Notation. Springer-Verlag, pp. 37-51.
16. HIERONS, R. M. 1997. Testing from a Z specification. Softw. Test., Verif. Reliab. 7, 1, pp. 19-33.
17. HOFFMAN, D. M. AND STROOPER, P. A. 1995. The testgraphs methodology-automated testing of collection classes. J. Obj.-Orient. Program., pp. 35-41.
18. HOFFMAN, D. M. AND STROOPER, P. A. 1998. ClassBench: A methodology and framework for automated class testing. In Testing Object-Oriented Software, D. C. Kung, P. Hsia, and J. Gao, Eds. IEEE Computer Society, pp. 152-176.
19. IFAD. Features of VDM tools, http://www.ifad.dk/products/vdmtools/ features.htm.
20. KAZMIERCZAK, E., DART, P., STIRLING, L., AND WINIKOFF, M. 2000. Verifying requirements through mathematical modelling and animation. Int. J. Softw. Engg. Knowl. Engg. 10, 2, pp. 251-273.
21. KAZMIERCZAK, E., KEARNEY, P., TRAYNOR, O., AND WANG, L. 1995. A modular extension to Z for specification, reasoning and refinement. Technical report 95-15, Software Verification Research Centre. February.
22. LEGEARD, B., PEUREUX, F., AND UTTING, M. 2002. Automated boundary testing from Z and B. In Proceedings of Formal Methods Europe 2002. Springer, pp. 21-40.
23. Liu, S. 1999. Verifying consistency and validity of formal specifications by testing. In Proceedings of the World Congress on Formal Methods in the Development of Computing Systems. Springer-Verlag, pp. 896-914.
24. MILLER, T. AND STROOPER, P. 2001. Animation can show only the presence of errors, never their absence. In the Australian Software Engineering Conference (ASWEC 2001) (Canberra, Australia). IEEE Computer Society Press, pp. 76-85.
25. MILLER, T. AND STROOPER, P. 2002a. A framework and tool support for the systematic testing of model-based specifications. Technical Report 02-35, SVRC, The University of Queensland, Australia.
26. MILLER, T. AND STROOPER, P. 2002b. Model-based animation using testgraphs. In the International Conference on Formal Engineering Methods. Springer Verlag, pp. 192-203.
27. MILLER, T. AND STROOPER, P. 2003. Supporting the software testing process through specification animation. In the 1st International Conference on Software Engineering and Formal Methods. IEEE Computer Society, pp. 14-23.
28. MURRAY, L., CARRINGTON, D., MACCOLL, L, MCDONALD, J., AND STROOPER, P. 1998. Formal derivation of finite state machines for class testing. In ZUM'98: The Z Formal Specification Notation, J. B. Hinchey, A. Fett, and M.G., Eds. Vol. 1493. Springer-Verlag, pp. 42-59.
29. ROBINSON, N., BARNEY, D., KEARNEY, P., NIKANDROS, G., AND TOMBS, D. 2001. Automatic generation and verification of design specifications for railway signalling applications. In Proceedings of INCOSE 11th Annual International Symposium.
30. SCHNEIDER, S. 2001. The B-Method: An Introduction. Palgrave.
31. STOCKS, P. AND CARRINGTON, D. 1996. A framework for specification-based testing. IEEE Trans. Softw. Engg. 22, 11, pp. 777-793.
32. TREHARNE, H., ORMSBY, B., DRAPER, J., AND BOYCE, T. 1996. Evaluating the B-Method on an avionics example. In Proceedings of DASIA Conference, pp. 89-97.
33. TURNER, C. AND ROBSON, D. 1995. A state-based approach to the testing of class-based programs. Softw.-Conc. Tools 16, 3, pp. 106-112.
34. UTTING, M. 2000. Data structures for Z testing tools, FM-TOOLS Workshop.
35. WAESELYNCK, H. AND BEHNIA, S. 1998. B-Model animation for external verification. In Proceedings of the International Conference for Formal Engineering Methods. IEEE Computer Society, pp. 3645.