FORTEST: Formal methods and testing

Proceedings-IEEE Computer Society's International Computer Software and Applications Conference

Volumn , Issue , 2002, Pages 91-101

  Bowen, Jonathan P ^a   Clark, John A ^b   Hierons, Robert M ^c   Bogdanov, Kirill ^d   Harman, Mark ^c   Krause, Paul ^e  

^a LONDON SOUTH BANK UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF YORK   (United Kingdom)

^c BRUNEL UNIVERSITY   (United Kingdom)

^d UNIVERSITY OF SHEFFIELD   (United Kingdom)

^e UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER HARDWARE DESCRIPTION LANGUAGES; CONTEXT FREE LANGUAGES; CONTEXT SENSITIVE LANGUAGES; FORMAL LOGIC; SOFTWARE ENGINEERING;

FORMAL METHODS; FORMAL TESTING;

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 0036392077     PISSN: 07303157     EISSN: None     Source Type: Journal    
DOI: 10.1109/CMPSAC.2002.1044538     Document Type: Article

References (59)

1. P. Ammann, P. E. Black, and W. Majurski. Using model checking to generate tests from specifications. In Proc. 2nd IEEE International Conference on Formal Engineering Methods (ICFEM '98), pages 46-54, Brisbane, Australia, Dec. 1998.
2. E. A. Ashcroft and Z. Manna. The translation of goto programs into while programs. In C. V. Freiman, J. E. Griffith, and J. L. Rosenfeld, editors, Proc. IFIP Congress 71, volume 1, pages 250-255. North-Holland, 1972.
3. M. Benjamin, D. Geist, A. Hartman, G. Mas, R. Smeets, and Y. Wolfsthal. A feasibility study in formal coverage driven test generation. In Proc. 36th Design Automation Conference (DAC'99), June 1999.
4. A. Bertolino and L. Strigini. On the use of testability measures for dependability assessment. IEEE Transactions on Software Engineering, 22(2):97-108, Feb. 1996.
5. K. Bogdanov. Automated Testing of Harel's Statecharts. PhD thesis, The University of Sheffield, UK, Jan. 2000.
6. K. Bogdanov and M. Holcombe. Statechart testing method for aircraft control systems. Software Testing, Verification and Reliability, 11:39-54, 2001.
7. L. Bouge, N. Choquet, L. Fibourg, and M.-C. Gaudel. Test sets generation from algebraic specifications using logic programming. Journal of Systems and Software, 6(4):343-360, 1986.
8. J. P. Bowen. The ethics of safety-critical systems. Communications of the ACM, 43(4):91-97, April 2000.
9. J. P. Bowen and M. G. Hinchey. Ten commandments of formal methods. IEEE Computer, 28(4):56-63, April 1995.
10. J. P. Bowen and M. G. Hinchey. Also in High-Integrity System Specification and Design, Springer-Verlag, FACIT series, pages 217-230, 1999.
11. J. P. Bowen and M. G. Hinchey, editors. ZUM'95: The Z Formal Specification Notation, 9th International Conference of Z Users, Limerick, Ireland, September 7-9, 1995, Proceedings, volume 967 of Lecture Notes in Computer Science. Springer-Verlag, 1995.
12. 20 states and beyond. Information and Computation, 98:142-170, 1992.
13. S. Burton, J. Clark, A. Galloway, and J. McDermid. Automated V&V for high integrity systems: A targeted formal methods approach. In Proc. 5th NASA Langley Formal Methods Workshop, June 2000.
14. S. Burton, J. Clark, and J. McDermid. Testing, proof and automation: An integrated approach. In Proc. 1st International Workshop of Automated Program Analysis, Testing and Verification, June 2000.
15. T. Chow. Testing software design modeled by finite-state machines. IEEE Transactions on Software Engineering, SE-4(3):178-187, 1978.
16. P. Cousot and R. Cousot. Abstract interpretation frameworks. Journal of Logic and Computation, 2(4):511-547, Aug. 1992.
17. J. Derrick and E. Boiten. Testing refinements of state-based formal specifications. Software Testing, Verification and Reliability, 9:27-50, July 1999.
18. J. Dick and A. Faivre. Automating the generation and sequencing of test cases from model based specifications. In J. C. P. Woodcock and P. G. Larsen, editors, FME '93: Industrial Strength Formal Methods, volume 670 of Lecture Notes in Computer Science, pages 268-284. Springer-Verlag, April 1993.
19. M. D. Ernst, J. Cockrell, W. G. Griswold, and D. Notkin. Dynamically discovering likely program invariants to support program evolution. In International Conference on Software Engineering, pages 213-224, 1999.
20. N. E. Fenton. Software Metrics: A Rigorous Approach. Chapman & Hall, London, 1991.
21. J.-C. Fernandez, C. Jard, T. Jeron, and G. Viho. Using on-the-fly verification techniques for the generation of test suites. In R. Alur and T. Henzinger, editors, Computer Aided Verification, 8th International Conference, CAV'96, volume 1102 of Lecture Notes in Computer Science, pages 348-359. Springer-Verlag, 1996.
22. A. Gargantini and C. Heitmeyer. Using model checking to generate tests from requirements specifications. In Proc. ESEC/FSE 99: Joint 7th European Software Engineering Conference (ESEC) and 7th ACM SIGSOFT International Symposium on the Foundations of Software Engineering (FSE-7), Toulouse, France, 6-10 September 1999.
23. M.-C. Gaudel. Testing can be formal too. In P. D. Moses, M. Nielson, and M. I. Schaertzbach, editors, TAPSOFT'95: Theory and Practice of Software Development, volume 915 of Lecture Notes in Computer Science, pages 82-96. Springer-Verlag, March 1995.
24. J. B. Goodenough and S. L. Gerhart. Towards a theory of test data selection. IEEE Transactions on Software Engineering, 1(2):156-173, 1975.
25. R. Hamlet. Theoretical comparison of testing methods. In Proc. ACM SIGSOFT'89, pages 28-37, 1989.
26. M. Harman, L. R. M. Hierons, A. Baresel, and H. Sthamer. Improving evolutionary testing by flag removal. In Genetic and Evolutionary Computation Conference (GECCO 2002), New York, USA, July 2002. AAAI. To appear.
27. M. Harman, Lin Hu, Xingyuan Zhang, and M. Munro. Side-effect removal transformation. In Proc. 9th IEEE International Workshop on Program Comprehension (IWPC'01), pages 310-319, Toronto, Canada, May 2001. IEEE Computer Society Press, Los Alamitos, California, USA.
28. R. M. Hierons. Testing from a Z specification. Software Testing, Verification and Reliability, 7(1):19-33, 1997.
29. R. M. Hierons, S. Sadeghipour, and H. Singh. Testing a system specified using statecharts and z. Information and Software Technology, 43(2):137-149, 2001.
30. C. A. R. Hoare. How did software get so reliable without proof? In M.-C. Gaudel and J. C. P. Woodcock, editors, FME'96: Industrial Benefit and Advances in Formal Methods, volume 1051 of Lecture Notes in Computer Science, pages 1-17. Springer-Verlag, 1996.
31. M. Holcombe and F. Ipate. Correct Systems: Building a Business Process Solution. Springer-Verlag, Sept. 1998.
32. H.-M. Hörcher. Improving software tests using Z specifications. In Bowen and Hinchey [10], pages 152-166.
33. F. Ipate and M. Holcombe. An integration testing method that is proved to find all faults. International Journal on Computer Mathematics, 63:159-178, 1997.
34. ITU-T. Z.500 Framework on Formal Methods in Conformance Testing. International Telecommunications Union, 1997.
35. B. F. Jones, H.-H. Sthamer, and D. E. Eyres. Automatic structural testing using genetic algorithms. Software Engineering Journal, 11(5):299-306, 1996.
36. S. Liu. Verifying consistency and validity of formal specifications by testing. In J. Wing, J. Woodcock, and J. Davies, editors, FM '99: Formal Methods, Volume I, volume 1708 of Lecture Notes in Computer Science, pages 896-914. Springer-Verlag, September 1999.
37. G. Lowe. Breaking and fixing the Needham-Schroeder public-key protocol using FDR. In T. Margaria and B. Steffen, editors, Tools and Algorithms for Construction and Analysis of Systems, volume 1055 of Lecture Notes in Computer Science, pages 147-166. Springer-Verlag, 1996.
38. G. Lowe. Also in Software Concepts and Tools, 17:93-102, 1996.
39. R. R. Lutz. Analyzing software requirements errors in safety-critical, embedded systems. In IEEE International Symposium on Requirements Engineering, pages 126-133, San Diego, CA, 1993. IEEE Computer Society Press.
40. J. D. McGregor and T. D. Korson. Integrated object-oriented testing and development processes. Communications of the ACM, 37(9):59-77, Sept. 1994.
41. E. P. Moore. Gedanken-Experiments. In C. Shannon and J. McCarthy, editors, Automata Studies. Princeton University Press, 1956.
42. L. J. Morell. A theory of fault-based testing. IEEE Transactions on Software Engineering, 16(8):844-857, Aug. 1990.
43. G. Myers. The Art of Software Testing. John Wiley and Sons, 1979.
44. K. M. N. Tracey, J. Clark and N. McDermid. Automated test-data generation for exception conditions. Software-Practice and Experience, 30(1):61-79, 2000.
45. S. C. Ntafos. A comparison of some structural testing strategies. IEEE Transactions on Software Engineering, 14(6):868-874, 1988.
46. R. P. Pargas, M. J. Harrold, and R. R. Peck. Test-data generation using genetic algorithms. Software Testing, Verification and Reliability, 9(4):263-282, 1999.
47. J. Peleska and M. Siegel. Test automation of safety-critical reactive systems. South African Computer Journal, 19:53-77, 1997.
48. A. Petrenko, N. Yevtushenko, and G. v. Bochmann. Testing deterministic implementations from nondeterministic FSM specifications. In Proc. 9th International Workshop on Testing of Communicating Systems (IWTCS'96), pages 125-140, 1996.
49. T. Ramalingam, A. Das, and K. Thulasiraman. On testing and diagnosis of communication protocols based on the FSM model. Computer communications, 18(5):329-337, May 1995.
50. L. Ramshaw. Eliminating goto's while preserving program structure. Journal of the ACM, 35(4):893-920, 1988.
51. S. Stepney. Testing as abstraction. In Bowen and Hinchey [10], pages 137-151.
52. P. A. Stocks and D. A. Carrington. A framework for specification-based testing. IEEE Transactions on Software Engineering, 22(11):777-793, November 1996.
53. N. Tracey, J. Clark, and K. Mander. Automated program flaw finding using simulated annealing. In Software Engineering Notes, Proc. International Symposium on Software Testing and Analysis, pages 73-81. ACM/SIGSOFT, March 1998.
54. N. Tracey, J. Clark, and K. Mander. The way forward for unifying dynamic test-case generation: The optimisation-based approach. In Proc. International Workshop on Dependable Computing and Its Applications (DCIA), pages 169-180. IFIP, January 1998.
55. N. Tracey, J. Clark, J. McDermid, and K. Mander. A search-based automated test data generation framework for safety-critical systems. In Systems Engineering for Business Process Change, chapter 12, pages 174-213. Springer-Verlag, 2002.
56. S. A. Vilkomir and J. P. Bowen. Formalization of software testing criteria using the Z notation. In 25th Annual International Computer Software and Applications Conference (COMPSAC 2001), Chicago, Illinois, pages 351-356. IEEE Computer Society, October 2001.
57. S. A. Vilkomir and J. P. Bowen. Reinforced condition/decision coverage (RC/DC): A new criterion for software testing. In D. Bert, J. P. Bowen, M. Henson, and K. Robinson, editors, ZB 2002: Formal Specification and Development in Z and B, volume 2272 of Lecture Notes in Computer Science, pages 295-313. Springer-Verlag, January 2002.
58. J. Wegener, A. Baresel, and H. Sthamer. Evolutionary test environment for automatic structural testing. Information and Software Technology, 43(14):841-854, 2001.
59. J. Wegener, A. Baresel, and H. Sthamer, Special issue on Software Engineering using Metaheuristic Innovative Algorithms.