Generation of test sequences from formal specifications: GSM 11-11 standard case study

Software - Practice and Experience

Volumn 34, Issue 10, 2004, Pages 915-948

  Bernard, Eddy ^a   Legeard, Bruno ^b   Luck, Xavier ^a   Peureux, Fabien ^b  

^a SchlumbergerSema Montrouge Prod C   (France)

^b UNIVERSITÉ DE FRANCHE COMTÉ   (France)

Author keywords

B notation; Constraint logic programming with sets; Smart card GSM 11 11 standard; Specification based testing

Indexed keywords

BOUNDARY CONDITIONS; FUNCTIONS; GRAPH THEORY; LOGIC PROGRAMMING; SET THEORY; SMART CARDS;

B NOTATION; CONSTRAINT LOGIC PROGRAMMING WITH SETS; SMART CARD GSM 11-11 STANDARD; SPECIFICATION-BASED TESTING;

GLOBAL SYSTEM FOR MOBILE COMMUNICATIONS;

EID: 3142715436     PISSN: 00380644     EISSN: None     Source Type: Journal    
DOI: 10.1002/spe.597     Document Type: Article

References (45)

1. Balcer MJ, Hasling WM, Ostrand TJ. Automatic generation of test scripts from formal test specifications. Proceedings of the ACM SIGSOFT'89 Third Symposium on Software Testings, Analysis and Verification (TAV3), Key West, FL, December 1989. ACM SIGSOFT, 1989; 210-218.
2. Carrington DA, Stocks P. A tale of two paradigms: Formal methods and software testing. Proceedings of the 8th Z User Meeting (ZUM'94), Cambridge, June 1994. Springer: New York, 1994; 51-68.
3. Gaudel M-C. Testing can be formal too. Proceedings of the 6th Joint Conference on Theory and Practice of Software Development (TAPSOFT'95), Aarhus, Denmark, May 1995 (Lecture Notes in Computer Science, vol. 915). Springer: Berlin, 1995; 82-96.
4. Spivey JM. The Z Notation: A Reference Manual (2nd edn). Prentice-Hall: Englewood Cliffs, NJ, 1992.
5. Jones CB. Systematic Software Development Using VDM (2nd edn). Prentice-Hall: Englewood Cliffs, NJ, 1990.
6. Abrial J-R. The E-BOOK: Assigning Programs to Meanings. Cambridge University Press: Cambridge, 1996.
7. Dick J, Faivre A. Automating the generation and sequencing of test cases from model-based specifications. Proceedings of the International Conference on Formal Methods Europe (FME'93) (Lecture Notes in Computer Science, vol. 670). Springer: Berlin, 1993; 268-284.
8. Stocks P, Carrington DA. Test templates: A specification-based testing framework. Proceedings 15th International Conference on Software Engineering (ICSE'93), Baltimore, MD, May 1993. IEEE Computer Society Press: Los Alamitos, CA, 1993; 405-414.
9. Hierons R. Testing from a Z specification. Journal of Software Testing, Verification and Reliability 1997; 7:19-33.
10. Van Aertryck L, Benveniste M, Le Metayer D. CASTING: A formally based software test generation method. 1st IEEE International Conference on Formal Engineering Methods (ICFEM'97). IEEE Computer Society Press: Los Alamitos, CA, 1997; 99-112.
11. Behnia S, Waeselynck H. Test criteria definition for B models. Proceedings of the World Congress on Formal Methods (FM'99), Toulouse, France, 1999 (Lecture Notes in Computer Science, vol. 1708). Springer: Berlin, 1999; 509-529.
12. Legeard B, Peureux F. Generation of functional test sequences from B formal specifications - Presentation and industrial case-study. Proceedings 16th International Conference on Automated Software Engineering (ASE'01), San Diego, CA, November 2001. IEEE Computer Society Press: Los Alamitos, CA, 2001; 377-381.
13. Legeard B, Peureux F, Utting M. Automated Boundary Testing from Z and B. Proceedings of the International Conference on Formal Methods Europe (FME'02), Copenhagen, Denmark, July 2002 (Lecture Notes in Computer Science, vol. 2391). Springer: Berlin, 2002; 21-40.
14. Legeard B, Peureux F, Utting M. A comparison of the BTT and TTF test-generation methods. Proceedings of the International Conference on Formal Specification and Development in Z and B (ZB'02), Grenoble, France, January 2002 (Lecture Notes in Computer Science, vol. 2272). Springer: Berlin, 2002; 309-329.
15. Jaffar J, Lassez J-L. Constraint logic programming. Proceedings of the 14th Symposium on Principles of programming Languages (POPL'87), Munich, Germany, January 1987. ACM Press: New York, 1987; 111-119.
16. Ambert F, Legeard B, Legros E. Constraint Logic Programming on sets and multisets. Proceedings of the ILPS'94 Workshop on Constraint Languages/Systems and Their Use in Problem Modeling, Ithaca, New York, November 1994; 151-165.
17. Bouquet F, Legeard B, Peureux F. Constraint Logic Programming with sets for animation of B formal specifications. CL'00 Workshop on (Constraint) Logic Programming and Software Engineering (LPSE'00), London, UK, July 2000.
18. Bouquet F, Legeard B, Peureux F. CLPS-B - A constraint solver for B, Proceedings of the ETAPS'02 International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS'02), Grenoble, France, April 2002 (Lecture Notes in Computer Science, vol. 2280). Springer: Berlin, 2002; 188-204.
19. Ambert F, Bouquet F, Chemin S, Guenaud D, Legeard B, Peureux F Vacelet N, Utting M. BZ-TT: A tool-set for test generation from Z and B using constraint logic programming. Proceedings of the CONCUR'02 Workshop on Formal Approaches to Testing of Software (FATES'02), INRIA Technical Report, Brnö, Czech Republic, August 2002; 105-120.
20. European Telecommunications Standards Institute. GSM 11-11 V7.2.0 Technical Specifications, 1999.
21. Sekerinski E, Sere K. Program Development by Refinement - Case Studies using the B Method. Springer: Berlin, 1999.
22. Atelier B Technical Support version 3, May 2001. Clearsy, Europarc de Pichaury, 13856 Aix-en-Provence Cedex 3, France. http://www.atelierb.societe. com.
23. Behm P, Desforges P, Meynadier JM. METEOR: An industrial success in formal development. Proceedings of the 2nd International Conference on the B Method, Montpellier, France, 1998 (Lecture Notes in Computer Science, vol. 1393). Springer: Berlin, 1998; 29-45.
24. Julliand J, Legeard B, Machicoane T, Parreaux B, Tatibouet B. Specification of an integrated circuit card protocol applications using the B method and linear temporal logic. Proceedings of the 2nd Conference on the B Method, Montpellier, France, 1998 (Lecture Notes in Computer Science, vol. 1393). Springer: Berlin, 1998; 273-292.
25. ISO. Information Processing Systems, Open Systems Interconnection. OSI Conformance Testing Methodology and Framework - ISO 9646, 1998.
26. Pretschner A. Classical search strategies for test case generation with Constraint Logic Programming. Proceedings of the CONCUR'01 Workshop on Formal Approaches to Testing of Software (FATES'01), Aalborg, Denmark, August 2001. BRICS, 2001.
27. Colin S, Legeard B, Peureux F. Preamble computation in automated test generation using Constraint Logic Programming. Proceedings of UK-Test Workshop, York, UK, September 2003.
28. Legeard B, Peureux F, Vincent J. Automatic generation of functional test patterns from a formalized smart card model - application to the GSM 11-11 specification (confidential). Technical Report TR-01/01, LIFC, University of Franche-Comté and Schlumberger Montrouge Product Center, 2001.
29. Hartman A. AGEDIS - Model Based Test Generation Tools. http://www.agedis.de/documents/ModelBasedTestGenerationTools_cs.pdft2002].
30. El-Far IK, Whittaker JA. Model-based software testing. Encyclopedia of Software Engineering (2nd edn), vol. 1. Wiley: New York, 2002; 825-837.
31. Grieskamp W, Gurevich Y, Schulte W, Veanes M. Generating finite state machines from abstract state machines. Proceedings of the International Symposium on Software Testing and Analysis (ISSTA'02), Rome, Italy, July 2002. ACM SIGSOFT, 2002; 112-122.
32. Friedman G, Hartman A, Nagin K, Shiran T. Projected state machine coverage for software testing. Proceedings of the International Symposium on Software. Testing and Analysis (ISSTA'02), Rome, Italy, July 2002, vol. 27. ACM SIGSOFT, 2002; 134-143.
33. Vaysburg B, Tahat L, Korel B. Dependence analysis in reduction of requirement based test suites. Proceedings of the International Symposium on Software Testing and Analysis (ISSTA'02), Rome, Italy, July 2002, vol. 27. ACM SIGSOFT, 2002; 107-111.
34. Hörcher HM, Peleska J. Using formal specifications to support software testing. Software Quality Journal 1995; 4(4):309-327.
35. Weyuker EJ, Ostrand TJ. Theories of program testing and the application of revealing subdomains. IEEE Transactions in Software Engineering 1980; 6(3):236-246.
36. Beizer B. Black-Box Testing: Techniques for Functional Testing of Software and Systems. Wiley: New York, 1995.
37. Choi Y, Rayadurgam S, Heimdahl MPE. Automatic abstraction for model checking software systems with interrelated numeric constraints. Software Engineering Notes 2001; 26(5): 164-174.
38. Gotlieb A, Botella B, Rueher M. A CLP framework for computing structural test data. Proceedings of the First International Conference on Computational Logic (CL'00), London, UK, July 2000. Springer: Berlin, 2000; 399-413.
39. Meudec C. ATGEN: Automatic test data generation using constraint logic programming and symbolic execution. Journal of Software Testing, Verification and Reliability 2001; 11(2):81-96.
40. Marre B, Arnould A. Test sequence generation from Lustre descriptions: GATEL. Proceedings 15th International Conference on Automated Software Engineering (ASE'00), Grenoble, France, 2000. IEEE Computer Society Press: Los Alamitos, CA, 2000; 229-237.
41. Pretschner A, Lötzbeyer H. Model-based testing with constraint logic programming: First results and challenges. Proceedings of the 2nd ICSE Workshop on Automated program Analysis, Testing and Verification (WAPATV'01), Toronto, May 2001; 1-9.
42. Philipps J, Pretschner A, Slotosch O, Aiglstorfer E, Kriebel S, Scholl K. Model-based test case generation for smart cards. Proceedings of the 8th International Workshop on Formal Methods for Industrial Critical Systems (FMICS'03), Trondheim, Norway, June 2003 (Electronic Notes in Theoretical Computer Science, vol. 80). Elsevier: Amsterdam, 2003; 168-182.
43. Swedish Institute of Computer Sciences. SICStus Prolog 3.8.7 manual documents, October 2001. http://www.sics.se/sicstus.html.
44. Sun microsystems. Java Card 2.1.1 Virtual Machine Specification, May 2000. http://java.sun.com/products/javacard/javacard21.html#specification.
45. The BZ-TT web site, http://lifc.univ-fcomte.fr/~bztt [September 2003].