A taxonomy of model-based testing approaches

Software Testing Verification and Reliability

Volumn 22, Issue 5, 2012, Pages 297-312

  Utting, Mark ^a   Pretschner, Alexander ^b   Legeard, Bruno ^c  

^a UNIVERSITY OF WAIKATO   (New Zealand)

^b KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

^c UNIVERSITÉ DE FRANCHE COMTÉ   (France)

Author keywords

model based testing approaches; survey; taxonomy

Indexed keywords

MODEL BASED TESTING; SYSTEM UNDER TEST; TEST CASE;

MEDIA STREAMING; SOFTWARE ENGINEERING; SOFTWARE TESTING; SURVEYS;

TAXONOMIES;

EID: 84862325128     PISSN: 09600833     EISSN: 10991689     Source Type: Journal    
DOI: 10.1002/stvr.456     Document Type: Article

References (72)

1. Chow TS,. Testing software design modeled by finite-state machines. IEEE Transactions on Software Engineering 1978; 4 (3): 178-187.
2. Hierons R, Bogdanov K, Bowen J, Cleaveland R, Derrick J, Dick J, Gheorghe M, Harman M, Kapoor K, Krause P, Lüttgen G, Simons A, Vilkomir S, Woodward M, Zedan H,. Using formal specifications to support testing. ACM Computing Surveys 2009; 41 (2): 9:1-9:76.
3. Dias Neto AC, Subramanyan R, Vieira M, Travassos GH,. A survey on model-based testing approaches: a systematic review. WEASELTech '07: Proceedings of the 1st ACM International Workshop on Empirical Assessment of SW Engineering Languages and Technologies. ACM: New York, NY, U.S.A., 2007; 31-36.
4. Utting M, Legeard B,. Commercial model-based testing tools, 2010. Available at: [Accessed November 2010].
5. Willcock C, Deiss T, Tobies S, Schulz S, Keil S, Engler F,. An Introduction to TTCN-3. Wiley: New York, 2005.
6. Utting M, Legeard B,. Practical model-based testing. A Tools Approach. Morgan Kaufman: Los Altos, CA, 2007.
7. Dias-Neto A, Subramanyan R, Vieira M, Travassos GH, Shull F,. Improving evidence about software technologies: A look at model-based testing. IEEE Software 2008; 25 (3): 10-13. (Pubitemid 351715607)
8. Pretschner A, Prenninger W, Wagner S, Kühnel C, Baumgartner M, Sostawa B, Zölch R, Stauner T,. One evaluation of model-based testing and its automation. Proceedings of the ICSE'05, St Louis, U.S.A., 2005; 392-401.
9. Paradkar A,. Case studies on fault detection effectiveness of model based testing generation techniques. Proceedings of the ICSE 2005 Workshop on Advances in Model-based Software Testing (A-MOST'05), St Louis, U.S.A., vol. 30, 2005; 1-7.
10. Horstmann M, Prenninger W, El-Ramly M,. Case studies. In Model-based Testing of Reactive Systems (Lecture Notes in Computer Science, vol. 3472), Broy M, Jonsson B, Katoen J-P, Leucker M, Pretschner A, (eds). Springer: Berlin, 2005; 439-461. (Pubitemid 350227436)
11. Bernard E, Legeard B, Luck X, Peureux F,. Generation of test sequences from formal specifications: GSM 11.11 standard case-study. SW Practice and Experience 2004; 34 (10): 915-948.
12. Blackburn M, Busser R, Nauman A,. Why model-based test automation is different and what you should know to get started. Proceedings of the International Conference on Practical Software Quality and Testing, Washington, DC, U.S.A., 2004.
13. Farchi E, Hartman A, Pinter SS,. Using a model-based test generator to test for standard conformance. IBM Systems Journal 2002; 41 (1): 89-110. (Pubitemid 34811655)
14. Dalal SR, Jain A, Karunanithi N, Leaton JM, Lott CM, Patton GC, Horowitz BM,. Model-based testing in practice. Proceedings of the ICSE'99, Los Angeles, U.S.A., 1999; 285-294.
15. Jacky J, Veanes M, Campbell C, Schulte W,. Model-based Software Testing and Analysis with C#. Cambridge University Press: Cambridge, 2008.
16. Pretschner A, Philipps J,. Methodological issues in model-based testing. In Model-based Testing of Reactive Systems (Lecture Notes in Computer Science, vol. 3472), Broy M, Jonsson B, Katoen J-P, Leucker M, Pretschner A, (eds). Springer: Berlin, 2005; 281-291. (Pubitemid 350227431)
17. Prenninger W, Pretschner A,. Abstractions for Model-Based Testing (Electronic Notes in Theoretical Computer Science, vol. 116). Elsevier: Amsterdam, 2005; 59-71.
18. Koomen T, vander Aalst L, Broekman B, Vroon M,. TMap Next, for Result-driven Testing. UTN Publishers: Hertogenbosch, The Netherlands, 2006.
19. Graham D, Veenendaal EV, Evans I, Black R,. Foundations of Software Testing: ISTQB Certification. International Thomson Business Press: Stanford, U.S.A, 2008.
20. Philipps J, Pretschner A, Slotosch O, Aiglstorfer E, Kriebel S, Scholl K,. Model-based test case generation for smart cards. Proceedings of the 8th International Workshop on Formal Methods for Industrial Critical Systems, 2003; 168-192.
21. Berkenkötter K, Kirner R,. Real-time and hybrid systems testing. In Model-based Testing of Reactive Systems (Lecture Notes in Computer Science, vol. 3472), Broy M, Jonsson B, Katoen J-P, Leucker M, Pretschner A, (eds). Springer: Berlin, 2005; 355-387. (Pubitemid 350237160)
22. van Lamsweerde A,. Formal specification: A roadmap. Proceedings of the ICSE'00, Limerick, Ireland, 2000; 147-159.
23. Cohen D, Dalal S, Fredman M, Patton G,. The AETG system: An approach to testing based on combinatorial design. IEEE TSE 1997; 23 (7): 437-444. (Pubitemid 127828305)
24. Gaudel M, LeGall P,. Testing data type implementations from algebraic specifications. Proceedings of the Formal Methods and Testing (Lecture Notes in Computer Science, vol. 4949). Springer: Berlin, 2008; 209-239. (Pubitemid 351632165)
25. Aho A, Dahbura A, Lee D, Uyar MU,. An optimization technique for protocol conformance test generation based on UIO sequences and rural chinese postman tours. IEEE Transactions on Communications 1991; 39 (11): 1604-1615.
26. Lee D, Yannakakis M,. Principles and methods of testing finite state machines A survey. Proceedings of the IEEE 1996; 84 (2): 1090-1126.
27. Zhu H, Hall P, May J,. Software unit test coverage and adequacy. ACM Computing Surveys 1997; 29 (4): 366-427. (Pubitemid 127583222)
28. Ntafos S,. A comparison of some structural testing strategies. IEEE TSE 1988; 14 (6): 868-874. (Pubitemid 18640026)
29. Frankl P, Weyuker E,. An applicable family of data flow testing criteria. IEEE TSE 1988; 14 (10): 1483-1498.
30. Grindal M, Offutt J, Andler S,. Combination testing strategies: A survey. Technical Report ISE-TR-04-05, George Mason University, 2004.
31. Kosmatov N, Legeard B, Peureux F, Utting M,. Boundary coverage criteria for test generation from formal models. Proceedings of the 15th International Symposium on SW Reliability Engineering, St Malo, France, 2004; 139-150. (Pubitemid 40455689)
32. Beizer B,. Black-Box Testing: Techniques for Functional Testing of Software and Systems. Wiley: New York, 1995.
33. Hamlet D, Taylor R,. Partition testing does not inspire confidence. IEEE TSE 1990; 16 (12): 1402-1411.
34. Duran J, Ntafos S,. An evaluation of random testing. IEEE TSE SE 1984; 10 (4): 438-444.
35. Gutjahr W,. Partition testing versus random testing: The influence of uncertainty. IEEE TSE 1999; 25 (5): 661-674. (Pubitemid 30541839)
36. Nair V, James D, Ehrlich W, Zevallos J,. A statistical assessment of some software testing strategies and application of experimental design techniques. Statistica Sinica 1998; 8: 165-184.
37. Gaston C, Seifert D,. Evaluating coverage-based testing. In Model-based Testing of Reactive Systems (Lecture Notes in Computer Science, vol. 3472), Broy M, Jonsson B, Katoen J-P, Leucker M, Pretschner A, (eds). Springer: Berlin, 2005; 293-322.
38. Wittevrongel J, Maurer F,. Scentor: Scenario-based testing of e-business applications. WETICE '01: Proceedings of the 10th IEEE International Workshop on Enabling Technologies. IEEE Comp Society: Washington, DC, 2001; 41-48.
39. Tsai WT, Saimi A, Yu L, Paul R,. Scenario-based object-oriented testing framework. QSIC 03, Dallas, U.S.A., 2003; 410.
40. Julliand J, Masson P-A, Tissot R,. Generating security tests in addition to functional tests. AST'08, 3rd International Workshop on Automation of Software Test. ACM Press: Leipzig, Germany, 2008; 41-44. Available at:.
41. Walton G, Poore J,. Generating transition probabilities to support model-based software testing. Software: Practice and Experience 2000; 30 (10): 1095-1106.
42. Musa J,. Software Reliability Engineering (2nd edn). Artech House: Bloomington, U.S.A., 2004.
43. Andrews J, Briand L, Labiche Y,. Is mutation an appropriate tool for testing experiments. Proceedings of the ICSE'05, St Louis, U.S.A., 2005; 402-411.
44. Prowell S,. Jumbl: A tool for model-based statistical testing. Proceedings of the HICSS'03. IEEE: New York, 2003; 337.3.
45. Kwan M,. Graphic programming using odd and even points. Chinese Mathematics 1962; 1: 273-277.
46. McMinn P,. Search-based software test data generation: A survey. Journal of Software Testing, Verification and Reliability 2004; 14 (2): 105-156.
47. Offutt A, Liu S, Abdurazik A, Ammann P,. Generating test data from state-based specifications. Journal of Software Testing, Verification and Reliability 2003; 13 (1): 25-53.
48. Hong H, Lee I, Sokolsky O, Ural H,. A temporal logic based theory of test coverage and generation. Proceedings of the TACAS'02, 2002; 327-341.
49. Pretschner A,. Classical search strategies for test case generation with constraint logic programming. Proceedings of the Formal Approaches to Testing of Software, Aalborg, Denmark, 2001; 47-60.
50. Marre B, Arnould A,. Test sequences generation from LUSTRE descriptions: GATEL. Proceedings 15th IEEE Conference on Automated Software Engineering, Grenoble, France, 2000; 229-237.
51. Colin S, Legeard B, Peureux F,. Preamble computation in automated test case generation using constraint logic programming. Journal of Software Testing, Verification and Reliability 2004; 14 (3): 213-235.
52. Dick J, Faivre A,. Automating the generation and sequencing of test cases from model-based specifications. Proceedings of the 1st International Symposium of Formal Methods Europe, Odense, Denmark, vol. 670, 1993; 268-284.
53. Helke S, Neustupny T, Santen T,. Automating test case generation from Z specifications with Isabelle. Proceedings of the 10th International Conference on Z Users, Reading, U.K., vol. 1212, 1997; 52-71. (Pubitemid 127051213)
54. Clarke D, Jéron T, Rusu V, Zinovieva E,. Stg: A symbolic test generation tool. Tools and Algorithms for the Construction and Analysis of Systems (TACAS'02) (Lecture Notes Computer Science, vol. 2280). Springer: Berlin, 2002; 470-475. Available at: [March 2011].
55. Colin S, Legeard B, Peureux F,. Preamble computation in automated test case generation using constraint logic programming. Journal of Software Testing, Verification and Reliability 2004; 14 (3): 213-235.
56. All4TEc, 2010. Available at: [March 2011].
57. Veanes M, Campbell C, Grieskamp W, Schulte W, Tillman N, Nachmanson L,. Model-based Testing of Object-Oriented Reactive Systems with Spec Explorer (Lecture Notes in Computer Science, vol. 4949), ch. 2. Springer: Berlin, 2008; 39-76.
58. Conformiq, 2010. Available at: [March 2011].
59. Smartesting, 2010. Available at: [March 2011].
60. Broy M, Jonsson B, Katoen J-P, Leucker M, Pretschner A, (eds), In Model-based Testing of Reactive Systems (Lecture Notes in Computer Science, vol. 3472). Springer: Berlin, 2005.
61. Gargantini A,. Conformance Testing. In Model-based Testing of Reactive Systems (Lecture Notes in Computer Science, vol. 3472), Broy M, Jonsson B, Katoen J-P, Leucker M, Pretschner A, (eds). Springer: Berlin, 2005; 87-111. (Pubitemid 350237158)
62. Binder RV,. Testing Object-oriented Systems: Models, Patterns, and Tools. Addison-Wesley: Reading, MA, 1999.
63. Hartman A,. Model-based test generation tools. Tech. rep., AGEDIS Project, 2002. Available at:.
64. Belinfante A, Frantzen L, Schallhart C,. Tools for test case generation. In Model-based Testing of Reactive Systems (Lecture Notes in Computer Science, vol. 3472), Broy M, Jonsson B, Katoen J-P, Leucker M, Pretschner A, (eds). Springer: Berlin, 2005; 391-438. (Pubitemid 350227435)
65. Götz H, Nickolaus M, Roner T, Salomon K,. Modellbasiertes Testen. Heise Zeitschriften Verlag GmbH: Hannover, Germany, 2009.
66. Shafique M, Labiche Y,. A systematic review of model based testing tool support. Technical Report SCE-10-04, Department of Systems and Computer Engineering, Carleton University, Ottawa, Canada, May 2010.
67. Dias-Neto AC, Travassos GH,. A picture from the model-based testing area: Concepts, techniques, and challenges. Advances in Computers 2010; 80: 45-120.
68. Dias-Neto AC, Travassos GH, Subramanyan R, Vieira M,. Characterization of model-based software testing approaches. Technical Report ES-713/07, PESC-COPPE/UFRJ, 2007. Available at:.
69. Dias Neto AC, Travassos GH,. Surveying model based testing approaches characterization attributes. ESEM '08: Proceedings of the Second ACM-IEEE International Symposium on Empirical Software Engineering and Measurement. ACM: New York, NY, U.S.A., 2008; 324-326.
70. Delgado N, Gates AQ, Roach S,. A taxonomy and catalog of runtime software-fault monitoring tools. IEEE Transactions on Software Engineering 2004; 30 (12): 859-872. (Pubitemid 41158279)
71. Kagdi H, Collard M, Maletic J,. Towards a taxonomy of approaches for mining of source code repositories. SIGSOFT SW Engineering Notes 2005; 30 (4): 1-5.
72. Krueger CW,. Integration testing in software product line engineering: A model-based technique. FASE'07: Proceedings of Fundamental Approaches to Software Engineering (Lecture Notes in Computer Science). Springer: Berlin, Heidelberg, 2007; 321-335.