Testing with model checkers: A survey

Software Testing Verification and Reliability

Volumn 19, Issue 3, 2009, Pages 215-261

  Fraser, Gordon ^a   Wotawa, Franz ^a   Ammann, Paul E ^b  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

^b Krasnow Institute for Advanced Study   (United States)

Author keywords

Automated testing; Model checking; Software testing; Test case generation

Indexed keywords

AUTOMATED TESTING; FORMAL VERIFICATION TOOLS; MODEL CHECKER; ROOT CAUSE; STATE OF THE ART; TEST CASE; TEST CASE GENERATION; USE-MODEL;

COMPUTER SOFTWARE SELECTION AND EVALUATION; SOFTWARE TESTING; SURVEYS;

MODEL CHECKING;

EID: 67650098410     PISSN: 09600833     EISSN: 10991689     Source Type: Journal    
DOI: 10.1002/stvr.402     Document Type: Review

References (126)

1. Callahan J, Schneider F, Easterbrook S. Automated software testing using model-checking. Proceedings 1996 SPIN Workshop, August 1996. Also WVU Technical Report NASA-IVV-96-022.
2. Engels A, Feijs L, Mauw S. Test generation for intelligent networks using model checking. Proceedings of the 3rd International Workshop on Tools and Algorithms for the Construction and Analysis of Systems (TACAS'97), Enschede, The Netherlands, April 1997 (Lecture Notes in Computer Science, vol. 1217), Brinksma ED (ed.). Springer: Berlin, 1997.
3. Utting M, Pretschner A, Legeard B. A taxonomy of model-based testing. Technical Report No. 04/2006, Department of Computer Science, The University of Waikato, New Zealand, April 2006.
4. Lichtenstein O, Pnueli A. Checking that finite state concurrent programs satisfy their linear specification. POPL '85: Proceedings of the 12th ACM SIGACT-SIGPLAN Symposium on Principles of Programming Languages. ACM Press: New York, NY, U.S.A., 1985; 97-107. ISBN 0-89791-147-4. DOI: 10.1145/318593.318622.
5. Vardi MY, Wolper P. An automata-theoretic approach to automatic program verification (preliminary report). Proceedings of the 1st IEEE Symposium on Logic in Computer Science (LICS'86). IEEE Computer Society: Silver Spring, MD, 1986; 332-334.
6. Clarke EM, Emerson EA, Sistla AP. Automatic verification of finite state concurrent system using temporal logic specifications: A practical approach. POPL '83: Proceedings of the 10th ACM SIGACT-SIGPLAN Symposium on Principles of Programming Languages. ACM Press: New York, NY, U.S.A., 1983; 117-126. ISBN 0-89791-090-7. DOI: 10.1145/ 567067.567080.
7. Queille J-P, Sifakis J. Specification and verification of concurrent systems in CESAR. Proceedings of the 5th Colloquium on International Symposium on Programming, London, U.K. Springer: Berlin, 1982; 337-351. ISBN 3-540-11494-7.
8. Cimatti A, Clarke EM, Giunchiglia F, Roveri M. NUSMV: A new symbolic model verifier. CAV '99: Proceedings of the 11th International Conference on Computer Aided Verification, London, U.K. Springer: Berlin, 1999; 495-499. ISBN 3-540-66202-2.
9. McMillan KL. The SMV system. Technical Report CMU-CS-92-131, Carnegie-Mellon University, 1992.
10. Pnueli A. The temporal logic of programs. Eighteenth Annual Symposium on Foundations of Computer Science, 31 October-2 November 1977, Providence, RI, U.S.A. IEEE Press: New York, 1977; 46-57.
11. Clarke EM, Allen Emerson E. Design and synthesis of synchronization skeletons using branching-time temporal logic. Logic of Programs, Workshop, London, U.K. Springer: Berlin, 1982; 52-71. ISBN 3-540-11212-X.
12. Allen Emerson E, Halpern JY. Decision procedures and expressiveness in the temporal logic of branching time. STOC '82: Proceedings of the Fourteenth Annual ACM Symposium on Theory of Computing, New York, NY, U.S.A. ACM Press: New York, 1982; 169-180. ISBN 0-89791-070-2. DOI: 10.1145/800070.802190.
13. Hennessy M, Milner R. Algebraic laws for nondeterminism and concurrency. Journal of the ACM (JACM) 1985; 32(1):137-161. ISSN 0004-5411. DOI: 10.1145/2455.2460.
14. Kozen D. Results on the propositional μ-calculus. Theoretical Computer Science 1983; 27(3):333-354.
15. Alur R, Courcoubetis C, Dill D. Model-checking for real-time systems. Proceedings of the Fifth Annual IEEE Symposium on Logic in Computer Science (LICS 90), 4-7 June 1990, Philadelphia, PA, U.S.A. IEEE Computer Society: Silver Spring, MD, 1990; 414-425.
16. Allen Emerson E, Lei C-L. Modalities for model checking: Branching time logic strikes back. Science of Computer Programming 1987; 8(3):275-306. ISSN 0167-6423. DOI: http://dx.doi.org/10.1016/ 0167-6423(87)90036-0.
17. De Nicola R, Vaandrager F. Action versus state based logics for transition systems. Proceedings of the LITP Spring School on Theoretical Computer Science on Semantics of Systems of Concurrent Processes, New York, NY, U.S.A. Springer: New York, 1990; 407-419. ISBN 0-387-53479-2.
18. Clarke EM, Grumberg O, Peled DA. Model Checking (1st edn). MIT Press: Cambridge, MA, 2001 (3rd printing).
19. Clarke EM, Grumberg O, McMillan KL, Zhao X. Efficient generation of counterexamples and witnesses in symbolic model checking. Proceedings of the 32nd Conference on Design Automation (DAC). ACM Press: New York, 1995; 427-432.
20. McMillan KL. Symbolic Model Checking. Kluwer Academic Publishers: Norwell, MA, U.S.A., 1993. ISBN 07 92393805.
21. Bryant RE. Graph-based algorithms for Boolean function manipulation. IEEE Transactions on Computers 1986; 35(8):677-691. ISSN 0018-9340. DOI: http://dx.doi.org/10.1109/TC.1986.1676819.
22. Biere A, Cimatti A, Clarke EM, Zhu Y. Symbolic model checking without BDDs. TACAS '99: Proceedings of the 5th International Conference on Tools and Algorithms for Construction and Analysis of Systems, London, U.K. Springer: Berlin, 1999; 193-207. ISBN 3-540-65703-7.
23. Wimmel G, Loetzbeyer H, Pretschner A, Slotosch O. Specification based test sequence generation with propositional logic. Software Testing, Verification and Reliability 2000; 10(4):229-248.
24. Holzmann GJ. The model checker SPIN. IEEE Transactions on Software Engineering 1997; 23(5):279-295. ISSN 0098-5589. DOI: 10.1109/ 32.588521.
25. de Moura L, Owre S, Rueβ H, Rushby J, Shankar N, Sorea M, Tiwari A. SAL 2. Computer-Aided Verification, CAV 2004 (Lecture Notes in Computer Science, vol. 3114), Boston MA, Alur R, Peled D (eds.). Springer: Berlin, July 2004; 496-500.
26. Clarke E, Veith H. Counterexamples revisited: Principles, algorithms, applications. Verification: Theory and Practice (Lecture Notes in Computer Science, vol. 2772). Springer: Berlin, 2004; 208-224.
27. Clarke EM, Jha S, Lu Y, Veith H. Tree-like counterexamples in model checking. LICS '02: Proceedings of the 17th Annual IEEE Symposium on Logic in Computer Science, Washington, DC, U.S.A. IEEE Computer Society: Silver Spring, MD, 2002; 19-29. ISBN 0-7695-1483-9.
28. Wijesekera D, Sun L, Ammann P, Fraser G. Relating counterexamples to test cases in CTL model checking specifications. A-MOST '07: Proceedings of the 3rd International Workshop on Advances in Model-based Testing, New York, NY, U.S.A. ACM Press: New York, 2007; 75-84. ISBN 978-1-59593-850-3. DOI: 10.1145/1291535.1291543.
29. Meolic R, Fantechi A, Gnesi S. Witness and counterexample automata for ACTL. Formal Techniques for Networked and Distributed Systems (Lecture Notes in Computer Science, vol. 3235). Springer: Berlin, 2004; 259-275.
30. Gargantini A, Heitmeyer C. Using model checking to generate tests from requirement specifications. ESEC/FSE'99: 7th European Software Engineering Conference, Held Jointly with the 7th ACM SIGSOFT Symposium on the Foundations of Software Engineering, vol. 1687. Springer: Berlin, 1999; 146-162.
31. Broy M, Jonsson B, Katoen J-P, Leucker M, Pretschner A. Model-Based Testing of Reactive Systems: Advanced Lectures (Lecture Notes in Computer Science). Springer: New York, Secaucus, NJ, U.S.A., 2005. ISBN 3540262784.
32. Hong HS, Lee I. Automatic test generation from specifications for control-flow and data-flow coverage criteria. Proceedings of Monterey Workshop, Naval Postgraduate School, Monterey, CA, June 2001; 230-246.
33. Huan H, Tsai W-T, Paul R, Chen Y. Automated model checking and testing for composite web services. Proceedings of the 8th IEEE International Symposium on Object-oriented Real-time Distributed Computing. IEEE Computer Society: Silver Spring, MD, 2005; 300-307.
34. Garcia-Fanjul J, Tuya J, de la Riva C. Generating test cases specifications for BPEL compositions of web services using SPIN. Proceedings of the International Workshop on Web Services Modeling and Testing (WS-MaTe 2006), Palermo, Italy, 2006; 83-94.
35. Tan L, Sokolsky O, Lee I. Specification-based testing with linear temporal logic. Proceedings of IEEE International Conference on Information Reuse and Integration (IRI'04), Las Vegas, U.S.A., 2004; 493-498.
36. Ammann PE, Black PE, Majurski W. Using model checking to generate tests from specifications. Proceedings of the Second IEEE International Conference on Formal Engineering Methods (ICFEM'98). IEEE Computer Society: Silver Spring, MD, 1998; 46-54.
37. Ammann P, Offutt J. Introduction to Software Testing. Cambridge University Press: New York, NY, U.S.A., 2008. ISBN 0521880386, 9780521880381.
38. Heitmeyer CL. Software cost reduction. Encyclopedia of Software Engineering, vol. 2. Wiley: New York, 2002.
39. Gurevich Y. Sequential abstract-state machines capture sequential algorithms. ACM Transactions on Computational Logic 2000; 1(1):77-111. DOI: 10.1145/343369.343384.
40. Gargantini A, Riccobene E. ASM-based testing: Coverage criteria and automatic test sequence. Journal of Universal Computer Science 2001; 7(11):1050-1067.
41. Gargantini A, Riccobene E, Rinzivillo S. Using SPIN to generate tests from ASM specifications. Proceedings of the Abstract State Machines 2003. Advances in Theory and Practice: 10th International Workshop, ASM 2003, Taormina, Italy, 3-7 March 2003 (Lecture Notes in Computer Science, vol. 2589). Springer: Berlin, 2003; 263.
42. Heimdahl MPE, Rayadurgam S, Visser W. Specification centered testing. Proceedings of the Second International Workshop on Automated Program Analysis, Testing and Verification, Toronto, Canada, May 2001.
43. Rayadurgam S, Heimdahl MPE. Coverage based test-case generation using model checkers. Proceedings of the 8th Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ECBS 2001), Washington, DC, U.S.A. IEEE Computer Society: Silver Spring, MD, April 2001; 83-91.
44. Rayadurgam S, Heimdahl MPE. Coverage based test-case generation using model checkers. Technical Report 01-005, University of Minnesota, Minneapolis, 2001.
45. Rayadurgam S, Heimdahl MPE. Test-sequence generation from formal requirement models. HASE '01: The 6th IEEE International Symposium on High-Assurance Systems Engineering, Washington, DC, U.S.A. IEEE Computer Society: Silver Spring, MD, 2001. ISBN 0769512755.
46. Thompson JM, Heimdahl MPE, Miller SP. Specification-based prototyping for embedded systems. ESEC/FSE-7: Proceedings of the 7th European Software Engineering Conference held jointly with the 7th ACM SIGSOFT International Symposium on Foundations of Software Engineering, London, U.K. Springer: Berlin, 1999; 163-179. ISBN 3-540-66538-2. DOI: 10.1145/318773.318940.
47. Ammann P, Offutt J, Huang H. Coverage criteria for logical expressions. ISSRE '03: Proceedings of the 14th International Symposium on Software Reliability Engineering, Washington, DC, U.S.A. IEEE Computer Society: Silver Spring, MD, 2003; 99. ISBN 0-7695-2007-3.
48. Offutt AJ, Xiong Y, Liu S. Criteria for generating specification-based tests. ICECCS '99: Proceedings of the 5th International Conference on Engineering of Complex Computer Systems, Washington, DC, U.S.A. IEEE Computer Society: Silver Spring, MD, 1999; 119-129. ISBN 0-7695-0434-5.
49. Chilenski JJ, Miller SP. Applicability of modified condition/decision coverage to software testing. Software Engineering Journal 1994; 9(5):193-200.
50. Rayadurgam S, Heimdahl MPE. Generating MC/DC adequate test sequences through model checking. Proceedings of the 28th Annual NASA Goddard Software Engineering Workshop, Greenbelt, MD, 2003; 91-96.
51. Ammann P, Black PE, Ding W. Model checkers in software testing. Technical Report NIST-IR 6777, National Institute of Standards and Technology, 2002.
52. Akers SB Jr. On a theory of Boolean functions. Journal of the Society for Industrial and Applied Mathematics 1959; 7(4):487-498. DOI: 10.1137/0107041.
53. Vilkomir SA, Bowen JP. Reinforced condition/decision coverage (RC/DC): A new criterion for software testing. ZB '02: Proceedings of the 2nd International Conference of B and Z Users on Formal Specification and Development in Z and B, London, U.K. Springer: Berlin, 2002; 291-308. ISBN 3-540-43166-7.
54. Hong HS, Lee I, Sokolsky I, Ural H. A temporal logic based theory of test coverage and generation. Tools and Algorithms for the Construction and Analysis of Systems: 8th International Conference, TACAS 2002, Held as Part of the Joint European Conference on Theory and Practice of Software, ETAPS 2002, Grenoble, France (Lecture Notes in Computer Science, vol. 2280). Springer: Berlin, 2002; 151-161.
55. Hong HS, Cha SD, Lee I, Sokolsky O, Ural H. Data flow testing as model checking. ICSE '03: Proceedings of the 25th International Conference on Software Engineering, Washington, DC, U.S.A. IEEE Computer Society: Silver Spring, MD, 2003.
56. Rapps S, Weyuker EJ. Selecting software test data using data flow information. IEEE Transactions on Software Engineering 1985; 11(4):367-375. ISSN 0098-5589. DOI: 10.1109/TSE.1985.232226.
57. Hong HS, Ural H. Dependence testing: Extending data flow testing with control dependence. Testing of Communicating Systems (Lecture Notes in Computer Science, vol. 3502). Springer: Berlin, 2002; 23-39.
58. Hong HS, Lee I, Sokolsky O, Cha SD. Automatic test generation from statecharts using model checking. Technical Report, MS-CIS-01-07, 2001.
59. Kuhn DR, Okun V. Pseudo-exhaustive testing for software. Thirtieth Annual IEEE/NASA Software Engineering Workshop (SEW-30 2006), 25-28 April 2006. Loyola College Graduate Center, Columbia, MD, U.S.A. IEEE Computer Society: Silver Spring, MD, 2006; 153-158. DOI: 10.1109/ SEW.2006.26.
60. Calvagna A, Gargantini A. A logic-based approach to combinatorial testing with constraints. Tests and Proofs (Lecture Notes in Computer Science, vol. 4966). Springer: Berlin, 2008; 66-83. DOI: 10.1007/ 978-3-540-79124-9-6.
61. Callahan JR, Easterbrook SM, Montgomery TL. Generating test oracles via model checking. Technical Report, NASA/WVU Software Research Lab, 1998.
62. Beer I, Ben-David S, Eisner C, Rodeh Y. Efficient detection of vacuity in ACTL formulas. CAV '97: Proceedings of the 9th International Conference on Computer Aided Verification, London, U.K. Springer: Berlin, 1997; 279-290. ISBN 3-540-63166-6.
63. Kupferman O, Vardi MY. Vacuity detection in temporal model checking. CHARME '99: Proceedings of the 10th IFIP WG 10.5 Advanced Research Working Conference on Correct Hardware Design and Verification Methods, London, U.K. Springer: Berlin, 1999; 82-96. ISBN 3-540-66559-5.
64. Purandare M, Somenzi F. Vacuum cleaning CTL formulae. CAV '02: Proceedings of the 14th International Conference on Computer Aided Verification, London, U.K. Springer: Berlin, 2002; 485-499. ISBN 3-540-43997-8.
65. Whalen MW, Rajan A, Heimdahl MPE, Miller SP. Coverage metrics for requirements-based testing. ISSTA'06: Proceedings of the 2006 International Symposium on Software Testing and Analysis, New York, NY, U.S.A. ACM Press: New York, 2006; ISBN 1-59593-263-1.
66. DeMillo RA, Lipton RJ, Sayward FG. Hints on test data selection: Help for the practicing programmer. Computer 1978; 11:34-41.
67. Acree AT, Budd TA, DeMillo RA, Lipton RJ, Sayward FG. Mutation analysis. Technical Report, School of Information and Computer Science, Georgia Institute of Technology, Atlanta, GA, 1979.
68. Budd TA, Gopal AS. Program testing by specification mutation. Computer Languages 1985; 10(1):63-73. ISSN 0096-0551. DOI: 10.1016/0096-0551(85)90011-6.
69. Ammann P, Black PE. A specification-based coverage metric to evaluate test sets. HASE '99: The 4th IEEE International Symposium on High-Assurance Systems Engineering. IEEE Computer Society: Washington, DC, U.S.A., 1999; 239-248. ISBN 0-7695-0418-3.
70. Srivatanakul T, Clark JA, Stepney S, Polack F. Challenging formal specifications by mutation: A CSP security example. Tenth Asia-Pacific Software Engineering Conference. IEEE Computer Society: Washington, DC, U.S.A., 2003; 340-350.
71. Black PE, Okun V, Yesha Y. Mutation operators for specifications. Proceedings of the 15th IEEE International Conference on Automated Software Engineering (ASE'00). IEEE Computer Society: Washington, DC, U.S.A., 2000.
72. Fraser G, Wotawa F. Using model-checkers for mutation-based test-case generation, coverage analysis and specification analysis. Proceedings of the International Conference on Software Engineering Advances (ICSEA 2006). IEEE Computer Society: Los Alamitos, CA, U.S.A., 2006; 16-22. ISBN 0-7695-2703-5. DOI: 10.1109/ICSEA.2006.75.
73. Fraser G, Wotawa F. Using and improving requirement properties for mutation based test-case generation. 22. WI-MAW Rundbrief, Jahrgang, 2006; 12(2):5-23.
74. Black PE, Okun V, Yesha Y. Mutation of model checker specifications for test generation and evaluation. Mutation Testing for the New Century. Kluwer Academic Publishers: Norwell, MA, U.S.A., 2001; 14-20.
75. Gargantini A. Using model checking to generate fault detecting tests. Proceedings of the International Conference on Tests And Proofs (TAP), Zurich, Switzerland (Lecture Notes in Computer Science, vol. 4454). Springer: Berlin, 2007; 189-206.
76. Okun V, Black PE, Yesha Y. Testing with model checker: Insuring fault visibility. Technical Report NIST-IR 6929, National Institute of Standards and Technology, 2003.
77. Boroday S, Petrenko A, Groz R. Can a Model Checker Generate Tests for Non-deterministic Systems (Electronic Notes in Theoretical Computer Science, vol. 190). Springer: Berlin, 2007; 3-19.
78. Ammann P, Ding W, Xu D. Using a model checker to test safety properties. Proceedings of the 7th International Conference on Engineering of Complex Computer Systems (ICECCS 2001). IEEE Press: New York, 2001; 212-221.
79. Fraser G, Wotawa F. Using model-checkers to generate and analyze property relevant test-cases. Software Quality Journal 2008; 16(2):161-183. ISSN 0963-9314.
80. Fraser G, Wotawa F. Property relevant software testing with model-checkers. SIGSOFT Software Engineering Notes 2006; 31(6):1-10. ISSN 0163-5948. DOI: 10.1145/1218776.1218787.
81. Clarke EM, Grumberg O, Jha S, Lu Y, Veith H. Counterexample-guided abstraction refinement. CAV '00: Proceedings of the 12th International Conference on Computer Aided Verification. Springer: London, U.K., 2000; 154-169. ISBN 3-540-67770-4.
82. Prenninger W, Pretschner A. Abstractions for Model-Based Testing (Electronic Notes in Theoretical Computer Science, vol. 116). Springer: Berlin, 2005; 59-71.
83. Ammann P, Black PE. Abstracting formal specifications to generate software tests via model checking. Proceedings of the 18th Digital Avionics Systems Conference, vol. 2. IEEE Press: New York, 1999.
84. Fraser G, Wotawa F. Test-case generation and coverage analysis for nondeterministic systems using model-checkers. Proceedings of the International Conference on Software Engineering Advances (ICSEA 2007). IEEE Computer Society: Los Alamitos, CA, U.S.A., 2007; 45. ISBN 0-7695-2937-2. DOI: 10.1109/ICSEA.2007.71.
85. Heimdahl MPE, Rayadurgam S, Visser W, Devaraj G, Gao J. Auto-generating test sequences using model checkers: A case study. Third International Workshop on Formal Approaches to Software Testing (Lecture Notes in Computer Science, vol. 2931). Springer: Berlin, 2003; 42-59.
86. Heimdahl MPE, Devaraj G, Weber R. Specification test coverage adequacy criteria=specification test generation inadequacy criteria? HASE. IEEE Computer Society: Los Alamitos, CA, U.S.A., 2004; 178-186. ISBN 0-7695-2094-4.
87. Devaraj G, Heimdahl MPE, Liang D. Coverage-directed test generation with model checkers: Challenges and opportunities. COMPSAC '05: Proceedings of the 29th Annual International Computer Software and Applications Conference (COMPSAC'05), vol. 1. IEEE Computer Society: Washington, DC, U.S.A., 2005; 455-462. DOI: 10.1109/COMPSAC.2005.66.
88. Abdurazik A, Ammann P, Ding W, Offutt J. Evaluation of three specification-based coverage testing criteria. Proceedings of the 6th IEEE International Conference on Engineering of Complex Computer Systems (ICECCS 2000). IEEE Computer Society: Tokyo, Japan, 2000; 179-187.
89. Offutt JA, Voas JM. Subsumption of condition coverage techniques by mutation testing. Technical Report, ISSE-TR-96-01, 1996.
90. Black PE. Demonstration of generating tests from formal specifications [web page]. URL http://hissa.nist.gov/black/AFTG/ [24 October 2007].
91. Hamon G, de Moura L, Rushby J. Automated test generation with SAL. Technical Report, Computer Science Laboratory, SRI International, 2005.
92. Gargantini A. ATGT: ASM Tests Generation Tool [web page]. URL http:// cs.unibg.it/gargantini/projects/atgt/ [25 June 2008].
93. Black PE, Ranville S. Winnowing tests: Getting quality coverage from a model checker without quantity. Digital Avionics Systems, 2001. DASC. The 20th Conference, vol. 2, 2001; 9B6/1-9B6/4.
94. Harrold MJ, Gupta R, Soffa ML. A methodology for controlling the size of a test suite. ACM Transactions on Software Engineering and Methodology 1993; 2(3):270-285. ISSN 1049-331X. DOI: 10.1145/ 152388.152391.
95. Heimdahl MPE, Devaraj G. Test-suite reduction for model based tests: Effects on test quality and implications for testing. ASE. IEEE Computer Society: Silver Spring, MD, 2004; 176-185. ISBN 0-7695-2131-2.
96. Zeng H, Miao H, Liu J. Specification-based test generation and optimization using model checking. Proceedings of the First Joint IEEE/IFIP Symposium on Theoretical Aspects of Software Engineering (TASE' 07). IEEE Computer Society: Los Alamitos, CA, U.S.A., 2007; 349-355. DOI: 10.1109/TASE.2007.46.
97. Fraser G, Wotawa F. Redundancy based test-suite reduction. Proceedings of the 10th International Conference on Fundamental Approaches to Software Engineering (FASE 2007) (Lecture Notes in Computer Science, vol. 4422). Springer: Berlin, 2007; 291-305.
98. Hamon G, de Moura L, Rushby J. Generating efficient test sets with a model checker. Proceedings of the 2nd International Conference on Software Engineering and Formal Methods (SEFM'04). IEEE Computer Society: Los Alamitos, CA, U.S.A., 2004; 261-270.
99. Fraser G, Wotawa F. Using LTL rewriting to improve the performance of model-checker based test-case generation. A-MOST '07: Proceedings of the 3rd International Workshop on Advances in Model-based Testing. ACM Press: New York, NY, U.S.A., 2007; 64-74. ISBN 978-1-59593-850-3. DOI: 10.1145/1291535.1291542.
100. Rothermel G, Untch RH, Chu C, Harrold MJ. Test case prioritization: An empirical study. ICSM'99: Proceedings of the IEEE International Conference on Software Maintenance. Washington, DC, USA. IEEE Computer Society: Silver Spring, MD, 1999; 179. ISBN 0-7695-0016-1.
101. Fraser G, Wotawa F. Test-case prioritization with model-checkers. SE'07: Proceedings of the 25th Conference on IASTED International Multi-Conference, Innsbruck, Austria. ACTA Press: Anaheim, CA, U.S.A., 2007; 267-272.
102. Hyoung S, Hong X, Ural H. Using model checking for reducing the cost of test generation. Formal Approaches to Software Testing (Lecture Notes in Computer Science, vol. 3395). Springer: Berlin, 2005; 110-124.
103. Havelund K, Rosu G. Monitoring programs using rewriting. ASE' 01: Proceedings of the 16th IEEE International Conference on Automated Software Engineering, Washington, DC, U.S.A. IEEE Computer Society: Silver Spring, MD, 2001; 135.
104. Barringer H, Goldberg A, Havelund K, Sen K. Program monitoring with LTL in EAGLE. PADTAD'04, Parallel and Distributed Systems: Testing and Debugging. IEEE Computer Society: Los Alamitos, CA, U.S.A., 2004.
105. Havelund K, Rosu G. Efficient monitoring of safety properties. International Journal on Software Tools for Technology Transfer 2004; 6(2):158-173. ISSN 1433-2779. DOI: 10.1007 /s10009-003-0117-6.
106. Rosu G, Havelund K. Rewriting-based techniques for runtime verification. Automated Software Engineering 2005; 12(2):151-197. DOI: 10.1007/s10515-005-6205-y.
107. Fraser G, Wotawa F. Mutant minimization for model-checker based test-case generation. Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION, 2007. TAICPART-MUTATION 2007. IEEE Computer Society: Silver Spring, MD, 2007; 161-168. DOI: 10.1109/TAICPART.2007.4344120.
108. Xu L, Dias M, Richardson D. Generating regression tests via model checking. COMPSAC '04: Proceedings of the 28th Annual International Computer Software and Applications Conference (COMPSAC'04), Washington, DC, U.S.A. IEEE Computer Society: Silver Spring, MD, 2004; 336-341. ISBN 0-7695-2209-2-1.
109. Fraser G, Aichernig B, Wotawa F. Handling Model Changes: Regression Testing and Test-suite Update with Model-checkers (Electronic Notes in Theoretical Computer Science, vol. 190). Springer: Berlin, 2007; 33-46.
110. Hessel A, Larsen KG, Nielsen B, Pettersson P, Skou A. Time-optimal real-time test case generation using Uppaal. Proceedings of the 3rd International Workshop on Formal Approaches to Software Testing (FATES 2003), vol. 2931, Petrenko A, Ulrich A (eds.). Springer: Berlin, Heidelberg, 2004; 114-130.
111. Larsen KG, Pettersson P, Yi W. UPPAAL in a nutshell. International Journal on Software Tools for Technology Transfer (STTT) 1997; 1(1-2):134-152.
112. Black PE. Modeling and marshaling: Making tests from model checker counterexamples. Proceedings of the 19th Digital Avionics Systems Conference, vol. 1. IEEE Press: New York, 2000; 1.B.3-1-1.B.3-6.
113. Groce A, Peled D, Yannakakis M. Adaptive model checking. TACAS'02: Proceedings of the 8th International Conference on Tools and Algorithms for the Construction and Analysis of Systems, London, U.K. Springer: Berlin, 2002; 357-370. ISBN 3-540-43419-4.
114. Peled D. Model checking and testing combined. Automata, Languages and Programming, Proceedings of the 30th International Colloquium, ICALP 2003, Eindhoven, The Netherlands, June 30-July 4 2003 (Lecture Notes in Computer Science, vol. 2719), Baeten CM, Lenstra JK, Parrow J, Woeginger GJ (eds.). Springer: Berlin, 2003; 47-63.
115. Beyer D, Chlipala AJ, Henzinger TA, Jhala R, Majumdar R. Generating tests from counterexamples. Proceedings of the 26th International Conference on Software Engineering (ICSE'04, Edinburgh). IEEE Computer Society Press: Silver Spring, MD, 2004; 326-335.
116. Henzinger TA, Jhala R, Majumdar R, Sutre G. Software verification with BLAST. Model Checking Software: Proceedings of the 10th International SPIN Workshop, Portland, OR, U.S.A., 9-10 May 2003. Springer: Berlin, 2003; 235-239.
117. Visser W, Pasareanu CS, Khurshid S. Test input generation with Java PathFinder. ISSTA'04: Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis, New York, NY, U.S.A. ACM Press: New York, 2004; 97-107. ISBN 1-58113-820-2. DOI: 10.1145/1007512.1007526.
118. Havelund K. Java PathFinder: A Translator from Java to Promela. Proceedings of the 5th and 6th International SPIN Workshops on Theoretical and Practical Aspects of SPIN Model Checking, London, U.K. Springer: Berlin, 1999; 152.
119. Visser W, Havelund K, Brat G, Park SJ. Model checking programs. ASE '00: Proceedings of the 15th IEEE International Conference on Automated Software Engineering, Washington, DC, U.S.A. IEEE Computer Society: Silver Spring, MD, 2000; 3-11. ISBN 0-7695-0710-7.
120. Pasareanu CS, Khurshid S, Visser W. Generalized symbolic execution for model checking and testing. TACAS'03: Proceedings of the 9th International Conference on Tools and Algorithms for the Construction and Analysis of Systems, Warsaw, Poland. Springer: Berlin, 2003; 553-568.
121. Visser W, Pǎasǎreanu CS, Pelánek R. Test input generation for Java containers using state matching. ISSTA'06: Proceedings of the 2006 International Symposium on Software Testing and Analysis, New York, NY, U.S.A. ACM Press: New York, 2006. ISBN 1-59593-263-1. DOI: 10.1145/1146238.1146243.
122. Mishra P, Dutt N. Automatic functional test program generation for pipelined processors using model checking. HLDVT '02: Proceedings of the Seventh IEEE International High-level Design Validation and Test Workshop, Washington, DC, U.S.A. IEEE Computer Society: Silver Spring, MD, 2002; 99. ISBN 0-7803-7655-2.
123. Mishra P, Dutt N. Graph-based functional test program generation for pipelined processors. DATE'04: Proceedings of the Conference on Design, Automation and Test in Europe, Washington, DC, U.S.A. IEEE Computer Society: Silver Spring, MD, 2004; 10182. ISBN 0-7695-2085-5-1.
124. Koo H-M, Mishra P. Test Generation using SAT-based bounded model checking for validation of pipelined processors. GLSVLSI'06: Proceedings of the 16th ACM Great Lakes Symposium on VLSI. ACM: New York, NY, U.S.A., 2006; 362-365. ISBN 1-59593-347-6. DOI: http:// doi.acm.org/10.1145/1127908.1127991.
125. Koo H-M, Mishra P, Bhadra J, Abadir M. Directed micro-architectural test generation for an industrial processor: A case study. Seventh International Workshop on Microprocessor Test and Verification. IEEE Computer Society: Los Alamitos, CA, U.S.A., 2006; 33-36. DOI: 10.1109/ MTV.2006.10.
126. Edelkamp S, Lafuente AL, Leue S. Directed explicit model checking with HSF-SPIN. SPIN'01: Proceedings of the 8th International SPIN Workshop on Model Checking of Software, New York, NY, U.S.A. Springer: New York, NY, U.S.A., 2001; 57-79. ISBN 3-540-42124-6.