An experimental evaluation of a higher-ordered-typed-functional specification-based test-generation technique

Empirical Software Engineering

Volumn 11, Issue 2, 2006, Pages 173-202

  Sinha, Avik ^a   Smidts, Carol ^b  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

Controlled experiment; EFSM software model; Empirical study; Functional specification language; Software test automation

Indexed keywords

CONTROLLED EXPERIMENT; EFSM SOFTWARE MODEL; EMPIRICAL STUDY; FUNCTIONAL SPECIFICATION LANGUAGE; SOFTWARE TEST AUTOMATION;

AUTOMATION; COMPUTER HARDWARE DESCRIPTION LANGUAGES; COMPUTER SOFTWARE; MATHEMATICAL MODELS;

SOFTWARE ENGINEERING;

EID: 33644906370     PISSN: 13823256     EISSN: 15737616     Source Type: Journal    
DOI: 10.1007/s10664-006-6401-9     Document Type: Article

References (39)

1. Arango G (1989) Domain analysis: from art form to engineering discipline. Proc. 5th International Workshop on Software Specification and Design, Pittsburgh, pp 152-159
2. Barnett M, Grieskamp W, Nachmanson L, Schulte W, Tillmann N, and Veanes M (2003). Model-based testing with asmL.NET. In Proc. 1st European Conference on Model-Driven Software Engineering
3. Basili V (1995) Software quality assurance and measurement: a worldwide perspective, applying the goal/question/metric paradigm in the experience factory, Chapter 2, International Thomson Computer Press, ITP An International Thomson Publishing Company, pp 21-44
4. Bjesse P, Claessen K, Sheeran M, and Singh S (1998, September) Lava: hardware design in Haskell. In Proc. ICFP
5. Campbell DT, and Stanley JC (1963) Experimental and quasi-experimental designs for research. Rand McNally and Company, Chicago
6. Chaar JK, Halliday MJ, Bhandari IS, and Chillarege R (1993) In-process evaluation of software inspection and test. IEEE Trans Softw Eng 19(11):1055-1070
7. Chays D, Dan S, Frankl PG, Vokolos FI, and Weyuker EJ (2000) A framework for testing database applications. In Proc. ISSTA, Portland, pp 147-157
8. Cohen J (1990) A power primer. Psychol Bull 112(1):155-159
9. Deursen A, Klint P, and Visser J (2000) Domain-specific languages: an annotated bibliography. ACM SIGPLAN Notices 35(6):26-36, http://www.cwi.nl/ projects/dsl
10. Dick J, and Faivre A (1993) Automating the generation and sequencing of test cases from model-based specifications. In Proc. First International Symposium of Formal Methods Europe on Industrial-Strength Formal Methods, Odense, pp 268-284
11. Dssouli R, Saleh K, Aboulhamid E, En-Nouaary A, and Bourhfir C (1999) Test development for communication protocols: towards automation. Comput Networks, 31:1835-1872
12. Field A, and Hole G (2003) How to design and report experiments. SAGE Publications, London, UK
13. Hall AV (1991) Relations between specifications and testing. Inf Softw Technol 33(1):47-52
14. HaskellDB Manual (2002) Galois Connections Inc.
15. Huber JT (1999) Efficiency and effectiveness measures to help guide the business of software testing. Applications of Software Measurement, HP Labs Research Report [Online]. Available: http://www.benchmarkqa.com/PDFs/ efficiency_measures.pdf
16. Hudak P (2000) The Haskell school of expression. Cambridge University Press, New York
17. Hughes A, and Grawoig D (1971) Statistics: a foundation for analysis. Addition Wesley Publishing Company, Reading, MA
18. IEEE Guide to Software Requirements Specification (1984) IEEE Standard 830
19. Jagadeesan LJ, Porter A, Puchol C, Ramming CJ, and Votta LG (1997) Specification-based testing of reactive software: tools and experiments. In Proc. 19th International Conference on Software Engineering, Boston, pp 525-535
20. John BE (1996) Evaluating usability evaluation techniques. ACM Computing Surveys, [Online] 28 (4es). Available: http://www.acm.org/pubs/citations/ journals/surveys/1996-28-4es/a139-john/
21. Leijen D, and Meijer E (1999) Domain specific embedded compilers. Proc. 2nd USENIX Conference on DSL, Austin, pp 109-122
22. Memon AM, Pollack ME, and Soffa ML (2001) Hierarchical GUI test case generation using automated planning. IEEE Trans Softw Eng 27(2):144-155
23. Nielsen J (1993) Usability engineering. Academic Press Inc, San Diego, CA
24. Peter DK, and Parnas DL (1998) Using test oracles generated from program documentation. IEEE Trans Softw Eng 24(3):161-173
25. Rational XDE Tester User's Guide (2004) IBM Corporation, New York, NY
26. Savage P, Walters S, and Stephenson M (1 997) Automated test methodology for operational flight programs. In Proc. IEEE Aerospace Conference, vol. 4, 293-305
27. Silktest User's Guide, Version 6.5 (2002) Segue Software Inc., Lexington, MA
28. Sinha A, Smidts C, and Moran A (2003) Enhanced testing of domain specific applications by automatic extraction of axioms from functional specifications. In Proc. 14th International Symposium on Software Reliability Engineering, Denver, pp 181-190
29. Sinha A (2005) Domain specific test case generation using higher ordered typed languages for specification. PhD Thesis, University of Maryland
30. Stark GE, Durst RC, and Pelnik TM (2001) An evaluation of software testing metrics for NASA's mission control center" MITRE
31. Stocks PA, and Carrington DA (1991) Deriving software test cases from formal specifications. In Proc. 6th Australian Software Engineering Conference, Sydney, pp 327-340
32. Test Master User's Guide (1999) Release 1.9.5, Empirix Inc., New Hampshire Testing Tool Information, Grove Consultants, 2002
33. Thiemann P, An Embedded Domain-Specific Language for Type-Safe Server-Side Web-Scripting. [Online] http://www.informatik.uni-freiburg.de/ ~thiemann/haskell/WASH/draft.pdf
34. Thompson S (1999) Haskell: the craft of functional programming. Addison-Wesley, Essex
35. Tretmans J, and Belinfante A (1999) Automatic testing with formal methods. In Proc. Euro-STAR'99: 7th European Int. Conference on Software Testing, Analysis & Review, Barcelona, Spain, EuroStar Conferences, Galway, Ireland, pp 8-12
36. Vaysburg B, Tahat LH, and Korel B (2002) Dependence analysis in reduction of requirement based test suites. In Proc. International Symposium on Software Testing and Analysis, Roma, Italy, pp 107-111
37. Wang CJ, and Liu MT (1993) Generating test cases for EFSM with given fault models. In Proc. IEEE Infocom, vol. 2, 774-781
38. Williams CE (2001) Toward a test-ready meta-model for use cases. In Proc. Workshop on Practical UML-based Rigorous Development Methods, Toronto, CA, pp 270-287
39. WinRunner User's Guide, Version 7.01 (2001) Mercury Interactive Inc., Sunnyvale, CA