Improving test suites via operational abstraction

Proceedings - International Conference on Software Engineering

Volumn , Issue , 2003, Pages 60-71

  Harder, Michael ^a   Mellen, Jeff ^a   Ernst, Michael D ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ABSTRACTING; DYNAMIC PROGRAMMING; ENCODING (SYMBOLS); PROGRAM DIAGNOSTICS; SEMANTICS;

PROGRAM SEMANTIC DOMAIN; PROGRAM SYNTACTIC DOMAIN; TEST SUITE EXECUTION;

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 0038262973     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/icse.2003.1201188     Document Type: Conference Paper

References (39)

1. Paul E. Amman and Paul E. Black. A specification-based coverage metric to evaluate test sets. International Journal of Reliability, Quality and Safety Engineering, 8(4):275-299, 2001.
2. Gilles Bernot, Marie Claude Gaudel, and Bruno Marre. Software testing based on formal specifications: a theory and a tool. IEE Software Engineering Journal, 6, November 1991.
3. Marc J. Balcer, William M. Hasling, and Thomas J. Ostrand. Automatic generation of test scripts from formal test specifications. In Richard A. Kemmerer, editor, Proceedings of the ACM SIGSOFT '89 Third Symposium on Testing, Analysis, and Verification (TAV3), pages 210-218, December 1989.
4. Simon Burton. Towards automated unit testing of state-chart implementations. Technical report, Department of Computer Science, University of York, UK, 1999.
5. Juei Chang and Debra J. Richardson. Structural specification-based testing: Automated support and experimental evaluation. In Proceedings of the 7th European Software Engineering Conference and the 7th ACM SIGSOFT Symposium on the Foundations of Software Engineering, pages 285-302, September 6-10, 1999.
6. Juei Chang, Debra J. Richardson, and Sriram Sankar. Structural specification-based testing with ADL. In Proceedings of the 1996 International Symposium on Software Testing and Analysis (ISSTA), pages 62-70, 1996.
7. J. Dick and A. Faivre. Automating the generating and sequencing of test cases from model-based specifications. In FME '93: Industrial Strength Formal Methods, 5th International Symposium of Formal Methods Europe, pages 268-284, 1993.
8. Joe W. Duran and Simeon C. Ntafos. An evaluation of random testing. IEEE Transactions on Software Engineering, 10(4):438-444, July 1984.
9. Michael R. Donat. Automating formal specification-based testing. In TAPSOFT '97: Theory and Practice of Software Development, 7th International Joint Conference CAAP/FASE, pages 833-847. Springer-Verlag, April 1997.
10. Michael D. Ernst, Adam Czeisler, William G. Griswold, and David Notkin. Quickly detecting relevant program invariants. In ICSE 2000, Proceedings of the 22nd International Conference on Software Engineering, pages 449-458, Limerick, Ireland, June 7-9, 2000.
11. Michael D. Ernst, Jake Cockrell, William G. Griswold, and David Notkin. Dynamically discovering likely program invariants to support program evolution. IEEE Transactions on Software Engineering, 27(2):1-25, February 2001. A previous version appeared in ICSE '99, Proceedings of the 21st International Conference on Software Engineering, pages 213-224, Los Angeles, CA, USA, May 19-21, 1999.
12. Michael D. Ernst. Dynamically Discovering Likely Program Invariants. PhD thesis, University of Washington Department of Computer Science and Engineering, Seattle, Washington, August 2000.
13. Phyllis G. Frankl, Richard G. Hamlet, Bev Littlewood, and Lorenzo Strigini. Evaluating testing methods by delivered reliability. IEEE Transactions on Software Engineering, 24(8):586-601, August 1998. Special Section: International Conference on Software Engineering (ICSE '97).
14. Phyllis Frankl, Dick Hamlet, Bev Littlewood, and Lorenzo Strigini. Correction to: Evaluating testing methods by delivered reliability. IEEE Transactions on Software Engineering, 25(2):286, March/April 1999.
15. John B. Goodenough and Susan L. Gerhart. Correction to "Toward a theory of test data selection". IEEE Transactions on Software Engineering, 1(4):425, December, 1975.
16. John B. Goodenough and Susan L. Gerhart. Toward a theory of test data selection. IEEE Transactions on Software Engineering, 1(2):156-173, June 1975.
17. Todd L. Graves, Mary Hean Harrold, Jung-Min Kim, Adam Porter, and Gregg Rothermal. An empirical study of regression test selection techniques. ACM Transactions on Software Engineering and Methodology, 10(2):184-208, April 2001.
18. Richard G. Hamlet. Probable correctness theory. Information Processing Letters, 25(1):17-25, April 20, 1987.
19. Michael Harder. Improving test suites via generated specifications. Technical Report 848, MIT Laboratory for Computer Science, Cambridge, MA, June 4, 2002. Revision of author's Master's thesis.
20. Monica Hutchins, Herb Foster, Tarak Goradia, and Thomas Ostrand. Experiments on the effectiveness of dataflow-and controlflow-based test adequacy criteria. In Proceedings of the 16th International Conference on Software Engineering, pages 191-200, Sorrento, Italy, May 16-21, 1994.
21. Roger Hayes and Sriram Sankar. Specifying and testing software components using ADL. Technical Report TR-94-23, Sun Microsystems Research, Palo Alto, CA, USA, April 1994.
22. Daniel Hoffman and Paul Strooper. Tools and techniques for Java API testing. In Proceedings of the 2000 Australian Software Engineering Conference, pages 235-245, 2000.
23. Daniel Hoffman, Paul Strooper, and Lee White. Boundary values and automated component testing. Software Testing, Verification, and Reliability, 9(1):3-26, March 1999.
24. Dick Hamlet and Ross Taylor. Partition testing does not inspire confidence. IEEE Transactions on Software Engineering, 16(12):1402-1411, December 1990.
25. James A. Jones and Mary Jean Harrold. Test-suite reduction and prioritization for modified condition/decision coverage. In ICSM 2001, Proceedings of the International Conference on Software Maintenance, pages 92-101, Florence, Italy, November 6-10, 2001.
26. Christophe Meudec. Automatic Generation of Software Test Cases From Formal Specifications. PhD thesis, Queen's University of Belfast, 1998.
27. Jeremy W. Nimmer and Michael D. Ernst. Automatic generation of program specifications. In ISSTA 2002, Proceedings of the 2002 International Symposium on Software Testing and Analysis, pages 232-242, Rome, Italy, July 22-24, 2002.
28. Jeremy W. Nimmer and Michael D. Ernst. Invariant inference for static checking: An empirical evaluation. In Proceedings of the ACM SIGSOFT 10th International Symposium on the Foundations of Software Engineering (FSE 2002), pages 11-20, Charleston, SC, November 20-22, 2002.
29. Toh Ne Win, Michael D. Ernst, Stephen J. Garland, Dilsun Kirli, and Nancy Lynch. Using simulated execution in verifying distributed algorithms. In VMCAI'03, Fourth International Conference on Verification, Model Checking and Abstract Interpretation, pages 283-297, New York, New York, Janury 9-11, 2003.
30. T. J. Ostrand and M. J. Balcer. The category-partition method for specifying and generating functional tests. Communications of the ACM, 31(6):676-686, June 1988.
31. A. Jefferson Offutt. An integrated automatic test data generation system. Journal of Systems Integration, 1(3):391-409, November 1991.
32. A. Jefferson Offutt and Shaoying Liu. Generating test data from SOFL specifications. The Journal of Systems and Software, 49(1):49-62, December 1999.
33. Gregg Rothermel and Mary Jean Harrold. Empirical studies of a safe regression test selection technique. IEEE Transactions on Software Engineering, 24(6):401-419, June 1998.
34. Debra J. Richardson, Owen O'Malley, and Cindy Tittle. Approaches to specification-based testing. In Richard A. Kemmerer, editor, Proceedings of the ACM SIGSOFT '89 Third Symposium on Testing, Analysis, and Verification (TAV3), pages 86-96, December 1989.
35. Gerard Salton. Automatic Information Organization and Retrieval. McGraw-Hill, 1968.
36. Kalman C. Toth, Michael R. Donat, and Jeffrey J. Joyce. Generating test cases from formal specifications. In 6th Annual Symposium of the International Council on Systems Engineering, Boston, July 1996.
37. Filippos I. Vokolos and Phyllis G. Frankl. Empirical evaluation of the textual differencing regression testing technique. In Proceedings of the International Conference on Software Maintenance, pages 44-53, 1998.
38. C. J. van Rijsbergen. Information Retrieval. Butterworths, London, second edition, 1979.
39. Hong Zhu, Patrick A. V. Hall, and John H. R. May. Software unit test coverage and adequacy. ACM Computing Surveys, 29(4):366-427, December 1997.