An empirical framework for comparing effectiveness of testing and property-based formal analysis

ACM SIGPLAN/SIGSOFT Workshop on Program Analysis for Software Tools and Engineering

Volumn , Issue , 2005, Pages 2-5

  Bradbury, Jeremy S ^a   Cordy, James R ^a   Dingel, Juergen ^a  

^a QUEEN S UNIVERSITY   (Canada)

Author keywords

bug detection; empirical software engineering; model checking; mutation testing; static analysis

Indexed keywords

BUG DETECTION; COMPLEMENTARY RELATIONSHIP; EMPIRICAL SOFTWARE ENGINEERING; EMPIRICAL STUDIES; EVALUATION OF TEST; FORMAL ANALYSIS TOOLS; MUTATION TESTING; SOFTWARE SYSTEMS;

COMPUTER PROGRAMMING LANGUAGES; COMPUTER SOFTWARE; MODEL CHECKING;

STATIC ANALYSIS;

EID: 47649091305     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1108792.1108795     Document Type: Conference Paper

References (17)

1. P. Anderson. CodeSurfer/Path Inspector. In Proc. of the IEEE Int. Conf. on Software Maintenance (ICSM04), Sept. 2004.
2. J.H. Andrews, L.C. Briand, and Y. Labiche. Is mutation an appropriate tool for testing experiments? In Proc. of ICSE 2005, pages 402-411, 2005.
3. T. Ball and S.K. Rajamani. The SLAM project: Debugging system software via static analysis. In Proc. of Symp. on Principles of Programming Languages (POPL 2002), pages 1-3, Jan. 2002.
4. S.S. Brilliant and J.C. Knight. Empirical research in software engineering: a workshop. SIGSOFT Software Engineering Notes, 24(3):44-52, 1999.
5. M.B. Dwyer, G.S. Avrunin, and J.C. Corbett. Patterns in property specifications for finite-state verification. In Proc. of ICSE'99, pages 411-420, May 1999.
6. M.D. Ernst, J. Cockrell, W.G. Griswold, and D. Notkin. Dynamically discovering likely program invariants to support program evolution. IEEE Trans. on Soft. Eng., 27(2):1-25, Feb. 2001.
7. G. Hamon, L. de Moura, and J. Rushby. Generating efficient test sets with a model checker. In Proc. of the Int. Conf. on Software Engineering and Formal Methods (SEFM'04), pages 261-270, Sept. 2004.
8. C.A.R. Hoare. Assertions: A personal perspective. IEEE Annals of the History of Computing, 25(2), Apr.-Jun. 2003.
9. Y. Hoskote, T. Kam, P. Ho, and X. Zhao. Coverage estimation for symbolic model checking. In Proc. of the Conference on Design Automation (DAC 1999), pages 300-305, Jun. 1999.
10. M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Proc. of ICSE'94, pages 191-200, May 1994.
11. N. Juristo, A.M. Moreno, and S. Vegas. Towards building a solid empirical body of knowledge in testing techniques. SIGSOFT Software Engineering Notes, 29(5):1-4, 2004.
12. S. Lu, Z. Li, F. Qin, L. Tan, P. Zhou, and Y. Zhou. Bugbench: Benchmarks for evaluating bug detection tools. In Proc. of the Work. on the Evaluation of Software Defect Detection Tools, June 2005.
13. Robby, M.B. Dwyer, and J. Hatcliff. Bogor: an extensible and highly-modular software model checking framework. In Proc. of ESEC/FSE-11, pages 267-276, Sept. 2003.
14. G. Rothermel and M.J. Harrold. Empirical studies of a safe regression test selection technique. IEEE Trans. on Soft. Eng., 25(6):401-419, Jun. 1998. (Pubitemid 128741964)
15. J. Rushby. Disappearing formal methods. In Proc. of the High-Assurance Systems Engineering Symp. (HASE'00), Nov. 2000.
16. H. Sutter. The free lunch is over: A fundamental turn toward concurrency in software. Dr. Dobb's Journal, 30(3), Mar. 2005.
17. J. Yang and D. Evans. Dynamically inferring temporal properties. In Proc. of the ACM SIGPLAN-SIGSOFT Work. on Program Analysis for Software Tools and Engineering (PASTE 2004), Jun. 2004.