An empirical evaluation of assertions as oracles

Proceedings - 4th IEEE International Conference on Software Testing, Verification, and Validation, ICST 2011

Volumn , Issue , 2011, Pages 110-119

  Shrestha, Kavir ^a   Rutherford, Matthew J ^a  

^a University of Denver   (United States)

Author keywords

design by contract; empirical study; runtime assertion checking; test oracles

Indexed keywords

DATA MINING TECHNIQUES; DESIGN BY CONTRACTS; EMPIRICAL EVALUATIONS; EMPIRICAL STUDIES; HIGH DEGREE OF ACCURACY; JAVA CLASS; JAVA MODELING LANGUAGE; MUTATION TESTING; POTENTIAL BENEFITS; RIGOROUS APPROACH; RUNTIME ASSERTION; RUNTIME ASSERTION CHECKING; RUNTIME SYSTEMS; TEST CASE; TEST ORACLES; TESTING PROCESS;

COMPUTER SIMULATION LANGUAGES; COMPUTER SOFTWARE SELECTION AND EVALUATION; DATA MINING; EXPERIMENTS; JAVA PROGRAMMING LANGUAGE; VERIFICATION;

SOFTWARE TESTING;

EID: 79958716510     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICST.2011.50     Document Type: Conference Paper

References (36)

1. P. Ammann and J. Offutt. Introduction to Software Testing. Cambridge University Press, 2008. ISBN: 978-0-521-88038-1.
2. J. Andrews, L. Briand, and Y. Labiche. Is mutation an appropriate tool for testing experiments? In Proceedings of the 27th International Conference on Software Engineering (ICSE) 2005, pages 402-411, St. Louis, MO, USA, May 2005.
3. S. Antoy and D. Hamlet. Automatically checking an implementation against its formal specification. IEEE Transactions on Software Engineering, 26:55-69, 2000. (Pubitemid 30584680)
4. K. Arnout and R. Simon. The .net contract wizard: Adding design by contract to languages other than eiffel. Technology of Object-Oriented Languages, International Conference on, 0:0014, 2001.
5. L. Baresi and M. Young. Test oracles. Technical Report CIS-TR01-02, 2001.
6. D. Bartetzko, C. Fischer, M. Moller, and H. Wehrheim. Jass - java with assertions. In Proceedings of the 2001 Workshop on Runtime Verification held in conjunction with the 13th Conference on Computer Aided Verification, CAV'01, 2001.
7. B. Baudry, Y. L. Traon, and J.-M. Jezequel. Robustness and diagnosability of oo systems designed by contracts. In METRICS '01: Proceedings of the 7th International Symposium on Software Metrics, page 272, Washington, DC, USA, 2001. IEEE Computer Society.
8. P. Bourque and R. Dupuis, editors. Guide to the Software Engineering Body of Knowledge (SWEBOK). IEEE Computer Society, 2004. available at http://www.swebok.org/.
9. L. C. Briand, Y. Labiche, and H. Sun. Investigating the use of analysis contracts to improve the testability of object-oriented code. Softw. Pract. Exper., 33(7):637-672, 2003.
10. L. Burdy, Y. Cheon, D. R. Cok, M. D. Ernst, J. R. Kiniry, G. T. Leavens, K. R. M. Leino, and E. Poll. An overview of jml tools and applications. International Journal on Software Tools for Technology Transfer (STTT), 7(3):212-232, June 2005. (Pubitemid 41349063)
11. M. Carrillo, J. G. Molina, E. Pimentel, and I. Repiso. Design by contract in smalltalk. Journal of Object-Oriented Programming, 9(7), 1996.
12. Y. Cheon. A runtime assertion checker for the java modeling language. Technical report, Iowa State University, 2003.
13. L. A. Clarke and D. S. Rosenblum. A historical perspective on runtime assertion checking in software development. SIGSOFT Softw. Eng. Notes, 31(3):25-37, 2006.
14. P. Corporation. Using design by contract[TM] to automate Java[TM] software and component testing. Technical report, 2003.
15. I. D. Curcio. Asap - a simple assertion pre-processor. SIGPLAN Not., 33(12):44-51, 1998.
16. R. W. Floyd. Assigning meaning to programs. volume 19, pages 19-32. American Mathematical Society, 1967.
17. P. Guerreiro. Simple support for design by contract in c++. Technology of Object-Oriented Languages, International Conference on, 0:0024, 2001.
18. J. V. Guttag and J. J. Horning. Larch: languages and tools for formal specification. Springer-Verlag New York, Inc., New York, NY, USA, 1993.
19. C. A. R. Hoare. An axiomatic basis for computer programming. Commun. ACM, 12(10):576-580, 1969.
20. S. Igarashi, R. L. London, and D. C. Luckham. Automatic program verification i: A logical basis and its implementation. Technical report, Stanford, CA, USA, 1973.
21. M. Karaorman, U. Hlzle, and J. Bruno. jcontractor: A reflective java library to support design by contract. In In Proceedings of Meta-Level Architectures and Reflection, volume 1616 of lncs, pages 175-196, 1999.
22. R. Kramer. icontract - the java(tm) design by contract(tm) tool. In TOOLS '98: Proceedings of the Technology of Object-Oriented Languages and Systems, page 295, Washington, DC, USA, 1998. IEEE Computer Society.
23. G. Kudrjavets, N. Nagappan, and T. Ball. Assessing the relationship between software assertions and faults: An empirical investigation. In ISSRE '06: Proceedings of the 17th International Symposium on Software Reliability Engineering, pages 204-212, Washington, DC, USA, 2006. IEEE Computer Society.
24. G. T. Leavens, G. T. Leavens, A. L. Baker, A. L. Baker, C. Ruby, and C. Ruby. Preliminary design of jml: A behavioral interface specification language for java. Technical report, Department of Computer Science, Iowa State University, 1999.
25. T. J. McCabe. A complexity measure. IEEE Transactions on Software Engineering, SE-2(4):308-320, 1976.
26. B. Meyer. Applying 'design by contract'. Computer, 25(10):40-51, Oct 1992.
27. M. Muller, R. Typke, and O. Hagner. Two controlled experiments concerning the usefulness of assertions as a means for programming. Software Maintenance, 2002. Proceedings. International Conference on, pages 84-92, 2002.
28. D. Peters, S. Member, I. David, L. Parnas, and S. Member. Using test oracles generated from program documentation. IEEE Transactions on Software Engineering, 24:161-173, 1998. (Pubitemid 128740273)
29. R. Ploesch and J. Pichler. Contracts: From analysis to c++ implementation. Technology of Object-Oriented Languages, International Conference on, 0:248, 1999.
30. S. Porat and L. P. Fertig. Class assertions in c++. J. Object Oriented Programming, 8(2):30-37, 1995.
31. D. S. Rosenblum. A practical approach to programming with assertions. IEEE Trans. Softw. Eng., 21(1):19-31, 1995.
32. R. P. Tan and S. H. Edwards. Experiences evaluating the effectiveness of jml-junit testing. SIGSOFT Softw. Eng. Notes, 29(5):1-4, 2004.
33. J. Voas and K. Miller. Improving the software development process using testability research. Software Reliability Engineering, 1992. Proceedings., Third International Symposium on, pages 114-121, oct. 1992.
34. D. Welch and S. Strong. An exception-based assertion mechanism for c++. J. Object Oriented Programming, 11(4):50-60, 1998.
35. I. H. Witten, E. Frank, L. Trigg, M. Hall, G. Holmes, and S. J. Cunningham. Weka: Practical machine learning tools and techniques with java implementations. In Proc ICONIP/ ANZIIS/ANNES99 Future Directions for Intelligent Systems and Information Sciences, pages 192-196. Morgan Kaufmann, 1999.
36. H. Zhu, P. A. V. Hall, and J. H. R. May. Software unit test coverage and adequacy. ACM Comput. Surv., 29(4):366-427, 1997.