On the use of specification-based assertions as test oracles

Proceedings of the 2005 29th Annual IEEE/NASA Software Engineering Workshop, SEW'05

Volumn 2005, Issue , 2005, Pages 305-314

  Coppit, David ^a   Haddox Schatz, Jennifer M ^b  

^a The College of William and Mary   (United States)

^b Daniel H Wagner Associates Inc   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ASSERTION-ENHANCED SYSTEMS; ORACLE PROBLEM; SOFTWARE FAULTS; SOFTWARE TESTING;

CODES (SYMBOLS); COMPUTER PROGRAMMING LANGUAGES; COMPUTER SCIENCE; COMPUTER SOFTWARE; COST EFFECTIVENESS; SPECIFICATIONS;

SOFTWARE ENGINEERING;

EID: 33646925479     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SEW.2005.33     Document Type: Conference Paper

References (37)

1. Detlef Bartetzko, Clemens Fischer, Michael Möller, and Heike Wehrheim. Jass - Java with assertions. In Klaus Havelund and Grigore Roşu, editors, Runtime Verification, volume 55 of Electronic Notes in Theoretical Computer Science. Elsevier, 23July 2001.
2. D. M. Blough and T. Torii. Fault-injection-based testing of fault-tolerant algorithms in message-passing parallel computers. In Proceedings of The Twenty-Seventh Annual International Symposium on Fault-Tolerant Computing (FTCS'97), pages 258-269, Washington - Brussels - Tokyo, June 1997. IEEE.
3. Manuel Blum and Sampath Kannan. Designing programs that check their work. Journal of the ACM, 42(1):269-91, January 1995.
4. Chandrasekhar Boyapati, Sarfraz Khurshid, and Darko Marinov. Korat: Automated testing based on Java predicates. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA 2002), Rome, Italy, 22-24 July 2002. IEEE.
5. Jeffrey A. Clark and Dhiraj K. Pradhan. Fault injection: A method for validating computer-system dependability. Computer, 28(6):47-56, June 1995.
6. David Coppit and Kevin J. Sullivan. Sound methods and effective tools for engineering modeling and analysis. In Proceedings of the 25th International Conference on Software Engineering, pages 198-207, Portland, Oregon, 3-10 May 2003. IEEE.
7. Richard A. DeMillo and A. Jefferson Offutt. Experimental results from an automatic test case generator. ACM Transactions on Software Engineering and Methodology, 2(2): 109-127, April 1993.
8. Eiffel Software. Building bug-free O-O software: An introduction to Design by Contract.
9. Dawson Engler, Benjamin Chelf, Andy Chou, and Seth Hallem. Checking system rules using system-specific, programmer-written compiler extensions. In Symposium on Operating Systems Design and Implementation (OSDI 2000), San Diego, CA, 23-25 October 2000.
10. Michael D. Ernst, Jake Cockrell, William G. Griswold, and David Notkin. Dynamically discovering likely program invariants to support program evolution. IEEE Transactions on Software Engineering, 27(2):1-25, February 2001.
11. Robert W. Floyd. Assigning meanings to programs. In J. T. Schwartz, editor, Mathematical. Aspects of Computer Science, volume 19 of Proceedings of Symposia in Applied Mathematics, pages 19-32, New York, New York, 5-7April 1967. American Mathematical Society.
12. Marie-Claude Gaudel. Testing can be formal, too. In Peter D. Mosses, Mogens Nielsen, and Michael I. Schwartzbach, editors, TAPSOFT '95: Theory and Practice of Software Development, volume 915 of Lecture Notes in Computer Science, pages 82-96. Springer-Verlag, 1995.
13. J. Haddox, G. Kapfhammer, and J. Steven. TDoG design documentation. Technical report, Cigital, Inc., 1998.
14. Jennifer M. Haddox, Gregory M. Kapfhammer, and Christoph C. Michael. An approach for understanding and testing third party software components. In Annual Reliability and Maintainability Symposium 2002 Proceedings, pages 293-9, Seattle, WA, 28-31 January 2002.
15. M. Haddox-Schatz. Auger design documentation. Technical report, Jefferson Labs, May 2003.
16. M. Hsueh, T. K. Tsai, and R. K. Iyer. Fault injection techniques and tools. IEEE Computer, 30(4):75-82, 1997.
17. Reto Kramer. iContract - the Java design by contract tool. In Proceedings of TOOLS 26: Technology of Object-Oriented Languages and Systems, page 295, Santa Barbara, CA, 3-7 August 1998. IEEE.
18. Gary T. Leavens, Erik Poll, Curtis Clifton, Yoonsik Cheon, Clyde Ruby, David R. Cok, and Joseph Kiniry. JML reference manual. Department of Computer Science, Iowa State University. Available from http://www.jmlspecs.org, April 2003.
19. David C. Luckham and Friedrich W. von Henke. Overview of Anna, a specification language for Ada. IEEE Software, 2(2):9-224, March 1985.
20. H. Madeira, D. Costa, and M. Vieira. On the emulation of software faults by software fault injection. In Proceedings of The International Conference on Dependable Systems and Networks, pages 417-426, New York, New York, June 2000. IEEE.
21. Darko Marinov and Sarfraz Khurshid. TestEra: A novel framework for automated testing of Java programs. In Proceedings of the 16th IEEE Conference on Automated Software Engineering (ASE 2001), San Diego, CA, 26-29 November 2001. IEEE.
22. Digital Mars - Design By Contract.
23. Bertrand Meyer. Applying Design by Contract. IEEE Computer, 25(10):40-51, October 1992.
24. Bertrand Meyer and Dino Mandrioli. Advances in Object-Oriented Software Engineering. Prentice Hall, New York, NY, 1992.
25. M. Müller, R. Typke, and O. Hagner. Two controlled experiments concerning the usefulness of assertions as a means for programming. In Proceedings of the International Conference on Software Maintenance, pages 84-93, Montreal, Quebec, Canada, 3-6 October 2002. IEEE.
26. Debra J. Richardson, Stephanie Leif Aha, and T. Owen O'Malley. Specification-based test oracles for reactive systems. In Proceedings of the 14th International Conference on Software Engineering, pages 105-18, Melbourne, Vic., Australia, 11-15 May 1992. ACM New York, NY.
27. David S. Rosenblum. A practical approach to programming with assertions. IEEE Transactions on Software Engineering, 21(1):19-31, January 1995.
28. Graeme Smith. The Object Z Specification Language. Kluwer Academic Publishers, 1999.
29. J. M. Spivey. The Z Notation: A Reference Manual. Prentice Hall International Series in Computer Science, Hertfordshire, UK, 2nd edition, 1992.
30. L. G. Stucki and G. L. Foshee. New assertion concepts in self-metric software. In Proceedings of the 1975 International Conference on Reliable Software, pages 59-71. IEEE, 1975.
31. J. Voas and G. McGraw. Software Fault Injection. John Wiley and Sons, Inc., 1998.
32. J. M. Voas. Software testability measurement for assertion placement and fault localization. In Proceedings of 2nd International Workshop on Automated and. Algorithmic. Debugging, St. Malo, France, May 1995.
33. Jeffrey Voas, Frank Charron, Gary McGraw, Keith Miller, and Michael Friedman. Predicting how badly "good" software can behave. IEEE Software, 14(4):73-83, July / August 1997.
34. Jeffrey Voas and Lora Kassab. Using assertions to make untestable software more testable. Software Quality Professional, 1(4), September 1999.
35. Jeffrey M. Voas and Keith W. Miller. Putting assertions in their place. In Proceedings of the International Symposium on Software Reliability Engineering, Monterey, CA, 6-9 November 1994. IEEE.
36. Hal Wasserman and Manuel Blum. Software reliability via run-time result-checking. Journal of the ACM, 44(6):826-49, November 1997.
37. Elaine J. Weyuker. On testing non-testable programs. The Computer Journal, 25(4):465-470, November 1982.