Using runtime testing to detect defects in applications without test oracles

Proceedings of the ACM SIGSOFT Symposium on the Foundations of Software Engineering

Volumn , Issue , 2008, Pages 21-24

  Murphy, Christian ^a  

^a Department of Earth and Environmental Sciences   (United States)

Author keywords

Metamorphic Testing; Perpetual Testing; Software Testing

Indexed keywords

CONFIGURABLE SYSTEMS; METAMORPHIC TESTING; RUNTIME TESTING; TEST ORACLES; TESTING SOFTWARE;

COMPUTER SOFTWARE SELECTION AND EVALUATION; SOFTWARE TESTING;

SOFTWARE ENGINEERING;

EID: 77950464457     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1496653.1496659     Document Type: Conference Paper

References (24)

1. A. Bhorkar. A run-time assertion checker for Java using JML. Technical Report TR00-08, Dept. of Computer Science, Iowa State Univ., 2000.
2. T. Y. Chen, S. C. Cheung, and S. Yiu. Metamorphic testing: a new approach for generating next test cases. Technical Report HKUST-CS98-01, Hong Kong Univ. of Science and Technology, 1998.
3. T. Y. Chen, F.-C. Kuo, T. H. Tse, and Z. Q. Zhou. Metamorphic testing and beyond. In Proc. of the International Workshop on Software Technology and Engineering Practice (STEP), pages 94:100, 2004.
4. T. Y. Chen, T. H. Tse, and Z. Q. Zhou. Fault-based testing without the need of oracles. Information and Software Technology, 44(15):923:931, 2002.
5. L. A. Clarke and D. S. Rosenblum. A historical perspective on runtime assertion checking in software development. ACM SIGSOFT Software Engineering Notes, 31(3):25:37, May 2006.
6. W. J. Cody Jr. and W. Waite. Software Manual for the Elementary Functions. Prentice Hall, 1980.
7. M. D. Davis and E. J. Weyuker. Pseudo-oracles for non-testable programs. In Proc. of the ACM '81 Conference, pages 254:257, 1981.
8. S. Elbaum and M. Hardojo. An empirical study of pro ling strategies for released software and their impact on testing activities. In Proc. of ISSTA 2004, pages 65:75, 2004.
9. M. D. Ernst, J. Cockrell, W. G. Griswold, and D. Notkin. Dynamically discovering likely programming invariants to support program evolution. In Proc. of the 21st ICSE, pages 213:224, 1999.
10. S. Hangal and M. S. Lam. Tracking down software bugs using automatic anomaly detection. In Proc. of the 24th ICSE, pages 291:301, 2002.
11. J. Henkel and A. Diwan. Discovering algebraic speci cations from Java classes. In Proc. of the 17th European Conference on Object-Oriented Programming ECOOP, 2003.
12. JUnit Cookbook. http://junit.sourceforge.net/doc/cookbook/cookbook.htm.
13. A. Krishna et al. A distributed continuous quality assurance process to manage variability in performance-intensive software. In 19th ACM OOPSLA Workshop on Component and Middleware Performance, 2004.
14. B. Liblit, M. Naik, A. X. Zheng, A. Aiken, and M. I. Jordan. Public deployment of cooperative bug isolation. In Proceedings of the Second International Workshop on Remote Analysis and Measurement of Software Systems, pages 57:62, May 2004.
15. C. Murphy, G. Kaiser, M. Chu, and I. Vo. Quality assurance of software applications using the in vivo testing approach. Technical Report cucs-045-108, Dept. of Computer Science, Columbia University, 2008.
16. C. Murphy, K. Shen, and G. Kaiser. Using JML runtime assertion checking to automate metamorphic testing in applications without test oracles. Technical Report cucs-044-108, Dept. of Computer Science, Columbia University, 2008.
17. A. Orso, T. Apiwattanapong, and M.J. Harrold. Leveraging eld data for impact analysis and regression testing. In Proc. of the 9th European Software Engineering Conf., pages 128:137, 2003.
18. OSCache. http://www.opensymphony.com/oscache.
19. L. Osterweil. Perpetually testing software. In The Ninth International Software Quality Week, May 1996.
20. RapidMiner. http://rapid-i.com/.
21. S. Sankar. Run-time consistency checking of algebraic speci cations. In Proc. of ISSTA 1991, pages 123:129, 1991.
22. S. Sankar, A. Goyal, and P. Sikchi. Software testing using algebraic speci cation based test oracles. Technical Report CSL-TR-93-566, Dept. of Computer Science, Stanford Univ., 1993.
23. E. J. Weyuker. On testing non-testable programs. Computer Journal, 25(4):465:470, November 1982.
24. I. H. Witten and E. Frank. Data Mining: Practical Machine Learning Tools and Techniques, 2nd Edition. Morgan Kaufmann, 2005.