COVRIG: A framework for the analysis of code, test, and coverage evolution in real software

2014 International Symposium on Software Testing and Analysis, ISSTA 2014 - Proceedings

Volumn , Issue , 2014, Pages 93-104

  Marinescu, Paul ^a   Hosek, Petr ^a   Cadar, Cristian ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Bugs and fixes; Coverage evolution; Latent patch coverage; Nondeterministic coverage; Patch characteristics

Indexed keywords

CODES (SYMBOLS); OPEN SOURCE SOFTWARE; PROGRAM DEBUGGING; SOFTWARE TESTING;

BUGS AND FIXES; COVERAGE EVOLUTION; LATENT PATCH COVERAGE; NONDETERMINISTIC COVERAGE; PATCH CHARACTERISTICS;

OPEN SYSTEMS;

EID: 84942782772     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2610384.2610419     Document Type: Conference Paper

References (41)

1. D. Babic, L. Martignoni, S. McCamant, and D. Song. Statically-directed dynamic automated test generation. In Proc. of the International Symposium on Software Testing and Analysis (ISSTA'11), July 2011.
2. M. Böhme, B. C. d. S. Oliveira, and A. Roychoudhury. Regression tests to expose change interaction errors. In Proc. of the joint meeting of the European Software Engineering Conference and the ACM Symposium on the Foundations of Software Engineering (ESEC/FSE'13), Aug. 2013.
3. C. Cadar, D. Dunbar, and D. Engler. KLEE: Unassisted and automatic generation of high-coverage tests for complex systems programs. In Proc. of the 8th USENIX Symposium on Operating Systems Design and Implementation (OSDI'08), Dec. 2008.
4. G. Canfora, L. Cerulo, and M. Di Penta. Identifying changed source code lines from version repositories. In Proc. of the 4th International Workshop on Mining Software Repositories (MSR'07), May 2007.
5. V. Dallmeier and T. Zimmermann. Extraction of bug localization benchmarks from history. In Proc. of the 22nd IEEE International Conference on Automated Software Engineering (ASE'07), Nov. 2007.
6. H. Dan and R. Hierons. Semantic mutation analysis of floating-point comparison. In Proc. of the IEEE International Conference on Software Testing, Verification, and Validation (ICST'12), Apr. 2012.
7. H. Do, S. Elbaum, and G. Rothermel. Supporting controlled experimentation with testing techniques: An infrastructure and its potential impact. Empirical Software Engineering (EMSE), 10(4):405-435, Oct. 2005.
8. S. Elbaum, D. Gable, and G. Rothermel. The impact of software evolution on code coverage information. In Proc. of the IEEE International Conference on Software Maintenance (ICSM'01), Nov. 2001.
9. G. Fraser and A. Zeller. Mutation-driven generation of unit tests and oracles. IEEE Transactions on Software Engineering (TSE), 38(2):278-292, 2012.
10. P. Godefroid, M. Y. Levin, and D. A. Molnar. Automated whitebox fuzz testing. In Proc. of the 15th Network and Distributed System Security Symposium (NDSS'08), Feb. 2008.
11. M. J. Harrold, C. Unwersity, R. Gupta, and M. L. Soffa. A methodology for controlling the size of a test suite. ACM Transactions on Software Engineering Methodology (TOSEM), 2:270-285, 1993.
12. K. Herzig, S. Just, A. Rau, and A. Zeller. Predicting defects using change genealogies. In Proc. of the 24th International Symposium on Software Reliability Engineering (ISSRE'13), Nov. 2013.
13. K. Herzig, S. Just, and A. Zeller. It's not a bug, it's a feature: How misclassification impacts bug prediction. In Proc. of the 35th International Conference on Software Engineering (ICSE'13), May 2013.
14. P. Hosek and C. Cadar. Safe software updates via multi-version execution. In Proc. of the 35th International Conference on Software Engineering (ICSE'13), May 2013.
15. V. Jagannath, M. Gligoric, D. Jin, Q. Luo, G. Rosu, and D. Marinov. Improved multithreaded unit testing. In Proc. of the joint meeting of the European Software Engineering Conference and the ACM Symposium on the Foundations of Software Engineering (ESEC/FSE'11), Sept. 2011.
16. P. Joshi, K. Sen, and M. Shlimovich. Predictive testing: Amplifying the effectiveness of software testing. In Proc. of the joint meeting of the European Software Engineering Conference and the ACM Symposium on the Foundations of Software Engineering (ESEC/FSE'07), Sept. 2007.
17. S. Kim, T. Zimmermann, K. Pan, and E. J. J. Whitehead. Automatic identification of bug-introducing changes. In Proc. of the 21st IEEE International Conference on Automated Software Engineering (ASE'06), Sept. 2006.
18. H. W. Kuhn. The hungarian method for the assignment problem. Naval Research Logistics Quarterly, 2:83-97, 1955.
19. V. I. Levenshtein. Binary codes capable of correcting deletions, insertions and reversals. In Soviet physics doklady, volume 10, page 707, 1966.
20. K.-K. Ma, Y. P. Khoo, J. S. Foster, and M. Hicks. Directed symbolic execution. In Proc. of the 18th International Static Analysis Symposium (SAS'11), Sept. 2011.
21. P. D. Marinescu and C. Cadar. High-coverage symbolic patch testing. In Proc. of the 19th International SPIN Workshop on Model Checking of Software (SPIN'12), July 2012.
22. P. D. Marinescu and C. Cadar. Make test-zesti: A symbolic execution solution for improving regression testing. In Proc. of the 34th International Conference on Software Engineering (ICSE'12), June 2012.
23. P. D. Marinescu and C. Cadar. KATCH: High-coverage testing of software patches. In Proc. of the joint meeting of the European Software Engineering Conference and the ACM Symposium on the Foundations of Software Engineering (ESEC/FSE'13), Aug. 2013.
24. M. Maurer and D. Brumley. TACHYON: Tandem execution for efficient live patch testing. In Proc. of the 21st USENIX Security Symposium (USENIX Security'12), Aug. 2012.
25. A. Murgia, G. Concas, M. Marchesi, and R. Tonelli. A machine learning approach for text categorization of fixing-issue commits on CVS. In Proc. of the 4th International Symposium on Empirical Software Engineering and Measurement (ESEM'10), Sept. 2010.
26. C. Pacheco, S. K. Lahiri, and T. Ball. Finding errors in NET with feedback-directed random testing. In Proc. of the International Symposium on Software Testing and Analysis (ISSTA'08), July 2008.
27. S. Person, M. B. Dwyer, S. Elbaum, and C. S. Pəsəreanu. Differential symbolic execution. In Proc. of the ACM Symposium on the Foundations of Software Engineering (FSE'08), Nov. 2008.
28. S. Person, G. Yang, N. Rungta, and S. Khurshid. Directed incremental symbolic execution. In Proc. of the Conference on Programing Language Design and Implementation (PLDI'11), June 2011.
29. D. Rosenblum and E. Weyuker. Using coverage information to predict the cost-effectiveness of regression testing strategies. IEEE Transactions on Software Engineering (TSE), 23(3):146-156, 1997.
30. G. Rothermel and M. J. Harrold. Analyzing regression test selection techniques. IEEE Transactions on Software Engineering (TSE), 22, 1996.
31. A. Singhal. Modern information retrieval: A brief overview. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering, 24:35-43, 2001.
32. J. Sliwerski, T. Zimmermann, and A. Zeller. When do changes induce fixes? In Proc. of the 2005 International Workshop on Mining Software Repositories (MSR'05), May 2005.
33. S. Soltesz, H. Pötzl, M. E. Fiuczynski, A. Bavier, and L. Peterson. Container-based operating system virtualization: A scalable, high-performance alternative to hypervisors. In Proc. of the 2nd European Conference on Computer Systems (EuroSys'07), Mar. 2007.
34. K. Sparck Jones. Document retrieval systems. chapter A Statistical Interpretation of Term Specificity and Its Application in Retrieval, pages 132-142. 1988.
35. A. Srivastava and J. Thiagarajan. Effectively prioritizing tests in development environment. In Proc. of the International Symposium on Software Testing and Analysis (ISSTA'02), July 2002.
36. K. Taneja, T. Xie, N. Tillmann, and J. de Halleux. eXpress: guided path exploration for efficient regression test generation. In Proc. of the International Symposium on Software Testing and Analysis (ISSTA'11), July 2011.
37. J. Tucek, W. Xiong, and Y. Zhou. Efficient online validation with delta execution. In Proc. of the 14th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'09), Mar. 2009.
38. C. Williams and J. Spacco. SZZ revisited: Verifying when changes induce fixes. In Proc. of the 2008 International Workshop on Defects in Large Software Systems (DEFECTS'08), July 2008.
39. Z. Xu, Y. Kim, M. Kim, G. Rothermel, and M. B. Cohen. Directed test suite augmentation: Techniques and tradeoffs. In Proc. of the ACM Symposium on the Foundations of Software Engineering (FSE'10), Nov. 2010.
40. Z. Xu and G. Rothermel. Directed test suite augmentation. In Proc. of the 16th Asia-Pacific Software Engineering Conference (ASPEC'09), Dec. 2009.
41. A. Zaidman, B. V. Rompaey, A. van Deursen, and S. Demeyer. Studying the co-evolution of production and test code in open source and industrial developer test processes through repository mining. Empirical Software Engineering (EMSE), 16(3):325-364, 2011.