Cause reduction for quick testing

Proceedings - IEEE 7th International Conference on Software Testing, Verification and Validation, ICST 2014

Volumn , Issue , 2014, Pages 243-252

  Groce, Alex ^a   Alipour, Mohammed Amin ^a   Zhang, Chaoqiang ^a   Chen, Yang ^b   Regehr, John ^b  

^a OREGON STATE UNIVERSITY   (United States)

^b University of Utah   (United States)

Author keywords

random testing; regression testing; test case minimization

Indexed keywords

JAVA PROGRAMMING LANGUAGE; PROGRAM DEBUGGING; TESTING;

DELTA DEBUGGING; RANDOM TESTING; REAL WORLD PROJECTS; REGRESSION SUITES; REGRESSION TESTING; SOFTWARE FAULT; TEST ENVIRONMENT; TEST-CASE MINIMIZATIONS;

SOFTWARE TESTING;

EID: 84903120396     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICST.2014.37     Document Type: Conference Paper

References (47)

1. A. Groce, G. Holzmann, and R. Joshi, "Randomized differential testing as a prelude to formal verification," in International Conference on Software Engineering, 2007, pp. 621-631.
2. A. Groce, K. Havelund, G. Holzmann, R. Joshi, and R.-G. Xu, "Establishing flight software reliability: Testing, model checking, constraintsolving, monitoring and learning," Annals of Mathematics and Artificial Intelligence, accepted for publication.
3. A. Zeller and R. Hildebrandt, "Simplifying and isolating failure-inducing input," Software Engineering, IEEE Transactions on, vol. 28, no. 2, pp. 183-200, 2002. (Pubitemid 34198322)
4. R. Hildebrandt and A. Zeller, "Simplifying failure-inducing input," in International Symposium on Software Testing and Analysis, 2000, pp. 135-145.
5. K. Claessen and J. Hughes, "QuickCheck: a lightweight tool for random testing of haskell programs," in ICFP, 2000, pp. 268-279. (Pubitemid 32024728)
6. C. Pacheco, S. K. Lahiri, M. D. Ernst, and T. Ball, "Feedback- directed random test generation," in International Conference on Software Engineering, 2007, pp. 75-84. (Pubitemid 47430643)
7. A. Groce, C. Zhang, E. Eide, Y. Chen, and J. Regehr, "Swarm testing," in International Symposium on Software Testing and Analysis, 2012, pp. 78-88.
8. X. Yang, Y. Chen, E. Eide, and J. Regehr, "Finding and understanding bugs in C compilers," in ACM SIGPLAN Conference on Programming Language Design and Implementation, 2011, pp. 283-294.
9. J. H. Andrews, A. Groce, M. Weston, and R.-G. Xu, "Random test run length and effectiveness," in Automated Software Engineering, 2008, pp. 19-28.
10. A. Gupta and P. Jalote, "An approach for experimentally evaluating effectiveness and efficiency of coverage criteria for software testing," Journal of Software Tools for Technology Transfer, vol. 10, no. 2, pp. 145-160, 2008. (Pubitemid 351338013)
11. M. Harder, J. Mellen, and M. D. Ernst, "Improving test suites via operational abstraction," in Software Engineering, 2003. Proceedings. 25th International Conference on. IEEE, 2003, pp. 60-71.
12. J. A. Jones and M. J. Harrold, "Empirical evaluation of the Tarantula automatic fault-localization technique," in Automated Software Engineering, 2005, pp. 273-282.
13. Y. Chen, A. Groce, C. Zhang, W.-K. Wong, X. Fern, E. Eide, and J. Regehr, "Taming compiler fuzzers," in ACM SIGPLAN Conference on Programming Language Design and Implementation, 2013, pp. 197-208.
14. S. Yoo and M. Harman, "Regression testing minimization, selection and prioritization: a survey," Softw. Test. Verif. Reliab., vol. 22, no. 2, pp. 67-120, Mar. 2012.
15. J. Bible, G. Rothermel, and D. S. Rosenblum, "A comparative study of coarse-and fine-grained safe regression test-selection techniques," ACM Trans. Softw. Eng. Methodol., vol. 10, no. 2, pp. 149-183, 2001. (Pubitemid 33602333)
16. A. Groce, K. Havelund, and M. Smith, "From scripts to specifications: The evolution of a flight software testing effort," in International Conference on Software Engineering, 2010, pp. 129-138.
17. Android Developers Blog, "UI/application exerciser monkey," http://developer.android.com/tools/help/monkey.html.
18. L. Baresi, P. L. Lanzi, and M. Miraz, "Testful: an evolutionary test approach for Java," in IEEE International Conference on Software Testing, Verification and Validation (ICST), 2010, pp. 185-194.
19. G. Fraser and A. Arcuri, "Evosuite: automatic test suite generation for object-oriented software," in Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering, ser. ESEC/FSE '11. ACM, 2011, pp. 416-419.
20. J. H. Andrews, T. Menzies, and F. C. Li, "Genetic algorithms for randomized unit testing," IEEE Transactions on Software Engineering (TSE), vol. 37, no. 1, pp. 80-94, 2011.
21. J. Andrews, Y. R. Zhang, and A. Groce, "Comparing automated unit testing strategies," Department of Computer Science, University of Western Ontario, Tech. Rep. 736, December 2010.
22. J. Ruderman, "Introducing jsfunfuzz," 2007, http://www.squarefree.com/2007/08/02/introducing-jsfunfuzz/.
23. M. Gligoric, A. Groce, C. Zhang, R. Sharma, A. Alipour, and D. Marinov, "Comparing non-adequate test suites using coverage criteria," in International Symposium on Software Testing and Analysis, 2013, pp. 302-313.
24. A. Groce, A. Fern, J. Pinto, T. Bauer, A. Alipour, M. Erwig, and C. Lopez, "Lightweight automated testing with adaptation-based programming," in IEEE International Symposium on Software Reliability Engineering, 2012, pp. 161-170.
25. J. Ruderman, "Mozilla bug 349611," https://bugzilla.mozilla. org/show\bug.cgiid=349611 (A meta-bug containing all bugs found using jsfunfuzz.
26. Y. Lei and J. H. Andrews, "Minimization of randomized unit test cases," in International Symposium on Software Reliability Engineering, 2005, pp. 267-276. (Pubitemid 44733909)
27. T. Y. Chen and M. F. Lau, "Dividing strategies for the optimization of a test suite," Inf. Process. Lett., vol. 60, no. 3, pp. 135-141, 1996. (Pubitemid 126393286)
28. G. Rothermel, R. Untch, C. Chu, and M. Harrold, "Prioritizing test cases for regression testing," Software Engineering, IEEE Transactions on, vol. 27, no. 10, pp. 929-948, 2001. (Pubitemid 33048252)
29. "Yaffs: A flash file system for embedded use," http://www.yaffs.net/.
30. J. H. Andrews, L. C. Briand, and Y. Labiche, "Is mutation an appropriate tool for testing experiments" in International Conference on Software Engineering, 2005, pp. 402-411.
31. L. Zhang, S.-S. Hou, J.-J. Hu, T. Xie, and H. Mei, "Is operator-based mutant selection superior to random mutant selection" in International Conference on Software Engineering, 2010, pp. 435-444.
32. J. Regehr, Y. Chen, P. Cuoq, E. Eide, C. Ellison, and X. Yang, "Testcase reduction for C compiler bugs," in Conference on Programming Language Design and Implementation, 2012, pp. 335-346.
33. A. Zeller, "Yesterday, my program worked. today, it does not. why" in ESEC/SIGSOFT Foundations of Software Engineering, 1999, pp. 253-267.
34. J. Choi and A. Zeller, "Isolating failure-inducing thread schedules," in International Symposium on Software Testing and Analysis, 2002, pp. 210-220.
35. H. Cleve and A. Zeller, "Locating causes of program failures," in ICSE, G.-C. Roman, W. G. Griswold, and B. Nuseibeh, Eds. ACM, 2005, pp. 342-351.
36. A. Zeller, "Isolating cause-effect chains from computer programs," in Foundations of Software Engineering, 2002, pp. 1-10.
37. G. Misherghi and Z. Su, "Hdd: hierarchical delta debugging," in International Conference on Software engineering, 2006, pp. 142-151. (Pubitemid 46600911)
38. P. Gastin, P. Moro, and M. Zeitoun, "Minimization of counterexamples in SPIN," in In SPIN Workshop on Model Checking of Software. Springer-Verlag, 2004, pp. 92-108.
39. A. Groce and D. Kroening, "Making the most of BMC counterexamples," Electron. Notes Theor. Comput. Sci., vol. 119, no. 2, pp. 67-81, Mar. 2005. (Pubitemid 40319811)
40. A. Leitner, M. Oriol, A. Zeller, I. Ciupa, and B. Meyer, "Efficient unit test case minimization," in International Conference on Automated Software Engineering, 2007, pp. 417-420.
41. W. McKeeman, "Differential testing for software," Digital Technical Journal of Digital Equipment Corporation, vol. 10(1), pp. 100-107, 1998.
42. S. McMaster and A. M. Memon, "Call-stack coverage for GUI test suite reduction," Software Engineering, IEEE Transactions on, vol. 34, no. 1, pp. 99-115, 2008. (Pubitemid 351350371)
43. A. J. Offutt, J. Pan, and J. M. Voas, "Procedures for reducing the size of coverage-based test sets," in In Proc. Twelfth Int'l. Conf. Testing Computer Softw, 1995.
44. H.-Y. Hsu and A. Orso, "Mints: A general framework and tool for supporting test-suite minimization," in Software Engineering, 2009. ICSE 2009. IEEE 31st International Conference on. IEEE, 2009, pp. 419-429.
45. K. R. Walcott, M. L. Soffa, G. M. Kapfhammer, and R. S. Roos, "Timeaware test suite prioritization," in Proceedings of the 2006 international symposium on Software testing and analysis, ser. ISSTA '06. New York, NY, USA: ACM, 2006, pp. 1-12. [Online]. Available: http://doi.acm.org/10. 1145/1146238.1146240
46. S. G. Elbaum, G. Rothermel, S. Kanduri, and A. G. Malishevsky, "Selecting a cost-effective test case prioritization technique," Software Quality Journal, vol. 12, no. 3, pp. 185-210, 2004. (Pubitemid 38930558)
47. G. Rothermel, M. J. Harrold, J. von Ronne, and C. Hong, "Empirical studies of test-suite reduction," Journal of Software Testing, Verification, and Reliability, vol. 12, pp. 219-249, 2007.