Oracle-centric test case prioritization

Proceedings - International Symposium on Software Reliability Engineering, ISSRE

Volumn , Issue , 2012, Pages 311-320

  Staats, Matt ^a   Loyola, Pablo ^a   Rothermel, Gregg ^a,b  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Software metrics; Software testing

Indexed keywords

MUTATION TESTING; PRIORITIZATION TECHNIQUES; REGRESSION TESTING; SOFTWARE METRICS; SYNCHRONOUS REACTIVE SYSTEMS; TEST CASE GENERATION; TEST CASE PRIORITIZATION; VARIABLE ASSIGNMENT;

FAULT DETECTION; SOFTWARE RELIABILITY;

SOFTWARE TESTING;

EID: 84876366232     PISSN: 10719458     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISSRE.2012.13     Document Type: Conference Paper

References (44)

1. M. Staats, M. Whalen, and M. Heimdahl, "Programs, tests, and oracles: The foundations of testing revisited," in Proc. of the 33rd Int'l Conf. on Software Engineering. IEEE, 2011.
2. G. Fraser and A. Zeller, "Mutation-driven generation of unit tests and oracles," in Proc. of the 19th Int'l Symp. on Software Testing and Analysis. ACM, 2010.
3. M. Staats, G. Gay, and M. Heimdahl, "Automated Oracle Creation Support, or: How I Learned to Stop Worrying About Fault Propagation and Love Mutation Testing," in Proc. of the 34rd Int'l Conf. on Software Engineering. IEEE, 2012.
4. G. Rothermel, R. Untch, C. Chu, and M. J. Harrold, "Prioritizing test cases for regression testing," IEEE Trans. on Software Engineering, vol. 27, no. 10, 2001.
5. H. Do, G. Rothermel, and A. Kinneer, "Prioritizing JUnit test cases: An empirical assessment and cost-benefits analysis," Empirical Software Engineering: An Int'l Journal, vol. 11, 2006.
6. A. Srivastava and J. Thiagarajan, "Effectively prioritizing tests in development environment," ACM SIGSOFT Software Engineering Notes, vol. 27, 2002.
7. W. Wong, J. Horgan, S. London, and H. Agrawal, "A study of effective regression testing in practice," in Proc. of the Int'l Symp. on Software Reliability Engineering, 1997.
8. B. Korel, G. Koutsogiannakis, and L. Tahat, "Application of system models in regression test suite prioritization," in Proc. of the Int'l Conf. on Software Maintenance, 2008.
9. S. Yoo, M. Harman, P. Tonella, and A. Susi, "Clustering test cases to achieve effective and scalable prioritisation incorporating expert knowledge," in Proc. of the Int'l. Symp. on Software Testing and Analysis, 2009.
10. L. Baresi and M. Young, "Test oracles," in Technical Report CIS-TR-01-02, Dept. of Computer and Information Science, Univ. of Oregon.
11. M. Staats, M. Whalen, and M. Heimdahl, "Nier track: Better testing through oracle selection," in Proc. of NIER Workshop, Int'l. Conf. on Software Engineering (ICSE) 2011. ACM New York, NY, USA, 2011.
12. J. Voas, "PIE: A dynamic failure-based technique," IEEE Trans. on Software Engineering, vol. 18, no. 8, 1992.
13. P. Frankl and E. Weyuker, "An applicable family of data flow testing criteria," IEEE Trans. on Software Engineering, vol. 14, no. 10, pp. 1483-1498, 1988.
14. T. Cormen, C. Leiserson, R. Rivest, and C. Stein, Introduction to Algorithms. MIT Press and McGraw-Hill, 2001.
15. E. Gamma and K. Beck, Contributing to Eclipse: Principles, Patterns, and Plugins. Addison Wesley Longman Publishing Co., Inc., 2003.
16. J. Jones and M. Harrold, "Test-suite reduction and prioritization for modified condition/decision coverage," Software Engineering, IEEE Trans. on, vol. 29, no. 3, pp. 195-209, 2003.
17. J. Sztipanovits and G. Karsai, "Generative programming for embedded systems," in Proc. of Int'l. Conference on Principles and Practice of Declarative Programming, vol. 6, no. 08. Springer, 2002.
18. A. Danial, "Cloc-count lines of code," http://cloc.sourceforge. net/.
19. SAE-ARP4761, Guidelines and Methods for Conducting the Safety Assessment Process on Civil Airborne Systems and Equipment. SAE International, December 1996.
20. H. Do and G. Rothermel, "Using sensitivity analysis to create simplified economic models for regression testing," in Proc. of the 17th Int'l Symp. on Software Testing and Analysis, 2008.
21. P. Kvam and B. Vidakovic, Nonparametric Statistics with Applications to Science and Engineering. Wiley-Interscience, 2007.
22. M. Staats, G. Gay, M. Whalen, and M. Heimdahl, "On the danger of coverage directed test case generation," in Proc. of Fundamental Approaches to Software Engineering, 2012.
23. A. Arcuri, M. Z. Z. Iqbal, and L. C. Briand, "Formal analysis of the effectiveness and predictability of random testing," in Proc. of the 19th Int'l Symp. on Software Testing and Analysis, 2010.
24. H. Do, G. Rothermel, and A. Kinneer, "Empirical studies of test case prioritization in a JUnit testing environment," in Proc. of the Int'l Symp. on Software Reliability Engineering, 2004.
25. S. Elbaum, A. Malishevsky, and G. Rothermel, "Prioritizing test cases for regression testing," in Proc. of the Int'l. Symp. on Software Testing and Analysis, 2000.
26. -, "Test case prioritization: A family of empirical studies," IEEE Transactions on Software Engineering, vol. 28, pp. 159-182, 2002.
27. J. Jones and M. Harrold, "Test suite reduction and prioritization for modified condition/decision coverage," IEEE Trans. on Software Engingeering, vol. 29, 2003.
28. D. Leon and A. Podgurski, "A comparison of coverage-based and distribution-based techniques for filtering and prioritizing test cases," in Proc. of the Int'l Symp. on Software Reliability Engineering, 2003.
29. Z. Li, M. Harman, and R. Hierons, "Search algorithms for regression test case prioritization," IEEE Trans. on Software Engingeering, vol. 33.
30. B. Korel, L. Tahat, and M. Harman, "Test prioritization using system models," in Proc. of the Int'l Conf. on Software Maintenance, 2005.
31. S. Hou, L. Zhang, T. Xie, and J. Sun, "Quota-constrained test case prioritization for regression testing of service-centric systems," in Proc of the Int'l Conf. on Software Maintenance, 2008.
32. S. Sampath, R. Bryce, G. Viswanath, V. Kandimalla, and A. Koru, "Prioritizing user-session-based test cases for web applications testing," in Proc. of the Int'l Conf. on Software Testing, Verification, and Validation, 2008.
33. M. Sherriff, M. Lake, and L. Williams, "Prioritization of regression tests using singular value decomposition with empirical change records," in Proc. of the Int'l Symposium on Software Reliability Engineering, 2007.
34. S. Elbaum, A. Malishevsky, and G. Rothermel, "Incorporating varying test costs and fault severities into test case prioritization," in Proc. of Int'l Conf. on Software Engineering, 2001.
35. H. Park, J. Ryu, and J. Baik, "Historical value-based approach for cost-cognizant test case prioritization to improve the effectiveness of regression testing," in Proc. of the Int'l Conf. on Secure System Integration and Reliability Improvement, 2008.
36. S. Mirarab and L. Tahvildari, "A prioritization approach for software test cases on Bayesian Networks," in Proc. of the Int'l Conf. on Fundamental Approaches to Software Engineering, LNCS 4422-0276, 2007.
37. A. Walcott, M. Soffa, G. Kapfhammer, and R. Roos, "Time-aware test suite prioritization," in Proc. of the Int'l Symposium on Software Testing and Analysis, 2006.
38. L. Zhang, S. Hou, C. Guo, T. Xie, and H. Mei, "Time-aware test-case prioritization using integer linear programming," in Proc. of the 18th Int'l Symp. on Software Testing and Analysis. ACM, 2009.
39. S. Alspaugh, K. Walcott, M. Belanich, G. Kapfhammer, and M. Soffa, "Efficient time-aware prioritization with knapsack solvers," in Proc. of the ACM Int'l Workshop on Empirical Assessment of Software Engineering Languages and Technologies, 2007.
40. M. Rummel, G. Kapfhammer, and A. Thall, "Towards the prioritization of regression test suites with data flow information," in Proc. of the 2005 ACM Symp. on Applied computing. ACM, 2005.
41. G. Fraser and F. Wotawa, "Test-case prioritization with model-checkers," in 25th Conf. on IASTED Intl., 2007.
42. D. Jeffrey and N. Gupta, "Test case prioritization using relevant slices," in Computer Software and Applications Conf., (COMPSAC) 2006., vol. 1. IEEE, 2006.
43. E. Weyuker, "On testing non-testable programs," The Computer Journal, 1982.
44. D. Schuler and A. Zeller, "Assessing oracle quality with checked coverage," in Software Testing, Verification and Validation (ICST), 2011. IEEE, 2011.