An empirical evaluation of test case filtering techniques based on exercising complex information flows

Proceedings - International Conference on Software Engineering

Volumn 2005, Issue , 2005, Pages 412-421

  Leon, David ^a   Masri, Wes ^b   Podgurski, Andy ^a  

^a Case Western Reserve University   (United States)

^b AMERICAN UNIVERSITY OF BEIRUT   (Lebanon)

Author keywords

Dynamic information flow analysis; Dynamic slicing; Observation based testing; Program dependences; Software testing; Test case filtering

Indexed keywords

DYNAMIC INFORMATION FLOW ANALYSIS; DYNAMIC SLICING; OBSERVATION BASED TESTING; PROGRAM DEPENDENCES; SOFTWARE TESTING; TEST CASE FILTERING;

BLOCK CODES; DISTRIBUTED COMPUTER SYSTEMS; FAULT TOLERANT COMPUTER SYSTEMS; SOFTWARE ENGINEERING; USER INTERFACES;

INFORMATION DISSEMINATION;

EID: 33244494413     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSE.2005.1553584     Document Type: Conference Paper

References (39)

1. Agrawal H., Horgan J., Krauser E., London S. Incremental Regression Testing. Proceedings of the IEEE Conference on Software Maintenance (Montreal, Canada, 1993).
2. th ACM Symposium on Principles of Programming Languages (January 1993), 384-396.
3. Clarke, L. A., Podgurski, A., Richardson, D. J., and Zeil, S. J. A formal evaluation of data flow path selection criteria. IEEE Transactions on Software Engineering, Vol. 15, No. 11 (November 1989), 1381-1332.
4. Denning D.E. and Denning P.J. Certification of programs for secure information flow. Communication of the ACM 20, 7 (1977), 504-513.
5. Dickinson, W., Leon, D., and Podgurski, A. Finding failures by cluster analysis of execution profiles. 23rd Intl. Conf. on Software Engineering (Toronto, May 2001), 339-348.
6. Dickinson, W., Leon, D., and Podgurski, A. Pursuing failure: the distribution of program failures in a profile space. 10th European Software Engineering Conf. and 9th ACM SIGSOFT Symp. on the Foundations of Software Engineering (Vienna, September 2001), ACM Press, 246-255.
7. Elbaum, S., Malishevsky, A.G., and Rothermel, G. Test case prioritization: a family of empirical studies. IEEE Transactions on Software Engineering 28, 2 (February 2002), 159-182.
8. Ferrante J., Ottenstein K.J., and Warren J.D.. The Program Dependence Graph and its Use in Optimization. ACM Transactions on Programming Languages and Systems 9, 3 (October 1987), 319-349.
9. th ACM SIGSOFT International Symposium on the Foundations of Software Engineering (Lake Buena Vista, FL, Nov. 1998), 153-162.
10. Frankl, P. G. and Y. Deng. A Comparison of Delivered Reliability of Branch, Data Flow, and Operational Testing: A Case Study. 2000 International Symposium on Software Testing and Analysis (Portland, OR, August 2000), 124-134.
11. Graves, T. L, Harrold, M. J., Kim, J. M., Porter, A., and Rothermel, G. An empirical study of regression test selection techniques. ACM Transactions on Software Engineering and Methodology 10, 2 (April 2001), 184-208.
12. Gupta, R., Harrold, M. J., and Soffa, M. L. Program Slicing-Based Regression Testing Techniques. Journal of Software Testing, Verification, and Reliability 6, 2 (June 1996), 83-112.
13. Harold, M. J., Rothermel, G., Sayre, K., Wu, R., and Yi, L. An Empirical Investigation of the Relationship Between Spectra Differences and Regression Faults. Journal of Softare Testing, Verification, and Reliability, 10, 3 (September 2000).
14. Hochbaum, D. S. (editor). Approximation algorithms for NP-hard problems. PWS Publishing, Boston, MA, 1997.
15. Jacks, IBM, Jacks Project, www.ibm.com/developerworks/oss/cvs/jacks/, 2002.
16. Java Language Specification, Sun Microsystems, java.sun.com/docs/books/ jls/second_edition/html/j.title.do c.html, 2000.
17. [I7] javac, Sun Microsystems Inc., Java™ 2 Platform, Standard Edition, java.sun.com/j2se/1.3/, 1995-2002.
18. JTidy, jtidy.sourceforge.net, World Wide Web Consortium (Massachusetts Institute of Technology, Institut National de Recherche en Informatique et en Automatique, Keio University), 1998-2000.
19. Kim, J. M. and Porter, A. A history-based test prioritization technique for regression testing in resource constrained environments. 2002 International Conference on Software Engineering (Orlando, FL, May 2002).
20. Korel, B. The Program Dependence Graph in Static Program Testing. Information Processing Letters 24 (January 1987), 103-108.
21. Korel B. and Laski J. Dynamic Program Slicing. Information Processing Letters 29 (October 1988), 155-163.
22. Korel B. and Yalamanchili S. Forward Computation of Dynamic Program Slices. ISSTA (1994), 66-79.
23. Laski, J. W. and Korel, B. A Data Flow Oriented Program Testing Strategy. IEEE Transactions on Software Engineering 9, 3 (May 1983), 347-354.
24. Leon, D. and Podgurski, A. A Comparison of Coverage-Based and Distribution-Based Techniques for Filtering and Prioritizing Test Cases. International Symposium on Software Reliability Engineering (Denver, CO, November 2003), 442-454.
25. Leon, D., Podgurski, A., and White, L.J. Multivariate visualization in observation-based testing. Proceedings of the 22nd International Conference on Software Engineering (Limerick, Ireland, June 2000), ACM Press, 116-125.
26. Masri, W., Podgurski, A., and Leon, D. Detecting and Debugging Insecure Information Flows. 15th. IEEE International Symposium on Software Reliability Engineering, ISSRE 2004. St. Malo, France Nov 2-5, 2004.
27. Ntafos, S. C. On Required Element Testing. IEEE Transactions on Software Engineering 10, 6 (November 1984), 795-803.
28. Podgurski A. and Clarke L. A Formal Model of Program Dependencies and its Implications for Software Testing, Debugging, and Maintenance. IEEE TSE, 16(9):965-979, September 1990.
29. Podgurski. A., Leon, D., Francis, P., Masri, W., Minch, M., Sun, J. and Wang, B. Automated support for classifying software failure reports. To appear in 2003 International Conference on Software Engineering (Portland, OR, May 2003).
30. Rapps, S. and E. J. Weyuker. Selecting Software Test Data Using Data Flow Information. IEEE Transactions on Software Engineering 11, 4 (April 1985), 367-375.
31. Rothermel, G. and Harrold, M.J. A Safe, Efficient Algorithm for Regression Test Selection, 1993 Conference on Software Maintenance (September 1993), pages 358-367.
32. Rothermel, G. and Harrold, M. J. Selecting Tests and Identifying Test Coverage Requirements for Modified Software. 1994 International Symposium on Software Testing and Analysis (August 1994), 169-184.
33. Rothermel, G., Untch, R., Chu, C., and Harrold, M.J. Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering 27, 10 (October 2001), 929-948.
34. Thompson, M. C., Richardson, D. J., and Clarke, L. A. An Information Flow Model of Fault Detection. International Symposium on Software Testing and Analysis (Cambridge, MA, June 1993), 182-192.
35. Weiser M. Program Slicing. IEEE Transactions On Software Engineering 10, 4 (1984), 352-357.
36. Wong, W. E., Horgan, J. R., London, S., and Mathur, A. P. Effect of test set size minimization and fault detection effectiveness. Software Practice and Experience 28, 4 (April 1998), 347-369.
37. st Annual International Computer Software and Applications Conference (Washington, D.C., August 1997), 522-528.
38. Xerces. The Apache XML Project: xml.apache.org/xerces-j.
39. XML Conformance Test Suite. www.w3.org/XML/Test