Open problems in testability transformation

2008 IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW'08

Volumn , Issue , 2008, Pages 196-209

  Harman, Mark ^a  

^a KING'S COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

INTERNATIONAL CONFERENCES; OPEN PROBLEMS; TEST ABILITY; TEST ADEQUACY; TEST DATA; TEST DATA GENERATION; VERIFICATION AND VALIDATION;

COMPUTER SOFTWARE SELECTION AND EVALUATION; TEST FACILITIES; TESTING; VERIFICATION;

SOFTWARE TESTING;

EID: 52249119943     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSTW.2008.30     Document Type: Conference Paper

References (61)

1. A. V. Aho, R. Sethi, and J. D. Ullman. Compilers: Principles, techniques and tools. Addison Wesley, 1986.
2. D. Baldwin and F. Sayward. Heuristics for determining equivalence of program mutations. Research Report 276, Department of Computer Science, Yale University, 1979.
3. A. Baresel, D. W. Binkley, M. Harman, and B. Korel. Evolutionary testing in the presence of loop-assigned s: A testability transformation approach. In International Symposium on Software Testing and Analysis (ISSTA 2004), pages 108- 118, Omni Parker House Hotel, Boston, Massachusetts, July 2004. Appears in Software Engineering Notes, Volume 29, Number 4.
4. A. Baresel and H. Sthamer. Evolutionary testing of flag conditions. In Genetic and Evolutionary Computation (GECCO-2003), volume 2724 of LNCS, pages 2442-2454, Chicago, 12-16 July 2003. Springer-Verlag.
5. B. Beizer. Software Testing Techniques. Van Nostrand Rein-hold, 1990.
6. D. W. Binkley and M. Harman. A survey of empirical results on program slicing. Advances in Computers, 62:105-178, 2004.
7. L. Bottaci. Instrumenting programs with flag variables for test data search by genetic algorithms. In GECCO 2002: Proceedings of the Genetic and Evolutionary Computation Conference, pages 1337-1342, New York, 9-13 July 2002. Morgan Kaufmann Publishers.
8. L. Bottaci and E. S. Mresa. Efficiency of mutation operators and selective mutation strategies: An empirical study. Software Testing, Verification and Reliability, 9(4):205-232, Dec. 1999.
9. British Standards Institute. BS 7925-1 vocabulary of terms in software testing, 1998.
10. T. A. Budd. Mutation analysis: Ideas, examples, problems and prospects. In Proceedings of the Summer School on Computer Program Testing, pages 129-148, Sogesta, June 1981.
11. P. Cousot and R. Cousot. Abstract interpretation frameworks. Journal of Logic and Computation, 2(4):511-547, Aug. 1992.
12. P. Cousot and R. Cousot. Systematic design of program transformation frameworks by abstract interpretation. ACM SIGPLAN Notices, 31(1):178-190, Jan. 2002.
13. J. Darlington and R. M. Burstall. A system which automatically improves programs. Acta Informatica, 6:41-60, 1976.
14. J. Darlington and R. M. Burstall. A tranformation system for developing recursive programs. J. ACM, 24(1):44-67, 1977.
15. R. A. DeMillo and A. J. Offutt. Experimental results from an automatic test generator. acm Transactions of Software Engineering and Methodology, 2(2):109-127, Mar. 1993.
16. N. Dershowitz and Z. Manna. The evolution of programs: A system for automatic program modification. In Conference Record of the Fourth Annual Symposium on Principles of Programming Languages, pages 144-154. ACM SIGACT and SIGPLAN, ACM Press, 1977.
17. B. Dufour, B. G. Ryder, and G. Sevitsky. Blended analysis for performance understanding of framework-based applications. In Proceedings of the ACM/SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2007, London, UK, July 9-12, 2007, pages 118-128. ACM, 2007.
18. M. S. Feather. A system for assisting program transformation. ACM Transactions on Programming Languages and Systems, 4(1):1-20, Jan. 1982.
19. R. Ferguson and B. Korel. The chaining approach for software test data generation. ACM Transactions on Software Engineering and Methodology, 5(1):63-86, Jan. 1996.
20. P. Godefroid, N. Klarlund, and K. Sen. DART: directed automated random testing. In V. Sarkar and M. W. Hall, editors, Proceedings of the ACM SIGPLAN 2005 Conference on Programming Language Design and Implementation, Chicago, IL, USA, June 12-15, 2005, pages 213-223. ACM, 2005.
21. J. Gustafsson. WCET 2007 - report from the WCET tool challenge 2006 ideas for the WCET tool challenge 2008. In C. Rochange, editor, 7th Intl. Workshop on Worst-Case Execution Time (WCET) Analysis, Pisa, Italy, July 3, 2007, volume 07002 of Dagstuhl Seminar Proceedings. Internationales Begegnungs- und Forschungszentrum fuer Infor-matik (IBFI), Schloss Dagstuhl, Germany, 2007.
22. M. Harman, A. Baresel, D. Binkley, R. Hierons, L. Hu, B. Korel, P. McMinn, and M. Roper. Testability transformation - program transformation to improve testability. In R. Hierons, J. Bowen, and M. Harman, editors, Fo r -mal Methods and Testing LNCS 4949, chapter 11. Springer, 2008. to appear.
23. M. Harman, D. W. Binkley, and S. Danicic. Amorphous program slicing. Journal of Systems and Software, 68(1):45- 64, Oct. 2003.
24. M. Harman, Y. Hassoun, K. Lakhotia, P. McMinn, and J. Wegener. The impact of input domain reduction on search-based test data generation. In ACM Symposium on the Foundations of Software Engineering (FSE '07), pages 155-164, Dubrovnik, Croatia, September 2007. Association for Computer Machinery.
25. M. Harman and R. M. Hierons. An overview of program slicing. Software Focus, 2(3):85-92, 2001.
26. M. Harman, L. Hu, R. Hierons, A. Baresel, and H. Sthamer. Improving evolutionary testing by flag removal. In GECCO 2002: Proceedings of the Genetic and Evolutionary Computation Conference, pages 1359-1366, San Francisco, CA 94104, USA, 9-13 July 2002. Morgan Kaufmann Publishers.
27. M. Harman, L. Hu, R. M. Hierons, J. Wegener, H. Sthamer, A. Baresel, and M. Roper. Testability transformation. IEEE Transactions on Software Engineering, 30(1):3-16, Jan. 2004.
28. R. Hierons, M. Harman, and C. Fox. Branch-coverage testability transformation for unstructured programs. The computer Journal, 48(4):421-436, 2005.
29. rd International Conference of B and Z Users (ZB2003), pages 388-407, Turku, Finland, June 2003. Springer. LNCS 2651.
30. R. M. Hierons. Testing from a Z specification. Journal of Software Testing, Verification and Reliability, 7:19-33, 1997.
31. R. M. Hierons and M. Harman. Testing conformance of a deterministic implementation against a non-deterministic specification. Theoretical Computer Science, 323(1-3):191- 233, 2004.
32. R. M. Hierons, M. Harman, and S. Danicic. Using program slicing to assist in the detection of equivalent mutants. Software Testing, Verification and Reliability, 9(4):233-262, 1999.
33. R. M. Hierons, T.-H. Kim, and H. Ural. On the testability of SDL specifications. Computer Networks, 44(5):681-700, 2004.
34. M. Holcombe. What are X-machines? Formal Asp. Comput, 12(6):418-422, 2000.
35. W. E. Howden. Weak mutation testing and completeness of test sets. IEEE Transactions on Software Engineering, 8:371-379, 1982.
36. K. N. King and A. J. Offutt. A FORTRAN language system for mutation-based software testing. Software Practice and Experience, 21:686-718, 1991.
37. th International Symposium on Software Reliability Engineering (ISSRE 05), pages 245-254, Chicago, Illinios, USA, Nov. 2005.
38. th International Workshop on Functional and Logic Programming (WFLP'2000), Beni-cassim, Spain, Sept. 2000. Online proceedings at http://www.dsic.upv.es/∼wflp2000/.
39. P. J. Landin. The next 700 programming languages. Communications of the ACM, 9(3):157-166, Mar. 1966.
40. P. McMinn. Search-based software test data generation: A survey. Software Testing, Verification and Reliability, 14(2):105-156, June 2004.
41. P. McMinn, D. Binkley, and M. Harman. Empirical evaluation of a nesting testability transformation for evolutionary testing. ACM Transactions on Software Engineering and Methodology. To appear.
42. P. McMinn, D. Binkley, and M. Harman. Testability transformation for efficient automated test data search in the presence of nesting. In UK Software Testing Workshop (UK Test 2005), Sheffield, UK, Sept. 2005.
43. P. McMinn, M. Harman, D. Binkley, and P. Tonella. The species per path approach to search-based test data generation. In International Symposium on Software Testing and Analysis (ISSTA 06), pages 13-24, Portland, Maine, USA., 2006.
44. P. McMinn and M. Holcombe. The state problem for evolutionary testing. In Genetic and Evolutionary Computation - GECCO-2003, volume 2724 of LNCS, pages 2488-2498, Berlin, 12-16 July 2003. Springer-Verlag.
45. P. McMinn and M. Holcombe. Evolutionary testing of state-based programs. In H.-G. Beyer and U.-M. O'Reilly, editors, Genetic and Evolutionary Computation Conference, GECCO 2005, Proceedings, Washington DC, USA, June 25-29, 2005, pages 1013-1020. ACM, 2005.
46. F. Mueller and J. Wegener. A comparison of static analysis and evolutionary testing for the verification of timing constraints. In 4th IEEE Real-Time Technology and Applications Symposium (RTAS '98), pages 144-154, Washington -Brussels - Tokyo, June 1998. IEEE.
47. A. J. Offutt and W. M. Craft. Using compiler optimization techniques to detect equivalent mutants. Software Testing, Verification and Reliability, 4:131-154, 1994.
48. A. J. Offutt, A. Lee, G. Rothermel, R. H. Untch, and C. Zapf. An experimental determination of sufficient mutant operators. ACM Transactions on Software Engineering Methodology, 5:99-118, 1996.
49. A. J. Offutt, J. Pan, K. Tewary, and T. Zhang. An experimental evalutation of data flow and mutation testing. Software Practice and Experience, 26:165-176, 1996.
50. A. J. Offutt and R. Untch. Mutation 2000: Uniting the orthogonal. In W. E. Wong, editor, Mutation Testing for the New Century (proceedings of Mutation 2000), pages 45-55, San Jose, California, USA, Oct. 2001. Kluwer.
51. H. Partsch. The CIP Transformation System, pages 305-322. Springer, 1984. Peter Pepper (ed.).
52. H. A. Partsch. The Specification and Transformation of Programs: A Formal Approach to Software Development. Springer, 1990.
53. K. Sen, D. Marinov, and G. Agha. CUTE: a concolic unit testing engine for C. In M. Wermelinger and H. Gall, editors, Proceedings of the 10th European Software Engineering Conference held jointly with 13th ACM SIGSOFT International Symposium on Foundations of Software Engineering, 2005, Lisbon, Portugal, September 5-9, 2005, pages 263-272. ACM, 2005.
54. F. Tip. A survey of program slicing techniques. Journal of Programming Languages, 3(3):121-189, Sept. 1995.
55. N. Tracey, J. Clark, and K. Mander. Automated program flaw finding using simulated annealing. In International Symposium on Software Testing and Analysis (ISSTA 98), pages 73-81, March 1998.
56. N. Tracey, J. Clark, K. Mander, and J. McDermid. Automated test-data generation for exception conditions. Software Practice and Experience, 30(1):61-79, 2000.
57. J. M. Voas and K. W. Miller. Software testability: The new verification. IEEE Software, 12(3):17-28, May 1995.
58. J. Wegener, A. Baresel, and H. Sthamer. Evolutionary test environment for automatic structural testing. Information and Software Technology, 43(14):841-854, 2001.
59. M. Weiser. Program slices: Formal, psychological, and practical investigations of an automatic program abstraction method. PhD thesis, University of Michigan, Ann Arbor, MI, 1979.
60. M. R. Woodward. Mutation testing - its origin and evolution. Information and Software Technology, 35:163-169, 1993.
61. Y. Zhan and J. A. Clark. The state problem for test generation in simulink. In GECCO 2006: Proceedings of the 8th annual conference on Genetic and evolutionary computation, volume 2, pages 1941-1948, Seattle, Washington, USA, 8-12 July 2006. ACM Press.