Experimental designs in software engineering: D-optimal designs and covering arrays

WISER 2004 - ACM Workshop on Interdisciplinary Software Engineering Research

Volumn , Issue , 2004, Pages 55-66

  Hoskins, Dean ^a   Turban, Renée C ^a   Colbourn, Charles J ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

Author keywords

Covering Arrays; D Optimal Designs; Factorial Experiments

Indexed keywords

COMPONENT-BASED SOFTWARE TESTING; D-OPTIMAL DESIGNS; DESIGN OF EXPERIMENT (DOE);

ALGORITHMS; COMBINATORIAL MATHEMATICS; MEDICINE; PRODUCT DESIGN;

SOFTWARE ENGINEERING;

EID: 27644533969     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (37)

1. Alphaworks:IBM. Combinatorial test services tool. http://www.alphaworks.ibm.com/tech/cts.
2. C. Barrett, M. Drozda, A. Marathe, and M. Marathe. Analyzing interaction between network protocols, topology and traffic in wireless radio networks. In Proceedings of the IEEE Wireless Communications and Networking Conference, pages 1760-1766. IEEE, March 2003.
3. C. Barrett, A. Marathe, M. Marathe, and M. Drozda. Characterizing the interaction between routing and mac protocols in ad-hoc networks. In Proceedings of the Third ACM Int. Symp. Mobile Ad Hoc Networking and Computing, pages 92-103. ACM, June 2002.
4. T. Berling and P. Runeson. Efficient evaluation of multifactor dependent system performance using fractional factorial design. IEEE Transactions on Software Engineering, 29(9):769-781, September 2003.
5. R. F. Berry. Computer benchmark evaluation and design of experiments: A case study. IEEE Transactions on Computers, 41(10): 1279-1289, October 1992.
6. J. Borkowski. A comparison of prediction varaince criteria for response surface designs. Journal of Quality Technology, 35(1):70-77, January 2003.
7. K. Burr and W. Young. Combinatorial test techniques: Table-based automation, test generation, and code coverage. In Proceedings of the International Conference on Software Testing, Analysis, and Review, pages 503-513. SQE, October 1998.
8. J. Cawse. Experimental design for combinatorial and high throughput materials development. In GE Global Research Technical Report, pages 1-27. GE, November 2002.
9. D. M. Cohen, S. R. Dalal, M. L. Fredman, and G. C. Patton. The AETG system: an approach to testing based on combinatorial design. IEEE Transactions on Software Engineering, 23(7):437-44, July 1997.
10. D. M. Cohen, S. R. Dalal, J. Parelius, and G. C. Patton. The combinatorial design approach to automatic test generation. IEEE Software, 13(5):83-88, September 1996.
11. M. B. Cohen, C. J. Colbourn, P. B. Gibbons, and W. B. Mugridge. Constructing test suites for interaction testing. In 25th International Conference on Software Engineering, pages 38-48. IEEE, May 2003.
12. C. J. Colbourn, M. B. Cohen, and R. C. Turban. A deterministic density algorithm for pairwise interaction coverage. In IASTED Proceedings of the International Conference on Software Engineering, pages 345-352. SE2004, February 2004.
13. I. Dunietz, W. Ehrlich, B. Szablak, C. Mallows, and A. Iannino. Applying design of experiments to software testing. In Proceedings of the 19th International Conference on Software Engineering, pages 205-215. ACM, May 1997.
14. R. Fisher. The arrangement of field experiments. Journal of the Ministry of Agriculture of Great Britain, 33(6):503-513, October 1926.
15. P. Goos. The Optimal Design of Blocked and Split Plot Experiments. Springer-Verlag, New York NY, 2002.
16. D. Kuhn and M. Reilly. An investigation of the applicability of design of experiments to software testing. In Proceeding of the 27th Annual NASA Goddard Software Engineering Workshop, pages 91-95. NASA, December 2002.
17. D. R. Kuhn, D. R. Wallace, and A. M. Gallo. Software fault interactions and implications for software testing. IEEE Transactions on Software Engineering, 30(6):418-421, June 2004.
18. M. Lewis. Pharmaceutical Experimental Design. Marcel Dekker Inc, New York NY, 2000.
19. R. Mandl. Orthogonal latin squares: an application of experiment design to compiler testing. Communications of the ACM, 28(10): 1054-1058, October 1985.
20. R. Meyers and D. C. Montgomery. Response Surface Methodology (Second Edition). John Wiley and Sons, New York NY, 2002.
21. T. Mitchell. An algorithm for the construction of 'd-optimal' experimental designs. Technometrics, 16(2):203-210, January 1974.
22. D. C. Montgomery. Design and Analysis of Experiments (Fifth Edition). John Wiley and Sons, New York NY, 2001.
23. J. Neter, M. Kutner, C. Nachtsheim, and W. Wasserman. Applied Linear Statistical Models (Fourth Edition). McGraw-Hill, New York NY, 1996.
24. K. Nurmela. Upper bounds for covering arrays by tabu search. Discrete Applied Math., 138(1):143-152, March 2004.
25. M. S. Phadke. Planning efficient software tests. Cross-Talk Journal of Defense Software Engineering, 10(10): 11-15, October 1997.
26. R. L. Plackett. The design of optimum multifactorial experiments. Biometrica, 33(4):305-325, June 1946.
27. Jmp in statistics version 5.1. SAS.
28. Design expert. StatEase Inc.
29. K. C. Tai and L. Yu. A test generation strategy for pairwise testing. IEEE Transactions on Software Engineering, 28(1):109-111, January 2002.
30. Testcover.com. Testcover.com tool. http://www.testcover.com/.
31. Y. W. Tung and W. S. Aldiwan. Automating test case generation for the new generation mission software system. In Proceedings of the IEEE Aerospace Conference, pages 431-437. IEEE, March 2000.
32. K. Vadde and V. R. Syrotiuk. Factor interaction on service delivery in mobile ad hoc networks. IEEE Journal on Selected Areas in Communications, 22(7): 1335-1346, September 2004.
33. A. W. Williams. Determination of test configurations for pair-wise interaction coverage. Testing of communicating systems: Tools and techniques. In Proc. IEEE Aerospace Conference, pages 59-74. ACM, August 2000.
34. A. W. Williams and R. L. Probert. A measure for component interaction test coverage. In Proceedings of the ACS/IEEE International Conference on Computer Systems and Applications, pages 304-311. ACS/IEEE, June 2001.
35. B. J. Winer. Statistical Principles in Experimental Design second edition. McGraw-Hill, New York NY, 1971.
36. C. Yilmaz, M. Cohen, and A. Porter. Covering arrays for efficient fault characterization in complex configuration spaces. In Intl. Symp. on Software Testing and Analysis, pages 45-54. ACM, July 2004.
37. L. Yu and K. C. Tai. In-parameter-order: a test generation strategy for pairwise testing. In Proceedings of the Third IEEE International High-Assurance Systems Engineering Symposium, pages 254-261. IEEE, November 1998.