Simulation-based test adequacy criteria for distributed systems

Proceedings of the ACM SIGSOFT Symposium on the Foundations of Software Engineering

Volumn , Issue , 2006, Pages 231-241

  Rutherford, Matthew J ^a   Carzaniga, Antonio ^a,b   Wolf, Alexander L ^a,b  

^a UNIVERSITY OF COLORADO   (United States)

^b UNIVERSITY OF LUGANO   (Switzerland)

Author keywords

Discrete event simulation; Distributed systems; Fault based analysis; Test adequacy criteria

Indexed keywords

ALGORITHMS; BANDWIDTH; COMPUTER SIMULATION; MATHEMATICAL MODELS; SCALABILITY;

DISCRETE-EVENT SIMULATION; FAULT-BASED ANALYSIS; TEST ADEQUACY CRITERIA;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 34547241726     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1181775.1181804     Document Type: Conference Paper

References (34)

1. M. Allman and A. Falk. On the effective evaluation of TCP. SIGCOMM Computer Communications Review, 29(5):59-70, 1999.
2. P. E. Ammann and P. E. Black. A specification-based coverage metric to evaluate test sets. International Journal of Reliability, Quality and Safety Engineering, 8(4):275-299, 2001.
3. G. Bochmann and A. Petrenko. Protocol testing: Review of methods and relevance for software testing. In Proceedings of the 1994 ACM SIGSOFT International Symposium on Software Testing and Analysis, pages 109-124, 1994.
4. L. C. Briand, Y. Labiche, and Y. Wang. Using simulation to empirically investigate test coverage criteria based on statecharts. In Proceedings of the 26th International Conference on Software Engineering, pages 86-95, 2004.
5. R., H. Carver and K.-C. Tai. Use of sequencing constraints for specification-based testing of concurrent programs. IEEE Transactions on Software Engineering, 24(6):471-490, 1998.
6. J. Chang and D. J. Richardson. Structural specification-based testing: Automated support and experimental evaluation. In Proceedings of the 7th European Software Engineering Conference/7th ACM SIGSOFT International Symposium on Foundations of Software Engineering, pages 285-302, 1999.
7. I. Clarke, S. G. Miller, T. W. Hong, O. Sandberg, and B. Wiley. Protecting free expression online with Freenet. IEEE Internet Computing, 6(1):40-49, 2002.
8. R. A. DeMillo, R. Lipton, and F. Sayward. Hints on test data selection: Help for the practicing programmer. IEEE Computer, 11(4):34-41, Apr. 1978.
9. J. L. Devore. Probability and Statistics for Engineering and the Sciences. Brooks/Cole, 4th edition, 1995
10. S. C. P. F. Fabbri, J. C. Maldonado, T. Sugeta, and P. C. Masiero. Mutation testing applied to validate specifications based on statecharts. In Proceedings of the 10th International Symposium on Software Reliability Engineering, page 210, Washington, DC, USA, 1999.
11. P. Frankl and O. Iakounenko. Further empirical studies of test effectiveness. In Proceedings of the 6th ACM SIGSOFT International Symposium on Foundations of Software Engineering, pages 153-162, New York, NY, USA, 1998.
12. P. Frankl and S. Weiss. An experimental comparison of the effectiveness of branch testing and data flow testing. IEEE Transactions on Software Engineering, 19(8):774-787, Aug. 1993.
13. P. Frankl and E. Weyuker. An applicable family of data flow testing criteria. IEEE Transactions on Software Engineering, 14(10): 1483-1498, 1988.
14. M. Harder, J. Mellen, and M. D. Ernst. Improving test suites via operational abstraction. In Proceedings of the 25th International Conference on Software Engineering, pages 60-71, 2003.
15. Z. Jin and J. Offutt. Deriving tests from software architectures. In Proceedings of the 12th IEEE International Symposium on Software Reliability Engineering, pages 308-313, Nov. 2001.
16. D. R. Kuhn. Fault classes and error detection capability of specification-based testing. ACM Transactions on Software Engineering Methodology, 8(4):411-424, 1999.
17. J. F. Kurose and K. W. Ross. Computer Networking: A Top-Down Approach Featuring the Internet. Pearson Benjamin Cummings, 2004.
18. Y.-S. Ma, J. Offutt, and Y.-R. Kwon. Mujava: An automated class mutation system. Journal of Software Testing, Verification and Reliability, 15(2):97-133, 2005.
19. H. Muccini, A. Bertolino, and P. Inverardi. Using software architecture for code testing. IEEE Transactions on Software Engineering, 30(3):160-171, Mar. 2004.
20. A. J. Offutt, A. Lee, G. Rothermel, R. H. Unten, and C. Zapf. An experimental determination of sufficient mutant operators. ACM Transactions on Software Engineering Methodology, 5(2):99-118, 1996.
21. A. J. Offutt and S. Liu. Generating test data from SOFL specifications. Journal of Systems and Software, 49(1):49-62, 1999.
22. J. Offutt, S. Liu, A. Abdurazik, and P. Ammann. Generating test data from state-based specifications. Journal of Software Testing, Verification and Reliability, 13(l):25-53, Mar. 2003.
23. T. J. Ostrand and M. J. Balcer. The category-partition method for specifying and generating fuctional tests. Communications of the ACM, 31(6):676-686, 1988.
24. D. E. Perry and A. L. Wolf. Foundations for the study of software architecture. SIGSOFT Software Engineering Notes, 17(4):40-52, 1992.
25. M. D. Rice and S. B. Seidman. An approach to architectural analysis and testing. In Proceedings of the 3rd International Workshop on Software Architecture, pages 121-123, 1998.
26. D. Richardson, O. O'Malley, and C. Tittle. Approaches to specification-based testing. In Proceedings of the ACM SIGSOFT '89 Third Symposium on Software Testing, Analysis, and Verification, pages 86-96, 1989.
27. D. Richardson and M. Thompson. An analysis of test data selection criteria using the RELAY model of fault detection. IEEE Transactions on Software Engineering, 19(6):533-553, 1993.
28. D. J. Richardson and A. L. Wolf. Software testing at the architectural level. In Joint Proceedings of the Second International Software Architecture Workshop (ISAW-2) and International Workshop on Multiple Perspectives in Software Development (Viewpoints '96) on SIGSOFT '96 Workshops, pages 68-71, 1996.
29. M. J. Rutherford, A. Carzaniga, and A. L. Wolf. Simulation-based testing of distributed systems. Technical Report CU-CS-1004-06, University of Colorado at Boulder, Boulder, CO, Jan. 2006.
30. S. D. R. S. D. Souza, J. C. Maldonado, S. C. P. F. Fabbri, and W. L. D. Souza. Mutation testing applied to Estelle specifications. Software Quality Control, 8(4):285-301, 1999.
31. I. Stoica, R. Morris, D. Liben-Nowell, D. R. Karger, M. F. Kaashoek, F. Dabek, and H. Balakrishnan. Chord: A scalable peer-to-peer lookup protocol for internet applications. IEEE/ACM Transactions on Networking, 11(1):17-32, 2003.
32. T. Tsuchiya and T. Kikuno. On fault classes and error detection capability of specification-based testing. ACM Transactions on Software Engineering Methodology, 11(11):58-62, 2002.
33. Y. Wang, M. J. Rutherford, A. Carzaniga, and A. L. Wolf. Automating experimentation on distributed testbeds. In Proceedings of 20th IEEE/ACM International Conference on Automated Software Engineering, pages 164-173, Long Beach, CA, Nov. 2005.
34. E. Weyuker, T. Goradia, and A. Singh. Automatically generating test data from a boolean specification. IEEE Transactions on Software Engineering, 20(5):353-363, 1994.