A cost-benefit stopping criterion for statistical testing

Proceedings of the Hawaii International Conference on System Sciences

Volumn 37, Issue , 2004, Pages 4867-4872

  Prowell, S J ^a  

^a University of Tennessee   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER HARDWARE; COMPUTER SOFTWARE; COST BENEFIT ANALYSIS; COSTS; DECISION MAKING; PROBABILITY; RELIABILITY;

COST-BENEFIT STOPPING; SOFTWARE COMPONENTS; SOFTWARE TESTING; TARGET RELIABILITY;

STATISTICAL TESTS;

EID: 12344320033     PISSN: 10603425     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/hicss.2004.1265715     Document Type: Conference Paper

References (20)

1. Tom Chávez. A decision-analytic stopping rule for validation of commercial software systems. IEEE Transactions on Software Engineering, 26(9):907-918, September 2000.
2. Sanping Chen and Shirley Mills. A binary Markov process model for random testing. IEEE Transactions on Software Engineering, 22(3):218-223, March 1996.
3. S. R. Dalal and C. L. Mallows. When should one stop testing software. Journal of the American Statistical Association, 83(403):872-879, September 1988.
4. Amrit L. Goel. Software reliability models: Assumptions, limitations, and applicability. IEEE Transactions on Software Engineering, SE-11(12):1411-1423, December 1985.
5. Amrit L. Goel and Kazu Okumoto. Time-dependent error-detection rate model for software reliability and other performance measures. IEEE Transactions on Reliability, R-28(3):206-211, August 1979.
6. Swapna S. Gokhale, Teebu Philip, and Peter N. Marinos. A non-homogeneous Markov software reliability model with imperfect repair. In Proceedings of the Second International Computer Performance and Dependability Symposium (IPDS 96), pages 262-270. IEEE Computer Society, September 1996.
7. Amjad Hajjar, Tom Chen, Isabelle Munn, Anneliese Andrews, and Maria Bjorkman. High quality behavioral verification using statistical stopping criteria. In Proceedings of the DATE 2001 on Design, Automation, and Test in Europe, pages 411-419. IEEE Press, March 2001.
8. Mary E. Helander, Ming Zhao, and Niclas Ohlsson. Planning models for software reliability and cost. IEEE Transactions on Software Engineering, 24(6):420-434, June 1998.
9. David P. Kelly and Jesse H. Poore. Improving software quality using statistical testing techniques. Information and Software Technology, 42(12):801-807, September 2000.
10. Harvey S. Koch and Peter Kubat. Optimal release time of computer software. IEEE Transactions on Software Engineering, SE-9(3):323-327, May 1983.
11. Bev Littlewood and David Wright. Some conservative stopping rules for the operational testing of safety-critical software. IEEE Transactions on Software Engineering, 23(11):673-683, November 1997.
12. Keith W. Miller, Larry J. Morell, Robert E. Noonan, Stephen K. Park, David M. Nicol, Branson W. Murriel, and Jeffrey M. Voas. Estimating the probability of failure when testing reveals no failures. IEEE Transactions on Software Engineering, 18(1):33-44, January 1992.
13. J. Offutt, X. Xiong, and S. Liu. Criterion for generating specification-based tests. In Proceedings of the Fifth IEEE International Conference on Engineering of Complex Computer Systems (ICECCS 99), pages 199-131. IEEE Computer Society Press, October 1999.
14. Kazu Okumoto and Amrit L. Goel. Optimum release-time for software systems based on reliability and cost criteria. Journal of Systems and Software, 1(4):315-318, 1980.
15. Jesse H. Poore, Harlan D. Mills, and David Mutchler. Planning and certifying system reliability. IEEE Software, 10(1):88-99, 1993.
16. Peter G. Sassone and William A. Schaffer. Cost-Benefit Analysis: A Handbook. Academic Press, New York, NY, 1978.
17. Kirk D. Sayre. Improved Techniques for Software Testing Based on Markov Chain Usage Models. PhD thesis, The University of Tennessee, Knoxville, TN, December 1999.
18. Kirk D. Sayre and Jesse H. Poore. Stopping criteria for statistical testing. Information and Software Technology, 42(12):851-857, September 2000.
19. Gwendolyn H. Walton, Jesse H. Poore, and Carmen J. Trammell. Statistical testing of software based on a usage model. Software - Practice and Experience, 25(1):97-108, January 1995.
20. James A. Whittaker and Michael G. Thomason. A Markov chain model for statistical software testing. IEEE Transactions on Software Engineering, 20(10):812-824, October 1994.