Partition testing, stratified sampling, and cluster analysis

Proceedings of the ACM SIGSOFT Symposium on the Foundations of Software Engineering

Volumn Part F129582, Issue , 1993, Pages 169-181

  Podgurski, Andy ^a   Yang, Charles ^a   Masri, Wassim ^b  

^a CASE WESTERN RESERVE UNIVERSITY   (United States)

^b Picker International   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTER ANALYSIS; RELIABILITY; SOFTWARE ENGINEERING; TESTING;

DEGREE OF PRECISION; ESTIMATING SOFTWARE; MANUAL LABORS; NEW APPROACHES; PARTITION TESTING; PROGRAM EXECUTION; SAMPLE SIZES; STRATIFIED SAMPLING;

SOFTWARE RELIABILITY;

EID: 84963693584     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/256428.167076     Document Type: Conference Paper

References (36)

1. Anderberg, M. R. Cluster Analysis for Applications, Academic Press, New York, 1973.
2. Bentley, J. Profilers. Communications of the ACM, Vol. 30, No. 7 (July 1987), pp. 587-592.
3. Binder, D. A. and Hidiroglou, M. A. Sampling in time. In Handbook of Statistics 6: Sampling, P. R. Krishnaiah and C. R. Rao editors, North Holland, Amsterdam, 1988.
4. Brown, J. R. and Lipow, M. Testing for software reliability. Proceedings of the International Conference on Reliable Software (Los Angeles, April 1975), pp. 518-527.
5. Butler, R. W. and Finelli, G. B. The infeasibility of experimental quantification of life-critical software reliability. Proceedings of the ACM SIGSOFT '91 Conference on Software for Critical Systems (New Orleans, December 1991), ACM Press, New York, 1991, pp. 66-76.
6. Chatfield, C. The Analysis of Time Series: An Introduction, Chapman and Hall, London, 1984.
7. Cho, C. Quality Programming, Wiley, New York, 1987.
8. Cochran, W. G. Sampling Techniques, Wiley, New York, 1977.
9. Currit, P. A., Dyer, M., and Mills, H. D. Certifying the reliability of software. IEEE Transactions on Software Engineering, Vol. SE-12, No. 1, (January 1986), pp. 3-11.
10. DeMillo, R. A., Say ward, F. G., and Lipton, R. J. Program mutation: a new approach to program testing. Infotech International State of the Art Report: Program Testing, Infotech International, 1979.
11. Duran, J. W. and Wiorkowski, J. J. Quantifying software validity by sampling. IEEE Transactions on Reliability, Vol. R-29, No. 2 (June 1980), pp. 141-144.
12. Duran, J. W. and Ntafos, S. C. An evaluation of random testing. IEEE Transactions on Software Engineering, Vol. SE-10, No. 4 (July 1984), pp. 438-444.
13. Goel, A. L. Software reliability models: assumptions, limitations, applicability. IEEE Transactions on Software Engineering, Vol. SE-11, No. 12 (December 1985), pp. 1411-1423.
14. Hamlet, D. and Taylor, R. Partition testing does not inspire confidence. IEEE Transactions on Software Engineering, Vol. 16, No. 12 (December 1990), pp. 206-215.
15. Howden, W. E. Methodology for the generation of program test data. IEEE Transactions on Computers, Vol. c-24, No. 5 (May 1975), pp. 554-559.
16. Kaufman, L. and Rousseeuw, P. J. Finding Groups in Data, Wiley, New York, 1990.
17. Knuth, D. E. The Art of Computer Programming, Vol. 2: Seminumerical Algorithms, Addison Wesley, Reading, MA, 1982.
18. Littlewood, B. Modelling growth in software reliability. In Software Reliability Handbook, P. Rook editor, Elsevier, New York, 1990, pp. 137-154.
19. Littlewood, B. and Strigini, L. The risks of software. Scientific American (November 1992), pp. 62-75.
20. McGeoch, C. Analyzing algorithms by simulation: variance reduction techniques and simulation speedups. ACM Computing Surveys, Vol. 24, No. 2 (June 1992), pp. 195-212.
21. Miller, K. W., Morell, L. J., Noonan, R. E., Park, S. K., Nichol, D. M., Murrill, B. W., and Voas, J. M. Estimating the probability of failure when testing reveals no failures. IEEE Transactions on Software Engineering, Vol. 18, No. 1, (January 1992), pp. 33-42.
22. Musa, J. D., Iannino, A., and Okumoto, K. Software Reliability: Measurement, Prediction, Application, McGraw-Hill, New York, 1987.
23. Musa, J. D. Operational profiles in software-reliability engineering. IEEE Software (March 1993), pp. 14-32.
24. Nelson, E. N. Estimating software reliability from test data. Microelectronics and Reliability, Vol. 17 (1978), pp. 67-74.
25. Nelson, B. L. A perspective on variance reduction in dynamic simulation experiments. Communications on Statistical Simulation, Vol. 16, No. 2 (1987), pp. 385-426.
26. Neyman, J. On two different aspects of the representative method: the method of stratified sampling and the method of purposive selection. Journal of the Royal Statistical Society, Vol. 97, pp. 558-606.
27. Podgurski, A. The role of statistical reliability assessment. Proceedings of the 25th Symposium on the Interface: Computing Science and Statistics (College Station, Texas, March 1992).
28. Rapps, S. and Weyuker, E. J. Selecting software test data using data flow information. IEEE Transactions on Software Engineering, Vol. SE-11, No. 4 (April 1985), pp. 367-375.
29. Richardson, D. J. and Clarke, L. A. A partition analysis method to increase program reliability. Proceedings of the Fifth International Conference on Software Engineering (1981), IEEE Computer Society, Los Alamitos, CA, pp. 244-253.
30. Sarndal, C.-E., Swensson, B., and Wretman, J. Model Assisted Survey Sampling, Springer-Verlag, New York, 1992.
31. Schick, G. J. and Wolverton, R. W. An analysis of competing software reliability models. IEEE Transactions on Software Engineering, Vol. SE-4, No. 2 (March 1978), pp. 104-120.
32. Sukhatme, P. V., Sukhatme, B. V., Sukhatme, S., and Asok, C. Sampling Theory of Surveys With Applications, third edition, Iowa State University Press, 1984.
33. Thayer, T. A., Lipow, M., and Nelson, E. C. Software Reliability, TRW technical report TRW-SS-76-03, March 1976.
34. Tsoukalas, M. Z., Duran, J. W., and Ntafos, S. C. On some reliability estimation problems in random and partition testing. Proceedings of the International Symposium on Software Reliability Engineering (Austin, Texas, May 1991), IEEE Computer Society Press, Los Alamitos, CA, pp. 194-201.
35. S. N. Weiss and E. J. Weyuker, "A generalized domain-based definition of software reliability," Proceedings of the Workshop on Software Testing (Banff, Alberta, July 1986) IEEE Computer Society Press, Los Alamitos, CA, pp. 98-107.
36. Weyuker, E. J. and Jeng, B. Analyzing partition testing strategies. IEEE Transactions on Software Engineering, Vol. 17, No. 7 (July 1991), pp. 703-711.