Modeling software testing costs and risks using fuzzy logic paradigm

Journal of Systems and Software

Volumn 80, Issue 6, 2007, Pages 817-835

  Engel, Avner ^a   Last, Mark ^b  

^a ISRAEL AIRCRAFT INDUSTRIES   (Israel)

^b BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

Author keywords

Cost; Fuzzy modeling; Lifecycle; Risk; Testing; Validation; Verification

Indexed keywords

COST EFFECTIVENESS; FUZZY LOGIC; LIFE CYCLE; MATHEMATICAL MODELS; OPTIMIZATION; PROBABILISTIC LOGICS; RISK MANAGEMENT;

FUZZY MODELING; VERIFICATION, VALIDATION AND TESTING (VVT);

SOFTWARE TESTING;

EID: 33947522847     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2006.09.013     Document Type: Article

References (52)

1. Beizer B. Black-Box Testing: Techniques for Functional Testing of Software and Systems (1995), John Wiley & Sons. 0471120944
2. Boehm W.B. Software Engineering Economics (1981), Prentice Hall Ptr. 0138221227
3. Boehm B. Software defects reduction top 10 list. IEEE Computer 34 1 (2001) 135-137
4. Boehm B., et al. Software Cost Estimation with Cocomo-II (2000), Prentice Hall PTR. 0130266922
5. Boehm B., Abts C., and Chulani S. Software development cost estimation approaches - a survey. Annals of Software Engineering 10 (2000) 177-205
6. Brade, D., Koester, A., 2001. Risk-based Validation & Verification Levels Definition. European Simulation Interoperability Workshop. University of Westminster, Harrow, Middlesex, UK.
7. Browning R.T. Sources of performance risk in complex systems development, INCOSE-1999. Brighten England (1999) 711-718
8. Burnstein, I., Suwannasart, T., Carlson, R.C., 1996. Developing a testing maturity model. Illinois Institute of Technology.
9. Conrow E.H., and Shishido P.S. Implementing risk management on software intensive projects. IEEE Software 14 3 (1997) 83-89
10. Dean, B.E., Wood, A.D., Moore, A.A., Bogart, H.E., 1986. Cost risk analysis based on perception of the engineering process. In: 1986 Annual Conference of the International Society of Parametric Analysts, Kansas City, MO.
11. Devooght J. Model uncertainty and model inaccuracy. Reliability Engineering and System Safety 59 (1998) 171-185
12. Dubois D., Foulloy L., Mauris G., and Prade H. Possibility/probability transformations, triangular fuzzy sets, and probabilistic inequalities. Reliable Computing 10 (2004) 273-297
13. Easterbrook S., and Callahan J. Formal methods for verification and validation of partial specifications: a case study. Journal of Systems Software 40 (1998) 199-210
14. Engel A., and Barad M. A methodology for modeling VVT risks and costs. Systems Engineering Journal 6 3 (2003) 135-151 Wiley InterScience, Online ISSN: 1520-6858, Print ISSN: 1098-1241
15. Engel A., and Shachar S. Measuring and optimizing systems' quality costs and project duration. Systems Engineering Journal 9 3 (2006) 259-280
16. Engel, A., Bogomolni, I., Shachar, S. Grinman, A., 2004. Using historical cost and risk data to optimize the VVT process. In: 14th Annual International Symposium of INCOSE, Toulouse, France.
17. Engel, A. et al., 2001. Developing methodology for advanced systems testing - SYSTEST. A research grant proposal for the European Commission, the Research Proposal Office, GRD1-2001-40487.
18. Eriksson, A., Bereza-Jarocinski, B., 1999. The kiss of life: software testing gets a blood transfusion. In: International Conference on Software Testing, Analysis & Review, Barcelona, Spain.
19. Fenton N., and Neil M. Making decision: using Bayesian nets and MCDA. Knowledge-Based Systems 14 (2001) 307-325
20. Fenton N., and Ohlsson N. Quantitative analysis of faults and failures in a complex systems. IEEE Transactions on Software Engineering 26 8 (2000) 797-814
21. Fischhoff B., Lichtenstein S., Slovic P., Derby L.S., and Keeney R. Acceptable Risk (1984), Cambridge University Press. 0521278929
22. Ghiassi M. Dual programming approach to software testing. Software Quality Journal 3 (1994) 45
23. Gonzalez A., and Barr V. Validation and verification of intelligent systems - what are they and how are they different?. Journal of Experimental and Theoretical Artificial Intelligence 12 4 (2000)
24. Haimes Y.Y., Kaplan S., and Lambert J.H. Risk filtering, ranking, and management framework using hierarchical holographic modeling. Risk Analysis 22 2 (2002) 383-398
25. Hajjar A., Chan T., Munn I., Andrews A., and Bjorkman M. High quality behavioral verification using statistical stopping criteria. Proceeding of the IEEE 2001 2nd International Symposium on Quality Electronic Design (2001), IEEE Computer Society, Los Alamos, CA 31-37
26. Houston D., and Keats J.B. Cost of software quality: a means of promoting software process improvement. Quality Engineering 10 3 (1998) 563-574
27. Ittner C.D. Exploratory evidence on the behavior of quality costs. Operations Research 44 1 (1996) 114-130
28. Jensen, R., 1983. An improved macrolevel software development resource estimation model. In: 5th ISPA Conference, April 1983, pp. 88-92.
29. Jones C. Applied Software Measurement: Assuring Productivity and Quality (1991), Mcgraw-Hill. 0070328137
30. Kim J.M., Porter A., and Rothermel G. An empirical study of regression test application frequency. The 22nd International Conference on Software Engineering (ICSE 2000) (2000), ACM, Toronto, Canada 126-135
31. Kishk, M., Al-Hajj, A., 2000. Fuzzy modeling of life-cycle costs of alternatives with different lives. In: 16th Annual Conference of the Association of Researchers in Construction Management (ARCOMM 2000), Glasgow Caledonian University.
32. Klir J.G., and Yuan B. Fuzzy Sets and Fuzzy Logic: Theory and Applications (1995), Prentice Hall. 0131011715
33. Kosko B. Fuzzy Engineering (1996), Prentice Hall ASIN: 0131249916
34. Lake, J., 1999. V&V in plain English. INCOSE-1999, Brighten England.
35. Malaiya, Y.K., Denton, J., 1998. Estimating the number of residual defects. In: Proceeding of IEEE High Assurance Systems Engineering Symposium, HASE 98, pp. 98-105.
36. Marczyk, J., 1999. Principles of simulation-based computer-aided engineering. FIM Publications, Dep. Legal B-, Barcelona, Spain, pp. 38994-38999.
37. Maskey, S., 2001. Uncertainty analysis in flood forecasting and warning system using expert judgment and fuzzy set theory. In: Proceedings of European Safety and Reliability International Conference, ESREL-2001, Turin, Italy, pp. 1787-1794.
38. Mercer, D.R., Horst, A.K., 2000. Increasing the importance of testing within systems engineering. In: Proceedings of EuSEC-2000, Munich, Germany.
39. van Moll, J.H., Jacobs, J.C., Freimut, B., Trienekens, J.J.M., 2002. The importance of lifecycle modeling to defect detection and prevention. In: Proceedings of the 10th International Workshop on Software Technology and Engineering Practice (STEP 2002), pp. 144-155.
40. Morgan M.G., and Henrion M. Uncertainty: A Guide to Dealing With Uncertainty in Quantitative Risk and Policy Analysis (1992), Cambridge University Press. 0521427444
41. Muessig, R.P., Laack, R.D., Wrobleski, W.J., 1997. Optimizing the selection of VV& A activities - a risk/benefit approach. In: Winter Simulation Conference, Atlanta Georgia, 60-66.
42. NIST, 2002. The economic impacts of inadequate infrastructure for software testing. National Institute of Standards & Technology, US Department of Commerce, Planning Report 02-3.
43. Oberkampf, L.W., Trucano, G.T., Hirsch C., 2002. Verification, validation and predictive capability in computational engineering and physics. Foundation for V&V in the 21st Century Workshop, John Hopkins University, Laural, MD.
44. Park, R., 1988. The Central Equations of the PRICE Software Cost Model, 4th COCOMO Users', Group Meeting, November 1988.
45. Pedrycz w. Why triangular membership functions?. Fuzzy Sets and Systems 64 (1994) 21-30
46. Putnam L., and Myers W. Measures For Excellence: Reliable Software On Time, Within Budget (1991), Prentice Hall PTR. 0135676940
47. Sorqvist, L., 1998. On poor quality costing. Doctoral thesis, Royal Institute of Technology, Department of Production Engineering, Stockholm.
48. Thomke S., and Bell D.E. Sequential testing in product development. Management Science 47 2 (2001) 308-323
49. Thompson M.K. Variability and uncertainty meet risk management and risk communication. Risk Analysis Journal (2002) 647-654
50. Vose D. Risk Analysis: A Quantitative Guide (2000), John Wiley & Sons. 047199765X
51. Whiteside M., and Reimann M. A methodology for quantitative assessment of the impact of alternate business practices on systems life-cycle costs. International Journal of Flexible Automation and Integrated Manufacturing 2 3 (1994) 231-343
52. Zadeh L.A. Fuzzy sets. Information and Control 8 (1965) 338-353