Uncertainty explicit assessment of off-the-shelf software: A Bayesian approach

Information and Software Technology

Volumn 51, Issue 2, 2009, Pages 497-511

  Gashi, Ilir ^a   Popov, Peter ^a   Stankovic, Vladimir ^a  

^a CITY UNIVERSITY   (United Kingdom)

Author keywords

Bayesian inference; COTS component assessment; Reliability and performance assessment

Indexed keywords

BAYESIAN NETWORKS; COMPUTER SOFTWARE SELECTION AND EVALUATION; INFERENCE ENGINES;

ASSESSMENT METHODS; BAYESIAN APPROACHES; BAYESIAN INFERENCE; BAYESIAN MODELS; CONVENTIONAL METHODS; COTS COMPONENT ASSESSMENT; COTS COMPONENTS; DATABASE SERVERS; EMPIRICAL DATUMS; INCOMPLETE KNOWLEDGES; LOW QUALITIES; SOFTWARE DEVELOPMENTS;

PROBABILITY DISTRIBUTIONS;

EID: 56349155979     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2008.06.003     Document Type: Article

References (50)

1. C. Ncube, N. Maiden, PORE: Procurement-oriented requirements engineering method for the component-based systems engineering development paradigm, in: International Workshop on Component-Based Software Engineering, 1999.
2. J. Kontio, S.Y. Chen, et al., A COTS selection method and experiences of its use, in: Twentieth annual software engineering workshop, NASA Goddard Space Flight Center, Greenbelt, Maryland, 1995.
3. J. Jeanrenaud, P. Romanazzi, Software Product Evaluation: A Methodological Approach, in: Software Quality Management II: Building Software into Quality, 1994, pp. 55-69.
4. V. Tran, D.-B. Liu, A risk mitigating model for the development of reliable and maintainable large-scale commercial-off-the-shelf integrated software systems, in: Proceedings of the 1997 Annual Reliability and Maintainability Symposium (RAMS), 1997, p. 361-367.
5. Ochs M., Pfahl D., et al. A method for efficient measurement-based COTS assessment and selection - method description and evaluation results. Proceedings of the 7th International Symposium on Software Metrics (2001), IEEE Computer Society, London, England 285-294
6. C. Alves, J. Castro, CRE: A systematic method for COTS components selection, in: XV Brazilian Symposium on Software Engineering (SBES), Rio de Janeiro, Brazil, 2001.
7. B.C. Phillips, S.M. Polen, Add decision analysis to your COTS selection process, in: CroosTalk - The Journal of Defence Software Engineering, 2002.
8. Boehm B., Port D., et al. Composable process elements for developing COTS-based applications. Proceedings of the 2003 International Symposium on Empirical Software Engineering, ISESE' 2003 (2003), ACM-IEEE 8-17
9. Dean J. An Evaluation Method for COTS Software Products (2000)
10. Kunda D., and Brooks L. Applying social-technical approach for COTS selection. Proceedings of the 4th UKAIS Conference (1999), University of York, England
11. Gregor S., Hutson J., and Oresky C. Storyboard process to assist in requirements verification and adaptation to capabilities inherent in COTS. Proceedings of the International Conference on COTS-Based Software Systems (ICCBSS-2002) (2002), Springer-Verlag, Florida, USA 132-141
12. Burgués X., Estay C., et al. Combined selection of COTS components. Proceedings of the International Conference on COTS-Based Software Systems (ICCBSS-2002) (2002), Springer-Verlag, Florida, USA 54-64
13. Comella-Dorda S., Dean J., et al. A process for COTS software product evaluation. Proceedings of the International Conference on COTS-Based Software Systems (ICCBSS-2002) (2002), Springer-Verlag, Florida, USA 86-92
14. Ruhe G. Intelligent support for selection of COTS products. Web, Web-Services, and Database Systems (2002), Springer 34-45
15. P. Lewis, P. Hyle, et al., Lessons learned in developing commercial off-the-shelf (COTS) intensive software systems, 2000.
16. Bertoa M.F., and Vallecillo A. Quality attributes for COTS components. Proceedings of the 6th ECOOP Workshop on Quantitative Approaches in Object-Oriented Software Engineering (QAOOSE 2002) (2002), Málaga, Spain 54-66
17. ISO/IEC-9126-1:2001, Information Technology - Product Quality - Part 1: Quality Model, 2001, International Standard ISO/IEC 9126, International Standard Organization, June, 2001.
18. IEEE/ANSI, Recommended Practice for Software Requirements Specifications, International Standard 830-1993, IEEE, 1993.
19. C. Abts, B. Boehm, E.B. Clark, COCOTS: A software COTS-based system (CBS) cost model, in: Proceedings of the 12th Annual Conference on European Software Control and Metrics (ESCOM), London, UK, 2001, p. 1-8.
20. Torchiano M., and Jaccheri L. Assessment of reusable COTS attributes. Proceedings of the International Conference on COTS-Based Software Systems (ICCBSS-2003) (2003), Springer-Verlag, Ottawa, Canada 219-228
21. Littlewood B., and Wright D. Some conservative stopping rules for the operational testing of safety-critical software. IEEE Transactions on Software Engineering 23 11 (1997) 673-683
22. Likert R. A Technique for the Measurement of Attitudes (1932), McGraw-Hill, New York
23. Brocklehurst S., Chan P.Y., et al. Recalibrating software reliability models. IEEE Transactions on Software Engineering SE-16 4 (1990) 458-470
24. In: Lyu M.R. (Ed). Handbook of Software Reliability Engineering (1996), IEEE Computer Society Press and McGraw-Hill
25. D. Wright, K.-Y. Cai, Representing Uncertainty for Safety Critical Systems, PDCS2 Tech. Rep. 135. Center for Software Reliability, City University, London, SHIP Project, 1994.
26. Musa J.D. Operational profiles in software-reliability engineering. IEEE Software (1993) 14-32
27. Johnson N.L., and Kotz S. Distributions in Statistics: Continuous Multivariate Distributions. In: Bradley R.A., Hunter J.S., Kendall D.G., and Watson G.S. (Eds). Wiley Series in Probability and Mathematical Statistics vol. 4 (1972), John Wiley and Sons, Inc. 333
28. Littlewood B., Popov P., and Strigini L. Assessment of the reliability of fault-tolerant software: a Bayesian approach. Proceedings of 19th International Conference on Computer Safety, Reliability and Security, SAFECOMP'2000 (2000), Springer, Rotterdam, The Netherlands 294-308
29. Popov P. Reliability Assessment of Legacy Safety-Critical Upgraded with Off-the-Shelf Components. SAFECOMP-2002 (2002), Springer, Catania, Italy 139-150
30. Kaplan W. Advanced Calculus. third ed. (1984), Addison-Wesley, Reading, MA
31. Port D., and Chen S. Assessing COTS Assessment: How Much is Enough?. Proceedings of the International Conference on COTS-Based Software Systems (ICCBSS-04) (2004), Springer-Verlag, Redondo Beach, CA 183-198
32. Jeng B., and Weyuker E.J. Analyzing partition testing strategies. IEEE Transactions on Software Engineering 17 7 (1991) 703-711
33. Hamlet D., and Taylor R. Partition testing does not inspire confidence. IEEE Transactions on Software Engineering 16 12 (1990) 1402-1411
34. Gashi I., Popov P., and Strigini L. Fault diversity among off-the-shelf SQL database servers. DSN'04 International Conference on Dependable Systems and Networks (2004), IEEE Computer Society Press, Florence, Italy pp. 389-398
35. Gashi I., Popov P., Stankovic V., and Strigini L. On Designing Dependable Services with Diverse Off-The-Shelf SQL Servers. In: Gacek C., de Lemos R., and Romanovsky A. (Eds). Architecting Dependable Systems II (2004), Springer-Verlag 191-214
36. Stankovic V., and Popov P. Improving DBMS Performance through Diverse Redundancy. 25th IEEE Symposium on Reliable Distributed Systems (SRDS'06) (2006), IEEE Computer Society, Leeds, UK 391-400
37. Gashi I., Popov P., and Strigini L. Fault Tolerance via Diversity for Off-The-Shelf Products: a Study with SQL Database Servers. IEEE Transactions on Dependable and Secure Computing 4 4 (2007) 280-294
38. TPC, "TPC-C, An On-Line Transaction Processing Benchmark, v. 5.2. 2004.
39. Adams E.N. Optimizing preventive service of software products. IBM Journal of Research and Development 28 1 (1984) 2-14
40. Gray, J., Why do Computers Stop and What Can Be Done About It? in: Sixth International Conference on Reliability and Distributed Databases, 1987.
41. Chandra S., and Chen P.M. Whither generic recovery from application faults? a fault study using open-source software. DSN 2000, International Conference on Dependable Systems and Networks (2000), IEEE Computer Society Press, New York, USA 97-106
42. Littlewood B., and Miller D.R. Conceptual modelling of coincident failures in multi-version software. IEEE Transactions on Software Engineering SE-15 12 (1989) 1596-1614
43. Eckhardt D.E., and Lee L.D. A theoretical basis for the analysis of multiversion software subject to coincident errors. IEEE Transactions on Software Engineering SE-11 12 (1985) 1511-1517
44. Knight J.C., and Leveson N.G. An experimental evaluation of the assumption of independence in multi-version programming. IEEE Transactions on Software Engineering SE-12 1 (1986) 96-109
45. Eckhardt D.E., Caglayan A.K., et al. An experimental evaluation of software redundancy as a strategy for improving reliability. IEEE Transactions on Software Engineering 17 7 (1991) 692-702
46. GNOME, BetaDist, 2008. .
47. T. Andrews, F. Curbera, H. Dholakia, Y. Goland, J. Klein, F. Leymann, K. Liu, D. Roller, D. Smith, S. Thatte, I. Trickovic, Business Process Execution Language for Web Services Version 1.1. 2003, BEA, IBM, Microsoft, SAP, Siebel, Systems.
48. Patterson, D., A. Brown, et al., Recovery Oriented Computing (ROC): Motivation, Definition, Techniques, and Case Studies, 2002. .
49. Ncube C., and Maiden N. Acquiring COTS software selection requirements. IEEE Software 15 2 (1998) 46-56
50. Apache-Software-Foundation, ab - Apache HTTP Server Benchmarking Tool, 2008. .