Architecture-based software reliability analysis: Overview and limitations

IEEE Transactions on Dependable and Secure Computing

Volumn 4, Issue 1, 2007, Pages 32-40

  Gokhale, Swapna S ^a,b  

^a IEEE   (United States)

^b University of Connecticut   (United States)

Author keywords

Software architecture; Software reliability

Indexed keywords

COMPUTATIONAL METHODS; COMPUTER ARCHITECTURE; ENGINEERING RESEARCH; RELIABILITY ANALYSIS;

SOFTWARE RELIABILITY ANALYSIS;

SOFTWARE RELIABILITY;

EID: 33847737071     PISSN: 15455971     EISSN: None     Source Type: Journal    
DOI: 10.1109/TDSC.2007.4     Document Type: Article

References (101)

1. http://www.isi.edu/nsnam/ns/, 2005.
2. A. Abd-Allah, "Extending Reliability Block Diagrams to Software Architectures," Technical Report USC-CSE-97-501, Dept. of Computer Science, Univ. Southern California, 1997.
3. G. Ahrens and A. Chandra, "Availability Modeling and Validation Methodology for RS/6000 Systems," Proc. Ann. Reliability and Maintainability Symp., pp. 305-309, Jan. 1999.
4. C. Alattinoglu, A.U. Shankar, K. Dussa-Zieger, and I. Matta, "Design and Implementation of MaRS: A Routing Testbed," J. Internetworking Research and Experience, vol. 5, no. 1, pp. 17-41, 1994.
5. L.J. Bain and M. Engelhardt, Introduction to Probability and Math. Statistics. Duxbury Press, 1980.
6. L.W. Birnbaum, "On the Importance of Different Components in a Multi-Component System," Multivariate Analysis II, Krisnaiah, ed., Academic Press, 1969.
7. M.H. Chen, M.R. Lyu, and W.E. Wong, "Effect of Code Coverage on Software Reliability Measurement," IEEE Trans. Reliability, vol. 50, no. 2, pp. 165-170, June 2001.
8. R.C. Cheung, "A User-Oriented Software Reliability Model," IEEE Trans. Software Eng., vol. 6, no. 2, pp. 118-125, Mar. 1980.
9. ΧSuds Team, "Mining System Tests to Aid Software Maintenance," Computer, vol. 31, no. 7, pp. 64-73, July 1998.
10. H. Choi, V. Kulkarni, and K.S. Trivedi, "Markov Regenerative Stochastic Petri Net," Performance Evaluation, vol. 20, nos. 1-3, pp. 337-357, 1994.
11. D.W. Coit and T. Jin, "Prioritizing System-Reliability Prediction Improvements," IEEE Trans. Reliability, vol. 50, no. 1, pp. 17-25, Mar. 2001.
12. OMG Corp., http://www.uml.org, 2005.
13. B. Cuick, H.H. Ammar, and K. Lateef, "Identifying High-Risk Scenarios of Complex Systems Using Input Domain Partitioning," Proc. Int'l Symp. Software Reliability Eng. (ISSRE '98), pp. 164-173, 1998.
14. B. Cukic, "The Virtues of Assessing Software Reliability Early," IEEE Software, pp. 50-53, May/June 2005.
15. W.M. Evanco, "Poisson Analysis of Defects for Small Software Components," J. Systems Software, vol. 38, no. 1, pp. 27-35, 1997.
16. W.W. Everett, "Software Component Reliability Analysis," Proc. Application Specific Software Eng. and Technology, pp. 204-211, Mar. 1999.
17. W. Farr, "Software Reliability Modeling Survey," Handbook of Software Reliability Eng., M.R. Lyu, ed., pp. 71-117, McGraw-Hill, 1996.
18. J. Fenlason and R. Stallman, "Gnu gprof," http://www.gnu.org/ manual/gprof-2.9.1/html_mono/gprof.html, 2005.
19. S. Gokhale, "Cost-Constrained Reliability Maximization of Software Systems," Proc. Ann. Reliability and Maintainability Symp. (RAMS '04), pp. 195-200, Jan. 2004.
20. S. Gokhale, "Quantifying the Variance in Application Reliability," Proc. Pacific Rim Dependability Conf., pp. 113-121, Mar. 2004.
21. S. Gokhale, "Software Application Design Based on Architecture, Reliability and Cost," Proc. Int'l Symp. Computers and Comm. (ISCC '04), vol. 2, pp. 1098-1103, July 2004.
22. S. Gokhale, "Software Failure Rate and Reliability Incorporating Repair Policies," Proc. 10th IEEE Int'l Symp. Software Metrics (METRICS '04), pp. 394-404, Sept. 2004.
23. S. Gokhale, "Software Reliability Analysis Incorporating Second-Order Architectural Statistics," Int'l J. Reliability, Quality and Safety Eng., vol. 12, no. 3, pp. 267-290, 2005.
24. S. Gokhale and M.R. Lyu, "Regression Tree Modeling for the Prediction of Software Quality," Proc. Int'l Symp. Sustainable Agricultural Technologies (ISSAT '97), pp. 31-36, Mar. 1997.
25. S. Gokhale, M.R. Lyu, and K.S. Trivedi, "Reliability Simulation of Component-Based Software Systems," Proc. Ninth Int'l Symp. Software Reliability Eng. (ISSRE '98), pp. 192-201, Nov. 1998.
26. S. Gokhale and R. Mullen, "From Test Count to Code Coverage Using the Lognormal Failure Rate," Proc. Int'l Symp. Software Reliability Eng. (ISSRE '04), pp. 295-395, Nov. 2004.
27. S. Gokhale and K.S. Trivedi, "Analytical Models for Architecture-Based Software Reliability Prediction: A Unification Framework," IEEE Trans. Reliability, accepted for publication.
28. S. Gokhale and K.S. Trivedi, "Structure-Based Software Reliability Prediction," Proc. Fifth Int'l Conf. Advanced Computing (ADCOMP '97), pp. 447-452, Dec. 1997.
29. S. Gokhale and K.S. Trivedi, "Dependency Characterization in Path-Based Approaches to Architecture-Based Software Reliability Prediction," Proc. First Application Specific Software Eng. Technology (ASSET '98), pp. 86-89, Mar. 1998.
30. S. Gokhale and K.S. Trivedi, "A Time/Structure Based Software Reliability Model," Annals of Software Eng., vol. 8, pp. 85-121, 1999.
31. S. Gokhale and K.S. Trivedi, "Reliability Prediction and Sensitivity Analysis Based on Software Architecture," Proc. Int'l Symp. Software Reliability Eng. (ISSRE '02), Nov. 2002.
32. S. Gokhale, W.E. Wong, K.S. Trivedi, and J.R. Horgan, "An Analytic Approach to Architecture-Based Software Performance and Reliability Prediction," Performance Evaluation, vol. 58, no. 4, pp. 391-412, Dec. 2004.
33. S. Gokhale and S. Yacoub, "Performability Analysis of a Pipeline Software Architecture," Proc. Int'l Conf. Computer Science and Applications, July 2005.
34. D.E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, 1989.
35. K. Goseva-Popstojanova, M. Hamill, and R. Perugupalli, "Large Empirical Case Study of Architecture-Based Software Reliability," Proc. Int'l Symp. Software Reliability Eng., pp. 43-52, Nov. 2005.
36. K. Goseva-Popstojanova and S. Kamavaram, "Assessing Uncertainty in Reliability of Component-Based Software Systems," Proc. Int'l Symp. Software Reliability Eng., pp. 307-320, 2003.
37. K. Goseva-Popstojanova and S. Kamavaram, "Software Reliability Estimation under Uncertainty: Generalization of the Method of Moments," Proc. Eighth IEEE Int'l Symp. High Assurance Systems Eng., pp. 209-218, 2004.
38. K. Goseva-Popstojanova, A.P. Mathur, and K.S. Trivedi, "Comparison of Architecture-Based Software Reliability Models," Proc. Int'l Symp. Software Reliability Eng., pp. 22-31, 2001.
39. V. Grassi, "Architecture-Based Dependability Prediction for Service-Oriented Computing," Proc. Workshop Architecting Dependable Systems, 2004.
40. M.E. Helander, M. Zhao, and N. Ohlsson, "Planning Models for Software Reliability and Cost," IEEE Trans. Software Eng., vol. 24, no. 6, pp. 420-434, June 1998.
41. C. Hirel, B. Tuffin, and K.S. Trivedi, "SPNP: Stochastic Petri Nets. Version 6.0," Proc. Int'l Conf. Technology of Object-Oriented Languages and Systems (TOOLS '00), 2000.
42. R. Huang, M.R. Lyu, and K. Kanoun, "Simulation Techniques for Component-Based Software Reliability Modeling with Project Application," Proc. Int'l Symp. Information Systems and Eng. (ISE '01), pp. 283-289, 2001.
43. R. Jacoby and K. Masuzawa, "Test Coverage Dependent Software Reliability Estimation by the HGD Model," Proc. Third Int'l Symp. Software Reliability Eng., 1992.
44. K. Jensen, Colored Petri Nets: Basic Concepts, Analysis Methods and Practical Use. Springer, 1997.
45. K. Jensen, "DesignCPN, Version 4.0," technical report, Univ. Denmark, 1999.
46. A. Jhumka, M. Hiller, and N. Suri, "Assessing Inter-Modular Error Propagation in Distributed Software," Proc. 20th IEEE Symp. Reliable Distributed Systems, Oct. 2001.
47. J.G. Kemeny and J.L. Snell, Finite Markov Chains. D. Van Nostrand, 1960.
48. S. Kirkpatrick, C.D. Gelatt, Jr., and M.P. Vecchi, "Optimization by Simulated Annealing," Science, vol. 220, pp. 671-680, May 1983.
49. S. Krishnamurthy and A.P. Mathur, "On the Estimation of Reliability of a Software System Using Reliabilities of Its Components," Proc. Eighth Int'l Symp. Software Reliability Eng., pp. 146-155, Nov. 1997.
50. V. Kulkarni and K.S. Trivedi, "FSPNs: Fluid Stochastic Petri Nets," Proc. 14th Int'l Conf. Applications and Theory of Petri Nets, pp. 24-31, 1993.
51. W. Kuo and V.R. Prasad, "An Annotated Overview of System-Reliability Optimization," IEEE Trans. Reliability, vol. 49, no. 2, pp. 176-187, June 2000.
52. J.C. Laprie, M. Kaaniche, and K. Kanoun, "Modeling Computer Systems Evolutions: Non-Stationary Process and Stochastic Petri Nets-Application to Dependability Growth," Proc. Sixth Int'l Workshop Petri Nets and Performance Models, pp. 221-230, Oct. 1995.
53. J.C. Laprie and K. Kanoun, "X-Ware Reliability and Availability Modeling," IEEE Trans. Software Eng., vol. 15, pp. 130-147, 1992.
54. J.C. Laprie and K. Kanoun, "Software Reliability and System Reliability," Handbook of Software Reliability Eng., M.R. Lyu, ed., pp. 27-69. McGraw-Hill, 1996.
55. J. Ledoux and G. Rubino, "A Counting Model for Software Reliability Analysis," IASTED J. Simulation, 1997.
56. M. Lipow, "Number of Faults per Line of Code," IEEE Trans. Software Eng., vol. 8, no. 4, pp. 437-439, July 1982.
57. B. Littlewood, "A Reliability Model for Markov Structured Software," Proc. Int'l Conf. Reliable Software, pp. 204-207, Apr. 1975.
58. B. Littlewood, "A Semi-Markov Model for Software Reliability with Failure Costs," Proc. Symp. Computer Software Eng., pp. 281-300, Apr. 1976.
59. J.H. Lo, C.Y. Huang, S.Y. Kuo, and M.R. Lyu, "Sensitivity Analysis of Software Reliability for Component-Based Software Systems," Proc. 27th Ann. Int'l Computer Software and Applications Conf. (COMPSAC '03), pp. 500-505, 2003.
60. D.G. Luenberger, Introduction to Linear and Nonlinear Programming. Addison-Wesley, 1974.
61. M.R. Lyu, S. Rangarajan, and A.P.A. van Moorsel, "Optimal Resource Allocation of Test Resources for Software Reliability Growth Modeling in Software Development," IEEE Trans. Reliability, vol. 51, no. 2, pp. 183-192, June 2002.
62. Y.K. Malaiya, M.N. Li, J.M. Bieman, and R. Karcich, "Software Reliability Growth with Test Coverage," IEEE Trans. Reliability, vol. 51, no. 4, pp. 420-426, Dec. 2002.
63. B. Marick, "Generic Coverage Tool: User's Guide," technical report, Testing Foundations, 1992.
64. D. Mason, "Probabilistic Analysis for Component Reliability Composition," Proc. Fifth ICSE Workshop Component-Based Software Eng. (CBSE '02), May 2002.
65. Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, second extended ed. Springer, 1994.
66. Sun Microsystems, http://java.sun.eom/j2se/1.4.2/docs/guide/ jvmpi/jvmpi.html, 2005.
67. Sun Microsystems, http://java.sun.com/products/jdk/rmi, 2005.
68. Sun Microsystems, http://java.sun.com/products/jms, 2005.
69. M. Casassa Mont, A. Baldwin, Y. Beres, K. Harrison, M. Sadler, and S. Shiu, "Reducing Risks of Widespread Faults and Attacks for Commercial Software Applications: Towards Diversity of Software Components," Proc. 26th Ann. Int'l Computer Software and Applications Conf. (COMPSAC '02), pp. 271-276, 2002.
70. S.H. Mullins, W.W. Charlesworth, and D.C. Anderson, "A New Method for Solving Mixed Sets of Equality and Inequality Constraints," J. Mechanical Design, vol. 117, pp. 322-328, June 1995.
71. J. Muppala, M. Malhotra, and K.S. Trivedi, "Stiffness-Tolerant Methods for Transient Analysis of Stiff Markov Chains," Microelectronics and Reliability, vol. 34, no. 11, pp. 1825-1841, 1994.
72. J.D. Musa, "Operational Profiles in Software-Reliability Engineering," IEEE Software, vol. 10, no. 2, pp. 14-32, Mar. 1993.
73. J.D. Musa, A. Iannino, and K. Okumoto, Software Reliability- Measurement, Prediction, Application. McGraw-Hill, 1987.
74. "ObjecTime User Guide/'technical report, ObjectTime, 1998.
75. OMG, http://www.omg.org, 2005.
76. P. Popic, D. Desovski, W. Abdelmoez, and B. Cukie, "Error Propagation in the Reliability Analysis of Component Based Systems," Proc. Int'l Symp. Software Reliability Eng., pp. 53-62, 2005.
77. A. Puliafito, M. Telek, and K.S. Trivedi, "The Evolution of Stochastic Petri Nets," Proc. World Congress Systems Simulation, pp. 3-15, Sept. 1997.
78. J. Rajgopal and M. Majumdar, "Modular Operational Test Plans for Inferences on Software Reliability Based on a Markov Model," IEEE Trans. Software Eng., vol. 28, no. 4, pp. 358-363, Apr. 2002.
79. Rational/IBM, http://www.rational.com/products/az/index.jsp, 2005.
80. Rational/IBM, http://www.rational.com/products/az/index.jsp, 2005.
81. N.F. Scheidewind, "Fault Correction Profiles," Proc. Int'l Symp. Software Reliability Eng., pp. 257-267, Nov. 2003.
82. K. Seigrist, "Reliability of Systems with Markov Transfer of Control," IEEE Trans. Software Eng., vol. 14, no. 7, pp. 1049-1053, July 1988.
83. K. Seigrist, "Reliability of Systems with Markov Transfer of Control, II," IEEE Trans. Software Eng., vol. 14, no. 10, pp. 1478-1480, Oct. 1988.
84. B. Selic, G. Gullekson, and P. Ward, Real-Time Object Oriented Modeling. John Wiley & Sons, 1994.
85. H. Singh, V. Cortellessa, B. Cukic, E. Gunel, and V. Bharadwaj, "A Bayesian Approach to Reliability Prediction and Assessment of Component-Based Systems," Proc. Int'l Symp. Software Reliability Eng. (ISSRE '01), pp. 12-21, Nov. 2001.
86. N.D. Singpurwalla and S.P. Wilson, Statistical Methods in Software Engineering: Reliability and Risk. Springer, 1999.
87. R. Srinivasan, "RFC: Remote Procedure Call Protocol Specification Version 2," Technical Report RFC 1831, Internet Eng. Task Force, Aug. 1995.
88. M. Tang and M. Chen, "Measuring OO Design Metrics from UML," Proc. Fifth Int'l Conf. Unified Modeling Language - The Language and Its Applications, Sept. 2002.
89. K.S. Trivedi, Probability and Statistics with Reliability, Queuing and Computer Science Applications. John Wiley & Sons, 2001.
90. A.G. Tsirukis and G.V. Reklaitis, "Application of Generalized Hopfield Networks to Discrete Nonlinear Optimization Problems," Computers and Chemical Eng., vol. 18, pp. 459-468, May 1994.
91. J.M. Voas, "PIE: A Dynamic Failure-Based Technique," IEEE Trans. Software Eng., vol. 18, no. 8, pp. 717-727, Aug. 1992.
92. S. Wadekar and S. Gokhale, "Exploring Cost/Reliability Tradeoffs in Architectural Alternatives Using a Genetic Algorithm," Proc. Int'l Symp. Software Reliability Eng. (ISSRE '99), pp. 104-113, Nov. 1999.
93. G.K. Wallace, "The JPEG Still Picture Compression Standard," Comm. ACM, Apr. 1991.
94. W. Wang, J. Loman, and P. Vassiliou, "Reliability Importance of Components in a Complex System," Proc. Ann. Reliability and Maintainability Symp., Jan. 2004.
95. W. Wang, D. Pan, and M. Chen, "Heterogeneous Software Reliability Modeling," Proc. 13th Int'l Symp. Software Reliability Eng., pp. 41-52, Nov. 2002.
96. W. Wang, Y. Wu, and M.H. Chen, "An Architecture-Based Software Reliability Model," Proc. Pacific Rim Dependability Symp., pp. 143-150, Dec. 1999.
97. D.M. Woit, "Specifying Component Interactions for Modular Reliability Estimation," Proc. First Int'l Software Quality Week Europe, Nov. 1997.
98. Z. Xu, T.M. Khoshgoftaar, and E.B. Allen, "Prediction of Software Faults Using Fuzzy Nonlinear Regression Modeling," Proc. Fifth Int'l Symp. High Assurance Systems Eng., pp. 281-290, Nov. 2000.
99. S. Yacoub, B. Cukic, and H. Ammar, "Scenario-Based Analysis of Component-Based Software," Proc. 10th Int'l Symp. Software Reliability Eng., Nov. 1999.
100. S. Yacoub, B. Cukic, and H. Ammar, "A Scenario-Based Analysis for Component-Based Software," IEEE Trans. Reliability, vol. 53, no. 4, pp. 465-480, 2004.
101. W.M. Zage and D.M. Zage, "Evaluating Design Metrics on Large Scale Software," IEEE Software, vol. 9, no. 4, pp. 75-81, July 1993.