Non-markovian state-space models in dependability evaluation

Quality and Reliability Engineering International

Volumn 29, Issue 2, 2013, Pages 225-239

  Distefano, Salvatore ^a   Trivedi, Kishor S ^b  

^a POLITECNICO DI MILANO   (Italy)

^b USA   (United States)

Author keywords

dependability; non Markovian techniques; state space models

Indexed keywords

DEPENDABILITY; DEPENDABILITY EVALUATION; DEPENDABILITY MODELING; DEPENDABILITY MODELS; NON-MARKOVIAN; RELIABILITY BEHAVIOR; SEMI-MARKOV; STATE - SPACE MODELS; STATE-SPACE;

QUALITY ASSURANCE; SAFETY ENGINEERING;

STATE SPACE METHODS;

EID: 84874106105     PISSN: 07488017     EISSN: 10991638     Source Type: Journal    
DOI: 10.1002/qre.1305     Document Type: Review

References (85)

1. Heimann DI, Mittal N, Trivedi K,. Availability and reliability modeling for computer systems. In Advances in Computers, Vol. 31, Yovits MC, (ed.). Academic Press: San Diego, CA, 1990; 175-233.
2. Muppala JK, Malhotra M, Trivedi KS,. Markov dependability models of complex systems: Analysis techniques. In Reliability and Maintenance of Complex Systems, Özekici S, (ed.). Springer: Berlim, Germany, 1996; 442-486.
3. Sahner R, Trivedi KS, Puliafito A,. Performance and Reliability Analysis of Computer Systems: An Example-Based Approach Using the SHARPE Software Package. Kluwer Academic Publishers: Dordrecht, The Netherlands, 1995.
4. Dhillon BS,. Reliability Engineering in Systems Design and Operation. Van Nostrand Reinhold: New York, NY, 1983.
5. Trivedi KS, Geist RM,. Decomposition in reliability analysis of fault-tolerant computer systems. IEEE Transactions on Reliability 1983; 32: 463-468.
6. Geist R, Smotherman M, Trivedi KS, Bectha Dugan J,. The reliability of life-critical computer systems. Acta Informatica 1986; 23 (6): 621-642.
7. Geist RM, Smotherman M, Trivedi KS, Dugan JB,. The use of weibull fault processes in modeling fault tolerant systems. AIAA Journal of Guidance, Control, and Dynamics 1988; 11: 91-93.
8. Botta RF, Harris CM, Marchal WG,. Characterizations of generalized hyperexponential distribution functions. Communications in Statistics-Stochastic Models 1987; 3 (1): 115-148.
9. Neuts MF,. Renewal process of phase type. Naval Research Logistics Quartely 1978; 25 (3): 445-454.
10. Çinlar E,. Introduction to Stochastic Processes. Prentice-Hall: Englewood Cliffs, NJ, 1975.
11. Kulkarni VG,. Modeling and Analysis of Stochastic Systems. Chapman & Hall: London, UK, 1995.
12. Cox DR,. The analysis of non-Markovian stochastic processes by the inclusion of supplementary variables. Proceedings of the Cambridge Philosophical Society 1955; 51 (3): 433-441.
13. Brokemeyer F, Halstron HS, Jensen A,. The life and works of A. K. Erlang. Transactions of the Danish Academy of Technical Sciences 1948; 2.
14. Cox DR,. Use of complex probabilities in the theory of stochastic processes. Proceedings of the Cambridge Philosophical Society 1955; 51: 313-318.
15. Botta RF, Harris CM,. Approximation with generalized hyperexponential distribution functions: Weak convergence results. Queueing Systems-Theory and Applications 1986; 1 (2): 169-190.
16. Neuts MF,. Probability distributions of phase type, Liber Amicorum Prof. Emeritus H. Florin. University of Louvain: Belgium, 1975; 173-206.
17. Neuts MF,. Matrix-Geometric Solutions in Stochastic Models: An Algorithmic Approach. Johns Hopkins University Press: Baltimore, MD, 1981.
18. Ramaswami V, Neuts MF,. A duality for phase type queues. Annals of Probability 1980; 8 (5): 974-985.
19. Bobbio A, Cumani A, Premoli A, Saracco O,. Modelling and identification of non-exponential distributions by homogeneous markov processes. Proceedings of the 6th Advances in Reliability Technology Symposium, Bradford, 1980; 373-392.
20. Bobbio A, Premoli A, Saracco O,. Multi-state homogeneous Markov models in reliability analysis. Microelectronics and Reliability 1980; 20: 875-880.
21. Bobbio A, Cumani A,. A Markov approach to wear-out modelling. Microelectronics and Reliability 1983; 23 (1): 113-119.
22. Cumani A,. On the canonical representation of homogeneous markov processes modelling failure-time distributions. Microelectronics and Reliability 1982; 22 (3): 583-602.
23. Smith WL,. Renewal theory and its ramifications. Journal of the Royal Statistical Society, Series B 1958; 20 (2): 243-302.
24. Fröberg C,. Introduction to Numerical Analysis, (2nd edn). Addison-Wesley Publishing Company: Reading, MA, 1969.
25. German R, Logothetis D, Trivedi KS,. Transient analysys of Markov regenerative stochastic Petri nets: A comparison of approaches. Proceedings of the 6th International Workshop on Petri Nets and Performance Models-PNPM'95, Durham, NC, 1995; 103-111.
26. Telek M, Bobbio A, Jereb L, Puliafito A, Trivedi KS,. Steady state analysis of Markov regenerative SPN with age memory policy. In Lecture Notes in Computer Science, Vol. 977, Beilner H, Bause F, (eds). 1995; 165-179.
27. Fricks R, Telek M, Puliafito A, Trivedi K,. Markov renewal theory applied to performability evaluation. In State-of-the Art in Performance Modeling and Simulation. Modeling and Simulation of Advanced Computer Systems: Applications and Systems, Bagchi K, Zobrist G, (eds). Gordon and Breach Publishers: Newark, NJ, 1997; 193-236.
28. Bobbio A, Telek M,. Markov regenerative SPN with non-overlapping activity cycles. In Proceedings of the 1st Annual IEEE International Computer Performance & Dependability Symposium-IPDS'95, Erlangen, Germany, 1995; 124-133.
29. Choi H, Kulkarni VG, Trivedi KS,. Markov regenerative stochastic Petri nets. Performance Evaluation 1994; 20: 337-357.
30. Logothetis D, Trivedi K,. Time-dependent behavior of redundant systems with deterministic repair. In Computations with Markov Chains, Stewart WJ, (ed.). Kluwer Academic Publishers: Norwell, MA, 1995; 135-150.
31. Smotherman M, Zemoudeh K,. A non-homogeneous Markov model for phased-mission reliability analysis. IEEE Transactions on Reliability 1989; 38 (5): 585-590.
32. Smotherman MK, Geist RM,. Phased mission effectiveness using a nonhomogeneous Markov reward model. Reliability Engineering and System Safety 1990; 27 (2): 241-255.
33. German R, Lindemann C,. Analysis of stochastic Petri nets by the method of supplementary variables. Performance Evaluation 1994; 20 (1-3): 317-335.
34. German R,. Transient analysis of deterministic and stochastic Petri nets by the method of supplementary variables. Proceedings of the 3rd International Workshop on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems Conference-MASCOTS'95, Durham, NC, 1995; 394-398.
35. Bobbio A, Kulkarni VG, Puliafito A, Telek M, Trivedi K,. Preemptive repeat identical transitions in Markov regenerative stochastic petri nets. Proceedings of the 6th International Workshop on Petri Nets and Performance Models-PNPM'95, Durham, NC, USA, 1995; 113-122.
36. Garg S, Puliafito A, Telek M, Trivedi K,. Analysis of preventive maintenance in transactions based software systems. Computers, IEEE Transactions on 1998; 47 (1): 96-107. DOI: 10.1109/12.656092. URL: http://ieeexplore.ieee. org/stamp/stamp.jsp?tp=&arnumber=656092&isnumber=14275
37. Logothetis D, Trivedi K,. Dependability evaluation of the double counter-rotating ring with concentrator attachments. ACM/IEEE Transactions on Networks 1994; 2 (5): 520-532.
38. Logothetis D, Trivedi K,. The effect of detection and restoration times for error recovery in communication networks. Journal of Network and Systems Management 1997; 5 (2): 173-195.
39. Telek M,. Some advanced reliability modeling techniques. Ph.D. Thesis, Technical University of Budapest, Departament of Telecomunications, Budapest, Hungary, 1994.
40. Telek M, Pfening A,. Performance analysis of Markov regenerative reward models. Performance Evaluation 1996; 27 & 28: 1-18.
41. Baccelli F, Trivedi KS,. Analysis of an M/G/2 standby redundant system. Performance 1983; 457-476.
42. Kalashnikov VV,. Mathematical Methods in Queueing Theory. Kluwer Academic Publishers: Dordrecht, The Netherlands, 1994.
43. Li H, Yang T,. Single-server retrial queue with server vacations and a finite number of input sources. European Journal of Operational Research 1995; 85 (1): 149-160.
44. Cao J,. Reliability analysis of M/G/1 queueing system with repairable service station of reliability series structure. Microelectronics and Reliability 1994; 34 (4): 721-725.
45. Chen Y-M, Fujisawa T, Osawa H,. Availability of the system with general repair time distributions and shut-off rules. Microelectronics and Reliability 1993; 33 (1): 13-19.
46. Dhillon BS, Anude OC,. Common-cause failure analysis of a non-identical unit parallel system with arbitrarily distributed repair times. Microelectronics and Reliability 1993; 33 (1): 87-103.
47. Dhillon BS, Anude OC,. Income optimization of repairable and redundant system. Microelectronics and Reliability 1994; 34 (11): 1709-1720.
48. Dhillon BS, Yang N,. Availability of a man-machine system with critical and non-critical human error. Microelectronics and Reliability 1993; 33 (10): 1511-1521.
49. Gopalan MN, Dinesh Kumar U,. On the transient behaviour of a repairable system with a warm standby. Microelectronics and Reliability 1996; 36 (4): 525-532.
50. Shao-Ming W, Ren H, De-Jun W,. Reliability analysis of a repairable system without being repaired "as good as new". Microelectronics and Reliability 1994; 34 (2): 357-360.
51. Singh C, Billinton R,. Reliability modelling in systems with non-exponential down time distributions. IEEE Transactions on Power Apparatus and Systems PAS-92 1973; 790-800.
52. German R,. New results for the analysis of deterministic and stochastic Petri nets. Proceedings of the IEEE International Computer Performance and Dependability Symposium-IPDS'95, Erlangen, Germany, 1995; 114-123.
53. German R, Kelling C, Zimmermann A, Hommel G,. TimeNET-a toolkit for evaluating non-Markovian stochastic Petri nets. Proceedings of the 6th International Workshop on Petri Nets and Performance Models-PNPM'95, Durham, NC, USA, 1995; 210-211.
54. Kelling C, German R, Zimmermann A, Hommel G,. TimeNET: Evaluation tool for non-Markovian stochastic Petri nets. Proceedings of the 1996 IEEE International Computer Performance & Dependability Symposium-IPDS'96, Urbana-Champaign, IL, USA, 1996; 62.
55. Lindemann C, Ciardo G, German R, Hommel G,. Performability modeling of an automated manufacturing system with deterministic and stochastic Petri nets. Proceedings of the IEEE International Conference on Robotics and Automation, Atlanta, GA, USA, 1993; 576-581.
56. Wolfram Research. Wolfram Mathematica® Website URL, June 2009.
57. Xie W,. Markov Regenerative Process In Sharpe, Durham, NC, USA, 1999.
58. Mainkar V, Trivedi K,. Approximate analysis of priority scheduling systems using stochastic reward nets. Proceedings of the 13th International Conference on Distributed Computing Systems-ICDCS'93, Pittsburgh, PA, USA, 1993; 466-473.
59. Nakagawa T, Osaki S,. Markov renewal processes with some non-regeneration points and their applications to reliability theory. Microelectronics Reliability 1976; 15 (6): 633-636.
60. Jin Q, Sugasawa Y, Seya K,. Probabilistic behavior and reliability analysis for a multi-robot system by applying petri net and markov renewal process theory. Microelectronics and Reliability 1989; 29 (6): 993-1001.
61. Limnios N, Oprisan G,. Semi-Markov Processes and Reliability, Statistics for Industry and Technology. Birkhäuser: Boston, MA, 2001.
62. Janssen J, Manca R,. Semi-Markov Risk Models for Finance, Insurance and Reliability. Springer Sciences + Business Media, LLC: New York, USA, 2007.
63. Barlow RE, Proschan F,. Mathematical Theory of Reliability, Classics in Applied Mathematics. Wiley: New York, NY, 1965.
64. Lisnianski A, Levitin G,. Multi-State System Reliability-Assessment, Optimization and Applications. Series On Quality, Reliability And Engineering Statistics Vol. 6. World Scientific Publishing Co: Singapore, 2003.
65. Csenki A,. On the interval reliability of systems modelled by finite semi-markov processes. Microelectronics Reliability 1994; 34 (8): 1319-1335.
66. Csenki A,. Joint interval reliability for markov systems with an application in transmission line reliability. Reliability Engineering and System Safety 2007; 92 (6): 685-696.
67. Yin L, Fricks R, Trivedi K,. Application of semi-markov process and ctmc to evaluation of ups system availability. Reliability and Maintainability Symposium, 2002. Proceedings Annual, 2002; 584-591.
68. Pievatolo A, Tironi E, Valade I,. Semi-markov processes for power system reliability assessment with application to uninterruptible power supply. IEEE Transactions on Power Systems 2004; 19 (3): 1326-1333.
69. Grabski F,. The reliability of an object with semi-Markov failure rate. Applied Mathematics and Computation 2003; 135 (1): 1-16.
70. das Chagas Moura M, Droguett EL,. Mathematical formulation and numerical treatment based on transition frequency densities and quadrature methods for non-homogeneous semi-markov processes. Reliability Engineering and System Safety 2009; 94 (2): 342-349.
71. Droguett EL,. A semi-markov model with bayesian belief network based human error probability for availability assessment of downhole optical monitoring systems. Simulation Modelling Practice and Theory 2008; 16 (10): 1713-1727, the Analysis of Complex Systems.
72. Pérez-Ocõn R, Castro JER,. Two models for a repairable two-system with phase-type sojourn time distributions. Reliability Engineering and System Safety 2004; 84 (3): 253-260.
73. Montoro-Cazorla D, Pérez-Ocõn R,. A deteriorating two-system with two repair modes and sojourn times phase-type distributed. Reliability Engineering and System Safety 2006; 91 (1): 1-9.
74. Ruiz-Castro JE, Pérez-Ocõn R, Fernández-Villodre G,. Modelling a reliability system governed by discrete phase-type distributions. Reliability Engineering and System Safety 2008; 93 (11): 1650-1657.
75. Fricks R, Yin L, Trivedi K,. Application of semi-markov process and CTMC to evaluation of UPS system availability. RAMS'2002, 2002; 584-591.
76. Perman M, Senegacnik A, Tuma M,. Semi-Markov models with an application to power-plant reliability analysis. IEEE Transactions on Reliability 1997; 46 (4): 526-532.
77. Wereley N, Walker B,. Approximate semi-Markov chain reliability models. 27th IEEE Conference on Decision and Control, Vol. 3, 1988; 2322-2329.
78. Vaidyanathan K, Selvamuthu D, Trivedi KS,. Analysis of inspection-based preventive maintenance in operational software systems. In Proceedings of the 21st IEEE Symposium on Reliable Distributed Systems (SRDS '02). IEEE Computer Society: Washington, DC, USA, 2002; 286-295.
79. Koutras VP, Platis AN,. Semi-markov availability modeling of a redundant system with partial and full rejuvenation actions. Dependability of Computer Systems, International Conference on 2008; 0: 127-134.
80. Xie W, Sun H, Cao Y, Trivedi KS,. Modeling of user perceived webserver availability. Proceedings of the IEEE International Conference on Communications, 2003.
81. Mura I, Bondavalli A,. Markov regenerative stochastic petri nets to model and evaluate phased mission systems dependability. IEEE Transactions on Computers 2001; 50 (12): 1337-1351.
82. chang Mo Y, Siewiorek D, zong Yang X,. Mission reliability analysis of fault-tolerant multiple-phased systems. Reliability Engineering and System Safety 2008; 93 (7): 1036-1046, bayesian Networks in Dependability.
83. Papazoglou IA,. Semi-markovian reliability models for systems with testable components and general test/outage times. Reliability Engineering and System Safety 2000; 68 (2): 121-133.
84. Faria JA, Matos MA,. An analytical methodology for the dependability evaluation of non-markovian systems with multiple components. Reliability Engineering and System Safety 2001; 74 (2): 193-210.
85. El-Gohary A,. Estimations of parameters in a three state reliability semi-markov model. Applied Mathematics and Computation 2004; 154 (2): 389-403.