Discrete Time Reward Models for Homogeneous Semi-Markov Systems

Communications in Statistics - Theory and Methods

Volumn 33, Issue 3, 2004, Pages 623-638

  McClean, Sally ^a   Papadopoulou, Aleka A ^b   Tsaklidis, George ^c  

^a UNIVERSITY OF ULSTER   (United Kingdom)

^b ALEXANDER TECHNOLOGICAL EDUCATIONAL INSTITUTE OF THESSALONIKI   (Greece)

^c ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Homogeneity; Poisson recruitment; Rewards; Semi Markov process; Stochastic population model

Indexed keywords

DECISION MAKING; MARKOV PROCESSES; MATHEMATICAL MODELS; STATISTICAL METHODS;

HOMOGENEITY; POISSON RECRUITMENT; REWARDS; SEMI MARKOV PROCESS; STOCHASTIC POPULATION MODEL;

INFORMATION MANAGEMENT;

EID: 1642325530     PISSN: 03610926     EISSN: None     Source Type: Journal    
DOI: 10.1081/STA-120028688     Document Type: Article

References (17)

1. Bartholomew, D. J. (1986). Stochastic Models for Social Processes. Chichester: Wiley.
2. Bartholomew, D. J., Forbers, A. F., McClean, S. I. (1991). Statistical Teqniques for Manpower Planning. Chichester: Wiley.
3. Howard, R. A. (1971). Dynamic Probabilistic Systems. Chichester: Wiley.
4. Kao, EPC. (1974). Modeling the movements of corronary patients within hospital by Semi-Markov processes. Operations Res. 22:683-699.
5. McClean, S. I. (1976). A continuous time population model with poisson recruitment. J. Appl. Prob. 13:348-354.
6. McClean, S. I. (1980). A semi Markovian model for a multigrade population. J. Appl. Prob. 17:846-852.
7. McClean, S., Millard, P. (1998). A three compartmental model of the patient flows in a geriatric department: A decision support approach. Health care Manag. Sci. 1:159-163.
8. McClean, S., McAlea, B., Millard, P. (1998). Using a Markov reward model to estimate spend-down costs for a geriatric department. J. Operational Res. Soc. 10:1021-1025.
9. Papadopoulou, A. A. (1998). Counting transitions-entrance probabilities in non homogeneous semi-Markov systems. Applied Stoch Models Data Anal. 13:199-206.
10. Papadopoulou, A. A. (2001). Rewards in non homogeneous semiMarkov systems in discrete time. In: Applied Stoch Models Data Analysis. Vol. 2. France: Technical University of Compiegne, pp. 819-824.
11. Papadopoulou, A. A., Vassiliou, P.-C. G. (1994). Asymptotic behavior of non homogeneous semi-Markov systems. Linear Algebra Appl. 210:153-198.
12. Pyke, R. (1961a). Markov renewal processes: Definitions and preliminary properties. Ann. Math. Statist. 32:1231-1242.
13. Pyke, R. (1961b). Markov renewal processes with finitely many states. Ann. Math. Statist. 32:1243-1259.
14. Taylor, G. J., McClean, S. I., Millard, P. H. (1998). Using a continuous time Markov model with Poisson arrivals to describe movements on geriatric patients. Journal of Applied Stochastic Models and Data Analysis 14:165-174.
15. Taylor, G. J., McClean, S. I., Millard, P. H. (2000). Stochastic models of geriatric patient bed occupancy behaviour. J. R. Statist. Soc. 163(1):39-48.
16. Vassiliou, P.-C. G., Papadopoulou, A. A. (1992). Non homogeneous semi-Markov systems and maintainability of the state sizes. J. Appl. Prob. 29:519-534.
17. Vassiliou, P.-C. G., Georgiou, A., Tsantas, N. (1990). Control of asymptotic variability in non homogeneous Markov systems. J. Appl. Prob. 27:756-766.