Approximate solutions to semi Markov decision processes through Markov Chain Montecarlo methods

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2809, Issue , 2004, Pages 151-162

  Moreno Díaz, Arminda ^a   Virto, Miguel A ^a   Martín, Jacinto ^b   Ríos Insua, David ^c  

^a UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^b UNIVERSITY OF EXTREMADURA   (Spain)

^c UNIVERSIDAD REY JUAN CARLOS   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

CHAINS; EMBEDDED SYSTEMS; INTELLIGENT SYSTEMS; MONTE CARLO METHODS; PREVENTIVE MAINTENANCE; SYSTEM THEORY;

ANALYSIS FRAMEWORKS; APPLICATION AREA; APPROXIMATE SOLUTION; MARKOV CHAIN MONTE CARLO SIMULATION; MARKOV CHAIN MONTE-CARLO; SEMI-MARKOV DECISION PROCESS; SEQUENTIAL DECISION PROCESS;

MARKOV PROCESSES;

EID: 0242371086     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: None     Document Type: Article

References (13)

1. Bielza, C., Müller, P., Ríos-Insua, D.: Decision Analysis by augmented probability simulation. Management Science, 45 (1999) 1552-1569.
2. Chib, S., Greenberg, E.: Understanding the Metropolis Hastings Algorithm. The American Statistician, 49, 4 (1995) 327-335.
3. Cho, D.I. and Parlar, M.: A Survey of Maintenance Models for Multi-units Systems. European Journal of Operational Research, 51 (1991) 1-23.
4. de Freitas, N., Hojen-Sorensen, P., Jordan, M.I. and Russell, S.: Variational MCMC. In J. Breese and D. Koller (Ed.). Uncertainty in Artificial Intelligence, Proceedings of the Seventeenth Conference (2001)
5. Dekker, R., Van der Duyn Schouten, P. and Wildeman, R.: A Review of Multi-Component Maintenance Models with Economic Dependence. Mathematical Methods of Operations Research, 45 (1997) 411-435.
6. French, S., Ríos Insua D.: Statistical Decision Theory, Arnold (2000)
7. Gamerman, D.: Markov Chain Monte Carlo: stochastic simulation for Bayesian inference. Chapman & Hall (1997)
8. Hastings, W.K.: Monte Carlo Sampling Methods Using Markov Chains and its Applications. Biometrika, 57 (1970) 97-109.
9. Puterman, M. L.: Markov Decision Processes, In Handbooks in OR & MS, Vol. 2. Elsevier (1990)
10. Shaked, M., Shantikumar, J. G.: Reliability and Maintainability, In Handbooks in OR & MS Vol.2. Elsevier (1990)
11. Virto, M.A.: Métodos Montecarlo en Análisis de Decisiones. PhD. Thesis. Universidad Nacional de Educación a Distancia. Madrid (2002)
12. Virto, M.A., Martín, J., Ríos Insua, D. and Moreno-Díaz, A.: Approximate Solutions of Complex Influence Diagrams through MCMC Methods. In Proceeedings of First European Workshop on Probabilistic Graphical Models. Gámez and Salmerón (Eds.) (2002) 169-175.
13. Virto, M.A., Martín, J., Ríos Insua, D. and Moreno-Díaz, A.: A Method for Sequential Optimization in Bayesian Analysis. Bayesian Statistics, 7 (J.M. Bernardo, M.J. Bayarri, J.O. Berger, A.P. Dawid, D. Heckerman A.F.M Smith and M. West eds.) Oxford University Press (2003) 701-710.