Markov decision process applied to the control of hospital elective admissions

Artificial Intelligence in Medicine

Volumn 47, Issue 2, 2009, Pages 159-171

  Nunes, Luiz Guilherme Nadal ^a   de Carvalho, Solon Venâncio ^b   Rodrigues, Rita de Cássia Meneses ^b  

^a SARAH NETWORK OF REHABILITATION HOSPITALS   (Brazil)

^b INSTITUTO NACIONAL DE PESQUISAS ESPACIAIS   (Brazil)

Author keywords

Hospital admission control; Markov decision processes; Patient flow modeling

Indexed keywords

ADMISSION CONTROL; ADMISSION CONTROL POLICIES; COMPLEX MODEL; CUSTOMIZED SOLUTIONS; DECISION MODELS; HOSPITAL ADMISSION CONTROL; MARKOV DECISION PROCESSES; PATIENT FLOW MODELING; RELATIVE IMPORTANCE; RESOURCE CONSUMPTION; STOCHASTIC DYNAMICS; VALUE ITERATION ALGORITHM;

HOSPITALS; LEARNING ALGORITHMS; MARKOV PROCESSES; STOCHASTIC MODELS;

PROCESS CONTROL;

ALGORITHM; ARTICLE; EMERGENCY CARE; HEALTH CARE COST; HEALTH CARE DELIVERY; HEALTH CARE PLANNING; HEALTH CARE POLICY; HIDDEN MARKOV MODEL; HOSPITAL ADMISSION; HOSPITAL CARE; HOSPITAL MANAGEMENT; HOSPITAL UTILIZATION; HUMAN; MEDICAL DECISION MAKING; PRIORITY JOURNAL; RESOURCE MANAGEMENT; STOCHASTIC MODEL;

ALGORITHMS; HOSPITALIZATION; MARKOV CHAINS; PATIENT ADMISSION; STOCHASTIC PROCESSES;

EID: 69949094173     PISSN: 09333657     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artmed.2009.07.003     Document Type: Article

References (22)

1. Kusters R., and Groot P. Modelling resource availability in general hospitals design and implementation of a decision support model. European Journal of Operational Research 88 (1996) 428-445
2. Adan I., and Vissers J. Patient mix optimization in hospital admission planning: a case study. International Journal of Operations and Production Management 22 (2002) 445-461
3. Gemmel P., and Van Dierdonck R. Admission scheduling in acute care hospitals: does the practice fit with the theory. International Journal of Operations and Production Management 19 (1999) 863-878
4. Groot P. Decision support for admission planning under multiple resource constraints (1993), Febo, Enschede
5. Roth A., and Van Dierdonck R. Hospital resource planning: concepts, feasibility, and framework. Production and Operations Management 4 (1995) 2-29
6. Kapadia A., Chan W., and Sachdeva R. Predicting duration of stay in a pediatric intensive care unit: a Markovian approach. European Journal of Operational Research 124 (2000) 353-359
7. Kapadia A., Vineberg S., and Rossi D. Predicting course of treatment in a rehabilitation hospital: a Markovian model. Computers & Operations Research 12 (1985) 459-469
8. Puterman M. Markov decision processes: discrete stochastic dynamic programming (2005), John Wiley & Sons, New York
9. Smallwood R., Murray G., Silva D., Sondik E., and Klainer L. A medical service requirements model for health system design. Proceedings of the IEEE 57 (1969) 1880-1887
10. Kao E. A semi-Markovian population model with application to hospital planning. IEEE Transactions on Systems, Man, and Cybernetics 4 (1973) 327-336
11. Hershey J., Weiss E., and Cohen M. A stochastic service network model with application to hospital facilities. Operations Research 29 (1981) 1-22
12. Côté M., and Stein W. An Erlang-based stochastic model for patient flow. Omega 28 (2000) 347-359
13. Navarro V. A systems approach to health planning. Health Services Research 4 (1969) 96-111
14. Hincapié D., Ospina J., Grisales H., Arroyave M., Valencia M., and González G. Análisis markoviano de un proceso de estancia hospitalaria en un hospital de tercer nivel de complejidad. Revista Facultad Nacional de Salud Pública 22 (2004) 61-71
15. Weiss E., Cohen M., and Hershey J. An iterative estimation and validation procedure for specification of semi-Markov models with application to hospital patient flow. Operations Research 30 (1982) 1082-1104
16. Fetter R., and Thompson J. A decision model for design and operation of a progressive patient care hospital. Medical Care 7 (1969) 450-462
17. Kao E. Modeling the movement of coronary patients within a hospital semi-Markov process. Operations Research 22 (1981) 683-699
18. Kao E. A semi-Markov model to predict recovery of coronary patients. Health Services Research 7 (1972) 191-208
19. Thomas W. A model for predicting recovery progress of coronary patients. Health Services Research 3 (1968) 185-213
20. Chang H., Fu M., and Marcus S. Simulation-based algorithms for Markov decision processes (2007), Springer, New York
21. Cao X.-R., Bhatnagar S., Fu M., and Marcus S. A time aggregation approach to Markov decision processes. Automatica 38 (2002) 929-943
22. In: Kogan J., Nicholas C., and Teboulle M. (Eds). Grouping multidimensional data: recent advances in clustering (2006), Springer, New York