A framework and a mean-field algorithm for the local control of spatial processes

International Journal of Approximate Reasoning

Volumn 53, Issue 1, 2012, Pages 66-86

  Sabbadin, Régis ^a   Peyrard, Nathalie ^a   Forsell, Nicklas ^a,b  

^a Centre de Toulouse   (France)

^b PSL RESEARCH UNIVERSITY   (France)

Author keywords

Approximate linear programming; Approximate policy iteration; Decision theoretic planning; Factored Markov decision processes; Mean field principle

Indexed keywords

APPROXIMATE LINEAR PROGRAMMING; DECISION-THEORETIC; FACTORED MARKOV DECISION PROCESS; MEAN-FIELD; POLICY ITERATION;

LEARNING ALGORITHMS; LINEAR PROGRAMMING; MARKOV PROCESSES;

GRAPH THEORY;

EID: 81155137694     PISSN: 0888613X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijar.2011.09.007     Document Type: Article

References (24)

1. M.L. Puterman Markov Decision Processes 1994 John Wiley and Sons New York pp
2. C. Boutilier, R. Dearden, and M. Goldszmidt Stochastic dynamic programming with factored representations Artificial Intelligence 121 1 2000 49 107
3. J. Hoey, R. St-Aubin, A. Hu, C. Boutilier, SPUDD: Stochastic planning using decision diagrams, in: Proceedings of UAI'99, Stockholm, Sweden, 1999.
4. R. St-Aubin, J. Hoey, A. Hu, C. Boutilier, APRICODD: Approximate policy construction using decision diagrams, in: Proceedings of NIPS'00, Denver, CO, 2000.
5. C. Guestrin, D. Koller, R. Parr, and S. Venkataraman Efficient solution algorithms for factored MDPs Journal of Artificial Intelligence Research 19 2003 399 468 (Pubitemid 41525926)
6. D.-P. de Farias, and B. Van Roy The linear programming approach to approximate dynamic programming Operations Research 51 6 2003 850 865
7. D.P. Bertsekas, and J.N. Tsitsiklis Neuro-Dynamic Programming 1996 Massachussetts Athena Scientific, Belmont
8. M. Opper, and D. Saad Advanced Mean-Field Methods: Theory and Practice 2001 Massachussetts Institute of Technology
9. N. Forsell, R. Sabbadin, Approximate linear-programming algorithms for graph-based Markov decision processes, in: Proceedings of ECAI06, Riva Del Garda, Italy, 2006, pp. 590-594.
10. N.L. Zhang, R. Qi, and D. Poole A computational theory of decision networks International Journal of Approximate Reasoning 11 2 1994 83 158
11. R.K. Chornei, H. Daduna, and P.S. Knopov Control of Spatially Structured Random Processes and Random Fields with Applications 2006 Springer
12. N. Peyrard, R. Sabbadin, E. Lô-Pelzer, J.N. Aubertot, A graph-based Markov decision process framework for optimising integrated management of diseases in agriculture, in: Proceedings of MODSIM'07, Christchurch, New-Zealand, 2007, pp. 2175-2181.
13. N. Forsell, L.O. Eriksson, F. Garcia, R. Sabbadin, P. Wikström, Management of the risk of wind damage in forestry: a graph-based markov decision process approach, Annals of Operations Research, Published online: 09 February 2009, 2009.
14. N. Peyrard, R. Sabbadin, Mean field approximation of the policy iteration algorithm for graph-based Markov decision processes, in: Proceedings of ECAI06, Riva Del Garda, Italy, 2006, pp. 595-599.
15. E. Altman Constrained Markov Decision Processes 1999 Chapman & Hall/CRC
16. Y. Xiang, and F. Hanshar Comparison of tightly and loosely coupled decision paradigms in multiagent expedition International Journal of Approximate Reasoning 51 2010 600 613
17. D.P. de Farias, and B. Van Roy On constraint sampling in the linear programming approach to approximate dynamic programming Mathematics of Operations Research 29 3 2004 462 478
18. B. Kveton, M. Hauskrecht, and C. Guestrin Solving factored MDPs with hybrid state and action variables Journal of Artificial Intelligence Research 27 2006 153 201 (Pubitemid 44681376)
19. P. Poupart, C. Boutilier, R. Patrascu, D. Schuurmans, Piecewise linear value function approximation for factored MDPs, in: Proceedings of AAAI'02, 2002, pp. 292-299.
20. C. Guestrin, D. Koller, R. Parr, Multiagent planning with factored MDPs, in: Proceedings of NIPS'01, 2001, pp. 1523-1530.
21. R.J. Williams, L.C.I. Baird, Tight performance bounds on greedy policies based on imperfect value functions, Technical report, College of Computer Science, Northeastern University, Boston, MA, 1993.
22. K. Blennow, and O. Sallnäs Winda - a system of models for assessing the probability of wind damage to forest stands within a landscape Ecologival Modelling 175 2004 87 99 (Pubitemid 38531878)
23. M.A. Finney, Modeling the spread and behavior of prescribed natural fires, in: Proceedings of the 12th Conference on Fire and Forest Meterology, 1994, pp. 138-143.
24. N. Forsell, F. Garcia, R. Sabbadin, Reinforcement learning for spatial processes, in: R.S. Anderssen, R.D. Braddock, L.T.H. Newham (Eds.), Proceedings of MODSIM'09, July 2009, pp. 755-761.