MOMDPs: A solution for modelling adaptive management problems

Proceedings of the National Conference on Artificial Intelligence

Volumn 1, Issue , 2012, Pages 267-273

  Chadès, Iadine ^a   Carwardine, Josie ^a   Martin, Tara G ^a   Nicol, Samuel ^b   Sabbadin, Régis ^c   Buffet, Olivier ^d  

^a CSIRO   (Australia)

^b UNIVERSITY OF ALASKA FAIRBANKS   (United States)

^c INRA   (France)

^d UNIVERSITÉ DE LORRAINE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE MANAGEMENT; BIRD SPECIES; CONSERVATION BIOLOGY; ENDANGERED SPECIES; GLOBAL CHANGE; ITERATIVE PROCESS; NATURAL RESOURCE MANAGEMENT; NORTHERN AUSTRALIA; SOLUTION METHODS; SYSTEM DYNAMICS; SYSTEM STATE; VALUE FUNCTIONS; VALUE ITERATION;

ALGORITHMS; CONSERVATION; COPYRIGHTS; ITERATIVE METHODS; NATURAL RESOURCES MANAGEMENT;

PROBLEM SOLVING;

EID: 84868297168     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Araya-López, M.; Thomas, V.; Buffet, O.; and Charpillet, F. 2010. A clo7ser look at MOMDPs. In Proc. of the 22nd Int. Conf. on Tools with Artificial Intelligence.
2. Bellman, R. E. 1957. Dynamic Programming. Princeton, N.J.: Princeton University Press.
3. Bonet, B. 2002. An e-optimal grid-based algorithm for partially observable Markov decision processes. In Proc. of the 19th Int. Conf. on Machine Learning (ICML-02).
4. Boutilier, C., and Poole, D. 1996. Computing optimal policies for partially observable decision processes using compact representations. In Proc. of the Nat. Conf. on Artificial Intelligence.
5. Brafman, R. 1997. A heuristic variable grid solution method for POMDPs. In Proc. of the Nat. Conf. on Artificial Intelligence.
6. Cassandra, A. R. 1998. Exact and Approximate Algorithms for Partially Observable Markov Decision Processes. Ph.D. Dissertation, Brown University, Dept. of Computer Science.
7. Chadès, I.; McDonald-Madden, E.; McCarthy, M. A.; Wintle, B.; Linkie, M.; and Possingham, H. P. 2008. When to stop managing or surveying cryptic threatened species. PNAS 105:13936-13940.
8. Chadès, L; Martin, T. G.; Nicol, S.; Burgman, M. A.; Possingham, H. P.; and Buckley, Y. M. 2011. General rules for managing and surveying networks of pests, diseases, and endangered species. PNAS 108(20):8323-8328.
9. Conitzer, V., and Sandholm, T. 2003. Definition and complexity of some basic metareasoning problems. In Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI-03), 1099-1106.
10. Keith, D. A.; Martin, T. G.; McDonald-Madden, E.; and Walters, C. 2011. Uncertainty and adaptive management for biodiversity conservation. Biological Conservation 144(4): 1175-1178.
11. Lovejoy, W. 1991. Computationally feasible bounds for partially observed Markov decision processes. Operations research 39(1):162-175.
12. Madani, O.; Hanks, S.; and Condon, A. 2003. On the undecidability of probabilistic planning and related stochastic optimization problems. Artificial Intelligence 147(1-2):5-34.
13. Ong, S. C. W; Png, S. W; Hsu, D.; and Lee, W. S. 2010. Planning under uncertainty for robotic tasks with mixed observability. The International Journal of Robotics Research 29(8):1053-1068.
14. Papadimitriou, C. H., and Tsitsiklis, J. N. 1987. The complexity of Markov decision processes. Journal of Mathematics of Operations Research 12(3):441-450.
15. Pineau, J.; Gordon, G.; and Thrun, S. 2003. Point-based value iteration: An anytime algorithm for POMDPs. In Proc. of the Int. Joint Conf. on Artificial Intelligence.
16. Poupart, P.; Vlassis, N.; Hoey, J.; and Regan, K. 2006. An analytic solution to discrete Bayesian reinforcement learning. In Proc. of the 23rd Int. Conf. on Machine Learning.
17. Poupart, P. 2005. Exploiting Structure to Efficiently Solve Large Scale Partially Observable Markov Decision Processes. Ph.D. Dissertation, University of Toronto.
18. Sondik, E. 1971. The Optimal Control of Partially Observable Markov Decision Processes. Ph.D. Dissertation, Stanford University, California.
19. Spaan, M., and Vlassis, N. 2005. Perseus: Randomized point-based value iteration for POMDPs. Journal of Artificial Intelligence Research 24:195-220.
20. Walters, C. J., and Hilborn, R. 1978. Ecological optimization and adaptive management. Annual Review of Ecology and Systematics 9:pp. 157-188.
21. Williams, B. 2009. Markov decision processes in natural resources management: Observability and uncertainty. Ecological Modelling 220(6):830-840.
22. Zhou, R., and Hansen, E. 2001. An improved grid-based approximation algorithm for POMDPs. In Proc. of the 17th Int. Joint Conf. on Artificial Intelligence.