Simulation and validation of a reinforcement learning agent-based model for multi-stakeholder forest management

Computers, Environment and Urban Systems

Volumn 34, Issue 2, 2010, Pages 162-174

  Bone, Christopher ^a   Dragićević, Suzana ^a  

^a SIMON FRASER UNIVERSITY   (Canada)

Author keywords

Agent based modeling; Forest management; Optimization; Reinforcement learning

Indexed keywords

AGENT BEHAVIOR; AGENT-BASED MODEL; AGENT-BASED MODELING; FOREST AREA; FOREST COMPANIES; FOREST HARVESTING; FOREST MANAGEMENT; LEARNING FUNCTIONS; MULTI-STAKEHOLDER; MULTIPLE STAKEHOLDERS; NON-LINEAR RELATIONSHIPS; OPTIMAL SOLUTIONS; OPTIMIZATION PROCEDURES; REINFORCEMENT LEARNING AGENT; SIMULATION AND VALIDATION; SIMULATION MODEL; SPATIAL OPTIMIZATION; SYSTEM CONSTRAINTS;

FORESTRY; HARVESTING; MATHEMATICAL MODELS; OPTIMIZATION; PROFITABILITY; REINFORCEMENT; REINFORCEMENT LEARNING;

LEARNING ALGORITHMS;

ALGORITHM; FOREST MANAGEMENT; LEARNING; OPTIMIZATION; RESEARCH WORK; SIMULATION; STAKEHOLDER;

ALGORITHMS; FOREST MANAGEMENT; FORESTRY; HARVESTING; MATHEMATICAL MODELS; MODELS; OPTIMIZATION; PROFITABILITY; REINFORCEMENT;

EID: 77949568581     PISSN: 01989715     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compenvurbsys.2009.10.001     Document Type: Article

References (49)

1. Acosta-Michlik L., Espaldon V. Assessing vulnerability of selected farming communities in the Philippines based on a behavioural model of agent's adaptation to global environmental change. Global Environmental Change-Human and Policy Dimensions 2008, 18:554-563.
2. Bakker M.M., van Doorn A.M. Farmer-specific relationships between land use change and landscape factors: Introducing agents in empirical land use modelling. Land Use Policy 2009, 26:809-817.
3. Barto A.G., Sutton R.S., Brouwer P.S. Associate search network: A reinforcement learning associative memory. Biological Cybernetics 1981, 40:201-211.
4. Baskent E.Z., Jordon G.A. Forest landscape management modeling using simulated annealing. Forest Ecology and Management 2002, 165:29-45.
5. Baskent E.Z., Keles S. Spatial forest planning: A review. Ecological Modelling 2005, 188:145-173.
6. Batty M. Agent-based pedestrian modeling. Environment and Planning B - Planning and Design 2001, 28:321-326.
7. Batty M., Torrens P. Modelling and prediction in a complex world. Futures 2005, 37:745-766.
8. Bennett D.A., Tang W. Modeling adaptive, spatially aware, and mobile agents: Elk migration in Yellowstone. International Journal of Geographical Information Science 2006, 20:1039-1066.
9. Bettinger P., Johnson D., Johnson K.N. Spatial forest plan development with ecological and economic goals. Ecological Modelling 2003, 169:215-236.
10. Bithell M., Brasington J. Coupling agent-based models of subsistence farming with individual-based forest models and dynamic models of water distribution. Environmental Modelling and Software 2009, 24:173-190.
11. Brown D.G., Aspinall R., Bennett D.A. Landscape models and explanations in landscape ecology - A space for generative landscape science?. The Professional Geographer 2006, 58:467-484.
12. Brown D.G., Page S., Riolo R., Rand W. Agent-based and analytical modeling to evaluate the effectiveness of greenbelts. Environmental Modelling and Software 2004, 19:1097-1109.
13. Brown D.G., Robinson D.T., An L., Nassauer J.I., Zellner M., Rand W., et al. Exurbia from the bottom-up: Confronting empirical challenges to characterizing a complex system. Geoforum 2008, 39:805-818.
14. Caro F., Constantino M., Martins M., Weintraub A. A 2-opt tabu search procedure for the multi-period forest harvesting problem with adjacency, green-up, old growth, and even flow constraints. Forest Science 2003, 49:738-751.
15. Castella J.C., Boissau S., Trung T.N., Quang D.D. Agrarian transition and lowland-upland interactions in mountain areas in northern Vietnam: Application of a multi-agent simulation model. Agricultural Systems 2005, 86:312-332.
16. Cerda J.P., Mitchell S.J. Using geographic information systems to investigate uncertainty in forest planning outcomes. The Forestry Chronicle 2004, 80:262-270.
17. Deadman P., Robinson D., Moran E., Brondizio E. Colonist household decision making and land-use change in the Amazon Rainforest: An agent-based simulation. Environment and Planning B - Planning and Design 2004, 31:693-709.
18. Ducheyne E.I., De Wulf R.R., De Baets B. A spatial approach to forest-management optimization: Linking GIS and multiple objective genetic algorithms. International Journal of Geographical Information Science 2006, 20:917-928.
19. Evans T., Kelley H. Assessing the transition from deforestation to forest regrowth with an agent-based model of land cover change for south-central Indiana (USA). Geoforum 2008, 39:819-832.
20. Government of British Columbia, (2007). Coast Log Market Reports. May 30, 2007. http://www.for.gov.bc.ca.
21. Guzy M.R., Smith C.L., Bolte J.P., Hulse D.W., Gregory S.V. Policy research using agent-based modeling to assess future impacts of urban expansion into farmlands and forests. Ecology and Society 2008, 13.
22. Hartig F., Drechsler M. Smart spatial incentives for market-based conservation. Biological Conservation 2009, 142:779-788.
23. Janssen M.A., Walker B.H., Langridge J., Abel N. An adaptive agent model for analysing co-evolution of management and policies in a complex rangeland system. Ecological Modelling 2000, 131:249-268.
24. Kangas J., Store R., Kangas A. Socioecological landscape planning approach and multicriteria acceptability analysis in multiple-purpose forest management. Forest Policy and Economics 2005, 7:603-614.
25. Li Y., Brimicombe A.J., Li C. Agent-based services for the validation and calibration of multi-agent models. Computers, Environment and Urban Systems 2008, 32:464-473.
26. Li X., He J.Q., Liu X.P. Intelligent GIS for solving high-dimensional site selection problems using ant colony optimization techniques. International Journal of Geographical Information Science 2009, 23:399-416.
27. Li X., Liu X.P. Defining agents' behaviors to simulate complex residential development using multicriteria evaluation. Journal of Environmental Management 2007, 85:1063-1075.
28. Li X., Liu X.P. Embedding sustainable development strategies in agent-based models for use as a planning tool. International Journal of Geographical Information Science 2008, 22:21-45.
29. Manson S. Land use in the southern Yucatan peninsular region of Mexico: Scenarios of population and institutional change. Computers, Environment and Urban Systems 2006, 30:230-253.
30. Manson S.M. Bounded rationality in agent-based models: Experiments with evolutionary programs. International Journal of Geographical Information Science 2006, 20:991-1012.
31. Maoh H., Kanaroglou P. Business establishment mobility behavior in urban areas: A microanalytical model for the City of Hamilton in Ontario, Canada. Journal of Geographical Systems 2007, 9:229-252.
32. Millington J., Romero-Calcerrada R., Wainwright J., Perry G. An agent-based model of Mediterranean agricultural land-use/cover change for examining wildfire risk. Jasss - The Journal of Artificial Societies and Social Simulation 2008, 11.
33. Nelson J. Forest level planning and challenges for their successful implementation. Canadian Journal of Forest Research 2003, 33:422-429.
34. Ohman K., Lamas T. Clustering of harvest activities in multi-objective long-term forest planning. Forest Ecology and Management 2003, 176:161-171.
35. Parker D.C., Manson S.M., Janssen M.A., Hoffmann M.J., Deadman P. Multi-agent systems for the simulation of land-use and land-cover change: A review. Annals of the Association of American Geographers 2003, 93:314-337.
36. Pederson L. Fraser timber supply area 2004, British Columbia Ministry of Forests, Victoria, pp. 70.
37. Purnomo H., Guizol P. Simulating forest plantation co-management with a multi-agent system. Mathematical and Computer Modelling 2006, 44:535-552.
38. Purnomo H., Mendoza G.A., Prabhu R., Yasmi Y. Developing multi-stakeholder forest management scenarios: A multi-agent system simulation approach applied in Indonesia. Forest Policy and Economics 2005, 7:475-791.
39. Richards E.W., Gunn E.A. Tabu search design for difficult forest management optimization problems. Canadian Journal of Forest Research 2003, 33:1126-1133.
40. Sengupta R., Lant C., Kraft S., Beaulieu J., Peterson W., Loftus T. Modeling enrollment in the conservation reserve program by using agents within spatial decision support systems: An example from southern Illinois. Environment and Planning B-Planning and Design 2005, 32:821-834.
41. Shao G., Wang H., Dia L., Wu G., Li Y., Lang R., et al. Integrating stand and landscape decisions for multi-purposes of forest harvesting. Forest Ecology and Management 2005, 207:233-243.
42. Smajgl A., Morris S., Heckbert S. Water policy impact assessment - Combining modelling techniques in the Great Barrier Reef region. Water Policy 2009, 11:191-202.
43. Sutton R.S. Learning to predict by the methods of temporal differences. Machine Learning 1988, 3:9-44.
44. Venema H.D., Calamai P.H., Fieguth P. Forest optimization using evolutionary programming and landscape ecology metrics. European Journal of Operational Research 2005, 164:423-439.
45. Xiao N., Bennet D.A., Armstrong M.P. Interactive evolutionary approaches to multiobjective spatial decision making: A synthetic review. Computers, Environment, and Urban Systems 2007, 31:232-252.
46. Xie Y.C., Batty M., Zhao K. Simulating emergent urban form using agent-based modeling: Desakota in the Suzhou-Wuxian region in China. Annals of the Association of American Geographers 2007, 97:477-495.
47. Yin L., Muller B. Residential location and the biophysical environment: Excurban development agents in a heterogeneous landscape. Environment and Planning B-Planning and Design 2007, 34:279-295.
48. Zellner M.L., Page S.E., Rand W., Brown D.G., Robinson D.T., Nassauer J., et al. The emergence of zoning policy games in exurban jurisdictions: Informing collective action theory. Land Use Policy 2009, 26:356-367.
49. Zellner M.L., Theis T.L., Karunanithi A.T., Garmestani A.S., Cabezas H. A new framework for urban sustainability assessments: Linking complexity, information and policy. Computers Environment and Urban Systems 2008, 32:474-488.