Constructing model credibility in the context of policy appraisal

Environmental Modelling and Software

Volumn 26, Issue 3, 2011, Pages 258-265

  Aumann, Craig A ^a  

^a ALBERTA RESEARCH COUNCIL   (Canada)

Author keywords

Assessment; Complexity; Critique; Hierarchy theory; Simulation; Trust; Validation; Verification

Indexed keywords

ASSESSMENT; COMPLEXITY; CRITIQUE; HIERARCHY THEORY; SIMULATION; TRUST; VALIDATION;

ENVIRONMENTAL PROTECTION; RATING;

COMPUTER SIMULATION;

ASSESSMENT METHOD; COMPLEXITY; ENVIRONMENTAL POLICY; NUMERICAL MODEL; POLICY MAKING; PSYCHOLOGY; STAKEHOLDER;

EID: 78649825321     PISSN: 13648152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.envsoft.2009.09.006     Document Type: Article

References (58)

1. Anderson M.G., Bates P.D. Hydrological science: model credibility and scientific understanding. Model Validation: Perspectives in Hydrological Science 2001, 1-10. John Wiley & Sons, New York, (Chapter 1). M.G. Anderson, P.D. Bates (Eds.).
2. Aumann C.A. A methodology for developing simulation models of complex systems. Ecological Modelling 2007, 202:385-396.
3. Balci O. Principles of simulation model validation, verification, and testing. Transactions of the Society for Computer Simulation International 1997, 14(1):3-12.
4. Beach L.R., Connolly T. The Psychology of Decision Making 2005, Sage Publications, California, (Chapter 10), pp. 159-181.
5. Bergandi D., Blandin P. Holism vs reductionism: do ecosystem ecology and landscape ecology clarify the debate?. Acta Biotheoretica 1998, 46:185-206.
6. Blomqvist K. The many faces of trust. Scandinavian Journal of Management 1997, 13(3):271-286.
7. Brunner R.D. Policy and global change research. Climate Change 1996, 32:121-147.
8. Cartwright N. The Dappled World: A Study of the Boundaries of Science 1999, Cambridge University Press, Cambridge.
9. Couclelis H. "Where has the future gone?" Rethinking the role of integrated land-use models in spatial planning. Environment and Planning A 2005, 37:1353-1371.
10. Damper R.I. Editorial for the special issue on 'Emergent Properties of Complex Systems': emergence and levels of abstraction. International Journal of Systems Science 2000, 31(7):811-818.
11. Dewar, J., Bankes, S., Hodges, J., Lucas, T., Saunders-Newton, D., Vye, P., 1996. Credible uses of the distributed interactive simulation (DIS) environment. Tech. Rep. MR-603-A, RAND, Santa Monica, CA.
12. Doyle J.K., Ford D.N. Mental models: concepts for system dynamics research. System Dynamics Review 1998, 14(1):3-29.
13. Doyle J.K., Ford D.N., Radzicki M.J., Trees W.S. Mental models of dynamic systems. Encyclopedia of Life Support Systems (EOLSS) 2002, Eolss Publishers, Oxford, UK. http://www.eolss.net, Y. Barlas (Ed.).
14. Doyle J.K., Radzicki M.J., Trees W.S. Measuring change in mental models of complex dynamic systems. Complex Decision Making: Theory and Practice, Electronic Edition 2008, 269-293. Springer, Berlin, (Chapter 14). H. Qudrat-Ullah, J.M. Spector, P. Davidsen (Eds.).
15. Edwards P.N. Global comprehensive models in politics and policy making. Climate Change 1996, 32:149-161.
16. Feibleman J.K. Theory of integrative levels. The British Journal for the Philosophy of Science 1954, 5(17):59-66.
17. Giampietro M. Multi-scale Integrated Analysis of Agroecosystems 2004, CRC Press, New York.
18. Gov.Canada Integrated Landscape Management Models for Sustainable Development Policy Making 2005, http://www.policyresearch.gc.ca/doclib/ILMM_Workshop_Report_e.pdf.
19. Grimm V., Revilla E., Berger U., Jeltsch F., Mooij W.M., Railsback S.F., Thulke H., Weiner J., Wiegand T., DeAngelis D.L. Pattern-oriented modeling of agent-based complex systems: lessons from ecology. Science November 2005, 310(11):987-991.
20. Grosler A. System dynamics projects that failed to make an impact. System Dynamics Review 2007, 23(4):437-452.
21. Guston D.H. Boundary organizations in environmental policy and science: an introduction. Science, Technology, and Human Values 2001, 26:399-408.
22. Harries C. Correspondence to what? Coherence to what? What is good scenario-based decision making?. Technological Forecasting and Social Change 2003, 70:797-817.
23. Hector D., Christensen C., Petrie J. A problem-structuring method for complex societal decisions: its philosophical and psychological dimensions. European Journal of Operational Research 2009, 193:693-708.
24. Hunt J., Shackley S. Reconceiving science and policy: academic, fiducial and beureaucratic knowledge. Minerva 1999, 37:141-164.
25. Jakeman A.J., Letcher R.A., Norton J. Ten iterative steps in development and evaluation of environmental models. Environmental Modelling & Software 2006, 21:602-614.
26. Kline S.J. Conceptual Foundations for Multidisciplinary Thinking 1995, Stanford University Press.
27. Kolkman M.J., Kok M., van der Veen A. Mental model mapping as a new tool to analyse the use of information in decision-making in integrated water management. Physics and Chemistry of the Earth 2005, 30:317-332.
28. Lempert R., Groves D.G., Popper S.W., Bankes S.C. A general, analytic method for generating robust strategies and narrative scenarios. Management Science 2006, 52(4):514-528.
29. Magnani L. Conjectures and manipulations. Computational modeling and the extra-theoretical dimension of scientific discovery. Minds and Machines 2004, 14:507-537.
30. Midgley G. Systemic Intervention: Philosophy, Methodology, and Practice 2000, Kluwer Academic, New York.
31. Morrison M., Morgan M.S. Models as mediating instruments. Models as Mediators 1999, 10-37. Cambridge University Press, (Chapter 2). M.S. Morgan, M. Morrison (Eds.).
32. Norton B.G. Sustainability: A Philosophy of Adaptive Ecosystem Management 2005, University of Chicago Press, Chicago.
33. Oreskes N., Belitz K. Philosophical issues in model assessment. Model Validation: Perspectives in Hydrological Science 2001, 23-41. John Wiley & Sons, New York, (Chapter 3). M.G. Anderson, P.D. Bates (Eds.).
34. Owens S. Making a difference? Some perspectives on environmental research and policy. Transactions of the Institute for British Geographers 2005, 30:287-292.
35. Owens S., Rayner T., Bina O. New agendas for appraisal: reflections on theory, practice, and research. Environment and Planning A 2004, 36:1943-1959.
36. Pahl-Wostl C. The implications of complexity for integrated resource management. Environmental Modelling & Software 2007, 22:561-569.
37. Rasmussen S., Baas N.A., Mayer B., Nilsson M., Olesen M.W. Ansatz for dynamical hierarchies. Artificial Life 2001, 7(4):329-353.
38. Refsgaard J.C., Henriksen H.J., Harrar W.G., Scholten H., Kassahun A. Quality assurance in model based water management - review of existing practice and outline of new approaches. Environmental Modelling & Software 2005, 20:1201-1215.
39. Reuter H., Hölker F., Middelhoff U., Jopp F., Eschenbach C., Breckling B. The concepts of emergent and collective properties in individual-based models - summary and outlook of the Bornhöved case studies. Ecological Modelling 2005, 186:489-501.
40. Richardson, G.P., Andersen, D.F., Maxwell, T.A., Stewart, T.R., 11-15 July 1994. Foundations of mental model research. In: Proceedings of the 12th International System Dynamics Conference, Scotland, pp. 181-192.
41. Robson B.J., Hamilton D.P., Webster I.T., Chan T. Ten steps applied to development and evaluation of process-based biogeochemical models of estuaries. Environmental Modeling & Software 2008, 23:369-384.
42. Rational Analysis for a Problematic World Revisited: Problem Structuring Methods for Complexity, Uncertainty and Conflict 2001, John Wiley & Sons, Ltd., New York. second ed. J. Rosenhead, J. Mingers (Eds.).
43. Rousseau D., Sitkin S., Burt R., Camerer C. Introduction to the special topic forum: not so different afterall - a cross-disciplinary view of trust. The Academy of Management Review 1998, 23(3):393-404.
44. Rowe J.S. The level-of-integration concept and ecology. Ecology 1961, 42(2):420-427.
45. Runhaar H., Dieperink C., Driessen P. Policy analysis for sustainable development: the toolbox for the environmental social scientist. International Journal of Sustainability in Higher Education 2006, 7(1):34-56.
46. Rykiel E.J. Testing ecological models: the meaning of validation. Ecological Modelling 1996, 90:229-244.
47. Saunders-Newton D., Scott H. "But the computer said!": Credible uses of computation modeling in public sector decision making. Social Science Computer Review 2001, 19(1):47-65.
48. Scholten H., Kassahun A., Refsgaard J.C., Kargas T., Gavardinas C., Beulens A.J. A methodology to support multidisciplinary model-based water management. Environmental Modelling & Software 2007, 22:743-759.
49. Selin C. Trust and the illusive force of scenarios. Futures 2006, 38:1-14.
50. Shackley S. Trust in models? The mediating and transformative role of computer models in environmental discourse. International Handbook of Environmental Sociology 1997, 237-260. Edward Elgar, Northampton, USA, (Chapter 17). M. Redclift, G. Woodgate (Eds.).
51. Sterk B., Carberry P., Leeuwis C., van Ittersum M.K., Howden M., Meinke H., van Keulen H., Rossing W.A.H. The interface between land use systems research and policy: multiple arrangements and leverages. Land Use Policy 2009, 26:434-442.
52. Stirling A. The appraisal of sustainability: some problems and possible responses. Local Environment 1999, 4(2):111-135.
53. van der Sluijs J.P., Craye M., Funtowicz S., Kloprogge P., Ravetz J., Risbey J. Combining quantitative and qualitative measures of uncertainty in model-based environmental assessment the NUSAP system. Risk Analysis 2005, 25(2):481-492.
54. van der Sluijs J.P., Petersen A.C., Janssen P.H., Risbey J.S., Ravetz J.R. Exploring the quality of evidence of complex and contested policy decisions. Environmental Research Letters 2008, 3:1-9.
55. Weber M., Adamowicz V. Tradable land-use rights for cumulative environmental effects management. Canadian Public Policy 2002, 28(4):581-595.
56. Welsh W.D. Water balance modelling in Bowen, Queensland, and the ten iterative steps in model development and evaluation. Environmental Modeling & Software 2008, 23:195-205.
57. Winsberg E. Simulated experiments: methodology for a virtual world. Philosophy of Science 2003, 70:105-125.
58. Zeigler B.P., Praehoffer H., Kim T.G. Theory of Modeling and Simulation 2000, Academic Press, New York. second ed.