Contributions to model validation: Hierarchy, process, and cessation

System Dynamics Review

Volumn 28, Issue 2, 2012, Pages 157-181

  Groesser, Stefan N ^a,b,c   Schwaninger, Markus ^b  

^a BERN UNIVERSITY OF APPLIED SCIENCES   (Switzerland)

^b UNIVERSITY OF ST GALLEN   (Switzerland)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEXITY; HIERARCHICAL SYSTEM; MODEL VALIDATION; SYSTEMS ANALYSIS;

EID: 84862673398     PISSN: 08837066     EISSN: 10991727     Source Type: Journal    
DOI: 10.1002/sdr.1466     Document Type: Article

References (73)

1. Anastasakis L, Olphert CW, Wilson JM. 2008. Experiences in using a contingency factor-based validation methodology for spreadsheet DSS. Journal of the Operational Research Society 59(6): 756-761.
2. Back G, Love G, Falk J. 2000. The doing of model verification and validation: balancing cost and theory. In Proceedings of the 18th International Conference of the System Dynamics Society, Bergen, Norway.
3. Balci O. 1994. Validation, verification and testing techniques throughout the life cycle of a simulation study. Annals of Operations Research 53(1): 121-173.
4. Balci O, Sargent RG. 1981. A methodology for cost-risk analysis in the statistical validation of simulation models. Communications of the ACM 24(4): 190-197.
5. Barlas Y. 1989. Multiple tests for validation of system dynamics type of simulation-models. European Journal of Operational Research 42(1): 59-87.
6. Barlas Y. 1990. An autocorrelation function test for output validation. Simulation 55(1): 7-16.
7. Barlas Y. 1996. Formal aspects of model validity and validation in system dynamics. System Dynamics Review 12(3): 183-210.
8. Barlas Y. 2006. Model Validity and Testing in System Dynamics: Two Specific Tools. Paper presented at the 24th International Conference of the System Dynamics Society. Nijmegen, The Netherlands.
9. Barlas Y, Carpenter S. 1990. Philosophical roots of model validation: two paradigms. System Dynamics Review 6(2): 148-166.
10. Bossel H. 2004. Systeme, Dynamik, Simulation: Modellbildung, Analyse und Simulation komplexer Systeme. Books on Demand: Norderstedt, Germany.
11. Bratley P, Fox B, Schrage L. 1987. A Guide to Simulation. Springer: New York.
12. Coyle RG, Exelby DR. 2000. The validation of commercial system dynamics models. System Dynamics Review 16(1): 27-41.
13. Defense Modeling and Simulation Office. 1996. Verification, Validation and Accreditation: Recommended Practices Guide. US Department of Defense: Washington, DC.
14. Déry R, Landry M, Banville C. 1993. Revisiting the issue of model validation in OR: an epistemological view. European Journal of Operational Research 66(2): 168-183.
15. Eberlein RL, Wang Q. 1983. Validation of oscillatory behavior modes using spectral analysis. In Proceedings of the International Conference of the System Dynamics Society, Chestnut Hill, MA.
16. Finlay PN, Wilson JM. 1997. Validity of decision support systems: towards a validation methodology. Systems Research and Behavioral Science 14(3): 169-182.
17. Finlay PN, Wilson JM. 2000. A survey of contingency factors affecting the validation of end-user spreadsheet-based decision support systems. Journal of the Operational Research Society 51(8): 949-958.
18. Finlay PN, Forsey GJ, Wilson JM. 1988. The validation of expert systems: contrasts with traditional methods. Journal of the Operational Research Society 39(10): 933-938.
19. Ford DN. 1999. A behavioral approach to feedback loop dominance analysis. System Dynamics Review 15(1): 3-36.
20. Forrester JW. 1961. Industrial Dynamics. Productivity Press: Cambridge, MA. (Now available from Pegasus Communications, Waltham, MA).
21. Forrester JW. 1985. The "model" versus a modeling "process". System Dynamics Review 1(1): 133-143.
22. Forrester JW. 1994. Policies, decisions, and information sources for modeling. In Modeling for Learning Organizations, Morecroft JDW, Sterman JD (eds). Productivity Press: Portland, OR; 51-84.
23. Forrester JW. 2007. System dynamics: the next fifty years. System Dynamics Review 23(2-3): 359-370.
24. Forrester JW, Senge PM. 1980. Tests for building confidence in system dynamics models. In System Dynamics: TIMS Studies in the Management Sciences, Legasto AA, Forrester JW, Lyneis JM (eds). North-Holland: Amsterdam; 209-228.
25. Gass SI. 1983. Decision-aiding models: validation, assessment, and related issues for policy analysis. Operations Research 31(4): 603-631.
26. Glaser BG. 1978. Theoretical Sensitivity: Advances in the Methodology of Grounded Theory. Sociology Press: Mill Valley, CA.
27. Glaser BG. 1992. Basics of Grounded Theory Analysis. Sociology Press: Mill Valley, CA.
28. Glaser BG, Strauss AL. 1967. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine De Gruyter: New York.
29. Graham AK. 1980. Parameter estimation in system dynamics modeling. In Elements of the System Dynamics Method, Randers J (ed). Productivity Press: Cambridge, MA; 143-161.
30. Groesser SN, Bruppacher S. 2007. Decisions in the planning process of a building: development of a dynamic model about individual's energy efficiency intention over time. In Proceedings of the 25th International Conference of the System Dynamics Society, Boston, MA.
31. Groesser SN, Schaffernicht M. 2012. Mental models of dynamic systems: taking stock and looking ahead. System Dynamics Review. DOI: 10.1002/sdr.476.
32. Groesser SN, Ulli-Beer S. 2006. Diffusion dynamics of energy-efficient innovations in the residential building environment: a simulation approach. In Proceedings of the 24th International Conference of the System Dynamics Society, Nijmegen, The Netherlands.
33. Groesser SN, Ulli-Beer S. 2008. Long-term innovation diffusion in the building construction industry: empirically-based theory building. In Proceedings of the 26th International Conference of the System Dynamics Society, Athens, Greece.
34. Güneralp B. 2006. Towards coherent loop dominance analysis: progress in eigenvalue elasticity analysis. System Dynamics Review 22(3): 263-289.
35. Hall RI. 1976. A system pathology of an organization: the rise and fall of the old Saturday Evening Post. Administrative Science Quarterly 21(2): 185-211.
36. Homer JB. 1983. Partial-model testing as a validation tool for system dynamics. In Proceedings of the International Conference of the System Dynamics Society, Chestnut Hill, MA.
37. Homer JB. 1996. Why we iterate: scientific modeling in theory and practice. System Dynamics Review 12(1): 1-19.
38. Kahneman D, Tversky A. 1979. Prospect theory: analysis of decision under risk. Econometrica 47(2): 263-291.
39. Kampmann CE, Oliva R. 2008. Structural dominance analysis and theory building in system dynamics. Systems Research and Behavioral Science. 25(4): 505-519.
40. Kennedy P. 2003. A Guide to Econometrics (5th edn). Basil Blackwell: Oxford.
41. Kirchner JW. 1984. A methodological framework for system dynamics model evaluation. Dynamica 10(1): 9-15.
42. Kleijnen JPC. 1995. Statistical validation of simulation models. European Journal of Operational Research 87(1): 21-34.
43. Kleindorfer GB, Geneshan R. 1993. The philosophy of science and validation in simulation. In Proceedings of the 25th Conference on Winter Simulation, Los Angeles CA.
44. Lane DC. 1995. The folding star: a comparative reframing and extension of validity concepts in system dynamics. In Proceedings of the International Conference of the System Dynamics Society, Tokyo.
45. Law AM, Kelton DW. 1982. Simulation Modeling and Analysis. McGraw-Hill: New York.
46. Mass N. 1991. Diagnosing surprise model behavior: a tool for evolving behavioral and policy insights. System Dynamics Review 7(1): 68-86.
47. Morecroft JDW. 2007. Strategic Modelling and Business Dynamics: A Feedback Systems Approach. Wiley: Chichester.
48. Müller MS, Groesser SN, Ulli-Beer S. 2012. How Do We Know Who to Include in Transdisciplinary Research? Toward a Method for the Identification of Experts. European Journal of Operational Research 216(2): 495-502.
49. Oliva R. 2003. Model calibration as a testing strategy for system dynamics models. European Journal of Operational Research 151(3): 552-568.
50. Olphert CW, Wilson JM. 2004. Validation of decision-aiding spreadsheets: the influence of contingency factors. Journal of the Operational Research Society 55(1): 12-22.
51. Oral M, Kettani O. 1993. The facets of the modeling and validation process in operations research. European Journal of Operational Research 66(2): 216-234.
52. Peterson DW, Eberlein RL. 1994. Reality checks: a bridge between systems thinking and system dynamics. System Dynamics Review 10(2-3): 159-174.
53. Richardson GP, Pugh AL III. 1981. Introduction to System Dynamics Modeling with DYNAMO. Productivity Press: Cambridge, MA. (Now available from Pegasus Communications, Waltham, MA).
54. Sargent RG. 1992. Validation and verification of simulation models. In Proceedings of the 24th conference on Winter Simulation, Arlington, VA.
55. Sargent RG. 2008. Verification and validation of simulation models. In Proceedings of the 40th Conference on Winter Simulation, Miami, FL.
56. Saysel AK, Barlas Y. 2006. Model simplification and validation with indirect structure validity tests. System Dynamics Review 22(3): 241-262.
57. Schaffernicht M. 2006. Detecting and monitoring change in models. System Dynamics Review 22(1): 73-88.
58. Schaffernicht M, Groesser SN. 2011. A comprehensive method for comparing mental models of dynamic systems. European Journal of Operational Research 210(1): 57-67.
59. Schwaninger M. 2009. Intelligent Organizations: Powerful Models for Systemic Management (2nd edn). Springer: Berlin.
60. Schwaninger M, Groesser SN. 2008. Model-based theory-building with system dynamics. Systems Research and Behavioral Science 25(4): 447-465.
61. Schwaninger M, Groesser SN. 2009. System dynamics modeling: validation for quality assurance. In Encyclopedia of Complexity and System Science. Springer: Berlin; 9000-9014.
62. Simon HA. 1964. Models of Man: Social and Rational Mathematical Essays on Rational Human Behavior in a Social Setting. Wiley: New York.
63. Sterman JD. 1984. Appropriate summary statistics for evaluating the historical fit of system dynamics models. Dynamica 10(2): 51-66.
64. Sterman JD. 2000. Business Dynamics: Systems Thinking and Modeling for a Complex World. McGraw-Hill: Boston, MA.
65. Sterman JD. 2002. All models are wrong: reflections on becoming a systems scientist. System Dynamics Review 18(4): 501-531.
66. Strauss AL, Corbin JM (eds). 1997. Grounded Theory in Practice. Sage: Thousand Oaks, CA.
67. Strauss AL, Corbin JM (eds). 1998. Basics of Qualitative Research Techniques and Procedures for Developing Grounded Theory (2nd edn). Sage: Thousand Oaks, CA.
68. Taylor AJ. 1980. Loop analysis and validation. Dynamica 6(1): 2-8.
69. Weick KE. 1989. Theory construction as disciplined imagination. Academy of Management Review 14(4): 516-531.
70. Weil HB. 1983. What is an adequate model? In Proceedings of the International Conference of the System Dynamics Society, Chestnut Hill, MA.
71. Wolstenholme EF. 1999. Qualitative vs quantitative modelling: the evolving balance. Journal of the Operational Research Society 50(4): 422-428.
72. Yücel G, Barlas Y. 2011. Automated parameter specification in dynamic feedback models based on behavior pattern features. System Dynamics Review 27(2): 195-215.
73. Zeigler BP, Praehofer H, Kim TG. 2000. Theory of Modeling and Simulation (2nd edn.). Academic Press: San Diego, CA.