Choosing the best model: Level of detail, complexity, and model performance

Mathematical and Computer Modelling

Volumn 24, Issue 4, 1996, Pages 1-14

  Brooks, R J ^a   Tobias, A M ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Complexity; Level of detail; Model performance; Modelling methodology; Simplification

Indexed keywords

EID: 0030208904     PISSN: 08957177     EISSN: None     Source Type: Journal    
DOI: 10.1016/0895-7177(96)00103-3     Document Type: Article

References (70)

1. 1. J. Fripp, How effective are models?, Omega 13 (1), 19-28 (1985).
2. 2. J.N.R. Jeffers, From free-hand curves to chaos: Computer modelling in ecology, In Computer Modelling in the Environmental Sciences, (Edited by D.G. Farmer and M.J. Rycroft), pp. 299-308, The Institute of Mathematics and its Applications Conference Series No. 28, Clarendon Press, Oxford, (1991).
3. 3. A.M. Tobias, Verification, validation and experimentation with visual interactive simulation models, In Operational Research Tutorial Papers, The Operational Research Society, (1991).
4. 4. P.-J. Courtois, On time and space decomposition of complex structures, Communications of the ACM 28 (6), 590-603 (1985).
5. 5. A.M. Law, Simulation model's level of detail determines effectiveness, Industrial Engineering 23 (10), 16-18 (1991).
6. 6. C.B. Tilanus, Failures and successes of quantitative methods in management, European Journal of Operational Research 19, 170-175 (1985).
7. 7. S.C. Ward, Arguments for constructively simple models, Journal of Operational Research Society 40 (2), 141-153 (1989).
8. 8. J.D. Salt, Keynote address: Simulation should be easy and fun!, In Proceedings of the 1993 Winter Simulation Conference, (Edited by G.W. Evans et al.), pp. 1-5, IEEE, New York, (1993).
9. 9. A.M. Law, J.S. Carson, K.J. Musselman, J.G. Fox, S.K. Halladin and O.M. Ulgen, A forum on crucial issues in the simulation of manufacturing systems, In Proceedings of the 1993 Winter Simulation Conference, (Edited by G.W. Evans et al.), pp. 916-922, IEEE, New York, (1993).
10. 10. J.C.R. Hunt, Presidential address: Contributions of mathematics to the solution of industrial and environmental problems, IMA Bulletin 30, 35-45 (1994).
11. 11. A.J. Jakeman and G.M. Hornberger, How much complexity is warranted in a rainfall-runoff model?, Water Resources Research 29, 2637-2649 (1993).
12. 12. B.P. Zeigler, Theory of Modelling and Simulation, John Wiley, New York, (1976).
13. 13. S.I. Gass, What is a computer-based mathematical model?, Mathl. Modelling 4 (5), 467-472 (1983).
14. 14. E. Rexstad, and G.S. Innis, Model simplification - Three applications, Ecological Modelling 27 (1/2), 1-13 (1985).
15. 15. R.E. Shannon, Systems Simulation: The Art and Science, Prentice Hall, Englewood Cliffs, NJ, (1975).
16. 16. J. Banks and J.S. Carson, Discrete-Event System Simulation, Prentice Hall, Englewood Cliffs, NJ, (1984).
17. 17. C.O. Stockle, Canopy photosynthesis and transpiration estimates using radiation interception models with different levels of detail, Ecological Modelling 60 (1), 31-44 (1992).
18. 18. A.M. Law and W.D. Kelton, Simulation Modeling and Analysis, McGraw-Hill, New York, (1991).
19. 19. M. Bunge, The Myth of Simplicity: Problems of Scientific Philosophy, Prentice Hall, Englewood Cliffs, NJ, (1963).
20. 20. J.L. Casti, Connectivity, Complexity, and Catastrophe in Large-Scale Systems, John Wiley and Sons, New York, (1979).
21. 21. R.L. Henneman and W.B. Rouse, On measuring the complexity of monitoring and controlling large-scale systems, IEEE Transactions on Systems, Man and Cybernetics SMC-16, 193-207 (1986).
22. 22. M. Gell-Mann, What is complexity?, Complexity 1 (1), 16-19 (1995).
23. 23. W. Weaver, Science and complexity, American Scientist 36 (Autumn), 536-544 (1948).
24. 24. G.J. Chaitin, Randomness and mathematical proof, Scientific American 232 (May), 47-52 (1975).
25. 25. H. Morowitz, The emergence of complexity, Complexity 1 (1), 4-5 (1995).
26. 26. M. Flatau, Review Article: When order is no longer order - Organising and the new science of complexity, Organization 2 (3/4), 566-575 (1995).
27. 27. R.L. Flood and E.R. Carson, Dealing with Complexity: An Introduction to the Theory and Application of Systems Science, 2nd edition, Plenum Press, New York, (1993).
28. 28. M.W. Golay, P.H. Seong and V.P. Manno, A measure of the difficulty of system diagnosis and its relationship to complexity, International Journal of General Systems 16 (1), 1-23 (1989).
29. 29. H.A. Simon, The architecture of complexity, General Systems Yearbook 10, 63-76 (1964).
30. 30. R. Rosen, Complexity as a system property, International Journal of General Systems 3, 227-232 (1977).
31. 31. L. George, Tests for system complexity, International Journal of General Systems 3, 253-258 (1977).
32. 32. B.P. Zeigler, Multifaceted modeling methodology: Grappling with the irreducible complexity of systems, Behavioral Science 29, 169-178 (1984).
33. 33. L. Schruben and E. Yücesan, Complexity of simulation models: A graph theoretic approach, In Proceedings of the 1993 Winter Simulation Conference, (Edited by G.W. Evans et al.), pp. 641-649, IEEE, New York, (1993).
34. 34. G. Blöschl and R. Kirnbauer, Point snowmelt models with different degrees of complexity - Internal processes, Journal of Hydrology 129, 127-147 (1991).
35. 35. J.A. le Roux and M.S. Potgieter, The simulation of Forbush decreases with time-dependent cosmic-ray modulation models of varying complexity, Astronomy and Astrophysics 243, 531-545 (1991).
36. 36. B.O. Palsson and I. Lee, Model complexity has a significant effect on the numerical value and interpretation of metabolic sensitivity coefficients, Journal of Theoretical Biology 161, 299-315 (1993).
37. 37. W.K. Durfee, Control of standing and gait using electrical stimulation: Influence of muscle model complexity on control strategy, Progress in Brain Research 97, 369-381 (1993).
38. 38. D.E. Smith and J.M. Starkey, Effects of model complexity on the performance of automated vehicle steering controllers: Model development, validation and comparison, Vehicle System Dynamics 24, 163-181 (1995).
39. 39. D.B. Webster, M.L. Padgett, G.S. Hines and D.L. Sirois, Determining the level of detail in a simulation model - A case study, Computers and Industrial Engineering 8 (3/4), 215-225 (1984).
40. 40. T.J. McCabe, A complexity measure, IEEE Transactions on Software Engineering 2 (4), 308-320 (1976).
41. 41. L. Schruben, Simulation modelling with event graphs, Communications of the ACM 26 (11), 957-963 (1983).
42. 42. M. Pidd, Computer Simulation in Management Science, John Wiley and Sons, Chichester, (1988).
43. 43. E. Halfon, Is there a best model structure? I. Modelling the fate of a toxic substance in a lake, Ecological Modelling 20, 135-152 (1983).
44. 44. E. Halfon, Is there a best model structure? II. Comparing the model structures of different fate models, Ecological Modelling 20, 153-163 (1983).
45. 45. R.W. Bosserman, Structural comparison for four lake ecosystem models, In A General Survey of Systems Methodology. Proceedings of the Twenty-sixth Annual Meeting of the Society for General Systems Research, (Edited by L. Troncale), pp. 559-568, Washington, DC, (1982).
46. 46. J.D. Farmer, A rosetta stone for connectionism, Physica D 42, 153-187 (1990).
47. 47. R.J. Brooks, A.M. Tobias and M.J. Lawrence, The population genetics of the self-incompatibility polymorphism in Papaver Rhoeas. XI. The effects of limited pollen and seed dispersal, overlapping generations and variation in plant size on the variance of S-allele frequencies in populations at equilibrium, Heredity 76, 367-376 (1996).
48. 48. C.G. Langten, Computation at the edge of chaos: Phase transitions and emergent computation, Physica D 42, 12-37 (1990).
49. 49. S. Henry and D. Kafura, Software quality metrics based on information flow, IEEE Transactions on Software Engineering 7 (5), 510-518 (1981).
50. 50. N.E. Fenton, Software Metrics: A Rigorous Approach, Chapman and Hall, London, (1991).
51. 51. W.S. Meisel and D.C. Collins, Repro-modelling: An approach to efficient model utilization and interpretation, IEEE Transactions on Systems, Man and Cybernetics SMC-3, 349-358 (1973).
52. 52. S.L.S. Jacoby and J.S. Kowalik, Mathematical Modeling with Computers, Prentice Hall, Englewood Cliffs, NJ, (1980).
53. 53. R.N. Palmer and J.L. Cohan, Complexity in Columbia River systems modeling, Journal of Water Resources Planning and Management 112, 453-468 (1986).
54. 54. P.A. Fishwick, The role of process abstraction in simulation, IEEE Transactions on Systems, Man and Cybernetics 18 (1), 19-39 (1988).
55. 55. G.S. Innis and E. Rexstad, Simulation model simplification techniques, Simulation 41 (1), 7-15 (1983).
56. 56. R. Costanza and F.H. Sklar, Articulation, accuracy and effectiveness of mathematical models: A review of freshwater wetland applications, Ecological Modelling 27 (1/2), 45-68 (1985).
57. 57. D.G. Decoursey, Developing models with more detail: Do more algorithms give more truth?, Weed Technology 6 (3), 709-715 (1992).
58. 58. H. Allison, Inverse unstable problems and some of their applications, Mathematical Scientist 4, 9-30 (1979).
59. 59. R.J. Brooks, D.N. Lerner and A.M. Tobias, Determining a range of predictions of a groundwater model which arise from alternative calibrations, Water Resources Research 30 (11), 2993-3000 (1994).
60. 60. D. Garfinkel, Modelling of inherently complex biological systems: Problems, strategies, and methods, Mathematical Biosciences 72 (2), 131-139 (1984).
61. 61. W.W. Murdoch, E. McCauley, R.M. Nisbet, W.S.C. Gurney and A.M. De Roos, Individual-based models: Combining testability and generality, In Individual-based Models and Approaches in Ecology: Populations, Communities and Ecosystems, (Edited by D.L. DeAngelis and L.J. Gross), pp. 18-35, Chapman and Hall, New York, (1992).
62. 62. T. Demarco, Controlling Software Projects: Management, Measurement and Estimation, Yourdon Press, New York, (1982).
63. 63. B.W. Boehm, Software Engineering Economics, Prentice Hall, Englewood Cliffs, NJ, (1981).
64. 64. B.P. Zeigler, Multilevel multiformalism modeling: An ecosystem example, In Theoretical Systems Ecology: Advances and Case Studies, (Edited by E. Halfon), pp. 17-54, Academic Press, New York, (1979).
65. 65. S. Sevinc, Automation of simplification in discrete event modelling and simulation, International Journal of General Systems 18 (2), 125-142 (1990).
66. 66. S. Addanki, R. Cremonini and J.S. Penberthy, Graphs of models, Artificial Intelligence 51, 145-177 (1991).
67. 67. B. Falkenheimer and K.D. Forbus, Compositional modelling: Finding the right model for the job, Artificial Intelligence 51, 95-143 (1991).
68. 68. P.P. Nayak, Automated modelling of physical systems, Ph.D. Thesis, Computer Science Department, Stanford University, Technical Report STAN-CS-92-1443, (1992).
69. 69. T.R. Gruber, Model formulation as a problem solving task - Computer-assisted engineering modelling, International Journal of Intelligent Systems 8 (1), 105-127 (1993).
70. 70. P.K. Davis and R. Hillestad, Families of models that cross levels of resolution: Issues for design, calibration and management, In Proceedings of the 1993 Winter Simulation Conference, (Edited by G.W. Evans, M. Mollaghasemi, E.G. Russell and W.E. Biles), pp. 1003-1012, IEEE, New York, (1993).