Using fit-constrained Monte Carlo trials to quantify confidence in simulation model outcomes

Proceedings of the Annual Hawaii International Conference on System Sciences

Volumn 2002-January, Issue , 2002, Pages

  Graham, A K ^a   Choi, C Y ^a   Mullen, T W ^a  

^a PA CONSULTING GROUP   (United Kingdom)

Author keywords

Analytical models; Business; Calibration; Computational modeling; History; Monte Carlo methods; Predictive models; Testing; Uncertainty; Vehicle dynamics

Indexed keywords

ANALYTICAL MODELS; CALIBRATION; FINANCIAL DATA PROCESSING; HISTORY; INDUSTRY; TESTING; UNCERTAINTY ANALYSIS;

CLOSED LOOP MODELS; COMPUTATIONAL MODEL; CONFIDENCE INTERVAL; DESIGN AND CONSTRUCTION; PREDICTIVE MODELS; SIMULATED BEHAVIORS; UNCERTAINTY; VEHICLE DYNAMICS;

MONTE CARLO METHODS;

EID: 84948699808     PISSN: 15301605     EISSN: None     Source Type: Journal    
DOI: 10.1109/HICSS.2002.994028     Document Type: Article

References (40)

1. J.M. Lyneis, "System Dynamics for Market Forecasting and Structural Analysis", System Dynamics Review 16(1), 2000, pp. 3-25
2. A.K. Graham and C.A. Ariza, "Dynamic, hard and strategic questions: Using Optimization to Answer a Marketing Resource Allocation Question", Proceedings of the International System Dynamics Conference, Atlanta, Georgia, July 23-27, 2001.
3. K.G. Cooper, "Naval Ship Production: A Claim Settled and a Framework Built", Interfaces 10(6), 1980, pp. 20-36.
4. K.G. Cooper, "The Rework Cycle: Benchmarks for the Program Manager", Project Management Journal, March 1993.
5. K.G. Cooper and T.W. Mullen, "Swords and Plowshares: The Rework Cycle of Defense and Commercial Software Development Projects", American Programmer 6(5), 1993.
6. A.K. Graham, "Beyond PM101: Lessons for Managing Large Development Programs", Project Management Journal 31(4), 2000, pp. 7-18.
7. Copeland, T., T. Koller, and J. Murrin, Valuation: Measuring and Managing the Value of Companies, John Wiley, New York, 1995.
8. T.A. Luehrman, "Investment Opportunities as Real Options: Getting Started on the Numbers", Harvard Business Review July-August 1998, pp. 51-67.
9. T.A. Luehrman, "Strategy as a Portfolio of Real Options", Harvard Business Review, September-October 1998, pp. 89-99.
10. Schweppe, F.C., Uncertain Dynamic Systems, John Wiley and Sons, Engelwood Cliffs, NJ, 1973.
11. Feng, G. and R. Lozano, Adaptive Control Systems, Butterworth-Heinemann, Oxford, UK, 1999.
12. R.A. Rohrer and M. Sobral, Jr., "Sensitivity Considerations in Optimal System Design", IEEE Transactions on Automatic Control AC10, 1965, pp. 43-48.
13. Ackoff, R., Creating the Corporate Future, John Wiley, New York, 1981.
14. Theil, H., Principles of Econometrics, John Wiley and Sons, New York, 1971, Section 3.6.
15. Hammersley, J. M. and D. C. Handscomb, Monte Carlo Methods, Chapman and Hall, 1964.
16. Rubinstein, R.Y., Simulation and the Monte Carlo Method, John Wiley and Sons, Engelwood Cliffs, NJ, 1981.
17. Fishman, G.S., Monte Carlo: Concepts, Algorithms and Applications, Springer Verlag, 1996.
18. B.S. Morgan, Jr., "Sensitivity Analysis and Synthesis of Multivariable Systems", IEEE Transactions on Automatic Control AC-11, 1966, pp. 506-512.
19. N. Metropolis, A.W. Rosenbluth, M.N. Rosenbluth, A.H. Teller and E. Teller, "Equations of State Calculations by Fast Computing Machines", J. Chem. Phys., 21, 1953, pp. 1087-1091.
20. W.K. Hastings, "Monte Carlo Sampling Methods Using Markov Chains and their Applications, " Biometrika, 57, 1970, pp. 97-109.
21. S. Geman and D. Geman, "Stochastic relaxation, Gibbs Distributions and the Bayesian Restoration of Images", IEEE Trans. Pattn. Anal. and Mach. Intell., 6, 1984, pp. 721-741.
22. Gilks, W.R. and S. Richardson and D.J. Spiegelhalter, Markov Chain Monte Carlo in Practice, Chapman and Hall, 1995.
23. Abdel-Hamid, T. and S.E. Madnick, Software Project Dynamics: An Integrated Approach, Prentice-Hall, 1991.
24. Ford, D.N., The Dynamics of Project Management: An Investigation of Projects' Process and Coordination on Performance, MIT PhD dissertation, Department of Civil and Environmental Engineering, Cambridge, Mass., 1995.
25. Forrester, J.W., Industrial Dynamics, Pegasus Communications, Waltham, Mass., 1961.
26. Richardson, G.P. and A.L. Pugh III, Introduction to System Dynamics Modeling using Dynamo, Pegasus Communications, Waltham, Mass., 1981.
27. Sterman, J.D., Business Dynamics: Systems Thinking for a Complex World, Irwin/McGraw-Hill, 2000.
28. System Dynamics Society. At www.albany.edu/cpr/sds/
29. J.W. Forrester and P.M. Senge, "Tests for Building Confidence in System Dynamics Models", TIMS Studies in the Management Sciences 14, 1980, pp. 209-228.
30. D.N. Ford and J.D. Sterman, "Expert Knowledge Elicitation for Improving Mental and Formal Models", System Dynamics Review 14(4), 1998, pp. 309-340.
31. J.M. Lyneis, K.S. Reichelt, and C.G. Bespolka, "Calibration Statistics for Life-Cycle Models", Proceedings of the 1996 System Dynamics Conference, 1996.
32. Sterman, J.D., 2000, op cit., pp. 874-880.
33. J.M. Lyneis and K.S. Reichelt, "Calibration Standards", PA Consulting Group Internal Document, Cambridge, Mass., April 11, 1996.
34. K.C. Eubanks and L.F. Yeager, "An Introduction to Jitia: Simulation Software Designed for Developing Large System Models", Proceedings of the International System Dynamics Conference, Atlanta, Georgia, July 23-27, 2001.
35. Graham, A.K. and L.E. Alfeld, Introduction to Urban Dynamics, Pegasus Communications, Waltham, Mass., 1976, pp. 123-126.
36. P.J. Vermuelen and D.C.J. de Jongh, "Dynamics of Growth in a Finite World: A Comprehensive Sensitivity Analysis", Automatica 3(1), 1977, pp. 77-84.
37. C.S.Y. Wong, "Criterion Sensitivity Analysis: A New Approach to Parameter Sensitivity", Applied Mathematical Modeling 4(1), 1980, pp. 7-15.
38. J.H. Miller, "Active Nonlinear Tests (ANTs) of Complex Simulation Models", Management Science 44(6), 1997, pp. 820-830.
39. Fisher, F.M., The Identification Problem in Econometrics, McGraw-Hill, New York, 1966.
40. Senge, P.M., The System Dynamics National Model Investment Function: A Comparison to the Neoclassical Investment Function, MIT Sloan School of Management Doctoral Dissertation, Cambridge, Mass., 1978.