Verification and validation of simulation models

Journal of Simulation

Volumn 7, Issue 1, 2013, Pages 12-24

  Sargent, R G ^a  

^a Syracuse University   (United States)

Author keywords

Simulation; Validation; Verification

Indexed keywords

COMPUTER SIMULATION; VERIFICATION;

CONCEPTUAL MODEL; MODEL DEVELOPMENT; MODEL VALIDATION; MODEL VALIDITY; MODEL VERIFICATION; SIMULATION; VALIDATION; VERIFICATION-AND-VALIDATION;

SOFTWARE ENGINEERING;

EID: 84872734011     PISSN: 17477778     EISSN: 17477786     Source Type: Journal    
DOI: 10.1057/jos.2012.20     Document Type: Article

References (54)

1. Anderson HA and Sargent RG (1974). An investigation into scheduling for an interactive computer system. IBM Journal of Research and Development 18(2): 125-137.
2. Anshoff HI and Hayes RL (1973). Roles of models in corporate decision making. In: Ross M (ed). Operations Research '72: Proceedings of the Sixth IFORS International Conference on Operational Research. North Hollard: Amsterdam.
3. Balci O (1989). How to assess the acceptability and credibility of simulation results. In: MacNair EA, Musselman KJ and Heidelberger P (eds). Proceedings of the 1989 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 62-71.
4. Balci O (2001). A methodology for certification of modeling and simulation applications. ACM Transactions on Modeling and Computer Simulation 11(4): 352-377.
5. Balci O and Sargent RG (1981). A methodology for cost-risk analysis in the statistical validation of simulation models. Communications of the ACM 24(6): 190-197.
6. Balci O and Sargent RG (1984a). A bibliography on the credibility assessment and validation of simulation and mathematical models. Simuletter 15(3): 15-27.
7. Balci O and Sargent RG (1984b). Validation of simulation models via simultaneous confidence intervals. American Journal of Mathematical and Management Science 4(3): 375-406. (Pubitemid 17573175)
8. Balci O, Nance RE, Arthur JD and Ormsby WF (2002). Expanding our horizons in verification, validation, and accreditation research and practice. In: Peters BA, Smith JS, Medeiros DJ and Rohrer MW (eds). Proceedings of the 2002 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 653-663.
9. Banks J, Carson II JS, Nelson BL and Nicol D (2010). Discrete-event System Simulation, 5th edn. Prentice-Hall: Englewood Cliffs, NJ
10. Banks J, Gerstein D and Searles SP (1988). Modeling processes, validation, and verification of complex simulations: A survey. In: Methodology and Validation, Simulation Series, Vol. 19, No. 1, The Society for Computer Simulation. Society forModeling and Simulation International: San Diego, CA, pp 13-18. (Pubitemid 18614631)
11. DoDI 5000.61 (2009). DoD modeling and simulation verification, validation, and accreditation. 9 December.
12. Fairley RE (1976). Dynamic testing of simulation software. In: Proceedings of the 1976 Summer Computer Simulation Conference. Society for Modeling and Simulation International: San Diego, CA, pp 40-46.
13. Gass SI (1983). Decision-aiding models: Validation, assessment, and related issues for policy analysis. Operations Research 31(4): 601-663.
14. Gass SI (1984). Documenting a computer-based model. Interfaces 14(3): 84-93.
15. Gass SI (1993). Model accreditation: A rationale and process for determining a numerical rating. European Journal of Operational Research 66(2): 250-258.
16. Gass SI and Joel L (1987). Concepts of model confidence. Computers and Operations Research 8(4): 341-346.
17. Hines WW, Montgomery DC, Goldsman DM and Borror CM (2003). Probability and Statistics for Engineers, 4th edn. John Wiley: New York.
18. Johnson RA, Miller I and Freund J (2010). Miller and Freund's Probability and Statistics for Engineers, 8th edn. Prentice-Hall: Englewood Cliffs, NJ
19. Kleijnen JPC (1999). Validation of models: Statistical techniques and data availability. In: Farrington PA, Black Nembhard H, Sturrock DT and Evans GW (eds). Proceedings of the 1999 Simulation Conference. IEEE: Piscataway, NJ, pp 647-654.
20. Kleijnen JPC (2008). Design and Analysis of Simulation Experiments. Springer-Verlag: Heidelberg.
21. Kleijnen JPC, Cheng RCH and Bettonvil BWM (2001). Validation of trace-driven simulation models: Bootstrapped tests. Management Science 47(11): 1533-1538. (Pubitemid 34192839)
22. Kleindorfer GB and Ganeshan R (1993). The philosophy of science and validation in simulation. In: Evans GW, Mollaghasemi M, Russell EC and Biles WE (eds). Proceedings of the 1993 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 50-57.
23. Knepell PL and Arangno DC (1993). Simulation Validation: A Confidence Assessment Methodology. IEEE Computer Society Press: Los Alamitos, CA
24. Landry M, Malouin JL and Oral M (1983). Model validation in operations research. European Journal of Operational Research 14(3): 207-220.
25. Law AM (2007). Simulation Modeling and Analysis, 4th edn. McGraw-Hill: New York.
26. Lowery J (1996). Design of hospital admissions scheduling system using simulation. In: Charnes JM,Morrice DJ, Brunner DT and Swain JJ (eds). Proceedings of the 1996 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 1199-1204.
27. Nance RE and Arthur JD (2006). Software requirements engineering: Exploring the role in simulation model development. In: Roberson S, Taylor S, Brailsford S and Garnett J (eds). Proceedings of the 2006 Operational Research Society Simulation Workshop. Coventry: England, pp 117-127.
28. Naylor TH and Finger JM (1967). Verification of computer simulation models. Management Science 14(2): B92-B101.
29. Rao MJ and Sargent RG (1988). An advisory system for operational validity. In: Hensen T (ed). Artificial Intelligence and Simulation: The Diversity of Applications. Society for Computer Simulation: San Diego, CA, pp 245-250.
30. Robinson S (2004). Simulation: The Practice of Model Development and Use. John Wiley: Chichester, West Sussex, UK
31. Ruess H and de Moura L (2003). From simulation to verification (and back). In: Chick S, Sanchez PJ, Ferrin E and Morrice DJ (eds). Proceedings of the 2003 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 888-896.
32. Sargent RG (1979). Validation of simulation models. In: Highland HJ, Spiegel MF and Shannon RE (eds). Proceedings of the 1979 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 497-503.
33. Sargent RG (1981). An assessment procedure and a set of criteria for use in the evaluation of computerized models and computer-based modeling tools. Final Technical Report RADC-TR-80-409, U.S. Air Force.
34. Sargent RG (1982). Verification and validation of simulation models. Chapter IX. In: Cellier FE (ed). Progress in Modelling and Simulation. Academic Press: London, pp 159-169.
35. Sargent RG (1984a). Simulation model validation, Chapter 19. In: Oren TI, Zeigler BP and Elzas MS (eds). Simulation and Modelbased Methodologies: An Integrative View. Springer-Verlag: Heidelberg, Germany, pp 537-555.
36. Sargent RG (1984b). A tutorial on verification and validation of simulation models. In: Sheppard S, Pooch UW and Pegden CD (eds). Proceedings of the 1984 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 114-121.
37. Sargent RG (1986). The use of graphical models in model validation. In: Wilson JR, Henriksen JO and Roberts SD (eds). Proceedings of the 1986 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 237-241.
38. Sargent RG (1990). Validation of mathematical models. In: Proceedings of Geoval-90: Symposium on Validation of Geosphere Flow and Transport Models. Stockholm, Sweden, pp 571-579.
39. Sargent RG (1991). Simulation model verification and validation. In: Nelson BL, Kelton WD and Clark GM (eds). Proceedings of the 1991 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 37-47.
40. Sargent RG (1996a). Some subjective validation methods using graphical displays of data. In: Charnes JM, Morrice DJ, Brunner DT and Swain JJ (eds). Proceedings of the 1996 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 345-351.
41. Sargent RG (1996b). Verifying and validating simulation models. In: Charnes JM, Morrice DJ, Brunner DT and Swain JJ (eds). Proceedings of the 1996 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 55-64.
42. Sargent RG (2000). Verification, validation, and accreditation of simulation models. In: Joines JA, Barton RR, Kang K and Fishwick PA (eds). Proceedings of the 2000 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 50-59.
43. Sargent RG (2001a). Graphical displays of simulation model data as statistical references. In: Ermakor SM, Kashtanov YN and Melas VB (eds). Simulation 2001 (Proceedings of the 4th St. Petersburg Workshop on Simulation). Chemistry Research Institute of St. Petersburg University, St. Petersburg, Russia, pp 109-118.
44. Sargent RG (2001b). Some approaches and paradigms for verifying and validating simulation models. In: Peters BA, Smith JS, Medeiros DJ and Rohrer MW (eds). Proceedings of the 2001 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 106-114. (Pubitemid 34091284)
45. Sargent RG (2005). Verification and validation of simulation models. In: Kuhl ME, Steiger NM, Armstrong FB and Joines JA (eds). Proceedings of the 2005 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 130-143. (Pubitemid 46188038)
46. Sargent RG (2010). A new statistical procedure for validation of simulation and stochastic models. Technical Report SYR-EECS-2010-06, Department of Electrical Engineering and Computer Science, Syracuse University, Syracuse, New York.
47. Sargent RG, Glasow PA, Kleijnen JPC, Law AM, McGregor I and Youngblood S (2000). Strategic directions in verification, validation, and accreditation research. In: Joines JA, Barton RR, Kang K and Fishwick PA (eds). Proceedings of the 2000 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 909-916. (Pubitemid 32873343)
48. Schruben LW (1980). Establishing the credibility of simulation models. Simulation 34(3): 101-105.
49. Szabo C and Teo YM (2012). An analysis of the cost of validating semantic composability. Journal of Simulation 11(3): 152-163.
50. U.S. General Accounting Office PEMD-88-3 (1987). DOD simulations: Improved assessment procedures would increase the credibility of results. U.S. General Accounting Office: Washington DC
51. Whitner RG and Balci O (1989). Guideline for selecting and using simulation model verification techniques. In: MacNair EA, Musselman KJ and Heidelberger P (eds). Proceedings of the 1989 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 559-568.
52. Wood DO (1986). MIT model analysis program: What we have learned about policy model review. In:Wilson JR, Henriksen JO and Roberts SD (eds). Proceedings of the 1986 Winter Simulation Conference. IEEE: Piscataway, NJ, pp 248-252.
53. Zeigler BP (1976). Theory of Modelling and Simulation. JohnWiley and Sons, Inc: New York.
54. Zeigler BP, Praehofer H and Kim TG (2000). Theory of Modelling and Simulation, 2nd edn. Academic Press: London.