An overview of the design and analysis of simulation experiments for sensitivity analysis

European Journal of Operational Research

Volumn 164, Issue 2, 2005, Pages 287-300

  Kleijnen, Jack P C ^a  

^a TILBURG UNIVERSITY   (Netherlands)

Author keywords

Regression; Risk analysis; Scenarios; Simulation; Uncertainty modelling

Indexed keywords

COMPUTER SIMULATION; OPTIMIZATION; REGRESSION ANALYSIS; RISK ASSESSMENT; ROBUSTNESS (CONTROL SYSTEMS); SENSITIVITY ANALYSIS;

SCENARIOS; SIMULATION MODEL; UNCERTAIN MODELING; VALIDATION;

OPERATIONS RESEARCH;

EID: 10444244845     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2004.02.005     Document Type: Article

References (41)

1. Alam, F.M., McNaught, K.R., Ringrose, T.J., 2003. A comparison of experimental designs in the development of a neural network simulation metamodel. Simulation Modelling: Practice and Theory (accepted conditionally).
2. Angün, E., Den Hertog, D., Gürkan, G., Kleijnen, J.P.C., 2002. Response surface methodology revisited. In: Yücesan, E., Chen, C.H., Snowdon, J.L., Charnes, J.M. (Eds.), Proceedings of the 2002 Winter Simulation Conference, Institute of Electrical and Electronics Engineers, Piscataway, NJ, pp. 377-383.
3. Antioniadis, A., Pham, D.T., 1998. Wavelet regression for random or irregular design. Computational Statistics and Data Analysis 28, 353-369.
4. Bettonvil, B., Kleijnen, J.P.C., 1996. Searching for important factors in simulation models with many factors: sequential bifurcation. European Journal of Operational Research 96 (1), 180-194.
5. Bettonvil, B., Kleijnen, J.P.C., 1990. Measurement scales and resolution IV designs. American Journal of Mathematical and Management Sciences 10 (3-4), 309-322.
6. Cheng, R.C.H., Kleijnen, J.P.C., 1999. Improved design of simulation experiments with highly heteroskedastic responses. Operations Research 47 (5), 762-777.
7. Clarke, S.M., Griebsch, J.H., Simpson, T.W., 2003. Analysis of support vector regression for approximation of complex engineering analyses. Proceedings of DETC'03, ASME 2003 Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Chicago.
8. Cressie, N.A.C., 1993. Statistics for Spatial Data. Wiley, New York.
9. Den Hertog, D., Kleijnen, J.P.C., Siem, A.Y.D., 2004. The correct Kriging variance. (Preliminary title) Working Paper, CentER, Tilburg University, Tilburg, The Netherlands (preprint: http://center.kub.nl/staff/kleijnen/papers. html).
10. Donohue, J.M., Houck, E.C., Myers, R.H., 1993. Simulation designs and correlation induction for reducing second-order bias in first-order response surfaces. Operations Research 41 (5), 880-902.
11. Horne, G., Leonardi, M. (Eds.), 2001. Maneuver Warfare Science 2001. Defense Automatic Printing Service, Quantico, VA.
12. Jin, R., Chen, W., Sudjianto, A., 2002. On sequential sampling for global metamodeling in engineering design. In: Proceedings of DETC'02, ASME 2002 Design Engineering Technical Conferences and Computers and Information in Engineering Conference, DETC 2002/DAC-34092, September 29-October 2, Montreal, Canada.
13. Kleijnen, J.P.C., 2004. Design and analysis of Monte Carlo experiments. In: Gentle, J.E., Haerdle, W., Mori Y. (Eds.), Handbook of Computational Statistics; vol. I: Concepts and Fundamentals. Springer, Heidelberg.
14. Kleijnen, J.P.C., 1998. Experimental design for sensitivity analysis, optimization, and validation of simulation models. In: Banks, J. (Ed.), Handbook of Simulation. Wiley, New-York, pp. 173-223.
15. Kleijnen, J.P.C., 1992. Regression metamodels for simulation with common random numbers: comparison of validation tests and confidence intervals. Management Science 38 (8), 1164-1185.
16. Kleijnen, J.P.C., 1987. Statistical tools for simulation practitioners. Marcel Dekker, New York.
17. Kleijnen, J.P.C., 1975. Statistical techniques in simulation, vol. II. Marcel Dekker, New York [Russian translation, Publishing House "Statistics", Moscow, 1978].
18. Kleijnen, J.P.C., Sanchez, S.M., Lucas, T.W., Cioppa, T.M., 2004a. A user's guide to the brave new world of designing simulation experiments. INFORMS Journal on Computing (accepted conditionally).
19. Kleijnen, J.P.C., Bettonvil, B., Person, F., 2004b. Finding the important factors in large discrete-event simulation: sequential bifurcation and its applications. In: Dean, A.M., Lewis, S.M. (Eds.), Screening, Springer, New York (forth-coming; preprint: http://center.kub.nl/staff/kleijnen/papers. html).
20. Kleijnen, J.P.C., Sargent, R.G., 2000. A methodology for the fitting and validation of metamodels in simulation. European Journal of Operational Research 120 (1), 14-29.
21. Kleijnen, J.P.C., Smits, M.T., 2003. Performance metrics in supply chain management. Journal Operational Research Society 54 (5), 507-514.
22. Kleijnen, J.P.C., Van Beers, W.C.M., 2004a. Robustness of Kriging when interpolating in random simulation with heterogeneous variances: Some experiments. European Journal of Operational Research (accepted conditionally).
23. Kleijnen, J.P.C., Van Beers, W.C.M., 2004b. Application-driven sequential designs for simulation experiments: Kriging meta-modeling. Journal of the Operational Research Society (in press).
24. Koehler, J.R., Owen, A.B., 1996. Computer experiments. In: Ghosh, S., Rao, C.R. (Eds.), Handbook of Statistics, vol. 13. Elsevier, Amsterdam, pp. 261-308.
25. Law, A.M., Kelton, W.D., 2000. Simulation Modeling and Analysis, third ed. McGraw-Hill, New York.
26. Lophaven, S.N., Nielsen, H.B., Sondergaard, J., 2002. DACE: a Matlab Kriging toolbox, version 2.0. Lyngby (Denmark), IMM Technical University of Denmark.
27. McKay, M.D., Beckman, R.J., Conover, W.J., 1979. A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21 (2), 239-245 (reprinted in 2000: Technometrics 42 (1), 55-61).
28. McKay, M.D., Beckman, R.J., Conover, W.J., 1979. A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21 (2), 239-245 (reprinted in 2000: Technometrics 42 (1), 55-61).
29. Meckesheimer, M., Barton, R.R., Limayem, F., Yannou, B., 2001. Metamodeling of combined discrete/continuous responses. AIAA Journal 39, 1950-1959.
30. Rechtschaffner, R.L., 1967. Saturated fractions of 2n and 3n factorial designs. Technometrics 9, 569-575.
31. Sacks, J., Welch, W.J., Mitchell, T.J., Wynn, H.P., 1989. Design and analysis of computer experiments. Statistical Science 4 (4), 409-435.
32. Santner, T.J., Williams, B.J., Notz, W.I., 2003. The design and analysis of computer experiments. Springer, New York.
33. Schruben, L.W., Margolin, B.H., 1978. Pseudorandom number assignment in statistically designed simulation and distribution sampling experiments. Journal American Statistical Association 73 (363), 504-525.
34. Simpson, T.W., Mauery, T.M., Korte, J.J., Mistree, F., 2001. Kriging metamodels for global approximation in simulation-based multidisciplinary design optimization. AIAA Journal 39 (12), 2233-2241.
35. Spall, J.C., 2003. Introduction to Stochastic Search and Optimization; Estimation, Simulation, and Control. Wiley, Hoboken, NJ.
36. Taguchi, G., 1987. System of Experimental Designs, vol. 1 and 2. UNIPUB/Krauss International, White Plains, NY.
37. Van Groenendaal, W.J.H., 1998. The Economic Appraisal of Natural Gas Projects. Oxford University Press, Oxford.
38. Vonk Noordegraaf, A., 2002. Simulation modelling to support national policy making in the control of bovine herpes virus 1. Doctoral dissertation, Wageningen University, Wageningen, The Netherlands.
39. Yamada, S., Lin, D.K.J., 2002. Construction of mixed-level supersaturated design. Metrika (56), 205-214, Available online: http://springerlink.metapress.com/app/home/content.asp?wasp= 4h8ac83qyg2rvm91wa7w&referrer=contribution&format=2&page=1.
40. Ye, K.Q., 1998. Orthogonal column Latin hypercubes and their application in computer experiments. Journal Association Statistical Analysis, Theory and Methods (93), 1430-1439.
41. Zeigler, B.P., Praehofer, K., Kim, T.G., 2000. Theory of Modeling and Simulation, second ed. Academic Press, New York.