Regression and Kriging metamodels with their experimental designs in simulation: A review

European Journal of Operational Research

Volumn 256, Issue 1, 2017, Pages 1-16

  Kleijnen, Jack P C ^a  

^a TILBURG UNIVERSITY   (Netherlands)

Author keywords

Design; Kriging; Metamodel; Regression; Robustness and sensitivity

Indexed keywords

DESIGN; GLOBAL OPTIMIZATION; INTERPOLATION; POLYNOMIALS; REGRESSION ANALYSIS;

EFFICIENT GLOBAL OPTIMIZATION; KRIGING; LATIN HYPERCUBE SAMPLING; LOW-ORDER POLYNOMIALS; META MODEL; REGRESSION; RESPONSE SURFACE METHODOLOGY; SEQUENTIAL BIFURCATION;

DESIGN OF EXPERIMENTS;

EID: 84990216175     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2016.06.041     Document Type: Review

References (62)

1. Angün, M.E., Black box simulation optimization: Generalized response surface methodology. CentER dissertation series, 2004, Tilburg University, Tilburg, Netherlands Also published in 2011 by VDM Verlag Dr. Müller, Saarbrücken, Germany.
2. Ankenman, B., Nelson, B., Staum, J., Stochastic Kriging for simulation metamodeling. Operations Research 58:2 (2010), 371–382.
3. Barton, R.R., Design of experiments for fitting subsystem metamodels. Andradóttir, S., Healy, K.J., Withers, D.H., Nelson, B.L., (eds.) Proceedings of the 1997 winter simulation conference, 1997, 303–310.
4. Barton, R.R., Meckesheimer, M., Metamodel-based simulation optimization. Henderson, S.G., Nelson, B.L., (eds.) Chapter 18 in handbooks in operations research and management science, Vol. 13, 2006, Elsevier, Amsterdam Simulation.
5. Bekki, J.M., Fowler, J.W., Mackulak, G.T., Kulahci, M., Simulation-based cycle-time quantile estimation in manufacturing settings employing non-FIFO dispatching policies. Journal of Simulation 3:2 (2009), 69–128 June.
6. Ben-Tal, A., Ghaoui, L.E., Nemirovski, A., Robust optimization, 2009, Princeton University Press, Princeton.
7. Bettonvil, B.W.M., Castillo, E.D., Kleijnen, J.P.C., Statistical testing of optimality conditions in multiresponse simulation-based optimization. European Journal of Operational Research 199:2 (2009), 448–458.
8. Bischl, B., Mersmann, O., Trautmann, H., Weihs, C., Resampling methods for meta-model validation with recommendations for evolutionary computation. Evolutionary Computation 20:2 (2012), 249–275.
9. Borgonovo, E., Plischke, E., Sensitivity analysis: a review of recent advances. European Journal of Operational Research 248:3 (2016), 869–887.
10. Box, G.E.P., Wilson, K.B., On the experimental attainment of optimum conditions. Journal Royal Statistical Society, Series B 13:1 (1951), 1–38.
11. Chang, K.-H., Li, M.-K., Wan, H., Combining STRONG with screening designs for large-scale simulation optimization. IIE Transactions 46:4 (2014), 357–373.
12. Chen, V.C.P., Tsui, K.-L., Barton, R.R., Meckesheimer, M., A review on design, modeling, and applications of computer experiments. IIE Transactions 38 (2006), 273–291.
13. Chen, X., Kim, K.-K., Building metamodels for quantile-based measures using sectioning. Pasupathy, R., Kim, S.-H., Tolk, A., Hill, R., Kuhl, M.E., (eds.) Proceedings of the 2013 winter simulation conference, 2013, 521–532.
14. Chevalier, C., Ginsbourger, D., Bect, J., Vazquez, E., Picheny, V., Richet, Y., Fast parallel kriging-based stepwise uncertainty reduction with application to the identification of an excursion set. Technometrics 56:4 (2014), 455–465.
15. Cousin, A., Maatouk, H., Rullière, D., Kriging of financialterm-structures, 2015 https://hal.archives-ouvertes.fr/hal-01206388. Accessed 13.06.16.
16. Crombecq, K., Laermans, E., Dhaene, T., Efficient space-filling and non-collapsing sequential design strategies for simulation-based modeling. European Journal of Operational Research 214 (2011), 683–696.
17. Dellino, G., Kleijnen, J.P.C., Meloni, C., Robust optimization in simulation: Taguchi and Krige combined. INFORMS Journal on Computing 24:3 (2012), 471–484.
18. Efron, B., Frequentist accuracy of Bayesian estimates. Royal Statistical Society's Series B Journal 77:part 3 (2015), 617–646.
19. Fédou, J.-M., Rendas, M.-J., Extending morris method: identification of the interaction graph using cycle-equitable designs. Journal of Statistical Computation and Simulation 85:7 (2015), 1398–1419.
20. Gordy, M.B., Juneja, S., Nested simulation in portfolio risk measurement. Management Science 56:11 (2010), 1833–1848.
21. Helton, J.C., Hansen, C.W., Swift, P.N., Performance assessment for the proposed high-level radioactive waste repository at yucca mountain, nevada. Reliability Engineering and System Safety 122 (2014), 1–6.
22. Jalali, H., Van Nieuwenhuyse, I., Simulation optimization in inventory replenishment: a classification. IIE Transactions, accepted, 2015.
23. Jones, D.R., Schonlau, M., Welch, W.J., Efficient global optimization of expensive black-box functions. Journal of Global Optimization 13 (1998), 455–492.
24. Kamiński, B., A method for updating of stochastic Kriging metamodels. European Journal of Operational Research, accepted, 2015.
25. Khuri, A.I., Mukhopadhyay, S., Response surface methodology. Wiley Interdisciplinary Reviews: Computational Statistics 2 (2010), 128–149.
26. Kleijnen, J.P.C., An overview of the design and analysis of simulation experiments for sensitivity analysis. European Journal of Operational Research 164:2 (2005), 287–300.
27. Kleijnen, J.P.C., Kriging metamodeling in simulation: a review. European Journal of Operational Research 192:3 (2009), 707–716.
28. Kleijnen, J.P.C., Design and analysis of simulation experiments, 2nd, 2015, Springer.
29. Kleijnen, J.P.C., Van Beers, W.C.M., Monotonicity-preserving bootstrapped Kriging metamodels for expensive simulations. Journal Operational Research Society 64 (2013), 708–717.
30. Kleijnen, J.P.C., Beers, W.C.M.V., Nieuwenhuyse, I.V., Constrained optimization in simulation: a novel approach. European Journal of Operational Research 202:1 (2010), 164–174.
31. Kleijnen, J.P.C., Deflandre, D., Validation of regression metamodels in simulation: bootstrap approach. European Journal of Operational Research 170:1 (2006), 120–131.
32. Kleijnen, J.P.C., Gaury, E.G.A., Short-term robustness of production-management systems: a case study. European Journal of Operational Research 148:2 (2003), 452–465.
33. Kleijnen, J.P.C., Pierreval, H., Zhang, J., Methodology for determining the acceptability of system designs in uncertain environments. European Journal of Operational Research 209:2 (2011), 176–183.
34. Koch, P., Wagner, T., Emmerich, M.T.M., Bäck, T., Konen, W., Efficient multi-criteria optimization on noisy machine learning problems. Applied Soft Computing 29 (2015), 357–370.
35. Law, A.M., Simulation modeling and analysis, 5th, 2015, McGraw-Hill, Boston.
36. Lee, K.-H., Park, G.-J., A global robust optimization using Kriging based approximation model. Journal of the Japanese Society for Mechanical Engineering 49:3 (2006), 779–788.
37. Loeppky, J.L., Sacks, J., Welch, W., Choosing the sample size of a computer experiment: a practical guide. Technometrics 51:4 (2009), 366–376.
38. Lophaven, S.N., Nielsen, H.B., Sondergaard, J., DACE: A Matlab Kriging toolbox, version 2.0, 2002, IMM Technical University of Denmark, Kongens Lyngby.
39. Maatouk, H., & Bay, X. (2016). Gaussian process emulators for computer experiments with inequality constraints. arXiv:1606.01265v1.
40. Markiewicz, A., Szczepańska, A., Optimal designs in multivariate linear models. Statistics & Probability Letters 77 (2007), 426–430.
41. Montgomery, D.C., Design and analysis of experiments, 7th, 2009, Wiley, Hoboken, NJ.
42. Myers, R.H., Montgomery, D.C., Anderson-Cook, C.M., Response surface methodology: process and product optimization using designed experiments, 3rd, 2009, Wiley, New York.
43. Nelson, B.L., ‘some tactical problems in digital simulation’ for the next 10 years. Journal of Simulation 10 (2016), 2–11.
44. Preuss, M., Wagner, T., Ginsbourger, D., High-Dimensional Model-Based Optimization Based on Noisy Evaluations of Computer Games. Hamadi, Y., Schoenauer, M., (eds.) LION 6, LNCS 7219, 2012, Springer-Verlag Berlin Heidelberg, 145–159.
45. Qu, H., Fu, M.C., Gradient extrapolated stochastic kriging. ACM Transactions on Modeling and Computer Simulation 24:4 (2014), 23:1–23:25.
46. Qu, X., Statistical properties of rechtschaffner designs. Journal of Statistical Planning and Inference 137 (2007), 2156–2164.
47. Rasmussen, C.E., Williams, C., Gaussian processes for machine learning, 2006, MIT Press, Cambridge, Massachusetts.
48. Ryan, K.J., Bulutoglu, D.A., Minimum aberration fractional factorial designs with large n. Technometrics 52:2 (2010), 250–255.
49. Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., et al. Global sensitivity analysis: The primer, 2008, Wiley.
50. Santos, M.I., Santos, P.M., Switching regression metamodels in stochastic simulation. European Journal of Operational Research 251:1 (2016), 142–147.
51. Shi, W., Kleijnen, J.P.C., Liu, Z., Factor screening for simulation with multiple responses: sequential bifurcation. European Journal of Operational Research 237:1 (2014), 136–147.
52. Shrivastava, A.K., Ding, Y., Graph based isomorph-free generation of two-level regular fractional factorial designs. Journal of Statistical Planning and Inference 140 (2010), 169–179.
53. Turner, A.J., Balestrini-Robinson, S., Mavris, D., Heuristics for the regression of stochastic simulations. Journal of Simulation 7 (2013), 229–239.
54. Ulaganathan, S., Couckuyt, I., Dhaene, T., Laermans, E., On the use of gradients in kriging surrogate models. Tolk, A., Diallo, S.Y., Ryzhov, I.O., Yilmaz, L., Buckley, S., Miller, J.A., (eds.) Proceedings of the 2014 winter simulation conference, 2014, 2692–2701.
55. Van Beers, W.C.M., Kleijnen, J.P.C., Customized sequential designs for random simulation experiments: Kriging metamodeling and bootstrapping. European Journal of Operational Research 186:3 (2008), 1099–1113.
56. Wan, H., Ankenman, B.E., Nelson, B.L., Improving the efficiency and efficacy of controlled sequential bifurcation for simulation factor screening. INFORMS Journal on Computing 22:3 (2010), 482–492.
57. Wei, P., Lu, Z., Song, J., Variable importance analysis: a comprehensive review. Reliability Engineering and System Safety 142 (2015), 399–432.
58. Woods, D. C., & Lewis, S. M. (2015). Design of experiments for screening. arXiv:1510.05248.
59. Wu, C.F.J., Hamada, M., Experiments: planning, analysis, and parameter design optimization, 2nd, 2009, Wiley, New York.
60. Yanikoğlu, I., den Hertog, D., Kleijnen, J.P.C., Adjustable robust parameter design with unknown distributions. IIE Transactions 48:3 (2016), 298–312.
61. Yin, J., Ng, S.H., Ng, K.M., A study on the effects of parameter estimation on Kriging model's prediction error in stochastic simulation. Rossini, M.D., Hill, R.R., Johansson, B., Dunkin, A., Ingalls, R.G., (eds.) Proceedings of the 2009 winter simulation conference, 2009, 674–685.
62. Yuan, J., Ng, S.H., Calibration, validation and prediction in random simulation models: Gaussian process metamodels and a bayesian integrated solution. Transactions on Modeling and Computer Simulation 25:3 (2015), 1–25 Article 18.