A systematic comparison of metamodeling techniques for simulation optimization in Decision Support Systems

Applied Soft Computing Journal

Volumn 10, Issue 4, 2010, Pages 1257-1273

  Li, Y F ^a   Ng, S H ^a   Xie, M ^a   Goh, T N ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Artificial intelligence; Decision making process; Decision support system; Simulation metamodel; Simulation optimization

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPLEX NETWORKS; DECISION MAKING; DEEP NEURAL NETWORKS; EFFICIENCY; GENETIC ALGORITHMS; NEURAL NETWORKS; RADIAL BASIS FUNCTION NETWORKS; REAL TIME SYSTEMS; REGRESSION ANALYSIS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

DECISION MAKING PROCESS; EFFICIENCY AND RELIABILITY; META MODEL; META-MODELING TECHNIQUE; MULTIVARIATE ADAPTIVE REGRESSION SPLINES; SIMULATION OPTIMIZATION; STOCHASTIC SIMULATIONS; SUPPORT VECTOR REGRESSION (SVR);

DECISION SUPPORT SYSTEMS;

EID: 78049279737     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2009.11.034     Document Type: Article

References (56)

1. D.J. Power, R. Shardab, Model-driven decision support systems: Concepts and research directions, Decision Support Systems 43 (2007) 1044-1061.
2. A.G. Greenwood, S. Vanguri, B. Eksioglu, P. Jain, T.W. Hill, J.W. Miller, C.T. Walden, Simulation optimization decision support system for ship panel shop operations, in: Proceedings of the 2005 Winter Simulation Conference, Vol. 1, 2005, pp. 2078-2086.
3. J.P. Shim, M. Warkentin, J.F. Courtney, D.J. Power, R. Sharda, C. Carlsson, Past, present, and future of decision support technology, Decision Support Systems 33 (2) (2002) 111-126.
4. J.P.C. Kleijnen, Statistical Tools for Simulation Practitioners, Marcel Dekker, New York, 1987.
5. H. Nakayama, M. Arakawa, R. Sasaki, Simulation-based optimization usingcomputational intelligence, Optimization and Engineering 3 (2) (2002) 201-214.
6. X.T. Wan, J.F. Pekny, G.V. Reklaitis, Simulation-based optimization with surrogate models-application to supply chain management, Computers and Chemical Engineering 29 (2005) 1317-1328.
7. G.G. Wang, S. Shan, Review of metamodeling techniques in support of engineering design optimization, Transactions of the ASME, Journal of Mechanical Design 129 (4) (2007) 370-380.
8. T.W. Simpson, T.M. Mauery, J.J. Korte, F. Mistree, Comparison of response surface and kriging models for multidisciplinary design optimization, in: Proc. 7th AIAA/USAF/NASA/ISSMO Symp. on Multidisciplinary Analysis & Optimization, Vol. 1, St. Louis, MO, 1998, pp. 381-391.
9. R. Jin, W. Chen, T.W. Simpson, Comparative studies of metamodeling techniques under multiple modelling criteria, Structural and Multidisciplinary Optimization 23 (1) (2001) 1-13.
10. H. Fanga, M. Rais-Rohanib, Z. Liuc, M.F. Horstemeyera, A comparative study of metamodeling methods for multiobjective crashworthiness optimization, Computers and Structures 83 (25-26) (2005) 2121-2136.
11. J.H. Friedman, Multivariate adaptive regression splines, Annals Statistics 19 (1991) 1-141.
12. W.C.M. van Beers, J.P.C. Kleijnen, Kriging for interpolation in random simulation, Journal of the Operational Research Society 54 (3) (2003) 255-262.
13. J.P.C. Kleijnen, W.C.M. van Beers, Application-driven sequential designs for simulation experiments: Kriging metamodeling, Journal of the Operational Research Society 55 (8) (2004) 876-883.
14. J.P.C. Kleijnen, W.C.M. van Beers, Robustness of Kriging when interpolating in random simulation with heterogeneous variances: Some experiments, European Journal of Operational Research 165 (3) (2005) 826-834.
15. M. Shin, R.G. Sargent, A.L. Goel, Gaussian radial basis functions for simulation metamodeling, Proceedings of the 2002 Winter Simulation Conference 1 (2002) 483-488.
16. G. Meghabghab, A. Kandel, Stochastic simulations of Web search engines: RBF versus second-order regression models, Information Sciences 159 (1-2) (2004) 1-28.
17. D.J. Fonseca, D. Navaresse, Artificial neural networks for job shop simulation, Advanced Engineering Informatics 16 (4) (2002) 241-246.
18. D.J. Fonseca, D.O. Navaresse, G.P. Moynihan, Simulation metamodeling through artificial neural networks, Engineering Applications of Artificial Intelligence 16 (2003) 177-183.
19. S.M. Clarke, J.H. Griebsch, T.W. Simpson, Analysis of support vector regression for approximation of complex engineering analyses, Journal of Mechanical Design 127 (6) (2005) 1077-1087.
20. J.P.C. Kleijnen, Kriging metamodeling in simulation: a review, European Journal of Operational Research 192 (3) (2009) 707-716.
21. N.A.C. Cressie, Statistics for Spatial Data, Wiley, New York, 1993.
22. V.R. Joseph, Limit Kriging, Technometrics 48 (4) (2006) 458-466.
23. J. Sacks, W.J. Welch, T.J. Mitchell, H.P. Wynn, Design and analysis of computer experiments, Statistical Science 4 (1989) 409-435.
24. S.N. Lophaven, H.B. Nielsen, J. Sondergaard, 2002. Aspects of the Matlab Toolbox DACE. Report IMM-REP-2002-13, Informatics and Mathematical Modeling, DTU. 44 pp.
25. J. Lawrence, Introduction to Neural Networks: Design, Theory, and Applications, California Scientific Software, Nevada City, CA, 1994.
26. M. Nasereddin, M. Mansooreh, The development of a methodology for the use of neural networks and simulation modeling in system design, in: Proceedings of the 31st Conference on Winter Simulation, vol. 1, 1999, pp. 537-542.
27. S. Haykin, Neural Networks: A Comprehensive Foundation, Prentice Hall PTR, NJ, USA, 1998.
28. M.T. Hagan, H.B. Demuth, M.H. Beale, Neural Network Design, PWS Publishing Co, Boston, MA, 1997.
29. R.L. Hardy, Multiquadratic equations of topography and other irregular surfaces, Journal of Geophysics Research 76 (1971) 1905-1915.
30. G. Meghabghab, Iterative radial basis functions neural networks as metamodels of stochastic simulations of the quality of search engines in the World Wide Web, Information Processing & Management 37 (4) (2001) 571-591.
31. V. Vapnik, The Nature of Statistical Learning Theory, Springer, New York, 1995.
32. T. Evgeniou, M. Pontil, T. Poggio, Regularization Networks and Support Vector Machines, Advances in Computational Mathematics 13 (1) (2000) 1-5.
33. S.S. Rao, Engineering Optimization, third ed., Wiley, New York, 1996.
34. J.S. Arora, Introduction to Optimum Design, McGraw-Hill, New York, 1989.
35. M.F. Hussain, R.R. Barton, S.B. Joshi, Metamodeling: radial basis functions, versus polynomials, European Journal of Operational Research 138 (1) (2002) 142-154.
36. R. Nicolai, R. Dekker, Automated response surface methodology for simulation optimization models with unknown variance, Quality Technology & Quantitative Management 6 (3) (2009) 1-28.
37. A.C. Keys, L.P. Rees, A sequential-design metamodeling strategy for simulation optimization, Computers and Operations Research 31 (11) (2004) 1911-1932.
38. R.A. Kilmer, A.E. Smithb, L.J. Shuman, Computing confidence intervals for stochastic simulation using neural network metamodels, Computers and Industrial Engineering 36 (1999) 391-407.
39. W.E. Biles, J.P.C. Kleijnen, W.C.M. van Beers, I. van Nieuwenhuyse, Kriging metamodeling in constrained simulation optimization: an explorative study, Proceedings of Winter Simulation Conference 2007 (2007) 355-362.
40. P.M.R. dos Santos, M.I.R. dos Santos, Using subsystem linear regression metamodels in stochastic simulation, European Journal of Operational Research 196 (3) (2009) 1031-1040.
41. M.D. McKay, R.J. Beckman, W.J. Conover, A comparison of three methods for selecting values of input variables in the analysis of output from a computer code, Technometrics 21 (1979) 239-245.
42. D. Jones, M. Schonlau, W. Welch, Efficient global optimization of expensive black-box functions, Journal of Global Optimization 13 (1998) 455-492.
43. R.D. Hurrion, S. Birgil, A comparison of factorial and random experimental design methods for the development of regression and neural network simulation metamodels, Journal of the Operational Research Society 50 (1999) 1018-1033.
44. J. Holland, Adaptation in Natural and Artificial Systems, University of Michigan Press, Ann Arbor, MI, USA, 1975.
45. D.E. Goldberg, K. Deb, J.H. Clark, Genetic algorithms, noise, and the sizing of populations, Complex Systems (1992) 333-362.
46. D. Doval, S. Mancoridis, B.S. Mitchell, Automatic clustering of software systems using a genetic algorithm, in: Proceedings 9th International Workshop Software Technology and Engineering Practice, 1999, pp. 73-81.
47. Y.F. Li, M. Xie, T.N. Goh, A study of project selection and feature weighting for analogy based software cost estimation, Journal of Systems and Software 82 (2) (2009) 241-252.
48. G. Rudolph, Convergence analysis of canonical genetic algorithms, IEEE Transactions on Neural Networks 5 (1) (1994) 96-101.
49. H. Ahn, K. Kim, I. Han, Hybrid genetic algorithms and case-based reasoning systems for customer classification, Expert Systems 23 (3) (2006) 127-144.
50. T. Hastie, R. Tibshirani, J.H. Friedman, The Elements of Statistical Learning, Springer, 2003.
51. A.C. Lorena, A. de Carvalho, Evolutionary tuning of SVM parameter values in multiclass problems, Neurocomputing 71 (16-18) (2008) 3326-3334.
52. C. Gold, A. Holub, P. Sollich, Bayesian approach to feature selection and parameter tuning for support vector machine classifiers, Neural Networks 18 (5-6) (2005) 693-701.
53. K.T. Fang, D.K. Lin, P. Winker, Y. Zhang, Uniform design: theory and application, Technometrics 42 (2000) 237-248.
54. H. Niederreiter, Random Number Generation and quasi-Monte-Carlo Methods, SAIM, Philadelphia, 1992.
55. F.M. Alam, K.R. McNaught, T.J. Ringrose, A comparison of experimental designs in the development of a neural network simulation metamodel, Simulation Modelling Practice and Theory 12 (7-8) (2004) 559-578.
56. A.J. Smola, B. Schölkopf, K.R. Muller, The connection between regularization operators and Support Vector kernels, Neural Networks 11 (4) (1998) 637-649.