On the use of kriging models to approximate deterministic computer models

Proceedings of the ASME Design Engineering Technical Conference

Volumn 1, Issue , 2004, Pages 481-492

  Martin, Jay D ^a   Simpson, Timothy W ^b  

^a State College   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Cross Validation; Kriging; Maximum Likelihood Estimation; Metamodel; Metamodel Error Assessment

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; COMPUTER AIDED DESIGN; DATA REDUCTION; INFORMATION ANALYSIS; MAXIMUM LIKELIHOOD ESTIMATION; METADATA; PARAMETER ESTIMATION; PROBABILITY DISTRIBUTIONS; REGRESSION ANALYSIS; STRUCTURAL OPTIMIZATION;

CROSS-VALIDATION; KRIGING; METAMODEL; METAMODEL ERROR ASSESSMENT;

COMPUTER SCIENCE;

EID: 14044253615     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1115/detc2004-57300     Document Type: Conference Paper

References (58)

1. Giunta, A. and Watson, L.T., "A Comparison of Approximation Modeling Technique: Polynomial Versus Interpolating Models," 7th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis & Optimization, AIAA-98-4758, AIAA, St. Louis, MO, 1998.
2. Simpson, T.W., Booker, A.J., Ghosh, S., Giunta, A., Koch, P.N., and Yang, R.J., "Approximation Methods in Multidisciplinary Analysis and Optimization: A Panel Discussion," Structural and Multidisciplinary Optimization, in press.
3. Meckesheimer, M., "A Framework for Metamodel-Based Design: Subsystem Metamodel Assessment and Implementation Issues," Ph.D. Dissertation, Industrial Engineering Dept., Pennsylvania State University, University Park, PA, 2001.
4. Batill, S.M., Renaud, J.E., and Gu, X., "Modeling and Simulation Uncertainty in Multidisciplinary Design Optimization," 8th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, AIAA 2000-4803, Long Beach, CA, 2000.
5. Barton, R.R., "Simulation Metamodels," Proceedings of the 1998 Winter Simulation Conference, 1998.
6. Currin, C., Mitchell, T.J., Morris, M.D., and Ylvisaker, D., "Bayesian Prediction of Deterministic Functions, With Applications to the Design and Analysis of Computer Experiments," Journal of the American Statistical Association, Vol. 86, No. 416, 1991, pp. 953-963.
7. Osio, I.G. and Amon, C.H., "An Engineering Design Methodology with Multistage Bayesian Surrogate and Optimal Sampling," Research in Engineering Design, Vol. 8, No. 4, 1996, pp. 189-206.
8. Pacheco, J.E., Amon, C.H., and Finger, S., "Bayesian Surrogates Applied to Conceptual Stages of the Engineering Design Process," Journal of Mechanical Design, Vol. 125, 2003, pp. 664-672.
9. Booker, A.J., Dennis, J.E., Jr., Frank, P.D., Serafini, D.B., Torczon, V., and Trosset, M., "A Rigorous Framework for Optimization of Expensive Functions by Surrogates," Structural Optimization, Vol. 17, No. 1, 1999, pp. 1-13.
10. Koch, P.N., Wujek, B.A., Golovidov, O., and Simpson, T.W., "Facilitating Probabilistic Multidisciplinary Design Optimization Using Kriging Approximation Models," 9th AIAA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, AIAA 2002-5415, Atlanta, GA, 2002.
11. Simpson, T.W., "Comparison of Response Surface and Kriging Models in the Multidisciplinary Design of an Aerospike Nozzle," Langley Research Center, NASA NASA/CR-1998-206935, Hampton, VA, Feb. 1998.
12. Yang, R.J., Wang, N., Tho, C.H., Bobineau, J.P., and Wang, B.P., "Metamodeling Development for Vehicle Frontal Impact Simulation," ASME 2001 Design Engineering Technical Conference, DETC2001/DAC-21012, Pittsburgh, PA, 2001.
13. Sacks, J., Welch, W.J., Mitchell, T.J., and Wynn, H.P., "Design and Analysis of Computer Experiments," Statistical Science, Vol. 4, No. 4, 1989, pp. 409-435.
14. Simpson, T.W., Peplinski, J., Koch, P.N., and Allen, J.K., "Metamodels for Computer-Based Engineering Design: Survey and Recommendations," Engineering with Computers, Vol. 17, No. 2, 2001, pp. 129-150.
15. Goldberger, A.S., "Best Linear Unbiased Prediction in the Generalized Linear Regression Model," Journal of the American Statistical Association, Vol. 57, 1962, pp. 369-375.
16. Journel, A.G and Huijbregts, C.J., Mining Geostatistics, Academic Press, New York, 1978.
17. Goovaerts, P., Geostatistics for Natural Resources Evaluation. Applied Geostatistics Series, ed. A.G Journal, Oxford University Press, New York, 1997, 483 p.
18. Ripley, B.D., Spatial Statistics. Wiley Series in Probability and Mathematical Statistics: Applied Probability & Math Section, John Wiley & Sons, New York, 1981, 252.
19. Cressie, N.A.C., Statistics for Spatial Data, John Wiley & Sons, Inc., New York, 1991.
20. Stein, M.L., Interpolation of Spatial Data : Some Theory for Kriging. Springer Series in Statistics, Springer-Verlag, New York, 1999.
21. Koehler, J.R. and Owen, A.B., Computer Experiments, in Handbook of Statistics, S. Ghosh and C.R. Rao, Editors. 1996, Elsevier Science: New York. p. 261-308.
22. Booker, A.J., "Design and Analysis of Computer Experiments," 7th AIAA/USAF/NASA ISSMO Symposium on Multidisciplinary Analysis and Optimization, AIAA-98-4757, St. Louis, MO, 1998.
23. Simpson, T.W., Maurey, T.M., Korte, J.J., and Mistree, F., "Kriging Metamodels for Global Approximation in Simulation-Based Multidisciplinary Design Optimization," AIAA Journal, Vol. 39, No. 12, 2001, pp. 2233-2241.
24. Ripley, B.D., Statistical Inference for Spatial Processes, Cambridge University Press, Cambridge, 1988.
25. Booker, A.J., Conn, A.R., Dennis, J.E., Jr., Frank, P.D., Trosset, M., and Torczon, V., "Global Modeling for Optimization: Boeing/IBM/Rice Collaborative Project 1995 Final Report," The Boeing Company ISSTECH-95-032, Seattle, WA, Dec. 1995.
26. Martin, J.D. and Simpson, T.W., "A Study on the Use of Kriging Models to Approximate Deterministic Computer Models," 2003 ASME Design Engineering Technical Conference, DETC2003/DAC48762, Chicago, IL, 2003.
27. Royston, P., "Remark AS R94: A Remark on Algorithm AS 181 the W-test for Normality," Applied Statistics, Vol. 44, No. 4, 1995, pp. 547-551.
28. Shapiro, S.S. and Wilk, M.B., "An Analysis of Variance Test for Normality (Complete Samples)," Biometrika, Vol. 52, No. 3/4, 1965, pp. 591-611.
29. Royston, P., "A Toolkit for Testing for Non-Normality in Complete and Censored Samples," The Statistician, Vol. 42, No. 1, 1993, pp. 37-43.
30. Mardia, K.V. and Marshall, R.J., "Maximum Likelihood Estimation of Models for Residual Covariance in Spatial Regression," Biometrika, Vol. 71, No. 1, 1984, pp. 135-146.
31. Kitanidis, P.K., "Parameter Uncertainty in Estimation of Spatial Functions: Bayesian Analysis," Water Resources Research, Vol. 22, 1986, pp. 499-507.
32. Mardia, K.V. and Watkins, A.J., "On Multimodality of the Likelihood in the Spatial Linear Model," Biometrika, Vol. 76, No. 2, 1989, pp. 289-295.
33. Warnes, J.J. and Ripley, B.D., "Problems with Likelihood Estimation of Covariance Function of Spatial Gaussian Processes," Biometrika, Vol. 74, 1987, pp. 640-2.
34. Fadeev, D.K. and Fadeeva, V.N., Computational Methods of Linear Algebra, W. H. Freeman and Company, San Francisco, CA, 1963.
35. Ababou, R., Bagtzoglou, A.C., and Wood, E.F., "On the Condition Number of Covariance Matrices in Kriging, Estimation, and Simulation of Random Fields," Mathematical Geology, Vol. 26, No. 1, 1994, pp. 99-133.
36. Sasena, M.J., "Flexibility and Efficiency Enhancements for Constrained Global Design Optimization with Kriging Approximations," Ph.D. Dissertation, Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI, 2002.
37. Booker, A.J., "Well-Conditioned Kriging Models for Optimization of Computer Simulations," The Boeing Company M&CT-TECH-00-002, Seattle, WA, Feb. 2000, p. 21.
38. Currin, C., Mitchell, T.J., Morris, M.D., and Ylvisaker, D., "A Bayesian Approach to the Design and Analysis of Computer Experiments," Oak Ridge National Laboratory ORNL-6498, Oak Ridge, TN.
39. Geisser, S. and Eddy, W.F., "A Predictive Approach to Model Selection," Journal of the American Statistical Association, Vol. 74, No. 365, 1979, pp. 153-160.
40. Martin, J.D. and Simpson, T.W., "On Using Kriging Models as Probabilistic Models in Design," 2004 SAE World Congress, 2004-01-0430, Detroit, MI, 2004.
41. Martin, J.D. and Simpson, T.W., "A Monte Carlo Simulation of the Kriging Model," 10th AIAA/ISSMO Symposium on Multidisciplincay Analysis and Optimization, Albany, NY, 2004.
42. Mitchell, T.J. and Morris, M.D., "Bayesian Design and Analysis of Computer Experiments: Two Examples," Statistica Sinica, Vol. 2, 1992, pp. 359-379.
43. Wahba, G, "A Comparison of GCV and GML for Choosing the Smoothing Parameter in the Generalized Spline Smoothing Problem," The Annals of Statistics, Vol. 13, No. 4, 1985, pp. 1378-1402.
44. Stein, M.L., "A Comparison of Generalized Cross Validation and Modified Maximum Likelihood for Estimating the Parameters of a Stochastic Process," The Annals of Statistics, Vol. 18, No. 3, 1990, pp. 1139-1157.
45. Wahba, G, Spline Models for Observational Data, Society for Industrial and Applied Mathematics, Philadelphia, PA, 1990.
46. Myers, R.H. and Montgomery, D.C., Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 2nd ed. ed. Wiley Series in Probability and Statistics, John Wiley & Sons, Inc., New York, 2002.
47. Meckesheimer, M., Booker, A.J., Barton, R.R., and Simpson, T.W., "Computationally Inexpensive Metamodel Assessment Strategies," AIAA Journal, Vol. 40, No. 10, 2002, pp. 2053-2060.
48. Laslert, GM., "Kriging and Splines: An Empirical Comparison of Their Predictive Performance in Some Applications," Journal of the American Statistical Association, Vol. 89, No. 426, 1994, pp. 391-400.
49. Akaike, H., "A New Look at the Statistical Model Identification," IEEE Transactions on Automatic Control, Vol. AC-19, No. 6, 1974, pp. 716-723.
50. Vecchia, A.V., "Estimation and Model Identification for Continuous Spatial Processes," Journal of the Royal Statistical Society, Series B, Vol. 50, 1988, pp. 297-312.
51. Andersen, D.R., Bumham, K.P., and White, G.C., "Comparison of Akaike Information Criterion and Consistent Akaike Information Criterion for Model Selection and Statistical Inference from Capture-Recapture Studies," Journal of Applied Statistics, Vol. 25, 1998, pp. 263-282.
52. Martin, J.D. and Simpson, T.W., "Use of Adaptive Metamodeling for Design Optimization," 9th AIAA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Atlanta, GA, 2002.
53. Jin, R., Chen, W., and Sudjianto, A., "On Sequential Sampling for Global Metamodeling in Engineering Design," 2002 ASME Design Engineering Technical Conference, DETC2002/DAC-34092, Montreal, Canada, 2002.
54. McKay, M.D., Conover, W.J., and Beckman, R.J., "A Comparison of Three Methods for Selecting Values of Input in the Analysis of Output from a Computer Code," Technometrics, Vol. 21, 1979, pp. 239-245.
55. Jones, D.R., Schonlau, M., and Welch, W.J., "Efficient Global Optimization of Expensive Black-Box Functions," Journal of Global Optimization, Vol. 13, 1998, pp. 455-492.
56. Nelder, J.A. and Mead, R., "A Simplex Method for Function Minimization," Computer Journal, Vol. 7, 1965, pp. 308-313.
57. Storn, R. and Price, K., "Differential Evolution - a Simple and Efficient Adaptive Scheme for Global Optimization over Continuous Space," ICSI Technical Report TR-95-012, 1995.
58. Abell, M.L., Braselton, J.P., and Rafter, J.A., Statistics with Mathematica, Academic Press, San Diego, CA, 1999.