On the use of statistics in design and the implications for deterministic computer experiments

Proceedings of the ASME Design Engineering Technical Conference

Volumn 3, Issue , 1997, Pages

  Simpson, Timothy W ^a   Peplinski, Jesse ^a   Koch, Patrick N ^a   Allen, Janet K ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

D optimal; design of experiments; inductive learning; kriging; metamodeling; neural networks; response surface methodology; Taguchi robust design

Indexed keywords

COMPUTATION THEORY; DESIGN OF EXPERIMENTS; LEARNING SYSTEMS; SIGNAL TO NOISE RATIO; STATISTICS; TAGUCHI METHODS;

COMPUTER EXPERIMENT; DESIGN IMPROVEMENTS; ENGINEERING DESIGN; META-MODELING TECHNIQUE; OPTIMIZATION ROUTINE; ORDERS OF MAGNITUDE; RESPONSE SURFACE METHODOLOGY; STATISTICAL TECHNIQUES;

CODES (SYMBOLS);

EID: 84888831107     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1115/DETC97/DTM-3881     Document Type: Conference Paper

References (83)

1. Balabanov, V., Kaufman, M., Knill, D.L., Haim, D., Golovidov, 0. and Giunta, A.A., 1996, "Dependence of Optimal Structural Weight on Aerodynamic Shape for a High Speed Civil Transport," 6th AIAA/USAF/NASA/ISSMO Multidisciplinary Anal. and Opt. Symp., Bellevue, WA, AIAA, Vol. 1, pp. 599-612
2. Barthelemy, J.-F.M., Haftka, R.T., 1993, "Approximation Concepts for Optimum Structural Design - A Review," Structural Optimization, Vol. 5, pp. 129-144
3. Bauer, D. and Krebs, R., 1996, "Optimization of Deep Drawing Processes Using Statistical Design of Experiments," 22nd Design Automation Conference (McCarthy, J. M., ed.), Irvine, CA, ASME, Paper 96-DETC/DAC-1446
4. Beard, J.E. and Sutherland, J.W., 1993, "Robust Suspension System Design," Advances in Design Automation (Gilmore, B.J., et al., eds.). Albuquerque, NM, ASME, Vol. 65-1, pp. 387-395
5. Boning, D.S. and Mozumder, P.K., 1994, "DOE/Opt: A System for Design of Experiments, Response Surface Modeling, and Optimization Using Process and Device Simulation," IEEE Trans. on Semiconductor Manufacturing, Vol. 7(2), pp. 233-244
6. Booth, R., Dupas, L., Cartuyvels, R. and De Meyer, K., 1991, "New Technique to Improve Response Surface Method Model Fitting Accuracy for Process Technology and Device Design Optimization," International Workshop on VLSI Process and Device Modeling (VPAD), Oiso Kanagawa, Japan
7. Box, G.E.P. and Draper, N.R., 1987, Empirical Model-Building and Response Surfaces, John Wiley & Sons, NY
8. Box, G.E.P., Hunter, W.G. and Hunter, J.S., 1978, Statistics for Experimenters, John Wiley & Sons, NY
9. Byrne, D.M. and Taguchi, S., 1987, "The Taguchi Approach to Parameter Design," 40th Annual Quality Congress Transactions, Milwaukee, WI, American Society for Quality Control
10. Cartuyvels, R. and Dupas, L., 1993, "NORMAN/DEBORA: A Powerful CAD-Integrating Automatic Sequencing System Including Advanced DOE/RSM Techniques for Various Engineering Optimization Problems," JSPE-IFIP WC 5.3 DIISM?93 Workshop (Design of Information Infrastructure Systems for Manufacturing), Tokyo
11. Chen, W., Allen, J.K., Mavris, D. and Mistree, F., 1996a, "A Concept Exploration Method for Determining Robust Top-Level Specifications," Engineering Optimization, Vol. 26, pp. 137-158
12. Chen, W., Simpson, T.W., Allen, J.K. and Mistree, F., 1996b, "Use of Design Capability Indices to Satisfy a Ranged Set of Design Requirements," ASME Design Automation Conference (Dutta, D., ed.), Irvine, CA, ASME, Paper 96-DETC/DAC-1090
13. Chen, W., Allen, J.K., Mistree, F. and Tsui, K.-L., 1995, "Integration of Response Surface Methods with the Compromise Decision Support Problem in Developing a General Robust Design Procedure," ASME Design Automation Conference (Azarm, S., et al., eds.), Boston, MA, ASME, DE-Vol. 82-2, pp. 485-492
14. Cheng, B. and Titterington, D.M., 1994, "Neural Networks: A Review from a Statistical Perspective," Statistical Science, Vol. 9, pp. 2-54
15. Chi, H.-W. and Bloebaum, C.L., 1995, "Mixed Variable Optimization Using Taguchi?s Orthogonal Arrays," Advances in Design Automation Conference (Azarm, S., et al., eds.), Boston, MA, ASME, Vol. 68-1, pp. 501-508
16. Cressie, N., 1989, "Geostatistics," American Statistician, Vol. 43(4), pp. 197-202
17. Cressie, N., 1988, "Spatial Prediction and Ordinary Kriging," Mathematical Geologoy, Vol. 20(4), pp. 405-421
18. Draper, N.R. and Lin, D.K.J., 1990a, "Connections Between Two-Level Designs of Resolutions III and V," Technometrics, Vol. 32(3), pp. 283-288
19. Draper, N.R. and Lin, D.K.J., 1990b, "Small Response-Surface Designs," Technometrics, Vol. 32(2), pp. 187-194
20. Engelund, W.C., Douglas, O.S., Lepsch, R.A., McMillian, M.M. and Unal, R., 1993, "Aerodynamic Configuration Design Using Response Surface Methodology Analysis," AIAA Aircraft Design, Sys. & Oper. Mngmt., Monterey, CA, Paper 93-3967
21. Evans, B. and Fisher, D., 1994, "Overcoming Process Delays with Decision Tree Induction," IEEE Expert, Vol. 9, pp. 60-66
22. Gadallah, M.H. and ElMaraghy, H.A., 1994, "The Tolerance Optimization Problem Using a System of Experimental Design," Advances in Design Automation Conference, Minneapolis, MN, ASME, Vol. 69-1, pp. 251-265
23. Giovannitti-Jensen, A. and Myers, R.H., 1989, "Graphical Assessment of the Prediction Capability of Response Surface Designs," Technometrics, Vol. 31(2), pp. 159-171
24. Giunta, A.A., Balabanov, V., Haim, D., Grossman, B., Mason, W.H. and Watson, L.T., 1996, "Wing Design for a High-Speed Civil Transport Using a Design of Experiments Methodology," 6th AIAA/USAF/NASA/ISSMO Symp. on Multidisciplinary Analysis and Optimization, Bellevue, WA, AIAA Vol. 1, pp. 168-183
25. Giunta, A.A., Dudley, J.M., Narducci, R., Grossman, B., Haftka, R.T., Mason, W.H. and Watson, L.T., 1994, "Noisy Aerodynamic Response and Smooth Approximations in HSCI Design," 5th AIAA/USAF/NASA/ISSMO Symp. on Multidisciplinary Analysis and Optimization, Panama City, FL, Vol. 2, pp. 1117-1128
26. Healy, M.J., Kowalik, J. S. and Ramsay, J.W., 1975, "Airplane Engine Selection by Optimization of Surface Fit Approximations," Journal of Aircraft, Vol. 12(7), pp. 593-599
27. Hong, J., Dagli, C.H. and Ragsdell, K.M., 1994, "Artificial Neural Network and the Taguchi Method Application for Robust Wheatstone Bridge Design," Advances in Design Automation Conference, Minneapolis, MN, ASME, Vol. 69-2, 37-41
28. Hunter, J.S., 1985, "Statistical Design Applied to Product Design," Journal of Quality Technology, Vol. 17(4), pp. 210-221
29. Hunter, J.S. and Naylor, T.H., 1970, "Experimental Designs for Computer Simulation Experiments," Management Science, Vol. 16(7), pp. 422-434
30. Journel, A.G., 1986, "Geostatistics: Models and Tools for the Earth Sciences," Mathemtical Geology, Vol. 18(l), pp. 119-140
31. Kleijnen, J.P.C., 1987, Statistical Tools for Simulation Practitioners, Marcel Dekker, NY
32. Koch, P.N., Allen, J.K., Misree, F., and Mavris, D., 1997, "The Problem of Size in Robust Design," to appear in 1997 ASME Design Automation Conference, Sacramento, CA, ASME, Paper No. DETC97DAC3983
33. Koch, P.N., Allen, J.K. and Mistree, F., 1996, "Robust Concept Exploration for Configuring Turbine Propulsion Systems," Design Automation Conference (Dutta, D., ed.). Irvine, CA, ASME, Paper 96-DETC/DAC-1285
34. Komgold, J.C. and Gabriele, G.A., 1995, "Multidisciplinary Analysis and Optimization of Discrete Problems Using Response Surface Methods," Design Automation Conference, Boston, MA, ASME, Vol. 82-1, pp. 173-180
35. Langley, P. and Simon, H.A., 1995, "Applications of Machine Learning and Rule Induction," Communications of the ACM, Vol. 38(1 l), pp. 55-64
36. Laslett, G.M., 1994, "Kriging and Splines: An Empirical Comparison of Their Predictive Performance in Some Applications," Journal of the American Statistical Assoc., Vol. 89, pp. 391-400
37. Leech, W.J., 1986, "A Rule Based Process Control Method With Feedback," Adv. in Instrumentation, Vol. 41, pp. 169-175
38. Lewis, K. and Mistree, F., 1997, "The Other Side of Multidisciplinary Design Optimization: Accommodating a Multiobjective, Uncertain and Non-Deterministic World," Engineering Optimization, in press
39. Li, C.-C., Sheu, T.-S. and Lee, Y.-C., 1994, "Robustness Consideration in Modeling a Prototype by Quality Engineering," Design Theory and Methodology Conference (Hight, T.K. and Mistree, F., eds.), Minneapolis, MN, ASME, Vol. 68, pp. 55-62
40. Lu, S.C.-Y. and Tcheng, D.K., 1991, "Building Layered Models to Support Engineering Decision Making: A Machine Learning Approach," Journal of Engineering in Industry, Vol. 113, pp. l-9
41. Lucas, J.M., 1994, "Using Response Surface Methodology to Achieve a Robust Process," Journal of Quality Technology, Vol. 26(4), pp. 248-260
42. Lucas, J.M., 1976, "Which Response Surface Design is Best," Technometrics, Vol. 18(4), pp. 411-417
43. Lucas, J.M., 1974, "Optimum Composite Designs," Technometrics, Vol. 16(4), pp. 561-567
44. Matheron, G., 1963, "Principles of Geostatistics," Economic Geology, Vol. 58, pp. 1246-1266
45. Mavris, D., Bandte, 0. and Schrage, D., 1996, "Application of Probabilistic Methods for the Determination of an Economically Robust HSCT Configuration," 6th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Bellevue, WA, AIAA, Vol. 2, pp. 968-978
46. Mavris, D.N., Bandte, 0. and Schrage, D.P., 1995, "Economic Uncertainty Assessment of an HSCT Using a Combined Design of Experiments/Monte Carlo Simulation Approach," Conference of the Society of International Parametric Analysts, San Diego
47. Mitchell, T., Morris, M. and Ylvisaker, D., 1988, "Existence of Smoothed Stationary Processes on an Interval," Working Paper
48. Montgomery, DC., 1997, Design and Analysis of Experiments, Fourth Edition, John Wiley & Sons, New York
49. Montgomery, D.C. and Evans, D.M., Jr., 1975, "Second-Order Response Surface Designs in Computer Simulation," Simulation, Vol. 29(6), pp. 169-178
50. Myers, R.H. and Montgomery, D.C., 1995, Response Surface Methodology: Process and Product Optimization Using Designed Experiments, John Wiley & Sons, NY
51. Myers, R.H., Khuri, A. I. and Carter, W.H., 1989, "Response Surface Methodology: 1966-1988," Technometrics, Vol. 3 l(2), pp. 137-157
52. Peplinski, J.D., Allen, J.K. and Mistree, F., 1996, "Integrating Product Design with Manufacturing Process Design Using the Robust Concept Exploration Method," Design Theory and Methodology Conference (Wood, K., ed.), Irvine, CA, ASME, Paper 96-DETC/DTM-1502
53. Phadke, M.S., 1989, Quality Engineering using Robust Design, Prentice Hall, Englewood Cliffs, NJ
54. Ramberg, J.S., Sanchez, S.M., Sanchez, P.J. and Hollick, L.J., 1991, "Designing Simulation Experiments: Taguchi Methods and Response Suface Metamodels," Proceedings of the Winter Simulation Conference (WSC), Phoenix, AZ, IEEE, pp. 167-176
55. Reddy, S.Y., 1996, "HIDER: A Methodology for Early-Stage Exploration of Design Space," Design Automation Conference (Dutta, D., ed.), Irvine, CA, ASME, Paper No. 96-DETC/DAC-1089
56. Renaud, J.E. and Gabriele, G.A., 1994, "Approximation in Nonhierarchic System Optimization," AIAA Journal, Vol. 32(l), pp. 198-205
57. Renaud, J.E. and Gabriele, G.A., 1993, "Improved Coordination in Non-Hierarchic System Optimization," AIAA Journal, Vol. 31(12), pp. 2367-2373
58. Renaud, J.E. and Gabriele, G.A., 1991, "Sequential Global Approximation in Non-Hierarchic System Decomposition and Optimization," Advances in Design Automation and Design Optimization, Miami, FL, ASME, Vol. 32-1, pp. 191-200
59. Ross, P. J., 1988, Taguchi Techniques for Qualtiy Engineering, McGraw-Hill, NY
60. Roux, W.J., Stander, N. and Haftka, R.T., 1996, "Response Surface Approximations for Structural Optimization," 6th AIAA/USAF/NASA/ISSMO Symp. on Multidisciplinary Analysis and Optimization, Bellevue, WA, AIAA, Vol. 1, pp. 565-578
61. Rowell, L.F., Braun, R.D., Olds, J.R. and Unal, R., 1996, "Recent Experiences in Multidisciplinary Conceptual Design Optimization for Launch Vehicles," 6th AlAA/USAF/NASA/ ISSMO Symposium on Multidisciplinary Analysis and Optimization, Bellevue, WA, AIAA, Vol. 1, pp. 642-654
62. Rumelhart, D.E., Widrow, B. and Lehr, M.A., 1994, "The Basic Ideas in Neural Networks," Comm. of the ACM, Vol. 37, pp. 87-92
63. Sacks, J., Schiller, S.B. and Welch, W.J., 1989a. "Designs for Computer Experiments," Technometrics, Vol. 31(l), pp. 41-47
64. Sacks, J., Welch, W.J., Mitchell, T.J. and Wynn, H.P., 1989b, "Design and Analysis of Computer Experiments," Statistical Science, Vol. 4(4), pp. 409-435
65. Sellar, R.S. and Batill, SM., 1996, "Concurrent Subspace Optimization Using Gradient-Enhanced Neural Network Approximations," 6th AIAA/NASA/USAF Multidisciplinary Analysis & Optimization Symp., Bellevue, WA, AIAA, Vol. 1, pp. 319-330
66. Sellar, R.S., Batill, SM. and Renaud, J.E., 1996a, "A Neural Network-Based, Concurrent Subspace Optimization Approach to Multidisciplinary Design Optimization," Aerospace Sciences Meeting, Reno, NV, AIAA, Paper No. 96-0714
67. Sellar, R.S., Stelmack, M.A., Batill, S.M. and Renaud, J.E., 1996b, "Multidisciplinary Design and Analysis of an Integrated Aeroelastic/Propulsive System," 37th AlAA/ASME/ASCE/ AHS/ASC Structures, Structural Dynamics, and Materials Conference, Salt Lake City, UT, AIAA, pp. 583-593
68. Shoemaker, A.C., Tsui, K.-L. and Wu, J., 1991, "Economical Experimentation Methods for Robust Design," Technometrics, Vol. 33(4), pp. 415-427
69. Simpson, T.W., Chen, W., Allen, J.K., and Mistree, F., "Conceptual Design of a Family of Products through the Use of the Robust Concept Exploration Method," 6th AIAA/USAF/ NASALSSMO Symp. on Multidisciplinary Analysis and Optimization, Bellevue, WA, AIAA, Vol. 2, pp. 1535-1545
70. Stanley, D.O., Unal, R. and Joyner, C.R., 1992, "Application of Taguchi Methods to Propulsion System Optimization for SST0 Vehicles," Spacecraft and Rockets, Vol. 29(4), pp. 453-459
71. Sundaresan, S., Ishii, K. and Houser, D. R., 1993, "A Robust Optimization Procedure with Variations on Design Variables and Constraints," Advances in Design Automation, Albuquerque, NM, ASME, Vol. 65-1, pp. 379-386
72. Unal, R., Lepsch, R.A., Engelund, W. and Stanley, D.O., 1996, "Approximation Model Building and Multidisciplinary Design Optimization Using Response Surface Methods," 6th AIAA/USAF/ NASABSSMO Symp. on Multidisciplinary Analysis and Optimization, Bellevue, WA, AIAA, Vol. 1, pp. 592-597
73. Unal, R., Stanley, D.O., Engelund, W. and Lepsch, R., 1994a, "Design for Quality using Response Surface Methods: An Alternative to Taguchi?s Parameter Design Approach," Engineering Management Journal, Vol. 6(3), pp. 40-48
74. Unal, R., Stanley, D. 0. and Joyner, C. R., 1994b, "Parametric Model Building and Design Optimization Using Response Surface Methods," Journal of Parametrics, Vol. 14(l), pp. 81-96
75. Unal, R., Wu, K.C. and Stanley, D.O., 1994c, "A Study of Design of Experiments Methods for Design Optimization and Quality Improvement," 15th Annual Conference of ASEM, ASEM
76. Unal, R., Stanley, D. 0. and Joyner, C. R., 1992, "The Role of Statistically Designed Experiments in Conceptual Aerospace Vehicle Design," 1992 IEEE International Engineering Management Conference, Eatontown, NJ, ASEM, pp. 211-214
77. Venter, G., Haftka, R.T. and Stames, J.H., Jr., 1996, "Construction of Response Surfaces for Design Optimization Applications," 6th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization Bellevue, WA, AIAA, Vol. 1, pp. 548-564
78. Welch, W.J., Buck, R.J., Sacks, J., Wynn, H.P., Mitchell, T.J. and Morris, M.D., 1992, "Screening, Predicting, and Computer Experiments," Technometrics, Vol. 34(l), pp. 15-25
79. Welch, W.J., Yu, W.K., Kang, SM. and Sacks, J., 1990, "Computer Experiments for Quality Control by Parameter Design," Journal of Qualtiy Technology, Vol. 22(l), pp. 15-22
80. Wujek, B.A., and Renaud, J.E., 1997, "A Concurrent Engineering Approach for Multidisciplinary Design in a Distributed Computing Environment," Proceedings in Applied Mathematics, Philadelphia, PA, SIAM, Vol. 80, pp. 189-208
81. Wujek, B.A., Renaud, J.E., Batill, S.M. and Brockman, J.B., 1996, "Concurrent Subspace Optimization Using Design Variable Sharing in a Distributed Computing Environment," Concurrent Engineering: Research and Applications, Vol. 4(4), pp. 361-378
82. Yerramareddy, S., Tcheng, D.K., Lu, S.C-Y. and Assanis, D.N., 1992, "Creating and Using Models for Engineering Design," IEEE Expert, Vol. 7(3), pp. 52-59
83. Yu, J.-C. and Ishii, K., 1993, "A Robust Optimization Method for Systems with Significant Nonlinear Effects," Adv. in Design Automation, Albuquerque, NM, ASME, Vol. 65-1, pp. 371-378