Global optimization with multivariate adaptive regression splines

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 37, Issue 2, 2007, Pages 333-340

  Crino, Scott ^a   Brown, Donald E ^b  

^a UNITED STATES MILITARY ACADEMY   (United States)

^b UNIVERSITY OF VIRGINIA   (United States)

Author keywords

Genetic algorithm (GA); Neural network (NN); Simulated annealing (SA); Successive response surface methodology (SRSM)

Indexed keywords

ARTIFICIAL INTELLIGENCE; GENETIC ALGORITHMS; GLOBAL OPTIMIZATION; MULTIVARIABLE SYSTEMS; REGRESSION ANALYSIS; SIMULATED ANNEALING;

MULTIVARIATE ADAPTIVE REGRESSION SPLINES; SUCCESSIVE RESPONSE SURFACE METHODOLOGY;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; MATHEMATICAL COMPUTING; MULTIVARIATE ANALYSIS; REGRESSION ANALYSIS; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; MODELS, THEORETICAL; MULTIVARIATE ANALYSIS; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; REGRESSION ANALYSIS;

EID: 34047153277     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2006.883430     Document Type: Article

References (38)

1. L. Zhan and Q. Zhang, "Optimal pin-assignment for ground noise minimization in ic packages and connectors," in Proc. 46th Electron. Compon. and Technol. Conf., May 1996, pp. 761-764.
2. G. A. Vignaux and Z. Michalewicz, "A genetic algorithm for the linear transportation problem," IEEE Trans. Syst., Man Cybern., vol. 21, no. 2, pp. 445-452, Mar./Apr. 1991.
3. C. C. Lo and W. H. Chang, "A multiobjective hybrid genetic algorithm for the capacitated multipoint network design problem," IEEE Trans. Syst., Man Cybern. B, Cybern., vol. 30, no. 3, pp. 461-470, Jun. 2000.
4. A. Fukunaga, S. Chien, D. Mutz, R. Sherwood, and A. Stechert, "Automating the process of optimization in spacecraft design," in Proc. IEEE Aerosp. Conf., 1997, pp. 411-427.
5. W. Wang, C. Cheng, and Y. Leu, "An online GA-based output-feedback direct adaptive fuzzy-neural controller for uncertain nonlinear systems," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 1, pp. 334-345, Feb. 2004.
6. K. Toh, "Deterministic global optimization for FNN training," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 33, no. 6, pp. 977-982, Dec. 2003.
7. G. P. Liu, V. Kadirkamanathan, and S. Billings, "Variable neural networks for adaptive control of nonlinear systems," IEEE Trans. Syst., Man Cybern. C, Appl. Rev., vol. 29, no. 1, pp. 34-43, Feb. 1999.
8. S. S. Yang and C. S. Tseng, "An orthogonal neural network for function approximation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 26, no. 5, pp. 779-785, Oct. 1996.
9. J. Sacks, S. Schiller, and W. Welch, "Designs for computer experiments," Technometrics, vol. 31, no. 1, pp. 41-47, 1989.
10. J. Friedman, "Multivariate adaptive regression splines," Ann. Stat., vol. 19, no. 1, pp. 1-141, 1991.
11. L. Breiman, J. Friedman, R. Olshen, and C. Stone, Classification and Regression Trees. Belmont, CA: Wadsworth Int. Group, 1984.
12. T. W. Simpson, C. Clark, and J. Griebsh, "Analysis of support vector regression for approximation of complex engineering analyses," presented at the ASME 2003 Design Engineering Technical Conf. and Computers and Information in Engineering Conf., Chicago, IL, Sep. 2003, Paper No. DETC2003/DAC-48759.
13. J. Friedman, "Fitting functions to noisy data in high dimensions," in Proc. 20th Symp. Interface Amer. Statistical Assoc., E. J. Wegman, D. T. Gantz, and J. J. Miller, Eds., 1988, pp. 13-43.
14. P. Craven and G. Wahba, "Smoothing noisy data with spline functions. Estimating the correct degree of smoothing by the method of generalized cross-validation," Numer. Math., vol. 31, pp. 377-403, 1979.
15. R. Jin, W. Chen, and T. W. Simpson, "Comparative studies of metamodeling techniques under multiple modeling criteria," Struct. Multidiscpl. Optim., vol. 23, no. 1, pp. 1-13, Dec. 2001.
16. J. Munoz and A. Felicisimo, "Comparison of statistical methods commonly used in predictive modelling," J. Vegetative Sci., vol. 15, pp. 285-292, 2004.
17. G. Moisen and T. Frescino, "Comparing five metamodeling techniques for predicting forest characteristics," Ecol. Model., vol. 157, no. 2/3, pp. 209-225, Nov. 2002.
18. S. Ren, "Modeling the toxicity of aromatic compounds to tetrahymena pyriformus, the response surface methodology with nonlinear methods," J. Chem. Inf. Comput. Sci., vol. 43, no. 5, pp. 1679-1687, Sep./Oct. 2003.
19. I. Uysal and H. A. Guvenir, "An overview of regression techniques for knowledge discovery," Knowl. Eng. Rev., vol. 14, no. 4, pp. 319-340, Dec. 1999.
20. R. J. Yang, L. Gu, L. Liaw, C. Gearhart, C. H. Tho, X. Liu, and B. P. Wang, "Approximations for safety optimization of large systems," presented at the ASME 2000 Design Engineering Technical Conf. Computers and Information Engineering Conf., Baltimore, MD, Sep. 2000, Paper No. DETC2000/DAC-14245.
21. T. McConoghy and G. Gielen, "Analysis of simulation-driven numerical performance modeling techniques for application to analog circuit optimization," in Proc. IEEE Int. Symp. Circuits Syst., May 2005, pp. 1298-1301.
22. K. Cogger, "Modern regression methods: A comparative study," in Proc. Washington Statistical Soc. Seminar, May 2001, pp. 2-23.
23. P. A. Lewis and J. G. Stevens, "Non-linear modeling of time series using multivariate adaptive regression splines (MARS)," J. Amer. Stat. Assoc., vol. 86, no. 416, pp. 864-877, 1991.
24. W. Zha and W. Y. Chan, "A data mining approach to objective speech quality measurement," in Proc. IEEE Int. Conf. Acoust., Speech and Signal Process., May 2004, pp. 1-461-1-464.
25. S. Mukkamala and A. H. Sung, "A comparative study of techniques for intrusion detection," in Proc. 15th IEEE Int. Conf. Tools with Artif. Intell., Nov. 2003, p. 570.
26. S. Wunnava and E. Rassi, "Data encryption performance and evaluation schemes," in Proc. IEEE Southeast Conf., Apr. 2002, pp. 234-238.
27. H. Haas and G. Kubin, "A multi-band nonlinear oscillator model for speech," in Proc. 32nd Asilomar Conf. Signals, Syst. and Comput. Conf. Rec., 1998, pp. 338-342.
28. T. W. Simpson, D. Lin, and W. Chen, "Sampling strategies for computer experiments: Design and analysis," Int. J. Reliab. Appl., vol. 2, no. 3, pp. 209-240, 2002.
29. N. Stander, R. Reichert, and T. Frank, "The successive response surface method applied to sheet-metal forming," in Proc. 6th Int. LS-DYNA Users Conf., 2001, pp. 16.1-16.14.
30. N. Stander and K. Craig, "On the robustness of a simple domain reduction scheme for simulation-based optimization," Eng. Comput., vol. 19, no. 4, pp. 431-450, 2002.
31. JMP, JMP 5.1 DOE tutorial, Jul. 2005. accessed. [Online]. Available: http://www.jmp.com
32. K. Craig, N. Stander, D. Dooge, and S. Varadappa, "Automotive crashworthiness design using response surface-based variable screening and optimization," Eng. Comput., vol. 22, no. 1, pp. 38-61, Jan. 2005.
33. W. Roux, N. Stander, and R. Haftka, "Response surface approximations for structural optimization," Int. J. Numer. Methods Eng., vol. 42, pp. 517-534, 1998.
34. E. Rafajlowicz and R. Schwabe, "Equidistributed designs in nonparametric regression," Stat. Sinica, vol. 13, no. 1, pp. 129-134, 2003.
35. A. Owen, "Orthogonal arrays for computer experiments, integration and visualization," Stat. Sinica, vol. 2, no. 2, pp. 439-452, 1992.
36. R. H. Myers and D. C. Montgomery, Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 2nd ed. New York: Wiley, 2002.
37. L. Kocis and W. Whiten, "Computational investigations of low-discrepancy sequences," ACM Trans. Math. Softw., vol. 23, no. 2, pp. 266-294, 1997.
38. B. Stuckman, G. Evans, and M. Mollaghasemi, "Comparison of global optimization search methods for design optimization using simulation," in Proc. 1991 Winter Simulation Conf., B. Nelson, W. David Kelton, and G. Clark, Eds., 1991, pp. 937-944.