An adjoint for likelihood maximization

Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences

Volumn 465, Issue 2111, 2009, Pages 3267-3287

  Toal, David J J ^a   Forrester, Alexander I J ^a   Bressloff, Neil W ^a   Keane, Andy J ^a   Holden, Carren ^b  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b AIRBUS OPERATIONS LTD   (United Kingdom)

Author keywords

Algorithmic differentiation; Kriging; Likelihood maximization

Indexed keywords

COMPUTATIONAL FLUID DYNAMICS; COST REDUCTION; FACTORIZATION; GLOBAL OPTIMIZATION;

ADJOINT FORMULATION; ADJOINTS; ALGORITHMIC DIFFERENTIATIONS; ANALYTICAL METHOD; COMPUTATIONAL MODELLING; KRIGING; KRIGING MODEL; LOCAL SEARCH; MULTI-MODAL OPTIMIZATION; OPTIMIZATION TECHNIQUES;

OPTIMIZATION;

EID: 73149117752     PISSN: 13645021     EISSN: 14712946     Source Type: Journal    
DOI: 10.1098/rspa.2009.0096     Document Type: Article

References (34)

1. Broyden, C. 1970 The convergence of a class of double-rank minimization algorithms. J. Inst. Math. Appl. 6, 76-90. (doi:10.1093/imamat/6.1.76)
2. D'Angelo, S. & Minisci, E. 2005 Multi-objective evolutionary optimization of subsonic airfoils by kriging approximation and evolution control. 2005 IEEE Congr. Evol. Comput. 2, 1262-1267.
3. Forrester, A. I., Bressloff, N. W. & Keane, A. J. 2006a Optimization using surrogate models and part converged computational fluid dynamics simulations. Proc. R. Soc. A 462, 2177-2204. (doi:10.1098/rspa.2006.1679) (Pubitemid 44922076)
4. Forrester, A. I., Bressloff, N. W. & Keane, A. J. 2006b Design and analysis of "Noisy" computer experiments. AIAA J. 44, 2331-2339. (doi:10.2514/1.20068) (Pubitemid 44672249)
5. Forrester, A. I., Sóbester, A. & Keane, A. J. 2008 Engineering design via surrogate modelling. Chichester, UK: John Wiley & Sons.
6. Gano, S. E., Renaud, J. E., Martin, J. D. & Simpson, T. W. 2006 Update strategies for kriging models used in variable fidelity optimization. Struct. Multidisciplin. Optim. 32, 287-298. (doi:10.1007/S00158-006-0025-y) (Pubitemid 44268028)
7. Griewank, A. 2000 Evaluating derivatives: principles and techniques of algorithmic differentiation. Philadelphia, PA: Society for Industrial and Applied Mathematics.
8. Gudla, P. & Ganguli, R. 2005 An automated hybrid genetic-conjugate gradient algorithm for multimodal optimization problems. Appl. Math. Comput. 167, 1457-1474. (doi:10.1016/ j.amc.2004.08.026)
9. Guo, Q., Yu, H. & Xu, A. 2006 A hybrid PSO-GD based intelligent method for machine diagnosis. Digital Signal Process. 16, 402-418. (doi:10.1016/j.dsp.2005.12.004) (Pubitemid 43947612)
10. Hollingsworth, P. & Mavris, D. 2003 Gaussian process meta-modelling: comparison of Gaussian process training methods. AIAA 3rd Annual Aviation Technology, Integration and Operations (ATIO), Denver, CO, 17-19 November 2003.
11. Hoyle, N., Bressloff, N. W. & Keane, A. J. 2006 Design optimization of a two-dimensional subsonic engine air intake. AIAA J. 44, 2672-2681. (doi:10.2514/1.16123) (Pubitemid 44788064)
12. Huang, D., Allen, T., Notz, W. & Miller, R. 2006 Sequential kriging optimization using multiple-fidelity evaluations. Struct. Multidisciplinary Optim. 32, 369-382. (doi:10.1007/S00158-005-0587-590)
13. Jin, R., Chen, W. & Simpson, T. 2001 Comparative studies of metamodelling techniques under multiple modelling criteria. Struct. Multidisciplinary Optim. 23, 1-13. (doi:10.1007/ S00158-001-0160-164)
14. Jones, D. 2001 A taxonomy of global optimization methods based on response surfaces. J. Global Optim. 21, 345-383. (doi:10.1023/A:1012771025575) (Pubitemid 33672374)
15. Jones, D., Schonlau, A. & Welch, W. 1998 Efficient global optimization of black-box functions. J. Global Optim. 13, 455-492. (doi:10.1023/A:1008306431147)
16. Keane, A. J. 2006 Statistical improvement criteria for use in multiobjective design optimization. AIAA J. 44, 879-891. (doi:10.2514/1.16875)
17. Keane, A. J. & Nair, P. B. 2005 Computational approaches for aerospace design. Chichester, UK: John Wiley & Sons.
18. Krige, D. G. 1951 A statistical approach to some basic mine valuation problems on the Witwatersrand. J. Chem. Metall. Mining Eng. Soc. S. Afr. 52, 119-139.
19. Kubota, K. 1994 Matrix inversion algorithms by means of automatic differentiation. Appl. Math. Lett. 7, 19-22. (doi:10.1016/0893-9659(94)90004-3)
20. 2)-Operation approximation of covariance matrix inverse in Gaussian process regression based on quasi-Newton BFGS method. Commun. Stat. Simul. Comput. 36, 367-380. (doi:10.1080/03610910601161298) (Pubitemid 46394200)
21. Mader, C., Martins, J., Alonso, J. & van der Weide, E. 2008 ADjoint: an approach for the rapid development of discrete adjoint solvers. AIAA J. 46, 863-873. (doi:10.2514/ 1.29123) (Pubitemid 351773889)
22. Martin, J. & Simpson, T. 2005 Use of kriging models to approximate deterministic computer models. AIAA J. 43, 853-863. (doi:10.2514/1.8650)
23. Park, J. & Baek, J. 2001 Efficient computation of maximum likelihood estimators in a spatial linear model with power exponential covariogram. Comput. Geosci. 27, 1-7. (doi:10.1016/S0098-3004(00)00016-9)
24. Petersen, K. & Perderson, M. 2007 The matrix cookbook. http://matrixcookbook.com
25. Press, W., Flannery, B., Teukolsky, S. & Vetterling, W. 1988 Numerical recipes: the art of scientific computing Cambridge, UK: Cambridge University Press.
26. Queipo, N. V., Haftka, R. T., Shyy, W., Goel, T., Vaidyanathan, R. & Tucker, P. K. 2005 Surrogate-based analysis and optimization. Progr. Aerospace Sci. 41, 1-28. (doi:10.1016/ j.paerosci.2005.02.001)
27. Sacks, J., Welch, W., Mitchell, T. & Wynn, H. 1989 Design and analysis of computer experiments. Stat. Sci. 4, 409-435. (doi:10.1214/ss/ 1177012413)
28. Sakata, S., Ashida, F. & Zako, M. 2003 Structural optimization using kriging approximation. Comput. Methods Appl. Mech. Eng. 192, 923-939. (doi:10.1016/S0045-7825(02)00617-5) (Pubitemid 36225325)
29. Simpson, T. W., Peplinski, J. D., Koch, P. N. & Allen, J. K. 2001 Metamodels for computer-based engineering design: survey and recommendations. Eng. Comput. 17, 129-150. (doi:10.1007/ PL00007198)
30. Smith, S. P. 1995 Differentiation of the cholesky algorithm. J. Comput. Graphical Statistics 4, 134-147. (doi:10.2307/1390762)
31. Toal, D. J. J., Bressloff, N. W. & Keane, A. J. 2008a Kriging hyperparameter tuning strategies. AIAA J. 46, 1240-1252. (doi:10.2514/1.34822)
32. Toal, D. J. J., Bressloff, N. W. & Keane, A. J. 2008b Geometric filtration using POD for aerodynamic design optimization. Collection of Technical Papers-26th AIAA Applied Aerodynamics Conference, Honolulu, HI, USA, 18-21 August.
33. Wang, G. G. & Shan, S. 2007 Review of metamodeling techniques in support of engineering design optimization. ASME J. Mech. Design 129, 370-380. (doi:10.1115/1.2429697) (Pubitemid 46736217)
34. Zhang, Y. & Leithead, W. 2005 Exploiting Hessian matrix and trust-region algorithm in hyperparameter estimation of gaussian process. Appl. Math. Comput. 171, 1264-1281. (doi:10.1016/j.amc.2005.01.113)