A preconditioning technique for a class of PDE-constrained optimization problems

Advances in Computational Mathematics

Volumn 35, Issue 2, 2011, Pages 149-173

  Benzi, Michele ^a   Haber, Eldad ^a,b   Taralli, Lauren ^c  

^a EMORY UNIVERSITY   (United States)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^c Standard and Poor's   (United States)

Author keywords

Constrained optimization; Hyperbolic PDEs; Image registration; KKT conditions; Krylov subspace methods; Monge Kantorovich problem; Preconditioning; Saddle point problems

Indexed keywords

EID: 80051879605     PISSN: 10197168     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10444-011-9173-8     Document Type: Article

References (38)

1. Akcelik, V., Biros, G., Ghattas, O.: Parallel multiscale Gauss-Newton-Krylov methods for inverse wave propagation. In: Proceedings of the IEEE/ACM Conference, pp. 1-15 (2002).
2. Akcelik, V., Biros, G., Ghattas, O., et al.: High resolution forward and inverse earthquake modeling on terascale computers. In: Proceedings of the IEEE/ACM Conference, pp. 1-52 (2003).
3. Angenent, S., Haker, S., Tannenbaum, A.: Minimizing flows for the Monge-Kantorovich problem. SIAM J. Math. Anal. 35, 61-97 (2003).
4. Arridge, S. R.: Optical tomography in medical imaging. Inverse Probl. 15, R41-R93 (1999).
5. Ascher, U. M., Haber, E.: Grid refinement and scaling for distributed parameter estimation problems. Inverse Probl. 17, 571-590 (2001).
6. Benamou, J. D., Brenier, Y.: A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem. Numer. Math. 84, 375-393 (2000).
7. Benzi, M., Golub, G. H., Liesen, J.: Numerical solution of saddle point problems. Acta Numer. 14, 1-137 (2005).
8. Biegler, L., Ghattas, O., Heinkenschloss, M., Waanders, B.: Large-scale PDE-constrained optimization. In: Lecture Notes in Computational Science and Engineering, vol. 30. Springer, New York (2003).
9. Biros, G., Ghattas, O.; Parallel Lagrange-Newton-Krylov-Schur methods for PDE-constrained optimization. Parts I-II. SIAM J. Sci. Comput. 27, 687-738 (2005).
10. Bouchouev, I., Isakov, V.: Uniqueness, stability and numerical methods for the inverse problem that arises in financial markets. Inverse Probl. 15, R95-R116 (1999).
11. Casanova, R., Silva, A., Borges, A. R.: A quantitative algorithm for parameter estimation in magnetic induction tomography. Meas. Sci. Technol. 15, 1412-1419 (2004).
12. Cheney, M., Isaacson, D., Newell, J. C.: Electrical impedance tomography. SIAM Rev. 41, 85-101 (1999).
13. Deuflhard, P., Potra, F.: Asymptotic mesh independence of Newton-Galerkin methods via a refined Mysovskii theorem. SIAM J. Numer. Anal. 29, 1395-1412 (1992).
14. Dollar, H. S.: Properties of Linear Systems in PDE-Constrained Optimization. Part I: Distributed Control. Tech. Rep. RAL-TR-2009-017, Rutherford Appleton Laboratory (2009).
15. Dupire, B.: Pricing with a smile. Risk 7, 32-39 (1994).
16. Egger, H., Engl, H. W.: Tikhonov regularization applied to the inverse problem of option pricing: convergence analysis and rates. Inverse Probl. 21, 1027-1045 (2005).
17. Elman, H., Silvester, D., Wathen, A.: Finite Elements and Fast Iterative Solvers with Applications in Incompressible Fluid Dynamics. Oxford University Press, Oxford (2005).
18. El-Qady, G., Ushijima, K.: Inversion of DC resistivity data using neural networks. Geophys. Prospect. 49, 417-430 (2001).
19. Golub, G. H., Van Loan, C. F.: Matrix Computations, 3rd edn. John Hopkins University Press, Baltimore (1996).
20. Haber, E., Ascher, U. M.: Preconditioned all-at-once methods for large, sparse parameter estimation problems. Inverse Probl. 17, 1847-1864 (2001).
21. Haber, E., Modersitzki, J.: A multilevel method for image registration. SIAM J. Sci. Comput. 27, 1594-1607 (2006).
22. Hanson, L. R.: Techniques in Constrained Optimization Involving Partial Differential Equations. PhD thesis, Emory University, Atlanta, GA (2007).
23. Hu, J., Sala, M., Tong, C., Tuminaro, R., et al.: ML: Multilevel Preconditioning Package, The Trilinos Project, Sandia National Laboratories (2006). http://trilinos. sandia. gov/packages/ml/.
24. Kantorovich, L. V.: On the translocation of masses. Dokl. Akad. Nauk SSSR 37, 227-229 (1942) (in Russian). English translation in J. Math. Sci. 133, 1381-1382 (2006).
25. Kantorovich, L. V.: On a problem of Monge. Usp. Mat. Nauk 3, 225-226 (1948) (in Russian). English translation in J. Math. Sci. 133, 1383 (2006).
26. Klibanov, M. V., Lucas, T. R.: Numerical solution of a parabolic inverse problem in optical tomography using experimental data. SIAM J. Appl. Math. 59, 1763-1789 (1999).
27. Laird, C. D., Biegler, L. T., Waanders, B., Bartlett, R. A.: Time-dependent contaminant source determination for municipal water networks using large scale optimization. ASCE J. Water Resour. Manage. Plan. 131, 125-134 (2005).
28. LeVeque, R. J.: Numerical Methods for Conservation Laws. Birkhauser, New York (1990).
29. Nocedal, J., Wright, S. J.: Numerical Optimization. Springer, New York (1999).
30. Orozco, C., Ghattas, O.; Massively parallel aerodynamic shape optimization. Comput. Syst. Eng. 1, 311-320 (1992).
31. Parker, R. L.: Geophysical Inverse Theory. Princeton University Press, Princeton (1994).
32. Rees, T., Dollar, H. S., Wathen, A. J.: Optimal solvers for PDE-constrained optimization. SIAM J. Sci. Comput. 32, 271-298 (2010).
33. Rees, T., Stoll, M.: Block-triangular preconditioners for PDE-constrained optimization. Numer. Linear Algebra Appl. 17, 977-996 (2010). doi: 10. 1002/nla. 693.
34. Saad, Y.: A flexible inner-outer preconditioned GMRES algorithm. SIAM J. Sci. Comput. 14, 451-469 (1993).
35. Saad, Y., Schultz, M. H.: GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems. SIAM J. Sci. Stat. Comput. 7, 856-869 (1986).
36. Shenoy, A., Heinkenschloss, M., Cliff, E. M.: Airfoil design by an all-at-once method. Int. J. Comput. Fluid Dyn. 11, 3-25 (1998).
37. Vogel, C. R.: Sparse matrix computations arising in distributed parameter identification. SIAM J. Matrix Anal. Appl. 20, 1027-1037 (1999).
38. Vogel, C. R.: Computational Methods for Inverse Problems, Frontiers in Applied Mathematics Series. Society for Industrial and Applied Mathematics, Philadelphia (2002).