Low-rank tensor krylov subspace methods for parametrized linear systems

SIAM Journal on Matrix Analysis and Applications

Volumn 32, Issue 4, 2011, Pages 1288-1316

  Kressner, Daniel ^a   Tobler, Christine ^b  

^a EPFL   (Switzerland)

^b ETH ZURICH   (Switzerland)

Author keywords

Krylov subspace methods; Low rank approximation; Parametrized linear system; Tensor; Tucker decomposition

Indexed keywords

COMPUTATIONAL EFFORT; DISCRETIZATIONS; ELLIPTIC PDES; KRYLOV SUBSPACE METHOD; LOW RANK; LOW RANK APPROXIMATIONS; NUMERICAL EXPERIMENTS; PARAMETER DEPENDENCY; PARAMETER RANGE;

LINEAR SYSTEMS;

TENSORS;

EID: 84856290662     PISSN: 08954798     EISSN: 10957162     Source Type: Journal    
DOI: 10.1137/100799010     Document Type: Article

References (48)

1. E. ACAR, D. M. DUNLAVY, AND T. G. KOLDA, A scalable optimization approach for fitting canonical tensor decompositions, J. Chemometrics, 25 (2011), pp. 67-86.
2. J. BALLANI AND L. GRASEDYCK, A projection method to solve linear systems in tensor format, Preprint 46, DFG-Schwerpunktprogramm 1324, 2010.
3. M. BARRAULT, Y. MADAY, N. C. NGUYEN, AND A. T. PATERA, An "empirical interpolation" method: Application to efficient reduced-basis discretization of partial differential equations, C. R. Math. Acad. Sci. Paris, 339 (2004), pp. 667-672. (Pubitemid 41447538)
4. R. BARRETT, M. BERRY, T. F. CHAN, J. W. DEMMEL, J. DONATO, J. J. DONGARRA, V. EIJKHOUT, R. POZO, C. ROMINE, AND H. VAN DER VORST, Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods, SIAM, Philadelphia, 1994.
5. U. BAUR, P. BENNER, A. GREINER, J. G. KORVINK, C. LIENEMANN, AND C. MOOSMANN, Parameter preserving model order reduction for MEMS applications, Math. Comput. Model. Dyn. Syst., 17 (2011), pp. 297-317.
6. M. BIERI, R. ANDREEV, AND C. SCHWAB, Sparse tensor discretization of elliptic SPDEs, SIAM J. Sci. Comput., 31 (2009), pp. 4281-4304.
7. M. BIERI, R. ANDREEV, AND C. SCHWAB, Sparse tensor discretization of elliptic SPDEs, Report 2009-07, Seminar for Applied Mathematics, ETH Zurich, Zurich, Switzerland, 2009.
8. D. BRAESS AND W. HACKBUSCH, Approximation of 1/x by exponential sums in [1, ∞), IMA J. Numer. Anal., 25 (2005), pp. 685-697.
9. H.-J. BUNGARTZ AND M. GRIEBEL, Sparse grids, Acta Numer., 13 (2004), pp. 147-269. (Pubitemid 38773594)
10. T. F. CHAN AND M. K. NG, Galerkin projection methods for solving multiple linear systems, SIAM J. Sci. Comput., 21 (1999), pp. 836-850.
11. A. COHEN, R. DEVORE, AND C. SCHWAB, Analytic regularity and polynomial approximation of parametric and stochastic elliptic PDE's, Anal. Appl. (Singap.), 9 (2011), pp. 11-47.
12. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, A multilinear singular value decomposition, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1253-1278. (Pubitemid 33217068)
13. V. DE SILVA AND L.-H. LIM, Tensor rank and the ill-posedness of the best low-rank approximation problem, SIAM J. Matrix Anal. Appl., 20 (2008), pp. 1084-1127.
14. M. ESPIG AND W. HACKBUSCH, A Regularized Newton Method for the Efficient Approximation of Tensors Represented in the Canonical Tensor Format, Preprint 78/2010, Max-Planck-Institut für Mathematik in den Naturwissenschaften, Leipzig, Germany, 2010.
15. K. V. FERNANDO AND S. HAMMARLING, A product induced singular value decomposition (πSVD) for two matrices and balanced realization, in Linear Algebra in Signals, Systems, and Control (Boston, MA, 1986), SIAM, Philadelphia, 1988, pp. 128-140.
16. R. W. FREUND, Solution of shifted linear systems by quasi-minimal residual iterations, in Numerical Linear Algebra (Kent, OH, 1992), de Gruyter, Berlin, 1993, pp. 101-121.
17. A. FROMMER AND U. GLÄSSNER, Restarted GMRES for shifted linear systems, SIAM J. Sci. Comput., 19 (1998), pp. 15-26. (Pubitemid 128617495)
18. G. H. GOLUB AND C. F. VAN LOAN, Matrix Computations, 3rd ed., Johns Hopkins University Press, Baltimore, MD, 1996.
19. L. GRAMMONT, N. J. HIGHAM, AND F. TISSEUR, A framework for analyzing nonlinear eigen-problems and parametrized linear systems, Linear Algebra Appl., 435 (2011), pp. 623-640.
20. L. GRASEDYCK, Existence and computation of low Kronecker-rank approximations for large linear systems of tensor product structure, Computing, 72 (2004), pp. 247-265.
21. L. GRASEDYCK, Hierarchical singular value decomposition of tensors, SIAM J. Matrix Anal. Appl., 31 (2010), pp. 2029-2054.
22. G.-D. GU AND V. SIMONCINI, Numerical solution of parameter-dependent linear systems, Numer. Linear Algebra Appl., 12 (2005), pp. 923-940. (Pubitemid 41639472)
23. W. HACKBUSCH AND S. KÜHN, A new scheme for the tensor representation, J. Fourier Anal. Appl., 15 (2009), pp. 706-722.
24. K. JBILOU, A. MESSAOUDI, AND H. SADOK, Global FOM and GMRES algorithms for matrix equations, Appl. Numer. Math., 31 (1999), pp. 49-63.
25. B. N. KHOROMSKIJ AND I. V. OSELEDETS, Quantics-TT approximation of elliptic solution operators in higher dimensions, Rus. J. Numer. Math., to appear.
26. B. N. KHOROMSKIJ AND C. SCHWAB, Tensor-structured Galerkin approximation of parametric and stochastic elliptic PDEs, SIAM J. Sci. Comput., 33 (2011), pp. 364-385.
27. M. E. KILMER AND E. DE STURLER, Recycling subspace information for diffuse optical tomography, SIAM J. Sci. Comput., 27 (2006), pp. 2140-2166. (Pubitemid 44784232)
28. A. KLIMKE, Sparse Grid Interpolation Toolbox - User's Guide, Technical Report IANS report 2007/017, University of Stuttgart, Stuttgart, Germany, 2007; available online at http://www.ians.uni-stuttgart.de/spinterp/.
29. A. KLIMKE AND B. WOHLMUTH, Algorithm 847: spinterp: Piecewise multilinear hierarchical sparse grid interpolation in MATLAB, ACM Trans. Math. Software, 31 (2005), pp. 561-579.
30. T. G. KOLDA AN D B. W. BADER, Tensor decompositions and applications, SIAM Rev., 51 (2009), pp. 455-500.
31. D. KRESSNER AND C. TOBLER, Krylov subspace methods for linear systems with tensor product structure, SIAM J. Matrix Anal. Appl., 31 (2010), pp. 1688-1714.
32. D. Kressner and C. Tobler, htucker - a matlab toolbox for tensors in hierarchical Tucker format, Technical report, Seminar for Applied Mathematics, ETH Zurich, Zurich, Switzerland, 2011, in preparation; available online at http://www.sam.math.ethz.ch/NLAgroup/htucker-toolbox.html.
33. G. G. LORENTZ, Approximation of Functions, 2nd ed., Chelsea Publishing Co., New York, 1986.
34. J. C. MIELLOU, P. CORTEY-DUMONT, AND M. BOULBRACHÊNE, Perturbation of fixed point iterative methods, Adv. Para. Comput., 1 (1990), pp. 81-122.
35. F. NOBILE, T. TEMPONE, AND C. G. WEBSTER, An anisotropic sparse grid stochastic collocation method for partial differential equations with random input data, SIAM J. Numer. Anal., 46 (2008), pp. 2411-2442.
36. F. NOBILE, T. TEMPONE, AND C. G. WEBSTER, A sparse grid stochastic collocation method for partial differential equations with random input data, SIAM J. Numer. Anal., 46 (2008), pp. 2309-2345.
37. I. V. OSELEDETS, Tensor-train decomposition, SIAM J. Sci. Comput., 33 (2011), pp. 2295-2317.
38. M. L. PARKS, E. DE STURLER, G. MACKEY, D. D. JOHNSON, AND S. MAITI, Recycling Krylov subspaces for sequences of linear systems, SIAM J. Sci. Comput., 28 (2006), pp. 1651-1674. (Pubitemid 47457322)
39. Y. SAAD, Iterative Methods for Sparse Linear Systems, 2nd ed., SIAM, Philadelpha, 2003.
40. U. SCHOLLWÖCK, The density-matrix renormalization group, Rev. Modern Phys., 77 (2005), pp. 259-315. (Pubitemid 41490660)
41. V. SIMONCINI, Extended Krylov subspace for parameter dependent systems, Appl. Numer. Math., 60 (2010), pp. 550-560.
42. 2A + λB + C)x = b and application to structural dynamics, SIAM J. Sci. Comput., 23 (2002), pp. 1875-1897. (Pubitemid 35427421)
43. P. SPITERI, J.-C. MIELLOU, AND D. EL BAZ, Perturbation of parallel asynchronous linear iterations by floating point errors, Electron. Trans. Numer. Anal., 13 (2002), pp. 38-55. (Pubitemid 38762199)
44. R. A. TODOR AND C. SCHWAB, Convergence rates for sparse chaos approximations of elliptic problems with stochastic coefficients, IMA J. Numer. Anal., 27 (2007), pp. 232-261.
45. L. N. TREFETHEN AND M. EMBREE, Spectra and Pseudospectra. The Behavior of Nonnormal Matrices and Operators, Princeton University Press, Princeton, NJ, 2005.
46. L. TUCKER, Some mathematical notes on three-mode factor analysis, Psychometrika, 31 (1966), pp. 279-311.
47. A. VAN DER SLUIS AND H. A. VAN DER VORST, The rate of convergence of conjugate gradients, Numer. Math., 48 (1986), pp. 543-560.
48. T. G. WRIGHT, EigTool, 2002; available online at http://www.comlab.ox.ac. uk/pseudospectra/eigtool/.