Quasioptimality of maximum-volume cross interpolation of tensors

Linear Algebra and Its Applications

Volumn 458, Issue , 2014, Pages 217-244

  Savostyanov, Dmitry V ^a,b  

^a INSTITUTE OF NUMERICAL MATHEMATICS   (Russian Federation)

^b UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Cross interpolation; High dimensional problems; Maximum volume principle; Tensor train format

Indexed keywords

TENSORS;

HIGH-DIMENSIONAL; HIGH-DIMENSIONAL PROBLEMS; INTERPOLATION ALGORITHMS; INTERPOLATION PROPERTIES; MAXIMUM-VOLUME PRINCIPLE; NUMERICAL EXPERIMENTS; QUASI-OPTIMALITY; TENSOR TRAINS;

INTERPOLATION;

EID: 84903310129     PISSN: 00243795     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.laa.2014.06.006     Document Type: Article

References (68)

1. A. Ammar, E. Cueto, and F. Chinesta Reduction of the chemical master equation for gene regulatory networks using proper generalized decompositions Int. J. Numer. Meth. Biomed. Engng. 28 2012 960 973 10.1002/cnm.2476
2. A. Ammar, B. Mokdad, F. Chinesta, and R. Keunings A new family of solvers for some classes of multidimensional partial differential equations encountered in kinetic theory modeling of complex fluids J. Non-Newton. Fluid Mech. 139 2006 153 176 10.1016/j.jnnfm.2006.07.007 (Pubitemid 44793705)
3. J. Ballani, and L. Grasedyck A projection method to solve linear systems in tensor format Numer. Linear Algebra Appl. 20 2013 27 43 10.1002/nla.1818
4. J. Ballani, L. Grasedyck, and M. Kluge Black box approximation of tensors in hierarchical Tucker format Linear Algebra Appl. 428 2013 639 657 10.1016/j.laa.2011.08.010
5. A. Barth, C. Schwab, and N. Zollinger Multi-level Monte Carlo finite element method for elliptic PDEs with stochastic coefficients Numer. Math. 119 2011 123 161 10.1007/s00211-011-0377-0
6. J.J. Bartholdi A good submatrix is hard to find 1982 School of Industrial and Systems Engineering, Georgia Institute of Technology
7. M. Bebendorf Approximation of boundary element matrices Numer. Math. 86 2000 565 589 10.1007/pl00005410
8. P. Binev, A. Cohen, W. Dahmen, R. DeVore, G. Petrova, and P. Wojtaszczyk Convergence rates for greedy algorithms in reduced basis methods SIAM J. Math. Anal. 43 2011 1457 1472 10.1137/100795772
9. H.-J. Bungatrz, and M. Griebel Sparse grids Acta Numer. 13 2004 147 269 10.1017/S0962492904000182 (Pubitemid 38773594)
10. E. Cancés, V. Ehrlacher, and T. Leliévre Convergence of a greedy algorithm for high-dimensional convex nonlinear problems Math. Models Methods Appl. Sci. 21 2011 2433 2467 10.1142/S0218202511005799
11. S.V. Dolgov TT-GMRES: solution to a linear system in the structured tensor format Russian J. Numer. Anal. Math. Modelling 28 2013 149 172 10.1515/rnam-2013-0009
12. S.V. Dolgov, B.N. Khoromskij, I.V. Oseledets, and D.V. Savostyanov Computation of extreme eigenvalues in higher dimensions using block tensor train format Comput. Phys. Comm. 185 2014 1207 1216 10.1016/j.cpc.2013.12.017
13. S.V. Dolgov, B.N. Khoromskij, and D.V. Savostyanov Superfast Fourier transform using QTT approximation J. Fourier Anal. Appl. 18 2012 915 953 10.1007/s00041-012-9227-4
14. S.V. Dolgov, and I.V. Oseledets Solution of linear systems and matrix inversion in the TT-format SIAM J. Sci. Comput. 34 2012 A2718 A2739 10.1137/110833142
15. S.V. Dolgov, and D.V. Savostyanov Alternating minimal energy methods for linear systems in higher dimensions. Part I: SPD systems arXiv:1301.6068 2013
16. S.V. Dolgov, and D.V. Savostyanov Alternating minimal energy methods for linear systems in higher dimensions. Part II: Faster algorithm and application to nonsymmetric systems arXiv:1304.1222 2013
17. S.V. Dolgov, and D.V. Savostyanov Corrected one-site density matrix renormalization group and alternating minimal energy algorithm to appear in Proc. ENUMATH 2013 arXiv:1312.6542 2013
18. P. Drineas, R. Kannan, and M.W. Mahoney Fast Monte Carlo algorithms for matrices III: computing a compressed approximate matrix decomposition SIAM J. Comput. 36 2006 184 206 10.1137/S0097539704442702 (Pubitemid 46374023)
19. M. Fannes, B. Nachtergaele, and R. Werner Finitely correlated states on quantum spin chains Comm. Math. Phys. 144 1992 443 490 10.1007/BF02099178
20. S.A. Goreinov, I.V. Oseledets, D.V. Savostyanov, E.E. Tyrtyshnikov, and N.L. Zamarashkin How to find a good submatrix V. Olshevsky, E. Tyrtyshnikov, Matrix Methods: Theory, Algorithms, Applications 2010 World Scientific Hackensack, NY 247 256
21. S.A. Goreinov, and E.E. Tyrtyshnikov The maximal-volume concept in approximation by low-rank matrices Contemp. Math. 208 2001 47 51
22. S.A. Goreinov, and E.E. Tyrtyshnikov Quasioptimality of skeleton approximation of a matrix in the Chebyshev norm Dokl. Math. 83 2011 374 375 10.1134/S1064562411030355
23. S.A. Goreinov, E.E. Tyrtyshnikov, and N.L. Zamarashkin Pseudo-skeleton approximations of matrices Rep. Russian Acad. Sci. 342 1995 151 152
24. S.A. Goreinov, E.E. Tyrtyshnikov, and N.L. Zamarashkin A theory of pseudo-skeleton approximations Linear Algebra Appl. 261 1997 1 21 10.1016/S0024-3795(96)00301-1
25. S.A. Goreinov, N.L. Zamarashkin, and E.E. Tyrtyshnikov Pseudo-skeleton approximations by matrices of maximum volume Math. Notes 62 1997 515 519 10.1007/BF02358985 (Pubitemid 127725193)
26. L. Grasedyck Hierarchical singular value decomposition of tensors SIAM J. Matrix Anal. Appl. 31 2010 2029 2054 10.1137/090764189
27. L. Grasedyck, D. Kressner, and C. Tobler A literature survey of low-rank tensor approximation techniques arXiv:1302.7121 2013
28. W. Hackbusch Tensor Spaces and Numerical Tensor Calculus 2012 Springer-Verlag Berlin
29. W. Hackbusch, and S. Kühn A new scheme for the tensor representation J. Fourier Anal. Appl. 15 2009 706 722 10.1007/s00041-009-9094-9
30. W.K. Hastings Monte Carlo sampling methods using Markov chains and their applications Biometrika 57 1970 97 109 10.1093/biomet/57.1.97
31. S. Holtz, T. Rohwedder, and R. Schneider The alternating linear scheme for tensor optimization in the tensor train format SIAM J. Sci. Comput. 34 2012 A683 A713 10.1137/100818893
32. T. Huckle, and K. Waldherr Subspace iteration method in terms of matrix product states Proc. Appl. Math. Mech. 12 2012 641 642 10.1002/pamm.201210309
33. E. Jeckelmann Dynamical density-matrix renormalization-group method Phys. Rev. B 66 2002 045114 10.1103/PhysRevB.66.045114
34. V. Kazeev, B. Khoromskij, and E. Tyrtyshnikov Multilevel Toeplitz matrices generated by tensor-structured vectors and convolution with logarithmic complexity SIAM J. Sci. Comput. 35 2013 A1511 A1536 10.1137/110844830
35. B. Khoromskij, and C. Schwab Tensor-structured Galerkin approximation of parametric and stochastic elliptic PDEs SIAM J. Sci. Comput. 33 2011 1 25 10.1137/100785715
36. B.N. Khoromskij O (dlog n) -Quantics approximation of N-d tensors in high-dimensional numerical modeling Constr. Approx. 34 2011 257 280 10.1007/s00365-011-9131-1
37. B.N. Khoromskij Tensor-structured numerical methods in scientific computing: survey on recent advances Chemometr. Intell. Lab. Syst. 110 2012 1 19 10.1016/j.chemolab.2011.09.001
38. B.N. Khoromskij, and I.V. Oseledets Quantics-TT collocation approximation of parameter-dependent and stochastic elliptic PDEs Comput. Methods Appl. Math. 10 2010 376 394 10.2478/cmam-2010-0023
39. A. Klümper, A. Schadschneider, and J. Zittartz Matrix product ground states for one-dimensional spin-1 quantum antiferromagnets Europhys. Lett. 24 1993 293 297 10.1209/0295-5075/24/4/010
40. T.G. Kolda, and B.W. Bader Tensor decompositions and applications SIAM Rev. 51 2009 455 500 10.1137/07070111X
41. D. Kressner, and C. Tobler Krylov subspace methods for linear systems with tensor product structure SIAM J. Matrix Anal. Appl. 31 2010 1688 1714 10.1137/090756843
42. D. Kressner, and C. Tobler Low-rank tensor Krylov subspace methods for parametrized linear systems SIAM J. Matrix Anal. Appl. 32 2011 273 290 10.1137/100799010
43. D. Kressner, and C. Tobler Preconditioned low-rank methods for high-dimensional elliptic PDE eigenvalue problems Comput. Methods Appl. Math. 11 2011 363 381 10.2478/cmam-2011-0020
44. S. Kühn Hierarchische Tensordarstellung PhD thesis 2012 Univ. Leipzig, Faculty of Mathematics and Informatics
45. C. Le Bris, T. Leliévre, and Y. Maday Results and questions on a nonlinear approximation approach for solving high-dimensional partial differential equations Constr. Approx. 30 2009 621 651 10.1007/s00365-009-9071-1
46. O.S. Lebedeva Tensor conjugate-gradient-type method for Rayleigh quotient minimization in block QTT-format Russian J. Numer. Anal. Math. Modelling 26 2011 465 489 10.1515/rjnamm.2011.026
47. M.W. Mahoney, M. Maggioni, and P. Drineas Tensor-CUR decompositions for tensor-based data SIAM J. Matrix Anal. Appl. 30 2008 957 987 10.1137/060665336
48. I.V. Oseledets DMRG approach to fast linear algebra in the TT-format Comput. Methods Appl. Math. 11 2011 382 393 10.2478/cmam-2011-0021
49. I.V. Oseledets Tensor-train decomposition SIAM J. Sci. Comput. 33 2011 2295 2317 10.1137/090752286
50. I.V. Oseledets Constructive representation of functions in low-rank tensor formats Constr. Approx. 37 2013 1 18 10.1007/s00365-012-9175-x
51. I.V. Oseledets, D.V. Savostianov, and E.E. Tyrtyshnikov Tucker dimensionality reduction of three-dimensional arrays in linear time SIAM J. Matrix Anal. Appl. 30 2008 939 956 10.1137/060655894
52. I.V. Oseledets, D.V. Savostyanov, and E.E. Tyrtyshnikov Cross approximation in tensor electron density computations Numer. Linear Algebra Appl. 17 2010 935 952 10.1002/nla.682
53. I.V. Oseledets, and E.E. Tyrtyshnikov Breaking the curse of dimensionality, or how to use SVD in many dimensions SIAM J. Sci. Comput. 31 2009 3744 3759 10.1137/090748330
54. I.V. Oseledets, and E.E. Tyrtyshnikov TT-cross approximation for multidimensional arrays Linear Algebra Appl. 432 2010 70 88 10.1016/j.laa.2009. 07.024
55. S. Östlund, and S. Rommer Thermodynamic limit of density matrix renormalization Phys. Rev. Lett. 75 1995 3537 3540 10.1103/PhysRevLett.75.3537
56. T.A. Porsching Estimation of the error in the reduced basis method solution of nonlinear equations Math. Comp. 45 1985 487 496 10.1090/S0025-5718- 1985-0804937-0
57. T. Rohwedder, and A. Uschmajew Local convergence of alternating schemes for optimization of convex problems in the TT format SIAM J. Numer. Anal. 51 2013 1134 1162 10.1137/110857520
58. D.V. Savostyanov Polilinear approximation of matrices and integral equations PhD thesis 2006 INM RAS Moscow (in Russian)
59. D.V. Savostyanov, and I.V. Oseledets Fast adaptive interpolation of multi-dimensional arrays in tensor train format Proceedings of 7th International Workshop on Multidimensional Systems (nDS) 2011 IEEE 10.1109/nDS.2011.6076873
60. J. Schneider Error estimates for two-dimensional cross approximation J. Approx. Theory 162 2010 1685 1700 10.1016/j.jat.2010.04.012
61. U. Schollwöck The density-matrix renormalization group Rev. Modern Phys. 77 2005 259 315 10.1103/RevModPhys.77.259 (Pubitemid 41490660)
62. S.A. Smolyak Quadrature and interpolation formulas for tensor products of certain class of functions Dokl. Akad. Nauk SSSR 148 1964 1042 1053 Transl.: Soviet Math. Dokl. 4 1963 240 243
63. V. Temlyakov Greedy Approximation 2011 Cambridge University Press
64. E.E. Tyrtyshnikov Incomplete cross approximation in the mosaic-skeleton method Computing 64 2000 367 380 10.1007/s006070070031
65. E.E. Tyrtyshnikov Tensor approximations of matrices generated by asymptotically smooth functions Sb. Math. 194 2003 941 954 10.1070/ SM2003v194n06ABEH000747 (Pubitemid 37282737)
66. E.E. Tyrtyshnikov Kronecker-product approximations for some function-related matrices Linear Algebra Appl. 379 2004 423 437 10.1016/j.laa.2003.08.013
67. S.R. White Density matrix formulation for quantum renormalization groups Phys. Rev. Lett. 69 1992 2863 2866 10.1103/PhysRevLett.69.2863
68. S.R. White Density-matrix algorithms for quantum renormalization groups Phys. Rev. B 48 1993 10345 10356 10.1103/PhysRevB.48.10345