The multidimensional maximum entropy moment problem: A review on numerical methods

Communications in Mathematical Sciences

Volumn 8, Issue 2, 2010, Pages 377-392

  Abramov, Rafail V ^a  

^a UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

Author keywords

Maximum entropy problem; Moment constraints; Numerical methods

Indexed keywords

EID: 77954642895     PISSN: 15396746     EISSN: None     Source Type: Journal    
DOI: 10.4310/CMS.2010.v8.n2.a5     Document Type: Review

References (41)

1. R. Abramov, A practical computational framework for the multidimensional moment-constrained maximum entropy principle, J. Comp. Phys., 211, 198-209, 2006.
2. R. Abramov, An improved algorithm for the multidimensional moment-constrained maximum entropy problem, J. Comp. Phys., 226, 621-644, 2007.
3. R. Abramov, The multidimensional moment-constrained maximum entropy problem: a BFGS algorithm with constraint scaling, J. Comp. Phys., 228, 96-108, 2009.
4. R. Abramov and A. Majda, Quantifying uncertainty for non-Gaussian ensembles in complex systems, SIAM J. Sci. Comp., 26, 411-447, 2003.
5. R. Abramov, A. Majda and R. Kleeman, Information theory and predictability for low frequency variability, J. Atmos. Sci., 62, 65-87, 2005.
6. M. Abramowitz and I. Stegun, Handbook of Mathematical Functions: with Formulas, Graphs, and Mathematical Tables, Dover Publications, 1965.
7. K. Bandyopadhyay, A. Bhattacharya, P. Biswas and D. Drabold, Maximum entropy and the problem of moments: a stable algorithm, Phys. Rev. E, 71, 2005.
8. J. Borwein and A. Lewis, On the convergence of moment problems, Trans. Amer. Math. Soc., 325, 249-271, 1991.
9. C. Broyden, The convergence of a class of double-rank minimization algorithms, J. Inst. Math. Appl., 6, 76-90, 1970.
10. R. Byrd, P. Lu and J. Nocedal, A limited memory algorithm for bound-constrained optimiza-tion, SIAM J. Sci. Comp., 16, 1190-1208, 1995.
11. A. Dax, A modified Gram-Schmidt algorithm with iterative orthogonalization and column pivoting, Lin. Alg. Appl., 310, 25-42, 2000.
12. R. Fletcher, A new approach to variable metric algorithms, Comp. J., 13, 317-322, 1970.
13. R. Fletcher, Practical Methods of Optimization, Wiley, New York, 1987.
14. M. Frontini and A. Tagliani, Maximum entropy in the finite Stieltjes and Hamburger moment problem, J. Math. Phys., 35, 6748-6756, 1994.
15. B. Fuglede, The multidimensional moment problem, Expo. Math., 1, 47-65, 1983.
16. L. Giraud and J. Langou, When modified Gram-Schmidt generates a well-conditioned set of vectors, IMA J. Num. Anal., 22, 521-528, 2002.
17. L. Giraud, J. Langou and M. Rozložíník, On the round-off error analysis of the Gram-Schmidt algorithm with reorthogonalization, Tech. Report TR/PA/02/33, CERFACS, 2002.
18. L. Giraud, J. Langou and M. Rozložník, On the loss of orthogonality in the Gram-Schmidt orthogonalization process, Tech. Report TR/PA/03/25, CERFACS, 2003.
19. D. Goldfarb, A family of variable metric updates derived by variational means, Math. Comp., 24, 23-26, 1970.
20. G. Golub and C. Van Loan, Matrix Computations, Johns Hopkins University Press, Baltimore, MD, 3rd ed., 1996.
21. K. Haven, A. Majda and R. Abramov, Quantifying predictability through information theory: small sample estimation in a non-Gaussian framework, J. Comp. Phys., 206, 334-362, 2005.
22. R. Haydock and C. Nex, Comparison of quadrature and termination for estimating the density of states within the recursion method, J. Phys. C: Solid State Phys., 17, 4783-4789, 1984.
23. R. Haydock and C. Nex, A general terminator for the recursion method, J. Phys. C: Solid State Phys., 18, 2235-2248, 1985.
24. M. Junk, Domain of definition of Levermore's five-moment problem, J. Stat. Phys., 93, 1143-1167, 1998.
25. R. Kleeman, Measuring dynamical prediction utility using relative entropy, J. Atmos. Sci., 59, 2057-2072, 2002.
26. S. Kullback and R. Leibler, On information and sufficiency, Ann. Math. Stat., 22, 79-86, 1951.
27. C. Levermore, Moment closure hierarchies for kinetic theories, J. Stat. Phys., 83, 1021-1065, 1996.
28. A. Majda, R. Abramov and M. Grote, Information Theory and Stochastics for Multiscale Nonlinear Systems, CRM Monograph Series of Centre de Recherches Mathématiques, Université de Montréal, American Mathematical Society, ISBN 0-8218-3843-1, 25, 2005.
29. A. Majda, R. Kleeman and D. Cai, A framework for predictability through relative entropy, Meth. Appl. Anal., 9, 425-444, 2002.
30. J. McCalpin, The statistics and sensitivity of a double-gyre model: the reduced gravity, quasi-geostrophic case, J. Phys. Oceanogr., 25, 806-824, 1995.
31. J. McCalpin and D. Haidvogel, Phenomenology of the low-frequency variability in a reduced-gravity, quasigeostrophic double-gyre model, J. Phys. Oceanogr., 26, 739-752, 1996.
32. L. Mead and N. Papanicolaou, Maximum entropy in the problem of moments, J. Math. Phys., 25, 2404-2417, 1984.
33. I. Müller and T. Ruggeri, Extended Thermodynamics, Springer Tracts in Natural Philosophy, Springer, Heidelberg, 1st ed., 1993.
34. D. Ormoneit and H. White, An efficient algorithm to compute maximum entropy densities, Econ. Rev., 18, 127-140, 1999.
35. M. Roulston and L. Smith, Evaluating probabilistic forecasts using information theory, Mon. Wea. Rev., 130, 1653-1660, 2002.
36. T. Schneider and S. Griffies, A conceptual framework for predictability studies, J. Clim., 12, 3133-3155, 1999.
37. D. Shanno, Conditioning of quasi-Newton methods for function minimization, Math. Comp., 24, 647-656, 1970.
38. A. Tagliani, Hausdorff moment problem and maximum entropy: a unified approach, Appl. Math. and Comp., 105, 291-305, 1999.
39. I. Turek, A maximum-entropy approach to the density of states with the recursion method, J. Phys. C, 21, 3251-3260, 1988.
40. X. Wu, Calculation of maximum entropy densities with application to income distribution, J. Econ., 115, 347-354, 2003.
41. Z. Wu, G. Phillips, R. Tapia and Y. Zhang, A fast Newton algorithm for entropy maximization in phase determination, SIAM Rev., 43, 623-642, 2001.