Information theoretic measures of dependence, compactness, and non-gaussianity for multivariate probability distributions

Nonlinear Processes in Geophysics

Volumn 16, Issue 1, 2009, Pages 57-64

  Monahan, A H ^a,b   DelSole, T ^c,d  

^a UNIVERSITY OF VICTORIA   (Canada)

^b CANADIAN INSTITUTE FOR ADVANCED RESEARCH   (Canada)

^c GEORGE MASON UNIVERSITY   (United States)

^d CENTER FOR OCEAN LAND ATMOSPHERE STUDIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA INTERPRETATION; DATA SET; GAUSSIAN METHOD; GEOMETRY; LEAST SQUARES METHOD; MULTIVARIATE ANALYSIS; PRINCIPAL COMPONENT ANALYSIS; PROBABILITY; THEORETICAL STUDY;

EID: 77949448233     PISSN: 10235809     EISSN: 16077946     Source Type: Journal    
DOI: 10.5194/npg-16-57-2009     Document Type: Article

References (12)

1. Cover, T. M. and Thomas, J. A.: Elements of Information Theory, John Wiley & Sons, Inc., New York, 1991.
2. DelSole, T.: Predictability and Information Theory. Part I: Measures of predictability, J. Atmos. Sci., 61, 2425-2440, 2004.
3. DelSole, T. and Tippett, M. K.: Predictability: Recent Insights from Information Theory, Rev. Geophys., 45, RG4002, doi:10.1029/2006RG000202, 2007.
4. Haven, K., Majda, A., and Abramov, R.: Quantifying predictability through information theory: Small sample estimation in a non-Gaussian framework, J. Comp. Phys., 206, 334-362, 2005.
5. Kleeman, R. and Majda, A.: Predictability in a model of geophysical turbulence, J. Atmos. Sci., 62, 2864-2879, 2005.
6. Lee, T.-W., Girolami, M., Bell, A., and Sejnowski, T.: A unifying information-theoretic framework for independent component analysis, Comp. Math. App., 39, 1-21, 2000.
7. Majda, A., Kleeman, R., and Cai, D.: A Mathematical Framework for Quantifying Predictability Through Relative Entropy, Meth. Appl. Anal., 9, 425-444, 2002.
8. Majda, A. J., Abramov, R. V., and Grote, M. J.: Information Theory and Stochastics for Multiscale Nonlinear Systems, American Mathematical Society, Providence, RI, USA, 2005.
9. Monahan, A. H., Fyfe, J. C., and Pandolfo, L.: The vertical structure of wintertime climate regimes of the Northern Hemisphere extratropical atmosphere, J. Climate, 16, 2005-2021, 2003.
10. Pardo, L.: Statistical Inference Based on Divergence Measures, Chapman and Hall, 2006.
11. Peña, D. and van der Linde, A.: Dimensionless measures of variability and dependence for multivariate continuous distributions, Comm. Stat. Theory Meth., 36, 1845-1854 doi:10.1080/03610920601126449, 2007. (Pubitemid 47153313)
12. Schneidman, E., Still, S., Berry, M. J., and Bialek, W.: Network information and connected correlations, Phys. Rev. Lett., 91, 238701-1-238701-238704, 2003.