An information theoretic alternative to model a natural system using observational information alone

Water Resources Research

Volumn 50, Issue 1, 2014, Pages 650-660

  Sharma, Ashish ^a   Mehrotra, Raj ^a  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

information theory; mutual information; partial mutual information

Indexed keywords

MUTUAL INFORMATIONS; NONPARAMETRIC BASIS; PARTIAL INFORMATION; PARTIAL MUTUAL INFORMATIONS; PREDICTIVE MODELING; RELATIVE CONTRIBUTION; SCIENCE AND ENGINEERING; SYSTEM SPECIFICATION;

CHAOTIC SYSTEMS; SPECIFICATIONS;

INFORMATION THEORY;

CHAOTIC DYNAMICS; DATA SET; EMPIRICAL ANALYSIS; INFORMATION MANAGEMENT; NUMERICAL MODEL; PARAMETERIZATION; STATISTICAL ANALYSIS;

EID: 84896739021     PISSN: 00431397     EISSN: 19447973     Source Type: Journal    
DOI: 10.1002/2013WR013845     Document Type: Article

References (43)

1. Abarbanel, H. D. I., U. Lall, Y. Moon, M. E. Mann, and, T. Sangoyomi, (1996), Nonlinear dynamics and the Great Salt Lake: A predictable indicator of regional climate, Energy, 21, 655-665.
2. Bowden, G. J., G. C. Dandy, and, H. R. Maier, (2005), Input determination for neural network models in water resources applications. Part 1: Background and methodology, J. Hydrol., 301 (1-4), 75-92.
3. Brown, P. F., V. J. Della Pietra, P. V. deSouza, J. C. Lai, and, R. L. Mercer, (1992), Class-based n-gram models of natural language, Comput. Linguistics, 18 (4), 467-479.
4. Carsten, O. D., R. Steuer, J. Selbig, and, S. Kloska, (2004), Estimating mutual information using B-spline functions-An improved similarity measure for analysing gene expression data, BMC Bioinformatics, 5, 118, doi: 10.1186/1471-2105-5-118.
5. Castelletti, A., S. Galelli, M. Restelli, and, R. Soncini-Sessa, (2010), Tree-based batch mode reinforcement learning for optimal water reservoir operation, Water Resour. Res., 46, W09507, doi: 10.1029/2009WR 008898.
6. Chowdhury, S., and, A. Sharma, (2007), Mitigating parameter bias in hydrological modelling due to uncertainty in covariates, J. Hydrol., 340, 197-204, doi: 10.1016/j.jhydrol.2007.04.010.
7. D'haeseleer, P., S. Liang, and, R. Somogyi, (2000), Genetic network inference: From co-expression clustering to reverse engineering, Bioinformatics, 16, 707-726, doi: 10.1093/bioinformatics/16.8.707.
8. Ellis, D. P. W., and, J. A. Bilmes, (2000), Using mutual information to design feature combinations, in Proceedings of the ICSLP-2000, Acoustical Society of America, Chinese Academy of Sciences, Institute of Acoustics, Beijing, China. [Available at http://hdl.handle.net/10022/AC:P:13809.]
9. Fernando, T., H. Maier, and, G. Dandy, (2009), Selection of input variables for data driven models: An average shifted histogram partial mutual information estimator approach, J. Hydrol., 367 (3-4), 165-176.
10. Fraser, A. M., and, H. L. Swinney, (1986), Independent coordinates for strange attractors from mutual information, Phys. Rev. A, 33 (2), 1134-1140.
11. Frenzel, S., and, B. Pompe, (2007), Partial mutual information for coupling analysis of multivariate time series, Phys. Rev. Lett., 99, 204,101-204,104.
12. Gong, W., H. V. Gupta, D. Yang, K. Sricharan, and, A. O. Hero Iii, (2013), Estimating epistemic and aleatory uncertainties during hydrologic modeling: An information theoretic approach, Water Resour. Res., 49, 2253-2273, doi: 10.1002/wrcr.20161.
13. Hahn, A., J. Rahnenführer, P. Talwar, and, T. Lengauer, (2005), Confirmation of human protein interaction data by human expression data, BMC Bioinformatics, 6, 112, doi: 10.1186/1471-2105-6-112.
14. Hamming, R. W., (1986), Coding and Information Theory, Prentice-Hall, Englewood Cliffs, N. J.
15. Harrold, T., A. Sharma, and, S. Sheather, (2001), Selection of a kernel bandwidth for measuring dependence in hydrologic time series using the mutual information criterion, Stochastic Environ. Res. Risk Assess., 15 (4), 310-324.
16. He, J., C. Valeo, A. Chu, and, N. F. Neumann, (2011), Prediction of event-based stormwater runoff quantity and quality by ANNs developed using PMI-based input selection, J. Hydrol., 400 (1-2), 10-23.
17. Hoyos, C. D., P. A. Agudelo, P. J. Webster, and, J. A. Curry, (2006), Deconvolution of the factors contributing to the increase in global hurricane intensity, Science, 312 (5770), 94-97.
18. Lall, U., and, A. Sharma, (1996), A nearest neighbor bootstrap for time series resampling, Water. Resour. Res., 32, 679-693.
19. Linfoot, E. H., (1957), An informational measure of correlation, Inf. Control, 1, 85-89.
20. Mardia, K. V., J. T. Kent, and, J. M. Bibby, (1988), Multivariate Analysis, Academic, London.
21. May, R. J., G. C. Dandy, H. R. Maier, and, J. B. Nixon, (2008), Application of partial mutual information variable selection to ANN forecasting of water quality in water distribution systems, Environ. Model. Software, 23 (10-11), 1289-1299.
22. Mehrotra, R., and, A. Sharma, (2006), Conditional resampling of hydrologic time series using multiple predictor variables: A K-nearest neighbour approach, Adv. Water Resour., 29, 987-999.
23. Mehrotra, R., and, A. Sharma, (2007), A semi-parametric model for stochastic generation of multi-site daily rainfall exhibiting low-frequency variability, J. Hydrol., 335 (1-2), 180-193.
24. Moon, Y., B. Rajagopalan, and, U. Lall, (1995), Estimation of mutual information using kernel density estimators, Phys. Rev. E, 52 (3), 2318-2321.
25. Peng, H., F. Long, and, C. Ding, (2005), Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy, IEEE Trans. Pattern Anal. Mach. Intell., 27 (8), 1226-1238.
26. Prokhorov, A. V., (2001), Partial correlation coefficient, in Encyclopaedia of Mathematics, edited by, M. Hazewinkel, Springer. [Available at http://www.encyclopediaofmath.org/index.php?title=Partial-correlation- coefficient&oldid=14288.]
27. Rössler, O. E., (1976), An equation for continuous chaos, Phys. Lett., 57A (5), 397-398.
28. Ruddell, B. L., and, P. Kumar, (2009a), Ecohydrologic process networks: 2. Analysis and characterization, Water Resour. Res., 45, W03420, doi: 10.1029/2008WR007280.
29. Ruddell, B. L., and, P. Kumar, (2009b), Ecohydrologic process networks: 1. Identification, Water Resour. Res., 45, W03419, doi: 10.1029/2008WR007279.
30. Sangoyomi, T., U. Lall, and, H. D. I. Abarbanel, (1996), Nonlinear dynamics of the Great Salt Lake: Dimension estimation, Water Resour. Res., 32, 149-159, doi: 10.1029/95WR02872.
31. Sankarasubramanian, A., U. Lall, N. Devineni, and, S. Espinueva, (2009), The role of monthly updated climate forecasts in improving intraseasonal water allocation, J. Appl. Meteorol. Climatol., 48 (7), 1464-1482.
32. Santos, J. F., M. M. Portela, and, I. Pulido-Calvo, (2013), Dimensionality reduction in drought modelling, Hydrol. Processes, 27 (10), 1399-1410.
33. Schena, M., D. Shalon, R. W. Davis, and, P. O. Brown, (1995), Quantitative monitoring of gene expression patterns with a complementary DNA microarray, Science, 270, 467-470.
34. Scott, D. W., (1992), Multivariate Density Estimation: Theory, Practice and Visualization, John Wiley, New York.
35. Shannon, C. E., (1948), A mathematical theory of communication, Bell Syst. Tech. J., 27, 379-423, 623-656.
36. Sharma, A., (2000a), Seasonal to interannual rainfall ensemble forecasts for improved water supply management: 1. A strategy for system predictor identification, J. Hydrol., 239, 232-239.
37. Sharma, A., (2000b), Seasonal to interannual rainfall probabilistic forecasts for improved water supply management. Part 3: A nonparametric probabilistic forecast model. J. Hydrol., 239 (1-4), 249-258.
38. Sharma, A., U. Lall, and, D. G. Tarboton, (1998), Kernel bandwidth selection for a first order nonparametric streamflow simulation model, Stochastic Hydrol. Hydraul., 12 (1), 33-52.
39. Sharma, A., K. C. Luk, I. Cordery, and, U. Lall, (2000), Seasonal to interannual rainfall probabilistic forecasts for improved water supply management. Part 2: Predictor identification of quarterly rainfall using ocean-atmosphere information, J. Hydrol., 239 (1-4), 240-248.
40. Silverman, B. W., (1986), Density Estimation for Statistics and Data Analysis, Chapman and Hall, London.
41. Thénevaz, P., and, M. Unser, (2000), Optimization of mutual information for multiresolution image registration, IEEE Trans. Image Process., 9, 2083-2099.
42. Tong, H., (1990), Nonlinear Time Series Analysis: A Dynamical Systems Perspective, Academic, San Diego, Calif.
43. Velculescu, V. E., I. Zhang, B. Vogelstein, and, K. Kinzler, (1995), Serial analysis of gene expression, Science, 270, 484-487.