Estimating information entropy for hydrological data: One-dimensional case

Water Resources Research

Volumn 50, Issue 6, 2014, Pages 5003-5018

  Gong, Wei ^a,b   Yang, Dawen ^b   Gupta, Hoshin V ^c   Nearing, Grey ^d  

^a BEIJING NORMAL UNIVERSITY   (China)

^b TSINGHUA UNIVERSITY   (China)

^c UNIVERSITY OF ARIZONA   (United States)

^d NASA GODDARD SPACE FLIGHT CENTER   (United States)

Author keywords

entropy; heteroscedasticity; hydrological data; observation error

Indexed keywords

BINS; ENTROPY; RUNOFF;

DEGREE OF PRECISION; ENVIRONMENTAL SCIENCE; HETEROSCEDASTICITY; HYDROLOGICAL DATA; INFORMATION ENTROPY; MEASUREMENT EFFECTS; OBSERVATION ERRORS; RAINFALL AND RUNOFFS;

STATISTICAL METHODS;

EID: 84902734475     PISSN: 00431397     EISSN: 19447973     Source Type: Journal    
DOI: 10.1002/2014WR015874     Document Type: Article

References (40)

1. Anderson, M. G., and, J. J. Mcdonnell, (2005), Encyclopedia of Hydrological Sciences, John Wiley, Chichester, U. K.
2. Box, G., and, D. R. Cox, (1982), An analysis of transformations revisited, rebutted, J. Am. Stat. Assoc., 77 (377), 209-210, doi: 10.2307/2287791.
3. Bulygina, N., and, H. Gupta, (2010), How Bayesian data assimilation can be used to estimate the mathematical structure of a model, Stochastic Environ. Res. Risk Assess., 24 (6SI), 925-937, doi: 10.1007/s00477-010-0387-y.
4. Chapman, T. G., (1986), Entropy as a measure of hydrologic data uncertainty and model performance, J. Hydrol., 85 (1-2), 111-126, doi: 10.1016/0022-1694(86)90079-X.
5. Cover, T. M., and, J. A. Thomas, (2006), Elements of Information Theory, John Wiley, Hoboken, N. J.
6. Efron, B., (1979), 1977 Rietz lecture-Bootstrap methods-Another look at the Jackknife, Ann. Stat., 7 (1), 1-26, doi: 10.1214/aos/1176344552.
7. Fernando, T., H. R. Maier, and, G. C. Dandy, (2009), Selection of input variables for data driven models: An average shifted histogram partial mutual information estimator approach, J. Hydrol., 367 (3-4), 165-176, doi: 10.1016/j.jhydrol.2008.10.019.
8. Gong, W., H. V. Gupta, D. W. Yang, K. Sricharan, and, A. O. Hero, (2013), Estimating epistemic and aleatory uncertainty during hydrologic modeling: An information theoretic approach, Water Resour. Res., 49, 2253-2273, doi: 10.1002/wrcr.20161.
9. Hyvarinen, A., and, E. Oja, (2000), Independent component analysis: Algorithms and applications, Neural Networks, 13 (4-5), 411-430, doi: 10.1016/S0893-6080(00)00026-5. (Pubitemid 30447427)
10. Li, C., V. P. Singh, and, A. K. Mishra, (2012), Simulation of the entire range of daily precipitation using a hybrid probability distribution, Water Resour. Res., 48, W3521, doi: 10.1029/2011WR011446.
11. Li, C., V. P. Singh, and, A. K. Mishra, (2013), A bivariate mixed distribution with a heavy-tailed component and its application to single-site daily rainfall simulation, Water Resour. Res., 49, 767-789, doi: 10.1002/wrcr.20063.
12. May, R. J., H. R. Maier, G. C. Dandy, and, T. Fernando, (2008), Non-linear variable selection for artificial neural networks using partial mutual information, Environ. Modell. Software, 23 (10-11), 1312-1326, doi: 10.1016/j.envsoft.2008.03.007.
13. Misirli, F., H. V. Gupta, S. Sorooshian, and, M. Thiemann, (2003), Bayesian recursive estimation of parameter and output uncertainty for watershed models, in Calibration of Watershed Models, Water Sci. Appl. Ser., vol 6, edited by, Q. Duan, pp. 113-124, AGU, Washington, D. C.
14. Pechlivanidis, I. G., B. M. Jackson, H. K. Mcmillan, and, H. V. Gupta, (2012a), Use of informational entropy-based metrics to drive model parameter identification, in Proceedings of the 12th International Conference on Enviornmental Science and Technology, edited by Lekkas T. D., Rhodes, Greece, A1476-A1483, Curran Associates, Inc., N. Y.
15. Pechlivanidis, I. G., B. M. Jackson, H. K. Mcmillan, and, H. V. Gupta, (2012b), Using an informational entropy-based metric as a diagnostic of flow duration to drive model parameter identification, Global NEST J., 14 (3), 325-334.
16. Ross, S. M., (2010), Introduction to Probability Models, 10th ed., Academic, Boston, Mass.
17. Ruddell, B. L., and, P. Kumar, (2009a), Ecohydrologic process networks: 1. Identification, Water Resour. Res., 45, W03419, doi: 10.1029/2008WR007279.
18. Ruddell, B. L., and, P. Kumar, (2009b), Ecohydrologic process networks: 2. Analysis and characterization, Water Resour. Res., 45 ̧ W03420, doi: 10.1029/2008WR007280.
19. Schoups, G., and, J. A. Vrugt, (2010), A formal likelihood function for parameter and predictive inference of hydrologic models with correlated, heteroscedastic, and non-Gaussian errors, Water Resour. Res., 46 ̧ W10531, doi: 10.1029/2009WR008933.
20. Scott, D. W., (1979), Optimal and data-based histograms, Biometrika, 66 (3), 605-610, doi: 10.2307/2335182. (Pubitemid 10218411)
21. Scott, D. W., (1985), Averaged shifted histograms-Effective nonparametric density estimators in several dimensions, Ann. Stat., 13 (3), 1024-1040, doi: 10.1214/aos/1176349654.
22. Scott, D. W., (2004), Handbook of Computational Statistics-Concepts and Methods, Springer, N. Y.
23. Scott, D. W., (2008), Multivariate Density Estimation: Theory, Practice, and Visualization, John Wiley, N. Y.
24. Scott, D. W., and, J. R. Thompson, (1983), Probability density estimation in higher dimensions, in Computer Science and Statistics: Proceedings of the Fifteenth Symposium on the Interface, edited by J. E. Gentle, 173-179, North-Holland, Amsterdam, Netherlands.
25. Shannon, C. E., (1948), A mathemetical theory of communication, Bell Syst. Tech. J., 27 (379-423), 623-656.
26. Sharma, A., (2000a), Seasonal to interannual rainfall probabilistic forecasts for improved water supply management: Part 1-A strategy for system predictor identification, J. Hydrol., 239 (1-4), 232-239, doi: 10.1016/S0022-1694(00)00346-2. (Pubitemid 32010449)
27. Sharma, A., (2000b), Seasonal to interannual rainfall probabilistic forecasts for improved water supply management: Part 3-A nonparametric probabilistic forecast model, J. Hydrol., 239 (1-4), 249-258, doi: 10.1016/S0022-1694(00)00348-6. (Pubitemid 32010451)
28. Sharma, A., K. C. Luk, I. Cordery, and, U. Lall, (2000), Seasonal to interannual rainfall probabilistic forecasts for improved water supply management: Part 2-Predictor identification of quarterly rainfall using ocean-atmosphere information, J. Hydrol., 239 (1-4), 240-248, doi: 10.1016/S0022-1694(00)00347-4. (Pubitemid 32010450)
29. Silverman, B. W., (1986), Density Estimation for Statistics and Data Analysis, Chapman and Hall, N. Y.
30. Singh, V. P., (1997), The use of entropy in hydrology and water resources, Hydrol. Processes, 11 (6), 587-626, doi: 10.1002/(SICI)1099- 1085(199705)11:6<587::AID-HYP479>3.3.CO;2-G.
31. Singh, V. P., (2000), The entropy theory as a tool for modelling and decision-making in environmental and water resources, Water SA, 26 (1), 1-11.
32. Singh, V. P., (2013), Entropy Theory and Its Application in Environmental and Water Engineering, Wiley-Blackwell, Oxford, U. K.
33. Sorooshian, S., and, J. A. Dracup, (1980), Stochastic parameter-estimation procedures for hydrologic rainfall-runoff models-Correlated and heteroscedastic error cases, Water Resour. Res., 16 (2), 430-442, doi: 10.1029/WR016i002p00430.
34. Sorooshian, S., Q. Y. Duan, and, V. K. Gupta, (1993), Calibration of rainfall-runoff models-Application of global optimization to the sacramento soil-moisture accouting model, Water Resour. Res., 29 (4), 1185-1194, doi: 10.1029/92WR02617. (Pubitemid 23383855)
35. Thiemann, M., M. Trosset, H. Gupta, and, S. Sorooshian, (2001), Bayesian recursive parameter estimation for hydrologic models, Water Resour. Res., 37 (10), 2521-2535, doi: 10.1029/2000WR900405. (Pubitemid 32908202)
36. Vrugt, J. A., H. V. Gupta, W. Bouten, and, S. Sorooshian, (2003), A shuffled complex evolution metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters, Water Resour. Res., 39 (8), 1201, doi: 10.1029/2002WR001642.
37. Weijs, S. V., and, N. van de Giesen, (2011), Accounting for observational uncertainty in forecast verification: An information-theoretical view on forecasts, observations, and truth B-5010-2008, Mon. Weather Rev., 139 (7), 2156-2162, doi: 10.1175/2011MWR3573.1.
38. Weijs, S. V., R. van Nooijen, and, N. van de Giesen, (2010a), Kullback-Leibler divergence as a forecast skill score with classic reliability-resolution-uncertainty decomposition, Mon. Weather Rev., 138 (9), 3387-3399, doi: 10.1175/2010MWR3229.1.
39. Weijs, S. V., G. Schoups, and, N. van de Giesen, (2010b), Why hydrological predictions should be evaluated using information theory, Hydrol. Earth Syst. Sci., 14 (12), 2545-2558, doi: 10.5194/hess-14-2545-2010.
40. Zoubir, A. M., and, B. Boashash, (1998), The bootstrap and its application in signal processing, IEEE Signal Process. Mag., 15 (1), 56-76, doi: 10.1109/79.647043.