Application of entropy concept for input selection of wavelet-ANN based rainfall-runoff modeling

Journal of Environmental Informatics

Volumn 26, Issue 1, 2015, Pages 52-70

  Nourani, V ^a   Khanghah, T R ^a   Baghanam, A H ^a  

^a UNIVERSITY OF TABRIZ   (Iran)

Author keywords

Feature extraction; Feed forward neural network; Multi step ahead forecasting; Rainfall runoff modeling; Shannon entropy (information content); Wavelet transform

Indexed keywords

ARTIFICIAL NEURAL NETWORK; DATA ACQUISITION; DATA SET; DECOMPOSITION; ENTROPY; GEOMORPHOLOGICAL RESPONSE; HYDROLOGICAL MODELING; PHYSICS; RAINFALL-RUNOFF MODELING; WATERSHED; WAVELET;

FLORIDA [UNITED STATES]; UNITED STATES;

EID: 84943252067     PISSN: 17262135     EISSN: 16848799     Source Type: Journal    
DOI: 10.3808/jei.201500309     Document Type: Article

References (42)

1. Abrahart, R.J., Anctil, F., Coulibaly, P., Dawson, C.W., Mount, N.J., See, L.M., Shamseldin, A.Y., Solomatine, D.P., Toth, E., and Wilby, R.L. (2012). Two decades of anarchy? Emerging themes and outstanding challenges for neural network river forecasting. Prog. Phys. Geogr., 36(4), 480-513. http://dx.doi.org/10.1177/0309133312444943
2. Adamowski, J. (2008). Development of a short-term river flood forecasting method for snowmelt driven floods based on wavelet and cross-wavelet analysis. J. Hydrol., 353(3-4), 247-266. http://dx.doi.org/10.1016/j.jhydrol.2008.02.013
3. Adamowski, J., Chan, H.F., Prasher, S.O., and Sharda, V.N. (2012). Comparison of multivariate adaptive regression splines with coupled wavelet transform artificial neural networks for runoff forecasting in Himalayan micro-watersheds with limited data. J. Hydroinf., 14(3), 731-744. http://dx.doi.org/10.2166/hydro.2011.044
4. Amorocho, J., and Espildora, B. (1973). Entropy in the assessment of uncertainty in hydrologic systems and models. Water Resour. Res., 9(6), 1551-1522. http://dx.doi.org/10.1029/WR009i006p01511
5. ASCE Task Committee on Application of Artificial Neural Networks in Hydrology (2000). Artificial neural networks in hydrology. II: Hydrologic applications. J. Hydrol. Eng., 5(2), 124-137. http://dx. doi.org/10.1061/(ASCE)1084-0699(2000)5:2(124)
6. Aussem, A., Campbell, J., and Murtagh, F. (1998). Wavelet-based feature extraction and decomposition strategies for financial forecasting. J. Comput. Intell. Finance, 6(2), 5-12.
7. Box, G.E.P., and Jenkins, G. (1976). Time Series Analysis: Forecasting and Control, Second ed., San Francisco, Holden-Day.
8. Cannas, B., Fanni, A., See, L., and Sias, G. (2006). Data preprocessing for river flow forecasting using neural networks: Wavelet transforms and data partitioning. Phys. Chem. Earth (A,B,C), 31(18), 1164-1171. http://dx.doi.org/10.1016/j.pce.2006.03.020
9. Caselton, W.F., and Husain, T. (1980). Hydrological networks: Information transmission. J. Water Resour. Plann. Manage., 106(WR2), 503-520.
10. Chang, F.J., Chiang, Y.M., and Chang, L.C. (2007). Multi-step-ahead neural networks for flood forecasting. Hydrol. Sci. J., 52(1), 114-130. http://dx.doi.org/10.1623/hysj.52.1.114
11. Cover, T.M., and Thomas, J.A. (1991). Elements of Information Theory, John Wiley & Sons, New York. http://dx.doi.org/10.1002/0471200611
12. Ebrahimi, N., Maasoumi, E., and Soofi, E.S. (1999). Ordering univariate distributions by entropy and variance. J. Econ., 90(2), 317-336. http://dx.doi.org/10.1016/S0304-4076(98)00046-3
13. Gao, Z., Gu, B., and Lin, J. (2008). Monomodal image registration using mutual information based methods. Image Vision Comput., 26(2), 164-173. http://dx.doi.org/10.1016/j.imavis.2006.08.002
14. Hagan, M.T., and Menhaj, M.B. (1994). Training feedforward networks with the Marquardt algorithm. IEEE Trans. Neural Networks, 5(6), 989-993. http://dx.doi.org/10.1109/72.329697
15. Harmancioglu, N.B., and Singh, V.P. (1998). Entropy in Environmental and Water Resources, Kluwer Academic Publishers, Dordrecht.
16. Hornik, K., Stinchcombe, M., and White, H. (1989). Multilayer feed forward networks are universal approximators. Neural Networks, 2(5), 359-366. http://dx.doi.org/10.1016/0893-6080(89)90020-8
17. Krstanovic, P.F., and Singh, V.P. (1992). Evaluation of rainfall networks using entropy: I. Theoretical development. Water Resour. Manage., 6(4), 279-293. http://dx.doi.org/10.1007/BF00872281
18. Labat, D. (2005). Recent advances in wavelet analyses: Part 1. A review of concepts. J. Hydrol., 314(1-4), 275-288. http://dx.doi.org/10.1016/j.jhydrol.2005.04.003
19. Legates, D.R., and McCabe, G.J. (1999). Evaluating the use of "goodness- of-fit" measures in hydrologic and hydroclimatic model validation. Water Resour. Res., 35(1), 233-241. http://dx.doi.org/10.1029/1998WR900018
20. Levenberg, K. (1944). A method for the solution of certain non-linear problems in least squares. Q. Appl. Math., 2(2), 164-168.
21. Maheswaran, R., and Khosa, R. (2012a). Multiscale nonlinear model for monthly stream flow forecasting: A wavelet-based approach. J. Hydroinf., 14(2), 424-442. http://dx.doi.org/10.2166/hydro.2011.130
22. Maheswaran, R., and Khosa, R. (2012b). Comparative study of different wavelets for hydrologic forecasting. Comput. Geosci., 46, 284-295. http://dx.doi.org/10.1016/j.cageo.2011.12.015
23. Mallat, S.G. (1998). A Wavelet Tour of Signal Processing, Academic Publication, San Diego.
24. MathWorks, Inc. (2010). MATLAB: User's Guide, Version 7, The Math works, Inc., Natick.
25. May, R.J., Maier, H.R., Dandy, G.C., and Gayani Fernando, T.M.K. (2008). Non-linear variable selection for artificial neural networks using partial information. Environ. Model. Software, 23(10-11), 1312-1326. http://dx.doi.org/10.1016/j.envsoft.2008.03.007
26. Mishra, A.K., Ӧzger, M., and Singh, V.P. (2009). An entropy-based investigation into the variability of precipitation. J. Hydrol., 370(1-4), 139-154. http://dx.doi.org/10.1016/j.jhydrol.2009.03.006
27. Morchen, F. (2003). Time Series Feature Extraction for Data Mining Using DWT and DFT, Technical Report, Department of Mathematics and Computer Science, University of Marburg, Germany.
28. Nourani, V. (2010). Reply to comment on ‘Nourani V, Mogaddam AA, Nadiri AO. 2008. An ANN-based model for spatiotemporal groundwater level forecasting. Hydrological Processes 22: 5054-5066’. Hydrol. Process., 24(3), 370-371. http://dx.doi.org/10.1002/hyp.7469
29. Nourani, V., and Zanardo, S. (2014). Wavelet-based regularization of the extracted topographic index from high-resolution topography for hydro-geomorphic applications. Hydrol. Process., 28(3), 1345-1357. http://dx.doi.org/10.1002/hyp.9665
30. Nourani, V., Komasi, M., and Mano, A. (2009). A multivariate ANN-wavelet approach for rainfall-runoff modeling. Water Resour. Manage., 23(14), 2877-2894. http://dx.doi.org/10.1007/s11269-009-9414-5
31. Nourani, V., Kisi, O., and Komasi, M. (2011). Two hybrid artificial intelligence approaches for modeling rainfall-runoff process. J. Hydrol., 402(1-2), 41-59. http://dx.doi.org/10.1016/j.jhydrol.2011.03.002
32. Nourani, V., Baghanam, A.H., and Gebremichael, M. (2012). Investigating the ability of Artificial Neural Network (ANN) models to estimate missing rain-gauge data. J. Environ. Inf., 19(1), 38-50. http://dx.doi.org/10.3808/jei.201200207
33. Nourani, V., Baghanam, A.H., Adamowski, J., and Gebremichael, M. (2013). Using self-organizing maps and wavelet transforms for space-time pre-processing of satellite precipitation and runoff data in neural network based rainfall-runoff modeling. J. Hydrol., 476, 228-243. http://dx.doi.org/10.1016/j.jhydrol.2012.10.054
34. Rajaee, T., Nourani, V., Zounemat-Kermani, M., and Kisi, O. (2011). River suspended sediment load prediction: Application of ANN and wavelet conjunction model. J. Hydrol. Eng., 16(8), 613-627. http://dx.doi.org/10.1061/(ASCE)HE.1943-5584.0000347
35. Safehian, J., Akbarzadeh, A., and Imani, B.M. (2012). Application of wavelet thresholding filter to improve multi-step ahead prediction model for hydraulic system. Adv. Mater. Res., 488-489, 1783-1787. http://dx.doi.org/10.4028/www.scientific.net/AMR.488-489.1783
36. Sang, Y.F. (2013). A review on the applications of wavelet transform in hydrology time series analysis. Atmos. Res., 122, 8-15. http://dx.doi.org/10.1016/j.atmosres.2012.11.003
37. Shannon, C.E. (1948). A mathematical theory of communications I and II. Bell Syst. Tech. J., 27(3), 379-443. http://dx.doi.org/10.1002/j.1538-7305.1948.tb01338.x
38. Shoaib, M., Shamseldin, A.Y., and Melville, B.W. (2014). Comparative study of different wavelet based neural network models for rainfall-runoff modeling. J. Hydrol., 515, 47-58. http://dx.doi.org/10.1016/j.jhydrol.2014.04.055
39. Singh, V.P. (1997). The use of entropy in hydrology and water resources. Hydrol. Process., 11(6), 587-626. http://dx.doi.org/10.100 2/(SICI)1099-1085(199705)11:6<587::AID-HYP479>3.0.CO;2-P
40. Singh, V.P. (2011). Hydrologic synthesis using entropy theory: Review. J. Hydrol. Eng., 16(5), 421-433. http://dx.doi.org/10.1061/(ASCE)HE.1943-5584.0000332
41. Singh, R.M. (2012). Wavelet-ANN model for flood events. Adv. Intell. Soft Comput., 131, 165-175. http://dx.doi.org/10.1007/978-81-322-0491-6_16
42. Yang, H.H., Vuuren, S.V., Sharma, S., and Hermansky, H. (2000). Relevance of time-frequency features for phonetic and speakerchannel classification. Speech Commun., 31(1), 35-50. http://dx. doi.org/10.1016/S0167-6393(00)00007-8