Entropy Theory and its Application in Environmental and Water Engineering

Entropy Theory and its Application in Environmental and Water Engineering

Volumn , Issue , 2013, Pages

  Singh, Vijay P ^a,b  

^a Texas A and M University   (United States)

^b Texas AandM University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84891584099     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781118428306     Document Type: Book

References (353)

1. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. Proceedings 2nd International Symposium on Information Theory, B.N. Petrov and F. Csaki, eds., Publishing House of the Hungarian Academy of Sciences, Budapest, Hungary.
2. Batty, M. (2010). Space, scale, and scaling in entropy maximizing. Geographical Analysis, Vol. 42, pp. 395-421.
3. Brillouin, L. (1956). Science and Information Theory. Academic Press, New York.
4. Denbigh, K.G. (1989). Note on entropy, disorder and disorganization. British Journal of Philosophical Science, Vol. 40, pp. 323-32.
5. Fast, J.D. (1968). Entropy: The Significance of the Concept of Entropy and its Application in Science and Technology. Gordon and Breach, Science Publishers Inc., New York.
6. Fisher, R.A. (1921). On mathematical foundations of theoretical statistics. Philosophical Transactions of the Royal Society of London, Series A, Vol. 222, pp. 30-368.
7. Gull, S.F. (1991). Some misconceptions about entropy. Chapter 7 in: Maximum Entropy in Action, edited by B. Buck and V.A. McCauley, Oxford Science Publishers, pp. 171-86.
8. Hartley, R.V.L. (1928). Transmission of information. The Bell System Technical Journal, Vol. 7, No. 3, pp. 535-63.
9. Kaplan, S. and Garrick, B.J. (1981). On the quantitative definition of risk. Risk Analysis, Vol. 1, No. 1, pp. 11-27.
10. Kapur, J.N. (1989). Maximum Entropy Models in Science and Engineering. Wiley Eastern Ltd., New Delhi, India.
11. Klir, G. J. (2006). Uncertainty and Information: Foundations of Generalized Information Theory. John Wiley & Sons, New York.
12. Luce, R.D., (1960). The theory of selective information and source of its behavioral applications. In: Developments in Mathematical Psychology, edited by R.D. Luce, The Free Press, Glencoe.
13. Marchand, B., (1972). Information theory and geography. Geographical Analysis, Vol. 4, pp. 234-57.
14. Maxwell, J.C. (1872). The Theory of Heat. D. Appleton, New York (reproduced by University Microfilms).
15. Ng, S.K. (1996). Information and system modeling. Mathematical and Computer Modeling, Vol. 23, No. 5, pp. 1-15.
16. Pal, N.R. and Pal, S.K. (1991a). Entropy: A new definition and its applications. IEEE: Transactions on Systems, Man, and Cybernetics, Vol. 21, No. 5, pp. 1260-70.
17. Pal, N.R. and Pal, S.K. (1991b). Image model, Poisson distribution and object extraction. International Journal of Pattern Recognition and Artificial Intelligence, Vol. 5, No. 3, pp. 459-83.
18. Pal, N.R. and Pal, S.K. (1992). Some properties of the exponential entropy. Informational Sciences, Vol. 66, pp. 119-37.
19. Pal, N.R. and Bezdek, J.C. (1994). Measuring fuzzy uncertainty. IEEE Transactions on Fuzzy Systems, Vol. 2, No. 2, pp. 107-18.
20. Papalexiou, S.M. and Koutsoyiannis, D. (2012). Entropy based derivation of probability distributions: A case study to daily rainfall. Advances in Water Resources, Vol. 45, pp. 51-57.
21. Prigogine, I. (1989). What is entropy?. Naturwissenschaften, Vol. 76, pp. 1-8.
22. Renyi, A. (1961). On measures of entropy and information. Proceedings, 4th Berkeley Symposium on Mathematics, Statistics and Probability, Vol. 1, pp. 547-561.
23. Rosenthal, H. and Binia, J. (1988). On the epsilon entropy of mixed random variables. IEEE Transactions on Information Theory, Vol. 34, No. 5, pp. 1110-14.
24. Shannon, C.E. (1948). A mathematical theory of communications, I and II. Bell System Technical Journal, Vol. 27, pp. 379-443.
25. Shannon, C.E. and Weaver, W. (1949). The Mathematical Theory of Communication. University of Illinois Press, Urbana, Illinois.
26. Sugawara, M. (1971). Water resources and negentropy. Proceedings of the Warsaw Symposium on Mathematical Models in Hydrology, Vol. 2, pp. 876-8, IAHS-UNESCO-WM, Warsaw, Poland.
27. Tsallis, C. (1988). Possible generalization of Boltzmann-Gibbs statistics. Journal of Statistical Physics, Vol. 52, No. 1/2, pp. 479-87.
28. Tribus, M. (1969). Rational Description: Decision and Designs. Pergamon Press, New York.
29. Watanabe, S. (1969). Knowing and Guessing: A Quantitative Study of Inference and Information. John Wiley & Sons, New York.
30. Zurek, W.H., 1989. Algorithmic randomness and physical entropy. Physical Review A, Vol. 40, No. 8, pp. 4731-51.
31. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, Vol. AC-19, No. 6, pp. 710-23.
32. Akaike, H. (1985). Prediction and entropy. Chapter 1 in: A Celebration of Statistics, edited by A.C. Atkinson and S.E. Fienberg, pp. 1-24, Springer-Verlag, Heidelberg, Germany.
33. Carnap, R. (1977). Two Essays on Entropy. University of California Press, Berkeley, California.
34. Cover, T.M. and Thomas, J.A. (1991). Elements of Information Theory. John Wiley & Sons, New York.
35. Harmancioglu, N.B. and Singh, V.P. (1998). Entropy in Environmental and Water Resources. pp. 225-241.
36. Jaynes, E.T. (1958). Probability Theory in Science and Engineering. Colloquium Lectures in Pure and Applied Science, Vol. 4, Field Research Laboratory, Socony Mobil Oil Company, Inc., USA.
37. Khinchin, A.I. (1957). The Entropy Concept in Probability Theory. Translated by R.A. Silverman and M.D. Friedman, Dover Publications, New York.
38. Jaynes, E.T. (1957). Information theory and statistical mechanics, I. Physical Review, Vol. 106, pp. 620-30.
39. Jaynes, E.T. (1982). On the rationale of maximum entropy methods. Proceedings of the IEEE, Vol. 70, pp. 939-52.
40. Levine, R.D. and Tribus, M., eds., (1978). The Maximum Entropy Formalism, 498 p., The MIT Press, Cambridge, Massachusetts.
41. Singh, V.P. (1998). Entropy-Based Parameter Estimation in Hydrology. Kluwer Academic Publishers, Boston, Massachusetts.
42. Singh, V.P. (1998). The use of entropy in hydrology and water resources. Hydrological Processes, Vol. 11, pp. 587-626.
43. Singh, V.P. (1998). Entropy as a decision tool in environmental and water resources. Hydrology Journal, Vol. XXI, No. 1-4, pp. 1-12.
44. Singh, V.P. (2000). The entropy theory as tool for modeling and decision making in environmental and water resources. Water SA, Vol. 26, No. 1, pp. 1-11.
45. Singh, V.P. (2003). The entropy theory as a decision making tool in environmental and water resources. In: Entropy Measures, Maximum Entropy and Emerging Applications, edited by Karmeshu, Springer-Verlag, Bonn, Germany, pp. 261-97.
46. Singh, V.P. (2005). Entropy theory for hydrologic modeling. in: Water Encyclopedia: Oceanography; Meteorology; Physics and Chemistry; Water Law; and Water History, Art, and Culture, edited by J. H. Lehr, Jack Keeley, Janet Lehr and Thomas B. Kingery, John Wiley & Sons, Hoboken, New Jersey, pp. 217-23.
47. Singh, V.P. (2011). Hydrologic synthesis using entropy theory: Review. Journal of Hydrologic Engineering, Vol. 16, No. 5, pp. 421-33.
48. Singh, V.P. and Fiorentino, M., editors (1992). Entropy and Energy Dissipation in Hydrology. Kluwer Academic Publishers, Dordrecht, The Netherlands, 595 p.
49. White, H. (1965). The entropy of a continuous distribution. Bulletin of Mathematical Biophysics, Vol. 27, pp. 135-43.
50. Abramowitz, M. and Stegun, I.A. (1970). Handbook of Mathematical Functions. Dover, New York.
51. Amorocho, J. and Espildora, B. (1973). Entropy in the assessment of uncertainty in hydrologic systems and models. Water Resources Research, Vol. 9, No. 6, pp. 1511-22.
52. Ash, R.B. (1965). Information Theory. Dover, New York.
53. Batty, M.J. (2010). Space, scale, and scaling in entropy maximizing. Geographical Analysis, Vol. 42, pp. 395-421.
54. Burg, J.P. (1975). Maximum entropy spectral analysis. Unpublished Ph.D. thesis, Stanford University, 123 p., Palo Alto, California.
55. Burg, J.P. (1977). Maximum entropy spectral analysis. Paper presented at the 37th Annual Meeting of Society of Exploration Geophysics, Oklahoma City, Oklahoma.
56. Chapman, T.G. (1980). Equations for entropy in hydrologic time series. Department of Civil Engineering, Faculty of Military Studies, University of New South Wales, Duntroon, N.S.W., Australia.
57. Chapman, T.G. (1986). Entropy as a measure of hydrological data uncertainty and model performance. Journal of Hydrology, Vol. 85, pp. 111-26.
58. Dembo, A. (1989). Simple proof of the concavity of the entropy power with respect to added Gaussian noise. IEEE Transactions on Information Theory, Vol. 35, No. 4, pp. 887-8.
59. Denbigh, K.G. (1989). Note on entropy, disorder and disorganization. British Journal of Philosophy and Science, Vol. 40, pp. 323-32.
60. Denbigh, K.G. and Denbigh, J.S. (1985). Entropy in Relation to Incomplete Knowledge. Cambridge University Press, Cambridge, U.K.
61. Feder, M. and Merhav, N. (1994). Relations between entropy and error probability. IEEE Transactions on Information Theory, Vol. 40, No. 1, pp. 259-66.
62. Feder, M., Merhav, N. and Gutman, M. (1992). Universal prediction of individual sequences. IEEE Transactions on Information Theory, Vol. 38, pp. 1258-70.
63. Feisauerova, J. and Vajda, I. (1993). Testing system entropy and prediction error probability. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 23, No. 5, pp. 1352-8.
64. Garner, W.R. and Hake, H.W. (1951). The amount of information in absolute judgments, Psychology Review, Vol. 58, pp. 446-59.
65. Harmancioglu, N.B., Yevjevich, V. and Obeysekara, J.T.B. (1986). Measures of information transfer between variables. in Proceedings of the Fourth International Hydrology Symposium on Multivariate Analysis of Hydrologic Processes, edited by H.W. Shen, pp. 481-99, Fort Collins, Colorado, July 1985.
66. Harmancioglu, N.B. and Singh, V.P. (1998). Entropy in environmental and water resources. Encyclopedia of Hydrology and Water Resources, R. W. Hershey and R. W. Fairbridge, eds., 225-41, Kluwer Academic Publishers, Boston, Massachusetts.
67. Jaynes, E.T. (1957). Information theory and statistical mechanics, I. Physical Review, 106, 620-30.
68. Jaynes, E.T. (1968). Prior probabilities. IEEE Transactions on System Science and Cybernetics, Vol. 70, pp. 939-52.
69. Jaynes, E.T. (1979). Concentration of distributions at entropy maxima. Paper presented at the 19th NBERNSF Seminar on Bayesian Statistics, Montreal, October 1979. in E.T. Jaynes: Papers on Probability, Statistics and Statistical Physics, edited by R.D. Rosenkratz, pp. 315-36, D. Reidel Publishing Co., Boston, MA, 1983.
70. Jaynes, E.T. (1982). On the rationale of maximum entropy methods. Proceedings of the IEEE, Vol. 70, 939-52.
71. Johnson, R.W. and Shore, J.E. (1984). Which is the better entropy expression for speech processing:-SlogS or LogS?. IEEE Transactions on Acoustics, Speech, and Signal Proecssing, Vol. ASSP-32, No. 1, pp. 129-37.
72. Kapur, J.N. and Kesavan, H.K. (1992). Entropy Maximization Principles with Applications. Academic Press, Inc., New York.
73. Kullback, S. (1959). Information Theory and Statistics. John Wiley & Sons, New York (reprinted in 1968 by Dover).
74. Kullback, S. and Leibler, R.A. (1951). On information and sufficiency. Annals of Mathematical Statistics, 22, 79-86.
75. Lathi, B.P. (1969). An Introduction to Random Signals and Communication Theory. International Textbook Company, Scanton, Pennsylvania.
76. Levine, R.D. and Tribus, M., eds. (1978). The Maximum Entropy Formalism, 498p., The MIT Press, Cambridge, Massachusetts.
77. Lindley, D.V. (1956). On a measure of information provided by an experiment. The Annals of Mathematical Statistics, Vol. 27, pp. 986-1005.
78. Lindley, D.V. (1961). The use of prior probability distributions in statistical inference and decision. Proceedings of the Fourth Berkeley Symposium, Vol. 1, pp. 436-8.
79. Marchand, B. (1972). Information theory and geography. Geographical Analysis, Vol. 4, pp. 234-57.
80. McGill, W.J. (1953). Multivariate transmission of information and its relation to analysis of variance. Report No. 32, Human Factors Operations Research Laboratories, MIT, Cambridge, Massachusetts.
81. McGill, W.J. (1954). Multivariate information transmission. Psychometrica, Vol. 19, No. 2, pp. 97-116.
82. Miller, G.A. (1953). What is information measurement?. American Psychologist, Vol. 8, pp. 3-11.
83. Moran, P.A.P. (1969). Statistical inference with bivariate gamma distributions. Biometrika, Vol. 56, No. 3, pp. 627-34.
84. Mukherjee, D. and Ratnaparkhi, M.V. (1986). On the functional relationship between entropy and variance with related applications. Communication in Statistics-Theory and Methods, Vol. 15, No. 1, pp. 291-311.
85. Papoulis, A. (1991). Probability, Random Variables and Stochastic Processes, 3rd edition, McGraw Hill, New York.
86. Paszto, V., Tuček, P. and Voženílek, V. (2009). On spatial entropy in geographical data. GIS Ostrava 2009.
87. Shannon, C.E. (1948). A mathematical theory of communications, I and II. Bell System Technical Journal, Vol. 27, pp. 379-443.
88. Shannon, C.E. and Weaver, W. (1949). The Mathematical Theory of Communication. University of Illinois Press, Urbana, Illinois.
89. Soofi, E. (1994). Capturing the intangible concept of information. Journal of the American Statistical Association, Vol. 89, No. 428, pp. 1243-54.
90. Tribus, M. (1969). Rational Description: Decision and Designs. Pergamon Press, New York.
91. Von Foerster, H. (1960). On self-organizing systems and their environments. In: Self-Organizing Systems, edited by C. Yovits and C. Cameron, Pergamon Press, Oxford, pp. 31-50.
92. White, H. (1965). The entropy of a continuous distribution. Bulletin of Mathematical Biophysics, Vol. 27, pp. 135-43.
93. Wilson, A.G. (1970). Entropy in Urban and Regional Modeling. Pion, London, England.
94. Zamir, R. and Feder, M. (1993). A generalization of the entropy power inequality with applications. IEEE Transactions on Information Theory, Vol. 39, No. 5, pp. 1723-8.
95. Agmon, N., Alhassid, Y. and Levine, R.D. (1979). An algorithm for finding the distribution of maximal entropy. Journal of Computational Physics, Vol. 30, No. 2, pp. 250-9.
96. Evans, R.A. (1969). The principle of minimum information. IEEE Transactions on Reliability, Vol. R-18, No. 3, pp. 87-90.
97. Feder, M. (1986). Maximum entropy as a special case on the minimum description length criterion. IEEE Transactions on Information Theory, Vol. IT-32, No. 6, pp. 847-9.
98. Jaynes, E.T. (1957a). Information theory and statistical mechanics, I. Physical Reviews, Vol. 106, pp. 620-30.
99. Jaynes, E.T. (1957b). Information theory and statistical mechanics, II. Physical Reviews, Vol. 108, pp. 171-90.
100. Jaynes, E.T. (1961). Probability Theory in Science and Engineering. McGraw-Hill Book Company, New York.
101. Jaynes, E.T. (1982). On the rationale of maximum entropy methods. Proceedings of IEEE, Vol. 70, pp. 939-52.
102. Kapur, J.N. (1989). Maximum Entropy Models in Science and Engineering. Wiley Eastern, New Delhi, India.
103. Kapur, J.N. and Kesavan, H.K. (1987). Generalized Maximum Entropy Principle (with Applications). Sandford Educational Press, University of Waterloo, Waterloo, Canada.
104. Kapur, J.N. and Kesavan, H.K. (1992). Entropy Optimization Principles with Applications. 408 p., Academic Press, New York.
105. Kesavan, H.K. and Kapur, J.N. (1989). The generalized maximum entropy principle. IEEE Transactions: Systems, Man and Cybernetics, Vol. 19, pp. 1042-52.
106. Rissanen, J. (1978). Modeling by shortest data description. Automatica, Vol. 14, pp. 465-71.
107. Rissanen, J. (1983). A universal prior for integers and estimation by MDL. Annals of Statistics, Vol. 11, No. 2, pp. 416-32.
108. Rissanen, J. (1984). Universal coding, information, prediction and estimation. IEEE Transactions on Information Theory, Vol. IT-30, No. 4, pp. 629-36.
109. Shore, J.E. and Johnson, R.W. (1980). Properties of cross-entropy minimization. IEEE Transactions on Information Theory, Vol. 17, pp. 472-82.
110. Soofi, E. (1994). Capturing the intangible concept of information. Journal the American Statistical Association, Vol. 89, No. 428, pp. 1243-54.
111. Van Campenhout, J. and Cover, T.M. (1981). Maximum entropy and conditional probability. IEEE Transactions on Information Theory, Vol. IT-27, No. 4, pp. 483-9.
112. Fiorentino, M., Claps, P. and Singh, V.P. (1993). An entropy-based morphological analysis of river-basin networks. Water Resources Research, Vol. 29, No. 4, pp. 1215-24.
113. Hao, Z. and Singh, V. P. (2009a). Entropy-based parameter estimation for extended three parameter Burr III distribution for low-flow frequency analysis. Transactions of the ASABE, Vol. 52, No. 4, pp. 1-10.
114. Hao, Z. and Singh, V.P. (2009b). Entropy-based parameter estimation for extended Burr XII Distribution. Stochastic Environmental Research and Risk Analysis, Vol. 23, pp. 1113-22.
115. Kapur, J.N. (1989). Maximum Entropy Models in Science and Engineering. Wiley Eastern, New Delhi, India.
116. Kapur, J.N. and Kesavan, H.K. (1987). Generalized Maximum Entropy Principle (with Applications). Sandford Educational Press, University of Waterloo, Waterloo, Canada.
117. Kapur, J.N. and Kesavan, H.K. (1992). Entropy Optimization Principles with Applications. 408 p., Academic Press, New York.
118. Krstanovic, P.F. and Singh, V.P. (1988). Application of entropy theory to multivariate hydrologic analysis, Vol. 1, Technical Report WRR8, 269 pp., Water Resources Program, Department of Civil Engineering, Louisiana State University, Baton Rouge, Louisiana.
119. Lienhard, J.H. (1964). A statistical mechanical prediction of the dimensionless unit hydrograph. Journal of Geophysical Research, Vol. 69. No. 24, pp. 5231-8.
120. Lienhard, J.H. (1966). A physical basis for the generalized gamma distribution. Quarterly of Applied Mathematics, Vol. 25, pp. 330-4.
121. Lienhard, J.H. (1972). Prediction of the dimensionless unit hydrograph. Nordic Hydrology, Vol. 3. pp. 107-9.
122. Rai, R.K., Sarkar, S., Upadhyay, A. and Singh, V.P. (2010). Efficacy of Nakagami-m distribution function for deriving unit hydrograph. Water Resources Management, Vol. 24, pp. 563-75.
123. Shao, Q.X., Wong, H., Xia, J., Wai-Cheung, I.P. (2004) Models for extremes using the extended threeparameter Burr XII system with application to flood frequency analysis. Hydrologic Sciences Journal, Vol. 49, No. 4, pp. 685-701.
124. Shao, Q.X., Chen, Y.D. and Zhang, L. (2008). An extension of three-parameter Burr III distribution for low-flow frequency analysis. Comp. Statistics and Data Analysis, Vol. 52, No. 3, pp. 1304-14.
125. Singh, V.P. (1998). Entropy-Based Parameter Estimation in Hydrology. Kluwer Academic Press, Boston.
126. Ali M.M., Mikhail, N.N. and Haq, M.S. (1978). A class of bivariate distributions including the bivariate logistic. Journal of Multivariate Analysis, Vol. 8, pp. 405-12.
127. Berntson, J., Espelid, T.O., and Genz, A. (1991). An adaptive algorithm for the approximate calculation of multiple integrals. ACM Transactions of Mathematical Software, Vol. 17, pp. 437-451.
128. Embrechts, P., Lindskog F. and McNeil, A. (2001). Modelling dependence with copulas and applications to risk management. http://www.risklab.ch/ftp/papers/DependenceWithCopulas.pdf.
129. Galambos, J. (1978). The Asymptotic Theory of Extreme Order Statistics. John Wiley & Sons, New York.
130. Genest, C. and L.-P. Rivest (1993). Statistical inference procedures for bivariate Archimedean copulas. Journal of the American Statistical Association Vol. 88, No. 423, pp. 1034-43.
131. Hu, L. (2006). Dependence patterns across financial markets: a mixed copula approach. Applied Financial Economics, Vol. 16, pp. 717-29.
132. Joe H. (1997). Multivariate Models and Dependence Concepts, Chapman and Hall, London.
133. Krstanovic, P.F. and Singh, V.P. (1988). Application of entropy theory to multivariate hydrologic analysis, Vol. 1. Technical Report WRR 8, Water Resources Program, Department of Civil Engineering, Louisiana State University, Baton Rouge, Louisiana.
134. Krstanovic, P.F. and Singh, V.P. (1988). Application of entropy theory to multivariate hydrologic analysis, Vol. 2. Technical Report WRR 9, Water Resources Program, Department of Civil Engineering, Louisiana State University, Baton Rouge, Louisiana.
135. Nelson, R.B. (1999). An Introduction to Copulas. Springer, New York.
136. Nelsen, R.B. (2006) An Introduction to Copulas, second edition. Springer-Verlag, New York.
137. Salvadori, G., De Michele, C., Kottegoda, N.T. and Rosso, R. (2007) Extremes in Nature: An Approach Using Copulas. Springer, Dordrecht, Netherlands.
138. Savu, C. and Trede, M. (2008). Goodness-of-fit tests for parametric families of Archimedean copulas. Quantitative Finance, Vol. 8, No. 2, pp. 109-16.
139. Sklar, A. (1959) Fonctions derépartitionàn dimensions et leurs marges. Publ. Inst. Stat. Univ. Paris, Vol. 8, pp. 229-231.
140. Wang, X., Gebremichael, M., Yan, J. (2010). Weighted likelihood copula modeling of extreme rainfall events in Connecticut. Journal of Hydrology, Vol. 390, No. 1-2, pp. 108-15.
141. Yue, S., Ouarda, T.B.M.J., Bobee, B., Legendre, P., Bruneau, P. (1999). The Gumbel mixed model for flood frequency analysis. Journal of Hydrology, Vol. 226, No. 1-2, pp. 88-100.
142. Dragomir, S.S., Scholz, M.L. and Sunde, J. (2000). Some upper bounds for relative entropy and applications. Computers and Mathematics with Applications, Vol. 39, pp. 91-100.
143. Hellman, M.E. and Raviv, J., (1970). Probability of error, equivocation, and the Chernoff bound. IEEE Transactions on Information Theory, Vol. IT-16, No. 4, pp. 368-72.
144. Kullback, S., (1959). Information Theory and Statistics. John Wiley, New York.
145. Kullback, S. and Leibler, R.A., (1951). On information and sufficiency. Annals of Mathematical Statistics, Vol. 22, pp. 79-86.
146. Kapur, J.N. (1989). Maximum Entropy Models in Science and Engineering. Wiley Eastern, New Delhi, India.
147. Kapur, J.N. and Kesavan, H.K. (1987). Generalized Maximum Entropy Principle (with Applications). Sandford Educational Press, University of Waterloo, Waterloo, Canada.
148. Kapur, J.N. and Kesavan, H.K. (1992). Entropy Optimization Principles with Applications. 408 p., Academic Press, New York.
149. Lin, J. (1991). Divergence measures based on the Shannon entropy. IEEE Transactions on Information Theory, Vol. 37, No. 1, pp. 145-51.
150. Toussaint, G.T. (1975). Sharper lower bounds for discrimination information in terms of variation. IEEE Transactions on Information Theory, Vol. IT-21, No. 1, pp. 99-100.
151. Vajda, I. (1970). Note on discrimination information and variation. IEEE Transactions on Information Theory, Vol. IT-16, pp. 771-6.
152. Kullback, S. (1959). Information Theory and Statistics. John Wiley, New York.
153. Kullback, S. and Leibler, R.A. (1951). On information and sufficiency. Annals of Mathematical Statistics, Vol. 22, pp. 79-87.
154. Kapur, J.N. (1989). Maximum Entropy Models in Science and Engineering. Wiley Eastern, New Delhi, India.
155. Kapur, J.N. and Kesavan, H.K. (1987). Generalized Maximum Entropy Principle (with Applications). Sandford Educational Press, University of Waterloo, Waterloo, Canada.
156. Kapur, J.N. and Kesavan, H.K. (1992). Entropy Optimization Principles with Applications. 408 p., Academic Press, New York.
157. Abramowitz, M. and Stegun, I.S. (1965). Handbook of Mathematical Functions. U.S. Department of Commerce, National Bureau of Standards, Washington, D.C.
158. Agmon, N., Alhassid, Y. and Levine, R.D. (1979). An algorithm for finding the distribution of maximal entropy. Journal of Computational Physics, Vol. 30, pp. 250-8.
159. Kapur, J.N. (1989). Maximum Entropy Models in Science and Engineering. Wiley Eastern, New Delhi, India.
160. Kapur, J.N. and Kesavan, H.K. (1988). Generalized Maximum Entropy Principle (with Applications). Sandford Educational Press, University of Waterloo, Waterloo, Canada.
161. Kapur, J.N. and Kesavan, H.K. (1992). Entropy Optimization Principles with Applications. 408 p., Academic Press, New York.
162. Kendall, M. G. and Stuart, A. (1973). The Advanced Theory of Statistics, vol. 2. Inference and relationship. Charles Griffin, London, UK.
163. Mead, L.R. and Papanicolaou, N. (1984). Maximum entropy in the problem of moments. Journal of Mathematical Physics, Vol. 25, No. 8, pp. 2404-17.
164. Singh, V.P. (1997). The use of entropy in hydrology and water resources. Hydrological Processes, Vol. 11, pp. 587-626.
165. Singh, V.P. (1998a). Entropy-based Parameter Estimation in Hydrology. Kluwer Academic Publishers, Boston.
166. Singh, V.P. (1998b). Entropy as a decision tool in environmental and water resources. Hydrology Journal, Vol. 21, No. 1-4, pp. 1-12.
167. Singh, V.P. (2000). The entropy theory as tool for modeling and decision making in environmental and water resources. Water SA, Vol. 26, No. 1, pp. 1-11.
168. Singh, V.P. and Fiorentino, M. (1992). A historical perspective of entropy applications in water resources. In: Entropy and Energy Dissipation in Water Resources, edited by V.P. Singh and M. Fiorentino, pp. 21-62, Kluwer Academic Publishers, Dordrecht, The Netherlands.
169. Singh, V.P. and Rajagopal, A.K. (1986). A new method of parameter estimation for hydrologic frequency analysis. Hydrological Science and Technology, Vol. 2, No. 3, pp. 33-40.
170. Singh, V.P., Rajagopal, A. K. and Singh, K. (1986). Derivation of some frequency distributions using the principle of maximum entropy (POME). Advances in Water Resources, Vol. 9, No. 2, pp. 91-106.
171. Singh, V.P., Singh, K. and Rajagopal, A. K. (1985). Application of the principle of maximum entropy (POME) to hydrologic frequency analysis, Completion Report 06, l44 p., Louisiana Water Resources Research Institute, Louisiana State University, Baton Rouge, Louisiana.
172. Adamic, L.A. (2002). Zpf, power-laws, and Pareto-ranking tutorial. Information Dynamics Lab, HP Labs, Palo Alto, California. Available at http://www.hpl.hp.com/research/idl/papers/ranking/ranking.html.
173. Anderson, J. (1969). On general system theory and the concept of entropy in urban geography. Research Paper No. 31, London School of Economics, Department of Geography, London, U.K.
174. Beckmann, M.J. (1974). Entropy, gravity and utility in transportation modeling. In: Information, Inference and Decision, edited by G. Menges, pp. 155-63, D. Reidel Publishing Company, Dordrecht, Holland.
175. Batty, M. (1972). Entropy and spatial geometry. Area, Vol. 4(4), pp. 230-6.
176. Batty, M. (1974). Spatial entropy. Geographical Analysis, Vol. 6, pp. 1-31.
177. Batty, M. (1976). Entropy in spatial aggregation. Geographical Analysis, Vol. 8, pp. 1-21.
178. Batty, M. (1983). Cost, accessibility, and weighted entropy. Geographical Analysis, Vol. 15, pp. 256-67.
179. Batty, M. (2010). Space, scale, and scaling in entropy maximizing. Geographical Analysis, Vol. 42, pp. 395-421.
180. Batty, M. and Sammons, R. (1978). On searching for the most informative spatial pattern. Environment and planning A, Vol. 10, pp. 747-79.
181. Batty, M. and Sammons, R. (1979). A conjecture on the use of Shannon's formula for measuring spatial information. Geographical Analysis, Vol. 11, No. 3, pp. 304-10.
182. Belis, M. and Guiasu, S. (1968). A quantitative-qualitative measure of information in cybernetic systems. IEEE Transactions on Information Theory, Vol. 14, pp. 593-4.
183. Chapman, G.P. (1970). The application of information theory to the analysis of population distributions in space. Economic Geography, Supplement, Vol. 46, pp. 317-31.
184. Curry, L. (1964). The random spatial economy: An exploration in settlement theory. Annals of the Association of American Geographers, Vol. 54, pp. 138-46.
185. Curry, L. (1971). Application of space-time moving-average forecasting. In: Regional Forecasting, edited by M. Chisholm, A. Frey and P. Haggert, Colston Papers No. 22, Butterworths, London, U.K.
186. Curry, L. (1972a). A spatial analysis of gravity flows. Regional Studies, Vol. 6, pp. 131-47.
187. Curry, L. (1972b). Spatial entropy. In: International Geography 2, P1204, edited by W.P. Adams and F.M. Helleiner, University of Toronto Press, Toronto, Canada.
188. Erlander, S. and Stewart, N.F. (1978). Interactivity, accessibility and cost in trip distribution. Transportation Research, Vol. 12, pp. 291-3.
189. Goldman, S. (1953). Information Theory. Prentice Hall, Englewood Cliffs, New Jersey.
190. Gibrat, R. (1931). Les Inegalites Economiques. Paris: Librarie du Recueil, Sirey.
191. Guiasu, S. (1977). Information Theory with Applications. McGraw-Hill, New York.
192. Gurevich, B.L. (1969). Geographical differentiation and its measures in a discrete system. Soviet Geography: Reviews and Translations, Vol. 16, pp. 387-413.
193. Leopold, L.B. and Langbein, W.B. (1962). The concept of entropy in landscape evolution. U.S. Geological Survey Professional Paper 500-A, Government Printing Office, Washington, D.C.
194. Marchand, B. (1972). Information theory and geography. Geographical Analysis, Vol. 4, pp. 234-57.
195. Medvedkov, Y. (1970). Entropy: An assessment of potentialities in geography. Economic Geography, Supplement, Vol. 46, pp. 306-16.
196. Mogridge, M.J.H. (1972). The use and misuse of entropy in urban and regional modeling of economic and spatial systems. Working Note No. 320, Centre for Environment Studies, London, U.K.
197. Pareto, V. (1906). Manual of Political Economy. (English Translation by Ann S. Schwier, 1971), Augustus M. Kelley Publishers, New York.
198. Robinson, S., Cattaneo, A. and El-Said, M. (2001). Updating and estimating in a social accounting matrix using cross entropy methods. Economic Systems Research, Vol. 13, No. 1, pp. 47-64.
199. Semple, R.K. and Golledge, R.G. (1970). An analysis of entropy changes in a settlement pattern over time. Economic Geography, Vol. 46, pp. 157-60.
200. Theil, H. (1967). Economics and Information Theory. North Holland Publishing Company, Amsterdam, The Netherlands.
201. Theil, H. (1980). Disutility as a probability: An interpretation of weighted information measures. Management Science, Vol. 26, pp. 1281-4.
202. Tribus, M. (1969). Rational Descriptions, Decisions and Designs. Pergamon Press, New York.
203. Wilson, A.G. (1970). Entropy in Urban and Regional Modeling. Pion, London, England.
204. Ya Nutenko, L. (1970). An information theory approach to the partitioning of an area. Soviet Geography: Reviews and Translations, Vol. 11, pp. 540-4.
205. You, L. and Wood, S. (2003). Patial allocation of agricultural production using a cross-entropy approach. Environment and Production Technology Division Discussion Paper No. 126, International Food Policy Research Institute, Washington, D.C.
206. You, L. and Wood, S. (2005). Assessing the spatial distribution of crop areas using a cross-entropy method. International Journal of Applied Earth Observation and Geoinformatics, Vol. 7, pp. 310-23.
207. You, L. and Wood, S. (2006). An entropy approach to spatial disaggregation of agricultural production. Agricultural Systems, Vol. 90, No. 1-3, pp. 329-47.
208. You, L., Wood, S. and Wood-Sichra U. (2009). Generating plausible crop distribution maps for sub-Saharan Africa using a spatially disaggregated data fusion and optimization approach. Agricultural Systems, Vol. 99, pp. 126-40.
209. Zellner, A. (1988). Optimal information processing and Bayes theorem. American Statistician, Vol. 42, pp. 278-84.
210. Zipf, G.K. (1949). Human Behavior and the Principle of Least Effort. Addison-Wesley, Cambridge, Massachusetts.
211. Aczel, J. and Daroczy, Z. (1975). On Measures of Information and Their Characterizations. Academic Press, New York.
212. Batty, M. (1976). Entropy in spatial aggregation. Geographical Analysis, Vol. 8, pp. 1-21.
213. Batty, M. (2010). Space, scale, and scaling in entropy maximizing. Geographical Analysis, Vol. 42, pp. 395-421.
214. Blundell, S.J. and Blundell, K.M. (2006). Concepts in Thermal Physics, Oxford University Press, Oxford.
215. Chapman, G.P. (1970). The application of information theory to the analysis of population distributions in space. Economic Geography, Supplement, Vol. 46, pp. 317-31.
216. Curry, L. (1971). Applicability of space-time moving average forecasting. In M. Chisolm, A, Frey and P. Haggett, editors, Regional Forecasting, Colston Papers, No. 22, Butterworths, London, U.K.
217. Curry, L. (1972a). A spatial analysis of gravity flows. Regional Studies, Vol. 6, pp. 131-47.
218. Curry, L. (1972b). Spatial entropy. P1204 in W.P. Adams and F.M. Helleiner, editors, International Geography, Vol. 2, Toronto and Buffalo, University of Toronto Press.
219. Kerridge, D.F. (1961). Inaccuracy and inference. Journal of the Royal Statistical Society, Series B, Vol. 23, pp. 184-94.
220. Kulback, S. (1959). Statistics and Information Theory. John Wiley, New York.
221. Moellering, H. and Tobler, W. (1972). Geographical variances. Geographical Analysis, Vol. 4, pp. 34-50.
222. Semple, R.K. and Golledge, R.G. (1970). An analysis of entropy changes in a settlement pattern over time. Economic Geography, Vol. 46, pp. 157-60.
223. Theil, H. (1967). Economics and Information. North Holland, Amsterdam.
224. Theil, H. (1972). Statistical Decomposition Analysis. North Holland, Amsterdam.
225. Tobler, W. (1963). Geographic area and map projections. Geographical Review, Vol. 53, pp. 59-78.
226. Burg, J.P. (1967). Maximum entropy spectral analysis. Paper presented at 37th Annual Meeting of Society of Exploration Geophysicists, Oklahoma City, Oklahoma.
227. Burg, J.P. (1969). A new analysis technique for time series data. Paper presented at NATO Advanced Institute on Signal Processing with Emphasis on Underwater Acoustics.
228. Burg, J.P. (1972a). The relationship maximum entropy spectra and maximum likelihood spectra. Geophysics, Vol. 37, No. 2, pp. 375-6.
229. Burg, J.P. (1972b). The relationship between maximum entropy spectra and maximum likelihood spectra. in: Modern Spectral Analysis, edited by D.G. Childers, pp. 130-1, M.S.A.
230. Burg, J.P. (1975). Maximum entropy spectral analysis. Unpublished Ph.D. dissertation, Stanford University, Palo Alto, California.
231. Dalezios, N.R. and Tyraskis, P.A. (1999). Maximum entropy spectra for regional precipitation analysis and forecasting. Journal of Hydrology, Vol. 109, pp. 25-42.
232. Fougere, P.F., Zawalick, E.J. and Radoski, H.R. (1976). Spontaneous line splitting in maximum entropy power spectrum analysis. Physics of the Earth and Planetary Interiors, Vol. 12, pp. 201-7.
233. Frieden, B.R. (1972). Restoring with maximum likelihood and maximum entropy. Journal of Optical Society of America, Vol. 62, pp. 511-18.
234. Gull, S.F. and Daniell, G.J. (1978). Image reconstruction from incomplete and noisy data. Nature, Vol. 272, pp. 686-90.
235. Kapur, J.N. (1999). Maximum Entropy Models in Science and Engineering. Wiley Eastern, New Delhi, India.
236. Kapur, J.N. and Kesavan, H.K. (1997). Generalized Maximum Entropy Principle (with Applications). Sandford Educational Press, University of Waterloo, Waterloo, Canada.
237. Kapur, J.N. and Kesavan, H.K. (1992). Entropy Optimization Principles with Applications. 409 p., Academic Press, New York.
238. Padmanabhan, G. and Rao, A.R. (1999). Maximum entropy spectral analysis of hydrologic data. Water Resources Research, Vol. 24, No. 9, pp. 1519-33.
239. Shore, J.E. (1979). Minimum cross-entropy spectral analysis. NRL Memorandum Report 3921, 32 p., Naval Research Laboratory, Washington, D.C.
240. Tzannes, N.S. and Avgeris, T.G. (1981). A new approach to the estimation of continuous spectra. Kybernetes, Vol. 10, pp. 123-33.
241. Tzannes, M.A., Politis, D. and Tzannes, N.S. (1985). A general method of minimum cross-entropy spectral estimation. IEEE Transactions on Acoustics, Speech, and Signal Processing, Vol. ASSP-33, No. 3, pp. 748-52.
242. Ulrych, T.J. and Clayton, R.W. (1976). Time series modeling and maximum entropy. Physics of the Earth and Planetary Interiors, Vol. 12, pp. 199-9.
243. Wu, N.-L. (1983). An explicit solution and data extension in the maximum entropy method. IEEE Transactions on Acoustics, Speech, and Signal Processing, Vol. ASSP-31, No. 2, pp. 486-91.
244. Burg, J.P. (1967). Maximum entropy spectral analysis. Paper presented at 37th Annual Meeting of Society of Exploration Geophysicists, Oklahoma City, Oklahoma.
245. Burg, J.P. (1969). A new analysis technique for time series data. Paper presented at NATO Advanced Institute on Signal Processing with Emphasis on Underwater Acoustics.
246. Burg, J.P. (1972a). The relationship maximum entropy spectra and maximum likelihood spectra. Geophysics, Vol. 37, No. 2, pp. 375-6.
247. Burg, J.P. (1972b). The relationship between maximum entropy spectra and maximum likelihood spectra. in: Modern Spectral Analysis, edited by D.G. Childers, pp. 130-1, M.S.A.
248. Burg, J.P. (1975). Maximum entropy spectral analysis. Unpublished Ph.D. dissertation, Stanford University, Palo Alto, California.
249. Dalezios, N.R. and Tyraskis, P.A. (1999). Maximum entropy spectra for regional precipitation analysis and forecasting. Journal of Hydrology, Vol. 109, pp. 25-42.
250. Fougere, P.F., Zawalick, E.J. and Radoski, H.R. (1976). Spontaneous line splitting in maximum entropy power spectrum analysis. Physics of the Earth and Planetary Interiors, Vol. 12, pp. 201-7.
251. Johnson, R.W. and Shore, J.E. (1983). Minimum cross-entropy spectral analysis of multiple signals. IEEE Transactions on Acoustics, Speech, and Signal Processing, Vol. ASSP-31, No. 3, pp. 574-82.
252. Kapur, J.N. (1999). Maximum Entropy Models in Science and Engineering. Wiley Eastern, New Delhi, India.
253. Kapur, J.N. and Kesavan, H.K. (1997). Generalized Maximum Entropy Principle (with Applications). Sandford Educational Press, University of Waterloo, Waterloo, Canada.
254. Kapur, J.N. and Kesavan, H.K. (1992). Entropy Optimization Principles with Applications. 409 p., Academic Press, New York.
255. Padmanabhan, G. and Rao, A.R. (1988). Maximum entropy spectral analysis of hydrologic data. Water Resources Research, Vol. 24, No. 9, pp. 1519-33.
256. Shore, J.E. (1979). Minimum cross-entropy spectral analysis. NRL Memorandum Report 3921, 32 pp., Naval Research Laboratory, Washington, D.C.
257. Shore, J.E. (1981). Minimum cross-entropy spectral analysis. IEEE Transactions on Acoustics, Speech, and Signal Processing, Vol. ASSP-291, pp. 230-7.
258. Shore, J.E. (1983). Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross entropy. IEEE Transactions on Information Theory, Vol. IT-26, pp. 26-37.
259. Ulrych, T.J. and Clayton, R.W. (1976). Time series modeling and maximum entropy. Physics of the Earth and Planetary Interiors, Vol. 12, pp. 189-99.
260. Adamowski, K. (1989). A Monte Carlo comparison of parametric and nonparametric estimation of flood frequencies. Journal of Hydrology, Vol. 108, pp. 295-309.
261. Alfonso, L. (2010). Optimisation of monitoring networks for water distribution systems. Ph.D. Dissertation, Delft University of Technology, Delft, The Netherlands.
262. Alfonso, L., Price, R. and Lobbrecht, A., 2010. Information theory-based approach for location of monitoring water level gauges. Water Resources Research, Vol. 46, W03528, doi:10.1029/2009WR008101.
263. Al-Zahrani, M. and Husain, T. (1998). An algorithm for designing a precipitation network in the south-western region of Saudi Arabia. Journal of Hydrology, Vol. 295, No. 3-4, pp. 205-16.
264. Berthouex, P.M. and Brown, L.C. (1994). Statistics for Environmental Engineers. CRC Press, Inc: Florida; 335 pp.
265. Bras, R.L. and Rodriguez-Iturbe, I. (1985). Random Functions and Hydrology. Addison Wesley, Reading, Massachusetts.
266. Bueso, M.C., Angulo, J.M., Cruz-Sanjulian, J. and Carcia-Arostegui, J.L. (1999). Optimal spatial sampling design in a multivariate framework. Mathematical Geology, Vol. 31, No. 5, pp. 507-25.
267. Burn, D.H. and Goulter, I.C. (1991). An approach to the rationalization of streamflow data collection networks. Journal of Hydrology, Vol. 122, pp. 71-91.
268. Cacoullos, T. (1966). Estimation of a multivariate density. Inst. Stat., Math. Ann., Vol. 18, pp. 179-89.
269. Cressie, N.C. (1990). Statistics for Spatial Data, Revised Edition. Wiley: New York; 900 pp.
270. Fass, D.M. (2006). Human Sensitivity to Mutual Information. Rutgers, The State University of New Jersey, New Brunswcks, New Jersey.
271. Guiasu, S. (1977). Information Theory with Applications. McGraw Hill Book Company, London, U.K.
272. Harmancioglu, N.B. (1981). Measuring the information content of hydrological processes by the entropy concept. Journal of Civil Engineering Faculty of Ege University, Special Issue: Centennial of Ataturk's Birth, Izmir, pp. 13-40, Turkey.
273. Harmancioglu, N.B. (1984). Entropy concept as used in determination of optimum sampling intervals. Proceedings of Hydrosoft '84, International Conference on Hydraulic Engineering Software, Portoroz, Yugoslavia, pp. 6-99 to 6-110.
274. Harmancioglu, N.B. and Alpaslan, N. (1992). Water quality monitoring network design. Water Resources Bulletin, Vol. 28, No. 1, pp. 179-92.
275. Harmancioglu, N.B., Fistikoglu, O., Ozkul, S.D., Singh, V.P. and Alpaslan, M.N. (1999). Water Quality Monitoring Network Design. Kluwer Academic Publishers: Boston; 299 pp.
276. Harmancioglu, N.B. and Yevjevich, V. (1985). Transfer of hydrologic information along rivers fed by karstified limestones. Proceedings of the Ankara-Antalya Symposium on Karst Water Resources, IAHS Publication 61, pp. 151-31.
277. Harmancioglu, N.B. and Yevjevich, V. (1987). Transfer of hydrologic information among river points. Journal of Hydrology, Vol. 91, pp. 103-18.
278. Husain, T. (1987). Hydrologic network design formulation. Canadian Water Resources Journal, Vol. 12, No. 1, pp. 44-63.
279. Husain, T. (1989). Hydrologic uncertainty measure and network design. Water Resources Bulletin, Vol. 25, No.3, pp. 527-34.
280. Husain, T., Ukayli, M.A. and Khan, H.U. (1986). Meteorological network expansion using information decay concept. Journal of Atmospheric and Oceanic Technology, AMA. Vol. 3, No. 1, pp. 27-37.
281. Jakulin, A. and Bratko, I., 2003. Quantifying and visualizing attribute interactions. Arxiv preprint cs.AI/0308002.
282. Jakulin, A. and Bratko, I., 2004. Testing the significance of attribute interactions. ACM International Conference Proceedings Series.
283. Jessop, A. (1995). Informed Assessments, An Introduction to Information, Entropy and Statistics. Ellis Horwood: New York; 366 pp.
284. Kapur, J.N. and Kesavan, H.K. (1992). Entropy Optimisation Principles with Applications. Academic Press Inc.: San Diego; 408 pp.
285. Kraskov, A., Stogbauer, H., Andrzejak, R.G. and Grassberger, P. (2003). Hierarchical clustering based on mutual information. ArXiv preprint q-bio. QM/0311039.
286. Krstanovic, P.F. and Singh, V.P. (1988). Application of entropy theory to multivariate hydrologic analysis. Technical Reports WRR8 and WRR9, Department of Civil Engineering, Louisiana State University, Baton Rouge, Louisiana.
287. Krstanovic, P.F. and Singh, V.P. (1992a). Evaluation of rainfall networks using entropy: 1. Theoretical development. Water Resources Management, Vol. 6, pp. 279-93.
288. Krstanovic, P.F. and Singh, V.P. (1992b). Evaluation of rainfall networks using entropy: 1. Application. Water Resources Management, Vol. 6, pp. 295-314.
289. Lathi, B.P. (1969). An Introduction to Random Signals and Communication Theory. International Textbook Company, Scanton, Pennsylvania.
290. Lee Y. and Ellis, J.H. (1997). On the equivalence of Kriging and maximum entropy estimators. Mathematical Geology, Vol. 29, No. 1, pp. 131-52.
291. Linfoot, E.H. (1957). An informational measure of correlation. Information and Control, Vol. 1, pp. 85-9.
292. Lubbe, C.A. (1996). Information Theory. Cambridge University Press: Cambridge; 350 pp.
293. McGill, W.J., (1954). Multivariate information transmission. Psychometrika, Vol. 19, pp. 97-116.
294. Mishra, A.K. and Coulibaly, P. (2009). Developments in hydrometric network design: a review. Reviews of Geophysics, Vol. 47, RG2001, doi:10.1029/2007RG000243.
295. Mogheir, Y. and Singh, V.P. (2002). Application of information theory to groundwater quality monitoring networks. Water Resources Management, Vol. 16, No. 1, pp. 37-49.
296. Ozkul, S., Harmancioglu, N.B. and Singh, V.P. (2000). Entropy-based assessment of water quality monitoring networks. Journal of Hydrologic Engineering, ASCE, Vol. 5, No. 1, pp. 90-100.
297. Parzen, E. (1962). On estimation of a probability density function and mode. Annals of Mathematical Statistics, Vol. 33, pp. 1065-76.
298. Rodriguez-Iturbe, I. and Mejia, J.M. (1974). The design of rainfall networks in time and space. Water Resources Research, Vol. 10, No. 4, pp. 713-28.
299. Scott, D.W. (1979). On optimal and data-based histograms. Biometrica, Vol. 66, No. 3, pp. 605-10.
300. Singh, V.P. (1998). Entropy-Based Parameter Estimation in Hydrology. Kluwer Academic Publishers: Boston.
301. Tukey, J. W. (1977). Exploratory Data Analysis. Reading, Mass: Addison-Wesley.
302. Uslu, O. and Tanriover, A. (1979). Measuring the information content of hydrological process. Proceedings of the First National Congress on Hydrology. Istanbul, pp. 437-43.
303. Watanabe, S. (1960). Information theoretical analysis of multivariate correlation. IBM Journal of Research and development, Vol. 6.
304. Wertz, W. (1979). Statistical Density Estimation: a survey. Vandenhoeck & Ruprecht, Gottingen.
305. Yang, Y. and Burn, D.H. (1994). An entropy approach to data collection network design. Journal of Hydrology, Vol. 157, pp. 307-24.
306. Zhang, J., Wang, H. and Singh, V.P. (2011). Information entropy of a rainfall network in China. Chapter 2 in: Modeling Risk Management in Sustainable Construction, edited by D.D. Wu and Y. Zhu, pp. 11-20, Springer, Berlin.
307. Alexander, D.E. (1991). Natural disasters: a framework for research and detaching. Disasters, Vol. 14, No. 3, pp. 209-26.
308. Bollander, B.V. and Weigend, A.E. (1994). Selecting input variables using mutual information and nonparametric density estimation. Proceedings of the 1994 International Symposium on Artificial Neural Networks, pp. 42-50.
309. Chen, C.C., Tseng, C.Y. and Dong, J.Y. (2007). New entropy-based method for variables selection and its application to the debris-flow hazard assessment. Engineering Geology, Vol. 94, pp. 19-26.
310. Davis, J.C. (2002). Statistics and Data Analysis in Geology. 3rd Edition, Wiley, New York.
311. Deyle, R.E., Fench, S.P., Olshansky, R.B. and Patterson, R.G. (1998). Hazard assessment: the factual basis for planning and mitigation. In: R.J. Burby, editor, Cooperating with Nature: Confronting Natural Hazards with Land Use Planning for Sustainable Communities. Joseph Henry Press, Washington, D.C., pp. 119-66.
312. Dupuis, J.A. and Robert, C.P. (2003). Variable selection in qualitative models via an entropic explanatory power. Journal of Statistical Planning and Inference, Vol. 111, pp. 77-94.
313. Forbes, F. and Peyrard, N. (2003). Hidden Markov random field model selection criteria based on mean filed-like approximations. IEEE transactions: Pattern Analysis and Machine Intelligence, Vol. 25, No. 9, pp. 1089-101.
314. Hosmer, D.W. and Lemeshow, S. (2000). Applied Logistic Regression. John Wiley, 375 p., New York.
315. Johnson, V.E. and Albert, J.H. (1999). Ordinal Data Modeling. Springer, New York.
316. Kleinbaum, D.G. (1994). Logistic Regression, a Self-learning Text. Springer Verlag, 292 p., New York.
317. Lin, P.S., Hung, J.Y. and Yang, J.C. (2002). Assessing debris flow hazard in a watershed in Taiwan. Engineering Geology, Vol. 66, pp. 295-313.
318. Liu, X. and Lei, J. (2003). A method for assessing regional debris flow risk: An application in Zhaotong of Yunnan province (WS China). Geomorphology, Vol. 52, pp. 181-91.
319. Reftery, A.E., Madigan, D. and Hoeting, J.A. (1997). Bayesian model averaging for regression models. Journal of American Statistical Association, Vol. 92, pp. 179-91.
320. Rupert, M.G., Cannon, S.H. and Gartner, J.E. (2003). Using logistic regression to predict the probability of debris flows occurring In areas recently burned by wildfires. Open File Report OF 03-500, US Geological Survey.
321. Tseng, C.Y. (2006). Entropic criterion for model selection. Physica A, Vol. 370, pp. 530-8.
322. Weiss, R.E. (1995). The influence of variable selection: a Bayesian diagnostic perspective. Journal of American Statistical Association, Vol. 90, pp. 619-25.
323. Abrahart, R. J. and See, L. M. (2007). Neural network modelling of non-linear hydrological relationships. Hydrol. Earth Syst. Sci., 11, 1563-79.
324. Ackley, D.H., Hinton, G.E. and Sejnowski, T.J. (1985). A learning algorithm for Boltzmann machines. Cognitive Science, Vol. 9, pp. 147-69.
325. Burr, D.J. (1988). Experiments on neural net recognition of spoken and written text. IEEE Transactions: Acoustic, Speech, Signal Processing, Vol. 36, pp. 1162-8.
326. Haykin, S. (1994). Neural Networks: A Comprehensive Foundation. Macmillan College Publishing Company, New York.
327. Hecht-Nielsen, R. (1987). Counterpropagation networks. Applied Optimization, Vol. 36, pp. 4979-84.
328. Linsker, R. (1987). Towards an organizing principle for perception: Hebbian synapses and the principle of neural encoding. IBM Research Report RC12820, IBM Research, Yorktown Heights, New York.
329. Linsker, R. (1988a). Self generalization in a perceptual network. Computer, Vol. 21, pp. 105-17.
330. Linsker, R. (1988b). Towards an organizing principle for a layered perceptual network. In: Neural Information Processing Systems, edited by D.Z. Anderson, pp. 485-94, American Institute of Physics, New York.
331. Linsker, R. (1989a). An application of the principle of maximum information preservation to linear systems. Advances in Neural Information Processing Systems, Vol. 1, pp. 186-94.
332. Linsker, R. (1989b). How to generate ordered maps by maximizing the mutual information between input and output signals. Neural Computation, Vol. 1, pp. 402-11.
333. Linsker, R. (1990a). Perceptual neural organization: Some approaches based on network models and information theory. Annual Review of Neuroscience, Vol. 13, pp. 257-81.
334. Linsker, R. (1990b). Self-organization in a perceptual system: How network models and information may shed light on neural organization. In: Connectionist Modeling and Brain Function: The Developing Interface, edited by S.J. Hanson and C. Roldon, Chapter 10, pp. 351-92, MIT Press, Cambridge.
335. Lippmann, R.P. (1987). An introduction to computing with neural nets. IEEE ASSP Management, pp. 4-22.
336. Moramarco, T., Barbetta, S., Melone, F. and Singh, V. P. (2006). A real-time stage Muskingum forecasting model for a site without rating curve. Hydrological Sciences Journal, Vol. 51, No. 1, pp. 66-82.
337. Rumelhart, D.E., Hinton, G.E. and Williams, R.J. (1986). Learning internal representation by error propagation. In Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1: Foundations, edited by D.E. Rummelhart and J.L. McClelland, M.I.T. Press, Cambridge, Massachusetts.
338. Seo, I.W. and Cheong, T.S. (1998). Predicting longitudinal dispersion coefficient in natural streams. Journal of Hydraulic Engineering, ASCE, Vol. 124, No. 1, pp. 25-32.
339. Sethi, I.K. (1990). Entropy nets: From decision trees to neural networks. Proceedings of the IEEE, Vol. 78, No. 10, pp. 1605-13.
340. Swiatek, D. (2002). Application of filtration numerical model for estimation of river embankments antiseepage protections efficiency. IMGW Research Papers, No. 13-Series: Water Engineering, Warsaw.
341. Tayfur, G. and Singh, V.P. (2005). Predicting longitudinal dispersion coefficient in natural streams by artificial neural network. Journal of Hydraulic Engineering, ASCE, Vol. 131, No. 11, pp. 991-1000.
342. Tayfur, G., Swiatek, D., Wita, A., and Singh, V.P. (2005). Case study: Finite element method and artificial neural network models for flow through Jeziorsko Earthfill Dam in Poland. Journal of Hydrologic Engineering, Vol. 131, No. 6, pp. 431-40.
343. Widrow, B., Winter, R.G. and Baxter, R.A. (1988). Layered neural nets for pattern recognition. IEEE Transactions on Acoustic, Speech, Signal Processing, Vol. 36, pp. 1109-18.
344. Bates, J.E. and Shepard, H.K. (1993). Measuring complexity using information fluctuation. Physical Letters A, Vol. 172, No.6, pp. 416-25.
345. Cornacchio, J.V. (1977). Maximum-entropy complexity measures. International Journal of Systems, Vol. 3, N. 4, pp. 215-25.
346. Englehardt, S., Matyssek, R. and Huwe, B. (2009). Complexity and information propagation in hydrologic time series of mountain forest catchments. European Journal of Forestry Research, Vol. 128, pp. 621-31.
347. Ferdinand, A.E. (1974). A theory of system complexity. International Journal of General Systems, Vol. 1, No. 1, pp. 19-33.
348. Grassberger, P. (1986). Toward a quantitative theory of self-generated complexity. International Journal of Theoretical Physics, Vol. 25, pp. 907-38.
349. Jimenez-Montano, M.A., Ebeling, W., Pohl, T. and Rapp, P.E. (2002). Entropy and complexity of finite sequences as fluctuating quantities. BioSystems, Vol. 64, pp. 23-32.
350. Kapur, J.N. (1983). On maximum-entropy complexity measures. International Journal of General Systems, Vol. 9, pp. 95-102.
351. Lange, H. (1999). Time series analysis of ecosystem variables with complexity measures. International Journal of Complex Systems, Manuscript #250, New England Complex Systems Institute, Cambridge, Massachusetts.
352. Pachepsky, Y., Guber, A., Jacques, D., Simunek, J., van Genuchten, M.T., Nicholson, T. and Cady, R. (2006). Information content and complexity of simulated soil water fluxes. Geoderma. Vol. 134, pp. 253-266.
353. Wolf, F. (1999). Berechnung von information und komplexitat von zeitreihen-analyse des wasserhaushaltes von bewaldeten einzugsgebieten. Bayreuth. Forum Okol. Vol. 65, pp. 164S.