Modifying goodness-of-fit indicators to incorporate both measurement and model uncertainty in model calibration and validation

Transactions of the ASABE

Volumn 53, Issue 1, 2010, Pages 55-63

  Harmel, R Daren ^a   Smith, Patricia K ^b   Migliaccio, Kati W ^c  

^a AGRICULTURAL RESEARCH SERVICE   (United States)

^b Texas A and M University   (United States)

^c UNIVERSITY OF FLORIDA   (United States)

Author keywords

Index of agreement; Model evaluation; Nash sutcliffe coefficient of efficiency; Watershed models

Indexed keywords

INDEX OF AGREEMENTS; MODEL EVALUATION; NASH-SUTCLIFFE COEFFICIENT; NASH-SUTCLIFFE COEFFICIENT OF EFFICIENCY; WATERSHED MODELS;

ERROR CORRECTION; LANDFORMS; QUALITY CONTROL; WATER POLLUTION; WATER QUALITY; WATERSHEDS;

UNCERTAINTY ANALYSIS;

CALIBRATION; CORRECTION; DATA SET; HYDROLOGY; MODEL VALIDATION; SIMULATION; WATER QUALITY; WATERSHED;

EID: 77949779484     PISSN: 21510032     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (50)

1. Abbaspour, K. C., J. Yang, I. Maximov, R. Siber, K. Bogner, J. Mieleitner, J. Zobrist, and R. Srinivasan. 2007. Modelling of hydrology and water quality in the pre-alpine/alpine Thur watershed using SWAT. J. Hydrol. 333(2-4): 413-430.
2. Arnold, J. G., R. Srinivasan, R. S. Muttiah, and J. R. Williams. 1998. Large area hydrologic modeling and assessment part I: Model development. J. American Water Resources Assoc. 34(1): 73-89.
3. Beck, M. B. 1987. Water quality modeling: A review of the analysis of uncertainty. Water Resources Res. 23(8): 1393-1442.
4. Beven, K. 1989. Changing ideas in hydrology: The case of the physically-based models. J. Hydrol. 105(1-2): 157-172.
5. Beven, K. 2006. On undermining the science? Hydrol. Proc. 20(14): 3141-3146.
6. Beven, K., and J. Freer. 2001. Equifinality, data assimilation, and uncertainty estimation in mechanistic modelling of complex environmental systems using the GLUE methodology. J. Hydrol. 249(1-4): 11-29.
7. Bicknell, B. R., J. C. Imhoff, J. L. Kittle Jr., A. S. Donigian Jr., and R. C. Johanson. 1997. Hydrological Simulation Program FORTRAN: User's Manual for Version 11. EPA/600/R-97/080. Research Triangle Park, N.C.: U.S. Environmental Protection Agency, National Exposure Research Laboratory.
8. Duan, Q. Y., S. Sorooshian, and V. Gupta. 1992. Effective and efficient global optimization for conceptual rainfall-runoff models. Water Resources Res. 28(4): 1015-1031.
9. Engel, B., D. Storm, M. White, J. Arnold, and M. Arabi. 2007. A hydrologic/water quality model application protocol. J. American Water Resources Assoc. 43(5): 1223-1236.
10. Gelman, S., J. B. Carlin, H. S. Stren, and D. B. Rubin. 1995. Bayesian Data Analysis. New York, N.Y.: Chapman and Hall.
11. Green, C. H., M. D. Tomer, M. Di Luzio, and J. G. Arnold. 2006. Hydrologic evaluation of the Soil and Water Assessment Tool for a large tile-drained watershed in Iowa. Trans. ASABE 49(2): 413-422.
12. Haan, C. T. 1989. Parametric uncertainty in hydrologic modeling. Trans. ASAE 32(1): 137-146.
13. Haan, C. T. 2002. Statistical Methods in Hydrology. 2nd ed. Ames, Iowa: Iowa State Press.
14. Haan, C. T., B. Allred, D. E. Storm, G. J. Sabbagh, and S. Prahhu. 1995. Statistical procedure for evaluating hydrologic/water quality models. Trans. ASAE 38(3): 725-733.
15. Haan, C. T., D. E. Storm, T. Al-Issa, S. Prabhu, G. J. Sabbagh, and D. R. Edwards. 1998. Effect of parameter distributions on uncertainty analysis of hydrologic models. Trans. ASABE 41(1): 65-70.
16. Haan, P. K., and R. W. Skaggs. 2003a. Effect of parameter uncertainty on DRAINMOD predictions: I. Hydrology and yield. Trans. ASAE 46(4): 1061-1067.
17. Haan, P. K., and R. W. Skaggs. 2003b. Effect of parameter uncertainty on DRAINMOD predictions: II. Nitrogen loss. Trans. ASAE 46(4): 1069-1075.
18. Harmel, R. D., and P. K. Smith. 2007. Consideration of measurement uncertainty in the evaluation of goodness-of-fit in hydrologic and water quality modeling. J. Hydrol. 337(3-4): 326-336.
19. Harmel, R. D., R. J. Cooper, R. M. Slade, R. L. Haney, and J. G. Arnold. 2006. Cumulative uncertainty in measured streamflow and water quality data for small watersheds. Trans. ASABE 49(3): 689-701.
20. Harmel, R. D., D. R. Smith, K. W. King, and R. M. Slade. 2009. Estimating storm discharge and water quality data uncertainty: A software tool for monitoring and modeling applications. Environ. Modelling Software 24(7): 832-842.
21. Hession, W. C., D. E. Storm, C. T. Haan, S. L. Burks, and M. D. Matlock. 1996. A watershed-level ecological risk assessment methodology. Water Resources Bull. 32(5): 1039-1054.
22. Jain, S. K., and K. P. Sudheer. 2008. Fitting of hydrologic models: A close look at the Nash-Sutcliffe index. J. Hydrol. Eng. 13(10): 981-986.
23. Kavetski, D., S. W. Franks, and G. Kuczera. 2002. Confronting input uncertainty in environmental modelling. In Calibration of Watershed Models, 49-68. AGU Water Science and Applications Series, vol. 6. S. Duan, H. V. Gupta, S. Sorooshian, A. N. Rousseau, and R. Turcotte, eds. Washington, D.C.: American Geophysical Union.
24. Kotlash, A. R., and B. C. Chessman. 1998. Effects of water sample preservation and storage on nitrogen and phosphorus determinations: Implications for the use of automated sampling equipment. Water Res. 32(12): 3731-3737.
25. Kuczera, G., and E. Parent. 1998. Monte Carlo assessment of parameter uncertainty in conceptual catchment models: The Metropolis algorithm. J. Hydrol. 211(1-4): 69-85.
26. Legates, D. R., and G. J. McCabe, Jr. 1999. Evaluating the use of "goodness-of-fit" measures in hydrologic and hydroclimatic model validation. Water Resources Res. 35(1): 233-241.
27. Loague, K., and R. E. Green. 1991. Statistical and graphical methods for evaluating solute transport models: Overview and application. J. Contam. Hydrol. 7(1-2): 51-73.
28. Madsen, H. O., S. Krenk, and N. C. Lind. 1986. Methods of Structural Safety. Englewood Cliffs, N.J.; Prentice-Hall.
29. McCuen, R. H., Z. Knight, and A. G. Cutter. 2006. Evaluation of the Nash-Sutcliffe efficiency index. J. Hydrol. Eng. 11(6): 597-602.
30. McKay, A. D., W. J. Conover, and R. J. Beckman. 1979. A comparison of three methods for selecting values on input variables in the analysis of output from a computer code. Technometrics 21(6): 239-245.
31. Metropolis, N., A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller. 1953. Equation of state calculations by fast computing machines. J. Chemical Physics 21(6): 1087-1092.
32. Migliaccio, K. W., and I. Chaubey. 2008. Spatial distributions and stochastic parameter influences on SWAT flow and sediment predictions. J. Hydrol. Eng. 13(4): 258-269.
33. Moriasi, D. N., J. G. Arnold, M. W. Van Liew, R. L. Bingner, R. D. Harmel, and T. L. Veith. 2007. Model evaluation guidelines for systematic quantification of accuracy in watershed simulations. Trans. ASABE 50(3): 885-900.
34. Muleta, M. K., and J. W. Nicklow. 2005. Sensitivity and uncertainty analysis coupled with automatic calibration for a distributed watershed model. J. Hydrol. 306: 127-145, doi:10.1016/ j.jhydrol .2004.09.005.
35. Muñoz-Carpena, R., G. Vellidis, A. Shirmohammadi, and W. W. Wallender. 2006. Evaluation of modeling tools for TMDL development and implementation. Trans. ASABE 49(4): 961-965.
36. Nash, J. E., and J. V. Sutcliffe. 1970. River flow forecasting through conceptual models: Part I. A discussion of principles. J. Hydrol. 10(3): 282-290.
37. Pappenberger, F., and K. J. Beven. 2006. Ignorance is bliss: Or seven reasons not to use uncertainty analysis. Water Resources Res. 42(5): W05302.
38. Pelletier, P. M. 1988. Uncertainties in the single determination of river discharge: A literature review. Canadian J. Civil Eng. 15(5): 834-850.
39. Reckhow, K. J. 2003. On the need for uncertainty assessment in TMDL modeling and implementation. J. Water Resources Planning Mgmt. 129(4): 245-246.
40. Santhi, C., J. G. Arnold, J. R. Williams, W. A. Dugas, R. Srinivasan, and L. M. Hauck. 2001. Validation of the SWAT model on a large river basin with point and nonpoint sources. J. American Water Resources Assoc. 37(5): 1169-1188.
41. Shen, Z., Q. Hong, H. Yu, and R. Liu. 2008. Parameter uncertainty analysis of the non-point source pollution in the Daning River watershed of the Three Gorges Reservoir Region, China. Sci. Total Environ. 405(1-3): 195-205.
42. Shirmohammadi, A., I. Chaubey, R. D. Harmel, D. D. Bosch, R. Muñoz-Carpena, C. Dharmasri, A. Sexton, M. Arabi, M. L. Wolfe, J. Frankenberger, C. Graff, and T. M. Sohrabi. 2006. Uncertainty in TMDL models. Trans. ASABE 49(4): 1033-1049.
43. Tolson, B. A., and C. A. Shoemaker. 2008. Efficient prediction uncertainty approximation in the calibration of environmental simulation models. Water Resources Res. 44: W0441 doi:10.1029/2007WR005869.
44. Tyagi, A., and C. T. Haan. 2001. Uncertainty analysis using corrected first-order approximation method. Water Resources Res. 37(6): 1847-1858.
45. Van Griensven, A., and T. Meixner. 2006. Methods to quantify and identify the sources of uncertainty for river basin water quality models. Water Sci. Tech. 53(1): 51-59.
46. Van Liew, M. W., J. G. Arnold, and J. D. Garbrecht. 2003. Hydrologic simulation on agricultural watersheds: Choosing between two models. Trans. ASAE 46(6): 1539-1551.
47. Vicens, G. J., I. Rodriguez-Iturbe, and J. C. Shaake. 1975. A Bayesian framework for the use of regional information in hydrology. Water Resources Res. 11(3): 405-414.
48. Williams, J. R., and A. N. Sharpley, eds. 1989. EPIC - Erosion/ Productivity Impact Calculator: 1. Model Documentation. USDA Technical Bulletin No. 1768. Washington, D.C.: USDA-ARS.
49. Willmott, C. J. 1981. On the validation of models. Physical Geographer 2(2): 184-194.
50. Yang, J., P. Reichert, K. C. Abbaspour, J. Xia, and H. Yang. 2008. Comparing uncertainty analysis techniques for a SWAT application to the Chaohe Basin in China. J. Hydrol. 358: 1-23, doi: 10.1016/j.jhydrol.2008.05.012.