Model evaluation guidelines for systematic quantification of accuracy in watershed simulations

Transactions of the ASABE

Volumn 50, Issue 3, 2007, Pages 885-900

  Moriasi, Daniel N ^a   Arnold, Jeffrey G ^b   Van Liew, Michael W ^c   Bingner, Ronald L ^d   Harmel, R Daren ^b   Veith, Tamie L ^b  

^a USDA ARS GRAZINGLANDS RESEARCH LABORATORY   (United States)

^b U S DEPARTMENT OF AGRICULTURE   (United States)

^c Montana Department of Environmental Quality   (United States)

^d AGRICULTURAL RESEARCH SERVICE   (United States)

Author keywords

Accuracy; Model calibration and validation; Simulation; Watershed model

Indexed keywords

NASH-SUTCLIFFE EFFICIENCY (NSE); SIMULATED DATA; WATERSHED MODELS;

COMPUTER AIDED SOFTWARE ENGINEERING; COMPUTER SIMULATION; MATHEMATICAL MODELS; SOILS; WATER RESOURCES;

WATERSHEDS;

ACCURACY ASSESSMENT; CALIBRATION; COMPARATIVE STUDY; FLOW MEASUREMENT; GRAPHICAL METHOD; GUIDELINE; HYDROLOGICAL MODELING; MODEL VALIDATION; NUTRIENT CYCLING; NUTRIENT DYNAMICS; PERFORMANCE ASSESSMENT; QUANTITATIVE ANALYSIS; SEDIMENT TRANSPORT; STREAMFLOW; WATER MANAGEMENT; WATERSHED;

EID: 34447500396     PISSN: 21510032     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (58)

1. Amatya, D. M., G. M. Chescheir, G. P. Fernandez, R. W. Skaggs, and J. W. Gilliam. 2004. DRAINWAT-based methods for estimating nitrogen transport in poorly drained watersheds. Trans. ASAE 47(3): 677-687.
2. Arnold, J. G., and P. M. Allen. 1999. Automated methods for estimating baseflow and ground water recharge from streamflow records. J. American Water Resources Assoc. 35(2): 411-424.
3. Arnold, J. G., P. M. Allen, R. Muttiah, and G. Bernhardt. 1995. Automated base flow separation and recession analysis techniques. Ground Water 33(6): 1010-1018.
4. Arnold, J. G., R. Srinivisan, R. S. Muttiah, and P. M. Allen. 1998. Large-area hydrologic modeling and assessment: Part I. Model development. J. American Water Resources Assoc. 34(1): 73-89.
5. Arnold, J. G., R. S. Muttiah, R. Srinivasan, and P. M. Allen. 2000. Regional estimation of base flow and groundwater recharge in the upper Mississippi River basin. J. Hydrology 227(1-2): 21-40.
6. ASCE. 1993. Criteria for evaluation of watershed models. J. Irrigation Drainage Eng. 119(3): 429-442.
7. Balascio, C. C., D. J. Palmeri, and H. Gao. 1998. Use of a genetic algorithm and multi-objective programming for calibration of a hydrologic model. Trans. ASAE 41(3): 615-619.
8. Borah, D. K., and M. Bera. 2004. Watershed-scale hydrologic and nonpoint-source pollution models: Review of applications. Trans. ASAE 47(3): 789-803.
9. Boyle, D. P., H. V. Gupta, and S. Sorooshian. 2000. Toward improved calibration of hydrologic models: Combining the strengths of manual and automatic methods. Water Resources Res. 36(12): 3663-3674.
10. Bracmort, K. S., M. Arabi, J. R. Frankenberger, B. A. Engel, and J. G. Arnold. 2006. Modeling long-term water quality impact of structural BMPS. Trans. ASAE 49(2): 367-384.
11. Brazil, L. E. 1988. Multilevel calibration strategy for complex hydrologic simulation models. Unpublished PhD diss. Fort Collins, Colo.: Colorado State University, Department of Civil Engineering.
12. CEAP-WAS. 2005. Conservation effects assessment project: Watershed assessment studies. Available at: ftp://ftp-fc.sc.egov.usda.gov/NHQ/nri/ceap/ ceapwaswebrev121004.pdf. Accessed 15 August 2005.
13. Chu, T. W., and A. Shirmohammadi. 2004. Evaluation of the SWAT model's hydrology component in the piedmont physiographic region of Maryland. Trans. ASAE 47(4): 1057-1073.
14. Donigian, A S., J. C. Imhoff, and B. R. Bicknell. 1983. Predicting water quality resulting from agricultural nonpoint-source pollution via simulation - HSPF. In Agricultural Management and Water Quality, 200-249. Ames, Iowa: Iowa State University Press.
15. Duan, Q. Y., V. K Gupta, and S. Sorooshian. 1993. Shuffled complex evolution approach for effective and efficient global minimization. J. Optimization Theory and Appl. 76(3): 501-521.
16. Engel B., D. Storm, M. White, and J. G. Arnold. 2007. A hydrologic/water quality model application protocol. J. American Water Resources Assoc. (in press).
17. Engelmann, C. J. K, A. D. Ward, A. D. Christy, and E. S. Bair. 2002. Applications of the BASINS database and NPSM model on a small Ohio watershed. J. American Water Resources Assoc. 38(1): 289-300.
18. Fernandez, G. P., G. M. Chescheir, R. W. Skaggs, and D. M. Amatya. 2005. Development and testing of watershed-scale models for poorly drained soils. Trans. ASAE 48(2): 639-652.
19. Gan, T. Y., and G. F. Biftu. 1996. Automatic calibration of conceptual rainfall-runoff models: Optimization algorithms, catchment conditions, and model structure. Water Resources Res. 32(12): 3513-3524.
20. Gan, T. Y, E. M. Dlamini, and G. F. Biftu. 1997. Effects of model complexity and structure, data quality, and objective functions on hydrologic modeling. J. Hydrology 192(1): 81-103.
21. Gupta, H. V., S. Sorooshian, and P. O. Yapo. 1999. Status of automatic calibration for hydrologic models: Comparison with multilevel expert calibration. J. Hydrologic Eng. 4(2): 135-143.
22. Haan, C. T., D. E. Storm, T. Al-Issa, S. Prabhu, G. J. Sabbagh, and D. R. Edwards. 1998. Effect of parameter distributions on uncertainty analysis of hydrologic models. Trans. ASAE 41(1): 65-70.
23. Hamby, D. M. 1994. A review of techniques for parameter sensitivity analysis of environmental models. Environ. Monitoring and Assessment 32(2): 135-154.
24. Harmel, R. D., R. J. Cooper, R. M. Slade, R. L. Haney, and J. G. Arnold. 2006. Cumulative uncertainty in measured streamflow and water quality data for small watersheds. Trans. ASAE 49(3): 689-701.
25. Isukapalli, S. S. 1999. Uncertainty analysis of transport-transformation models. Unpublished PhD diss. New Brunswick, N.J.: Rutgers, The State University of New Jersey, Department of Chemical and Biochemical Engineering.
26. Legates, D. R., and G. J. McCabe. 1999. Evaluating the use of "goodness-of-fit" measures in hydrologic and hydroclimatic model validation. Water Resources Res. 35(1): 233-241.
27. Ma, L., J. C. Ascough II, L. R. Ahuja, M. J. Shaffer, J. D. Hanson, and K. W. Rojas. 2000. Root zone water quality model sensitivity analysis using Monte Carlo simulation. Trans. ASAE 43(4): 883-895.
28. Motovilov, Y. G., L. Gottschalk, K. England, and A. Rodhe. 1999. Validation of distributed hydrological model against spatial observations. Agric. Forest Meteorology 98-99: 257-277.
29. Narasimhan, B., R. Srinivasan, J. G. Arnold, and M. Di Luzio. 2005. Estimation of long-term soil moisture using a distributed parameter hydrologic model and verification using remotely sensed data. Trans. ASAE 48(3): 1101-1113.
30. Nash, J. E., and J. V. Sutcliffe. 1970. River flow forecasting through conceptual models: Part 1. A discussion of principles. J. Hydrology 10(3): 282-290.
31. Parker, R., J. G. Arnold, M. Barrett, L. Burns, L. Carrubba, C. Crawford, S. L. Neitsch, N. J. Snyder, R. Srinivasan, and W. M. Williams. 2006. Evaluation of three watershed-scale pesticide fate and transport models. J. American Water Resources Assoc. (in review).
32. Peterson, J. R., and J. M. Hamlett. 1998. Hydrologic calibration of the SWAT model in a watershed containing fragipan soils. J. American Water Resources Assoc. 34(3): 531-544.
33. Ramanarayanan, T. S., J. R. Williams, W. A. Dugas, L. M. Hauck, and A. M. S. McFarland. 1997. Using APEX to identify alternative practices for animal waste management. ASAE Paper No. 972209. St. Joseph, Mich.: ASAE.
34. Ramírez, J. A. 2000. Chapter 11: Prediction and modeling of flood hydrology and hydraulics. In Inland Flood Hazards: Human, Riparian and Aquatic Communities. E. Wohl, ed. Cambridge, U.K.: Cambridge University Press.
35. Reyes, M. R., R. W. Skaggs, and R. L. Bengtson. 2004. GLEAMS-SWT with nutrients. Trans. ASAE 47(1): 129-132.
36. Refsgaard, J. C. 1997. Parameterisation, calibration, and validation of distributed hydrological models. J. Hydrology 198(1): 69-97.
37. Saleh, A., and B. Du. 2004. Evaluation of SWAT and HSPF within BASINS program for the upper North Bosque River watershed in central Texas. Trans. ASAE 47(4): 1039-1049.
38. Saleh, A, J. G. Arnold, P. W. Gassman, L. M. Hauk, W. D. Rosenthal, J. R. Williams, and A. M. S. MacFarland. 2000. Application of SWAT for the upper North Bosque River watershed. Trans. ASAE 43(5): 1077-1087.
39. Sands, G. R., C. X. Jin, A. Mendez, B. Basin, P. Wotzka, and P. Gowda. 2003. Comparing the subsurface drainage flow prediction of the DRAINMOD and ADAPT models for a cold climate. Trans. ASAE 46(3): 645-656.
40. Santhi, C, J. G. Arnold, J. R. Williams, W. A. Dugas, R. Srinivasan, and L. M. Hauck. 2001. Validation of the SWAT model on a large river basin with point and nonpoint sources. J. American Water Resources Assoc. 37(5): 1169-1188.
41. Sevat, E., and A. Dezetter. 1991. Selection of calibration objective functions in the context of rainfall-runoff modeling in a Sudanese savannah area. Hydrological Sci. J. 36(4): 307-330.
42. Shirmohammadi, A., T. W. Chu, H. Montas, and T. Sohrabi. 2001. SWAT model and its applicability to watershed nonpoint-source pollution assessment. ASAE Paper No. 012005. St. Joseph, Mich.: ASAE.
43. Singh, J., H. V. Knapp, and M. Demissie. 2004. Hydrologic modeling of the Iroquois River watershed using HSPF and SWAT. ISWS CR 2004-08. Champaign, Ill.: Illinois State Water Survey. Available at: www.sws.uiuc.edu/pubdoc/CR/ ISWSCR2004-08.pdf. Accessed 8 September 2005.
44. Singh, J., H. V. Knapp, J. G. Arnold, and M. Demissie. 2005. Hydrologic modeling of the Iroquois River watershed using HSPF and SWAT. J. American Water Resources Assoc. 41(2): 361-375.
45. Spruill, C. A., S. R. Workman, and J. L. Taraba. 2000. Simulation of daily and monthly stream discharge from small watersheds using the SWAT model. Trans. ASAE 43(6): 1431-1439.
46. Taylor, M. M., and C. D. Creelman. 1967. PEST: Efficient estimates on probability functions. J. Acoustical Soc. America 41(4A): 782-787.
47. Topping, J. 1972. Errors of Observation and Their Treatment. 4th ed. London, U.K.: Chapman and Hall.
48. U.S. EPA. 2002. Guidance for quality assurance project plans for modeling. EPA QA/G-5M. Report EPA/240/R-02/007. Washington, D.C.: U.S. EPA, Office of Environmental Information.
49. vanGriensven, A., and W. Bauwens. 2003. Multiobjective autocalibration for semidistributed water quality models. Water Resources Res. 39(12): 1348-1356.
50. Van Liew, M. W., J. G. Arnold, and J. D. Garbrecht. 2003. Hydrologic simulation on agricultural watersheds: Choosing between two models. Trans. ASAE 46(6): 1539-1551.
51. Van Liew, M. W., T. L. Veith, D. D. Bosch, and J. G. Arnold. 2007. Suitability of SWAT for the conservation effects assessment project: A comparison on USDA-ARS experimental watersheds. J. Hydrologic Eng. 12(2): 173-189.
52. Varanou, E., E. Gkouvatsou, E. Baltas, and M. Mimikou. 2002. Quantity and quality integrated catchment modeling under climate change with use of soil and water assessment tool model. ASCE J. Hydrologic Eng. 7(3): 228-244.
53. Vazquez-Amábile, G. G., and B. A. Engel. 2005. Use of SWAT to compute groundwater table depth and streamflow in the Muscatatuck River watershed. Trans. ASAE 48(3): 991-1003.
54. Wang, X., and A. M. Melesse. 2005. Evaluation of the SWAT model's snowmelt hydrology in a northwestern Minnesota watershed. Trans. ASAE 48(4): 1359-1376.
55. Willmott, C. J. 1984. On the evaluation of model performance in physical geography. In Spatial Statistics and Models, 443-460. G. L. Gaile and C. J. Willmott, eds. Norwell, Mass.: D. Reidel.
56. Willmott, C. J. 1981. On the validation of models. Physical Geography 2: 184-194.
57. Yapo, P. O., H. V. Gupta, and S. Sorooshian, 1998. Multi-objective global optimization for hydrologic models. J. Hydrology 204(1): 83-97.
58. Yuan, Y., R. L. Bingner, and R. A. Rebich. 2001. Evaluation of AnnAGNPS on Mississippi Delta MSEA watersheds. Trans. ASAE 44(5): 1183-1190.