An evaluation of the statistical methods for testing the performance of crop models with observed data

Agricultural Systems

Volumn 127, Issue , 2014, Pages 81-89

  Yang, J M ^a   Yang, J Y ^b   Liu, S ^b,c   Hoogenboom, G ^d  

^a JILIN AGRICULTURAL UNIVERSITY   (China)

^b HARROW RESEARCH AND DEVELOPMENT CENTRE   (Canada)

^c SHANXI UNIVERSITY   (China)

^d WASHINGTON STATE UNIVERSITY   (United States)

Author keywords

Autocorrelation; Crop simulation model; Deviation statistics; Heteroskedasticity; Statistical evaluation; Test statistics

Indexed keywords

AGRICULTURAL MODELING; AUTOCORRELATION; CROP PLANT; DATA SET; NUMERICAL MODEL; PERFORMANCE ASSESSMENT; SOIL WATER; STATISTICAL ANALYSIS;

BRAZIL; CHINA; GHANA; UNITED STATES;

ARACHIS HYPOGAEA; GLYCINE MAX; SOLANUM TUBEROSUM; TRITICUM AESTIVUM; ZEA MAYS;

EID: 84899978585     PISSN: 0308521X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.agsy.2014.01.008     Document Type: Article

References (44)

1. Addiscott T.M., Whitmore A.P. Computer simulation of changes of soil mineral nitrogen and crop nitrogen during autumn, winter and spring. J. Agr. Sci. Cambridge 1987, 109:141-157.
2. Aigner D.J. Basic Econometrics 1971, Prentice-hall Inc., Englewood Cliffs, New Jersey.
3. Akinremi O.O., Jame Y.W., Campbell C.A., Zentner R.P., Chang C., de Jong R. Evaluation of LEACHMN under Dryland conditions. I. Simulation of water and solute transport. Can. J. Soil Sci. 2005, 85:223-232.
4. Boyce M.S., Pitt J., Northrup J.M., Morehouse A.T., Knopff K.H., Cristescu B., Stenhouse G.B. Temporal autocorrelation functions for movement rates from global positioning system radiotelemetry data. Phil. Trans. R. Soc. B 2010, 365:2213-2219.
5. Brienen R.J.W., Zuidema P.A., During H.J. Autocorrelated growth of tropical forest trees: unraveling patterns and quantifying consequences. Forest Ecol. Manage. 2006, 237:179-190.
6. Cao H., Hanan J.S., Liu Y., Liu Y.X., Yue Y.B., Zhu D.W., Lu J.F., Sun J.Y., Shi C.L., Ge D.K., Wei X.F., Yao A.Q., Tian P.P., Bao T.L. Comparison of crop model validation methods. JIA 2012, 11:1274-1285.
7. Hoogenboom, G., Wilkens, P.W., Tsuji, G.Y., 1999. DSSAT v3, vol. 4. University of Hawaii, Honolulu, Hawaii.
8. Hoogenboom, G., Jones, J.W., Wilkens, P.W., Porter, C.H., Hunt, L.A., Boote, K.J., Singh, U., Uryasev, O., Lizaso, J.I., Gijsman, A.J., White, J.W., Batchelor, W.D., Tsuji, G.Y., 2010. Decision support system for agrotechnology transfer (DSSAT) version 4.5 [CD-ROM], University of Hawaii, Honolulu, Hawaii.
9. Jones J.W., Hoogenboom G., Porter C.H., Boote K.J., Batchelor W.D., Hunt L.A., Wilkens P.W., Singh U., Gijsman A.J., Ritchie J.T. The DSSAT cropping system model. Eur. J. Agron. 2003, 18:235-265.
10. Kobayashi K., Salam M.U. Comparing simulated and measured values using mean squared deviation and its components. Agron. J. 2000, 92:345-352.
11. Krause P., Boyle D.P., Bäse F. Comparison of different efficiency criteria for hydrological model assessment. Adv. Geosci. 2005, 5:89-97.
12. Legates D.R., McCabe G.J. Evaluating the use of "goodness-of-fit" measures in hydrologic and hydroclimatic model validation. Water Resour. Res. 1999, 35:233-241.
13. Liu S., Yang J.Y., Zhang X.Y., Drury C.F., Reynolds, Hoogenboom G. Modelling crop yield, soil water content and soil temperature for asoybean-maize rotation under conventional and conservation tillage systems in Northeast China. Agric. Water Manage. 2013, 123:32-44.
14. Loague K., Green R.E. Statistical and graphical methods for evaluating solute transport models: overview and application. J. Contamin. Hydro. 1991, 7:51-73.
15. Mayer D.G., Butler D.G. Statistical validation. Ecol. Modell. 1993, 68:21-32.
16. McCuen R.H., Snyder W.M. A proposed index for comparing hydrographs. Water Resour. Res. 1975, 11:1021-1024.
17. Medeiros P.V., Marcuzzo F.F.N., Youlton C., Wendland E. Error autocorrelation and linear regression for temperature-based evapotranspiration estimates improvement. J. Am. Water Resour. 2012, 48:297-305.
18. Moriasi D.N., Arnold J.G., Van Liew M.W., Bingner R.L., Harmel R.D., Veith T. Model evaluation guidelines for systematic quantification of accuracy in watershed simulations. Trans. ASABE 2007, 50:885-900.
19. Nash J.E., Sutcliffe J.V. River flow forecasting through conceptual models part I- A discussion of principles. J. Hydrol. 1970, 10:282-290.
20. Priesack E., Gayler S., Hartmann H.P. The impact of crop growth sub-model choice on simulated water and nitrogen balances. Nutr. Cycl. Agroecosyst 2006, 75:1-13.
21. Reckhow K.H., Clements J.T., Dodd R.C. Statistical evaluation of mechanistic water-quality models. J. Environ. Engine 1990, 116:250-268.
22. Rinaldi M., Ventrella D., Gagliano C. Comparison of nitrogen and irrigation strategies in tomato using CROPGRO model. A case study from Southern Italy. Agric. Water Manage. 2007, 87(9):1-105.
23. Ritchie, J., Singh. U., Godwin, D., Hunt, L., 1993. A user's guide to CERES Maize-V2.10.
24. Rykiel E.J. Testing ecological models: the meaning of validation. Ecol. Model 1996, 90:229-244.
25. Sinclaira T.R., Seligman N. Criteria for publishing papers on crop modeling. Field Crops Res. 2000, 68:165-172.
26. Smith P., Smith J.U., Powlson D.S., McGill W.B., Arah J.R.M., Chertov O.G., Coleman K., Franko U., Frolking S., Jenkinson D.S., Jensen L.S., Kelly R.H., Klein-Gunnewiek H., Komarov A.S., Li C., Molina J.A.E., Mueller T., Parton W.J., Thornley J.H.M., Whitmore A.P. A comparison of the performance of nine soil organic matter models using datasets from seven long-term experiments. Geoderma 1997, 81:153-225.
27. Snedecor G.W., Cochran W.G. Statistical Methods 1976, The Iowa State University Press, Ames, Iowa, USA. seventh ed.
28. Soler, C.M.T., 2004. Using CERES-Maize model for maize sown off season yield forecast, PhD. Thesis. Escola Superior de Agricultura Luiz de Queiroz, University of Sao Paulo, Piracicaba, Brazil.
29. Soler C.M.T., Sentelhas P.C., Hoogenboom G. Thermal time for phenological development of four maize hybrids grown off-season in a subtropical environment. J. Agric. Sci. 2005, 143:169-182.
30. Soler C.M.T., Hoogenboom G., Sentelhas P.C., Pereira Duarte A. Impact of water stress on maize grown off-season in a subtropical environment. J. Agron. Crop Sci. 2007, 193:247-261.
31. Soler C.M.T., Sentelhas P.C., Hoogenboom G. Application of the CSM-CERES-Maize model for planting date evaluation and yield forecasting for maize grown off-season in a subtropical environment. Eur. J. Agron. 2007, 27:165-177.
32. Tsuji, G.Y., Uehara, G., Balas, S., 1994. DSSAT v3. University of Hawaii, Honolulu, Hawaii. User's Guide.
33. Tsuji, G.Y., Hoogenboom, G., Thornton, P.K., 1998. Systems Approaches for Sustainable Agricultural Development vol. 7 Understanding Options for Agricultural Production. Kluwer Academic Publishers in Cooperation with ICASA.
34. Wagger, M.G., 1983. Nitrogen Cycling in the Plan-Soil System. Ph.D. Thesis, Kansas State University.
35. Willmott C.J. On the validation of models. Phys. Geog. 1981, 2:184-194.
36. Willmott C.J. Some comments on the evaluation of model performance. Bul. Am. Meteorol. Soc. 1982, 63:1309-1313.
37. Willmott C.J., Ackleson S.G., Davis R.E., Feddema J.J., Klink K.M., Legates D.R., O'Donnell J., Rowe C.M. Statistics for the evaluation and comparison of models. J. Geophys. Res. 1985, 90:8995-9005.
38. Willmott C.J., Robeson S.M., Matsuura K. Short communication: a refined index of model performance. Int. J. Climatol. 2011, 32:2088-2094.
39. Yang, J.Y., Huffman, E.C., 2003. EasyGrapher v1.0 Help Manual. In: Jones, J.W., Hoogenboom, G., Wilkens, P.W. et al., Decision Support System for Agrotechnology Transfer Version 4.0, 2003, V3 41-80. University of Hawaii, Honolulu, HI.
40. Yang J.Y., Huffman E.C. EasyGrapher: software for graphical and statistical validation of DSSAT outputs. Comput. Electron. Agri. 2004, 45:125-132.
41. Yang J., Greenwood D.J., Rowell D.L., Wadsworth G.A., Burns I.G. Statistical methods for evaluating a crop nitrogen simulation model.NABLE. Agric. Syst. 2000, 64:37-53.
42. Yang, J.Y., Drury, C.F., Johnston, R., Simard, M., Zavitz, J., Hoogenboom, G., 2010. EasyGrapher v4.5: software for graphical and statistical evaluation of DSSAT v4.5 outputs. Poster presentation. In: Annual meeting of ASA-CSSA-SSSA, 2010, Lang Beach, CA.
43. Yang J.M., Dou S., Yang J.Y., Hoogenboom G., Jiang X., Zhang Z.Q., Jiang H.W., Jia L.H. Crop-soil nitrogen cycling and soil organic carbon balance in black soil zone of Jilin province based on DSSAT model. Chin. J. Appl. Ecol. 2011, 22:2075-2083.
44. Yang, J.M., Liu, J., Dou, S., Yang, J.Y., Hoogenboom, G., 2011b. Evaluation and optimization of best management practices of maize for black soil in Jilin China using the DSSAT model: I. Cultivar calibration and sensitivity analysis of maize yield parameters. Acta Pedologica Sinica. 48, pp. 366-374.