New indices to quantify patterns of residuals produced by model estimates

Agronomy Journal

Volumn 96, Issue 3, 2004, Pages 631-645

  Donatelli, Marcello ^a   Acutis, Marco ^b   Bellocchi, Gianni ^a   Fila, Gianni ^a  

^a ISTITUTO NAZIONALE DELLA NUTRIZIONE   (Italy)

^b UNIVERSITY OF MILAN   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; MATHEMATICAL MODELS; MONTE CARLO METHODS; PROBABILITY;

PATTERN INDICES; POWER ANALYSIS; VARIANCE RATIOS;

AGRONOMY;

EID: 2642519006     PISSN: 00021962     EISSN: None     Source Type: Journal    
DOI: 10.2134/agronj2004.0631     Document Type: Article

References (64)

1. Acutis, M. 1996. Modelling water movement in the soil: Comparison of different approaches and parameterizations [Online]. Available at http://www.sipeaa.it/tools/MACRO/Modelling_Soil_Water_ Movement.pdf (verified 30 Jan. 2003). ISCI-Agronomy, Bologna, Italy.
2. Acutis, M., and S. Lotito. 1997. Possibilità applicative dei «resampling methods» nell'analisi statistica di dati agronomici. Riv. di Agron. 31:810-816.
3. Addiscott, T.M., and A.P. Whitmore. 1987. Computer simulation of changes in soil mineral nitrogen and crop nitrogen during autumn, winter and spring. J. Agric. Sci. 109:141-157.
4. ASTM. 2000. Standard guide for statistical evaluation of atmospheric dispersion model performance [Online]. D6589. Available at www. astm.org (verified 22 Jan. 2004). ASTM, West Conshohocken, PA.
5. Bair, E.S. 1994. Model (in)validation - a view from courtroom. Ground Water 32:530-531.
6. Beck, M.B. 1986. The selection of structure in models of environmental systems. The Statistician 35:151-161.
7. Bell, C.B., and P.K. Sen. 1984. Randomization procedures. p. 1-29. In P.R. Krishnaiah and P.K. Sen (ed.) Nonparametric methods. Handb. of Stat. IV. Elsevier Sci. Publ., Amsterdam.
8. Bellocchi, G., M. Acutis, G. Fila, and M. Donatelli. 2002. An indicator of solar radiation model performance based on a fuzzy expert system. Agron. J. 94:1222-1233.
9. Bindi, M., M. Donatelli, J. Porter, and M.K. Van Ittersum. 2001. Proc. Int. Symp. Modelling Cropping Syst., 2nd, Florence, Italy. 16-18 July 2001. CNR Inst. for Biometeorol., Florence, Italy.
10. Box, G.E.P., G.M. Jenkins, and G.C. Reinsel. 1994. Time series analysis: Forecasting and control. 3rd ed. Prentice Hall, Englewood Cliffs, NJ.
11. Bradley, J. 1968. Distribution-free statistical tests. Prentice Hall, Englewood Cliffs, NJ.
12. Bredehoeft, J.D., and L.F. Konikow. 1993. Ground water models: Validate or invalidate. Ground Water 3:178-179.
13. Bristow, K.L., and G.S. Campbell. 1984. On the relationship between incoming solar radiation and daily maximum and minimum temperature. Agric. For. Meteorol. 31:159-166.
14. Campbell, G.S., and J.M. Norman. 1998. An introduction to environmental biophysics. 2nd ed. Springer, New York.
15. Carmer, S.G., and M.R. Swanson. 1971. Detection of differences between means: A Monte Carlo study of five pairwise multiple comparison procedures. Agron. J. 63:940-945.
16. Cook, R.D., and S. Weisberg. 1982. Residuals and influence in regression. Chapman & Hall, London.
17. Cook, R.D., and S. Weisberg. 1999. Graphs in statistical analysis: Is the medium the message? Am. Stat. 53:29-37.
18. Danuso, F. 1996. Analisi dell'incertezza nelle applicazioni agronomiche dei modelli dinamici e di regressione. Statistica Applicata 8: 103-125.
19. Dent, J.B., and M.J. Blackie. 1979. Systems simulation in agriculture. Appl. Sci. Publ., London.
20. Donatelli, M., M. Acutis, and G. Bellocchi. 2000. Two statistical indices to quantify patterns of errors produced by models. p. 186. In Proc. Int. Crop Sci. Conf., 3rd, Hamburg, Germany. 17-22 Aug. 2000. Eur. Soc. for Agron., Hamburg.
21. Donatelli, M., and G. Bellocchi. 2000. New methods to estimate global solar radiation. p. 186. In Proc. Int. Crop Sci. Conf., 3rd, Hamburg, Germany. 17-22 Aug. 2000. Eur. Soc. for Agron., Hamburg.
22. Donatelli, M., G. Bellocchi, and F. Fontana 2003. RadEst3.00: Software to estimate daily radiation data from commonly available meteorological variables. Eur. J. Agron. 18:369-372.
23. Donatelli, M., C.O. Stöckle, F. Villalobos, and J.M. Villar Mir. 1999. Proc. Int. Symp. Modelling Cropping Syst., 1st, Lleida, Spain. 21-23 June 1999. University of Lleida, Spain.
24. Donatelli, M., M.K. van Ittersum, M. Bindi, and J.R. Porter. 2002. Modelling cropping systems - highlights of the symposium and preface to the special issues. Eur. J. Agron. 18:1-11.
25. Draper, N.R., and H. Smith. 1998. Applied regression analysis. 3rd ed. John Wiley & Sons, New York.
26. Erickson, M., A. Mayer, and J. Horns. 2002. Multi-objective optimal design of groundwater remediation systems: Application of the niched Pareto genetic algorithm (NPGA). Adv. Water Resour. 25:51-65.
27. Fila, G., G. Bellocchi, M. Acutis, and M. Donatelli. 2003a. IRENE: A software to evaluate model performance. Eur. J. Agron. 18:369-372.
28. Fila, G., G. Bellocchi, M. Donatelli, and M. Acutis. 2003b. IRENE_DLL: A class library for evaluating numerical estimates. Agron. J. 95:1330-1333.
29. Fox, D.G. 1981. Judging air quality model performance: A summary of the AMS workshop on dispersion models performance. Bull. Am. Meteorol. Soc. 62:599-609.
30. Janssen, P.H.M., and P.S.C. Heuberger. 1995. Calibration of process-oriented models. Ecol. Modell. 83:55-66.
31. Jarvis, N.J. 1994. The MACRO model (Version 3.1). Technical description and sample simulations. Rep. and Diss. 19. Swedish Univ. of Agric. Sci., Dep. of Soil Sci., Uppsala.
32. Klepper, O., and D.I. Rouse. 1991. A procedure to reduce parameter uncertainty for complex models by comparison with real system output illustrated on a potato growth model. Agric. Syst. 36:375-395.
33. Klepper, O., H. Scholten, and J.P.G. Van de Kamer. 1991. Prediction uncertainty in an ecological model of the Oosterschelde estuary, S.W. Netherlands. J. Forecasting 10:191-209.
34. Kobayashi, K., and M.U. Salam. 2000. Comparing simulated and measured values using mean squared deviation and its components. Agron. J. 92:345-352.
35. Konikow, L.F., and J.D. Bredehoeft. 1992. Ground water models cannot be validated. Adv. Water Resour. 15:75-83.
36. Loague, K., and R.W. Green. 1991. Statistical and graphical methods for evaluating solute transport models: Overview and application. J. Contam. Hydrol. 7:51-73.
37. Manly, B.F.J. 1997. Randomization, bootstrap, and Monte Carlo methods in biology. Chapman and Hall/CRC, New York.
38. Martorana, F., and G. Bellocchi. 1999. A review of methodologies to evaluate agroecosystem simulation models. Ital. J. Agron. 3:19-39.
39. Mayer, D.G., and D.G. Butler. 1993. Statistical validation. Ecol. Modell. 68:21-32.
40. McCullagh, P., and J.A. Nelder. 1989. Generalized linear models. Stat. and Appl. Probability Monogr. 37. 2nd ed. Chapman & Hall, London.
41. Metselaar, K. 1999. Auditing predictive models: A case study in crop growth. Ph.D. thesis. Wageningen Agric. Univ., Wageningen, the Netherlands.
42. Miklós, D., S. Kemény, G. Almásy, and K. Kollár-Hunek. 1995. Thermodynamic consistency of data banks. Fluid Phase Equilib. 110: 89-113.
43. Oreskes, N., K. Shrader-Frechette, and K. Belitz. 1994. Verification, validation, and confirmation of numerical models in the earth sciences. Science (Washington, DC) 263:641-646.
44. Penning de Vries, F.W.T. 1977. Evaluation of simulation models in agriculture and biology: Conclusions of a workshop. Agric. Syst. 2:99-107.
45. Penning de Vries, F.W.T., D.M. Jansen, H.F.M. ten Berge, and A. Bakema. 1989. Simulation of ecophysiological processes of growth of several annual crops. Simulation Monogr. Pudoc, Wageningen, the Netherlands.
46. Plentiger, M., and F.W.T. Penning de Vries. 1997. Rotation models for ecological farming. CAMASE/PE Workshop Rep. AB-DLO and C.T. de Wit Graduate School for Prod. Ecol., Wageningen, the Netherlands.
47. Press, W.H., B.P. Flannery, S.A. Teukolsky, and W.T. Vetterling. 1992. Numerical recipes in Fortran. Cambridge Univ. Press, Cambridge, UK.
48. Reckhow, K., J. Trevor Clements, and R.C. Dodd. 1990. Statistical evaluation of mechanistic water quality models. J. Environ. Eng. 116:250-268.
49. Rykiel, E.J., Jr. 1996. Testing ecological models: The meaning of validation. Ecol. Modell. 90:239-244.
50. Sage, A.P. 1987. Validation. p. 4996. In M.G. Sage (ed.) Systems analysis and control encyclopedia: Theory, technology, applications. Pergamon, Oxford, UK.
51. Scheffé, H. 1959. The analysis of variance. Wiley, New York.
52. Schlesinger, S., R.E. Crosbie, R.E. Gagne, G.S. Innis, C.S. Lalwani, J. Loch et al. 1979. Terminology for model credibility. Simulation 32:103-104.
53. Smith, P., J.U. Smith, D.S. Powlson, W.B. McGill, J.R.M. Arah, O.G. Chertov et al. 1997. A comparison of the performance of nine soil organic matter models using datasets from seven long-term experiments. Geoderma 81:153-225.
54. Sorooshian, S., Q. Duan, and V.K. Gupta. 1993. Calibration of rainfall-runoff models: Application of global optimization to the Sacramento Soil Moisture Model. Water Resour. Res. 29:1185-1194.
55. Sorooshian, S., V.K. Gupta, and J.L. Fulton. 1983. Evaluation of maximum likelihood parameter estimation techniques for conceptual runoff models: Influence of calibration data variability and length on model credibility. Water Resour. Res. 1:251-259.
56. Sprott, J.G. 1991. Numerical recipes: Routines and examples in BASIC. Cambridge Univ. Press, Cambridge, UK.
57. Wallach, D. 1999. Linking model validation, uncertainty analysis and parameter adjustment. p. 271-272. In Proc. Int. Symp. Modelling Cropping Syst., 1st, Lleida, Spain. 21-23 June 1999. University of Lleida, Spain.
58. Wallach, D. 2003. Editorial. Agronomie (Paris) 22:115-117.
59. Wallach, D., B. Goffinet, J.-E. Bergez, P. Debaeke, D. Leenhardt, and J.-N. Aubertot. 2001. Parameter estimation of crop models: A new approach and application to a corn model. Agron. J. 93: 757-766.
60. Willavize, S.E., S.G. Carmer, and W.M. Walker. 1980. Evaluation of cluster analysis for comparing treatment means. Agron. J. 72:317-320.
61. Willmott, C.J., and D.E. Wicks. 1980. An empirical method for the spatial interpolation of monthly precipitation within California. Phys. Geogr. 1:59-73.
62. Wisniak, J., and A. Polishuk. 1999. Analysis of residuals - a useful tool for phase equilibrium data analysis. Fluid Phase Equilib. 164:61-82.
63. Yang, J., D.J. Greenwood, D.L. Rowell, G.A. Wadsworth, and I.G. Burns. 2000. Statistical methods for evaluating a crop nitrogen simulation model, N_ABLE. Agric. Syst. 64:37-53.
64. Zacharias, S., C.D. Heatwole, and C.W. Coakley. 1996. Robust quantitative techniques for validating pesticide transport models. Trans. ASAE 39:47-54.