Comment on "Two statistics for evaluating parameter identifiability and error reduction" by John Doherty and Randall J. Hunt

Journal of Hydrology

Volumn 380, Issue 3-4, 2010, Pages 481-488

  Hill, Mary C ^a  

^a U S GEOLOGICAL SURVEY   (United States)

Author keywords

First order second moment (FOSM) analysis; Model discrimination; Parameter null space; Sensitivity analysis; Singular value decomposition; Uncertainty

Indexed keywords

ERROR STATISTICS; SENSITIVITY ANALYSIS; STATISTICS; UNCERTAINTY ANALYSIS;

EVALUATING PARAMETERS; FIRST ORDER SECOND MOMENT; MODEL DISCRIMINATION; NULL SPACE; NULL-SPACE COMPONENTS; PARAMETER CORRELATION; PARAMETER IDENTIFIABILITY; UNCERTAINTY;

SINGULAR VALUE DECOMPOSITION;

ERROR CORRECTION; NUMERICAL MODEL; SENSITIVITY ANALYSIS; UNCERTAINTY ANALYSIS;

EID: 72249111076     PISSN: 00221694     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jhydrol.2009.10.011     Document Type: Note

References (40)

1. Anderman E.R., Hill M.C., and Poeter E.P. Two-dimensional advective transport in ground-water flow parameter estimation. Ground Water 34 6 (1996) 1001-1009
2. Barlebo H.C., Hill M.C., Rosbjerg Dan., and Jensen K.H. Concentration data and dimensionality in groundwater models, evaluation using inverse modelling. Nordic Hydrology 29 (1998) 149-178
3. Barlebo H.C., Hill M.C., and Rosbjerg Dan. Identification of groundwater parameters at Columbus, Mississippi, using three-dimensional inverse flow and transport model. Water Resources Research 40 4 (2004) W0421110.1029/2002WR001935
4. Barth G.R., Hill M.C., Illangasekare T.H., and Rajaram H. Predictive modeling of flow and transport in a two-dimensional intermediate-scale, heterogeneous porous media. Water Resources Research 37 10 (2001) 2503-2512
5. Barth G.R., and Hill M.C. Numerical methods for improving sensitivity analysis and parameter estimation of virus transport simulated using sorptive-reactive processes. Journal of Contaminant Hydrology 76 (2005) 251-277
6. Barth G.R., and Hill M.C. Parameter and observation importance in modeling virus transport in saturated systems - investigations in a homogenous system. Journal of Contaminant Hydrology 80 (2005) 107-129
7. Burnham K.P., and Anderson D.R. Model Selection and Multi-model Inference. A Practical Information-Theoretic Approach (2002), Springer-Verlag, New York, NY
8. D'Agnese F.A., Faunt C.C., Hill M.C., and Turner A.K. Death Valley regional ground-water flow model calibration using optimal parameter estimation methods and geoscientific information systems. In: Leijnse A., and Hill M.C. (Eds). Invited paper for a Special Section on Model Calibration and Reliability Evaluation for Ground-water Systems. Advances in Water Resources vol. 22(8) (1999) 777-790
9. Doherty J. Manual and Addendum for PEST: Model Independent Parameter Estimation (2008), Watermark Numerical Computing, Brisbane, Australia
10. Doherty J., and Hunt R.J. Two statistics for evaluating parameter identifiability and error reduction. Journal of Hydrology 366 (2009) 119-127
11. Ely, D.M., Hill, M.C., Tiedeman, C.R., O'Brien, G.M., 2000. Evaluating observations in the context of predictions for the Death Valley regional groundwater system. In: Proceedings of the 2000 Joint Conference on Water Resources Engineering and Water Resources Planning and Management, Minneapolis, Minnesota, compact disk, American Society of Civil Engineers.
12. Faunt, C.C., Blainey, J.B., Hill, M.C., D'Agnese, F.A., O'Brien, G.A., 2004. Transient numerical model of ground-water flow. In: Belcher, W. (Ed.), Evaluation of the Death Valley Regional Ground-water Flow System (DVRFS), US Geological Survey Scientific Investigations Report 2004-5205, Nevada and California.
13. Fienen M.N., Muffles C.T., and Hunt R.J. On constraining pilot point calibration with regularization in PEST. Ground Water (2009) 10.1111/j.1745-6584.2009.00579.x
14. Foglia L., Mehl S.W., Hill M.C., Perona P., and Burlando P. Testing alternative ground water models using cross validation and other methods. Ground Water 45 5 (2007) 627-641 10.1111/j.1745-6584.2007.00341.x
15. Foglia L., Hill M.C., Mehl S.W., and Burlando P. Sensitivity analysis, calibration and testing of a distributed hydrological model using an error-weighted objective function. Water Resources Research 45 (2009) W06427 10.1029/2008WR007255
16. Gooseff M.N., Bencala K.E., Scott D.T., Runkel R.L., and McKnight D.M. Sensitivity analysis of conservative and reactive stream transient storage models applied to field data from multiple-reach experiments. Advances in Water Resources 28 5 (2005) 479-492
17. Hill, M.C., 1992. A computer program (MODFLOWP) for estimating parameters of a transient, three-dimensional ground-water flow model using nonlinear regression. US Geological Survey Open-File Report 91-484, 358p.
18. Hill M.C., 1998. Methods and guidelines for effective model calibration. US Geological Survey Water-Resources Investigations Report 98-4005. .
19. Hill M.C. The practical use of simplicity in developing ground-water models. Ground Water 44 6 (2006) 775-781
20. Hill M.C. Data error and highly parameterized groundwater models. In: Refsgaard J.C. (Ed). Calibration and Reliability in Groundwater Modeling, Credibility of Modeling. Proceeding of the ModelCARE2007 Conference 320 (2008), IAHS Publication, Copenhagen, Denmark 316-321
21. Hill, M.C., Banta, E.R., Harbaugh, A.W., Anderman, E.R., 2000. MODFLOW-2000, the US Geological Survey modular ground-water model, User's guide to the Observation, Sensitivity, and Parameter-Estimation Process and three post-processing programs: US Geological Survey Open-File Report 00-184, 209 p. .
22. Hill, M.C., Ely, D.M., Tiedeman, C.R. D'Agnese, F.A., Faunt, C.C., O'Brien, G.A., 2001. Preliminary evaluation of the importance of existing hydraulic-head observation locations to advective-transport predictions, Death Valley regional flow system, California and Nevada: US Geological Survey Water-Resources Investigations Report 00-4282, 82p. .
23. Hill M.C., and Østerby O. Determining extreme parameter correlation in ground water models. Ground Water 41 4 (2003) 420-430
24. Hill M.C., and Tiedeman C.R. Effective Groundwater Model Calibration, with Analysis of Sensitivities, Predictions, and Uncertainty (2007), Wiley, New York, New York. http://water.usgs.gov/lookup/get?crresearch/hill_tiedeman_book 455p.
25. Hunt R.J., Doherty J., and Tonkin M.J. Are models too simple? Arguments for increased parameterization. Ground Water 45 3 (2007) 254-262
26. Kirchner J.W. Getting the right answers for the right reasons, linking measurements, analyses, and models to advance the science of hydrology. Water Resources Research 41 (2006) 10.1029/2005WR004362
27. Mehl S.W., and Hill M.C. A comparison of solute-transport solution techniques and their effect on sensitivity analysis and inverse modeling results. Ground Water 39 2 (2001) 300-307
28. Moore C., and Doherty J. Role of the calibration process in reducing model predictive error. Water Resources Research 41 (2005) 10.1029/2004WR003501
29. Poeter E.P., and Anderson D. Multi-model ranking and inference in ground water modeling. Ground Water 43 4 (2005) 85-89
30. Poeter E.P., and Hill M.C. Inverse models, a necessary next step in groundwater modeling. Ground Water 35 2 (1997) 250-260
31. Poeter, E.P., Hill, M.C., 2007. MMA, a computer code for multi-model analysis: U.S. Geological Survey Techniques and Methods 6-E3, 113p. .
32. Poeter E.P., Hill M.C., Banta E.R., Mehl S.W., and Christensen S. UCODE-2005 and six other computer codes for universal sensitivity analysis, inverse modeling, and uncertainty evaluation. US Geological Survey Techniques and Methods (2005) 6-A11
33. Scott D.T., Gooseff M.N., Bencala K.E., and Runkel R.L. Automated calibration of a stream solute transport model. Implications for interpretation of biogeochemical parameters. Journal of the North American Benthological Society 22 4 (2003) 492-510
34. Sobol' I.M., Tarantola S., Gatelli D., Kucherenko S.S., and Mauntz W. Estimating the approximation error when fixing unessential factors in global sensitivity analysis. Reliability Engineering and System Safety 92 7 (2007) 957-960
35. Tiedeman C.R., Hill M.C., D'Agnese F.A., and Faunt C.C. Methods for using groundwater model predictions to guide hydrogeologic data collection, with application to the Death Valley regional ground-water flow system. Water Resources Research 39 1 (2003) 5-1-5-17 10.1029/2001WR001255
36. Tiedeman C.R., Ely D.M., Hill M.C., and O'Brien G.M. A method for evaluating the importance of system state observations to model predictions, with application to the Death Valley regional groundwater flow system. Water Resources Research 40 (2004) W12411 10.1029/2004WR003313
37. Tonkin, M., Tiedeman, C.R., Ely, D.M., Hill, M.C., 2007. OPR-PPR, a computer program for assessing data importance to model predictions using linear statistics: US Geological Survey Techniques and Methods 6-E2, 115p. .
38. Ye Ming., Neuman S.P., and Meyer P.D. Maximum likelihood Bayesian averaging of spatial variability models in unsaturated fractured tuff. Water Resources Research 40 (2004) W05113 10.1029/2003WR002557
39. Ye Ming., Neuman S.P., Meyer P.D., and Pohlmann K. Sensitivity analysis and assessment of prior model probabilities in MLBMA with application to unsaturated fractured tuff. Water Resources Research 41 (2005) W12429 10.1029/2005WR004260
40. Ye M., Meyer P.D., and Neuman S.P. On model selection criteria in multimodel analysis. Water Resources Research 44 (2008) W03428 10.1029/2008WR006803