Analysis of regression confidence intervals and bayesian credible intervals for uncertainty quantification

Water Resources Research

Volumn 48, Issue 9, 2012, Pages

  Lu, Dan ^a   Ye, Ming ^a   Hill, Mary C ^b  

^a FLORIDA STATE UNIVERSITY   (United States)

^b U S GEOLOGICAL SURVEY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYTICAL AND NUMERICAL MODELS; BAYESIAN THEORY; CONFIDENCE INTERVAL; CONFIDENCE REGION; CREDIBLE INTERVAL; CREDIBLE REGIONS; DATA COLLECTION STRATEGIES; ENVIRONMENTAL MODEL; ENVIRONMENTAL MODELING; ENVIRONMENTAL PROBLEMS; EXECUTION TIME; GAUSSIAN ERRORS; GROUNDWATER MODELS; INDIVIDUAL MODELS; INTRINSIC MODEL; LIKELIHOOD METHODS; MARKOV CHAIN MONTE CARLO; MODEL CONSTRUCTION; MODEL DEVELOPMENT; MODEL ERRORS; MONOTONIC FUNCTIONS; NON-IDEAL CONDITIONS; NON-LINEAR MODEL; NON-LINEARITY; OBSERVATION ERRORS; PREDICTIVE UNCERTAINTY; PRIOR INFORMATION; UNCERTAINTY INTERVALS; UNCERTAINTY QUANTIFICATIONS;

ERRORS; GROUNDWATER; NONLINEAR ANALYSIS; NONLINEAR SYSTEMS;

UNCERTAINTY ANALYSIS;

BAYESIAN ANALYSIS; CONFIDENCE INTERVAL; GAUSSIAN METHOD; GROUNDWATER FLOW; NONLINEARITY; REGRESSION ANALYSIS; UNCERTAINTY ANALYSIS;

EID: 84866709402     PISSN: 00431397     EISSN: None     Source Type: Journal    
DOI: 10.1029/2011WR011289     Document Type: Article

References (89)

1. Aster, R. C., B. Borchers, and C. H. Thurber (2012), Parameter Estimation and Inverse Problems, 2nd ed., 360 pp., Elsevier, Amsterdam.
2. Bates, D. M., and D. G. Watts (1980), Relative curvature measures of nonlinearity, J. R. Stat. Soc. B, 42(1), 1-25.
3. Bates, D. M., and D. G. Watts (1988), Nonlinear Regression Analysis and Its Applications, 365 pp., John Wiley and Sons, New York.
4. Beale, E. M. L. (1960), Confidence regions in non-linear estimation, J. R. Stat. Soc., B, 22(1), 41-76.
5. Box, E. P., and G. C. Tiao (1992), Bayesian Inference in Statistical Analysis, 588 pp., Wiley, New York.
6. Brockwell, P. J., and R. A. Davis (1987), Time Series, Theory and Methods, 600 pp., Springer, New York.
7. Carrera, J., and S. P. Neuman (1986), Estimation of aquifer parameters under transient and steady state conditions: 1. Maximum likelihood method incorporating prior information, Water Resour. Res., 22(2), 199-210, doi:10.1029/WR022i002p00199.
8. Casella, G., and R. L. Berger (2002), Statistical Inference, 2nd ed., 660 pp., Duxbury, Belmont, Calif.
9. Chen, M., and Q. Shao (1999), Monte Carlo estimation of Bayesian credible and HPD intervals, J. Comput. Graph. Statist., 8(1), 69-92.
10. Christensen, S., and R. L. Cooley (1999), Evaluation of confidence intervals for a steady-state leaky aquifer model, Adv. Water Resour., 22(8), 807-817, doi:10.1016/S0309-1708 (98) 00055-4.
11. Christensen, S., and R. L. Cooley (2005), User guide to the UNC process and three utility programs for computation of nonlinear confidence and prediction intervals using MODFLOW-2000, U. S. Geol. Surv. Tech. Methods Rep., 2004-1349.
12. Clark, M. P., D. Kavetski, and F. Fenicia (2011), Pursuing the method of multiple working hypotheses for hydrological modeling, Water Resour. Res., 47, W09301, doi:10.1029/2010WR009827.
13. Cook, R. D., and S. Weisberg (1982), Residuals and Influence in Regression, 230 pp., Chapman and Hall, New York.
14. Cooley, R. L. (1977), A method of estimating parameters and assessing reliability for models of steady-state groundwater flow: 1. Theory and numerical properties, Water Resour. Res., 13(2), 318-324, doi:10.1029/WR013i002p00318.
15. Cooley, R. L. (1979), A method of estimating parameters and assessing reliability for models of steady state groundwater flow: 2. Application of statistical analysis, Water Resour. Res., 15(3), 603-617, doi:10.1029/ WR015i003p00603.
16. Cooley, R. L. (1983), Incorporation of prior information on parameters into nonlinear regression groundwater flow models: 2. Applications, Water Resour. Res., 19(3), 662-676, doi:10.1029/WR019i003p00662.
17. Cooley, R. L. (1993a), Exact Scheffé-type confidence intervals for output from groundwater flow models: 1. Use of hydrogeologic information, Water Resour. Res., 29(1), 17-33, doi:10.1029/92WR01863.
18. Cooley, R. L. (1993b), Exact Scheffé-type confidence intervals for output from groundwater flow models 2. Combined use of hydrogeologic information and calibration data, Water Resour. Res., 29(1), 35-50, doi:10.1029/92WR01864.
19. Cooley, R. L. (1997), Confidence intervals for ground water models using linearization, likelihood, and bootstrap method, Ground Water, 35(5), 869-880, doi:10.1111/j.1745-6584.1997.tb00155.x.
20. Cooley, R. L. (1999), Practical Scheffe-type credibility intervals for variables of a groundwater model, Water Resour. Res., 35(1), 113-126, doi:10.1029/98WR02819.
21. Cooley, R. L. (2004), A theory for modeling groundwater flow in heterogeneous media, U. S. Geol. Surv. Prof. Pap., 1679.
22. Cooley, R. L., and R. L. Naff (1990), Regression modeling of ground-water flow, in U. S. Geological Survey Techniques of Water-Resources Investigations, Book 3, Chap. B4, 232 pp., U. S. Geol. Surv., Washington, D. C.
23. Cooley, R. L., and A. V. Vecchia (1987), Calculation of nonlinear confidence and prediction intervals for groundwater flow models, Water Resour. Bull, 23(4), 581-599, doi:10.1111/j.1752-1688.1987.tb00834.x.
24. Dausman, A. M., J. Doherty, C. D. Langevin, and M. C. Sukop (2010), Quantifying data worth toward reducing predictive uncertainty, Ground Water, 48(5), 729-740, doi:10.1111/j.1745-6584.2010.00679.x.
25. Doherty, J. (2003), MICA: Model-independent Markov Chain Monte Carlo Analysis, Watermark Numer. Comput, Brisbane, Australia.
26. Doherty, J., and R. J. Hunt (2010), Response to comment on "Two statistics for evaluating parameter identifiability and error reduction", J. Hydrol, 380, 489-496, doi:10.1016/j.jhydrol.2009.10.012.
27. Donaldson, J. R., and R. B. Schnabel (1987), Computational experience with confidence regions and confidence intervals for nonlinear least squares, Technometrics, 29, 67-82.
28. Draper, N. R., and H. Smith (1998), Applied Regression Analysis, 3rd ed., John Wiley, New York.
29. Fienen, M. N., J. E. Doherty, R. J. Hunt, and H. W. Reeves (2010), Using prediction uncertainty analysis to design hydrologic monitoring networks: Example applications from the great lakes water availability pilot project, U. S. Geol. Surv. Sci. Invest. Rep., 2010-5159.
30. Finsterle, S., and K. Pruess (1995), Solving the estimation- identification problem in two-phase flow modeling, Water Resour. Res., 31(4), 913-924, doi:10.1029/94WR03038.
31. Finsterle, S., and Y. Zhang (2011), Error handling strategies in multiphase inverse modeling, Comput. Geosci., 37, 724-730, doi:10.1016/j.cageo. 2010.11.009.
32. Foglia, L., S. W. Mehl, M. C. Hill, P. Perona, and P. Burlando (2007), Testing alternative ground water models using cross-validation and other methods, Ground Water, 45(5), 627-641, doi:10.1111/j.1745-6584.2007.00341.x.
33. Fu, G., D. Butler, S.-T. Khu, and S. Sun (2011), Imprecise probabilistic evaluation of sewer flooding in urban drainage systems using random set theory, Water Resour. Res., 47, W02534, doi:10.1029/2009WR008944.
34. Gallagher, M., and J. Doherty (2007), Parameter estimation and uncertainty analysis for a watershed model, Environ. Model. Softw., 22, 1000-1020, doi:10.1016/j.envsoft.2006.06.007.
35. Gelman, A., J. B. Carlin, H. S. Stern, and D. B. Rubin (1995), Bayesian Data Analysis, 696 pp., Chapman and Hall, London.
36. Haario, H., E. Saksman, and J. Tamminen (2001), An adaptive Metropolis algorithm, Bernoulli, 7(2), 223-242, doi:10.2307/3318737.
37. Hill, M. C. (1989), Analysis of accuracy of approximate, simultaneous, nonlinear confidence intervals on hydraulic heads in analytical and numerical test cases, Water Resour. Res., 25(2), 177-190, doi:10.1029/WR025i002p00177.
38. Hill, M. C. (2010), Comment on "Two statistics for evaluating parameter identifiability and error reduction" by John Doherty and Randall J. Hunt, J. Hydrol, 380, 481-488, doi:10.1016/j.jhydrol.2009.10.011.
39. Hill, M. C., and C. R. Tiedeman (2007), Effective Calibration of Ground Water Models, With Analysis of Data, Sensitivities, Predictions, and Uncertainty, 480 pp., John Wiley and Sons, New York.
40. Hill, M. C., R. L. Cooley, and D. W. Pollock (1998), A controlled experiment in ground water flow model calibration, Ground Water, 36(3), 520-535, doi:10.1111/j.1745-6584.1998.tb02824.x.
41. Jaynes, E. T. (1976), Confidence intervals vs Bayesian intervals, in Foundations of Probability Theory, Statistical Inference, and Statistical Theories of Science, edited by W. L. Harper and C. A. Hooker, pp. 175-257, D. Reidel Publ., Dordrecht, Netherlands.
42. Kavetski, D., and M. P. Clark (2010), Ancient numerical daemons of conceptual hydrological modeling: 2. Impact of time stepping schemes on model analysis and prediction, Water Resour. Res., 46, W10511, doi:10.1029/ 2009WR008896.
43. Kavetski, D., G. Kuczera, and S. W. Franks (2006), Calibration of conceptual hydrological models revisited: 2. Improving optimization and analysis, J. Hydrol., 320, 187-201, doi:10.1016/j.jhydrol.2005.07.013.
44. Kitanidis, P. K. (1986), Parameter uncertainty in estimation of spatial functions: Bayesian analysis, Water Resour. Res., 22(4), 499-507, doi:10.1029/WR022i004p00499.
45. Kitanidis, P. K. (1997), Introduction to Geostatistics, Applications in Hydrology, 272 pp., Cambridge Univ. Press, New York, doi:10.1017/ CBO9780511626166.
46. Kitanidis, P. K. (2010), Bayesian and geostatistical approaches to inverse problems, in Large-scale inverse problems and quantification of uncertainty, edited by L. Biegler et al., pp. 71-86, Wiley, New York, doi:10.1002/9780470685853.ch4.
47. Krzysztofowicz, R. (2010), Decision criteria, data fusion and prediction calibration: A Bayesian approach, Hydrol. Sci. J., 55(6), 1033-1050, doi:10.1080/02626667.2010.505894.
48. Li, X., and F. T.-C. Tsai (2009), Bayesian model averaging for groundwater head prediction and uncertainty analysis using multimodel and multimethod, Water Resour. Res., 45, W09403, doi:10.1029/2008WR007488.
49. Linssen, H. N. (1975), Nonlinearity measures: A case study, Stat. Neerl., 29, 93-99, doi:10.1111/j.1467-9574.1975.tb00253.x.
50. Liu, X., M. A. Cardiff, and P. K. Kitanidis (2010), Parameter estimation in nonlinear environmental problems, Stochastic Environ. Res. Risk Assess., 24, 1003-1022, doi:10.1007/s00477-010-0395-y.
51. Lu, D., M. Ye, S. P. Neuman, and L. Xue (2012), Multimodel Bayesian analysis of data-worth applied to unsaturated fractured tuffs, Adv. Water Resour., 35, 69-82, doi:10.1016/j.advwatres.2011.10.007.
52. McClave, J. T., and T. Sincich (2000), Statistics, 8th ed., Prentice Hall, Upper Saddle River, N. J.
53. Mehl, S. W., and M. C. Hill (2010), Grid-size dependence of Cauchy boundary conditions used to simulate stream-aquifer interactions, Adv. Water Resour., 33, 430-442, doi:10.1016/j.advwatres.2010.01.008.
54. Meyer, P. D., M. Ye, M. L. Rockhold, S. P. Neuman, and K. J. Cantrell (2007), Combined Estimation of Hydrogeologic Conceptual Model, Parameter, and Scenario Uncertainty, NUREG/CR-6940, PNNL-16396, U. S. Nucl. Regul. Comm., Washington, D. C.
55. Montanari, A., and A. Brath (2004), A stochastic approach for assessing the uncertainty of rainfall-runoff simulations, Water Resour. Res., 40, W01106, doi:10.1029/2003WR002540.
56. Montanari, A., and G. Grossi (2008), Estimating the uncertainty of hydrological forecasts: A statistical approach, Water Resour. Res., 44, W00B08, doi:10.1029/2008WR006897.
57. Morgan, M. G., and M. Henrion (1990), Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis, Cambridge Univ. Press, Cambridge, U. K., doi:10.1017/CBO9780511840609.
58. Neuman, S. P. (2003), Maximum likelihood Bayesian averaging of alternative conceptual-mathematical models, Stochastic Environ. Res. Risk Assess., 17(5), 291-305, doi:10.1007/s00477-003-0151-7.
59. Neuman, S. P., and P. J. Wierenga (2003), A Comprehensive Strategy of Hydrogeologic Modeling and Uncertainty Analysis for Nuclear Facilities and Sites, NUREG/CR-6805, U. S. Nucl. Regul. Comm., Washington, D. C.
60. Neuman, S. P., L. Xue, M. Ye, and D. Lu (2012), Bayesian analysis of data-worth considering model and parameter uncertainties, Adv. Water Resour., doi:10.1016/j.advwatres.2011.02.007, in press.
61. Oliver, D. S., A. C. Reynolds, and N. Liu (2008), Inverse Theory for Petroleum Reservoir Characterization and History Matching, 392 pp., Cambridge Univ. Press, New York.
62. Parker, J. C., U. Kim, M. Widdowson, P. Kitanidis, and R. Gentry (2010), Effects of model formulation and calibration data on uncertainty in dense nonaqueous phase liquids source dissolution predictions, Water Resour. Res., 46, W12517, doi:10.1029/2010WR009361.
63. Poeter, E. P., and D. A. Anderson (2005), Multimodel ranking and inference in ground water modeling, Ground Water, 43(4), 597-605, doi:10.1111/j.1745-6584.2005.0061.x.
64. Poeter, E. P., and M. C. Hill (2007), A computer code for multimodel analysis, U. S. Geol. Surv. Tech. Methods, 6-E3.
65. Poeter, E. P., M. C. Hill, E. R. Banta, S. W. Mehl, and S. Christensen (2005), UCODE-2005 and six other computer codes for universal sensitivity analysis, inverse modeling, and uncertainty evaluation, U. S. Geol. Surv. Tech. Methods, 6-A11.
66. Razavi, S., B. A. Tolson, and D. H. Burn (2012), Review of surrogate modeling in water resources, Water Resour. Res., 48, W07401, doi:10.1029/2011WR011527.
67. Renard, B., D. Kavetski, E. Leblois, M. Thyer, G. Kuczera, and S. W. Franks (2011), Toward a reliable decomposition of predictive uncertainty in hydrological modeling: Characterizing rainfall errors using conditional simulation, Water Resour. Res., 47, W11516, doi:10.1029/2011WR010643.
68. Saltelli, A., M. Ratto, T. Andres, F. Campolongo, J. Cariboni, D. Gatelli, M. Saisana, and S. Tarantola (2008), Global Sensitivity Analysis, The Primer, John Wiley and Sons, New York.
69. Samanta, S., D. S. Mackay, M. K. Clayton, E. L. Kruger, and B. E. Ewers (2007), Bayesian analysis for uncertainty estimation of a canopy transpiration model, Water Resour. Res., 43, W04424, doi:10.1029/2006WR005028.
70. Schoups, G., and J. A. Vrugt (2010), A formal likelihood function for parameter and predictive inference of hydrologic models with correlated, heteroscedastic, and non-Gaussian errors, Water Resour. Res., 46, W10531, doi:10.1029/2009WR008933.
71. Schweppe, F. C. (1973), Uncertainty Dynamic Systems, Prentice Hall, Englewood Cliffs, N. J.
72. Sciortino, A., T. C. Harmon, and W. W.-G. Yeh (2002), Experimental design and model parameter estimation for locating a dissolving dense nonaqueous phase liquid pool in groundwater, Water Resour. Res., 38(5), 1057, doi:10.1029/2000WR000134.
73. Seber, G. A. F., and A. J. Lee (2003), Linear Regression Analysis, 549 pp., Wiley, New York, doi:10.1002/9780471722199.
74. Seber, G. A. F., and C. J. Wild (2003), Nonlinear Regression, 768 pp., Wiley, New York.
75. Shi, X., M. Ye, S. Finsterle, and J. Wu (2012), Comparing nonlinear regression and Markov chain Monte Carlo methods for assessment of predictive uncertainty in vadose zone modeling, Vadose Zone J., doi:10.2136/vzj2011.0147, in press.
76. Stark, P. B., and L. Tenorio (2011), A primer of frequentists and Bayesian inverence in inverse problems, in Large-scale Inverse Problems and Quantification of Uncertainty, edited by L. Biegler et al., pp. 9-32, Wiley, New York.
77. Sun, A. Y., A. P. Morris, and S. Mohanty (2009), Sequential updating of multimodal hydrogeologic parameter fields using localization and clustering techniques, Water Resour. Res., 45, W07424, doi:10.1029/2008WR007443.
78. Tang, Y., P. Reed, T. Wagener, and K. van Werkhoven (2007), Comparing sensitivity analysis methods to advance lumped watershed model identification and calibration, Hydrol. Earth Syst. Sci., 11, 793-817, doi:10.5194/hess-11-793- 2007.
79. Tiedeman, C. R., M. C. Hill, F. A. D'Agnese, and C. C. Faunt (2003), Methods for using groundwater model predictions to guide hydrogeologic data collection, with application to the Death Valley regional groundwater flow system, Water Resour. Res., 39(1), 1010, doi:10.1029/2001WR001255.
80. Tiedeman, C. R., D. M. Ely, M. C. Hill, and G. M. O'Brien (2004), A method for evaluating the importance of system state observations to model predictions, with application to the Death Valley regional groundwater flow system, Water Resour. Res., 40, W12411, doi:10.1029/2004WR003313.
81. Tonkin, M., C. R. Tiedeman, D. M. Ely, and M. C. Hill (2007), OPR-PPR, a computer program for assessing data importance to model predictions using linear statistics, U. S. Geol. Surv. Tech. Methods, 6-E2, 115 pp. [Available at http://water.usgs.gov/software/OPR-PPR.html.]
82. Vecchia, A. V., and R. L. Cooley (1987), Simultaneous confidence and prediction intervals for nonlinear regression models with application to a groundwater flow model, Water Resour. Res., 23(7), 1237-1250, doi:10.1029/WR023i007p01237.
83. Vrugt, J. A., and W. Bouten (2002), Validity of first-order approximations to describe parameter uncertainty in soil hydraulic models, Soil Sci. Soc. Am. J., 66, 1740-1751, doi:10.2136/sssaj2002.1740.
84. Vrugt, J. A., C. J. F. ter Braak, M. P. Clark, J. M. Hyman, and B. A. Robinson (2008), Treatment of input uncertainty in hydrologic modeling: Doing hydrology backward with Markov chain Monte Carlo simulation, Water Resour. Res., 44, W00B09, doi:10.1029/2007WR006720.
85. Vrugt, J. A., C. J. F. ter Braak, C. G. H. Diks, B. A. Robinson, J. M. Hyman, and D. Higdon (2009), Accelerating Markov Chain Monte Carlo simulation by differential evolution with self-adaptive randomized subspace sampling, Int. J. Nonlinear Sci. Numer. Simul., 10(3), 271-288.
86. Wang, Q. J., D. E. Robertson, and F. H. S. Chiew (2009), A Bayesian joint probability modeling approach for seasonal forecasting of streamflows at multiple sites, Water Resour. Res., 45, W05407, doi:10.1029/2008WR007355.
87. Ye, M., S. P. Neuman, and P. D. Meyer (2004), Maximum likelihood Bayesian averaging of spatial variability models in unsaturated fractured tuff, Water Resour. Res., 40, W05113, doi:10.1029/2003WR002557.
88. Yeh, W. W.-G. (1986), Review of parameter identification procedures in groundwater hydrology: The inverse problem, Water Resour. Res., 22(2), 95-108, doi:10.1029/WR022i002p00095.
89. Yeh, W. W.-G., and Y. S. Yoon (1981), Aquifer parameter identification with optimum dimension in parameterization, Water Resour. Res., 17(3), 664-672, doi:10.1029/WR017i003p00664.