Uncertainty and sensitivity analysis in performance assessment for the Waste Isolation Pilot Plant

Computer Physics Communications

Volumn 117, Issue 1-2, 1999, Pages 156-180

  Helton, J C ^a,b  

^a ARIZONA STATE UNIVERSITY   (United States)

^b SANDIA NATIONAL LABORATORIES   (United States)

Author keywords

Aleatory uncertainty; Epistemic uncertainty; Performance assessment; Radioactive waste disposal: Sensitivity analysis; Stochastic uncertainty; Subjective uncertainty; Uncertainty analysis: Waste Isolation Pilot Plant

Indexed keywords

EID: 0001079329     PISSN: 00104655     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0010-4655(98)00171-4     Document Type: Article

References (71)

1. U.S. Department of Energy, Final Environmental Impact Statement. Waste Isolation Pilot Plant, DOE/EIS-0026 (U.S. Department of Energy, Washington, DC, 1980).
2. U.S. Department of Energy, Final Supplement: Environmental Impact Statement, Waste Isolation Pilot Plant, DOE/EIS-0026-FS (U.S. Department of Energy, Office of Environmental Restoration and Waste Management, Washington. DC, 1990).
3. National Research Council, The Waste Isolation Pilot Plant: A Potential Solution for the Disposal of Transuranic Waste. Committee on the Waste Isolation Pilot Plant, Board on Radioactive Waste Management, Commission on Geosciences, Environment, and Resources, National Research Council (National Academy Press, Washington, D.C., 1996).
4. WIPP Performance Assessment Division, Preliminary Comparison with 40 CFR Part 191, Subpart B for the Waste Isolation Pilot Plant, December 1991, Vols. 1-4, SAND9I-0893/1-4 (Sandia National Laboratories. Albuquerque, NM, 1991-1992).
5. WIPP Performance Assessment Department, Preliminary Performance Assessment for the Waste Isolation Pilot Plant, December 1992. Vols. 1-5, SAND92-0700/1-5 (Sandia National Laboratories, Albuquerque, NM, 1992-1993).
6. J.C. Helton. J.W. Garner, R.D. McCurley, D.K. Rudeen, Sensitivity Analysis Techniques and Results for Performance Assessment at the Waste Isolation Pilot Plant, SAND90-7103 (Sandia National Laboratories, Albuquerque, NM, 1991).
7. J.C. Helton, J.E. Bean, B.M. Butcher, J.W. Garner, J.D. Schreiber, P.N. Swift, P. Vaughn. Uncertainty and Sensitivity Analyses for Gas and Brine Migration at the Waste Isolation Pilot Plant, May 1992. SAND92-2013 (Sandia National Laboratories, Albuquerque. NM, 1993).
8. J.C. Helton, J.W. Garner, M.G. Marietta, R.P. Rechard, D.K. Rudeen, P.N. Swift, Uncertainty and sensitivity analysis results obtained in a preliminary performance assessment for the Waste Isolation Pilot Plant, Nucl. Sci. & Eng. 114 ( 1993) 286-331.
9. J.C. Helton. D.R. Anderson, B.L. Baker, J.E. Bean, J.W. Berglund, W. Beyeler, J.W. Garner, H.J. luzzolino, M.G. Marietta, R.P. Rechard. P.J. Roache, D.K. Rudeen, J.D. Schreiber, P.N. Swift, M.S. Tierney, P. Vaughn, Effect of alternative conceptual models in a preliminary performance assessment for the Waste Isolation Pilot Plant, Nucl. Eng. & Design 154 ( 1995) 251-344.
10. J.C. Helton. D.R. Anderson. B.L. Baker, J.E. Bean, J.W. Berglund, W. Beyeler, K. Economy, J.W. Garner. S.C. Hora. H.J. luzzolino. P. Knupp. M.G. Marietta, J. Rath. R.P. Rechard, P.J. Roache, D.K. Rudeen, K. Salari, J.D. Schreiber, P.N. Swift, M.S. Tierney, P. Vaughn, Uncertainly and sensitivity analysis results obtained in the 1992 performance assessment for the Waste Isolation Pilot Plant, Reliability Eng. & System Safety 51 (1996) 53-100.
11. J.C. Helton. J.E. Bean, B.M. Butcher. J.W. Garner. J.D. Schreiber. P.N. Swift. P. Vaughn, Uncertainty and sensitivity analysis for gas and brine migration at the Waste Isolation Pilot Plant: fully consolidated shaft, Nucl. Sci. & Eng. 122 (1996) 1-31.
12. J.C. Helton, J.E. Bean, B.M. Butcher, J.W. Garner, J.D. Schreiber, P.N. Swift, P. Vaughn, Uncertainty and sensitivity analysis for gas and brine migration at the Waste Isolation Pilot Plant: permeable shaft with panel seals, J. Hazardous Materials 45 ( 1996) 107-139.
13. J.C. Helton, J.E. Bean, B.M. Butcher, J.W. Garner, J.D. Schreiber, P.N. Swift, P. Vaughn, Uncertainty and sensitivity analysis for gas and brine migration at the Waste Isolation Pilot Plant: permeable shaft without panel seals. Reliability Eng. & System Safety 57 (1997) 299-316.
14. J.C. Helton, J.E. Bean. J.W. Berglund, F.J. Davis, K. Economy, J.W. Garner, J.D. Johnson, R.J. MacKinnon, J. Miller, D.G. O'Brien, J.L. Ramsey, J.D. Schreiber, A. Shinta, L.N. Smith, D.M. Stoelzel. C. Stockman, P. Vaughn. Uncertainty and Sensitivity Analysis Results Obtained in the 1996 Performance Assessment for the Waste Isolation Pilot Plant, SAND98-0365 (Sandia National Laboratories, Albuquerque, NM, 1998).
15. J.C. Helton, J.D. Johnson, H.-N. Jow, R.D. McCuriey, L.J. Rahal, Stochastic and subjective uncertainty in the assessment of radiation exposure at the Waste Isolation Pilot Plant, Human & Ecological Risk Assessment 4 (1998) 469-526.
16. U.S. Department of Energy, Title 40 CFR Part 191 Compliance Certification Application for the Waste Isolation Pilot Plant. DOE/CAO-1996-2184 (U.S. Department of Energy, Carlsbad Area Office, Carlsbad, NM, 1996).
17. U.S. Environmental Protection Agency, Criteria for the certification and recertification of the Waste Isolation Pilot Plant's compliance with the disposal regulations: certification decision; final rule. Federal Register 63 ( 1998) 27353-27406.
18. U.S. Environmental Protection Agency, Environmental standards for the management and disposal of spent nuclear fuel, high-level and transuranic radioactive wastes; final rule, 40 CFR Part 191, Federal Register 50 (1985) 38066-38089.
19. U.S. Environmental Protection Agency, Environmental radiation protection standards for the management and disposal of spent nuclear fuel, high-level and transuranic radioactive wastes; final rule, 40 CFR Part 191, Federal Register 58 (1993) 66398-66416.
20. U.S. Environmental Protection Agency, 40 CFR Part 194: Criteria for the certification and re-certification of the Waste Isolation Pilot Plant's compliance with the 40 CFR part 191 disposal regulations; final rule. Federal Register 61 (1996) 5224-5245.
21. J.C. Helton, Risk, uncertainty in risk, and the EPA release limits for radioactive waste disposal, Nucl. Technol. 101 (1991) 18-39.
22. J.C. Helton, D.R. Anderson, M.G. Marietta, R.P. Rechard, Performance assessment for the Waste Isolation Pilot Plant: from regulation to calculation for 40 CFR 191.13, Operations Research 45 (1997) 157-177.
23. J.C. Helton, Treatment of uncertainty in performance assessments for complex systems. Risk Analysis 14 (1994) 483-511.
24. J.C. Helton, Uncertainty and sensitivity analysis in the presence of stochastic and subjective uncertainty, J. Statist. Comput. & Simul.57 (1997) 3-76.
25. S. Kaplan, B.J. Garrick, On the quantitative definition of risk. Risk Analysis 1 (1981) 11-27.
26. G. Apostolakis, The concept of probability in safety assessments of technological systems. Science 250 (1990) 1359-1364.
27. P.O. Huffman, J.S. Hammonds, Propagation of uncertainty in risk assessments: the need to distinguish between uncertainty due to lack of knowledge and uncertainty due to variability. Risk Analysis 14 ( 1994) 707-712.
28. J.C. Helton, D.E. Burmaster, Guest editorial: treatment of aleatory and epistemic uncertainty in performance assessments for complex systems, Reliability Eng. & System Safety 54 (1996) 91-94.
29. ME. Pate-Cornell, Uncertainties in risk analysis: six levels of treatment. Reliability Eng. & System Safety 54 (1996) 95-111.
30. R.L. Winkler, Uncertainty in probabilistic risk assessment. Reliability Eng. & System Safety 54 (1996) 127-132.
31. D. Draper, Assessment and propagation of model uncertainty. J. Roy. Statist. Soc. Ser. B 57 (1995) 45-97.
32. D. Draper, A. Pereira, P. Prado, A. Saltelli, R. Cheal, S. Eguibór, B. Mendes, S. Tarantola, Scenario and parametric uncertainty in GESAMAC: A methodological study in nuclear waste disposal risk assessment, Comput. Phys. Commun. 117 ( 1999) 142-155, this issue.
33. J.C. Helton, Computational structure of a performance assessment involving stochastic and subjective uncertainty, Proc. 1996 Winter Simulation Conference. J.M. Charnes et al., eds. (Instil. Electrical and Electronics Engineers, Piscataway, NJ, 1996), pp. 239-247.
34. W. Feller, An Introduction to Probability Theory and Its Applications, Vol. II, 2nd ed. (Wiley, New York. 1971).
35. J.E. Bean, M.E. Lord, D.A. McArthur, R.J. MacKinnon, J.D. Miller, J.D. Schreiber, Analysis Package for the Salado Flow Calculations (Task 1) of the Performance Assessment Analysis Supporting the Compliance Certification Application (CCA), Analysis package. SWCF-A:1.2.07.4.1:PA:QA:CCA, Sandia WIPP Central Files WPO # 40514 (Sandia National Laboratories. Albuquerque, NM, 1996).
36. D.M. Stoelzel. D.G. O'Brien, 1996, Analysis Package for the BRAGFLO Direct Release Calculations (Task 4) of the Performance Assessment Calculations Supporting the Compliance Certification Application (CCA), AP-029, Brine Release Calculations. Analysis package, SWCF-A: 1.2.07.4.1:PA:QA, Sandia WIPP Central Files WPO # 40520 (Sandia National Laboratories. Albuquerque, NM, 1996).
37. F.D. Hansen, M.K. Knowles, T.W. Thompson, M. Gross, J.D. McLennan, J.F. Schatz. Description and Evaluation of a Mechanistically Based Conceptual Model for Spall, SAND97-1369 (Sandia National Laboratories, Albuquerque, NM, 1997).
38. J.W. Berglund, Mechanisms Governing the Direct Removal of Wastes from the Waste Isolation Pilot Plant Repository Caused by Exploratory Drilling. SAND92-7295 (Sandia National Laboratories, Albuquerque, NM, 1992).
39. J.W. Berglund, Analysis Package for the Cuttings and Spalling Calculations (Tasks 5 and 6) of the Performance Assessment Calculation Supporting the Compliance Certification Application (CCA), AP-015 and AP-016, Analysis package, SWCF-A:1.2.07.4.1:PA:CCA:QA, Sandia Central Files WPO #40521 (Sandia National Laboratories, Albuquerque, NM, 1996).
40. A.M. LaVenue, B.S. RamaRao, A Modeling Approach to Address Spatial Variability within the Culebra Dolomite Transmissivity Field, SAND92-7306 (Sandia National Laboratories, Albuquerque, NM, 1992).
41. A.M. LaVenue, AP-018 (Task 3) Analysis of the Generation of Transmissivity Fields for the Culebra Dolomite Compliance Certification Application (CCA), Analysis package, SWCF-A:1.2.07.4.1 :PA:QA, Sandia WIPP Central Files WPO # 40517 (Sandia National Laboratories. Albuquerque, NM, 1996).
42. C. Stockman, A. Shinta, J.W. Garner, Analysis Package for the Salado Transport Calculations (Task 2) of the Performance Assessment Analyses Supporting the Compliance Certification Application (CCA), AP-023, Analysis package, SWCF-A:1.2.07.4.I:PA:QA:CCA, Sandia WIPP Central Files WPO # 40515 (Sandia National Laboratories, Albuquerque. NM. 1996).
43. P.J. Roache. The SECO suite of codes for site performance assessment. High Level Radioactive Waste Management, Proc. Fourth Annual International Conference, Las Vegas, NV, April 26-30, 1993, Vol. 2 (American Nuclear Society. La Grange Park, IL, 1993) pp. 1586-1594.
44. J. Ramsey. M.G. Wallace, Analysis Package for the Culebra Flow and Transport Calculations (Task 3) of the Performance Assessment Calculations Supporting the Compliance Certification Application (CCA), Analysis Plan 019, Analysis package, SWCF-A:WA:1.2.07.4.1:QA, Sandia WIPP Central Files WPO # 40516 (Sandia National Laboratories. Albuquerque, NM, 1996).
45. C.M. Stone, SANTOS - A Two-Dimensional Finite Element Program for the Quasistatic. Large Deformation, Inelastic Response of Solids. SAND90-0543 (Sandia National Laboratories, Albuquerque, NM, 1997).
46. C.M. Stone, Final Disposal Room Structural Response Calculations, SAND97-0795 (Sandia National Laboratories, Albuquerque, NM. 1997).
47. J.C. Helton, H.J. luzzolino, Construction of complementary cumulative distribution functions for comparison with the EPA release limits for radioactive waste disposal. Reliability Eng. & System Safety 40 (1993) 277-293.
48. J.C. Helton, A.W. Shiver, A Monte Carlo procedure for the construction of complementary cumulative distribution functions for comparison with the EPA elease limits for radioactive waste disposal. Risk Analysis 16 (1996) 43-55.
49. J.C. Helton, Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposal. Reliability Eng. & System Safety 42 (1993) 327-367.
50. M.D. McKay, R.J. Beckman, W.J. Conover, A comparison of three methods for selecting values of input variables in the analysis of output from a computer code, Technometrics 21 (1979) 239-245.
51. [51 R.L. Iman, J.C. Helton, The repeatability of uncertainty and sensitivity analyses for complex probabilistic risk assessments. Risk Analysis 11 (1991) 591-606.
52. J.C. Helton, J.D. Johnson, M.D. McKay, A.W. Shiver, J.L. Sprung, Robustness of an uncertainty and sensitivity analysis of early exposure results with the MACCS reactor accident consequence model, Reliability Eng. & System Safety 48 ( 1995) 129-148.
53. R.L, Iman, W.J. Conover. Small sample sensitivity analysis techniques for computer models, with an application to risk assessment. Commun. Slat. A 9 (1980) 1749-1842;
54. rejoinder to Comments, Commun. Stat. A 9 (1980) 1863-1874.
55. M. Stein. Large sample properties of simulations using Latin hypercube sampling, Technometrics 29 (1987) 143-151.
56. A.B. Owen. A central limit theorem for Latin hypercube sampling, J. Roy. Statist. Soc. Ser. B 54 (1992) 541-551.
57. R.L. Iman, J.C. Helton, An investigation of uncertainty and sensitivity analysis techniques for computer models. Risk Analysis 8 (1988) 71-90.
58. R.L. Iman. W.J. Conover, A distribution-free approach to inducing rank correlation among input variables. Commun. Stat.: Simul. & Comput. B 11 (1982) 311-334.
59. R.L. Iman, J.M. Davenport, Rank correlation plots for use with correlated input variables. Commun. Slat.: Simul. & Comput. B 11 (1982) 335-360.
60. R.L. Iman, Statistical methods for including uncertainties associated with the geologic isolation of radioactive waste which allow for a comparison with licensing criteria. Proceedings of the Symposium on Uncertainties Associated with the Regulation of the Geologic Disposal of High Level Radioactive Waste, Gatlinburg, Tennessee, March 9-1.3, 1981, D.C. Kocher, ed., NUREG/CP-0022, CONF-810372 (Oak Ridge National Laboratory, Oak Ridge, TN, 1982) pp. 145-157.
61. J.C. Helton, Probability, conditional probability and complementary cumulative distribution functions in performance assessment for radioactive waste disposal. Reliability Eng. & System Safety 54 ( 1996) 145-163.
62. R.J. MacKinnon, G. Freeze. H.-N. Jow, Summary of EPA-Mandated Performance Assessment Verification Test (Replicate 1) and Comparison with the Compliance Certification Application Calculations, Sandia WIPP Central Files WPO # 46674 (Sandia National Laboratories. Albuquerque, NM. 1997).
63. R.L. Iman, W.J. Conover, The use of the rank transform in regression, Technometrics 21 (1979) 499-509.
64. D.M. Allen, The Prediction Sum of Squares as a Criterion for Selecting Predictor Variables, Report No. 23 (Department of Statistics, University of Kentucky. Lexington, KY, 1971).
65. I.M. Sobol', Sensitivity analysis for nonlinear mathematical models. Math. Model. & Comput. Exp. 1 (1993) 407-414;
66. translation of: l.M. Sobol'. Sensitivity estimates for nonlinear mathematical models, Matematicheskoe Modelirovanie 2 (1990) 112-118 [in Russian].
67. T. Homma, A. Saltelli. Importance measures in global sensitivity analysis of nonlinear models. Reliability Eng. & System Safety 52 (1996) 1-17.
68. A. Saltelli, S. Tarantola, K. Chan, A quantitative model-independent method for global sensitivity analysis of model output, Technometrics (1999). to appear.
69. H.M. Wagner. Global sensitivity analysis. Operations Research 43 ( 1995) 948-969.
70. J.P.C. Kleijnen, J.C. Helton, Statistical Analyses of Scatterplots to Identify Important Factors in Large-Scale Simulations. SAND98-2202 (Sandia National Laboratories, Albuquerque, NM, 1999).
71. J.C. Helton, D.R. Anderson, H.-N. Jow, M.G. Marietta, G. Basabilvazo, Performance assessment in support of the 1996 compliance certification application for the Waste Isolation Pilot Plant, Risk Analysis ( 1999), to appear.