On the problem of model validation for predictive exposure assessments

Stochastic Hydrology and Hydraulics

Volumn 11, Issue 3, 1997, Pages 229-254

  Beck, M B ^a   Ravetz, J R ^b   Mulkey, L A ^c   Barnwell, T O ^c  

^a UNIVERSITY OF GEORGIA   (United States)

^b Research Methods Consultancy   (United Kingdom)

^c U S ENVIRONMENTAL PROTECTION AGENCY   (United States)

Author keywords

Analysis of uncertainty; Model calibration; Model validation; Model verification; Quality assurance; System identification

Indexed keywords

EID: 0000966625     PISSN: 09311955     EISSN: None     Source Type: Journal    
DOI: 10.1007/BF02427917     Document Type: Article

References (48)

1. Ababou, R.; Sagar, B.; Wittmeyer, G. 1992: Testing procedures for spatially distributed flow models, Adv. Water Resour. 15(3), 181-198
2. Akaike, H. 1974: A new look at statistical model identification, IEEE Trans on Automatic Control AC-19, 716-722
3. American Society for Testing and Materials. 1984: Standard practice for evaluating environmental fate models of chemicals, Standard E 978-84, American Society for Testing and Materials, Philadelphia, Pennsylvania
4. Beck, M.B. 1987: Water quality modeling: a review of the analysis of uncertainty, Water Resour. Res. 23(8), 1393-1442
5. Beck, M.B. 1991: Forecasting environmental change, J. Forecasting 10(1/2), 3-19
6. Beck, M.B. 1994: Understanding uncertain environmental systems, in Predictability and Nonlinear Modelling in Natural Sciences and Economics (J. Grasman and G. van Straten, eds), Kluwer, Dordrecht, pp 294-311
7. Beck, M.B.; Halfon E. 1991: Uncertainty, identifiability and the propagation of prediction errors: a case study of Lake Ontario, J. Forecasting 10(1/2), 135-161
8. Beck, M.B.; Chen, J. 1997: Process models: validation and structural change, in Assessment of Environmental Impact (Proceedings of a Workshop), International Centre for Mathematical Sciences, Edinburgh, UK (in preparation)
9. Burns, L.A. 1983: Validation of exposure models: the role of conceptual verification, sensitivity analysis, and alternative hypotheses, in Proceedings 6th Symposium, Aquatic Toxicology and Hazard Assessment (W E Bishop, R D Cardwell, and B B Heidolph, eds), American Society for Testing and Materials, Philadelphia, ASTM. Special Technical Publication 802, pp 255-281
10. Burns, L.A.; Barber, M.C.; Bird, S.L.; Mayer, F.L.; Suárez, A. 1990: PIRANHA: Pesticide and Industrial Chemical Risk Analysis and Hazard Assessment, Internal Report, Environmental Research Laboratory, United States Environmental Protection Agency, Athens, Georgia
11. Cale, W.G.Jr.; O'Neill, R.V.; Shugart, H.H. 1983: Development and application of desirable ecological models, Ecological Modelling 18, 171-186
12. Caswell, H. 1976: The validation problem, in Systems Analysis and Simulation in Ecology (B C Patten, ed), Academic, New York, Vol IV, pp 313-325
13. Chen, J.; Beck, M.B. 1997: Discriminating power of the EPA's Multi-Media Model in performing a screening task, Technical Report, United States Environmental Protection Agency, Athens, Georgia (in review)
14. Costanza, R.; Sklar, F.H. 1975: Mathematical models of freshwater wetlands and shallow water ecosystems: an articulated review, in Proceedings SCOPE International Conference on Freshwater Wetlands and Shallow Water Bodies
15. Cox, D.C.; Baybutt, P. 1981: Methods of uncertainty analysis: a comparative survey, Risk Analysis 1(4), 251-258
16. Davis, P.A.; Price, L.L.; Wahi, K.K.; Goodrich, M.T.; Gallegos, D.P.; Bonano E.J.; Guzowksi, R.V. 1990: Components of an overall performance assessment methodology, Report NUREG/CR-5256, SAND88-3020, Sandia National Laboratories, Albuquerque, New Mexico
17. Donigian A.S.; Rao, P.S.C. 1990: Selection, application, and validation of environmental models, in Proceedings International Symposium on Water Quality Modeling of Agricultural Non-Point Sources, (D G DeCoursey, ed), Report ARS-81, Agricultural Research Service, United States Department of Agriculture, pp 577-600
18. Environmental Protection Agency. 1991: Guidelines for Exposure Assessment, Science Advisory Board Draft Final, August
19. Funtowicz, S.O.; Ravetz, J. 1990: Uncertainty and Quality in Science for Policy, Kluwer, Dordrecht
20. Hassanizadeh, S.M.; Carrera, J. 1992: Editorial: special issue on validation of geo-hydrological models, Adv. Water Resour. 15(1), 1-3
21. Hermann, C.F. 1967: Validation problems in games and simulations with special reference to models of international politics, Behavioral Science 12, 216-231
22. Hornberger, G.M.; Spear, R.C. 1980: Eutrophication in Peel Inlet, I. Problem-defining behaviour and a mathematical model for the phosphorus scenario, Water Res. 14, 29-42
23. Irnan, R.L.; Helton, J.C. 1988: An investigation of uncertainty and sensitivity analysis techniques for computer models, Risk Analysis 8(1), 71-90
24. Konikow, L.F.; Bredehoeft, J.D. 1992: Ground-water models cannot be validated, Adv. Water Resour. 15(1), 75-83
25. Luis, S.J.; McLaughlin, D.B. 1992: A stochastic approach to model validation, Adv. Water Resour. 15(1), 15-32
26. MacFarlane, A.G.J. 1990: Interactive computing: a revolutionary medium for teaching and design, Computing and Control Engineering Journal 1(4), 149-158
27. Mankin, J.B.; O'Neill, R.V.; Shugart, H.H.; Rust, B.W. 1977: The importance of validation in ecosystem analysis, in New Directions in the Analysis of Ecological Systems, (G S Innis, ed), Simulation Council, La Jolla, California, Proceedings Series 5(1), pp 63-72
28. Mihram, G.A. 1973: Some practical aspects of the verification and validation of simulation models, Operations Research Quarterly 23, 17-29
29. Miller, D,R.; Butler, G.; Bramall, C. 1976: Validation of ecological system models, J. Environmental Management 4, 383-401
30. Morion, A. 1993: Mathematical models: questions of trustworthiness, British J. Phil of Science 44, 659-674
31. National Acid Precipitation Assessment Program (NAPAP). 1990: Evaluation of regional acidic deposition models and selected applications of RADM, Acidic Deposition: State of Science and Technology, Vol I, Report 5, The National Acid Precipitation Assessment Program, Washington, DC
32. National Research Council. 1990: Ground Water Models: Scientific and Regulatory Applications, Water Science and Technology Board, United States National Research Council, National Academy Press, Washington DC
33. Oreskes, N.; Shrader-Frechette, K.; Belitz, K. 1994: Verification, validation, and confirmation of numerical models in the earth sciences, Science 263, 641-646
34. Parrish, R.S.; Smith, C.N. 1990: A method for testing whether model predictions fall within a prescribed factor of true values, with an application to pesticide leaching, Ecological Modelling 51, 59-72
35. Popper, K.R. 1959: The Logic of Scientific Discovery, Harper, New York
36. Popper, K.R. 1963: Conjectures and Refutations: The Growth of Scientific Knowledge, Harper, New York
37. Reckhow, K.H.; Chapra, S.C. 1983: Confirmation of water quality models, Ecological Modelling 20, 113-133
38. Reckhow, K.H.; Clements, J.T.; Dodd, R.C. 1990: Statistical evaluation of mechanistic water-quality models, J. Environmental Engineering, Proc American Society of Civil Engineers, 116(2), 250-268.
39. Scavia D. 1980: An ecological model of Lake Ontario, Ecological Modelling 8, 49-78
40. Spear, R.C.; Hornberger, G.M. 1980: Eutrophication in Peel Inlet, II. Identification of critical uncertainties via generalised sensitivity analysis, Water Res. 14, 43-49
41. United States Environmental Protection Agency. 1989: Resolution on Use of Mathematical Models by EPA for Regulatory Assessment and Decision-Making, Report, Environmental Engineering Committee, Science Advisory Board, United States Environmental Protection Agency, Washington DC
42. Usunoff, E.; Carrera, J.; Mousavi, S.F. 1992: An approach to the design of experiments for discriminating among alternative conceptual models, Adv. Water Resour. 15(3), 199-214
43. Van Straten, G.; Keesman, K.J. 1991: Uncertainty propagation and speculation in projective forecasts of environmental change: a lake-eutrophication example, J. Forecasting 10(1/2), 163-190
44. Varis, O. 1995: Belief networks for modelling and assessment of environmental change, Environmetrics 6, 439-444
45. Versar Inc. 1988: Current and suggested practices in the validation of exposure assessment models, Report, Office of Health and Environmental Assessment, United States Environmental Protection Agency, Washington DC
46. Young, P.C. 1978: General theory of modelling badly defined systems, in Modelling, Identification and Control in Environmental Systems, (G.C. Vansteenkiste, ed), North-Holland, Amsterdam, pp 103-135
47. Young, P.C.; Hornberger, G.M.; Spear, R.C. 1978: Modelling badly defined systems - Some further thoughts, in Proceedings SIMSIG Simulation Conference, Australian National University, Canberra, 24-32
48. Zimmerman, D.A.; Wahi, K.K.; Gutjahr, A.L.; Davis, P.A. 1990: A review of techniques for propagating data and parameter uncertainties in high-level radioactive waste repository performance assessment models, Report NUREG/CR-5393, SAND89-1432, Sandia National Laboratories, Albuquerque, New Mexico