Automated continuous verification for numerical simulation

Geoscientific Model Development

Volumn 4, Issue 2, 2011, Pages 435-449

  Farrell, P E ^a   Piggott, M D ^a   Gorman, G J ^a   Ham, D A ^a   Wilson, C R ^b   Bond, T M ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b International Research Institute for Climate and Society   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; MATHEMATICAL ANALYSIS; NUMERICAL MODEL; SOFTWARE;

EID: 84860505133     PISSN: 1991959X     EISSN: 19919603     Source Type: Journal    
DOI: 10.5194/gmd-4-435-2011     Document Type: Article

References (47)

1. Adrion, W. R., Branstad, M. A., and Cherniavsky, J. C.: Validation, Verification, and Testing of Computer Software, ACM Computing Surveys, 14, 159-192, doi:10.1145/356876.356879, 1982.
2. Babuska, I. and Oden, J. T.: Verification and validation in computational engineering and science: Basic concepts, Comput. Method Appl. M., 193, 4057-4066, doi:10.1016/j.cma.2004.03.002, 2004. (Pubitemid 39142612)
3. Botella, O. and Peyret, R.: Benchmark spectral results on the liddriven cavity flow, Comput. Fluids, 27, 421-433, 1998. (Pubitemid 28393192)
4. Brown, P. P. and Lawler, D. F.: Sphere Drag and Settling Velocity Revisited, J. Environ. Eng.-ASCE, 129, 222-231, doi:10.1061/(ASCE)0733- 9372(2003)129:3(222), 2003. (Pubitemid 36333888)
5. Bruneau, C. H. and Saad, M.: The 2D lid-driven cavity problem revisited, Comput. Fluids, 35, 326-348, 2006. (Pubitemid 41722781)
6. Collins-Sussman, B., Fitzpatrick, B. W., and Pilato, C. M.: Version Control with Subversion, O'Reilly & Associates, available at: http://subversion.apache.org, last access: 16 May 2011, 2004.
7. Davies, T., Cullen, M. J. P., Malcolm, A. J., Mawson, M. H., Staniforth, A., White, A. A., and Wood, N.: A new dynamical core for the Met Office's global and regional modelling of the atmosphere, Q. J. Roy. Meteorol. Soc., 131, 1759-1782, doi:10.1256/qj.04.101, 2005. (Pubitemid 41573492)
8. Deleersnijder, E., Fichefet, T., Hanert, E., Legat, V., Remacle, J.-F., and Frazao, S. S.: Taking up the challenges of multi-scale marine modelling, available at: http://sites-final.uclouvain.be/slim/assets/files/documents/ ProposalWeb 2.pdf, excerpts from a proposal for a Concerted Research Actions (ARC) programme, last access: 16 May 2011, 2010.
9. Easterbrook, S. M. and Johns, T. C.: Engineering the Software for Understanding Climate Change, Comput. Sci. Eng., 11, 65-74, doi:10.1109/MCSE. 2009.193, 2009.
10. Erturk, E., Corke, T. C., and Gokcol, C.: Numerical solutions of 2-D steady incompressible driven cavity ow at high Reynolds numbers, Int. J. Numer. Meth. Fl., 48, 747-774, doi:10.1002/fld.953, 2005. (Pubitemid 40865391)
11. Ford, R., Pain, C. C., Piggott, M. D., Goddard, A. J. H., de Oliveira, C. R. E., and Umpleby, A. P.: A Nonhydrostatic Finite-Element Model for Three-Dimensional Stratified Oceanic Flows, Part II: Model Validation, Month. Weather Rev., 132, 2832-2844, 2004. (Pubitemid 40099010)
12. Fringer, O. B., Gerritsen, M., and Street, R. L.: An unstructuredgrid, finite-volume, nonhydrostatic, parallel coastal ocean simulator, Ocean Model., 14, 139-173, 2006. (Pubitemid 44070678)
13. Giraldo, F. X. and Restelli, M.: A study of spectral element and discontinuous Galerkin methods for the Navier-Stokes equations in nonhydrostatic mesoscale atmospheric modeling: Equation sets and test cases, J. Comput. Phys., 227, 3849-3877, doi:10.1016/j.jcp.2007.12.009, 2008.
14. Graham, S. L., Kessler, P. B., and McKusick, M. K.: gprof: A Call Graph Execution Profiler, in: SIGPLAN Symposium on Compiler Construction, 120-126, doi:10.1145/872726.806987, 1982.
15. Griffies, S. M.: Elements of MOM4p1, available at: http://data1.gfdl. noaa.gov/-arl/pubrel/r/mom4p1/src/mom4p1/doc/guide4p1.pdf, last access: 16 May 2011, 2009.
16. Griffies, S. M., Harrison, M. J., Pacanowski, R. C., and Rosati, A.: A Technical guide to MOM4, available at: http://data1.gfdl. noaa.gov/-arl/pubrel/ o/old/doc/mom4p0 guide.pdf, last access: 16 May 2011, 2004.
17. Haidvogel, D. B. and Beckmann, A.: Numerical Ocean Circulation Modeling, Imperial College Press, River Edge, NJ, USA, 1999.
18. Ham, D. A., Farrell, P. E., Gorman, G. J., Maddison, J. R., Wilson, C. R., Kramer, S. C., Shipton, J., Collins, G. S., Cotter, C. J., and Piggott, M. D.: Spud 1.0: generalising and automating the user interfaces of scientific computer models, Geosci. Model Dev., 2, 33-42, doi:10.5194/gmd-2-33-2009, 2009.
19. Härtel, C., Meiburg, E., and Necker, F.: Analysis and direct numerical simulation of the flow at a gravity-current head, Part I, Flow topology and front speed for slip and no-slip boundaries, J. Fluid Mech., 418, 189-212, 2000.
20. Hecht, M. W., Wingate, B. A., and Kassis, P.: A better, more discriminating test problem for ocean tracer transport, Ocean Model., 2, 1-15, 2000.
21. Hiester, H. R., Piggott, M. D., and Allison, P. A.: The impact of mesh adaptivity on the gravity current front speed in a 2D lock-exchange, Ocean Model., 38, 1-2 , 1-21, doi:10.1016/j.ocemod.2011.01.003, 2011
22. Howden, W. E.: Reliability of the Path Analysis Testing Strategy, IEEE T. Software Eng., SE-2, 208-215, 1976.
23. Jones, E., Oliphant, T., Peterson, P., et al.: SciPy: Open source scientific tools for Python, available at: http://www.scipy.org, last access: 16 May 2011, 2001.
24. Knupp, P., Ober, C. C., and Bond, R. B.: Measuring progress in order-verification within software development projects, Eng. Comput., 23, 271-282, doi:10.1007/s00366-007-0066-x, 2007. (Pubitemid 47611102)
25. Madec, G., Delecluse, P., and Imbard, M.: OPA 8.1 ocean general circulation model reference manual, Paris VI, France, note 11, 1998.
26. Marshall, J., Adcroft, A., Hill, C., Perelman, L., and Heisey, C.: A finite-volume, incompressible Navier Stokes model for studies of the ocean on parallel computers, J. Geophys. Res., 102, 5753-5766, doi:10.1029/96JC02775, 1997.
27. NEMO Consortium: The Nemo Consortium Agreement, availabe at: http://www.nemo-ocean.eu/, last access: 16 May 2011, 2008.
28. Oberkampf, W. L. and Atrucano, T. G.: Verification and Validation in Computational Fluid Dynamics, Tech. Rep. SAND 2002-0529, Sandia National Laboratories, Albuquerque, NM, 2002.
29. Oberkampf, W. L., Sindir, M. M., and Conlisk, A. T.: Guide for the Verification and Validation of Computational Fluid Dynamics Simulations, Tech. Rep. G-077-98, American Institute of Aeronautics and Astronautics, 1998.
30. Oreskes, N., Shrader-Frechette, K., and Belitz, K.: Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences, Science, 263, 641-646, doi:10.1126/science.263.5147.641, 1994.
31. Pain, C. C., Umpleby, A. P., de Oliveira, C. R. E., and Goddard, A. J. H.: Tetrahedral mesh optimisation and adaptivity for steadystate and transient finite element calculations, Comput. Method Appl. M., 190, 3771-3796, doi:10.1016/S0045-7825(00)00294-2, 2001.
32. Pain, C. C., Piggott, M. D., Goddard, A. J. H., Fang, F., Gorman, G. J., Marshall, D. P., Eaton, M. D., Power, P.W., and de Oliveira, C. R. E.: Three-dimensional unstructured mesh ocean modelling, Ocean Model., 10, 5-33, doi:10.1016/j.ocemod.2004.07.005, 2005. (Pubitemid 40335010)
33. Panton, R. L.: Incompressible Flow, Wiley-Interscience, 1996.
34. Piggott, M. D., Gorman, G. J., Pain, C. C., Allison, P. A., Candy, A. S., Martin, B. T., and Wells, M. R.: A new computational framework for multi-scale ocean modelling based on adapting unstructured meshes, Int. J. Numer. Meth. Fl., 56, 1003-1015, doi:10.1002/fld.1663, 2008. (Pubitemid 351385436)
35. Piggott, M. D., Farrell, P. E., Wilson, C. R., Gorman, G. J., and Pain, C. C.: Anisotropic mesh adaptivity for multi-scale ocean modelling, Philos. T. Roy. Soc. A, 367, 4591-4611, doi:10.1098/rsta.2009.0155, 2009.
36. Popper, K. R.: The Logic of Scientific Discovery, Routledge, London, 1959.
37. Roache, P. J.: Code Verification by the Method of Manufactured Solutions, J. Fluid. Eng. T. ASME, 124, 4-10, doi:10.1115/1.1436090, 2002. (Pubitemid 40005659)
38. Salari, K. and Knupp, P.: Code Verification by the Method of Manufactured Solutions, Tech. Rep. SAND2000-1444, Sandia National Laboratories, Albuquerque, NM, 2000.
39. Schroeder, W., Martin, K., and Lorensen, B.: The Visualization Toolkit: An Object-Oriented Approach to 3D Graphics, KitWare, Inc., 4th Edn., available at: http://www.vtk.org, last access: 16 May 2011, 2006.
40. Simpson, J. E.: Gravity Currents in the Environment and the Laboratory, Cambridge University Press, 2nd Edn., 1999.
41. Song, Y. and Haidvogel, D. B.: A Semi-implicit Ocean Circulation Model Using a Generalized Topography-Following Coordinate System, J. Comput. Phys., 115, 228-244, doi:10.1006/jcph.1994.1189, 1994. (Pubitemid 124012851)
42. Stein, W., Abbott, T., Abshoff, M., et al.: SAGE Mathematics Software, The SAGE Group, available at: http://www.sagemath.org, last access: 16 May 2011, 2007.
43. Stern, F.,Wilson, R. V., Coleman, H.W., and Paterson, E. G.: Comprehensive approach to verification and validation of CFD simulations, 1: Methodology and procedures, J. Fluid. Eng. T. ASME, 123, 793-802, 2001. (Pubitemid 33715601)
44. Stommel, H.: The westward intensification of wind-driven ocean currents, Transactions of the American Geophysical Union, 29, 202-206, 1948.
45. Trefethen, L. N.: Numerical Analysis, in: Princeton Companion to Mathematics, edited by: Gowers, T., Princeton University Press, section IV. 21, 604-615, 2008.
46. White, L., Deleersnijder, E., and Legat, V.: A threedimensional unstructured mesh finite element shallow-water model, with application to the flows around an island and in a wind-driven, elongated basin, Ocean Model., 22, 26-47, doi:10.1016/j.ocemod.2008.01.001, 2008.
47. Williamson, D. L., Drake, J., Hack, J., Akob, R., and Swartzrauber, P. N.: A standard test set for numerical approximations to the shallow water equations in spherical geometry, J. Comput. Phys., 102, 211-224, 1992.