An automatic and effective parameter optimization method for model tuning

Geoscientific Model Development

Volumn 8, Issue 11, 2015, Pages 3579-3591

  Zhang, T ^a   Li, L ^b   Lin, Y ^a   Xue, W ^a   Xie, F ^b   Xu, H ^a   Huang, X ^a  

^a TSINGHUA UNIVERSITY   (China)

^b INSTITUTE OF ATMOSPHERIC PHYSICS   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CLIMATE MODELING; CONVECTIVE CLOUD; GENERAL CIRCULATION MODEL; MODEL TEST; OPTIMIZATION; PARAMETERIZATION; PERFORMANCE ASSESSMENT; SOFTWARE;

EID: 84947261648     PISSN: 1991959X     EISSN: 19919603     Source Type: Journal    
DOI: 10.5194/gmd-8-3579-2015     Document Type: Article

References (61)

1. Adler, R. F., Huffman, G. J., Chang, A., Ferraro, R., Xie, P.-P., Janowiak, J., Rudolf, B., Schneider, U., Curtis, S., Bolvin, D., Gruber, A., Susskind, J., Arkin, P., and Nelkin, E.: The version-global precipitation climatology project (GPCP) monthly precipitation analysis (1979-present), J. Hydrometeorol., 4, 1147-1167, 2003.
2. Aksoy, A., Zhang, F., and Nielsen-Gammon, J.W.: Ensemble-based simultaneous state and parameter estimation with MM5, Geophys. Res. Lett., 33, L12801, doi:10.1029/2006GL026186, 2006.
3. Allen, M. R., Stott, P. A., Mitchell, J. F., Schnur, R., and Delworth, T. L.: Quantifying the uncertainty in forecasts of anthropogenic climate change, Nature, 407, 617-620, 2000.
4. Arulampalam, M., Maskell, S., Gordon, N., and Clapp, T.: A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking, Signal Processing, IEEE T., 50, 174-188, 2002.
5. Bardenet, R., Brendel, M., Kégl, B., and Sebag, M.: Collaborative hyperparameter tuning, in: Proceedings of the 30th International Conference on Machine Learning (ICML-13), 16-21 June 2013, Atlanta, Georgia, USA, 199-207, 2013.
6. Barkstrom, B. R.: The earth radiation budget experiment (ERBE), B. Am. Meteorol. Soc., 65, 1170-1185, 1984.
7. Beven, K. and Binley, A.: The future of distributed models: model calibration and uncertainty prediction, Hydrol. Process., 6, 279-298, 1992.
8. Cameron, D., Beven, K. J., Tawn, J., Blazkova, S., and Naden, P.: Flood frequency estimation by continuous simulation for a gauged upland catchment (with uncertainty), J. Hydrol., 219, 169-187, 1999.
9. Campolongo, F., Cariboni, J., and Saltelli, A.: An effective screening design for sensitivity analysis of large models, Environ. Modell. Softw., 22, 1509-1518, 2007.
10. Chen, T.-Y., Wei, W.-J., and Tsai, J.-C.: Optimum design of headstocks of precision lathes, Int. J. Mach. Tool. Manu., 39, 1961-1977, 1999.
11. Eldred, M., Agarwal, H., Perez, V., Wojtkiewicz Jr., S., and Renaud, J.: Investigation of reliability method formulations in DAKOTA/UQ, Struct. Infrastruct. E., 3, 199-213, 2007.
12. Elkinton, C. N., Manwell, J. F., and McGowan, J. G.: Algorithms for offshore wind farm layout optimization, Wind Engineering, 32, 67-84, 2008.
13. Evensen, G.: The ensemble Kalman filter: Theoretical formulation and practical implementation, Ocean Dynam., 53, 343-367, 2003.
14. Gan, Y., Duan, Q., Gong, W., Tong, C., Sun, Y., Chu, W., Ye, A., Miao, C., and Di, Z.: A comprehensive evaluation of various sensitivity analysis methods: a case study with a hydrological model, Environ. Modell. Softw., 51, 269-285, 2014.
15. Gilks, W. R.: Markov Chain Monte Carloin Practice, Chapman and Hall/CRC, London, UK, 1995.
16. Gill, M. K., Kaheil, Y. H., Khalil, A., McKee, M., and Bastidas, L.: Multiobjective particle swarm optimization for parameter estimation in hydrology, Water Resour. Res., 42, W07417, doi:10.1029/2005WR004528, 2006.
17. Gleckler, P. J., Taylor, K. E., and Doutriaux, C.: Performance metrics for climate models, J. Geophys. Res.-Atmos., 113, D06104, doi:10.1029/2007JD008972, 2008.
18. Golaz, J., Salzmann, M., Donner, L. J., Horowitz, L. W., Ming, Y., and Zhao, M.: Sensitivity of the aerosol indirect effect to subgrid variability in the cloud parameterization of the GFDL atmosphere general circulation model AM3, J. Climate, 24, 3145-3160, 2011.
19. Goldberg, D. E., Korb, B., and Deb, K.: Messy genetic algorithms: motivation, analysis, and first results, Complex systems, 3, 493-530, 1989.
20. Grell, G. A., Dudhia, J., and Stauffer, D.: A description of the fifthgeneration Penn State/NCAR Mesoscale Model (MM5), NCAR Tech. Note NCAR/TN-3981STR, 122 pp., 1994.
21. Hack, J. J., Boville, B., Kiehl, J., Rasch, P., and Williamson, D.: Climate statistics from the National Center for Atmospheric Research Community Climate Model CCM2, J. Geophys. Res.- Atmos., 99, 20785-20813, 1994.
22. Hader, R. and Park, S. H.: Slope-rotatable central composite designs, Technometrics, 20, 413-417, 1978.
23. Hakkarainen, J., Ilin, A., Solonen, A., Laine, M., Haario, H., Tamminen, J., Oja, E., and Järvinen, H.: On closure parameter estimation in chaotic systems, Nonlin. Processes Geophys., 19, 127-143, doi:10.5194/npg-19-127-2012, 2012.
24. Hararuk, O., Xia, J., and Luo, Y.: Evaluation and improvement of a global land model against soil carbon data using a Bayesian Markov chain Monte Carlo method, J. Geophys. Res.-Biogeo., 119, 403-417, 2014.
25. Hegerty, B., Hung, C.-C., and Kasprak, K.: A comparative study on differential evolution and genetic algorithms for some combinatorial problems, in: Proceedings of 8th Mexican International Conference on Artificial Intelligence, 9-13 November 2009, Guanajuato, Mexico, 88, 2009.
26. Jackson, C., Sen, M. K., and Stoffa, P. L.: An efficient stochastic Bayesian approach to optimal parameter and uncertainty estimation for climate model predictions, J. Climate, 17, 2828-2841, 2004.
27. Jackson, C. S., Sen, M. K., Huerta, G., Deng, Y., and Bowman, K. P.: Error reduction and convergence in climate prediction, J. Climate, 21, 6698-6709, 2008.
28. Jakumeit, J., Herdy, M., and Nitsche, M.: Parameter optimization of the sheet metal forming process using an iterative parallel Kriging algorithm, Struct. Multidiscip. O., 29, 498-507, 2005.
29. Kennedy, J.: Particle swarm optimization, in: Encyclopedia of Machine Learning, Springer, New York, USA, 760-766, 2010.
30. Li, L., Wang, B., Dong, L., Liu, L., Shen, S., Hu, N., Sun, W., Wang, Y., Huang, W., Shi, X., Pu, Y., and Yang, G.: Evaluation of grid-point atmospheric model of IAP LASG version 2 (GAMIL2), Adv. Atmos. Sci., 30, 855-867, 2013.
31. Li, J., Duan, Q. Y., Gong, W., Ye, A., Dai, Y., Miao, C., Di, Z., Tong, C., and Sun, Y.: Assessing parameter importance of the Common Land Model based on qualitative and quantitative sensitivity analysis, Hydrol. Earth Syst. Sci., 17, 3279-3293, doi:10.5194/hess-17-3279-2013, 2013.
32. Liang, F., Cheng, Y., and Lin, G.: Simulated stochastic approximation annealing for global optimization with a square-root cooling schedule, J. Am. Stat. Assoc., 109, 847-863, 2013.
33. Lin, Y. L., Zhao, M., Ming, Y., Golaz, J., Donner, L. J., Klein, S. A., Ramaswamy, V., and Xie, S.: Precipitation partitioning, tropical clouds, and intraseasonal variability in GFDL AM2, J. Climate, 26, 5453-5466, 2013.
34. McKay, M. D., Beckman, R. J., and Conover, W. J.: Comparison of three methods for selecting values of input variables in the analysis of output from a computer code, Technometrics, 21, 239245, 1979.
35. Morris, M. D.: Factorial sampling plans for preliminary computational experiments, Technometrics, 33, 161-174, 1991.
36. Morrison, H. and Gettelman, A.: A new two-moment bulk stratiform cloud microphysics scheme in the Community Atmosphere Model, version 3 (CAM3). Part I: Description and numerical tests, J. Climate, 21, 3642-3659, 2008.
37. Murphy, J. M., Sexton, D. M., Barnett, D. N., Jones, G. S., Webb, M. J., Collins, M., and Stainforth, D. A.: Quantification of modelling uncertainties in a large ensemble of climate change simulations, Nature, 430, 768-772, 2004.
38. Nelder, J. A. and Mead, R.: A simplex method for function minimization, Computer J., 7, 308-313, 1965.
39. Poterjoy, J., Zhang, F., andWeng, Y.: The effects of sampling errors on the EnKF assimilation of inner-core hurricane observations, Mon. Weather Rev., 142, 1609-1630, 2014.
40. Press, W., Teukolsky, S., Vetterling, W., and Flannery, B.: Numerical Recipes in Fortran, Cambridge Univ. Press, Cambridge 70pp., 1992.
41. Raktoe, B. L., Hedayat, A., and Federer, W. T.: Factorial Designs, John Wiley & Sons, Hoboken, New Jersey, USA, 1981.
42. Reichler, T. and Kim, J.: How well do coupled models simulate todays climate?, B. Am. Meteorol. Soc., 89, 303-311, 2008.
43. Santitissadeekorn, N. and Jones, C.: Two-stage filtering for joint state-parameter estimation, Mon.Weather Rev., 143, 2028-2042, doi:10.1175/MWR-D-14-00176.1, 2015.
44. Severijns, C. and Hazeleger, W.: Optimizing parameters in an atmospheric general circulation model, J. Climate, 18, 3527-3535, 2005.
45. Shi, Y. and Eberhart, R. C.: Empirical study of particle swarm optimization, in: Proceedings of the 1999 Congress on Evolutionary Computation, CEC 99, Vol. 3, IEEE, 6-9 July 1999,Washington, DC, USA, 1945-1950, 1999.
46. Simmons, A., Uppala, S., Dee, D., and Kobayashi, S.: ERA-interim: new ECMWF reanalysis products from 1989 onwards, ECMWF Newsl., 110, 25-35, 2007.
47. Sobol, I. M.: Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates, Math. Comput. Simulat., 55, 271-280, 2001.
48. Storn, R. and Price, K.: Differential Evolution -a Simple and Efficient Adaptive Scheme for Global Optimization over Continuous Spaces, ICSI Berkeley, Berkeley, California, USA, 1995.
49. Sun, Y., Hou, Z., Huang, M., Tian, F., and Ruby Leung, L.: Inverse modeling of hydrologic parameters using surface flux and runoff observations in the Community Land Model, Hydrol. Earth Syst. Sci., 17, 4995-5011, doi:10.5194/hess-17-4995-2013, 2013.
50. Taylor, K. E.: Summarizing multiple aspects of model performance in a single diagram, J. Geophys. Res.-Atmos., 106, 7183-7192, 2001.
51. Tong, C.: PSUADE Users Manual, Lawrence Livermore National Laboratory (LLNL), Livermore, CA, 109 pp., 2005.
52. Van Laarhoven, P. J. and Aarts, E. H.: Simulated Annealing, Springer, Dordrecht, Netherlands, 1987.
53. Wang, B., Wan, H., Ji, Z., Zhang, X., Yu, R., Yu, Y., and Liu, H.: Design of a new dynamical core for global atmospheric models based on some efficient numerical methods, S. China Ser. A, 47, 4-21, 2004.
54. Warren, S. G. and Schneider, S. H.: Seasonal simulation as a test for uncertainties in the parameterizations of a Budyko-Sellers zonal climate model, J. Atmos. Sci., 36, 1377-1391, 1979.
55. Williams, P. D.: Modelling climate change: the role of unresolved processes, Philos. T. R. Soc. A, 363, 2931-2946, 2005.
56. Xu, K.-M. and Krueger, S. K.: Evaluation of cloudiness parameterizations using a cumulus ensemble model, Mon. Weather Rev., 119, 342-367, 1991.
57. Yang, B., Qian, Y., Lin, G., Leung, L. R., Rasch, P. J., Zhang, G. J., McFarlane, S. A., Zhao, C., Zhang, Y., Wang, H., Wang, M., and Liu, X.: Uncertainty quantification and parameter tuning in the CAM5 Zhang-McFarlane convection scheme and impact of improved convection on the global circulation and climate, J. Geophys. Res.-Atmos., 118, 395-415, 2013.
58. Yang, B., Zhang, Y., Qian, Y., Huang, A., and Yan, H.: Calibration of a convective parameterization scheme in the WRF model and its impact on the simulation of East Asian summer monsoon precipitation, Clim. Dynam., 1, 1-24, 2014.
59. Yu, R.: A two-step shape-preserving advection scheme, Adv. Atmos. Sci., 11, 479-490, 1994.
60. Zhang, G. J. and Mu, M.: Effects of modifications to the Zhang- McFarlane convection parameterization on the simulation of the tropical precipitation in the National Center for Atmospheric Research Community Climate Model, version 3, J. Geophys. Res.- Atmos., 110, D09109, doi:10.1029/2004JD005617, 2005.
61. Zhang, M., Lin, W., Bretherton, C. S., Hack, J. J., and Rasch, P. J.: A modified formulation of fractional stratiform condensation rate in the NCAR Community Atmospheric Model (CAM2), J. Geophys. Res.-Atmos., 108, 4035, doi:10.1029/2002jd002523, 2003.