A fully multiple-criteria implementation of the Sobol' method for parameter sensitivity analysis

Journal of Geophysical Research Atmospheres

Volumn 117, Issue 7, 2012, Pages

  Rosolem, Rafael ^a   Gupta, Hoshin V ^a   Shuttleworth, W James ^a   Zeng, Xubin ^a   De Gonçalves, Luis Gustavo Gonçalves ^b  

^a UNIVERSITY OF ARIZONA   (United States)

^b INSTITUTO NACIONAL DE PESQUISAS ESPACIAIS   (Brazil)

Author keywords

[No Author keywords available]

Indexed keywords

CARBON; GEOLOGIC MODELS; HEAT FLUX; PARAMETER ESTIMATION; PHYSIOLOGY; SENSITIVITY ANALYSIS; SOILS; SURFACE MEASUREMENT; UNCERTAINTY ANALYSIS;

AMAZONIA; CARBON FLUXES; DEFAULT VALUES; FIELD CAMPAIGN; FLUX TOWERS; LAND SURFACE MODELS; METRICS OF PERFORMANCE; MODEL CALIBRATION; MODEL COMPONENTS; MODEL EVALUATION; MODEL PERFORMANCE; MODEL UNCERTAINTIES; MORPHOLOGICAL PROPERTIES; MULTI-OUTPUT; PARAMETER SENSITIVITIES; PHYSIOLOGICAL PROPERTIES; SENSIBLE HEAT FLUX; SIMILAR MODELS; SOIL PROPERTY; SOIL RESPIRATION; STRUCTURAL CHARACTERISTICS; SUBMODELS; VARIANCE-BASED SENSITIVITY ANALYSIS;

PHYSIOLOGICAL MODELS;

CALIBRATION; CARBON FLUX; ENERGY FLUX; LATENT HEAT FLUX; MODEL VALIDATION; PHYSIOLOGY; SENSIBLE HEAT FLUX; SENSITIVITY ANALYSIS; UNCERTAINTY ANALYSIS; VARIANCE ANALYSIS;

BRAZIL;

EID: 84859704416     PISSN: 01480227     EISSN: None     Source Type: Journal    
DOI: 10.1029/2011JD016355     Document Type: Article

References (77)

1. Araújo, A. C., et al. (2002), Comparative measurements of carbon dioxide fluxes from two nearby towers in a central Amazonian rainforest: The Manaus LBA site, J. Geophys. Res., 107(D20), 8090, doi:10.1029/2001JD000676.
2. Avissar, R., and C. A. Nobre (2002), Preface to special issue on the Large- Scale Biosphere-Atmosphere Experiment in Amazonia (LBA), J. Geophys. Res., 107(D20), 8034, doi:10.1029/2002JD002507.
3. Bastidas, L. A., H. V. Gupta, S. Sorooshian, W. J. Shuttleworth, and Z. L. Yang (1999), Sensitivity analysis of a land surface scheme using multicriteria methods, J. Geophys. Res., 104(D16), 19,481-19,490, doi:10.1029/1999JD900155.
4. Bastidas, L. A., T. S. Hogue, S. Sorooshian, H. V. Gupta, and W. J. Shuttleworth (2006), Parameter sensitivity analysis for different complexity land surface models using multicriteria methods, J. Geophys. Res., 111, D20101, doi:10.1029/2005JD006377. (Pubitemid 44941261)
5. Betts, R. A., P. M. Cox, M. Collins, P. P. Harris, C. Huntingford, and C. D. Jones (2004), The role of ecosystem-atmosphere interactions in simulated Amazonian precipitation decrease and forest dieback under global climate warming, Theor. Appl. Climatol., 78(1-3), 157-175. (Pubitemid 38865530)
6. Borma, L. S., et al. (2009), Atmosphere and hydrological controls of the evapotranspiration over a floodplain forest in the Bananal Island region, Amazonia, J. Geophys. Res., 114, G01003, doi:10.1029/2007JG000641.
7. Brubaker, K. L., D. Entekhabi, and P. S. Eagleson (1993), Estimation of continental precipitation recycling, J. Clim., 6(6), 1077-1089, doi:10.1175/1520-0442(1993)0062.0.CO;2. (Pubitemid 24397342)
8. Campolongo, F., A. Saltelli, and S. Tarantola (2000), Sensitivity analysis as an ingredient of modeling, Stat. Sci., 15(4), 377-395, doi:10.1214/ss/1009213004.
9. Cox, P. M., R. A. Betts, C. D. Jones, S. A. Spall, and I. J. Totterdell (2000), Acceleration of global warming due to carbon-cycle feedbacks in a coupled climate model, Nature, 408(6809), 184-187, doi:10.1038/35041539.
10. Dai, Y. J., et al. (2003), The Common Land Model, Bull. Am. Meteorol. Soc., 84(8), 1013-1023, doi:10.1175/BAMS-84-8-1013.
11. da Rocha, H. R., H. C. Freitas, R. Rosolem, R. I. N. Juarez, R. N. Tannus, M. V. Ligo, O. M. R. Cabral, and M. A. F. Silva Dias (2002), Measurements of CO2 exchange over a woodland savanna (cerrado sensu stricto) in southeast Brasil, Biota Neotropica, 2(1), 1-11. [Available at http://www.biotaneotropica.org.br/v2n1/pt/fullpaper?bn01702012002+en.]
12. da Rocha, H. R., et al. (2009), Patterns of water and heat flux across a biome gradient from tropical forest to savanna in Brazil, J. Geophys. Res., 114, G00B12, doi:10.1029/2007JG000640.
13. Demarty, J., C. Ottle, I. Braud, A. Olioso, J. P. Frangi, L. A. Bastidas, and H. V. Gupta (2004), Using a multiobjective approach to retrieve information on surface properties used in a SVAT model, J. Hydrol., 287(1-4), 214-236, doi:10.1016/j.jhydrol.2003.10.003. (Pubitemid 38300329)
14. Eltahir, E. A. B., and R. L. Bras (1994), Precipitation recycling in the Amazon basin, Q. J. R. Meteorol. Soc., 120(518), 861-880, doi:10.1002/qj. 49712051806.
15. Fisher, R. A. (1915), Frequency distribution of the values of the correlation coefficient in samples of an indefinitely large population, Biometrika, 10(4), 507-521.
16. Fisher, R. A. (1921), On the "probable error" of a coefficient of correlation deduced from a small sample, Metron, 1, 3-32.
17. Frey, H. C. (2002), Guest editorial: Introduction to special section on sensitivity analysis and summary of NCSU/USDA Workshop on Sensitivity Analysis, Risk Anal., 22, 539-545, doi:10.1111/0272-4332.00037. (Pubitemid 34655121)
18. Frey, H. C., and S. R. Patil (2002), Identification and review of sensitivity analysis methods, Risk Anal., 22(3), 553-578, doi:10.1111/0272-4332. 00039. (Pubitemid 34655123)
19. Goldberg, D. E. (1989), Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley, Reading, Mass.
20. Gupta, H. V., S. Sorooshian, and P. O. Yapo (1998), Toward improved calibration of hydrologic models: Multiple and noncommensurable measures of information, Water Resour. Res., 34(4), 751-763, doi:10.1029/97WR03495. (Pubitemid 28159454)
21. Hall, J. W., S. Tarantola, P. D. Bates, and M. S. Horritt (2005), Distributed sensitivity analysis of flood inundation model calibration, J. Hydraul. Eng., 131(2), 117-126, doi:10.1061/(ASCE)0733-9429(2005)131:2(117). (Pubitemid 40191047)
22. Hornberger, G. M., and R. C. Spear (1981), An approach to the preliminary analysis of environmental systems, J. Environ. Manage., 12(1), 7-18.
23. Houghton, R. A., K. T. Lawrence, J. L. Hackler, and S. Brown (2001), The spatial distribution of forest biomass in the Brazilian Amazon: A comparison of estimates, Global Change Biol., 7(7), 731-746, doi:10.1046/j.1365-2486.2001. 00426.x. (Pubitemid 32997081)
24. Hutyra, L. R., W. Munger, S. R. Saleska, E. Gottlieb, B. C. Daube, A. L. Dunn, D. F. Amaral, P. B. de Camargo, and S. C. Wofsy (2007), Seasonal controls on the exchange of carbon and water in an Amazonian rain forest, J. Geophys. Res., 112, G03008, doi:10.1029/2006JG000365. (Pubitemid 350120709)
25. Hutyra, L. R., J. W. Munger, E. Hammond-Pyle, S. R. Saleska, N. Restrepo- Coupe, B. C. Daube, P. B. de Camargo, and S. C. Wofsy (2008), Resolving systematic errors in estimates of net ecosystem exchange of CO2 and ecosystem respiration in a tropical forest biome, Agric. For. Meteorol., 148, 1266-1279, doi:10.1016/j.agrformet.2008.03.007.
26. Jolly, W. M., R. Nemani, and S. W. Running (2005), A generalized, bioclimatic index to predict foliar phenology in response to climate, Global Change Biol., 11, 619-632, doi:10.1111/j.1365-2486.2005.00930.x. (Pubitemid 40560555)
27. Keller, M., et al. (2004), Ecological research in the large-scale biosphereatmosphere experiment in Amazonia: Early results, Ecol. Appl., 14(SP4), 3-16, doi:10.1890/03-6003.
28. Keller, M., M. Bustamante, J. Gash, and P. S. Dias (Eds.) (2009), Amazonia and Global Change, Geophys. Monogr. Ser., vol. 186, 576 pp., AGU, Washington, D. C.
29. Kruijt, B., J. A. Elbers, C. von Randow, A. C. Araújo, P. J. Oliveira, A. Culf, A. O. Manzi, A. D. Nobre, P. Kabat, and E. J. Moors (2004), The robustness of eddy correlation fluxes for Amazon rain forest conditions, Ecol. Appl., 14(SP4), 101-113, doi:10.1890/02-6004.
30. LBA Science Planning Group (1996), The Large-Scale Biosphere- Atmosphere Experiment in Amazonia (LBA): Concise experimental plan, 44 pp., Wageningen, Netherlands.
31. Liepmann, D., and G. Stephanopoulos (1985), Development and global sensitivity analysis of a closed ecosystem model, Ecol. Modell., 30, 13-47, doi:10.1016/0304-3800(85)90035-3. (Pubitemid 17246794)
32. Liu, Y. Q., H. V. Gupta, S. Sorooshian, L. A. Bastidas, and W. J. Shuttleworth (2004), Exploring parameter sensitivities of the land surface using a locally coupled land-atmosphere model, J. Geophys. Res., 109, D21101, doi:10.1029/2004JD004730. (Pubitemid 40191146)
33. Malhi, Y., and E. A. Davidson (2009), Biogeochemistry and ecology of terrestrial ecosystems of Amazonia, in Amazonia and Global Change, Geophys. Monogr. Ser., vol. 186, edited by M. Keller et al., pp. 293-298, AGU, Washington, D. C.
34. Malhi, Y., and J. Grace (2000), Tropical forests and atmospheric carbon dioxide, Trends Ecol. Evol., 15(8), 332-337, doi:10.1016/S0169-5347(00) 01906-6. (Pubitemid 30484260)
35. Malhi, Y., S. Saatchi, C. Girardin, and L. E. O. C. Aragao (2009), The production, storage, and flow of carbon in Amazonian forests, in Amazonia and Global Change, Geophys. Monogr. Ser., vol. 186, edited by M. Keller et al., pp. 355-372, AGU, Washington, D. C, USA.
36. Miller, S. D., M. L. Goulden, M. C. Menton, H. R. da Rocha, H. C. de Freitas, A. Figueira, and C. A. D. de Sousa (2004), Biometric and micrometeorological measurements of tropical forest carbon balance, Ecol. Appl., 14(SP4), 114-126, doi:10.1890/02-6005.
37. Nemani, R. R., C. D. Keeling, H. Hashimoto, W. M. Jolly, S. C. Piper, C. J. Tucker, R. B. Myneni, and S. W. Running (2003), Climate-driven increases in global terrestrial net primary production from 1982 to 1999, Science, 300, 1560-1563, doi:10.1126/science.1082750. (Pubitemid 36682885)
38. Nobre, C. A., P. J. Sellers, and J. Shukla (1991), Amazonian deforestation and regional climate change, J. Clim., 4(10), 957-988, doi:10.1175/1520-0442(1991)0042.0.CO;2.
39. Pitman, A. J. (2003), The evolution of, and revolution in, land surface schemes designed for climate models, Int. J. Climatol., 23(5), 479-510, doi:10.1002/joc.893. (Pubitemid 36586468)
40. Prihodko, L., A. S. Denning, N. P. Hanan, I. Baker, and K. Davis (2008), Sensitivity, uncertainty and time dependence of parameters in a complex land surface model, Agric. For. Meteorol., 148(2), 268-287, doi:10.1016/j.agrformet. 2007.08.006.
41. Randall, D. A., D. A. Dazlich, C. Zhang, A. S. Denning, P. J. Sellers, C. J. Tucker, L. Bounoua, S. O. Los, C. O. Justice, and I. Fung (1996), A revised land surface parameterization (SiB2) for GCMs. Part III: The greening of the Colorado State University general circulation model, J. Clim., 9(4), 738-763, doi:10.1175/1520-0442(1996)0092.0.CO;2.
42. Rosero, E., Z. L. Yang, T. Wagener, L. E. Gulden, S. Yatheendradas, and G. Y. Niu (2010), Quantifying parameter sensitivity, interaction, and transferability in hydrologically enhanced versions of the Noah land surface model over transition zones during the warm season, J. Geophys. Res., 115, D03106, doi:10.1029/2009JD012035.
43. Rosolem, R., L. A. Bastidas, W. J. Shuttleworth, L. G. G. de Gonçalves, E. J. Burke, H. R. da Rocha, S. D. Miller, and M. L. Goulden (2005), Evaluation of effects of selective logging on energy-water and carbon exchange processes, in Regional Hydrological Impacts of Climatic Change: Hydroclimatic Variability, edited by S. Franks et al., pp. 118-125, Int. Assoc. of Hydrol. Sci. Press, Wallingford, U. K. (Pubitemid 40538546)
44. Rosolem, R., W. J. Shuttleworth, and L. G. G. de Gonçalves (2008), Is the data collection period of the Large-Scale Biosphere-Atmosphere Experiment in Amazonia representative of long-term climatology?, J. Geophys. Res., 113, G00B09, doi:10.1029/2007JG000628.
45. Rosolem, R., W. J. Shuttleworth, X. Zeng, S. R. Saleska, and T. E. Huxman (2010), Land surface modeling inside the Biosphere 2 tropical rainforest biome, J. Geophys. Res., 115, G04035, doi:10.1029/2010JG001443.
46. Rosolem, R., H. V. Gupta, W. J. Shuttleworth, L. G. G. de Gonçalves, and X. Zeng (2012), Assessing components of uncertainty in parameter estimation of the SiB3 land surface model for Amazon biomes, Hydrol. Processes, in press.
47. Sakaguchi, K., X. Zeng, B. Christoffersen, N. Coupe, S. Saleska, and P. Brando (2011), Natural and drought scenarios in an east central Amazon forest: Fidelity of the Community Land Model 3.5 with three biogeochemical models, J. Geophys. Res., 116, G01029, doi:10.1029/2010JG001477.
48. Sakai, R.K., D. R. Fitzjarrald, O. L. L.Moraes, R.M. Staebler, O. C.Acevedo, M. J. Czikowsky, R. Da Silva, E. Brait, and V. Miranda (2004), Land-use change effects on local energy, water, and carbon balances in an Amazonian agricultural field, Global Change Biol., 10(5), 895-907, doi:10.1111/j.1529- 8817.2003.00773.x. (Pubitemid 38728012)
49. Salati, E. (1987), The forest and the hydrological cycle, in The Geophysiology of Amazonia: Vegetation and Climate Interactions, edited by R. E. Dickinson, pp. 273-296, John Wiley, New York.
50. Saleska, S. R., et al. (2003), Carbon in Amazon forests: Unexpected seasonal fluxes and disturbance-induced losses, Science, 302(5650), 1554-1557, doi:10.1126/science.1091165. (Pubitemid 37475696)
51. Saltelli, A. (2002a), Sensitivity analysis for importance assessment, Risk Anal., 22(3), 579-590, doi:10.1111/0272-4332.00040. (Pubitemid 34655124)
52. Saltelli, A. (2002b), Making best use of model evaluations to compute sensitivity indices, Comput. Phys. Commun., 145(2), 280-297, doi:10.1016/S0010-4655(02)00280-1. (Pubitemid 34524628)
53. Saltelli, A., S. Tarantola, and K. P. S. Chan (1999), A quantitative modelindependent method for global sensitivity analysis of model output, Technometrics, 41(1), 39-56, doi:10.2307/1270993.
54. Saltelli, A., M. Ratto, S. Tarantola, and F. Campolongo (2005), Sensitivity analysis for chemical models, Chem. Rev., 105, 2811-2828, doi:10.1021/cr040659d. (Pubitemid 41046991)
55. Saltelli, A., M. Ratto, S. Tarantola, F. Campolongo, European Commission, and Joint Research Centre of Ispra (I) (2006), Sensitivity analysis practices: Strategies for model-based inference, Reliab. Eng. Syst. Saf., 91(10-11), 1109-1125, doi:10.1016/j.ress.2005.11.014.
56. Saltelli, A., P. Annoni, I. Azzini, F. Campolongo, M. Ratto, and S. Tarantola (2010), Variance based sensitivity analysis of model output: Design and estimator for the total sensitivity index, Comput. Phys. Commun., 181, 259-270, doi:10.1016/j.cpc.2009.09.018.
57. Sellers, P. J., Y. Mintz, Y. C. Sud, and A. Dalcher (1986), A Simple Biosphere model (SiB) for use within general circulation models, J. Atmos. Sci., 43(6), 505-531, doi:10.1175/1520-0469(1986)0432.0.CO;2.
58. Sellers, P. J., D. A. Randall, G. J. Collatz, J. A. Berry, C. B. Field, D. A. Dazlich, C. Zhang, G. D. Collelo, and L. Bounoua (1996a), A revised land surface parameterization (SiB2) for atmospheric GCMs. 1. Model formulation, J. Clim., 9(4), 676-705, doi:10.1175/1520-0442(1996) 0092.0.CO;2. (Pubitemid 126544330)
59. Sellers, P. J., S. O. Los, C. J. Tucker, C. O. Justice, D. A. Dazlich, G. J. Collatz, and D. A. Randall (1996b), A revised land surface parameterization (SiB2) for atmospheric GCMs. 2. The generation of global fields of terrestrial biophysical parameters from satellite data, J. Clim., 9(4), 706-737, doi:10.1175/1520-0442(1996)0092.0.CO;2. (Pubitemid 126544331)
60. Sellers, P. J., et al. (1997), Modeling the exchanges of energy, water, and carbon between continents and the atmosphere, Science, 275(5299), 502-509, doi:10.1126/science.275.5299.502. (Pubitemid 27051900)
61. Shuttleworth, W. J. (1988), Evaporation from Amazonian rainforest, Proc. R. Soc. London, Ser. B, 233(1272), 321-346, doi:10.1098/rspb.1988. 0024.
62. Sobol', I. M. (1993), Sensitivity analysis for nonlinear mathematical models, Math. Modell. Comput. Exp., 1, 407-414.
63. Stöckli, R., and P. L. Vidale (2004), European plant phenology and climate as seen in a 20-year AVHRR land-surface parameter dataset, Int. J. Remote Sens., 25(17), 3303-3330, doi:10.1080/01431160310001618149. (Pubitemid 39047737)
64. Stöckli, R., T. Rutishauser, D. Dragoni, J. O'Keefe, P. E. Thornton, M. Jolly, L. Lu, and A. S. Denning (2008), Remote sensing data assimilation for a prognostic phenology model, J. Geophys. Res., 113, G04021, doi:10.1029/2008JG000781.
65. Tang, Y., P. Reed, K. van Werkhoven, and T. Wagener (2007a), Advancing the identification and evaluation of distributed rainfall-runoff models using global sensitivity analysis, Water Resour. Res., 43, W06415, doi:10.1029/2006WR005813. (Pubitemid 47124438)
66. Tang, Y., P. Reed, T. Wagener, and K. van Werkhoven (2007b), Comparing sensitivity analysis methods to advance lumped watershed model identification and evaluation, Hydrol. Earth Syst. Sci., 11(2), 793-817, doi:10.5194/hess-11- 793-2007. (Pubitemid 46204653)
67. U.S. Environmental Protection Agency (EPA), (2009), Guidance on the development, evaluation, and application of environmental models, Rep. EPA/100/K-09/003, 99 pp., Off. of the Sci. Advisor, Counc. for Regul. Environ. Model., Washington, D. C. [Available at http://www. epa.gov/crem/library/cred- guidance-0309.pdf.]
68. van Werkhoven, K., T. Wagener, P. Reed, and Y. Tang (2008), Characterization of watershed model behavior across a hydroclimatic gradient, Water Resour. Res., 44, W01429, doi:10.1029/2007WR006271. (Pubitemid 351304154)
69. Vidale, P. L., and R. Stöckli (2005), Prognostic canopy air space solutions for land surface exchanges, Theor. Appl. Climatol., 80(2-4), 245-257, doi:10.1007/s00704-004-0103-2. (Pubitemid 40829191)
70. von Randow, C., et al. (2004), Comparative measurements and seasonal variations in energy and carbon exchange over forest and pasture in south west Amazonia, Theor. Appl. Climatol., 78(1-3), 5-26.
71. Wagener, T., and J. Kollat (2007), Numerical and visual evaluation of hydrological and environmental models using the Monte Carlo analysis toolbox, Environ. Model. Software, 22(7), 1021-1033, doi:10.1016/j. envsoft.2006.06.017. (Pubitemid 46209836)
72. Werth, D., and R. Avissar (2004), The regional evapotranspiration of the Amazon, J. Hydrometeorol., 5(1), 100-109, doi:10.1175/1525-7541(2004) 0052.0.CO;2. (Pubitemid 38381928)
73. Wofsy, S. C., M. L. Goulden, J. W. Munger, S. M. Fan, P. S. Bakwin, B. C. Daube, S. L. Bassow, and F. A. Bazzaz (1993), Net exchange of CO2 in a midlatitude forest, Science, 260(5112), 1314-1317, doi:10.1126/science.260. 5112.1314. (Pubitemid 23383058)
74. Yan, J., and C. T. Haan (1991a), Multiobjective parameter estimation for hydrologic models-Weighting of errors, Trans. ASAE, 34(1), 135-141. (Pubitemid 21730902)
75. Yan, J., and C. T. Haan (1991b), Multiobjective parameter estimation for hydrologic models-Multiobjective programing, Trans. ASAE, 34(3), 848-856. (Pubitemid 21708965)
76. Yilmaz, K. K., H. V. Gupta, and T. Wagener (2008), A process-based diagnostic approach to model evalutation: Application to the NWS distributed hydrologic model, Water Resour. Res., 44, W09417, doi:10.1029/2007WR006716.
77. Zadeh, L. A. (1963), Optimality and non-scalar valued performance criteria, IEEE Trans. Autom. Control, 8, 59-60.