Applicability of Monte Carlo cross validation technique for model development and validation using generalised least squares regression

Journal of Hydrology

Volumn 482, Issue , 2013, Pages 119-128

  Haddad, Khaled ^a   Rahman, Ataur ^a   A Zaman, Mohammad ^a   Shrestha, Surendra ^a  

^a UNIVERSITY OF WESTERN SYDNEY   (Australia)

Author keywords

Generalised least squares regression; Hydrological regression; Model selection; Model validation; Monte Carlo simulation; Ungauged catchments

Indexed keywords

GENERALISED LEAST SQUARES REGRESSIONS; HYDROLOGICAL REGRESSION; MODEL SELECTION; MODEL VALIDATION; MONTE CARLO SIMULATION; UNGAUGED CATCHMENT;

CATCHMENTS; FLOOD CONTROL; FLOODS; REGRESSION ANALYSIS;

MONTE CARLO METHODS;

DATA PROCESSING; FLOOD; HYDROLOGICAL MODELING; LEAST SQUARES METHOD; MONTE CARLO ANALYSIS; PARSIMONY ANALYSIS; REGRESSION ANALYSIS;

AUSTRALIA; NEW SOUTH WALES;

EID: 84873566710     PISSN: 00221694     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jhydrol.2012.12.041     Document Type: Article

References (52)

1. Bates B.C., Rahman A., Mein R.G., Weinmann P.E. Climatic and physical factors that influence the homogeneity of regional floods in south-eastern Australia. Water Resour. Res. 1998, 34(12):3369-3381.
2. Brath A., Castellarin A., Montanari A. Assessing the reliability of regional depth-duration-frequency equations for gauged and ungauged sites. Water Resour. Res. 2003, 39(12):1367. 10.1029/2003WR002399.
3. Breiman L., Freidman J.H., Olsen R.A., Stone C. Classification and Regression Trees 1984, Wadsworth, Belmont, CA.
4. Bunke O., Droge B. Bootstrap and cross-validation estimates of the prediction error for linear regression models. Ann. Stat. 1984, 12(4):1400-1424.
5. Burman P.A. A comparative study of ordinary cross validation, v-fold cross-validation and repeated learning-tested methods. Biometrika 1989, 76:503-514.
6. Castiglioni S., Castellarin A., Montanari A. Prediction of low flow indices in ungauged basins through physiographical space-based interpolation. J. Hydrol. 2009, 378:272-280. 10.1016/j.jhydrol.2009.09.032.
7. Chebana F., Ouarda T.B.M.J. Depth and homogeneity in regional flood frequency analysis. Water Resour. Res. 2008, 44(11):W11422. 10.1029/2007WR006771.
8. Chowdhury S., Sharma A. Multi-site seasonal forecast of arid river flows using a dynamic model combination approach. Water Resour. Res. 2009, 45:W10428. 10.1029/2008WR007510.
9. Di Baldassarre G., Castellarin A., Brath A. Relationships between statistics of rainfall extremes and mean annual precipitation: an application for design-storm estimation in northern Italy. Hydrol. Earth Syst. Sci. 2006, 10:589-601.
10. Efron B. Estimating the error rate of a prediction rule: some improvements on cross-validation. J. Am. Stat. Assoc. 1983, 78:316-331.
11. Efron B. How biased is the apparent error rate of the prediction rule?. J. Am. Stat. Assoc. 1986, 81:461-470.
12. Faber K., Kowalski B.R. Propagation of measurement erros for the validation of prediction obtained by principal component regression and partial least squares. J. Chemo. 1997, 11:181-238.
13. Griffis V.W., Stedinger J.R. The use of GLS regression in regional hydrologic analyses. J. Hydrol. 2007, 204:82-95.
14. Haddad K., Zaman M., Rahman A. Regionalisation of skew for flood frequency analysis: a case study for eastern NSW. Aust. J. Water Resour. 2010, 14(1):33-41.
15. Haddad K., Rahman A., Weinmann P.E., Kuczera G., Ball J.E. Streamflow data preparation for regional flood frequency analysis: lessons from south-east Australia. Aust. J. Water Resour. 2010, 14(1):17-32.
16. Haddad K., Rahman A., Kuczera G. Comparison of ordinary and generalised least squares regression models in regional flood frequency analysis: a case study for New South Wales. Aust. J. Water Resour. 2011, 15(2):59-70.
17. Haddad K., Rahman A., Stedinger J.R. Regional flood frequency analysis using Bayesian generalized least squares: a comparison between quantile and parameter regression techniques. Hydrol. Process. 2012, 25:1-14. 10.1002/hyp.8189.
18. Haddad K., Rahman A. Regional flood frequency analysis in eastern Australia: Bayesian GLS regression-based methods within fixed region and ROI framework - quantile regression vs. parameter regression technique. J. Hydrol. 2012, 10.1016/j.jhydrol.2012.02.012.
19. Hosking J.R.M., Wallis J.R. Regional Frequency Analysis: An Approach Based on L-Moments 1997, Cambridge University Press, New York.
20. Iacobellis V., Gioia A., Manfreda S., Fiorentino M. Flood quantiles estimation based on theoretically derived distribtions: regional analysis in Southern Italy. Nat. Hazards Earth Syst. Sci. 2011, 11:673-695. 10.5194/nhess -11-673-2011.
21. Institution of Engineers Australia (I. E. Aust.) 1987. Australian Rainfall and Runoff: A Guide to Flood Estimation. Vol.1, I. E. Aust, Canberra.
22. Juraj M., Ouarda T.B.M.J. Regional flood-rainfall duration-frequency modeling of small ungaged sites. J. Hydrol. 2007, 345:61-69. 10.1016/j.jhydrol.2007.07.011.
23. Kjeldsen T.R., Jones D. An exploratory analysis of error components in hydrological regression modelling. Water Resour. Res. 2009, 45:W02407. 10.1029/2007WR006283.
24. Kjeldsen T.R. Modelling the impact of urbanization on flood frequency relationships in the UK. J. Hydrol. Res. 2010, 41(5):391-405. 10.2166/nh.2010.056.
25. Kuczera G. Comprehensive at-site flood frequency analysis using Monte Carlo Bayesian inference. Water Resour. Res. 1999, 35(5):1551-1557.
26. Laaha G., Blöschl G. A national low flow estimation procedure for Austria. Hydrol. Sci. J. 2007, 52(4):625-644. 10.1623/hysj.52.4.625.
27. Madsen H., Mikkelsen P.S., Rosbjerg D., Harremoes P. Regional estimation of rainfall intensity duration curves using generalised least squares regression of partial duration series statistics. Water Resour. Res. 2002, 38(11):1-11.
28. Marter H., Martern M. Multivariate analysis of quality: an introduction 2001, John Wiley & Sons Ltd., Chichester.
29. Merz R., Blöschl G. Flood frequency regionalisation-spatial proximity vs. catchment attributes. J. Hydrol. 2005, 302:283-306.
30. Micevski T., Kuczera G. Combining site and regional flood information using a Bayesian Monte Carlo approach. Water Resour. Res. 2009, 45:W04405. 10.1029/2008WR007173.
31. Michaelsen J. Cross-validation in statistical climate forecast models. J. Climate Appl. Meteor. 1987, 26:1589-1600.
32. Mosteller F., Tukey J.W. Data analysis and regression: a second course in statistics: reading 1977, Addison-Wesley, Mass.
33. Pandey G.R., Nguyen V.T.V. A comparative study of regression based methods in regional flood frequency analysis. J. Hydrol. 1999, 225:92-101.
34. Picard R.R., Cook R.D. Cross-validation of regression models. J. Am. Stat. Assoc. 1984, 21:299-313.
35. Racine J. Consistent cross-validitory method for dependant data: hv-block cross validation. J. Econ. 2000, 99:39-61.
36. Rahman A. A quantile regression technique to estimate design floods for ungauged catchments in south-east Australia. Aust. J. Water Resour. 2005, 9(1):81-89.
37. Reis D.S., Stedinger J.R., Martins E.S. Bayesian GLS regression with application to LP3 regional skew estimation. Water Resour. Res. 2005, 41:W10419. 10.1029/2004WR00344.
38. Rosbjerg D., Madsen H. Uncertainty measures of regional flood frequency analysis estimators. J. Hydrol. 1994, 167:209-224.
39. Sankarasubramanian A., Lall U. Flood quantiles in a changing climate: seasonal forecasts and causal relations. Water Resour. Res. 2003, 39:51134. 10.1029/2002WR001593.
40. Shao J. Linear model selection by cross validation. J. Amer. Stat. Assoc. 1993, 88:486-494.
41. Sivapalan M., Takeuchi K., Franks S.W., Gupta V.K., Karambiri H., Lakshmi V., Liang X., McDonnell J.J., Mendiondo E.M., O'Connell P.E., Oki T., Pomeroy J.W., Schertzer D., Uhlenbrook S., Zehe E. IAHS decade on Predictions in Ungauged Basins (PUB), 2003-2012: shaping an exciting future for the hydrological sciences. Hydrol. Sci. J. 2003, 48(6):857-880.
42. Song Xu Q., Zeng Liang Y. Monte Carlo cross validation. Chemo. Int. Lab. Sys. 2001, 56:1-11.
43. Song Xu Q., Zeng Liang Y., Ping Du Y. Monte Carlo cross-validation for selecting a model and estimating the prediction error in multivariate calibration. J. Chemo. 2005, 18:112-120. 10.1002/cem.858.
44. Stedinger J.R., Tasker G.D. Regional hydrologic analysis, 1. Ordinary, weighted, and generalised least squares compared. Water Resour. Res. 1985, 21(9):1421-1432.
45. Stedinger J.R., Tasker G.D. Correction to Regional hydrologic analysis, 1.Ordinary, weighted, and generalised least squares compared. Water Resour. Res. 1986, 22(5):844.
46. Stedinger J.R., Tasker G.D. Regional hydrologic analysis, 2. Model error estimators, estimation of sigma and log - Pearson type 3 distributions. Water Resour. Res. 1986, 22(10):1487-1499.
47. Stone M. Cross validatory choice and assessment of statistical predictions. J. Roy. Stat. Soc. 1974, 36(2):111-147.
48. Sun R., Chen L., Bojie F. Predicting monthly precipitation with multivariate regression methods using geographic and topographic information. J. Phys. Geo. 2011, 32(3):269-285. 10.2747/0272-3646.32.3.269.
49. Tasker G.D., Stedinger J.R. An operational GLS model for hydrologic regression. J. Hydrol. 1989, 111:361-375.
50. Tsakiris G., Nalbantis I., Cavadias G. Regionalization of low flows based on canonical correlation analysis. Adv. Water Resour. 2011, 34:865-872. 10.1016/j.advwatres.2011.04.007.
51. Thomas, D.M., Benson, M.A., 1970. Generalization of Streamflow Characteristics from Drainage Basin Characteristics. US Geological Survey Water Supply Paper 1975, pp. 55.
52. Zhang P. Model selection via multifold cross validation. Ann. Stat. 1993, 21:299-313.