Simulating California reservoir operation using the classification and regression-tree algorithm combined with a shuffled cross-validation scheme

Water Resources Research

Volumn 52, Issue 3, 2016, Pages 1626-1651

  Yang, Tiantian ^a   Gao, Xiaogang ^a   Sorooshian, Soroosh ^a   Li, Xin ^b  

^a University of California at Irvine   (United States)

^b Chinese Academy of Sciences   (China)

Author keywords

California; controlled outflow; decision tree; reservoir operation

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); CLIMATE MODELS; DATA MINING; DECISION MAKING; DECISION TREES; RESERVOIR MANAGEMENT; RIVERS; VERIFICATION;

APPLICATION STUDIES; CALIFORNIA; CLASSIFICATION AND REGRESSION TREE; CONTROLLED OUTFLOW; ENVIRONMENTAL CONSTRAINTS; HYDROLOGICAL PROCESS; PREDICTIVE PERFORMANCE; RESERVOIR OPERATION;

RESERVOIRS (WATER);

ADAPTIVE MANAGEMENT; ALGORITHM; DAM; DATA MINING; DECISION ANALYSIS; FLOW CONTROL; FLOW REGULATION; HYDROGEOLOGY; OPERATIONS TECHNOLOGY; OUTFLOW; PEAK FLOW; PREDICTION; RESERVOIR;

CALIFORNIA; OROVILLE DAM; UNITED STATES;

EID: 84960145075     PISSN: 00431397     EISSN: 19447973     Source Type: Journal    
DOI: 10.1002/2015WR017394     Document Type: Article

References (75)

1. Allen, D. M., (1974), The relationship between variable selection and data agumentation and a method for prediction, Technometrics, 16 (1), 125-127.
2. Araújo, M. B., and, M. New, (2007), Ensemble forecasting of species distributions, Trends Ecol. Evol., 22 (1), 42-47.
3. Arlot, S., and, A. Celisse, (2010), A survey of cross-validation procedures for model selection, Stat. Surv., 4, 40-79.
4. Barnes, G. W., Jr., and, F. I. Chung, (1986), Operational planning for California water system, J. Water Resour. Plann. Manage., 112 (1), 71-86.
5. Bauer, E., and, R. Kohavi, (1999), An empirical comparison of voting classification algorithms: Bagging, boosting, and variants, Mach. Learning, 36 (1-2), 105-139.
6. Bessler, F. T., D. A. Savic, and, G. A. Walters, (2003), Water reservoir control with data mining, J. Water Resour. Plann. Manage., 129 (1), 26-34.
7. Bonner, V., (1989), HEC-5: Simulation of flood control and conservation systems (for microcomputers), Model-Simulation, Rep. PB-90-502428/XAB, Hydrol. Eng. Cent., Davis, Calif.
8. Breiman, L., (1996), Bagging predictors, Mach. Learning, 24 (2), 123-140.
9. Breiman, L., (2001), Random forests, Mach. Learning, 45 (1), 5-32.
10. Breiman, L., and, P. Spector, (1992), Submodel selection and evaluation in regression, The X-random case, Int. Stat. Rev., 60, 291-319.
11. Breiman, L., J. Friedman, C. J. Stone, and, R. A. Olshen, (1984), Classification and Regression Trees, Wadsworth, Belmont, Calif.
12. Buntine, W., and, T. Niblett, (1992), A further comparison of splitting rules for decision-tree induction, Mach. Learning, 8 (1), 75-85.
13. Burnham, K. P., and, D. R. Anderson, (2002), Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach, Springer, N. Y.
14. Caruana, R., and, A. Niculescu-Mizil, (2006), An empirical comparison of supervised learning algorithms, paper presented at Proceedings of the 23rd international conference on Machine learning, ACM, Pittsburgh, Pa.
15. Chandra, B., R. Kothari, and, P. Paul, (2010), A new node splitting measure for decision tree construction, Pattern Recognition, 43 (8), 2725-2731.
16. Chaturvedi, M., and, D. Srivastava, (1981), Study of a complex water resources system with screening and simulation models, Water Resour. Res., 17 (4), 783-794.
17. Chebrolu, S., A. Abraham, and, J. P. Thomas, (2005), Feature deduction and ensemble design of intrusion detection systems, Comput. Security, 24 (4), 295-307.
18. Chipman, H. A., E. I. George, and, R. E. McCulloch, (1998), Bayesian CART model search, J. Am. Stat. Assoc., 93 (443), 935-948.
19. Chung, F. I., M. C. Archer, and, J. J. DeVries, (1989), Network flow algorithm applied to California aqueduct simulation, J. Water Resour. Plann. Manage., 115 (2), 131-147.
20. Corani, G., A. E. Rizzoli, A. Salvetti, and, M. Zaffalon, (2009), Reproducing human decisions in reservoir management: The case of Lake Lugano, in Information Technologies in Environmental Engineering, edited by L. N. Athanasiadis et al., pp. 252-263, Springer, Berlin.
21. De'ath, G., and, K. E. Fabricius, (2000), Classification and regression trees: A powerful yet simple technique for ecological data analysis, Ecology, 81 (11), 3178-3192.
22. Draper, A. J., A. Munévar, S. K. Arora, E. Reyes, N. L. Parker, F. I. Chung, and, L. E. Peterson, (2004), CalSim: Generalized model for reservoir system analysis, J. Water Resour. Plann. Manage., 130 (6), 480-489.
23. DWR (2005), California Water Plan Update 2005, Calif. Dep. of Water Resour., Sacramento.
24. DWR (2009), California Water Plan Update 2009, Calif. Dep. of Water Resour., Sacramento.
25. DWR (2013a), Feather River Regional Flood Management Plan, Calif. Dep. of Water Resour., Sacramento.
26. DWR (2013b), California Water Plan Update 2013, Calif. Dep. of Water Resour., Sacramento.
27. Elith, J., and, J. R. Leathwick, (2009), Species distribution models: Ecological explanation and prediction across space and time, Annu. Rev. Ecol. Evol. Syst., 40 (1), 677-697.
28. Fayyad, U., G. Piatetsky-Shapiro, and, P. Smyth, (1996), From data mining to knowledge discovery in databases, AI Mag., 17 (3), 37-54.
29. Freund, Y., and, R. E. Schapire, (1996), Experiments with a new boosting algorithm, in Proceedings of the 13th International Conference of Machine Learning (ICML), pp. 148-156, Morgan Kaufmann, Bari, Italy.
30. Geisser, S., (1975), The predictive sample reuse method with applications, J. Am. Stat. Assoc., 70 (350), 320-328.
31. Geisser, S., (1993), Predictive Inference, CRC Press, Boca Raton, Fla.
32. Giuliani, M., F. Pianosi, and, A. Castelletti, (2015), Making the most of data: An information selection and assessment framework to improve water systems operations, Water Resour. Res., 51, 9073-9093, doi: 10.1002/2015WR017044.
33. Gupta, H. V., S. Sorooshian, and, P. O. Yapo, (1998), Toward improved calibration of hydrologic models: Multiple and noncommensurable measures of information, Water Resour. Res., 34 (4), 751-763.
34. Guyon, I., and, A. Elisseeff, (2003), An introduction to variable and feature selection, J. Mach. Learning Res., 3, 1157-1182.
35. Hancock, T., R. Put, D. Coomans, Y. Vander Heyden, and, Y. Everingham, (2005), A performance comparison of modern statistical techniques for molecular descriptor selection and retention prediction in chromatographic QSRR studies, Chemometrics Intelligent Lab. Syst., 76 (2), 185-196.
36. Hejazi, M. I., X. Cai, and, B. L. Ruddell, (2008), The role of hydrologic information in reservoir operation-learning from historical releases, Adv. Water Resour., 31 (12), 1636-1650.
37. Johnson, S. A., J. R. Stedinger, and, K. Staschus, (1991), Heuristic operating policies for reservoir system simulation, Water Resour. Res., 27 (5), 673-685.
38. Kelly, K. F., (1986), Reservoir operation during drought: Case studies, Rep. RD-25, Inst. for Water Resour. Corps of Eng., Davis, Calif.
39. Kohavi, R., (1995), A study of cross-validation and bootstrap for accuracy estimation and model selection, paper presented at International Joint Conference on Artificual Intelligence (IJCAI), IJCAI Inc., Montreal, Quebec, Canada.
40. Kuczera, G., and, G. Diment, (1988), General water supply system simulation model: WASP, J. Water Resour. Plann. Manage., 114 (4), 365-382.
41. Kumar, A. R. S., M. K. Goyal, C. S. P. Ojha, R. D. Singh, and, P. K. Swamee, (2013a), Application of artificial neural network, fuzzy logic and decision tree algorithms for modelling of streamflow at Kasol in India, Water Sci. Technol., 68 (12), 2521-2526.
42. Kumar, A. R. S., M. K. Goyal, C. S. P. Ojha, R. D. Singh, P. K. Swamee, and, R. K. Nema, (2013b), Application of ANN, Fuzzy Logic and Decision Tree Algorithms for the development of reservoir operating rules, Water Resour. Manage., 27 (3), 911-925.
43. Lewis, R. J., (2000), An introduction to classification and regression tree (CART) analysis, paper presented at Annual Meeting of the Society for Academic Emergency Medicine, Citeseer, San Francisco, Calif.
44. Li, S. F., X. L. Wang, J. Z. Xiao, and, Z. J. Yin, (2014), Self-adaptive obtaining water-supply reservoir operation rules: Co-evolution artificial immune system, Expert Syst. Appl., 41 (4), 1262-1270.
45. Liaw, A., and, M. Wiener, (2002), Classification and regression by randomForest, R News, 2 (3), 18-22.
46. Louks, D. P., and, O. T. Sigvaldason, (1981), Multiple reservoir operation in North America, paper presented at Surface Water Impoundments, Am. Soc. of Civ. Eng., Reston, Va.
47. Lund, J. R., and, J. Guzman, (1999), Derived operating rules for reservoirs in series or in parallel, J. Water Resour. Plann. Manage., 125 (3), 143-153.
48. Mingers, J., (1989), An empirical comparison of selection measures for decision-tree induction, Mach. Learning, 3 (4), 319-342.
49. Moriasi, D., J. Arnold, M. Van Liew, R. Bingner, R. Harmel, and, T. Veith, (2007), Model evaluation guidelines for systematic quantification of accuracy in watershed simulations, Trans. ASABE, 50 (3), 885-900.
50. Nash, J., and, J. V. Sutcliffe, (1970), River flow forecasting through conceptual models part I-A discussion of principles, J. Hydrol., 10 (3), 282-290.
51. Oliveira, R., and, D. P. Loucks, (1997), Operating rules for multireservoir systems, Water Resour. Res., 33 (4), 839-852.
52. Picard, R. R., and, R. D. Cook, (1984), Cross-validation of regression models, J. Am. Stat. Assoc., 79 (387), 575-583.
53. Prasad, A. M., L. R. Iverson, and, A. Liaw, (2006), Newer classification and regression tree techniques: Bagging and random forests for ecological prediction, Ecosystems, 9 (2), 181-199.
54. Qi, Y., Z. Bar-Joseph, and, J. Klein-Seetharaman, (2006), Evaluation of different biological data and computational classification methods for use in protein interaction prediction, Proteins, 63 (3), 490-500.
55. Quinlan, J. R., (1979), Discovering rules by induction from large collections of examples, in Expert Systems in the Micro Electronic Age, pp. 168-201, Edinburgh Univ. Press, Edinburgh, U. K.
56. Quinlan, J. R., (1986), Induction of decision trees, Mach. Learning, 1 (1), 81-106.
57. Raman, H., and, V. Chandramouli, (1996), Deriving a general operating policy for reservoirs using neural network, J. Water Resour. Plann. Manage., 122 (5), 342-347.
58. Razi, M. A., and, K. Athappilly, (2005), A comparative predictive analysis of neural networks (NNs), nonlinear regression and classification and regression tree (CART) models, Expert Syst. Appl., 29 (1), 65-74.
59. Rieker, J. D., and, J. W. Labadie, (2012), An intelligent agent for optimal river-reservoir system management, Water Resour. Res., 48, W09550, doi: 10.1029/2012WR011958.
60. Sandri, M., and, P. Zuccolotto, (2008), A bias correction algorithm for the gini variable importance measure in classification trees, J. Comput. Graphical Stat., 17 (3), 611-628.
61. Sandri, M., and, P. Zuccolotto, (2010), Analysis and correction of bias in total decrease in node impurity measures for tree-based algorithms, Stat. Comput., 20 (4), 393-407.
62. Sattari, M. T., H. Apaydin, F. Ozturk, and, N. Baykal, (2012), Application of a data mining approach to derive operating rules for the Eleviyan irrigation reservoir, Lake Reservoir Manage., 28 (2), 142-152.
63. Shrestha, B. P., L. Duckstein, and, E. Z. Stakhiv, (1996), Fuzzy rule-based modeling of reservoir operation, J. Water Resour. Plann. Manage., 122 (4), 262-269.
64. Sigvaldson, O., (1976), A simulation model for operating a multipurpose multireservoir system, Water Resour. Res., 12 (2), 263-278.
65. Steinberg, D., and, P. Colla, (2009), CART: Classification and regression trees, in The Top Ten Algorithms in Data Mining, vol. 9, 179 pp., CRC Press, Boca Raton, Fla.
66. Stone, M., (1977), Asymptotics for and against cross-validation, Biometrika, 64, 29-35.
67. Timofeev, R., (2004), Classification and regression trees (CART) theory and applications, Master thesis, Cent. of Appl. Stat. and Econ., Humboldt Univ., Berlin, Germany.
68. Tsai, C.-C., M.-C. Lu, and, C.-C. Wei, (2012), Decision tree-based classifier combined with neural-based predictor for water-stage forecasts in a river basin during typhoons: A case study in Taiwan, Environ. Eng. Sci., 29 (2), 108-116.
69. USBR (2004), Long-Term Central Valley Project Operations Criteria and Plan CVP-OCAP, Sacramento, Calif.
70. Wei, C.-C., (2012), Discretized and continuous target fields for the reservoir release rules during floods, Water Resour. Manage., 26 (12), 3457-3477.
71. Wei, C. C., and, N. S. Hsu, (2008), Derived operating rules for a reservoir operation system: Comparison of decision trees, neural decision trees and fuzzy decision trees, Water Resour. Res., 44, W02428, doi: 10.1029/2006WR005792.
72. Wu, X., V. Kumar, J. R. Quinlan, J. Ghosh, Q. Yang, H. Motoda, G. J. McLachlan, A. Ng, B. Liu, and, S. Y. Philip, (2008), Top 10 algorithms in data mining, Knowledge Inf. Syst., 14 (1), 1-37.
73. Xu, M., P. Watanachaturaporn, P. K. Varshney, and, M. K. Arora, (2005), Decision tree regression for soft classification of remote sensing data, Remote Sens. Environ., 97 (3), 322-336.
74. Yang, T., X. Gao, S. L. Sellars, and, S. Sorooshian, (2015), Improving the multi-objective evolutionary optimization algorithm for hydropower reservoir operations in the California Oroville-Thermalito complex, Environ. Modell. Software, 69, 262-279.
75. Yates, D., J. Sieber, D. Purkey, and, A. Huber-Lee, (2005), WEAP21-A demand-, priority-, and preference-driven water planning model: Part 1: Model characteristics, Water Int., 30 (4), 487-500.