Forecasting uncertainty in electricity smart meter data by boosting additive quantile regression

IEEE Transactions on Smart Grid

Volumn 7, Issue 5, 2016, Pages 2448-2455

  Ben Taieb, Souhaib ^a   Huser, Raphael ^a   Hyndman, Rob J ^b   Genton, Marc G ^a  

^a KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Saudi Arabia)

^b MONASH UNIVERSITY   (Australia)

Author keywords

gradient boosting; Probabilistic load forecasting; quantile regression; smart meters

Indexed keywords

AGGREGATES; ELECTRIC POWER MEASUREMENT; ELECTRIC POWER UTILIZATION; FORECASTING; PROBABILITY DISTRIBUTIONS; REGRESSION ANALYSIS;

BOX COX TRANSFORMATION; ELECTRICITY DEMANDS; ELECTRICITY METERS; ELECTRICITY-CONSUMPTION; HOUSEHOLD ELECTRICITY CONSUMPTION; PROBABILISTIC FORECASTS; QUANTILE REGRESSION; TRADITIONAL APPROACHES;

SMART METERS;

EID: 84960193121     PISSN: 19493053     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSG.2016.2527820     Document Type: Article

References (43)

1. X. Zhu and M. G. Genton, ?Short-term wind speed forecasting for power system operations,? Int. Stat. Rev., vol. 80, no. 1, pp. 2-23, 2012.
2. P. Bacher, H. Madsen, and H. A. Nielsen, ?Online short-term solar power forecasting,? Solar Energy, vol. 83, no. 10, pp. 1772-1783, Oct. 2009.
3. T. K. Wijaya, M. Sinn, and B. Chen, ?Forecasting uncertainty in electricity demand,? in Proc. AAAI Workshop Comput. Sustain., Austin, TX, USA, 2015. [Online]. Available: http://www.aaai.org/ocs/index.php/WS/AAAIW15/paper/view/10104/10187.
4. T. Hong, ?Short term electric load forecasting,? Ph.D. dissertation, Dept. Oper. Res. Elect. Eng., North Carolina State Univ., Raleigh, NC, USA, 2010.
5. T. Hong and S. Fan, ?Probabilistic electric load forecasting: A tutorial review,? Int. J. Forecast., vol. 32, no. 2, 2016, to be published.
6. S. Arora and J. W. Taylor, ?Forecasting electricity smart meter data using conditional kernel density estimation,? Omega, vol. 59, pp. 47-59, Mar. 2016.
7. T. Gneiting and M. Katzfuss, ?Probabilistic forecasting,? Annu. Rev. Stat. Appl., vol. 1, no. 1, pp. 125-151, Jan. 2014.
8. P. Mirowski, S. Chen, T. K. Ho, and C.-N. Yu, ?Demand forecasting in smart grids,? Bell Labs Tech. J., vol. 18, no. 4, pp. 135-158, Mar. 2014.
9. F. L. Quilumba, W.-J. Lee, H. Huang, D. Y. Wang, and R. L. Szabados, ?Using smart meter data to improve the accuracy of intraday load forecasting considering customer behavior similarities,? IEEE Trans. Smart Grid, vol. 6, no. 2, pp. 911-918, Mar. 2015.
10. Y. Zhang, J. Wang, and X. Wang, ?Review on probabilistic forecasting of wind power generation,? Renew. Sustain. Energy Rev., vol. 32, pp. 255-270, Apr. 2014.
11. P. Pinson, ?Very-short-term probabilistic forecasting of wind power with generalized logit-normal distributions,? J. Royal Stat. Soc. Ser. C Appl. Stat., vol. 61, no. 4, pp. 555-576, Aug. 2012.
12. D. M. Bashtannyk and R. J. Hyndman, ?Bandwidth selection for kernel conditional density estimation,? Comput. Stat. Data Anal., vol. 36, no. 3, pp. 279-298, May 2001.
13. R. Koenker, Quantile Regression (Econometric Society Monographs). Cambridge, U.K.: Cambridge Univ. Press, 2005.
14. ?Electricity smart metering customer behaviour trials findings report,? Comm. Energy Regul., Dublin, Ireland, Tech. Rep. CER/11/080a, 2011. [Online]. Available: http://www.cer.ie/docs/000340/cer11080(a)(i).pdf.
15. C. Beckel, L. Sadamori, T. Staake, and S. Santini, ?Revealing household characteristics from smart meter data,? Energy, vol. 78, pp. 397-410, Dec. 2014.
16. P. Pompey, A. Bondu, Y. Goude, and M. Sinn, ?Massive-scale simulation of electrical load in smart grids using generalized additive models,? in Modeling and Stochastic Learning for Forecasting in High Dimension (Lecture Notes in Statistics). Berlin, Germany: Springer-Verlag, 2014, pp. 193-212.
17. J. A. Carta, P. Ram?rez, and S. Vel?zquez, ?A review of wind speed probability distributions used in wind energy analysis: Case studies in the Canary Islands,? Renew. Sustain. Energy Rev., vol. 13, no. 5, pp. 933-955, Jun. 2009.
18. T. Gneiting, ?Quantiles as optimal point forecasts,? Int. J. Forecast., vol. 27, no. 2, pp. 197-207, Apr./Jun. 2011.
19. V. Chernozhukov, I. Fern?ndez-Val, and A. Galichon, ?Quantile and probability curves without crossing,? Econometrica J. Econ. Soc., vol. 78, no. 3, pp. 1093-1125, May 2010.
20. G. Anastasiades and P. McSharry, ?Quantile forecasting of wind power using variability indices,? Energies, vol. 6, no. 2, pp. 662-695, Feb. 2013.
21. T. Jónsson, P. Pinson, H. Madsen, and H. A. Nielsen, ?Predictive densities for day-ahead electricity prices using time-adaptive quantile regression,? Energies, vol. 7, no. 9, pp. 5523-5547, Aug. 2014.
22. B. Liu, J. Nowotarski, T. Hong, and R. Weron, ?Probabilistic load forecasting via quantile regression averaging on sister forecasts,? IEEE Trans. Smart Grid, to be published.
23. T. Gneiting and A. E. Raftery, ?Strictly proper scoring rules, prediction, and estimation,? J. Amer. Stat. Assoc., vol. 102, no. 477, pp. 359-378, 2007.
24. T. Gneiting, F. Balabdaoui, and A. E. Raftery, ?Probabilistic forecasts, calibration and sharpness,? J. Royal Stat. Soc. Ser. B Stat. Methodol., vol. 69, no. 2, pp. 243-268, 2007.
25. A. Mayr, T. Hothorn, and N. Fenske, ?Prediction intervals for future BMI values of individual children: A non-parametric approach by quantile boosting,? BMC Med. Res. Methodol., vol. 12, no. 1, p. 6, Jan. 2012.
26. S. Ben Taieb and R. J. Hyndman, ?A gradient boosting approach to the Kaggle load forecasting competition,? Int. J. Forecast., vol. 30, no. 2, pp. 382-394, Apr. 2014.
27. S. Fan and R. J. Hyndman, ?Short-term load forecasting based on a semi-parametric additive model,? IEEE Trans. Power Syst., vol. 27, no. 1, pp. 134-141, Feb. 2012.
28. S. B. Taieb and R. J. Hyndman, ?Boosting multi-step autoregressive forecasts,? in Proc. 31st Int. Conf. Mach. Learn. (ICML), Beijing, China, 2014, pp. 109-117.
29. T. Hastie and R. Tibshirani, Generalized Additive Models. London, U.K.: Chapman & Hall, 1990.
30. J. H. Friedman, ?Greedy function approximation: A gradient boosting machine,? Ann. Stat., vol. 29, no. 5, pp. 1189-1232, Oct. 2001.
31. P. Bühlmann and B. Yu, ?Boosting with the L2-loss: Regression and classification,? J. Amer. Stat. Assoc., vol. 98, no. 462, pp. 324-339, 2003.
32. R. Koenker, P. Ng, and S. Portnoy, ?Quantile smoothing splines,? Biometrika, vol. 81, no. 4, pp. 673-680, Dec. 1994.
33. R. Koenker, ?Additive models for quantile regression: Model selection and confidence bandaids,? Braz. J. Probab. Stat., vol. 25, no. 3, pp. 239-262, Nov. 2011.
34. R. E. Schapire and Y. Freund, Boosting: Foundations and Algorithms. Cambridge, MA, USA: MIT Press, 2012.
35. T. Kneib, T. Hothorn, and G. Tutz, ?Variable selection and model choice in geoadditive regression models,? Biometrics, vol. 65, no. 2, pp. 626-634, Jun. 2009.
36. D. Ruppert, ?Selecting the number of knots for penalized splines,? J. Comput. Graph. Stat., vol. 11, no. 4, pp. 735-757, 2002.
37. M. Schmid and T. Hothorn, ?Boosting additive models using componentwise P-splines,? Comput. Stat. Data Anal., vol. 53, no. 2, pp. 298-311, Dec. 2008.
38. T. Hothorn, P. Bühlmann, T. Kneib, M. Schmid, and B. Hofner, ?Modelbased boosting 2.0,? J. Mach. Learn. Res., vol. 11, pp. 2109-2113, Aug. 2010.
39. R Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, 2015.
40. R. Engle, C. Granger, R. Ramanathan, and F. Vahid-Araghi, ?Probabilistic methods in forecasting hourly loads,? Electric Power Research Inst., Palo Alto, CA, USA, Tech. Rep. EPRI-TR-101902, Apr. 1993.
41. R. Sevlian, S. Patel, and R. Rajagopal. (2015). Distribution System Load and Forecast Model. [Online]. Available: http://arxiv.org/abs/1407.3322.
42. Y.-H. Hsiao, ?Household electricity demand forecast based on context information and user daily schedule analysis from meter data,? IEEE Trans. Ind. Informat., vol. 11, no. 1, pp. 33-43, Feb. 2015.
43. R. Sevlian and R. Rajagopal, ?Scaling law of very short term electricity load forecasting on varying levels of aggregation,? IEEE Trans. Smart Grid, 2014. [Online]. Available: http://arxiv.org/pdf/1404.0058.