Recent advances in electricity price forecasting: A review of probabilistic forecasting

Renewable and Sustainable Energy Reviews

Volumn 81, Issue , 2018, Pages 1548-1568

  Nowotarski, Jakub ^a   Weron, Rafał ^a  

^a WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Autoregression; Day ahead market; Electricity price forecasting; Neural network; Probabilistic forecast; Reliability; Sharpness

Indexed keywords

COSTS; DECISION MAKING; FORECASTING; POWER MARKETS; REGRESSION ANALYSIS;

AUTOREGRESSION; COMPETITIVE POWER MARKETS; DAY AHEAD MARKET; ELECTRICITY PRICES FORECASTING; ENERGY COMPANIES; NEURAL-NETWORKS; PROBABILISTIC FORECASTING; PROBABILISTIC FORECASTS; PROBABILISTICS; SHARPNESS;

NEURAL NETWORKS;

EID: 85020812142     PISSN: 13640321     EISSN: 18790690     Source Type: Journal    
DOI: 10.1016/j.rser.2017.05.234     Document Type: Review

References (124)

1. Weron, R., Electricity price forecasting: a review of the state-of-the-art with a look into the future. Int J Forecast 30:4 (2014), 1030–1081.
2. De Gooijer, J.G., Hyndman, R.J., 25 years of time series forecasting. Int J Forecast 22:3 (2006), 443–473.
3. Hong, T., Pinson, P., Fan, S., Zareipour, H., Troccoli, A., Hyndman, R.J., Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond. Int J Forecast 32:3 (2016), 896–913.
4. Moghimi Ghadikolaei, H., Ahmadi, A., Aghaei, J., Najafi, M., Risk constrained self-scheduling of hydro/wind units for short term electricity markets considering intermittency and uncertainty. Renew Sustain Energy Rev 16:7 (2012), 4734–4743.
5. Hong, T., Fan, S., Probabilistic electric load forecasting: a tutorial review. Int J Forecast 32 (2016), 914–938.
6. Liu, B., Nowotarski, J., Hong, T., Weron, R., Probabilistic load forecasting via Quantile Regression Averaging on sister forecasts. IEEE Trans Smart Grid 8:2 (2017), 730–737.
7. Weron, R., Ziel, F., Forecasting electricity prices: a guide to robust modeling. 2017, CRC Press [forthcoming].
8. Chatfield, C., Time-series forecasting. 2000, Chapman & Hall/CRC, Boca Raton, Florida.
9. Amjady, N., Hemmati, M., Energy price forecasting. IEEE Power Energy Mag(March/April), 2006, 20–29.
10. Raza, M., Khosravi, A., A review on artificial intelligence based load demand forecasting techniques for smart grid and buildings. Renew Sustain Energy Rev 50 (2015), 1352–1372.
11. Zhang, L., Luh, P., Neural network-based market clearing price prediction and confidence interval estimation with an improved extended Kalman filter method. IEEE Trans Power Syst 20:1 (2005), 59–66.
12. Misiorek, A., Trück, S., Weron, R., Point and interval forecasting of spot electricity prices: linear vs. non-linear time series models. Stud Nonlinear Dyn Econ, 10(3), 2006 (Article 2).
13. Serinaldi, F., Distributional modeling and short-term forecasting of electricity prices by Generalized Additive Models for location, scale and shape. Energy Econ 33 (2011), 1216–1226.
14. Hyndman R. The difference between prediction intervals and confidence intervals. Hyndsight Blog (13 March 2013), 〈 http://robjhyndman.com/hyndsight/intervals〉; 2011.
15. Gneiting, T., Balabdaoui, F., Raftery, A., Probabilistic forecasts, calibration and sharpness. J R Stat Soc B 69 (2007), 243–268.
16. Gneiting, T., Raftery, A., Strictly proper scoring rules, prediction, and estimation. J Am Stat Assoc 102:477 (2007), 359–378.
17. Gneiting, T., Katzfuss, M., Probabilistic forecasting. Annu Rev Stat Appl 1 (2014), 125–151.
18. Pinson, P., Nielsen, H., Moller, J., Madsen, H., Kariniotakis, G., Non-parametric probabilistic forecasts of wind power: required properties and evaluation. Wind Energy 10:6 (2007), 497–516.
19. Zhang, Y., Wang, J., Wang, X., Review on probabilistic forecasting of wind power generation. Renew Sustain Energy Rev 32 (2003), 255–270.
20. Jung, J., Broadwater, R.P., Current status and future advances for wind speed and power forecasting. Renew Sustain Energy Rev 31 (2014), 762–777.
21. Yan, J., Liu, Y., Han, S., Wang, Y., Feng, S., Reviews on uncertainty analysis of wind power forecasting. Renew Sustain Energy Rev 52 (2015), 1322–1330.
22. Weron, R., Modeling and forecasting electricity loads and prices: a statistical approach. 2006, John Wiley & Sons, Chichester.
23. Zhang, L., Luh, P., Kasiviswanathan, K., Energy clearing price prediction and confidence interval estimation with cascaded neural networks. IEEE Trans Power Syst 18:1 (2003), 99–105.
24. Weron, R., Misiorek, A., Forecasting spot electricity prices: a comparison of parametric and semiparametric time series models. Int J Forecast 24 (2008), 744–763.
25. Panagiotelis, A., Smith, M., Bayesian forecasting of intraday electricity prices using multivariate skew-elliptical distributions. Int J Forecast 24 (2008), 710–727.
26. Amjady, N., Day-ahead price forecasting of electricity markets by a new fuzzy neural network. IEEE Trans Power Syst 21:2 (2006), 887–896.
27. Catalão, J., Mariano, S., Mendes, V., Ferreira, L., Short-term electricity prices forecasting in a competitive market: a neural network approach. Electr Power Syst Res 77:10 (2007), 1297–1304.
28. Nowotarski, J., Weron, R., Computing electricity spot price prediction intervals using quantile regression and forecast averaging. Comput Stat 30:3 (2015), 791–803.
29. Maciejowska, K., Nowotarski, J., Weron, R., Probabilistic forecasting of electricity spot prices using Factor Quantile Regression Averaging. Int J Forecast 32:3 (2016), 957–965.
30. Zhao, J., Dong, Z., Xu, Z., Wong, K., A statistical approach for interval forecasting of the electricity price. IEEE Trans Power Syst 23:2 (2008), 267–276.
31. Chen, X., Dong, Z., Meng, K., Xu, Y., Wong, K., Ngan, H., Electricity price forecasting with extreme learning machine and bootstrapping. IEEE Trans Power Syst 27:4 (2012), 2055–2062.
32. Wan, C., Xu, Z., Wang, Y., Dong, Z., Wong, K., A hybrid approach for probabilistic forecasting of electricity price. IEEE Trans Smart Grid 5:1 (2014), 463–470.
33. Maciejowska, K., Nowotarski, J., A hybrid model for GEFCom2014 probabilistic electricity price forecasting. Int J Forecast 32:3 (2016), 1051–1056.
34. Koenker, R.W., Quantile regression. 2005, Cambridge University Press.
35. Gaillard, P., Goude, Y., Nedellec, R., Additive models and robust aggregation for GEFCom2014 probabilistic electric load and electricity price forecasting. Int J Forecast 32:3 (2016), 1038–1050.
36. Hastie, T.J., Tibshirani, R.J., Generalized additive models. 43, 1990, CRC Press.
37. Tibshirani, R., Regression shrinkage and selection via the lasso. J R Stat Soc B 58 (1996), 267–288.
38. Chernozhukov, V., Fernandez-Val, I., Galichon, A., Quantile and probability curves without crossing. Econometrica 73:3 (2010), 1093–1125.
39. Dudek, G., Multilayer perceptron for GEFCom2014 probabilistic electricity price forecasting. Int J Forecast 32 (2016), 1057–1060.
40. Juban, R., Ohlsson, H., Maasoumy, M., Poirier, L., Kolter, J.Z., A multiple quantile regression approach to the wind, solar, and price tracks of GEFCom2014. Int J Forecast 32:3 (2016), 1094–1102.
41. Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J., Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3:1 (2011), 1–122.
42. Uniejewski, B., Nowotarski, J., Weron, R., Automated variable selection and shrinkage for day-ahead electricity price forecasting. Energies, 9, 2016, 621.
43. Ziel, F., Forecasting electricity spot prices using LASSO: on capturing the autoregressive intraday structure. IEEE Trans Power Syst 31:6 (2016), 4977–4987.
44. Janczura, J., Weron, R., An empirical comparison of alternate regime-switching models for electricity spot prices. Energy Econ 32:5 (2010), 1059–1073.
45. Zhou, M., Yan, Z., Ni, Y., Li, G., Nie, Y., Electricity price forecasting with confidence-interval estimation through an extended ARIMA approach. IEEE Proc, Gener Transm Distrib 153:2 (2006), 187–195.
46. Christoffersen, P., Evaluating interval forecasts. Int Econ Rev 39:4 (1998), 841–862.
47. Huurman, C., Ravazzolo, F., Zhou, C., The power of weather. Comput Stat Data Anal 56:11 (2012), 3793–3807.
48. Berkowitz, J., Testing density forecasts, with applications to risk management. J Bus Econ Stat 19:4 (2001), 465–474.
49. Bao, Y., Lee, T.-H., Saltoğlu, B., Comparing density forecast models. J Forecast 26:3 (2007), 203–225.
50. Jonsson, T., Pinson, P., Madsen, H., Nielsen, H., Predictive densities for day-ahead electricity prices using time-adaptive quantile regression. Energies 7:9 (2014), 5523–5547.
51. Alonso, A., Garcia-Martos, C., Rodriguez, J., Sanchez, M., Seasonal dynamic factor analysis and bootstrap inference: application to electricity market forecasting. Technometrics 53 (2011), 137–151.
52. Khosravi, A., Nahavandi, S., Creighton, D., Quantifying uncertainties of neural network-based electricity price forecasts. Appl Energy 112 (2013), 120–129.
53. Pinson, P., Tastu, J., Discussion of “Prediction intervals for short-term wind farm generation forecasts” and "Combined nonparametric prediction intervals for wind power generation". IEEE Trans Sustain Energy 5:3 (2014), 1019–1020.
54. Wan, C., Xu, Z., Østergaard, J., Dong, Z.Y., Wong, K.P., Discussion of "Combined nonparametric prediction intervals for wind power generation". IEEE Trans Sustain Energy, 5(3), 2014, 1021.
55. Khosravi, A., Nahavandi, S., Creighton, D., A neural network-garch-based method for construction of prediction intervals. Electr Power Syst Res 96 (2013), 185–193.
56. Rafiei M, Niknam T, Khooban M. Probabilistic electricity price forecasting by improved clonal selection algorithm and wavelet preprocessing, Neural Computing and Applications; 2016 DOI: http://dx.doi.org/10.1007/s00521-016-2279-7.
57. Garcia-Martos, C., Rodriguez, J., Sanchez, M., Forecasting electricity prices and their volatilities using Unobserved Components. Energy Econ 33:6 (2011), 1227–1239.
58. Wu, H.C., Chan, S.C., Tsui, K.M., Hou, Y., A new recursive dynamic factor analysis for point and interval forecast of electricity price. IEEE Trans Power Syst 28:3 (2013), 2352–2365.
59. Bello, A., Reneses, J., Muñoz, A., Delgadillo, A., Probabilistic forecasting of hourly electricity prices in the medium-term using spatial interpolation techniques. Int J Forecast 32:3 (2016), 966–980.
60. Janczura, J., Trück, S., Weron, R., Wolff, R., Identifying spikes and seasonal components in electricity spot price data: a guide to robust modeling. Energy Econ 38 (2013), 96–110.
61. Shahidehpour, M., Yamin, H., Li, Z., Market operations in electric power systems: forecasting, scheduling, and risk management. 2002, Wiley.
62. Conejo, A.J., Contreras, J., Espínola, R., Plazas, M.A., Forecasting electricity prices for a day-ahead pool-based electric energy market. Int J Forecast 21 (2005), 435–462.
63. Nowotarski, J., Tomczyk, J., Weron, R., Robust estimation and forecasting of the long-term seasonal component of electricity spot prices. Energy Econ 39 (2013), 13–27.
64. Christensen, T., Hurn, A., Lindsay, K., Forecasting spikes in electricity prices. Int J Forecast 28:2 (2012), 400–411.
65. Bello, A., Reneses, J., Muñoz, A., Medium-term probabilistic forecasting of extremely low prices in electricity markets: application to the Spanish case. Energies, 9(3), 2016, 193.
66. Brier, G.W., Verification of forecasts expressed in terms of probability. Mon Weather Rev 78:1 (1950), 1–3.
67. Zareipour, H., Janjani, A., Leung, H., Motamedi, A., Schellenberg, A., Classification of future electricity market prices. IEEE Trans Power Syst 26:1 (2011), 165–173.
68. Ziel, F., Steinert, R., Electricity price forecasting using sale and purchase curves: the X-model. Energy Econ 59 (2016), 435–454.
69. Pinson, P., Madsen, H., Nielsen, H.A., Papaefthymiou, G., Klöckl, B., From probabilistic forecasts to statistical scenarios of short-term wind power production. Wind Energy 12:1 (2009), 51–62.
70. Alexander, C., Market risk analysis IV: value at risk models. 2008, Wiley.
71. Nowotarski, J., Raviv, E., Trück, S., Weron, R., An empirical comparison of alternate schemes for combining electricity spot price forecasts. Energy Econ 46 (2014), 395–412.
72. Nowotarski, J., Weron, R., To combine or not to combine? Recent trends in electricity price forecasting. ARGO 9 (2016), 7–14.
73. Efron, B., Tibshirani, R.J., An introduction to the bootstrap. 1993, Chapman & Hall, New York.
74. Clements, M.P., Kim, J.H., Bootstrap prediction intervals for autoregressive time series. Comput Stat Data Anal 51 (2007), 3580–3594.
75. Nowotarski J, Weron R. Merging quantile regression with forecast averaging to obtain more accurate interval forecasts of Nord Pool spot prices. In: IEEE Conference Proceedings - EEM14, DOI: http://dx.doi.org/10.1109/EEM.2014.6861285; 2014.
76. Zhang, Y., Liu, K., Qin, L., An, X., Deterministic and probabilistic interval prediction for short-term wind power generation based on variational mode decomposition and machine learning methods. Energy Convers Manag 112 (2016), 208–219.
77. Kupiec, P.H., Techniques for verifying the accuracy of risk measurement models. J Deriv 3:2 (1995), 73–84.
78. Dawid, A.P., Statistical theory: the prequential approach. J R Stat Soc A 147 (1984), 278–292.
79. Wallis, K.F., Chi-squared tests of interval and density forecasts and the Bank of England fan charts. Int J Forecast 19 (2003), 165–175.
80. Corradi V, Swanson NR. Predictive density evaluation. In: Handbook of Economic Forecasting (Elliott G, Granger CWJ, Timmermann A. eds.), Elsevier, 2006 pp. 197–284.
81. Clements, M.P., Taylor, T., Evaluating interval forecasts of high-frequency financial data. J Appl Econ 18:4 (2003), 445–456.
82. Berkowitz, J., Christoffersen, P., Pelletier, D., Evaluating value-at-risk models with desk-level data. Manag Sci 57:12 (2011), 2213–2227.
83. Christoffersen, P., Pelletier, D., Backtesting value-at-risk: a duration-based approach. J Financ Econ 2:1 (2004), 84–108.
84. Santos, A.P.P., Alves, M.F., A new class of independence tests for interval forecast evaluation. Comput Stat Data Anal 56:11 (2012), 3366–3380.
85. Engle, R.F., Manganelli, S., CAViaR: conditional autoregressive value at risk by regression quantiles. J Bus Econ Stat 22:4 (2004), 367–381.
86. Gaglianone, W., Lima, L., Linton, O., Smith, D., Evaluating Value-at-Risk models via quantile regression. J Bus Econ Stat 29:1 (2011), 150–160.
87. Granger, C.W.J., Prediction with a generalized cost of error function. Oper Res Q 20 (1969), 199–207.
88. Gneiting, T., Quantiles as optimal point forecasts. Int J Forecast 27:2 (2011), 197–207.
89. Winkler, R.L., A decision-theoretic approach to interval estimation. J Am Stat Assoc 67:337 (1972), 187–191.
90. Diebold, F.X., Mariano, R.S., Comparing predictive accuracy. J Bus Econ Stat 13 (1995), 253–263.
91. Diebold, F.X., Comparing predictive accuracy, twenty years later: a personal perspective on the use and abuse of Diebold-Mariano tests. J Bus Econ Stat 33:1 (2015), 1–9.
92. Hansen, P.R., Lunde, A., Nason, J.M., The model confidence set. Econometrica 79 (2011), 453–497.
93. Harvey, D., Leybourne, S., Newbold, P., Tests for forecast encompassing. J Bus Econ Stat 16 (1998), 254–259.
94. Matheson, J.E., Winkler, R.L., Scoring rules for continuous probability distributions. Manag Sci 22 (1976), 1087–1096.
95. Good, I.J., Rational decisions. J R Stat Soc B 14 (1952), 107–114.
96. Pinson, P., Kariniotakis, G., Conditional prediction intervals of wind power generation. IEEE Trans Power Syst 25:4 (2010), 1845–1856.
97. Taylor, J.W., Evaluating volatility and interval forecasts. J Forecast 18 (1999), 111–128.
98. Uniejewski, B., Weron, R., Ziel, F., Variance stabilizing transformations for electricity spot price forecasting. IEEE Trans Power Syst, 2017 [Submitted for publication].
99. Winkler, R.L., Murphy, A.H., Good probability assessors. J Appl Meteorol 7 (1968), 751–758.
100. Morales, J.M., Conejo, A.J., Madsen, H., Pinson, P., Zugno, M., Integrating renewables in electricity markets: operational problems. 2014, Springer.
101. Wan, C., Xu, Z., Pinson, P., Dong, Z., Wong, K., Probabilistic forecasting of wind power generation using extreme learning machine. IEEE Trans Power Syst 29:3 (2014), 1033–1044.
102. Khosravi, A., Nahavandi, S., Closure to the discussion of “Prediction intervals for short-term wind farm generation forecasts” and “Combined nonparametric prediction intervals for wind power generation” and the discussion of "Combined nonparametric prediction intervals for wind power generation". IEEE Trans Sustain Energy 5:3 (2014), 1022–1023.
103. Elliott, G., Timmermann, A., Economic forecasting. 2016, Princeton University Press.
104. Morgan, M.G., Henrion, M., Small, M., Uncertainty: a guide to dealing with uncertainty in quantitative risk and policy analysis. 1990, Cambridge University Press.
105. Paraschiv F, Bunn D.W, Westgaard S. Estimation and application of fully parametric multifactor quantile regression with dynamic coefficients, 2016. University of St. Gallen, School of Finance Research Paper No. 2016/07. Available at SSRN: 〈 https://ssrn.com/abstract=2741692〉.
106. Unger D.A. A method to estimate the continuous ranked probability score. In: Proceedings of the 9th conference on probability and statistics in atmospheric sciences, Virginia Beach, VA, 206–213; 1985.
107. Hersbach, H., Decomposition of the continuous ranked probability score for ensemble prediction systems. Weather Forecast 15 (2000), 559–570.
108. Taieb, S.B., Huser, R., Hyndman, R.J., Genton, M.G., Forecasting uncertainty in electricity smart meter data by boosting additive quantile regression. IEEE Trans Smart Grid 7:5 (2016), 2448–2455.
109. Cuaresma, J.C., Hlouskova, J., Kossmeier, S., Obersteiner, M., Forecasting electricity spot-prices using linear univariate time-series models. Appl Energy 77:1 (2004), 87–106.
110. Gianfreda, A., Grossi, L., Forecasting Italian electricity zonal prices with exogenous variables. Energy Econ 34:6 (2012), 2228–2239.
111. Hong, Y.-Y., Wu, C.-P., Day-ahead electricity price forecasting using a hybrid principal component analysis network. Energies 5:11 (2012), 4711–4725.
112. Bordignon, S., Bunn, D.W., Lisi, F., Nan, F., Combining day-ahead forecasts for British electricity prices. Energy Econ 35 (2013), 88–103.
113. Maciejowska, K., Weron, R., Forecasting of daily electricity prices with factor models: utilizing intra-day and inter-zone relationships. Comput Stat 30:3 (2015), 805–819.
114. Maciejowska, K., Weron, R., Short- and mid-term forecasting of baseload electricity prices in the UK: the impact of intra-day price relationships and market fundamentals. IEEE Trans Power Syst 31:2 (2016), 994–1005.
115. Tastu, J., Pinson, P., Trombe, P.-J., Madsen, H., Probabilistic forecasts of wind power generation accounting for geographically dispersed information. IEEE Trans Smart Grid 5:1 (2014), 480–489.
116. Baran, S., Lerch, S., Mixture EMOS model for calibrating ensemble forecasts of wind speed. Environmetrics 27:2 (2016), 116–130.
117. Nowotarski, J., Weron, R., On the importance of the long-term seasonal component in day-ahead electricity price forecasting. Energy Econ 57 (2016), 228–235.
118. Karakatsani, N., Bunn, D., Forecasting electricity prices: the impact of fundamentals and time-varying coefficients. Int J Forecast 24 (2008), 764–785.
119. Schneider, S., Power spot price models with negative prices. J Energy Mark 4:4 (2011), 77–102.
120. Diaz, G., Planas, E., A note on the normalization of Spanish electricity spot prices. IEEE Trans Power Syst 31:3 (2016), 2499–2500.
121. Nogales, F.J., Contreras, J., Conejo, A.J., Espinola, R., Forecasting next-day electricity prices by time series models. IEEE Trans Power Syst 17 (2002), 342–348.
122. Misiorek, A., Short-term forecasting of electricity prices: do we need a different model for each hour?. Medium Économ Toepass 16:2 (2008), 8–13.
123. Kristiansen, T., Forecasting Nord Pool day-ahead prices with an autoregressive model. Energy Policy 49 (2012), 328–332.
124. Keles, D., Scelle, J., Paraschiv, F., Fichtner, W., Extended forecast methods for day-ahead electricity spot prices applying artificial neural networks. Appl Energy 162 (2016), 218–230.