Load/price forecasting and managing demand response for smart grids: Methodologies and challenges

IEEE Signal Processing Magazine

Volumn 29, Issue 5, 2012, Pages 68-85

  Chan, S C ^a   Tsui, K M ^a   Wu, H C ^a   Hou, Yunhe ^a   Wu, Yik Chung ^a   Wu, Felix F ^a  

^a UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

COSTS; ELECTRIC POWER TRANSMISSION NETWORKS; ENERGY UTILIZATION; FORECASTING; INVESTMENTS;

APPROPRIATE MODELS; ELECTRICITY COSTS; ELECTRICITY PRICES; PEAK ELECTRICITY; STATISTICAL ESTIMATION; THERMAL GENERATION; USERS' SATISFACTIONS; UTILITY FUNCTIONS;

SMART POWER GRIDS;

EID: 85032751153     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2012.2186531     Document Type: Article

References (79)

1. J. Conti and G. E. Sweetnam, "Emissions of greenhouse gases in the United States 2008," U.S. Energy Information Administration, U.S. Dept. Energy, Washington, DC, Tech. Rep. DOE EIA-0573(2008), Dec. 2009.
2. M. Glinkowski, J. Hou, and G. Rackliffe, "Advances in wind energy technologies in the context of smart grid," Proc. IEEE, vol. 99, no. 6, pp. 1083-1097, June 2011.
3. K. Turitsyn, P. Sulc, S. Backhaus, and M. Chertkov, "Options for control of reactive power by distributed photovoltaic generators," Proc. IEEE, vol. 99, no. 6, pp. 1063-1073, June 2011.
4. N. P. Padhy, "Unit commitment-A bibliographical survey," IEEE Trans. Power Syst., vol. 2, no. 19, pp. 1196-1205, 2004.
5. DOE. (2008, July). 20% wind energy by 2030: Increasing wind energy's contribution supply. U.S. Dept. Energy, Office of Energy Efficiency and Renewable [Online]. Available: http://www1.eere.energy.gov/windandhydro/wind- 2030. html
6. P. Denholm and R. M. Margolis, "Evaluating the limit of solar photovoltaics (PV) in traditional electric power systems," Energy Policy, vol. 35, no. 6, pp. 2852-2861, 2007. (Pubitemid 46381399)
7. R. Sioshansi and W. Short, "Evaluating the impacts of real-time pricing on the usage of wind generation," IEEE Trans. Power Syst., vol. 24, no. 2, pp. 516-524, May 2009.
8. R. H. Lasseter, "Smart distribution: Coupled microgrids," Proc. IEEE, vol. 99, no. 6, pp. 1074-1082, June 2011.
9. J. Wells, Electricity Markets-Consumers Could Benefit From Demand Programs, But Challenges Remain. Washington, DC: Government Accountability Office, 2004.
10. G. W. Arnold, "Challenges and opportunities in smart grid: A position article," Proc. IEEE, vol. 99, no. 6, pp. 922-927, 2011.
11. S. S. Oren, "Demand response: A historical perspective and business models for load control aggregation," presented at the Power System Engineering Research Center Public Webinar, Feb. 1, 2011.
12. G. Ghatikar, J. L. Mathieu, M. A. Piette, and S. Liliccote. (2010, Dec. 1-3). Open automated demand response technologies for dynamic pricing and smart grid. presented at Grid-Interop Conference 2010, Chicago, IL. [Online]. Available: http://drrc.lbl.gov/sites/drrc.lbl.gov/files/lbnl-4028e.pdf
13. A. Faruqui and S. Sergici, "Household response to dynamic pricing of electricity: A survey of 15 experiments," J. Regulatory Economics, vol. 38, no. 2, pp. 193-225, Oct. 2010.
14. D. Kathan, C. Daly, E. Eversole, M. Farinella, J. Gadani, R. Irwin, C. Lankford, A. Pan, C. Switzer, and D. Wight, "National action plan on demand response," The Federal Energy Regulatory Commission Staff, Federal Energy Regulatory Commission, Washington, DC, Tech. Rep. AD09-10, 2010.
15. C. King. (2010). PowerCentsDC program final report. Smart Meter Pilot Program, Inc., eMeter Corp. Washington, DC, USA. [Online]. Available: http:// www.powercentsdc.org/ESC%2010-09-08%20PCDC%20Final%20Report%20 -%20FINAL.pdf
16. "What Is the Smart Grid?" SmartGrid.gov. U.S. Dept. of Energy. [Online]. Available: www.smartgrid.gov/the-smart-grid#home
17. A. G. Phadke, "Synchronized phasor measurements in power systems," IEEE Comput. Appl. Power, vol. 6, no. 2, pp. 10-15, Apr. 1993. (Pubitemid 23638773)
18. A. Gomez-Exposito, A. Abur, A. de la Villa Jaen, and C. Gomex-Quiles, "A multilevel state estimation paradigm for smart grids," Proc. IEEE, vol. 99, no. 6, pp. 952-976, June 2011.
19. M. H. J. Bollen, I. Y. H. Gu, S. Santoso, M. F. Mcgranaghan, P. A. Crossley, M. V. Ribeiro, and P. F. Ribeiro, "Bridging the gap between signal and power," IEEE Signal Process. Mag., vol. 26, no. 4, pp. 12-31, July 2009.
20. H. Gharavi and R. Ghafurian, "Smart grid: The electric energy system of the future," Proc. IEEE, vol. 99, no. 6, pp. 917-921, June 2011.
21. H. Sane and M. Guay, "Minimax dynamic optimization over a finite-time horizon for building demand control," in Proc. 2008 American Control Conf., Seattle, WA, June 11-13, 2008, pp. 1469-1474.
22. D. Bargiotas and J. D. Birdwell, "Residential air conditioner dynamic model for direct load control," IEEE Trans. Power Delivery, vol. 3, no. 4, pp. 2119-2126, 1988.
23. Y. C. Ho and R. C. K. Lee, "A Bayesian approach to problems in stochastic estimation and control," IEEE Trans. Automat. Contr., vol. AC-9, no. 4, pp. 333-339, 1964.
24. D. L. Alspach and H. W. Sorenson, "Nonlinear Bayesian estimation using Gaussian sum approximation," IEEE Trans. Automat. Contr., vol. AC-17, no. 4, pp. 439-448, Aug. 1972.
25. R. E. Kalman, "A new approach to linear filtering and prediction problems," Trans. ASME, J. Basic Eng., vol. 82D, pp. 35-45, Mar. 1960.
26. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Statist. Soc. B, vol. 39, no. 1, pp. 1-38, 1977.
27. R. Tibshirani, "Regression shrinkage and selection via the lasso," J. Roy. Statist. Soc. B, vol. 58, no. 1, pp. 267-288, 1996.
28. J. Fan and R. Li, "Variable selection via nonconcave penalized likelihood and its oracle properties," J. Amer. Stat. Assoc., vol. 96, no. 456, pp. 1348-1360, Dec. 2001. (Pubitemid 33695585)
29. S. C. Chan, Z. G. Zhang, and Y. J. Chu, "A new transform-domain regularized recursive least M-estimate algorithm for robust linear estimation," IEEE Trans. Circuits Syst. II, vol. 58, no. 2, pp. 120-128, Feb. 2011.
30. P. J. Huber, Robust Statistics. New York: Wiley, 1981.
31. C. J. Masreliez and R. D. Martin, "Robust Bayesian estimation for the linear model and robustifying the Kalman filter," IEEE Trans. Automat. Contr., vol. AC-22, pp. 361-371, June 1977.
32. S. C. Chan and Y. Zou, "A recursive least M-estimate algorithm for robust adaptive filtering in impulsive noise: Fast algorithm and convergence performance analysis," IEEE Trans. Signal Processing, vol. 52, no. 4, pp. 975-991, Apr. 2004.
33. A. Doucet, N. De Freitas, and N. J. Gordon. Sequential Monte Carlo Methods in Practice. New York: Springer-Verlag, 2001.
34. S. C. Chan, B. Liao, and K. M. Tsui, "Bayesian Kalman filtering, regularization and compressed sampling," in Proc. IEEE MWSCAS, Aug. 2011, pp 1-4.
35. S. Haykin, Adaptive Filter Theory, 4th ed. Englewood Cliffs, NJ: Prentice- Hall, 2001.
36. J. Fan and I. Gijbels, Local Polynomial Modelling and its Applications. London, U.K.: Chapman & Hall, 1996.
37. V. Katkovnik, "A new method for varying adaptive bandwidth selection," IEEE Trans. Signal Processing, vol. 47, no. 9, pp. 2567-2571, Sept. 1999.
38. Z. G. Zhang, S. C. Chan, K. L. Ho, and K. C. Ho, "On bandwidth selection in local polynomial regression analysis and its application to multi-resolution analysis of non-uniform data," J. Signal Process. Syst., vol. 52, no. 3, pp. 263-280, Sept., 2008.
39. S. C. Chan and Z. G. Zhang, "Local polynomial modeling and variable bandwidth selection for time-varying linear systems," IEEE Trans. Instrum. Meas., vol. 60, no. 3, pp. 1102-1117, Mar. 2011.
40. Z. G. Zhang and S. C. Chan, "Tracking of voltage flicker in power distribution systems: A local polynomial modeling approach," in Proc. ICGCS, Shanghai, China, June 21-23, 2010, pp. 543-548.
41. Z. G. Zhang and S. C. Chan, "A new regularized adaptive windowed lomb periodogram for spectral analysis of time-varying signals with impulsive components," submitted for publication.
42. R. Weron, Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach. West Sussex, England: Wiley, 2006.
43. Y. Hou, C. C. Liu, and H. Salazar, "Electricity prices as stochastic processes," in Advances in Electric Power and Energy (Power Engineering Series of IEEE Press/Wiley books), M. El Hawary, Ed., to be published.
44. Z. Xia, Pricing and Risk Management in Competitive Electricity Markets, Ph.D. dissertation, School of Industrial and System Engineering, Georgia Inst. Technol., 2005.
45. Y. Hou and Y. He, "Modeling of electricity prices," in Proc. 2010 Int. Conf. Green Circuits and Systems, 21-23 June, 2010, pp. 549-554.
46. Y. Hou and F. Wu, "Probability distribution functions of generator profit from spot market," in Proc. 2008 16th Power Systems Computation Conf., pp. 1261-1266, 2008.
47. R. Huisman and R. Mahieu, "Regime jumps in electricity prices," Energy Economics, vol. 25, no. 5, pp. 425-434, 2003. (Pubitemid 37144462)
48. H. L. Shang. (2010). Nonparametric modeling and forecasting electricity demand: An empirical study, in Proc. Australian Statistical Conf. [Online]. Available: http://www.buseco.monash.edu.au/ebs/pubs/wpapers/2010/wp19-10.pdf
49. B. Yang, "Projection approximation subspace tracking," IEEE Trans. Signal Processing, vol. 43, no. 1, pp. 95-107, Jan. 1995.
50. S. C. Chan, H. C. Wu, and K. M. Tsui, "Robust recursive eigen-decomposition and subspace-based algorithms with application to fault detection in wireless sensor networks," IEEE Trans. Instrum. Meas., vol. 61, no, 6, pp. 1703-1718, 2012.
51. C. Y. Fung and S. C. Chan, "Estimation of fast fading channel in impulse noise environment," in Proc. IEEE Int. Symp. Circuits and Systems (ISCAS), AZ, May 26-29, 2002, vol. 4, pp. 497-500.
52. Y. He, "Modeling electricity prices for generation investment and scheduling analysis," Ph.D. dissertation, Dept. Elect. Eng., Hong Kong Univ., Hong Kong, China, 2010.
53. S. Heydari and A. S. Siddiqui, "Valuing a gas-fired power plant: A comparison of ordinary linear models, regime switching approaches, and models with stochastic volatility," Energy Economics, vol. 32, no. 3, pp. 709-725, Oct. 2009.
54. ISO New England Inc. (2011). Hourly zonal information. [Online]. Available: http://www.iso-ne.com/markets/hstdata/znl info/hourly/index.html
55. M. A. Piette, S. Kiliccote, and G. Ghatikar. "Design and implementation of an open, interoperable automated demand response infrastructure," presented at the Grid Interop Forum, Albuquerque, NM, Nov. 2007, Paper LBNL-63665.
56. A. Botterud, J. Wang, V. Miranda, R. Bessa, H. Keko, and J. S. Akilimali, "Wind power forecasting and electricity market operations," presented at the IAWind 2010 Conf., Ames, IA, Apr. 6, 2010.
57. H. Holttinen, P. Meibom, A. Orths, B. Lange, M. O'Malley, J. O. Tande, A. Estanqueiro, E. Gomez, L. Söder, G. Strbac, J. C. Smith, and F. van Hulle, "Impacts of large amounts of wind power on design and operation of power systems, results of IEA collaboration," Wind Energy, vol. 14, no. 2, pp. 179-192, Mar. 2011.
58. X. Li and C. Jiang, "Unit commitment and risk management based on wind power penetrated system," in Proc. Int. Conf. Power System Technology, 2010, pp. 1-7.
59. A. Tuohy, P. Meibom, E. Denny, and M. O'Malley, "Unit commitment for systems with significant wind penetration," IEEE Trans. Power Syst., vol. 24, no. 2, pp. 592-601, 2009.
60. J. Wang, M. Shahidehpour, and Z. Li, "Security-constrained unit commitment with volatile wind power generation," IEEE Trans. Power Syst., vol. 23, no. 3, pp. 1319-1327, 2008.
61. L. Zhao and B. Zeng. (2010). Robust unit commitment problem with demand response and wind energy. Univ. South Florida, Tech. Rep. [Online]. Available: http://www.optimization-online.org/DB-HTML/2010/11/2784.html
62. H. Ma and S. M. Shahidehpour, "Unit commitment with transmission security and voltage constraints," IEEE Trans Power Syst., vol. 14, no. 2, pp. 757-764, 1999.
63. M. A. A. Pedrasa, T. D. Spooner, and I. F. MacGill, "Coordinated scheduling of residential distributed energy resources to optimize smart home energy services," IEEE Trans. Smart Grid, vol. 1, no. 2, pp. 134-143, Sept. 2010.
64. A. Mohsenian-Rad and A. Leon-Garcia, "Optimal residential load control with price prediction in real-time electricity pricing environments," IEEE Trans. Smart Grid, vol. 1, no. 2, pp. 120-133, Sept. 2010.
65. N. Li, L. Chen, and S. H. Low, "Optimal demand response based on utility maximization in power networks," in Proc. IEEE Power and Energy Society General Meeting, July 2011, pp. 1-8.
66. P. Samadi, A. Mohsenian-Rad, R. Schober, V. W. S. Wong, and J. Jatskevich, "Optimal real-time pricing algorithm based on utility maximization for smart grid," in Proc. IEEE Int. Conf. Smart Grid Communications, 2010, pp. 415-420.
67. A. Siddiqui, M. Stadler, C. Marnay, and J. Lai, "Optimal control of distributed energy resources and demand response under uncertainty," in Proc. Int. Association for Energy Economics, June 6-9, 2010.
68. R. N. Anderson, A. Boulanger, W. B. Powell, and W. Scott, "Adaptive stochastic control for the smart grid," Proc. IEEE, vol. 99, no. 6, pp. 1098-1115, June 2011.
69. K. M. Tsui, S. C. Chan, and Y. Hou, "Demand response optimization for microgrids and electric vehicle station under real-time pricing," Dept. Elect. Electron. Eng., Hong Kong Univ., Hong Kong, P.R. China, Internal Rep., 2011.
70. M. Ilic, N. Popli, J. Y. Joo, and Y. Hou, "Possible engineering and economic framework for implementing demand side participation in frequency regulation at value," presented at IEEE PES General Meeting, 2011.
71. H. Gharavi and B. Hu, "Multigate communication network for smart grid," Proc. IEEE, vol. 99, no. 6, pp. 1028-1045, 2011.
72. S. Galli, A. Scaglione, and Z. Wang, "For the grid and through the grid: The role of power line communications in the smart grid," Proc. IEEE, vol. 99, no. 6, pp. 998-1027, June 2011.
73. R. Samsudin, A. Shabri, and P. Saad, "A comparison of time series forecasting using support vector machine and artificial neural network model," J. Appl. Sci., vol. 10, no. 11, pp. 950-958, 2010.
74. T. Niimura, "Forecasting techniques for deregulated electricity market prices-Extended survey," in Proc. IEEE PES Power Systems Conf. Exposition, (PSCE 2006), Oct. 2006, pp. 51-56.
75. B. Ernst, B. Oakleaf, M. L. Ahlstrom, M. Lange, C. Moehrlen, B. Lange, U. Focken, and K. Rohrig, "Predicting the wind," IEEE Power Energy Mag., vol. 5, no. 6, pp. 78-89, Nov. 2007. (Pubitemid 350121780)
76. H. Zheng and A. Kusiak, "Prediction of wind farm power ramp rates: A datamining approach," J. Solar Energy Eng., vol. 131, no. 3, pp. 031011-1-031011-8, 2009.
77. F. Deng, G. Su, C. Liu, and Z. Wang, "Global solar radiation modeling using the artificial neural network technique," in Proc. IEEE Power and Energy Engineering Conf., Apr. 2010, pp. 1-5.
78. A. Kudish and E. Evseev, "The assessment of four different correction models applied to the diffuse radiation measured with a shadow ring using global and normal beam radiation measurements for Beer Sheva," Solar Energy, vol. 82, no. 2, pp. 144-156, 2008.
79. F. Deng, G. Su, C. Liu, and Z.Wang, "Prediction of solar radiation resources in China using the LS-SVM algorithms," in Proc. IEEE ICCAE, Apr. 2010, pp. 31-35.