An integrated framework of agent-based modelling and robust optimization for microgrid energy management

Applied Energy

Volumn 129, Issue , 2014, Pages 70-88

  Kuznetsova, Elizaveta ^a,b   Li, Yan Fu ^b   Ruiz, Carlos ^c   Zio, Enrico ^b,d  

^a LABORATOIRE DES SCIENCES DU CLIMAT ET DE L ENVIRONNEMENT   (France)

^b EDF R AND D   (France)

^c UNIVERSIDAD CARLOS III DE MADRID   (Spain)

^d POLITECNICO DI MILANO   (Italy)

Author keywords

Agent based model; Microgrid; Power imbalance; Robust optimization; System reliability; Uncertain scenarios

Indexed keywords

COMPUTATIONAL METHODS; ECONOMICS; ENERGY MANAGEMENT; GENETIC ALGORITHMS; LOSS OF LOAD PROBABILITY; PHOTOVOLTAIC CELLS; PRODUCTION ENGINEERING; UNCERTAINTY ANALYSIS;

AGENT-BASED MODEL; MICRO GRID; POWER IMBALANCE; ROBUST OPTIMIZATION; SYSTEM RELIABILITY; UNCERTAIN SCENARIOS;

ELECTRIC POWER DISTRIBUTION;

ENERGY EFFICIENCY; GENETIC ALGORITHM; INTEGRATED APPROACH; NUMERICAL MODEL; OPTIMIZATION; PHOTOVOLTAIC SYSTEM; POWER GENERATION; STAKEHOLDER; STOCHASTICITY;

EID: 84901008590     PISSN: 03062619     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.apenergy.2014.04.024     Document Type: Article

References (96)

1. Glenn J.C., Gordon T.J., Florescu E. 2009 State of the future 2009.
2. Owen J. The planet's future: climate change 'will cause civilisation to collapse. The Independent; 2009. Available: [accessed: 10.09.10]. http://www.independent.co.uk/environment/climate-change/the-planets-future-climate-change-will-cause-civilisation-to-collapse-1742759.html.
3. Jung M., Yeung P. Connecting smart grid and climate change 2009.
4. Hledik R. How green is the smart grid?. Electricity J 2009, 22(3):29-41.
5. Hatziargyriou ND. European transactions on electrical power. Special issue: microgrids and energy management, no. December 2010; 2011. p. 1139-342.
6. Katiraei F., Iravani M.R. Power management strategies for a microgrid with multiple distributed generation units. Power Syst IEEE Trans 2006, 21(4):1821-1831.
7. Carrasco J.M., Franquelo L.G., Bialasiewicz J.T., Galvan E., Guisado R.C.P., Prats M.A.M., et al. Power-electronic systems for the grid integration of renewable energy sources: a survey. Ind Electro IEEE Trans 2006, 53(4):1002-1016.
8. Manfren M., Caputo P., Costa G. Paradigm shift in urban energy systems through distributed generation: methods and models. Appl Energy 2011, 88(4):1032-1048.
9. Chen C., Duan S., Cai T., Liu B., Hu G. Smart energy management system for optimal microgrid economic operation. Renew Power Gener IET 2011, 5(3):258-267.
10. Niknam T., Azizipanah-Abarghooee R., Narimani M.R. An efficient scenario-based stochastic programming framework for multi-objective optimal micro-grid operation. Appl Energy 2012, 455-470.
11. Niknam T., Golestaneh F., Malekpour A. Probabilistic energy and operation management of a microgrid containing wind/photovoltaic/fuel cell generation and energy storage devices based on point estimate method and self-adaptive gravitational search algorithm. Energy 2012, 43(1):427-437.
12. De Muro A.G., Jimeno J., Anduaga J. Architecture of a microgrid energy management system. Eur Trans Electr Pow 2011, 21:1142-1158.
13. Kuznetsova E., Culver K., Zio E. Complexity and vulnerability of smartgrid systems. In: Advances in safety, reliability and risk management, European Safety and Reliability Conference (ESREL 2011) 2011, 2474-2482.
14. Colson M.H., Nehrir C.M., Gunderson R.W. Multi-agent microgrid power management. In: 18th IFAC world congress 2011, 3678-3683.
15. Reddy P.P., Veloso M.M. Strategy learning for autonomous agents in smart grid markets. In: Twenty-second international joint conference on artificial intelligence 2005, 1446-1451.
16. Krause T., Beck E., Cherkaoui R., Germond A., Andersson G., Ernst D. A comparison of Nash equilibria analysis and agent-based modelling for power markets. Int J Electr Power Energy Syst 2006, 28(9):599-607.
17. Weidlich A., Veit D. A critical survey of agent-based wholesale electricity market models. Energy Econ 2008, 30(4):1728-1759.
18. Yousefi S., Moghaddam M.P., Majd V.J. Optimal real time pricing in an agent-based retail market using a comprehensive demand response model. Energy 2011, 36(9):5716-5727.
19. Jun Z., Junfeng L., Jie W., Ngan H.W. A multi-agent solution to energy management in hybrid renewable energy generation system. Renewable Energy 2011, 36(5):1352-1363.
20. Kuznetsova E., Ruiz C., Li Y.F., Zio E., Ault G., Bell K. Reinforcement learning for microgrid energy management. Energy 2013, 59:133-146.
21. Zeng Y., Cai Y., Huang G., Dai J. A review on optimization modeling of energy systems planning and GHG emission mitigation under uncertainty. Energies 2011, 4(12):1624-1656.
22. Lagorse J., Simoes M.G., Miraoui A. A multiagent fuzzy-logic-based energy management of hybrid systems. Ind Appl IEEE Trans 2009, 45(6):2123-2129.
23. Solano Martínez J., John R.I., Hissel D., Péra M.-C. A survey-based type-2 fuzzy logic system for energy management in hybrid electrical vehicles. Inf. Sci. 2012, 190:192-207. May.
24. Ben-Tal A., Nemirovski A. Robust solutions of uncertain linear programs. Oper Res Lett 1999, 25(1):1-13.
25. Bertsimas D., Sim M. The price of robustness. Oper Res 2004, 52(1):35-53.
26. Krey V., Martinsen D., Wagner H.-J. Effects of stochastic energy prices on long-term energy-economic scenarios. Energy 2007, 32(12):2340-2349.
27. Cai Y.P., Huang G.H., Yang Z.F., Lin Q.G., Tan Q. Community-scale renewable energy systems planning under uncertainty-an interval chance-constrained programming approach. Renew. Sustain. Energy Rev. 2009, 13(4):721-735.
28. Liu M. An interval-parameter fuzzy robust nonlinear programming model for water quality management. J Water Resour Protect 2013, 05(01):12-16.
29. Li Y., Huang G. Robust interval quadratic programming and its application to waste management under uncertainty. Environ Syst Res 2012, 1(1):7.
30. Parisio A., Del Vecchio C., Vaccaro A. Electrical power and energy systems a robust optimization approach to energy hub management. Int J Electr Power Energy Syst 2012, 42(1):98-104.
31. Chen C., Li Y.P., Huang G.H., Li Y.F. A robust optimization method for planning regional-scale electric power systems and managing carbon dioxide. Electr Power Energy Syst 2012, 40:70-84.
32. Chen C., Li Y.P., Huang G.H., Zhu Y. An inexact robust nonlinear optimization method for energy systems planning under uncertainty. Renewable Energy 2012, 47:55-66.
33. Dong C., Huang G.H., Cai Y.P., Liu Y. Robust planning of energy management systems with environmental and constraint-conservative considerations under multiple uncertainties. Energy Convers Manage 2013, 65:471-486.
34. Ak R., Li Y.F., Vitelli V., Zio E. Multi-objective generic algorithm optimization of a neural network for estimating wind speed prediction intervals. Appl Soft Comput 2013, submitted for publication.
35. Khosravi A., Nahavandi S., Creighton D., Amir F.A. A comprehensive review of neural network-based prediction intervals and new advances. IEEE Trans Neural Net 2011, 22(9):1341-1356.
36. Econoving. Programme Gare. Econoving, 2011. Available: [accessed: 13.02.13]. http://www.econoving.uvsq.fr/econoving/langue-fr/recherche/projets/programme-gare/programme-gare-236018.kjsp.
37. Culver K., Guilloteau R., Hue C. Hard nodes in soft surroundings: a 'dream of islands' strategy for urban sustainability. Development 2011, 54:336-342.
38. European Commission. Photovoltaic Solar Energy Best. Practice Stroies; 2002.
39. Fischer E, Lo C. Back to the future: top trends in railway station design. railway-technology.com; 2011. Available: [accessed: 24.09.13]. http://www.railway-technology.com/features/featureback-to-the-future-top-trends-in-railway-station-design.
40. RTE. Bilan électrique 2012; 2012.
41. Saint Girons AL. Des incertitudes juridiques croissantes dans le secteur du photovoltaïque: vers un blocage de la filière?. Actu-Environnement; 2010. Available: [accessed: 24.09.13]. http://www.actu-environnement.com/ae/news/anne-laure-saint-girons-incertitudes-juridiques-photovoltaique-11077.php4.
42. Traub C. Autolib': Rent an Electric Car in Paris. About.com Guide; 2013. Available: [accessed: 04.10.13]. http://www.goparis.about.com/od/transportation/a/Autolib-electric-cars-Paris.htm.
43. Niknam T., Azizipanah-Abarghooee R., Narimani M.R. An efficient scenario-based stochastic programming framework for multi-objective optimal micro-grid operation. Appl Energy 2012, 99:455-470.
44. Kim H.-M., Lim Y., Kinoshita T. An Intelligent multiagent system for autonomous microgrid operation. Energies 2012, 5(12):3347-3362.
45. Hawkes A.D., Leach M.A. Modelling high level system design and unit commitment for a microgrid. Appl Energy 2009, 86(7-8):1253-1265.
46. Ren H., Gao W. A MILP model for integrated plan and evaluation of distributed energy systems. Appl Energy 2010, 87(3):1001-1014.
47. Liu D., Guo J., Huang Y., Wang W. An active power control strategy for wind farm based on predictions of wind turbine's maximum generation capacity. J Renew Sustain Energy 2013, 5(1):013121.
48. Chandra R.S., Liu Y., Bose S., Bedout J.M. Hybrid robust predictive optimization method of power system dispatch 2011.
49. Mahmoud M.M., Imad I.H. Field experience on solar electric power systems and their potential in Palestine. Renew Sustain Energy Rev 2003, 7:531-543.
50. Mohamed F.A., Koivo H.N. Electrical power and energy systems system modelling and online optimal management of MicroGrid using mesh adaptive direct search. Int J Electr Power Energy Syst 2010, 32(5):398-407.
51. Mohamed F.A., Koivo H.N. Online management genetic algorithms of MicroGrid for residential application. Energy Convers Manage 2012.
52. Dong C., Huang G.H., Cai Y.P., Liu Y. Robust planning of energy management systems with environmental and constraint-conservative considerations under multiple uncertainties. Energy Convers Manage 2013, 65:471-486.
53. Cai Y.P., Huang G.H., Yang Z.F., Tan Q. Identification of optimal strategies for energy management systems planning under multiple uncertainties. Appl Energy 2009, 86(4):480-495.
54. Li Y.P., Huang G.H., Li M.W. An integrated optimization modeling approach for planning emission trading and clean-energy development under uncertainty. Renewable Energy 2014, 62:31-46.
55. Al-Sharif L. Modelling of escalator energy consumption. Energy Build 2011, 43(6):1382-1391.
56. Ademe. Eclairage public: routier, urban, grands espaces, illuminations et cadre de vie; 2002.
57. Safety Time Inc. Automatic Fare Collection System. Manage 2010.
58. Roux Dit Riche B. Les distributeurs automatiques devront réduire leur consommation d ' énergie. Cleantech Republic; 2011. Available: [accessed: 12.04.11]. http://www.cleantechrepublic.com/2009/06/09/les-distributeurs-automatiques-devront-reduire-leur-consommation-denergie/.
59. Mohamed F.A., Koivo H.N. System modelling and online optimal management of MicroGrid using mesh adaptive direct search. Int J Electr Power Energy Syst 2010, 32(5):398-407.
60. Atwa Y.M., Salama M.M.A., Seethapathy R. Optimal renewable resources mix for distribution system energy loss minimization. IEEE Trans Power Syst 2010, 25(1):360-370.
61. Hill D.C., Mcmillan D., Bell K.R.W., Infield D. Application of auto-regressive models to UK wind speed data for power system impact studies. IEEE Trans Sustain Energy 2012, 3(1).
62. Dialynas E.N., Machias A.V. Reliability modelling interactive techniques of power systems including wind generating units. Arch Elktrotech 1989, 72:33-41.
63. Fong C., Haddad S., Patton D. The IEEE reliability test system - 1996. IEEE Trans Power Syst 1999, 14(3).
64. Karki R., Billinton R. Reliability/cost implications of PV and wind energy utilization in small isolated power systems. IEEE Trans Energy Convers 2001, 16(4):368-373.
65. Herbert G.M.J., Iniyan S., Goic R. Performance, reliability and failure analysis of wind farm in a developing country. Renew Energy 2010, 35(12):2739-2751.
66. Zio E. The Monte Carlo simulation method for system reliability and risk analysis 2013, Springer.
67. IBM. IBM ILOG CPLEX Optimization Studio. CPLEX User's Manual; 2011.
68. Khosravi A., Nahavandi S., Creighton D., Atiya A.F. Comprehensive review of neural network-based prediction intervals and new advances. Neural Netw IEEE Trans 2011, 22(9):1341-1356.
69. Zhi Z., Wai Kin C., Joe H C. Agent-based simulation of electricity markets: a survey of tools. Artif Intell Rev 2009, 28:305-342.
70. Hegazy Y.G., Salama M.M.A., Chikhani A.Y. Adequacy assessment of distributed generation systems using Monte Carlo simulation. IEEE Trans Power Syst 2003, 18(1):48-52.
71. Chaudhry N., Hughes L. Forecasting the reliability of wind-energy systems: a new approach using the RL technique. Appl Energy 2012, 96:422-430.
72. Zhang P., Li W., Li S., Wang Y., Xiao W. Reliability assessment of photovoltaic power systems: review of current status and future perspectives. Appl Energy 2013, 104:822-833.
73. Girard R., Laquaine K., Kariniotakis G. Assessment of wind power predictability as a decision factor in the investment phase of wind farms. Appl Energy 2013, 101:609-617.
74. Pinson P., Chevallier C., Kariniotakis G.N. Trading wind generation from short-term probabilistic forecasts of wind power. IEEE Trans Power Syst 2007, 1-9.
75. Luickx PJ, Pérez PS, Driesen J, D'haeseleer WD. Imbalance tariff systems in European countries and the cost effect of wind power. no; March 2009. p. 1-23.
76. Usaola J., Ravelo O., González G., Soto F., Dávila M.C., Díaz-Guerra B. Benefits for wind energy in electricity markets from using short term wind power prediction tools - a simulation study. Wind Eng 2004, 28(1):119-127.
77. Matallanas E., Castillo-Cagigal M., Gutiérrez a., Monasterio-Huelin F., Caamaño-Martín E., Masa D., et al. Neural network controller for active demand-side management with PV energy in the residential sector. Appl Energy 2012, 91(1):90-97.
78. Kyriakarakos G., Piromalis D.D., Dounis A.I., Arvanitis K.G., Papadakis G. Intelligent demand side energy management system for autonomous polygeneration microgrids. Appl Energy 2013, 103:39-51.
79. Chen Y.-H., Lu S.-Y., Chang Y.-R., Lee T.-T., Hu M.-C. Economic analysis and optimal energy management models for microgrid systems: a case study in Taiwan. Appl Energy 2013, 103:145-154.
80. Garcia R.C., Contreras J., Van Akkeren M., Garcia J.B.C. A GARCH forecasting model to predict day-ahead electricity prices. IEEE Trans Power Syst 2005, 20(2):867-874.
81. Cococcioni M, D'Andrea E, Lazzerini B. 24-hour-ahead forecasting of energy production in solar PV systems. in Intelligent Systems Design and Applications (ISDA); 2011 11th International Conference on; 2011. p. 1276-81.
82. Chaouachi A., Kamel R.M., Andoulsi R., Nagasaka K. Multiobjective intelligent energy management for a microgrid. IEEE Trans Industr Electron 2013, 60(4):1688-1699.
83. Lewbel A., Dong Y., Yang T.T. Comparing features of convenient estimators for binary choice models with endogenous regressors. Can J Econ/Revue canadienne d'économique 2012, 45(3):809-829.
84. Yona A., Senjyu T., Funabashi T., Kim C.-H. Determination method of insolation prediction with fuzzy and applying neural network for long-term ahead PV power output correction. Sustain Energy IEEE Trans 2013, 4(2):527-533.
85. Klopper B., Sondermann-Wolke C., Romaus C. Probabilistic planning for predictive condition monitoring and adaptation within the self-optimizing energy management of an autonomous railway vehicle. J Robot Mechatronics 2012, 24(1):5-15.
86. Kariniotakis G., Pinson P., Siebert N., Giebel G., Barthelmie R. The state of the art in short-term prediction of wind power - from an offshore perspective. In: Proceedings of 2004 SeaTechWeek 2004, 2004:1-13.
87. Oldewurtel F., Parisio A., Jones C.N., Gyalistras D., Gwerder M., Stauch V., et al. Use of model predictive control and weather forecasts for energy efficient building climate control. Energy Build 2012, 45:15-27.
88. Martín L., Zarzalejo L.F., Polo J., Navarro A., Marchante R., Cony M. Prediction of global solar irradiance based on time series analysis: application to solar thermal power plants energy production planning. Sol Energy 2010, 84(10):1772-1781.
89. Ettoumi F.Y., Mefti A., Adane A., Bouroubi M.Y. Statistical analysis of solar measurements in Algeria using beta distributions. Renew Energy 2002, 26:47-67.
90. Martin L., Zarzalejo L.F., Polo J., Navarro A., Marchante R., Cony M. Prediction of global solar irradiance based on time series analysis: application to solar thermal power plants energy production planning. Sol Energy 2010, 84:1772-1781.
91. Sulaiman M.Y., Oo W.M.H., Wahab M.A. Application of beta distribution model to Malaysian sunshine data. Renew Energy 1999, 18:573-579.
92. Lei M., Shiyan L., Chuanwen J., Hongling L., Yan Z. A review on the forecasting of wind speed and generated power. Renew Sustain Energy Rev 2009, 13:915-920.
93. Pimenta F., Kempton W., Garvine R. Combining meteorological stations and satellite data to evaluate the offshore wind power resource of Southeastern Brazil. Renewable Energy 2008, 33:2375-2387.
94. Grassi G., Vecchio P. Commun nonlinear sci numer simulat wind energy prediction using a two-hidden layer neural network. Commun Nonlinear Sci Numer Simul 2010, 15(9):2262-2266.
95. Khosravi A., Nahavandi S., Creighton D., Atiya A.F. Lower upper bound estimation method for construction of neural network-based prediction intervals. IEEE Trans Neural Net 2011, 22(2):337-346.
96. EEX. Hour Contracts - France. European Energy Exchange 2013. Available: [accessed: 13.02.13]. http://www.eex.com/en/MarketData/TradingData/Power/HourContractsSpotHourlyAuction/spot-hours-table/2013-02-14/FRANCE.