Unsupervised energy prediction in a Smart Grid context using reinforcement cross-building transfer learning

Energy and Buildings

Volumn 116, Issue , 2016, Pages 646-655

  Mocanu, Elena ^a   Nguyen, Phuong H ^a   Kling, Wil L ^a   Gibescu, Madeleine ^a  

^a EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Building energy prediction; Deep Belief Networks; Machine learning; Reinforcement learning; Transfer learning

Indexed keywords

ARTIFICIAL INTELLIGENCE; BAYESIAN NETWORKS; BEHAVIORAL RESEARCH; BUILDINGS; COMPLEX NETWORKS; DECISION MAKING; ECONOMICS; ELECTRIC POWER TRANSMISSION NETWORKS; ENERGY UTILIZATION; FORECASTING; LEARNING ALGORITHMS; LEARNING SYSTEMS; REINFORCEMENT LEARNING; STOCHASTIC SYSTEMS;

BUILDING ENERGY; BUILDING ENERGY CONSUMPTION; CONTINUOUS STATE; DEEP BELIEF NETWORK (DBN); DEEP BELIEF NETWORKS; ENERGY PREDICTION; HIGH-LEVEL FEATURES; TRANSFER LEARNING;

SMART POWER GRIDS;

EID: 84958191195     PISSN: 03787788     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.enbuild.2016.01.030     Document Type: Article

References (42)

1. L. Yang, H. Yan, and J.C. Lam Thermal comfort and building energy consumption implications - a review Appl. Energy 115 2014 164 173 10.1016/j.apenergy.2013.10.062
2. E.A. Bakirtzis, C.K. Simoglou, P.N. Biskas, D.P. Labridis, and A.G. Bakirtzis Comparison of advanced power system operations models for large-scale renewable integration Electr. Power Syst. Res. 128 2015 90 99 10.1016/jepsr.2015.06.025
3. A. Costa, M.M. Keane, J.I. Torrens, and E. Corry Building operation and energy performance: monitoring, analysis and optimisation toolkit Appl. Energy 101 2013 310 316 10.1016/j.apenergy.2011.10.037
4. M. Simoes, R. Roche, E. Kyriakides, S. Suryanarayanan, B. Blunier, K. McBee, P. Nguyen, P. Ribeiro, and A. Miraoui A comparison of smart grid technologies and progresses in Europe and the U.S. IEEE Trans. Ind. Appl. 48 4 2012 1154 1162 10.1109/TIA.2012.2199730
5. X. Li, D. Gong, L. Li, and C. Sun Next day load forecasting using SVM J. Wang, X.-F. Liao, Z. Yi, Advances in Neural Networks - ISNN 2005, Vol. 3498 of Lecture Notes in Computer Science 2005
6. W.-C. Hong Electric load forecasting by support vector model Appl. Math. Model. 33 5 2009 2444 2454
7. S. Wong, K.K. Wan, and T.N. Lam Artificial neural networks for energy analysis of office buildings with daylighting Appl. Energy 87 2 2010 551 557
8. S.A. Kalogirou Artificial neural networks in energy applications in buildings Int. J. Low-Carbon Technol. 1 3 2006 201 216
9. T. Mestekemper, G. Kauermann, and M.S. Smith A comparison of periodic autoregressive and dynamic factor models in intraday energy demand forecasting Int. J. Forecast. 29 1 2013 1 12
10. M. Wytock, and J.Z. Kolter Large-scale probabilistic forecasting in energy systems using sparse gaussian conditional random fields Proceedings of the 52nd IEEE Conference on Decision and Control, CDC 2013 December 10-13, 2013, Firenze, Italy 2013 1019 1024
11. E. Mocanu, P.H. Nguyen, M. Gibescu, and W. Kling Comparison of machine learning methods for estimating energy consumption in buildings Proceedings of the 13th International Conference on Probabilistic Methods Applied to Power Systems (PMAPS) July 10-13, Durham, UK 2014
12. M. Aydinalp-Koksal, and V.I. Ugursal Comparison of neural network, conditional demand analysis, and engineering approaches for modeling end-use energy consumption in the residential sector Appl. Energy 85 4 2008 271 296
13. L. Xuemei, D. Lixing, L. Jinhu, X. Gang, L. Jibin, A novel hybrid approach of KPCA and SVM for building cooling load prediction, in: Knowledge Discovery and Data Mining, 2010. Third International Conference on WKDD '10, 2010.
14. L. Suganthi, and A.A. Samuel Energy models for demand forecasting - a review Renew. Sustain. Energy Rev. 16 2 2012 1223 1240
15. M. Krarti Energy Audit of Building Systems: An Engineering Approach, Mechanical and Aerospace Engineering Series 2nd ed. 2012 Taylor & Francis
16. A.I. Dounis Artificial intelligence for energy conservation in buildings Adv. Build. Energy Res. 4 1 2010 267 299
17. A. Foucquier, S. Robert, F. Suard, L. Stéphan, and A. Jay State of the art in building modelling and energy performances prediction: a review Renew. Sustain. Energy Rev. 23 0 2013 272 288
18. H. xiang Zhao, and F. Magoulès A review on the prediction of building energy consumption Renew. Sustain. Energy Rev. 16 6 2012 3586 3592
19. D. Ernst, M. Glavic, F. Capitanescu, and L. Wehenkel Reinforcement learning versus model predictive control: a comparison on a power system problem IEEE Trans. Syst. Man Cybern. B: Cybern. 39 2 2009 517 529
20. R. Crites, and A. Barto Improving elevator performance using reinforcement learning in: Advances in Neural Information Processing Systems, vol. 8 1996 MIT Press 1017 1023
21. H. Ammar, D. Mocanu, M. Taylor, K. Driessens, K. Tuyls, and G. Weiss Automatically mapped transfer between reinforcement learning tasks via three-way restricted Boltzmann machines in: Machine Learning and Knowledge Discovery in Databases, Vol. 8189 of Lecture Notes in Computer Science 2013 449 464
22. B. Sallans, and G.E. Hinton Reinforcement learning with factored states and actions J. Mach. Learn. Res. 5 2004 1063 1088
23. N. Heess, D. Silver, and Y.W. Teh Actor-critic reinforcement learning with energy-based policies JMLR Workshop and Conference Proceedings: EWRL 2012 2012
24. V. Mnih, K. Kavukcuoglu, D. Silver, A.A. Rusu, J. Veness, M.G. Bellemare, A. Graves, M. Riedmiller, A.K. Fidjeland, G. Ostrovski, S. Petersen, C. Beattie, A. Sadik, I. Antonoglou, H. King, D. Kumaran, D. Wierstra, S. Legg, and D. Hassabis Human-level control through deep reinforcement learning Nature 518 7540 2015 529 533
25. R.S. Sutton, and A.G. Barto Introduction to Reinforcement Learning 1st ed. 1998 MIT Press Cambridge, MA, USA
26. C.J.C.H. Watkins, and P. Dayan Technical note: Q-learning J. Mach. Learn. Res. 8 3-4 1992 279 292
27. Y. Bengio Learning deep architectures for AI Found. Trends Mach. Learn. 2 1 2009 1 127 also published as a book. Now Publishers, 2009
28. M. Wiering, and M. van Otterlo Reinforcement Learning: State-of-the-Art 2012 Springer
29. L. Busoniu, D. Ernst, B. De Schutter, R. Babuska, Approximate reinforcement learning: an overview, in: 2011 IEEE Symposium on Adaptive Dynamic Programming And Reinforcement Learning (ADPRL), 2011, pp. 1-8.
30. M.L. Puterman Markov Decision Processes: Discrete Stochastic Dynamic Programming 1st ed. 1994 John Wiley & Sons, Inc. New York, NY, USA
31. M. Castronovo, F. Maes, R. Fonteneau, and D. Ernst Learning exploration/exploitation strategies for single trajectory reinforcement learning in: EWRL, Vol. 24 of JMLR Proceedings 2012 1 10
32. G. Hinton, and R. Salakhutdinov Reducing the dimensionality of data with neural networks Science 313 5786 2006 504 507
33. G.E. Hinton, S. Osindero, and Y.-W. Teh A fast learning algorithm for deep belief nets Neural Comput. 18 7 2006 1527 1554
34. G.W. Taylor, G.E. Hinton, and S.T. Roweis Two distributed-state models for generating high-dimensional time series J. Mach. Learn. Res. 12 2011 1025 1068
35. L.J. van der Maaten, E.O. Postma, and H.J. van den Herik Dimensionality reduction: a comparative review J. Mach. Learn. Res. 10 1-41 2009 66 71
36. G.E. Hinton, and S. Osindero A fast learning algorithm for deep belief nets Neural Comput. 18 2006 2006
37. G.E. Hinton Training products of experts by minimizing contrastive divergence Neural Comput. 14 8 2002 1771 1800
38. R. Salakhutdinov Learning deep boltzmann machines using adaptive MCMC Proceedings of the 27th International Conference on Machine Learning (ICML-10) Haifa, Israel 2010 943 950
39. B.G.E. Company. http://www.supplier.bge.com (last visit 17.10.15).
40. F.J. Massey The Kolmogorov-Smirnov test for goodness of fit J. Am. Stat. Assoc. 46 253 1951 68 78
41. G.E. Hinton A practical guide to training restricted Boltzmann machines in: Neural Networks: Tricks of the Trade, Lecture Notes in Computer Science 2nd ed. 2012 Springer 599 619
42. J.R.K. Susan, J. Devlin, and R. Gnanadesikan Robust estimation and outlier detection with correlation coefficients Biometrika 62 3 1975 531 545