Robust reinforcement learning for heating, ventilation, and air conditioning control of buildings

Handbook of Learning and Approximate Dynamic Programming

Volumn , Issue , 2004, Pages 517-534

  Anderson, Charles W ^a   Kretchmar, Matt ^a   Hittle, Douglas ^b   Young, Peter ^b  

^a Department of Computer Science   (United States)

^b Department of Mechanical Engineering   (United States)

Author keywords

Artificial neural networks; Coils; Learning; Mathematical model; Robustness; Water heating

Indexed keywords

AIR CONDITIONING; MATHEMATICAL MODELS; NEURAL NETWORKS; ROBUST CONTROL; ROBUSTNESS (CONTROL SYSTEMS);

AIR CONDITIONING CONTROLS; COILS; CONTROL FRAMEWORK; HEATING AND COOLING SYSTEMS; INTERNET LINKS; LEARNING; PROBLEM FORMULATION; WATER HEATING;

REINFORCEMENT LEARNING;

EID: 84927711527     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1109/9780470544785.ch20     Document Type: Chapter

References (42)

1. Ahmed, J. W. Mitchell, and S. A. Klein, Application of general regression neural network (GRNN) in HVAC process identification and control, ASHRAE Trans., vol. 102, no. 1, 1996.
2. C. W. Anderson, D. C. Hittle, A. D. Katz, and R. M. Kretchmar, Synthesis of reinforcement learning, neural networks, and pi control applied to a simulated heating coil, Artificial Intelligence in Engineering, vol. 11, no. 4, pp. 423-431, 1997.
3. G. J. Balas, and P. M. Young, Control design for variations in structural natural frequencies, AIAA Journal of Guidance, Dynamics and Control, vol. 18, pp. 325-332, 1995.
4. G. J. Balas, A. K. Packard, J. C. Doyle, K. Glover, and R. S. Smith, Development of advanced control design software for researchers and engineers, Proc. American Control Conference, pp. 996-1001, Boston, MA, 1991.
5. B. Bamieh and M. Dahleh, Robust stability with structured time-invariant perturbations, Proc. 31st IEEE Conference on Decision and Control, pp. 1987-1990, Tuscon, AZ, 1992.
6. B. R. Barmish, and H. I. Kang, A survey of extreme point results for robustness of control systems, Automatica, vol. 29, pp. 13-35, 1993.
7. E. Bass, and K. Y. Lee, Robust control of nonlinear systems using norm-bounded neural networks, Proc. 1994 IEEE International Conference on Neural Networks, pp. 2524-2529, Orlando, FL, 1994.
8. J. Bekker, P. K. Meckel, and D. Hittle, A tuning method for first order processes with PI controllers, ASHRAE Trans., vol. 97, no. 1,1991.
9. S. Brandt, Adaptive control implementation issues, ASHRAE Trans., vol. 92, no. 2B, pp. 211-219,1986.
10. H. Buschek, and A. J. Calise, Hypersonic flight control system design using fixed order robust controllers, Proc. 6th International Aerospace Planes and Hypersonic Technologies Conference, Nashville, TN, 1995.
11. K. D. Cock, B. D. Moor, W. Minten, W. V. Brempt, and H. Verrelst, A tutorial on PID-control, Technical Report ESAT-SIST/TR1997-08, Katholieke Universiteit, Leuven, 1997.
12. R S. Curtiss, Experimental results from a network-assisted PID controller, ASHRAE Trans., vol. 102, no. 1,1996.
13. P. S. Curtiss, J. K. Kreider, and M. J. Brandemuehl, Adaptive control of HVAC processes using predictive neural networks, ASHRAE Trans., vol. 99, no. 1,1993.
14. P. S. Curtiss, G. Shavit, and J. K. Kreider, Neural networks applied to buildings-a tutorial and case studies in prediction and adaptive control, ASHRAE Trans., vol. 102, no. 1,1996.
15. A. Dexter, and P. Haves, A robust self-tuning predictive controller for HVAC applications, ASHRAE Journal, vol. 32, no. 12, pp. 12-22,1990.
16. J. C. Doyle, Analysis of feedback systems with structured uncertainty, IEEE Proc., vol. 129, no. D, pp. 242-250,1982.
17. J. C. Doyle, Structured uncertainty in control system design, Proc. 24th Conference on Decision and Control, pp. 260-265, Kyoto, Japan, 1985.
18. N. Elia, P. M. Young, and M. A. Dahleh, Robust performance for both fixed and worst case inputs, Proc. 34th IEEE Conference on Decision and Control, pp. 3170-3175, New Orleans, LA, 1995.
19. F. Ferrano, and K. Wong, Prediction of thermal storage loads using a neural network, ASHRAE Trans., vol. 96, no. 2, pp. 723-726,1990.
20. J. S. Haberl, L. K. Norford, and J. V. Spadaro, Diagnosing building operational problems, ASHRAE Journal, vol. 31, no. 6, pp. 20-30,1989.
21. S. J. Hep worth, and A. L. Dexter, Neural control of non-linear HVAC plant, Proc. IEEE Conference on Control Applications, vol. 3, no. 3, pp. 1849-1854, 1994.
22. P. A. Ioannou, and J. Sun, Robust Adaptive Control, Prentice-Hall, Englewood Cliffs, NJ, 1996.
23. M. Khammash, and J. B. Pearson, Performance robustness of discrete-time systems with structured uncertainty, IEEE Trans. Automatic Control, vol. 36, pp. 398-412,1991.
24. A. Megretsky, Necessary and sufficient conditions of stability: A multiloop generalization of the circle criterion, IEEE Trans. Automatic Control, vol. 38, pp.753-760,1993.
25. R. Miller, and J. Seem, Comparison of artificial neural networks with traditional methods of predicting return time from night or weekend setback, ASHRAE Trans., vol. 97,1991.
26. R. M. Kretchmar, A Synthesis of Reinforcement Learning and Robust Control Theory, Ph.D. Thesis, Colorado State University, Department of Computer Science, Fort Collins, CO, 2000.
27. C. G. Nesler and W. F. Stoecker, Selecting the proportional and integral constants in the direct digital control of discharge air temperature, ASHRAE Trans., vol. 90, no. 2B, pp. 834-845,1984.
28. L. K. Norford, A. Allgeier, and J. V. Spadaro, Improved energy information for a building operator-exploring the possibilities of a quasi-real-time knowledge-based system, ASHRAE Trans., vol. 96, no. 1, pp. 1515-1523, 1990.
29. F. Paganini, Necessary and sufficient conditions for robust performance, American Control Conference, pp. 1970-1975, Seattle, WA, 1995.
30. M. Pinella, D. C. Hittle, E. Wechselberger, and C. Pederson, Self-tuning digital integral control, ASHRAE Trans., vol. 92, no. 2B, pp. 202-209, 1986.
31. M. G. Safonov, Stability margins for diagonally perturbed multivariable feedback systems, IEEE Proc., vol. 129, no. D, pp. 251-256, 1982.
32. J. E. Seem, A new pattern recognition adaptive controller, Presented at 13th International Federation of Automatic Control World Congress, San Francisco, CA, 1996.
33. J. Seem, and J. Braun, Adaptive methods for real-time forecasting of building electrical demand, ASHRAE Trans., vol. 97,1991.
34. J. E. Seem, and H. J. Haugstad, Field and laboratory results for a new pattern recognition adaptive controller, Proc. CLIMA 2000 International Conference, p. 77, Brussels, Belgium, 1997.
35. J. S. Shamma, Robust stability with time-varying structured uncertainty, IEEE Trans. Automatic Control, vol. 39, pp. 714-724,1994.
36. R. S. Sutton, and A. G. Barto, Reinforcement Learning: An Introduction, MIT Press, Cambridge, MA, 1998.
37. J. A. K. Suykens, B. L. R. De Moor, and J. Vandewalle, Nonlinear system identification using neural state space models, applicable to robust control design, International Journal of Control, vol. 64, pp. 129-152,1995.
38. D. M. Underwood, and R. R. Crawford, Dynamic nonlinear modeling of a hot-water-to-air heat exchanger for control applications, ASHRAE Trans., vol. 97, no. 1, pp. 149-155,1991.
39. P. J. Werbos, An overview of neural networks for control, Control Systems Magazine, vol. 11, no. 1, pp. 40-41,1991.
40. P. M. Young, Controller Design with Real Parametric Uncertainty, International Journal of Control, vol. 65, pp. 469-509, 1996.
41. p Stability and Performance, Systems & Control Letters, vol. 26, pp. 305-312, 1995.
42. C. Watkins, Learning with Delayed Rewards, Ph.D. Thesis, Cambridge University Psychology Department, Cambridge, UK, 1989.