Dynamic energy control for energy efficiency improvement of sustainable manufacturing systems using markov decision process

IEEE Transactions on Systems, Man, and Cybernetics: Systems

Volumn 43, Issue 5, 2013, Pages 1-11

  Li, Lin ^a   Sun, Zeyi ^a  

^a University of Illinois   (United States)

Author keywords

Energy efficiency improvement; Markov decision process (mdp); Sustainable manufacturing systems

Indexed keywords

CARBON DIOXIDE; ELECTRIC POWER GENERATION; ENERGY UTILIZATION; GAS EMISSIONS; GLOBAL WARMING; GREENHOUSE GASES; INDUSTRIAL RESEARCH; MANUFACTURE; MARKOV PROCESSES; REAL TIME SYSTEMS;

APPROXIMATE ALGORITHMS; ENERGY EFFICIENCY IMPROVEMENTS; INDUSTRIAL MANUFACTURING; MARKOV DECISION PROCESSES; NEAR-OPTIMAL SOLUTIONS; PRODUCTION CONSTRAINTS; REAL-TIME APPLICATION; SUSTAINABLE MANUFACTURING;

ENERGY EFFICIENCY;

EID: 84887085406     PISSN: 10834427     EISSN: 21682232     Source Type: Journal    
DOI: None     Document Type: Article

References (42)

1. Energy Information Administration. (Sep. 2012). Energy Information Administration/Monthly Energy Review [Online]. Available: www.eia.gov/ totalenergy/data/monthly/pdf/sec2-3.pdf
2. PI White Paper: The PROFlenergy Profile (Mar. 2010). [Online]. Available: http://us.profibus.com/docs/PI-PROFIenergy-White-Paper-01.pdf
3. T. Gutowski, C. Murphy, D. Allen, D. Bauer, B. Bras, T. Piwonka, P. Sheng, J. Sutherland, D. Thurston, and E. Wolff, "Environmentally benign manufacturing: Observations from Japan, Europe and the United States," J. Clean Prod., vol. 13, pp. 1-17, 2005.
4. B. Obama and J. Biden. (Dec. 2008). New Energy for America. [Online]. Available: http://www.barackobama.com/pdf/factsheet-energy-speech-080308.pdf
5. C. W. Park, K. S. Kwon, W. B. Kim, B. K. Min, S. J. Park, I. H. Sung, Y. S. Yoon, K. S. Lee, J. H. Lee, and J. Seok, "Energy consumption reduction technology in manufacturing - A selective review of policies, standards, and research," Int. J. Precis. Eng. Man., vol. 10, no. 5, pp. 151-173, 2009.
6. C. Galitsky and E. Worrell, Energy Efficiency Improvement and Cost Saving Opportunities for the Vehicle Assembly Industry, an ENERGY STAR® Guide for Energy and Plant Managers. Berkeley, CA, USA: Ernest Orlando Lawrence Berkeley National Laboratory, Mar. 2008
7. S. Ambani, L. Li, and J. Ni, "Condition-based maintenance decision-making for multiple machine systems," ASME Trans., J. Manuf. Sci. E., vol. 131, no. 3, pp. 031009-1-9, 2009.
8. S. B. Gershwin, Manufacturing Systems Engineering. Englewood Cliffs, NJ, USA: Prentice Hall, 1994.
9. L. Li, Q. Chang, and J. Ni, "Data driven bottleneck detection of manufacturing systems," Int. J. Prod. Res., vol. 47, no. 18, pp. 5019-5036, 2009.
10. J. Wang, M. Zhou, and Y. Deng, "Throughput analysis of discrete event systems based on stochastic Petri Nets," IJICS, vol. 3, no. 3, pp. 343-358, 1999.
11. T. Fleite, D. Fehrenbach, E. Worrell, and W. Eichhammer, "Energy efficiency in the German pulp and paper industry - A model-based assessment of saving potentials," Energy, vol. 40, no. 1, pp. 84-99, 2012.
12. D. Phylipsen, K. Blok, E. Worrell, and J. Beer, "Bench marking the energy efficiency of Dutch industry: An assessment of the expected effect on energy consumption and CO2 emissions," Energy Policy, vol. 30, no. 8, pp. 663-679, 2002.
13. K. Tanaka, "Review of policies and measures for energy efficiency in industry sector," Energy Policy, vol. 39, no. 10, pp. 6532-6550, 2012.
14. F. Drganescu, M. Gheorghe, and C. V. Doicin, "Models of machine tool efficiency and specific consumed energy," J. Mater. Process Technol., vol. 141, no. 1, pp. 9-15, 2003.
15. T. Gutowski, J. Dahmus, and A. Thiriez, "Electrical energy requirements for manufacturing processes," in Proc. 13th CIRP Int. Conf. Life Cycle Eng., Leuven, Belgium, May 31-Jun. 2, 2006, pp. 623-627.
16. J. Dahmus and T. Gutowski, "An environmental analysis of machining," in Proc. ASME IMECE, Anaheim, CA, 2004, pp. 643-652.
17. A. Dietmair and A. Verl, "A generic energy consumption model for decision making and energy efficiency optimization in manufacturing," Int. J. Sust. E., vol. 2, no. 2, pp. 123-133, 2009.
18. W. Li and S. Kara, "An empirical model for predicting energy consumption of manufacturing processes: A case of turning process," Proc. IMechE B, J. Eng. Manuf., vol. 225, pp. 1636-1646, Aug. 22, 2011
19. W. Li, Z. Andre, K. Sami, and H. Christoph, "An investigation into fixed energy consumption of machine tool: Glocalized solutions for sustainability in manufacturing," Proc. 18th CIRP Int. Conf. Life Cycle Eng., Braunschweig, Germany,May 2011, pp. 274-279
20. E. Abele, T. Sielaff, A. Schiffler, and S. Rothenbucher, "Analyzing energy consumption of machine tool spindle units and identification of potential for improvements of efficiency: Glocalized solutions for sustainability in manufacturing," in Proc. 18th CIRP Int. Conf. Life Cycle Eng., Braunschweig, Germany May 2011, pp. 280-285.
21. S. E. Anderberg, S. Kara, and T. Beno, "Impact of energy efficiency on computer numerically controlled machining," Proc. IMechE B, J. Eng. Manuf., vol. 224, no. 4, pp. 531-541, Apr. 2010.
22. G. Mouzon and M. B. Yildirim, "A framework to minimize total energy consumption and total tardiness on a single machine," Int. J. Sust. E., vol. 1, no. 2, pp. 105-116, 2008.
23. Z. Sun, S. Biller, F. Gu, and L. Li, "Energy consumption reduction for sustainable manufacturing systems considering machines with multiple-power states," in Proc. 2011 ASME Int. Manuf. Sci. Eng. Conf. (MSEC), Corvallis, OR, USA, Jun. 13-17, 2011, pp. 99-103.
24. J. Li, S. M. Meerkov, Production Systems Engineering. Livermore, CA, USA: WingSpan, 2008.
25. K. Chatterjee and L. Doyen, "Energy and mean-payoff parity Markov Decision Processes," in Proc. 36th Int. Symp. MFCS, Warsaw, Poland, Aug. 2011, pp. 206-218.
26. M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. Hoboken, NJ, USA: Wiley, 2005.
27. B. Givan and R. Parr. (2001). An Introduction to Markov Decision Processes. [Online]. Available: http://www.cs.rice.edu/$\ sim$vardi/dag01/givan1.pdf
28. B. G. Brown, R. W. Katz, and A. H. Murphy, Case Studies of the Economic Value of Monthly and Seasonal Climate Forecasts, 1: The Planting/Fallowing Problem. Corvallis, OR, USA: Dept. Atmospheric Sci., Oregon State Univ., 1984.
29. D. W. Onstad and R. Rabbinge, "Dynamic programming and the computation of economic injury levels for crop disease control," Agr. Syst., vol. 18, no. 4, pp. 207-226, 1985.
30. J. D. C. Little, "The use of storage water in hydroelectric systems," J. Oper. Res., vol. 3, no. 2, pp. 187-197, 1955.
31. S. Y. Su and R. A. Deininger, "Generalisation of White's method of successive approximation to periodic Markovian Decision Processes," J. Oper. Res., vol. 19, no. 2, pp. 318-326, 1972.
32. D. J. White, "Dynamic programming and systems of uncertain duration," Manage. Sci., vol. 12, no. 1, pp. 37-67, 1965.
33. B. G. Kingsman, "Commodity purchasing," JORS, vol. 20, no. 1, pp. 59-79, 1969.
34. J. M. Norman and D. J. White, "Control of cash reserves," JORS, vol. 16, no. 3, pp. 309-328, 1965.
35. C. Derman, G. J. Lieberman, and S. M. Ross, "A stochastic sequential allocation model," J. Oper. Res., vol. 32, no. 6, pp. 362-379, 1984.
36. L. Li, "Bottleneck detection of complex manufacturing systems using data driven method," Int. J. Prod. Res., vol. 47, no. 24, pp. 6929-6940, 2009.
37. Y. Dai, Y. Zhou, and Y. Jia, "Distribution of time between failures of machining center based on type I censored data," Reliab. Eng. Syst. Safe., vol. 79, no. 3, pp. 377-379, 2003.
38. Y. Zhou, J. Pei, and Y. Qian, "Proximity analysis on the life distribution functions of the high-speed rotating machine," in Proc. 8th Int. Conf. Reliab., Maintainability Safety, Chengdu, China, Jul. 20-24, 2009, pp. 991-994.
39. W. Q. Meeker and L. A. Escobar, Statistical Methods for Reliability Data. New York, NY, USA: Wiley, 1998.
40. R. Bellman, Dynamic Programming. Princeton, NJ, USA: Princeton Univ. Press, 1957.
41. Z. J. Huang and J. Ma, "Solving the curse of dimensionality utilizing action-dependent heuristic dynamic programming," in Proc. CSAE, IEEE Int. Conf., Shanghai, China, Jun. 10-12, 2011, vol. 2, pp. 289-292.
42. B. P. Warren, Approximate Dynamic Programming. Hoboken, NJ, USA: Wiley, 2007.