Real time optimal feeding in a fermentor using a Markov decision algorithm

Computers and Chemical Engineering

Volumn 22, Issue 4-5, 1998, Pages 547-558

  Saucedo, Victor M ^a,b   Nazmul Karim, M ^a  

^a Department of Environmental and Radiological Health Sciences   (United States)

^b AUBURN UNIVERSITY   (United States)

Author keywords

Fed batch fermentations; Markov decision processes; Real time optimization

Indexed keywords

ALGORITHMS; ETHANOL; FERMENTERS; MARKOV PROCESSES; OPTIMAL CONTROL SYSTEMS; OPTIMIZATION; PROCESS CONTROL; REAL TIME SYSTEMS;

MARKOV DECISION PROCESS;

FERMENTATION;

EID: 0032043017     PISSN: 00981354     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0098-1354(97)00236-6     Document Type: Article

References (32)

1. Andersson, L., Stradenberg, L., Haggstrom, L. and Enfors, S. (1994) Modeling of high cell density fedbatch cultivation. FEMS Microbiol. Rev. 14, 39-44.
2. Bellman, R. (1957) Dynamic Programming. Princeton University Press, NJ.
3. Bertsekas, D. (1987) Dynamic Programming: Deterministic and Stochastic Models. Prentice Hall, Englewood Cliffs, NJ.
4. Diener, A. and Goldschmidt, B. (1994) Suboptimal control of fed-batch bioprocesses using phase properties. J. Biotechnol. 33, 71-85.
5. Havre, L. (1983) A note on optimal maintenance policies for deciding whether to repair or replace. Eur. J. Oper. Res. 12, 171-175.
6. Hilary, A. (1992) Structured mathematical modeling and optimization of xylose fermentation by a recombinant Escherichia coli. PhD thesis, Colorado State University, Fort Collins, CO.
7. Hilary, A., Karim, M. and Guyre, D. (1994) Optimization of an industrial microalgae fermentation. Biotechnol. Bioeng. 43, 314-320.
8. Hilary, A., Karim, M. and Linden, J. (1994) Comparison of ethanol production from xylose by a recombinant Escherichia coli in batch, fed-batch and continuous fermentations. J. Gen. Appl. Microbiol. 40, 463-467.
9. Howard, R. (1960) Dynamic Programming and Markov Processes. MIT Press, MA.
10. Ignall, E. and Kolesar, P. (1974) Optimal dispatching of an infinite-capacity shuttle: control at a single terminal. Oper. Res. 22, 1008-1024.
11. Ingram, L. and Conway, T. (1988) Expression of different levels of ethanologenic enzymes from Zymomonas mobilis in recombinant strains of Escherichia coli. Appl. Environ. Microbiol. 54(3), 397-403.
12. Kan, A. and Timmer, G. (1987) Stochastic global optimization methods, part I: clustering methods. Math. Programming 39, 27-56.
13. Kushner, H. and Dupuis, P., Numerical Methods for Stochastic Control Problems in Continuous Time. Springer-Verlag, New York, NY (1992).
14. Mendelssohn, R. (1978) Optimal harvesting strategies for stochatic single-species, multistage class models. Math. Biosci. 41, 159-174.
15. Modak, J., Lim, H. and Tayeb, Y. (1986) General characteristics of optimal feed rate profiles for various fed-batch fermentation processes. Biotechnol. Bioeng. 28, 1396-1407.
16. Ohta, K., Alterthum, F. and Ingram, L. (1990) Effects of environmental conditions on xylose fermentation by recombinant Escherichia coli. Appl. Environ. Microbiol. 56(2), 463-465.
17. Olsson, L., Hahn-Hagerdal, B. and Zacchi, G. (1995) Kinetics of ethanol production by recombinant E. coli KO11. Biotechnol. Bioeng. 45, 356-365.
18. Park, T., Seo, J. and Lim, H. (1989) Optimization of fermentation processes using recombinant Escherichia coli, with the cloned trp Operon. Biotechnol. Bioeng. 34, 1167-1177.
19. Press, W., Teukolsky, S., Vetterling, W. and Flannery, B. (1992) Numerical Recipes in C. Cambridge University Press, New York, NY.
20. Puterman, M. (1994) Markov Decision Processes. John Wiley, New York, NY.
21. San, K. and Stephanopoulos, G. (1989) Optimization of fed-batch penicillin fermentation: a case of singular optimal control with state constraints. Biotechnol. Bioeng. 34, 72-78.
22. Saucedo, V. (1995). On-line optimization of fed-batch fermentations using Markov decision processes. PhD thesis, Colorado State University, Fort Collins, CO.
23. Saucedo, V. and Karim, M. (In press) A decreasing feeding profile for the optimization of a fed-batch fermentation. Biotechnol. Lett.
24. Solis, F. and Wets, R. (1981) Minimization by random search techniques. Math. Oper. Res. 6(1), 19.
25. Stengos, D. and Thomas, L. (1980) The blast furnaces problem. Eur. J. Oper. Res. 4, 330-336.
26. Stuckman, B. (1988) A global search method for optimizing nonlinear systems. IEEE Trans. Syst. Man Cybernetics 18(6), 965-975.
27. Stuckman, B. and Easom, E. (1992) A comparison of Bayesian/sampling global optimization techniques. IEEE Trans. Syst. Man and Cybernetics 22(5), 1024-1032.
28. Szidarovszky, F. and Bahill, A. (1992) Linear Systems Theory. CRC Press, Boca Raton, FL.
29. Tijms, H. (1986) Stochastic Modelling and Analysis: A computational Approach. John Wiley, New York, NY.
30. Tijms, H. and van der Duyn Scheuten, F. (1984) A Markov decision algorithm for optimal inspections and revisions in a maintenance system with partial information. Eur. J. Oper. Res. 21, 245-253.
31. White, D. (1985) Real applications of Markov decision processes. Interfaces 15(6), 73-83.
32. White, D. (1993) A survey of applications of Markov decision processes. J. Oper. Res. Soc. 44(11), 1073-1096.