Adaptive Soft Sensor Development Based on Online Ensemble Gaussian Process Regression for Nonlinear Time-Varying Batch Processes

Industrial and Engineering Chemistry Research

Volumn 54, Issue 30, 2015, Pages 7320-7345

  Jin, Huaiping ^a   Chen, Xiangguang ^a   Wang, Li ^a   Yang, Kai ^a   Wu, Lei ^a  

^a BEIJING INSTITUTE OF TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; FERMENTATION; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); INFERENCE ENGINES; MIXTURES; PROCESS CONTROL; SOCIAL NETWORKING (ONLINE); STATISTICAL TESTS;

GAUSSIAN PROCESS REGRESSION; PENICILLIN FERMENTATION PROCESS; POSTERIOR PROBABILITY; PREDICTION UNCERTAINTY; PREDICTIVE DISTRIBUTIONS; PROBABILISTIC ANALYSIS; TIME VARYING BEHAVIOR; TIME-VARYING CHANGES;

BATCH DATA PROCESSING;

EID: 84938633868     PISSN: 08885885     EISSN: 15205045     Source Type: Journal    
DOI: 10.1021/acs.iecr.5b01495     Document Type: Article

References (92)

1. Cinar, A.; Parulekar, S. J.; Undey, C.; Birol, G. Batch Fermentation: Modeling: Monitoring, and Control; CRC Press: New York, 2003.
2. Weber, R.; Brosilow, C. The use of secondary measurements to improve control AIChE J. 1972, 18, 614-623 10.1002/aic.690180323
3. Joseph, B.; Brosilow, C. B. Inferential control of processes: Part I. Steady state analysis and design AIChE J. 1978, 24, 485-492 10.1002/aic.690240313
4. Brosilow, C.; Tong, M. Inferential control of processes: Part II. The structure and dynamics of inferential control systems AIChE J. 1978, 24, 492-500 10.1002/aic.690240314
5. Joseph, B.; Brosilow, C. Inferential control of processes: Part III. Construction of optimal and suboptimal dynamic estimators AIChE J. 1978, 24, 500-509 10.1002/aic.690240315
6. Tham, M. T.; Montague, G. A.; Morris, A. J.; Lant, P. A. Soft-sensors for process estimation and inferential control J. Process Control 1991, 1, 3-14 10.1016/0959-1524(91)87002-F
7. Kresta, J.; Marlin, T.; MacGregor, J. Development of inferential process models using PLS Comput. Chem. Eng. 1994, 18, 597-611 10.1016/0098-1354(93)E0006-U
8. Park, S.; Han, C. A nonlinear soft sensor based on multivariate smoothing procedure for quality estimation in distillation columns Comput. Chem. Eng. 2000, 24, 871-877 10.1016/S0098-1354(00)00343-4
9. Fortuna, L.; Graziani, S.; Rizzo, A.; Xibilia, M. G. Soft sensors for monitoring and control of industrial processes; Springer-Verlag: London, 2007.
10. Lin, B.; Recke, B.; Knudsen, J. K.; Jørgensen, S. B. A systematic approach for soft sensor development Comput. Chem. Eng. 2007, 31, 419-425 10.1016/j.compchemeng.2006.05.030
11. Kano, M.; Nakagawa, Y. Data-based process monitoring, process control, and quality improvement: Recent developments and applications in steel industry Comput. Chem. Eng. 2008, 32, 12-24 10.1016/j.compchemeng.2007.07.005
12. Kadlec, P.; Gabrys, B.; Strandt, S. Data-driven soft sensors in the process industry Comput. Chem. Eng. 2009, 33, 795-814 10.1016/j.compchemeng.2008.12.012
13. Kano, M.; Fujiwara, K. Virtual sensing technology in process industries: trends and challenges revealed by recent industrial applications J. Chem. Eng. Jpn. 2013, 46, 1-17 10.1252/jcej.12we167
14. Jolliffe, I. T. Principal component analysis, 2 nd ed.; Springer: New York, 2002.
15. Fujiwara, K.; Kano, M.; Hasebe, S.; Takinami, A. Soft-sensor development using correlation-based just-in-time modeling AIChE J. 2009, 55, 1754-1765 10.1002/aic.11791
16. Ge, Z.; Song, Z.; Kano, M. External analysis-based regression model for robust soft sensing of multimode chemical processes AIChE J. 2014, 60, 136-147 10.1002/aic.14253
17. Ge, Z.; Huang, B.; Song, Z. Mixture semisupervised principal component regression model and soft sensor application AIChE J. 2014, 60, 533-545 10.1002/aic.14270
18. Wold, S.; Sjöström, M.; Eriksson, L. PLS-regression: a basic tool of chemometrics Chemom. Intell. Lab. Syst. 2001, 58, 109-130 10.1016/S0169-7439(01)00155-1
19. Kadlec, P.; Gabrys, B. Local learning-based adaptive soft sensor for catalyst activation prediction AIChE J. 2011, 57, 1288-1301 10.1002/aic.12346
20. Ni, W.; Tan, S. K.; Ng, W. J.; Brown, S. D. Localized, adaptive recursive partial least squares regression for dynamic system modeling Ind. Eng. Chem. Res. 2012, 51, 8025-8039 10.1021/ie203043q
21. Ni, W.; Br own, S. D.; Man, R. A localized adaptive soft sensor for dynamic system modeling Chem. Eng. Sci. 2014, 111, 350-363 10.1016/j.ces.2014.03.002
22. Kim, S.; Kano, M.; Hasebe, S.; Takinami, A.; Seki, T. Long-Term Industrial Applications of Inferential Control Based on Just-In-Time Soft-Sensors: Economical Impact and Challenges Ind. Eng. Chem. Res. 2013, 52, 12346-12356 10.1021/ie303488m
23. Jin, H.; Chen, X.; Yang, J.; Wang, L.; Wu, L. Online local learning based adaptive soft sensor and its application to an industrial fed-batch chlortetracycline fermentation process Chemom. Intell. Lab. Syst. 2015, 143, 58-78 10.1016/j.chemolab.2015.02.018
24. Shao, W.; Tian, X.; Wang, P. Local partial least squares based online soft sensing method for multi-output processes with adaptive process states division Chin. J. Chem. Eng. 2014, 22, 828-836 10.1016/j.cjche.2014.05.003
25. Shao, W.; Tian, X. Adaptive Soft Sensor for Quality Prediction of Chemical Processes Based on Selective Ensemble of Local Partial Least Squares Models Chem. Eng. Res. Des. 2015, 95, 113-132 10.1016/j.cherd.2015.01.006
26. Kaneko, H.; Arakawa, M.; Funatsu, K. Development of a new soft sensor method using independent component analysis and partial least squares AIChE J. 2009, 55, 87-98 10.1002/aic.11648
27. Ge, Z.; Song, Z. Ensemble independent component regression models and soft sensing application Chemom. Intell. Lab. Syst. 2014, 130, 115-122 10.1016/j.chemolab.2013.09.009
28. Ge, Z.; Song, Z.; Wang, P. Probabilistic combination of local independent component regression model for multimode quality prediction in chemical processes Chem. Eng. Res. Des. 2014, 92, 509-521 10.1016/j.cherd.2013.09.010
29. Yuan, X.; Ge, Z.; Song, Z. Locally Weighted Kernel Principal Component Regression Model for Soft Sensing of Nonlinear Time-Variant Processes Ind. Eng. Chem. Res. 2014, 53, 13736-13749 10.1021/ie4041252
30. Rosipal, R.; Trejo, L. J. Kernel partial least squares regression in reproducing kernel hilbert space Journal of Machine Learning Research 2001, 2, 97-123
31. Yu, J. Multiway Gaussian mixture model based adaptive kernel partial least squares regression method for soft sensor estimation and reliable quality prediction of nonlinear multiphase batch processes Ind. Eng. Chem. Res. 2012, 51, 13227-13237 10.1021/ie3020186
32. Jin, H.; Chen, X.; Yang, J.; Wu, L. Adaptive soft sensor modeling framework based on just-in-time learning and kernel partial least squares regression for nonlinear multiphase batch processes Comput. Chem. Eng. 2014, 71, 77-93 10.1016/j.compchemeng.2014.07.014
33. Gonzaga, J.; Meleiro, L.; Kiang, C.; Maciel Filho, R. ANN-based soft-sensor for real-time process monitoring and control of an industrial polymerization process Comput. Chem. Eng. 2009, 33, 43-49 10.1016/j.compchemeng.2008.05.019
34. Niu, D.-p.; Wang, F.-l.; Zhang, L.-l.; He, D.-k.; Jia, M.-x. Neural network ensemble modeling for nosiheptide fermentation process based on partial least squares regression Chemom. Intell. Lab. Syst. 2011, 105, 125-130 10.1016/j.chemolab.2010.11.007
35. Cui, L.; Xie, P.; Sun, J.; Yu, T.; Yuan, J. Data-driven prediction of the product formation in industrial 2-keto-L-gulonic acid fermentation Comput. Chem. Eng. 2012, 36, 386-391 10.1016/j.compchemeng.2011.06.012
36. Desai, K.; Badhe, Y.; Tambe, S. S.; Kulkarni, B. D. Soft-sensor development for fed-batch bioreactors using support vector regression Biochem. Eng. J. 2006, 27, 225-239 10.1016/j.bej.2005.08.002
37. Jain, P.; Rahman, I.; Kulkarni, B. Development of a soft sensor for a batch distillation column using support vector regression techniques Chem. Eng. Res. Des. 2007, 85, 283-287 10.1205/cherd05026
38. Yu, J. A Bayesian inference based two-stage support vector regression framework for soft sensor development in batch bioprocesses Comput. Chem. Eng. 2012, 41, 134-144 10.1016/j.compchemeng.2012.03.004
39. Kaneko, H.; Funatsu, K. Application of online support vector regression for soft sensors AIChE J. 2014, 60, 600-612 10.1002/aic.14299
40. Kaneko, H.; Funatsu, K. Adaptive soft sensor based on online support vector regression and Bayesian ensemble learning for various states in chemical plants Chemom. Intell. Lab. Syst. 2014, 137, 57-66 10.1016/j.chemolab.2014.06.008
41. Jin, H.; Chen, X.; Yang, J.; Zhang, H.; Wang, L.; Wu, L. Multi-model adaptive soft sensor modeling method using local learning and online support vector regression for nonlinear time-variant batch processes Chem. Eng. Sci. 2015, 131, 282-303 10.1016/j.ces.2015.03.038
42. Liu, Y.; Gao, Z.; Li, P.; Wang, H. Just-in-time kernel learning with adaptive parameter selection for soft sensor modeling of batch processes Ind. Eng. Chem. Res. 2012, 51, 4313-4327 10.1021/ie201650u
43. Liu, Y.; Chen, J. Integrated soft sensor using just-in-time support vector regression and probabilistic analysis for quality prediction of multi-grade processes J. Process Control 2013, 23, 793-804 10.1016/j.jprocont.2013.03.008
44. Rasmussen, C.; Williams, C. Gaussian processes for machine learning; MIT Press: London, 2006.
45. Li, X.; Su, H.; Chu, J. Multiple model soft sensor based on affinity propagation, gaussian process and bayesian committee machine Chin. J. Chem. Eng. 2009, 17, 95-99 10.1016/S1004-9541(09)60039-2
46. Chen, T.; Ren, J. Bagging for Gaussian process regression Neurocomputing 2009, 72, 1605-1610 10.1016/j.neucom.2008.09.002
47. Yu, J. Online quality prediction of nonlinear and non-Gaussian chemical processes with shifting dynamics using finite mixture model based Gaussian process regression approach Chem. Eng. Sci. 2012, 82, 22-30 10.1016/j.ces.2012.07.018
48. Yu, J.; Chen, K.; Rashid, M. M. A Bayesian model averaging based multi-kernel Gaussian process regression framework for nonlinear state estimation and quality prediction of multiphase batch processes with transient dynamics and uncertainty Chem. Eng. Sci. 2013, 93, 96-109 10.1016/j.ces.2013.01.058
49. Grbić, R.; Slišković, D.; Kadlec, P. Adaptive soft sensor for online prediction and process monitoring based on a mixture of Gaussian process models Comput. Chem. Eng. 2013, 58, 84-97 10.1016/j.compchemeng.2013.06.014
50. Liu, Y.; Gao, Z. Real-time property prediction for an industrial rubber-mixing process with probabilistic ensemble Gaussian process regression models. J. Appl. Polym. Sci. 2015, 132, http://dx.doi.org/10.1002/app.41432, 10.1002/app.41432.
51. Liu, Y.; Gao, Z. Industrial melt index prediction with the ensemble anti-outlier just-in-time Gaussian process regression modeling method. J. Appl. Polym. Sci. 2015, 132, http://dx.doi.org/10.1002/app.41958, 10.1002/app.41958.
52. Soares, S.; Araújo, R.; Sousa, P.; Souza, F. Design and application of soft sensor using ensemble methods. 2011 IEEE 16th Conference on Emerging Technologies & Factory Automation (ETFA, Toulouse, France, September 5-9, 2011; pp 1-8.
53. Atkeson, C. G.; Moore, A. W.; Schaal, S. 1997. Locally weighted learning Artificial Intelligence Review 1997, 11, 11-73 10.1023/A:1006559212014
54. Schaal, S.; Atkeson, C. G.; Vijayakumar, S. Scalable techniques from nonparametric statistics for real time robot learning Applied Intelligence 2002, 17, 49-60 10.1023/A:1015727715131
55. Cheng, C.; Chiu, M.-S. A new data-based methodology for nonlinear process modeling Chem. Eng. Sci. 2004, 59, 2801-2810 10.1016/j.ces.2004.04.020
56. Chen, K.; Ji, J.; Wang, H.; Liu, Y.; Song, Z. Adaptive local kernel-based learning for soft sensor modeling of nonlinear processes Chem. Eng. Res. Des. 2011, 89, 2117-2124 10.1016/j.cherd.2011.01.032
57. Kano, M.; Ogawa, M. The state of the art in chemical process control in Japan: Good practice and questionnaire survey J. Process Control 2010, 20, 969-982 10.1016/j.jprocont.2010.06.013
58. Tsymbal, A. The problem of concept drift: definitions and related work. Technical Report; Department of Computer Science, Trinity College Dublin, The University of Dublin: Ireland, 2004.
59. Kadlec, P.; Grbić, R.; Gabrys, B. Review of adaptation mechanisms for data-driven soft sensors Comput. Chem. Eng. 2011, 35, 1-24 10.1016/j.compchemeng.2010.07.034
60. Kaneko, H.; Funatsu, K. Classification of the degradation of soft sensor models and discussion on adaptive models AIChE J. 2013, 59, 2339-2347 10.1002/aic.14006
61. Wang, X.; Kruger, U.; Irwin, G. W. Process monitoring approach using fast moving window PCA Ind. Eng. Chem. Res. 2005, 44, 5691-5702 10.1021/ie048873f
62. Ni, W.; Tan, S. K.; Ng, W. J.; Brown, S. D. Moving-window GPR for nonlinear dynamic system modeling with dual updating and dual preprocessing Ind. Eng. Chem. Res. 2012, 51, 6416-6428 10.1021/ie201898a
63. Grbic, R.; Sliskovic, D.; Kadlec, P. Adaptive soft sensor for online prediction based on moving window Gaussian process regression. 2012 11th International Conference on Machine Learning and Applications (ICMLA), Boca Raton, Florida, USA, December 12-15, 2012; pp 428-433.
64. Kaneko, H.; Funatsu, K. Moving window and just-in-time soft sensor model based on time differences considering a small number of measurements Ind. Eng. Chem. Res. 2015, 54, 700-704 10.1021/ie503962e
65. Qin, S. J. Recursive PLS algorithms for adaptive data modeling Comput. Chem. Eng. 1998, 22, 503-514 10.1016/S0098-1354(97)00262-7
66. Mu, S.; Zeng, Y.; Liu, R.; Wu, P.; Su, H.; Chu, J. Online dual updating with recursive PLS model and its application in predicting crystal size of purified terephthalic acid (PTA) process J. Process Control 2006, 16, 557-566 10.1016/j.jprocont.2005.11.004
67. Ahmed, F.; Nazir, S.; Yeo, Y. K. A recursive PLS-based soft sensor for prediction of the melt index during grade change operations in HDPE plant Korean J. Chem. Eng. 2009, 26, 14-20 10.1007/s11814-009-0003-3
68. Kaneko, H.; Funatsu, K. Maintenance-free soft sensor models with time difference of process variables Chemom. Intell. Lab. Syst. 2011, 107, 312-317 10.1016/j.chemolab.2011.04.016
69. Kaneko, H.; Funatsu, K. A soft sensor method based on values predicted from multiple intervals of time difference for improvement and estimation of prediction accuracy Chemom. Intell. Lab. Syst. 2011, 109, 197-206 10.1016/j.chemolab.2011.09.003
70. Kaneko, H.; Funatsu, K. Database monitoring index for adaptive soft sensors and the application to industrial process AIChE J. 2014, 60, 160-169 10.1002/aic.14260
71. Chen, M.; Khare, S.; Huang, B. A unified recursive just-in-time approach with industrial near infrared spectroscopy application Chemom. Intell. Lab. Syst. 2014, 135, 133-140 10.1016/j.chemolab.2014.04.007
72. Liu, J. On-line soft sensor for polyethylene process with multiple production grades Control Engineering Practice 2007, 15, 769-778 10.1016/j.conengprac.2005.12.005
73. Xie, L.; Zeng, J.; Gao, C. Novel just-in-time learning-based soft sensor utilizing non-Gaussian information IEEE Transactions on Control Systems Technology 2014, 22, 360-368 10.1109/TCST.2013.2248155
74. Bishop, C. M. Pattern recognition and machine learning; The MIT Press: London, 2006.
75. Tian, H.-X.; Mao, Z.-Z. An ensemble ELM based on modified AdaBoost. RT algorithm for predicting the temperature of molten steel in ladle furnace IEEE Transactions on Automation Science and Engineering 2010, 7, 73-80 10.1109/TASE.2008.2005640
76. Khatibisepehr, S.; Huang, B.; Khare, S. Design of inferential sensors in the process industry: A review of Bayesian methods J. Process Control 2013, 23, 1575-1596 10.1016/j.jprocont.2013.05.007
77. Soares, S. G.; Araújo, R. A dynamic and on-line ensemble regression for changing environments Expert Systems with Applications 2015, 42, 2935-2948 10.1016/j.eswa.2014.11.053
78. Gomes Soares, S.; Araújo, R. An on-line weighted ensemble of regressor models to handle concept drifts Engineering Applications of Artificial Intelligence 2015, 37, 392-406 10.1016/j.engappai.2014.10.003
79. Kaneko, H.; Arakawa, M.; Funatsu, K. Applicability domains and accuracy of prediction of soft sensor models AIChE J. 2011, 57, 1506-1513 10.1002/aic.12351
80. Kaneko, H.; Funatsu, K. Estimation of predictive accuracy of soft sensor models based on data density Chemom. Intell. Lab. Syst. 2013, 128, 111-117 10.1016/j.chemolab.2013.08.005
81. Frühwirth-Schnatter, S. Finite mixture and Markov switching models; Springer-Verlag: New York, 2006.
82. Fan, M.; Ge, Z.; Song, Z. Adaptive Gaussian mixture model-based relevant sample selection for JITL soft sensor development Ind. Eng. Chem. Res. 2014, 53, 19979-19986 10.1021/ie5029864
83. Xie, X.; Shi, H. Dynamic multimode process modeling and monitoring using adaptive Gaussian mixture models Ind. Eng. Chem. Res. 2012, 51, 5497-5505 10.1021/ie202720y
84. Van Vaerenbergh, S.; Via, J.; Santamaría, I. A sliding-window kernel RLS algorithm and its application to nonlinear channel identification. 2006 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toulouse, France, May 14-19, 2006; pp V-V.
85. Liu, W.; Principe, J. C.; Haykin, S. Kernel Adaptive Filtering: A Comprehensive Introduction; John Wiley & Sons: Hoboken, NJ, 2011.
86. Chen, L. Z.; Nguang, S. K.; Chen, X. D. Modelling and optimization of biotechnological processes: artificial intelligence approaches; Springer Science & Business Media: 2006.
87. Birol, G.; Ündey, C.; Cinar, A. A modular simulation package for fed-batch fermentation: penicillin production Comput. Chem. Eng. 2002, 26, 1553-1565 10.1016/S0098-1354(02)00127-8
88. Zhao, C.; Wang, F.; Gao, F.; Lu, N.; Jia, M. Adaptive monitoring method for batch processes based on phase dissimilarity updating with limited modeling data Ind. Eng. Chem. Res. 2007, 46, 4943-4953 10.1021/ie061320f
89. Zhao, C.; Wang, F.; Mao, Z.; Lu, N.; Jia, M. Adaptive monitoring based on independent component analysis for multiphase batch processes with limited modeling data Ind. Eng. Chem. Res. 2008, 47, 3104-3113 10.1021/ie701680y
90. Zhao, C.; Wang, F.; Gao, F. Improved calibration investigation using phase-wise local and cumulative quality interpretation and prediction Chemom. Intell. Lab. Syst. 2009, 95, 107-121 10.1016/j.chemolab.2008.09.003
91. Hu, Y.; Ma, H.; Shi, H. Enhanced batch process monitoring using just-in-time-learning based kernel partial least squares Chemom. Intell. Lab. Syst. 2013, 123, 15-27 10.1016/j.chemolab.2013.02.004
92. Jin, H.; Chen, X.; Yang, J.; Wu, L.; Wang, L. Hybrid intelligent control of substrate feeding for industrial fed-batch chlortetracycline fermentation process ISA Trans. 2014, 53, 1822-1837 10.1016/j.isatra.2014.08.015