Online local learning based adaptive soft sensor and its application to an industrial fed-batch chlortetracycline fermentation process

Chemometrics and Intelligent Laboratory Systems

Volumn 143, Issue , 2015, Pages 58-78

  Jin, Huaiping ^a   Chen, Xiangguang ^a   Yang, Jianwen ^a   Wang, Li ^a   Wu, Lei ^a  

^a BEIJING INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Adaptive sample selection; Adaptive soft sensor; Dual updating; Fed batch chlortetracycline fermentation processes; Just in time learning; Local learning

Indexed keywords

CHLORTETRACYCLINE;

ACCURACY; ARTICLE; BIOSENSOR; DATA ANALYSIS; FED BATCH FERMENTATION; INTERMETHOD COMPARISON; MACHINE LEARNING; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MATHEMATICAL PARAMETERS; MUTUAL INFORMATION WEIGHTED; ONLINE ANALYSIS; ONLINE LOCAL LEARNING ADAPTIVE SOFT SENSOR; ONLINE SYSTEM; PREDICTION; PRIORITY JOURNAL; PROBABILITY; PROCESS DEVELOPMENT; PROCESS OPTIMIZATION; RELIABILITY; VALIDATION PROCESS;

EID: 84924229688     PISSN: 01697439     EISSN: 18733239     Source Type: Journal    
DOI: 10.1016/j.chemolab.2015.02.018     Document Type: Article

References (92)

1. Fortuna L., Graziani S., Rizzo A., Xibilia M.G. Soft Sensors for Monitoring and Control of Industrial Processes 2007, Springer, London.
2. Kadlec P., Gabrys B., Strandt S. Data-driven soft sensors in the process industry. Comput. Chem. Eng. 2009, 33:795-814.
3. Kano M., Fujiwara K. Virtual sensing technology in process industries: trends and challenges revealed by recent industrial applications. J. Chem. Eng. Jpn. 2013, 46:1-17.
4. Kano M., Nakagawa Y. Data-based process monitoring, process control, and quality improvement: recent developments and applications in steel industry. Comput. Chem. Eng. 2008, 32:12-24.
5. Kim S., Kano M., Hasebe S., Takinami A., Seki T. Long-term industrial applications ofinferential control based on just-in-timesoft-sensors: economical impact and challenges. Ind. Eng. Chem. Res. 2013, 52:12346-12356.
6. Lin B., Recke B., Knudsen J.K., Jørgensen S.B. A systematic approach for soft sensor development. Comput. Chem. Eng. 2007, 31:419-425.
7. Sliskovic D., Grbic R., Hocenski Z. Methods for plant data-based process modeling in soft-sensor development. Automatica 2011, 52:306-318.
8. Jolliffe I.T. Principal Component Analysis 2002, Springer, New York. second ed.
9. Ge Z., Huang B., Song Z. Mixture semisupervised principal component regression model and soft sensor application. AICHE J. 2014, 60:533-545.
10. Ge Z., Song Z., Kano M. External analysis-based regression model for robust soft sensing of multimode chemical processes. AICHE J. 2014, 60:136-147.
11. Sharmin R., Sundararaj U., Shah S., Vande Griend L., Sun Y.-J. Inferential sensors for estimation of polymer quality parameters: industrial application of a PLS-based soft sensor for a LDPE plant. Chem. Eng. Sci. 2006, 61:6372-6384.
12. Wold S., Sjöström M., Eriksson L. PLS-regression: a basic tool of chemometrics. Chemom. Intell. Lab. Syst. 2001, 58:109-130.
13. Ge Z., Song Z. Ensemble independent component regression models and soft sensing application. Chemom. Intell. Lab. Syst. 2014, 130:115-122.
14. Kaneko H., Arakawa M., Funatsu K. Development of a new soft sensor method using independent component analysis and partial least squares. AICHE J. 2009, 55:87-98.
15. Jin H., Chen X., Yang J., Wu L. Adaptive soft sensor modeling framework based on just-in-time learning and kernel partial least squares regression for nonlinear multiphase batch processes. Comput. Chem. Eng. 2014, 71:77-93.
16. Yu J. Multiway Gaussian mixture model based adaptive kernel partial least squares regression method for soft sensor estimation and reliable quality prediction of nonlinear multiphase batch processes. Ind. Eng. Chem. Res. 2012, 51:13227-13237.
17. Zhang X., Yan W., Shao H. Nonlinear multivariate quality estimation and prediction based on kernel partial least squares. Ind. Eng. Chem. Res. 2008, 47:1120-1131.
18. Zhang Y., Ma C. Fault diagnosis of nonlinear processes using multiscale KPCA and multiscale KPLS. Chem. Eng. Sci. 2011, 66:64-72.
19. Yuan X., Ge Z., Song Z. Locally weighted kernel principal component regression model for soft sensing of nonlinear time-variant processes. Ind. Eng. Chem. Res. 2014, 53:13736-13749.
20. Cui L., Xie P., Sun J., Yu T., Yuan J. Data-driven prediction of the product formation in industrial 2-keto-l-gulonic acid fermentation. Comput. Chem. Eng. 2012, 36:386-391.
21. Gonzaga J., Meleiro L., Kiang C., Maciel Filho R. ANN-basedsoft-sensor for real-time process monitoring and control of an industrial polymerization process. Comput. Chem. Eng. 2009, 33:43-49.
22. Jain P., Rahman I., Kulkarni B. Development of a soft sensor for a batch distillation column using support vector regression techniques. Chem. Eng. Res. Des. 2007, 85:283-287.
23. Yu J. A Bayesian inference based two-stage support vector regression framework for soft sensor development in batch bioprocesses. Comput. Chem. Eng. 2012, 41:134-144.
24. Jassar S., Liao Z., Zhao L. Adaptive neuro-fuzzy based inferential sensor model for estimating the average air temperature in space heating systems. Build. Environ. 2009, 44:1609-1616.
25. Chen T., Ren J. Bagging for Gaussian process regression. Neurocomputing 2009, 72:1605-1610.
26. Rasmussen C.E., Williams C.K.I. Gaussian Processes for Machine Learning 2006, The MIT Press, Cambridge, Massachusetts.
27. Yuan X., Ge Z., Song Z. Soft sensor model development in multiphase/multimode processes based on Gaussian mixture regression. Chemom. Intell. Lab. Syst. 2014, 138:97-109.
28. Liu J. On-line soft sensor for polyethylene process with multiple production grades. Control. Eng. Pract. 2007, 15:769-778.
29. Yu J., Chen K., Rashid M.M. A Bayesian model averaging based multi-kernelGaussian process regression framework for nonlinear state estimation and quality prediction of multiphase batch processes with transient dynamics and uncertainty. Chem. Eng. Sci. 2013, 93:96-109.
30. Lu N., Gao F. Stage-based process analysis and quality prediction for batch processes. Ind. Eng. Chem. Res. 2005, 44:3547-3555.
31. Figueiredo M.A., Jain A.K. Unsupervised learning of finite mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 2002, 24:381-396.
32. Yu J. Online quality prediction of nonlinear and non-Gaussian chemical processes with shifting dynamics using finite mixture model based Gaussian process regression approach. Chem. Eng. Sci. 2012, 82:22-30.
33. Li X., Su H., Chu J. Multiple model soft sensor based on affinity propagation, Gaussian process and Bayesian committee machine. Chin. J. Chem. Eng. 2009, 17:95-99.
34. Niu D.-p., Wang F.-l., Zhang L.-l., He D.-k., Jia M.-x. Neural network ensemble modeling for nosiheptide fermentation process based on partial least squares regression. Chemom. Intell. Lab. Syst. 2011, 105:125-130.
35. Cao D.S., Xu Q.S., Liang Y.-Z., Zhang L.-X., Li H.-D. The boosting: a new idea of building models. Chemom. Intell. Lab. Syst. 2010, 100:1-11.
36. Khatibisepehr S., Huang B., Khare S. Design of inferential sensors in the process industry: a review of Bayesian methods. J. Process Control 2013, 23:1575-1596.
37. Kadlec P., Grbić R., Gabrys B. Review of adaptation mechanisms for data-driven soft sensors. Comput. Chem. Eng. 2011, 35:1-24.
38. Kaneko H., Funatsu K. Classification of the degradation of soft sensor models and discussion on adaptive models. AICHE J. 2013, 59:2339-2347.
39. Kano M., Ogawa M. The state of the art in chemical process control in Japan: good practice and questionnaire survey. J. Process Control 2010, 20:969-982.
40. Joe Qin S. Recursive PLS algorithms for adaptive data modeling. Comput. Chem. Eng. 1998, 22:503-514.
41. Ahmed F., Nazir S., Yeo Y.K. A recursive PLS-based soft sensor for prediction of the melt index during grade change operations in HDPE plant. Korean J. Chem. Eng. 2009, 26:14-20.
42. Mu S., Zeng Y., Liu R., Wu P., Su H., Chu J. Online dual updating with recursive PLS model and its application in predicting crystal size of purified terephthalic acid (PTA) process. J. Process Control 2006, 16:557-566.
43. Ni W., Tan S.K., Ng W.J., Brown S.D. Localized, adaptive recursive partial least squares regression for dynamic system modeling. Ind. Eng. Chem. Res. 2012, 51:8025-8039.
44. Ni W., Tan S.K., Ng W.J., Brown S.D. Moving-windowGPR for nonlinear dynamic system modeling with dual updating and dual preprocessing. Ind. Eng. Chem. Res. 2012, 51:6416-6428.
45. Ni W., Brown S.D., Man R. A localized adaptive soft sensor for dynamic system modeling. Chem. Eng. Sci. 2014, 111:350-363.
46. Kaneko H., Funatsu K. Adaptive soft sensor model using online support vector regression with time variable and discussion of appropriate hyperparameter settings and window size. Comput. Chem. Eng. 2013, 58:288-297.
47. Kaneko H., Funatsu K. Application of online support vector regression for soft sensors. AICHE J. 2014, 60:600-612.
48. Wang X., Kruger U., Irwin G.W. Process monitoring approach using fast moving window PCA. Ind. Eng. Chem. Res. 2005, 44:5691-5702.
49. Kaneko H., Funatsu K. Maintenance-free soft sensor models with time difference of process variables. Chemom. Intell. Lab. Syst. 2011, 107:312-317.
50. Deng J., Xie L., Chen L., Khatibisepehr S., Huang B., Xu F., Espejo A. Development and industrial application of soft sensors with on-line Bayesian model updating strategy. J. Process Control 2013, 23:317-325.
51. Kadlec P., Gabrys B. Local learning-based adaptive soft sensor for catalyst activation prediction. AICHE J. 2011, 57:1288-1301.
52. Vijayakumar S., D'souza A., Schaal S. Incremental online learning in high dimensions. Neural Comput. 2005, 17:2602-2634.
53. Grbić R., Slišković D., Kadlec P. Adaptive soft sensor for online prediction and process monitoring based on a mixture of Gaussian process models. Comput. Chem. Eng. 2013, 58:84-97.
54. Kaneko H., Funatsu K. Adaptive soft sensor based on online support vector regression and Bayesian ensemble learning for various states in chemical plants. Chemom. Intell. Lab. Syst. 2014, 135:57-66.
55. Kaneko H., Funatsu K. A soft sensor method based on values predicted from multiple intervals of time difference for improvement and estimation of prediction accuracy. Chemom. Intell. Lab. Syst. 2011, 109:197-206.
56. Atkeson C.G., Moore A.W., Schaal S. Locally weighted learning for control. Lazy Learning 1997, 75-113. Springer, Netherlands. D.W. Aha (Ed.).
57. Bontempi G., Birattari M., Bersini H. Lazy learning for local modelling and control design. Int. J. Control. 1999, 72:643-658.
58. Cheng C., Chiu M.-S. A new data-based methodology for nonlinear process modeling. Chem. Eng. Sci. 2004, 59:2801-2810.
59. Cheng C., Chiu M.-S. Nonlinear process monitoring using JITL-PCA. Chemom. Intell. Lab. Syst. 2005, 76:1-13.
60. Lv Z., Yan X., Jiang Q. Batch process monitoring based on just-in-time learning and multiple-subspace principal component analysis. Chemom. Intell. Lab. Syst. 2014, 137:128-139.
61. Saptoro A. State of the art in the development of adaptive soft sensors based on just-in-time models. Proc. Chem. 2014, 9:226-234.
62. Schaal S., Atkeson C.G., Vijayakumar S. Scalable techniques from nonparametric statistics for real time robot learning. Appl. Intell. 2002, 17:49-60.
63. Xie L., Zeng J., Gao C. Novel just-in-timelearning-based soft sensor utilizing non-Gaussian information. IEEE Trans. Control Syst. Technol. 2014, 22:360-368.
64. Rosipal R., Trejo L.J. Kernel partial least squares regression in reproducing kernel Hilbert space. J. Mach. Learn. Res. 2002, 2:97-123.
65. Wold S. Nonlinear partial least squares modelling II. Spline inner relation. Chemom. Intell. Lab. Syst. 1992, 14:71-84.
66. Schölkopf B., Smola A., Müller K.-R. Kernel principal component analysis. Artificial Neural Networks-ICANN'97 1997, 583-588. Springer, Berlin Heidelberg.
67. Ge Z., Song Z. A comparative study of just-in-time-learning based methods for online soft sensor modeling. Chemom. Intell. Lab. Syst. 2010, 104:306-317.
68. Fujiwara K., Kano M., Hasebe S., Takinami A. Soft-sensor development using correlation-based just-in-time modeling. AICHE J. 2009, 55:1754-1765.
69. Fujiwara K., Kano M., Hasebe S. Development of correlation-based clustering method and its application to software sensing. Chemom. Intell. Lab. Syst. 2010, 101:130-138.
70. Fujiwara K., Kano M., Hasebe S. Development of correlation-based pattern recognition algorithm and adaptive soft-sensor design. Control. Eng. Pract. 2012, 20:371-378.
71. Kim S., Kano M., Nakagawa H., Hasebe S. Estimation of active pharmaceutical ingredients content using locally weighted partial least squares and statistical wavelength selection. Int. J. Pharm. 2011, 421:269-274.
72. Shigemori H., Kano M., Hasebe S. Optimum quality design system for steel products through locally weighted regression model. J. Process Control 2011, 21:293-301.
73. Kim S., Okajima R., Kano M., Hasebe S. Development of soft-sensor using locally weighted PLS with adaptive similarity measure. Chemom. Intell. Lab. Syst. 2013, 124:43-49.
74. Lee D.E., Song J.-H., Song S.-O., Yoon E.S. Weighted support vector machine for quality estimation in the polymerization process. Ind. Eng. Chem. Res. 2005, 44:2101-2105.
75. Chen K., Ji J., Wang H., Liu Y., Song Z. Adaptive local kernel-based learning for soft sensor modeling of nonlinear processes. Chem. Eng. Res. Des. 2011, 89:2117-2124.
76. Wold H. Nonlinear estimation by iterative least squares procedures. Research Papers in Statistics 1966, 411-444. John Wiley and Sons, New York. F.N. David (Ed.).
77. Geladi P., Kowalski B.R. Partial least-squares regression: a tutorial. Anal. Chim. Acta 1986, 185:1-17.
78. Ge Z., Song Z., Gao F. Review of recent research on data-based process monitoring. Ind. Eng. Chem. Res. 2013, 52:3543-3562.
79. Cybenko G. Just-in-time learning and estimation. Identification, Adaptation, Learning: The Science of Learning Models From Data 1996, 423-434. Springer, Berlin. S. Bittanti, G. Picci (Eds.).
80. Birattari M., Bontempi G., Bersini H. Lazy learning meets the recursive least squares algorithm. Adv. Neural Inf. Process. Syst. 1999, 11:375-381.
81. Atkeson C.G., Moore A.W., Schaal S. Locally weighted learning. Artif. Intell. Rev. 1997, 11:11-73.
82. Braun M.W., Rivera D.E., Stenman A. A 'Model-on-Demand' identification methodology for non-linear process systems. Int. J. Control. 2001, 74:1708-1717.
83. Kaneko H., Funatsu K. Database monitoring index for adaptive soft sensors and the application to industrial process. AICHE J. 2014, 60:160-169.
84. François D., Rossi F., Wertz V., Verleysen M. Resampling methods for parameter-free and robust feature selection with mutual information. Neurocomputing 2007, 70:1276-1288.
85. Chen J., Yu J., Mori J., Rashid M.M., Hu G., Yu H., Flores-Cerrillo J., Megan L. A non-Gaussian pattern matching based dynamic process monitoring approach and its application to cryogenic air separation process. Comput. Chem. Eng. 2013, 58:40-53.
86. Rashid M.M., Yu J. Nonlinear and non-Gaussian dynamic batch process monitoring using a new multiway kernel independent component analysis and multidimensional mutual information based dissimilarity approach. Ind. Eng. Chem. Res. 2012, 51:10910-10920.
87. Rashid M.M., Yu J. A new dissimilarity method integrating multidimensional mutual information and independent component analysis for non-Gaussian dynamic process monitoring. Chemom. Intell. Lab. Syst. 2012, 115:44-58.
88. Kraskov A., Stögbauer H., Grassberger P. Estimating mutual information. Phys. Rev. E 2004, 69:066138.
89. Wang Z., Isaksson T., Kowalski B.R. New approach for distance measurement in locally weighted regression. Anal. Chem. 1994, 66:249-260.
90. Liu R.L. Studies on Soft Sensor Technology and Their Applications to Industrial Processes 2004, Zhejiang University, China, [PhD dissertation].
91. Chen M., Khare S., Huang B. A unified recursive just-in-time approach with industrial near infrared spectroscopy application. Chemom. Intell. Lab. Syst. 2014, 135:133-140.
92. Jin H., Chen X., Yang J., Wu L., Wang L. Hybrid intelligent control of substrate feeding for industrial fed-batch chlortetracycline fermentation process. ISA Trans. 2014, 53:1822-1837.