Multi-model adaptive soft sensor modeling method using local learning and online support vector regression for nonlinear time-variant batch processes

Chemical Engineering Science

Volumn 131, Issue , 2015, Pages 282-303

  Jin, Huaiping ^a   Chen, Xiangguang ^a   Yang, Jianwen ^a   Zhang, Hua ^b   Wang, Li ^a   Wu, Lei ^a  

^a BEIJING INSTITUTE OF TECHNOLOGY   (China)

^b Inner Mongolia Firmaco Hong Yuan Electrical Machine Co Ltd   (China)

Author keywords

Adaptive soft sensor; Batch process; Bayesian ensemble learning; Offset compensation; Online support vector regression; Within batch and between batch time variant changes

Indexed keywords

BATCH DATA PROCESSING; FERMENTATION; PROCESS CONTROL; QUERY PROCESSING; REGRESSION ANALYSIS; SOCIAL NETWORKING (ONLINE);

ADAPTIVE SOFT-SENSOR; BATCH PROCESS; BATCH TIME; ENSEMBLE LEARNING; OFFSET COMPENSATION; ONLINE SUPPORT;

E-LEARNING;

EID: 84928348714     PISSN: 00092509     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ces.2015.03.038     Document Type: Article

References (85)

1. Ahmed F., Nazir S., Yeo Y.K. A recursive PLS-based soft sensor for prediction of the melt index during grade change operations in HDPE plant. Korean J. Chem. Eng. 2009, 26:14-20.
2. Atkeson C.G., Moore A.W., Schaal S. Locally weighted learning for control. Lazy Learning 1997, 75-113. Springer, Netherlands, New York. first ed. D.W. Aha (Ed.).
3. Birol G., Ündey C., Cinar A. A modular simulation package for fed-batch fermentation: penicillin production. Comput. Chem. Eng. 2002, 26:1553-1565.
4. Bishop C.M. Pattern Recognition and Machine Learning 2006, Springer, New York.
5. Bontempi G., Birattari M., Bersini H. Lazy learning for local modelling and control design. Int. J. Control 1999, 72:643-658.
6. Castro-Neto M., Jeong Y.-S., Jeong M.-K., Han L.D. Online-SVR for short-term traffic flow prediction under typical and atypical traffic conditions. Expert Syst. Appl. 2009, 36:6164-6173.
7. Chang C.-C., Lin C.-J. LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2011, 2:27.
8. Chen L.Z., Nguang S.K., Chen X.D. Modelling and Optimization of Biotechnological Processes: Artificial Intelligence Approaches 2006, Springer, Berlin, Heidelberg, New York.
9. Chen T., Ren J. Bagging for Gaussian process regression. Neurocomputing 2009, 72:1605-1610.
10. Cheng C., Chiu M.-S. A new data-based methodology for nonlinear process modeling. Chem. Eng. Sci. 2004, 59:2801-2810.
11. Cheng C., Chiu M.-S. Nonlinear process monitoring using JITL-PCA. Chemom. Intell. Lab. Syst. 2005, 76:1-13.
12. Cinar A., Parulekar S.J., Undey C., Birol G. Batch Fermentation: Modeling: Monitoring, and Control 2003, CRC Press, New York.
13. Cui L., Xie P., Sun J., Yu T., Yuan J. Data-driven prediction of the product formation in industrial 2-keto-l-gulonic acid fermentation. Comput. Chem. Eng. 2012, 36:386-391.
14. Cortes C., Vapnik V. Support-vector networks. Mach. Learn. 1995, 20:273-297.
15. Cybenko G. Just-in-time learning and estimation. Nato Asi Ser. F: Comput. Syst. Sci. 1996, 153:423-434.
16. Desai K., Badhe Y., Tambe S.S., Kulkarni B.D. Soft-sensor development for fed-batch bioreactors using support vector regression. Biochem. Eng. J. 2006, 27:225-239.
17. do Carmo Nicoletti M., Jain L.C. Computational Intelligence Techniques for Bioprocess Modelling, Supervision and Control 2009, Springer-Verlag, Berlin, Heidelberg.
18. Figueiredo M.A., Jain A.K. Unsupervised learning of finite mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 2002, 24:381-396.
19. Fortuna L., Graziani S., Rizzo A., Xibilia M.G. Soft Sensors for Monitoring and Control of Industrial Processes 2007, Springer-Verlag, London.
20. Fujiwara K., Kano M., Hasebe S., Takinami A. Soft-sensor development using c correlation-based just-in-time modeling. AIChE J. 2009, 55:1754-1765.
21. Ge Z., Song Z. A comparative study of just-in-time-learning based methods for online soft sensor modeling. Chemom. Intell. Lab. Syst. 2010, 104:306-317.
22. Ge Z., Song Z. Ensemble independent component regression models and soft sensing application. Chemom. Intell. Lab. Syst. 2014, 130:115-122.
23. Gonzaga J., Meleiro L., Kiang C., Maciel Filho R. ANN-based soft-sensor for real-time process monitoring and control of an industrial polymerization process. Comput. Chem. Eng. 2009, 33:43-49.
24. Grbić R., Slišković D., Kadlec P. Adaptive soft sensor for online prediction and process monitoring based on a mixture of Gaussian process models. Comput. Chem. Eng. 2013, 58:84-97.
25. Haimi H., Mulas M., Corona F., Vahala R. Data-derived soft-sensors for biological wastewater treatment plants: an overview. Environ. Model. Softw. 2013, 47:88-107.
26. Jain P., Rahman I., Kulkarni B. Development of a soft sensor for a batch distillation column using support vector regression techniques. Chem. Eng. Res. Des. 2007, 85:283-287.
27. Jassar S., Liao Z., Zhao L. Adaptive neuro-fuzzy based inferential sensor model for estimating the average air temperature in space heating systems. Build. Environ. 2009, 44:1609-1616.
28. Jin H., Chen X., Yang J., Wu L. Adaptive soft sensor modeling framework based on just-in-time learning and kernel partial least squares regression for nonlinear multiphase batch processes. Comput. Chem. Eng. 2014, 71:77-93.
29. Jin H., Chen X., Yang J., Wu L., Wang L. Hybrid intelligent control of substrate feeding for industrial fed-batch chlortetracycline fermentation process. ISA Trans. 2014, 53:1822-1837.
30. Jin H., Chen X., Yang J., Wang L., Wu L. Online local learning based adaptive soft sensor and its application to an industrial fed-batch chlortetracycline fermentation process. Chemom. Intell. Lab. Syst. 2015, 143:58-78. 10.1016/j.chemolab.2015.02.018.
31. Jolliffe I.T. Principal Component Analysis 2002, Springer, New York. second ed.
32. Kadlec P., Gabrys B. Local learning-based adaptive soft sensor for catalyst activation prediction. AIChE J. 2011, 57:1288-1301.
33. Kadlec P., Gabrys B., Strandt S. Data-driven soft sensors in the process industry. Comput. Chem. Eng. 2009, 33:795-814.
34. Kadlec P., Grbić R., Gabrys B. Review of adaptation mechanisms for data-driven soft sensors. Comput. Chem. Eng. 2011, 35:1-24.
35. Kaneko H., Arakawa M., Funatsu K. Development of a new soft sensor method using independent component analysis and partial least squares. AIChE J. 2009, 55:87-98.
36. Kaneko H., Funatsu K. Maintenance-free soft sensor models with time difference of process variables. Chemom. Intell. Lab. Syst. 2011, 107:312-317.
37. Kaneko H., Funatsu K. A soft sensor method based on values predicted from multiple intervals of time difference for improvement and estimation of prediction accuracy. Chemom. Intell. Lab. Syst. 2011, 109:197-206.
38. Kaneko H., Funatsu K. Classification of the degradation of soft sensor models and discussion on adaptive models. AIChE J. 2013, 59:2339-2347.
39. Kaneko H., Funatsu K. Adaptive soft sensor model using online support vector regression with time variable and discussion of appropriate hyperparameter settings and window size. Comput. Chem. Eng. 2013, 58:288-297.
40. Kaneko H., Funatsu K. Adaptive soft sensor based on online support vector regression and Bayesian ensemble learning for various states in chemical plants. Chemom. Intell. Lab. Syst. 2014, 137:57-66.
41. Kaneko H., Funatsu K. Application of online support vector regression for soft sensors. AIChE J. 2014, 60:600-612.
42. Kano M., Fujiwara K. Virtual sensing technology in process industries: trends and challenges revealed by recent industrial applications. J. Chem. Eng. Jpn. 2013, 46:1-17.
43. Kano M., Nakagawa Y. Data-based process monitoring, process control, and quality improvement: recent developments and applications in steel industry. Comput. Chem. Eng. 2008, 32:12-24.
44. Kano M., Ogawa M. The state of the art in chemical process control in Japan: good practice and questionnaire survey. J. Process. Control 2010, 20:969-982.
45. Khatibisepehr S., Huang B., Khare S. Design of inferential sensors in the process industry: a review of Bayesian methods. J. Process. Control 2013, 23:1575-1596.
46. Kim S., Kano M., Hasebe S., Takinami A., Seki T. Long-term industrial applications of inferential control based on just-in-time soft-sensors: economical impact and challenges. Ind. Eng. Chem. Res. 2013, 52:12346-12356.
47. Li X., Su H., Chu J. Multiple model soft sensor based on affinity propagation, gaussian process and bayesian committee machine. Chin. J. Chem. Eng. 2009, 17:95-99.
48. Lin B., Recke B., Knudsen J.K., Jørgensen S.B. A systematic approach for soft sensor development. Comput. Chem. Eng. 2007, 31:419-425.
49. Liu J. On-line soft sensor for polyethylene process with multiple production grades. Control Eng. Pract. 2007, 15:769-778.
50. Liu Y., Chen J. Integrated soft sensor using just-in-time support vector regression and probabilistic analysis for quality prediction of multi-grade processes. J. Process. Control 2013, 23:793-804.
51. Liu R. Studies on Soft Sensor Technology and Their Applications to Industrial Processes 2004, (Ph.D. dissertation), Zhejiang University, China.
52. Lu N., Gao F., Wang F. Sub-PCA modeling and on-line monitoring strategy for batch processes. AIChE J. 2004, 50:255-259.
53. Lu N., Gao F. Stage-based process analysis and quality prediction for batch processes. Ind. Eng. Chem. Res. 2005, 44:3547-3555.
54. Lv Z., Yan X., Jiang Q. Batch process monitoring based on just-in-time learning and multiple-subspace principal component analysis. Chemom. Intell. Lab. Syst. 2014, 137:128-139.
55. Ma J., Theiler J., Perkins S. Accurate on-line support vector regression. Neural Comput. 2003, 15:2683-2703.
56. Mu S., Zeng Y., Liu R., Wu P., Su H., Chu J. Online dual updating with recursive PLS model and its application in predicting crystal size of purified terephthalic acid (PTA) process. J. Process. Control 2006, 16:557-566.
57. Nguyen-Tuong D., Seeger M., Peters J. Model learning with local gaussian process regression. Adv. Robot. 2009, 23:2015-2034.
58. Ni W., Tan S.K., Ng W.J., Brown S.D. Moving-window GPR for nonlinear dynamic system modeling with dual updating and dual preprocessing. Ind. Eng. Chem. Res. 2012, 51:6416-6428.
59. Ni W., Tan S.K., Ng W.J., Brown S.D. Localized, adaptive recursive partial least squares regression for dynamic system modeling. Ind. Eng. Chem. Res. 2012, 51:8025-8039.
60. Ni W., Brown S.D., Man R. A localized adaptive soft sensor for dynamic system modeling. Chem. Eng. Sci. 2014, 111:350-363.
61. Niu D.-p., Wang F.-l., Zhang L.-l., He D.-k., Jia M..-x. Neural network ensemble modeling for nosiheptide fermentation process based on partial least squares regression. Chemom. Intell. Lab. Syst. 2011, 105:125-130.
62. Parrella F. Online Support Vector Regression 2007, (Master[U+05F3]s thesis), Department of Information Science, University of Genoa, Italy.
63. Qin S.J. Recursive PLS algorithms for adaptive data modeling. Comput. Chem. Eng. 1998, 22:503-514.
64. Rasmussen C.E., Williams C.K.I. Gaussian Processes for Machine Learning 2006, The MIT Press, Cambridge, Massachusetts, London, England.
65. Saptoro A. State of the art in the development of adaptive soft sensors based on just-in-time models. Procedia Chem. 2014, 9:226-234.
66. Schaal S., Atkeson C.G., Vijayakumar S. Scalable techniques from nonparametric statistics for real time robot learning. Appl. Intell. 2002, 17:49-60.
67. Sliskovic D., Grbic R., Hocenski Z. Methods for plant data-based process modeling in soft-sensor development. Automatika 2011, 52:306-318.
68. Soares S.G., Araújo R. A dynamic and on-line ensemble regression for changing environments. Expert Syst. Appl. 2014, 42:2935-2948. 10.1016/j.eswa.2014.11.053.
69. Soares S.G., Araújo R. An on-line weighted ensemble of regressor models to handle concept drifts. Eng. Appl. Artif. Intell. 2015, 37:392-406.
70. Student The probable error of a mean. Biometrika 1908, 6:1-25.
71. Tsymbal A. The Problem of Concept Drift: Definitions and Related Work. Technical Report 2004, Department of Computer Science, Trinity College Dublin, The University of Dublin, Ireland.
72. Vapnik V.N., Vapnik V. Statistical Learning Theory 1998, John Wiley and Sons, New York.
73. Vijayakumar S., D'souza A., Schaal S. Incremental online learning in high dimensions. Neural Comput. 2005, 17:2602-2634.
74. Wang X., Kruger U., Irwin G.W. Process monitoring approach using fast moving window PCA. Ind. Eng. Chem. Res. 2005, 44:5691-5702.
75. Warnes M.R., Glassey J., Montague G.A., Kara B. On data-based modelling techniques for fermentation processes. Process. Biochem. 1996, 31:147-155.
76. Wold S., Sjöström M., Eriksson L. PLS-regression: a basic tool of chemometrics. Chemom. Intell. Lab. Syst. 2001, 58:109-130.
77. Xie L., Zeng J., Gao C. Novel just-in-time learning-based soft sensor utilizing non-gaussian information. IEEE Trans. Control Syst. Technol. 2014, 22:360-368.
78. Xie X., Shi H. Dynamic multimode process modeling and monitoring using adaptive Gaussian mixture models. Ind. Eng. Chem. Res. 2012, 51:5497-5505.
79. Yu J. A Bayesian inference based two-stage support vector regression framework for soft sensor development in batch bioprocesses. Comput. Chem. Eng. 2012, 41:134-144.
80. Yu J. Multiway Gaussian mixture model based adaptive kernel partial least squares regression method for soft sensor estimation and reliable quality prediction of nonlinear multiphase batch processes. Ind. Eng. Chem. Res. 2012, 51:13227-13237.
81. Yu J. Online quality prediction of nonlinear and non-Gaussian chemical processes with shifting dynamics using finite mixture model based Gaussian process regression approach. Chem. Eng. Sci. 2012, 82:22-30.
82. Yu J., Chen K., Rashid M.M. A Bayesian model averaging based multi-kernel Gaussian process regression framework for nonlinear state estimation and quality prediction of multiphase batch processes with transient dynamics and uncertainty. Chem. Eng. Sci. 2013, 93:96-109.
83. Yu J., Qin S.J. Multimode process monitoring with Bayesian inference-based finite Gaussian mixture models. AIChE J. 2008, 54:1811-1829.
84. Yuan X., Ge Z., Song Z. Locally weighted kernel principal component regression model for soft sensing of nonlinear time-variant processes. Ind. Eng. Chem. Res. 2014, 53:13736-13749.
85. Zhao C., Wang F., Gao F. Improved calibration investigation using phase-wise local and cumulative quality interpretation and prediction. Chemom. Intell. Lab. Syst. 2009, 95:107-121.