Subagging for the improvement of predictive stability of extreme learning machine for spectral quantitative analysis of complex samples

Chemometrics and Intelligent Laboratory Systems

Volumn 161, Issue , 2017, Pages 43-48

  Zhang, Caixia ^a   Bian, Xihui ^a   Liu, Peng ^a   Tan, Xiaoyao ^a   Fan, Qingjie ^b   Liu, Wei ^a   Lin, Ligang ^a  

^a TIANJIN POLYTECHNIC UNIVERSITY   (China)

^b Green (Tianjin) Technology Development Company Ltd   (China)

Author keywords

Complex samples; Ensemble modeling; Extreme learning machine; Multivariate calibration; Spectral analysis

Indexed keywords

FUEL OIL;

ARTICLE; BLOOD; BLOOD SAMPLING; CONTROLLED STUDY; EXTREME LEARNING MACHINE; MACHINE LEARNING; MEASUREMENT ACCURACY; MULTIVARIATE ANALYSIS; PREDICTION; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; SPECTROSCOPY; SUBAGGING EXTREME LEARNING MACHINE;

EID: 85008237793     PISSN: 01697439     EISSN: 18733239     Source Type: Journal    
DOI: 10.1016/j.chemolab.2016.10.019     Document Type: Article

References (45)

1. [1] Ahmadi, G., Tauler, R., Abdollahi, H., Multivariate calibration of first-order data with the correlation constrained MCR-ALS method. Chemom. Intell. Lab. Syst. 142 (2015), 143–150.
2. [2] Luypaert, J., Massart, D.L., Heyden, Y.V., Near-infrared spectroscopy applications in pharmaceutical analysis. Talanta 72 (2007), 865–883.
3. [3] Lu, T., Yuan, Y., Jiao, Y., Wen, Z.N., Wang, L., Zhao, Y.H., Zhang, Y.X., Li, M.L., Pu, X.M., Xu, T., Simultaneous spectrophotometric quantification of dinitrobenzene isomers in water samples using multivariate calibration methods. Chemom. Intell. Lab. Syst. 154 (2016), 72–79.
4. [4] Bian, X.H., Li, S.J., Shao, X.G., Liu, P., Variable space boosting partial least squares for multivariate calibration of near infrared spectroscopy. Chemom. Intell. Lab. Syst., 2016, 10.1016/j.chemolab.2016.08.005.
5. [5] Keithley, R.B., Heien, M.L., Wightman, R.M., Multivariate concentration determination using principal component regression with residual analysis. Trac-Trends Anal. Chem. 28 (2009), 1127–1136.
6. [6] Lin, Y.W., Deng, B.C., Xu, Q.S., Yun, Y.H., Liang, Y.Z., The equivalence of partial least squares and principal component regression in the sufficient dimension reduction framework. Chemom. Intell. Lab. Syst. 150 (2016), 58–64.
7. [7] Wold, S., Sjostrom, M., Eriksson, L., PLS-regression: a basic tool of chemometrics. Chemom. Intel. Lab. Syst. 58 (2001), 109–130.
8. [8] Wilcox, K.E., Blanch, E.W., Doig, A.J., Determination of protein secondary structure from infrared spectra using partial least-squares regression. Biochemistry 55 (2016), 3794–3802.
9. [9] Ramadan, Z., Hopke, P.K., Johnson, M.J., Scow, K.M., Application of PLS and back-propagation neural networks for the estimation of soil properties. Chemom. Intel. Lab. Syst. 75 (2005), 23–30.
10. [10] da Rocha, R.A., Paiva, I.M., Anjos, V., Furtado, M.A.M., Bell, M.J.V., Quantification of whey in fluid milk using confocal Raman microscopy and artificial neural network. J. Dairy Sci. 98 (2015), 3559–3567.
11. [11] Thissen, U., Ustun, B., Melssen, W.J., Buydens, L.M.C., Multivariate calibration with least-squares support vector machines. Anal. Chem. 76 (2004), 3099–3105.
12. [12] Luo, R.M., Tan, S.M., Zhou, Y.P., Liu, S.J., Xu, H., Song, D.D., Cui, Y.F., Fu, H.Y., Yang, T.M., Quantitative analysis of tea using ytterbium-based internal standard near-infrared spectroscopy coupled with boosting least-squares support vector regression. J. Chemom. 27 (2013), 198–206.
13. [13] Huang, G.B., Zhu, Q.Y., Siew, C.K., Extreme learning machine: theory and applications. Neurocomputing 70 (2006), 489–501.
14. [14] Huang, G.B., Zhou, H.M., Ding, X.J., Zhang, R., Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern. Part B-Cybern. 42 (2012), 513–529.
15. [15] Aybar-Ruiz, A., Jimenez-Fernandez, S., Cornejo-Bueno, L., Casanova-Mateo, C., Sanz-Justo, J., Salvador-Gonzalez, P., Salcedo-Sanz, S., A novel grouping genetic algorithm-extreme learning machine approach for global solar radiation prediction from numerical weather models inputs. Sol. Energy 132 (2016), 129–142.
16. [16] Lima, A.R., Cannon, A.J., Hsieh, W.W., Forecasting daily streamflow using online sequential extreme learning machines. J. Hydrol. 537 (2016), 431–443.
17. [17] Sun, Z.L., Choi, T.M., Au, K.F., Yu, Y., Sales forecasting using extreme learning machine with applications in fashion retailing. Decis. Support Syst. 46 (2008), 411–419.
18. [18] Sajjadi, S., Shamshirband, S., Alizamir, M., Yee, P.L., Mansor, Z., Manaf, A.A., Altameem, T.A., Mostafaeipour, A., Extreme learning machine for prediction of heat load in district heating systems. Energy Build. 122 (2016), 222–227.
19. [19] Wang, G.R., Zhao, Y., Wang, D., A protein secondary structure prediction framework based on the extreme learning machine. Neurocomputing 72 (2008), 262–268.
20. [20] Chen, H.L., Wang, G., Ma, C., Cai, Z.N., Liu, W.B., Wang, S.J., An efficient hybrid kernel extreme learning machine approach for early diagnosis of Parkinson's disease. Neurocomputing 184 (2016), 131–144.
21. [21] Peng, J.T., Li, L.Q., Tang, Y.Y., Combination of activation functions in extreme learning machines for multivariate calibration. Chemom. Intel. Lab. Syst. 120 (2013), 53–58.
22. [22] AlHichri, H., Bazi, Y., Alajlan, N., Melgani, F., Malek, S., Yager, R.R., A novel fusion approach based on induced ordered weighted averaging operators for chemometric data analysis. J. Chemom. 27 (2013), 447–456.
23. [23] Chen, W.R., Bin, J., Lu, H.M., Zhang, Z.M., Liang, Y.Z., Calibration transfer via an extreme learning machine auto-encoder. Analyst 141 (2016), 1973–1980.
24. [24] Jiang, H., Liu, G.H., Mei, C.L., Chen, Q.S., Qualitative and quantitative analysis in solid-state fermentation of protein feed by FT-NIR spectroscopy integrated with multivariate data analysis. Anal. Methods 5 (2013), 1872–1880.
25. [25] Bian, X.H., Li, S.J., Meng, M.R., Guo, Y.G., Chang, N., Wang, J.J., Spectral quantitative analysis of complex samples based on the extreme learning machine. Anal. Methods 8 (2016), 4674–46799.
26. [26] Lu, H.J., An, C.L., Zheng, E.H., Lu, Y., Dissimilarity based ensemble of extreme learning machine for gene expression data classification. Neurocomputing 128 (2014), 22–30.
27. [27] Li, Y.K., Jing, J., A consensus PLS method based on diverse wavelength variables models for analysis of near-infrared spectra. Chemom. Intell. Lab. Syst. 130 (2014), 45–49.
28. [28] Shao, X.G., Bian, X.H., Cai, W.S., An improved boosting partial least squares method for near-infrared spectroscopic quantitative analysis. Anal. Chim. Acta 666 (2010), 32–37.
29. [29] Jiao, J., Tan, S.M., Luo, R.M., Zhou, Y.P., A robust boosting regression tree with applications in quantitative structure-activity relationship studies of organic compounds. J. Chem. Inf. Model. 51 (2011), 816–828.
30. [30] Wang, N.N., Dong, J., Deng, Y.H., Zhu, M.F., Wen, M., Yao, Z.J., Lu, A.P., Wang, J.B., Cao, D.S., ADME properties evaluation in drug discovery: prediction of caco-2 cell permeability using a combination of NSGA-II and boosting. J. Chem. Inf. Model. 56 (2016), 763–773.
31. [31] Bian, X.H., Li, S.J., Lin, L.G., Tan, X.Y., Fan, Q.J., Li, M., High and low frequency unfolded partial least squares regression based on empirical mode decomposition for quantitative analysis of fuel oil samples. Anal. Chim. Acta 925 (2016), 16–22.
32. [32] Breiman, L., Bagging predictors. Mach. Learn. 24 (1996), 123–140.
33. [33] Li, Y.K., Shao, X.G., Cai, W.S., A consensus least squares support vector regression (LS-SVR) for analysis of near-infrared spectra of plant samples. Talanta 72 (2007), 217–222.
34. [34] Niu, D.P., Wang, F.L., Zhang, L.L., He, D.K., Jia, M.X., Neural network ensemble modeling for nosiheptide fermentation process based on partial least squares regression. Chemom. Intell. Lab. Syst. 105 (2011), 125–130.
35. [35] Shahbazikhah, P., Kalivas, J.H., A consensus modeling approach to update a spectroscopic calibration. Chemom. Intell. Lab. Syst. 120 (2013), 142–153.
36. [36] Ge, Z.Q., Song, Z.H., Ensemble independent component regression models and soft sensing application. Chemom. Intell. Lab. Syst. 130 (2014), 115–122.
37. [37] He, Y.L., Geng, Z.Q., Zhu, Q.X., Soft sensor development for the key variables of complex chemical processes using a novel robust bagging nonlinear model integrating improved extreme learning machine with partial least square. Chemom. Intell. Lab. Syst. 151 (2016), 78–88.
38. [38] Buhlmann, P., Yu, B., Analyzing bagging. Ann. Stat. 30 (2002), 927–961.
39. [39] Galvao Filho, A.R., Galvao, R.K.H., Araujo, M.C.U., Effect of the subsampling ratio in the application of subagging for multivariate calibration with the successive projections algorithm. J. Braz. Chem. Soc. 22 (2011), 2225–2233.
40. [40] Galvao, R.K.H., Araujo, M.C.U., Martins, M.D.N., Jose, G.E., Pontes, M.J.C., Silva, E.C., Saldanha, T.C.B., An application of subagging for the improvement of prediction accuracy of multivariate calibration models. Chemom. Intell. Lab. Syst. 81 (2006), 60–67.
41. [41] Cheng, Z., Zhu, A.S., Chen, D.Z., Combined prediction model based on partial least squares regression and its application to near infrared spectroscopy quantitative analysis. Chin. J. Anal. Chem. 35 (2007), 978–982.
42. [42] Wang, K., Chen, T., Lau, R., Bagging for robust non-linear multivariate calibration of spectroscopy. Chemom. Intell. Lab. Syst. 105 (2011), 1–6.
43. [43] Chen, Z.Y., Fan, Z.P., Sun, M.H., Behavior-aware user response modeling in social media: learning from diverse heterogeneous data. Eur. J. Oper. Res. 241 (2015), 422–434.
44. [44] Wentzell, P.D., Andrews, D.T., Walsh, J.M., Cooley, J.M., Spencer, P., Estimation of hydrocarbon types in light gas oils and diesel fuels by ultraviolet absorption spectroscopy and multivariate calibration. Can. J. Chem. 77 (1999), 391–400.
45. [45] Kuenstner, J.T., Norris, K.H., Spectrophotometry of human hemoglobin in the near infrared region from 1000–2500 nm. J. Infrared Spectrosc. 2 (1994), 59–65.