A bootstrapping soft shrinkage approach for variable selection in chemical modeling

Analytica Chimica Acta

Volumn 908, Issue , 2016, Pages 63-74

  Deng, Bai Chuan ^a,b,c   Yun, Yong Huan ^b   Cao, Dong Sheng ^b   Yin, Yu Long ^a,c   Wang, Wei Ting ^b   Lu, Hong Mei ^b   Luo, Qian Yi ^b   Liang, Yi Zeng ^b  

^a SOUTH CHINA AGRICULTURAL UNIVERSITY   (China)

^b CENTRAL SOUTH UNIVERSITY   (China)

^c INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

Author keywords

Model population analysis; Soft shrinkage and partial least squares; Variable selection; Weighted bootstrap sampling

Indexed keywords

DIESEL FUELS; GENETIC ALGORITHMS; INFRARED DEVICES; ITERATIVE METHODS; MEAN SQUARE ERROR; MONTE CARLO METHODS; OPTIMIZATION; SHRINKAGE;

BOOTSTRAP SAMPLINGS; GENETIC ALGORITHM-PARTIAL LEAST SQUARES; MODELPOPULATION ANALYSIS (MPA); MONTE CARLO UNINFORMATIVE VARIABLE ELIMINATIONS; PARTIAL LEAST SQUARE (PLS); POPULATION ANALYSIS; VARIABLE SELECTION; VARIABLE SELECTION METHODS;

LEAST SQUARES APPROXIMATIONS;

ALGORITHM; ARTICLE; BOOTSTRAPPING; BOOTSTRAPPING SOFT SHRINKAGE; CHEMICAL MODEL; COEFFICIENT OF DETERMINATION OF CROSSVALIDATION; COEFFICIENT OF DETERMINATION OF TEST SET; COMPETITIVE ADAPTIVE REWEIGHTED SAMPLING; CONCEPTUAL FRAMEWORK; CONTROLLED STUDY; GENETIC ALGORITHM PARTIAL LEAST SQUARE; INTERMETHOD COMPARISON; MODEL POPULATION ANALYSIS; MONTE CARLO UNINFORMATIVE VARIABLE ELIMINATION; NEAR INFRARED SPECTROSCOPY; PRIORITY JOURNAL; ROOT MEAN SQUARED ERROR OF CROSS VALIDATION; ROOT MEAN SQUARED ERROR OF PREDICTION OF TEST SET; STATISTICAL ANALYSIS; VALIDATION PROCESS; WEIGHTED BOOTSTRAP SAMPLING; LEAST SQUARE ANALYSIS; MONTE CARLO METHOD; VALIDATION STUDY;

ALGORITHMS; LEAST-SQUARES ANALYSIS; MODELS, CHEMICAL; MONTE CARLO METHOD; SPECTROSCOPY, NEAR-INFRARED;

EID: 84989771002     PISSN: 00032670     EISSN: 18734324     Source Type: Journal    
DOI: 10.1016/j.aca.2016.01.001     Document Type: Article

References (52)

1. Xu R.N., Fan L., Rieser M.J., El-Shourbagy T.A. Recent advances in high-throughput quantitative bioanalysis by LC-MS/MS. J. Pharm. Biomed. Anal. 2007, 44:342-355.
2. Mikkers H., Allen J., Knipscheer P., Romeyn L., Hart A., Vink E., Berns A. High-throughput retroviral tagging to identify components of specific signaling pathways in cancer. Nat. Genet. 2002, 32:153-159.
3. Siesler H.W., Ozaki Y., Kawata S., Heise H.M. Near-infrared Spectroscopy: Principles, Instruments, Applications 2008, John Wiley & Sons.
4. Bakeev K.A. Process Analytical Technology: Spectroscopic Tools and Implementation Strategies for the Chemical and Pharmaceutical Industries 2010, John Wiley & Sons, New York.
5. Cen H., He Y. Theory and application of near infrared reflectance spectroscopy in determination of food quality. Trends Food Sci. Tech. 2007, 18:72-83.
6. Balabin R.M., Safieva R.Z., Lomakina E.I. Gasoline classification using near infrared (NIR) spectroscopy data: comparison of multivariate techniques. Anal. Chim. Acta 2010, 671:27-35.
7. Liang Y.-Z., Xie P., Chan K. Quality control of herbal medicines. J. Chromatogr. B 2004, 812:53-70.
8. Luo Q., Yun Y., Fan W., Huang J., Zhang L., Deng B., Lu H. Application of near infrared spectroscopy for the rapid determination of epimedin A, B, C and icariin in Epimedium. RSC Adv. 2015, 5:5046-5052.
9. Johnstone I.M., Titterington D.M. Statistical challenges of high-dimensional data introduction. Philos. T R. Soc. A 2009, 367:4237-4253.
10. Wold S., Sjostrom M., Eriksson L. PLS-regression: a basic tool of chemometrics. Chemom. Intell. Lab. 2001, 58:109-130.
11. Jolliffe I. Principal Component Analysis 2005, Wiley Online Library, New York.
12. Spiegelman C.H., McShane M.J., Goetz M.J., Motamedi M., Yue Q.L., Coté G.L. Theoretical justification of wavelength selection in PLS calibration: development of a new algorithm. Anal. Chem. 1998, 70:35-44.
13. Wang Q., Li H.D., Xu Q.S., Liang Y.Z. Noise incorporated subwindow permutation analysis for informative gene selection using support vector machines. Analyst 2011, 136:1456-1463.
14. Guyon I., Elisseeff A. An introduction to variable and feature selection. J. Mach. Learn. Res. 2003, 3:1157-1182.
15. Blanchet F.G., Legendre P., Borcard D. Forward selection of explanatory variables. Ecology 2008, 89:2623-2632.
16. Sutter J.M., Kalivas J.H. Comparison of forward selection, backward elimination, and generalized simulated annealing for variable selection. Microchem. J. 1993, 47:60-66.
17. Derksen S., Keselman H. Backward, forward and stepwise automated subset selection algorithms: frequency of obtaining authentic and noise variables. Br. J. Math. Stat. Psychol. 1992, 45:265-282.
18. Tibshirani R. Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B Methodol. 1996, 267-288.
19. Zou H., Hastie T. Regularization and variable selection via the elastic net. J. Roy. Stat. Soc. B 2005, 67:301-320.
20. Efron B., Hastie T., Johnstone I., Tibshirani R. Least angle regression. Ann. Stat. 2004, 32:407-499.
21. Leardi R., Lupiáñez González A. Genetic algorithms applied to feature selection in PLS regression: how and when to use them. Chemom. Intell. Lab. 1998, 41:195-207.
22. Leardi R. Application of genetic algorithm-PLS for feature selection in spectral data sets. J. Chemom. 2000, 14:643-655.
23. Shen Q., Jiang J.H., Jiao C.X., Huan S.Y., Shen G.L., Yu R.Q. Optimized partition of minimum spanning tree for piecewise modeling by particle swarm algorithm. QSAR studies of antagonism of angiotensin II antagonists. J. Chem. Inf. Comp. Sci. 2004, 44:2027-2031.
24. Shamsipur M., Zare-Shahabadi V., Hemmateenejad B., Akhond M. Ant colony optimisation: a powerful tool for wavelength selection. J. Chemom. 2006, 20:146-157.
25. Lindgren F., Geladi P., Rännar S., Wold S. Interactive variable selection (IVS) for PLS. Part 1: theory and algorithms. J. Chemom. 1994, 8:349-363.
26. Lindgren F., Geladi P., Berglund A., Sjöström M., Wold S. Interactive variable selection (IVS) for PLS. Part II: chemical applications. J. Chemom. 1995, 9:331-342.
27. Li H.D., Liang Y.Z., Xu Q.S., Cao D.S. Key wavelengths screening using competitive adaptive reweighted sampling method for multivariate calibration. Anal. Chim. Acta 2009, 648:77-84.
28. Andries J.P.M., Vander Heyden Y., Buydens L.M.C. Improved variable reduction in partial least squares modelling based on Predictive-Property-Ranked Variables and adaptation of partial least squares complexity. Anal. Chim. Acta 2011, 705:292-305.
29. Wold S., Johansson E., Cocchi M. PLS: Partial Least Squares Projections to Latent Structures, 3D QSAR in Drug Design 1993, 523-550.
30. Centner V., Massart D.L., de Noord O.E., de Jong S., Vandeginste B.M., Sterna C. Elimination of uninformative variables for multivariate calibration. Anal. Chem. 1996, 68:3851-3858.
31. Cai W.S., Li Y.K., Shao X.G. A variable selection method based on uninformative variable elimination for multivariate calibration of near-infrared spectra. Chemom. Intell. Lab. 2008, 90:188-194.
32. Han Q.J., Wu H.L., Cai C.B., Xu L., Yu R.Q. An ensemble of Monte Carlo uninformative variable elimination for wavelength selection. Anal. Chim. Acta 2008, 612:121-125.
33. Rajalahti T., Arneberg R., Berven F.S., Myhr K.-M., Ulvik R.J., Kvalheim O.M. Biomarker discovery in mass spectral profiles by means of selectivity ratio plot. Chemom. Intell. Lab. 2009, 95:35-48.
34. Rajalahti T., Arneberg R., Kroksveen A.C., Berle M., Myhr K.-M., Kvalheim O.M. Discriminating variable test and selectivity ratio plot: quantitative tools for interpretation and variable (biomarker) selection in complex spectral or chromatographic profiles. Anal. Chem. 2009, 81:2581-2590.
35. Li H.D., Zeng M.M., Tan B.B., Liang Y.Z., Xu Q.S., Cao D.S. Recipe for revealing informative metabolites based on model population analysis. Metabolomics 2010, 6:353-361.
36. Deng B.-C., Yun Y.-H., Liang Y.-Z. Model population analysis in chemometrics. Chemom. Intell. Lab. 2015, 149(Part B):166-176.
37. Deng B.C., Yun Y.H., Liang Y.Z., Yi L.Z. A novel variable selection approach that iteratively optimizes variable space using weighted binary matrix sampling. Analyst 2014, 139:4836-4845.
38. Deng B.C., Yun Y.H., Ma P., Lin C.C., Ren D.B., Liang Y.Z. A new method for wavelength interval selection that intelligently optimizes the locations, widths and combinations of the intervals. Analyst 2015, 140:1876-1885.
39. Yun Y.H., Wang W.T., Tan M.L., Liang Y.Z., Li H.D., Cao D.S., Lu H.M., Xu Q.S. A strategy that iteratively retains informative variables for selecting optimal variable subset in multivariate calibration. Anal. Chim. Acta 2014, 807:36-43.
40. Yun Y.-H., Wang W.-T., Deng B.-C., Lai G.-B., Liu X.-b., Ren D.-B., Liang Y.-Z., Fan W., Xu Q.-S. Using variable combination population analysis for variable selection in multivariate calibration. Anal. Chim. Acta 2015, 862:14-23.
41. Efron B., Tibshirani R.J. An Introduction to the Bootstrap 1994, CRC press.
42. Efron B. Bootstrap methods: another look at the jackknife. Ann. Stat. 1979, 1-26.
43. Brás L.P., Lopes M., Ferreira A.P., Menezes J.C. A bootstrap-based strategy for spectral interval selection in PLS regression. J. Chemom. 2008, 22:695-700.
44. Gosselin R., Rodrigue D., Duchesne C. A bootstrap-VIP approach for selecting wavelength intervals in spectral imaging applications. Chemom. Intell. Lab. 2010, 100:12-21.
45. Barbe P., Bertail P. The Weighted Bootstrap 1995, Springer Science & Business Media.
46. Li H.D., Liang Y.Z., Xu Q.S., Cao D.S. Model-population analysis and its applications in chemical and biological modeling. Trac-Trend Anal. Chem. 2012, 38:154-162.
47. Yun Y.-H., Liang F., Deng B.-C., Lai G.-B., Vicente Gonçalves C., Lu H.-M., Yan J., Huang X., Yi L.-Z., Liang Y.-Z. Informative metabolites identification by variable importance analysis based on random variable combination. Metabolomics 2015, 1-13.
48. Deng B.-C., Yun Y.-H., Liang Y.-Z., Cao D.-S., Xu Q.-S., Yi L.-Z., Huang X. A new strategy to prevent over-fitting in partial least squares models based on model population analysis. Anal. Chim. Acta 2015, 880:32-41.
49. Donoho D.L., Johnstone J.M. Ideal spatial adaptation by wavelet shrinkage. Biometrika 1994, 81:425-455.
50. Snee R.D. Validation of regression models: methods and examples. Technometrics 1977, 19:415-428.
51. Forina M., Drava G., Armanino C., Boggia R., Lanteri S., Leardi R., Corti P., Conti P., Giangiacomo R., Galliena C., Bigoni R., Quartari I., Serra C., Ferri D., Leoni O., Lazzeri L. Transfer of calibration function in near-infrared spectroscopy. Chemom. Intell. Lab. 1995, 27:189-203.
52. Jiang J.H., Berry R.J., Siesler H.W., Ozaki Y. Wavelength interval selection in multicomponent spectral analysis by moving window partial least-squares regression with applications to mid-infrared and near-infrared spectroscopic data. Anal. Chem. 2002, 74:3555-3565.