Comparison of Sparse and Jack-knife partial least squares regression methods for variable selection

Chemometrics and Intelligent Laboratory Systems

Volumn 122, Issue , 2013, Pages 65-77

  Karaman, Ibrahim ^a   Qannari, El Mostafa ^b,c   Martens, Harald ^d,e   Hedemann, Mette Skou ^a   Knudsen, Knud Erik Bach ^a   Kohler, Achim ^d,e  

^a AARHUS UNIVERSITY   (Denmark)

^b LUNAM UNIVERSITÉ   (France)

^c CEMAGREF   (France)

^d NOFIMA   (Norway)

^e NORWEGIAN UNIVERSITY OF LIFE SCIENCES   (Norway)

Author keywords

Cross model validation; Jack knife PLSR; Perturbation parameter; Sparse PLSR

Indexed keywords

ARTICLE; COMPARATIVE STUDY; DATA ANALYSIS; GENOMICS; INFRARED SPECTROSCOPY; INTERMETHOD COMPARISON; JACK-KNIFE PARTIAL LEAST SQUARES REGRESSION; MATHEMATICAL COMPUTING; PARTIAL LEAST SQUARES REGRESSION; PREDICTION; PRIORITY JOURNAL; SIMULATION; SPARSE PARTIAL LEAST SQUARES REGRESSION; STATISTICAL MODEL; STATISTICAL PARAMETERS; VALIDATION STUDY; VARIABLE SELECTION;

EID: 84873885030     PISSN: 01697439     EISSN: 18733239     Source Type: Journal    
DOI: 10.1016/j.chemolab.2012.12.005     Document Type: Article

References (47)

1. Wold H. Soft modeling: the basic design and some extensions. Systems under indirect observation 1982, 1-53. North-Holland, Amsterdam.
2. Martens H., Næs T. Multivariate Calibration 1992, Wiley, Chichester.
3. Kettaneh N., Berglund A., Wold S. PCA and PLS with very large data sets. Computational Statistics and Data Analysis 2005, 48:69-85.
4. Mehmood T., Liland K.H., Snipen L., Sæbø S. A review of variable selection methods in Partial Least Squares Regression. Chemometrics and Intelligent Laboratory Systems 2012, 118:62-69.
5. Zerzucha P., Walczak B. Again about partial least squares and feature selection. Chemometrics and Intelligent Laboratory Systems 2012, 115:9-17.
6. Filzmoser P., Gschwandtner M., Todorov V. Review of sparse methods in regression and classification with application to chemometrics. Journal of Chemometrics 2012, 26:42-51.
7. Andries J.P.M., Vander Heyden Y., Buydens L.M.C. Improved variable reduction in partial least squares modelling based on Predictive-Property-Ranked Variables and adaptation of partial least squares complexity. Analytica Chimica Acta 2011, 705:292-305.
8. Andersen C.M., Bro R. Variable selection in regression-a tutorial. Journal of Chemometrics 2010, 24:728-737.
9. Höskuldsson A. Variable and subset selection in PLS regression. Chemometrics and Intelligent Laboratory Systems 2001, 55:23-38.
10. Nørgaard L., Saudland A., Wagner J., Nielsen J.P., Munck L., Engelsen S.B. Interval partial least-squares regression (iPLS): a comparative chemometric study with an example from near-infrared spectroscopy. Applied Spectroscopy 2000, 54:413-419.
11. Centner V., Massart D.L., de Noord O.E., De Jong S., Vandeginste B.M., Sterna C. Elimination of uninformative variables for multivariate calibration. Analytical Chemistry 1996, 68:3851-3858.
12. Martens H., Martens M. Modified Jack-knife estimation of parameter uncertainty in bilinear modelling by partial least squares regression (PLSR). Food Quality and Preference 2000, 11:5-16.
13. Anderssen E., Dyrstad K., Westad F., Martens H. Reducing over-optimism in variable selection by cross-model validation. Chemometrics and Intelligent Laboratory Systems 2006, 84:69-74.
14. Westad F., Martens H. Variable selection in near infrared spectroscopy based on significance testing in partial least squares regression. Journal of Near Infrared Spectroscopy 2000, 8:117-124.
15. Indahl U. A twist to partial least squares regression. Journal of Chemometrics 2005, 19:32-44.
16. Sæbø S., Almøy T., Aarøe J., Aastveit A.H. ST-PLS: a multi-directional nearest shrunken centroid type classifier via PLS. Journal of Chemometrics 2008, 22:54-62.
17. Lê Cao K.A., Rossouw D., Robert-Granié C., Besse P. A sparse PLS for variable selection when integrating omics data. Statistical Applications in Genetics and Molecular Biology 2008, 7.
18. Chun H., Keles S. Sparse partial least squares regression for simultaneous dimension reduction and variable selection. Journal of the Royal Statistical Society: Series B: Statistical Methodology 2010, 72:3-25.
19. Fernandez Pierna J.A., Abbas O., Baeten V., Dardenne P. A backward variable selection method for PLS regression (BVSPLS). Analytica Chimica Acta 2009, 642:89-93.
20. The Unscrambler 2012, Camo Software, Oslo, Norway.
21. Tibshirani R. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B: Methodological 1996, 58:267-288.
22. Zou H., Hastie T. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B: Statistical Methodology 2005, 67:301-320.
23. Lê Cao K.A., Martin P.G.P., Robert-Granié C., Besse P. Sparse canonical methods for biological data integration: application to a cross-platform study. BMC Bioinformatics 2009, 10.
24. Chung D., Keles S. Sparse partial least squares classification for high dimensional data. Statistical Applications in Genetics and Molecular Biology 2010, 9.
25. Martens H., Høy M., Westad F., Folkenberg D., Martens M. Analysis of designed experiments by stabilised PLS regression and jack-knifing. Chemometrics and Intelligent Laboratory Systems 2001, 58:151-170.
26. Rubingh C.M., Bijlsma S., Derks E.P.P.A., Bobeldijk I., Verheij E.R., Kochhar S., Smilde A.K. Assessing the performance of statistical validation tools for megavariate metabolomics data. Metabolomics 2006, 2:53-61.
27. Urban Hjort J.S. Computer Intensive Statistical Methods 1993, Chapman and Hall, London.
28. Gidskehaug L., Anderssen E., Alsberg B.K. Cross model validated feature selection based on gene clusters. Chemometrics and Intelligent Laboratory Systems 2006, 84:172-176.
29. Jolliffe I.T., Trendafilov N.T., Uddin M. A Modified Principal Component Technique Based on the LASSO. Journal of Computational and Graphical Statistics 2003, 12:531-547.
30. Zou H., Hastie T., Tibshirani R. Sparse principal component analysis. Journal of Computational and Graphical Statistics 2006, 15:265-286.
31. Shen H., Huang J.Z. Sparse principal component analysis via regularized low rank matrix approximation. Journal of Multivariate Analysis 2008, 99:1015-1034.
32. Krämer N., Boulesteix A.L., Tutz G. Penalized Partial Least Squares with applications to B-spline transformations and functional data. Chemometrics and Intelligent Laboratory Systems 2008, 94:60-69.
33. Wegelin J.A. Survey of Partial Least Squares (PLS) Methods, with Emphasis on the Two-Block Case. Technical Report 371 2000, Department of Statistics, University of Washington, Seattle.
34. Cruciani G., Baroni M., Clementi S., Costantino G., Riganelli D., Skagerberg B. Predictive ability of regression models. Part I: Standard deviation of prediction errors (SDEP). Journal of Chemometrics 1992, 6:335-346.
35. Efron B. The Jack-knife, the Bootstrap and Other Resampling Plans 1982, Society for Industrial and Applied Mathematics, Philadelphia, Pennsylvania.
36. Westad F., Hersletha M., Lea P., Martens H. Variable selection in PCA in sensory descriptive and consumer data. Food Quality and Preference 2007, 14:463-472.
37. Tusher V.G., Tibshirani R., Chu G. Significance analysis of microarrays applied to the ionizing radiation response. Proceedings of the National Academy of Sciences 2001, 98:5116-5121.
38. Westad F., Afseth N.K., Bro R. Finding relevant spectral regions between spectroscopic techniques by use of cross model validation and partial least squares regression. Analytica Chimica Acta 2007, 595:323-327.
39. Westerhuis J.A., Hoefsloot H.C.J., Smit S., Vis D.J., Smilde A.K., Velzen E.J.J., Duijnhoven J.P.M., Dorsten F.A. Assessment of PLSDA cross validation. Metabolomics 2008, 4:81-89.
40. Martens H., Stark E. Extended multiplicative signal correction and spectral interference subtraction: new preprocessing methods for near infrared spectroscopy. Journal of Pharmaceutical and Biomedical Analysis 1991, 9:625-635.
41. Kohler A., Zimonja M., Segtnan V., Martens H. Standard normal variate, multiplicative signal correction and extended multiplicative signal correction preprocessing in biospectroscopy. Comprehensive Chemometrics 2009, 139-162. Elsevier, Oxford. D.B. Stephen, T. Romá, W. Beata (Eds.).
42. MATLAB 2010, The Mathworks Inc., Natick, Massachusetts, USA.
43. Hassani S., Martens H., Qannari E.M., Kohler A. Degrees of freedom estimation in principal component analysis and consensus principal component analysis. Chemometrics and Intelligent Laboratory Systems 2012, 118:246-259.
44. Umetrics User's Guide to SIMCA-P, SIMCA-P+ 2005, Umetrics.
45. Oust A., Møretrø T., Naterstad K., Sockalingum G.D., Adt I., Manfait M., Kohler A. Fourier transform infrared and Raman spectroscopy for characterization of Listeria monocytogenes strains. Applied and Environmental Microbiology 2006, 72:228-232.
46. Katla T., Naterstad K., Vancanneyt M., Swings J., Axelsson L. Differences in susceptibility of Listeria monocytogenes strains to sakacin P, sakacin A, pediocin PA-1, and nisin. Applied and Environmental Microbiology 2003, 69:4431-4437.
47. Kohler A., Hanafi M., Bertrand D., Qannari E.M., Janbu A.O., Møretrø T., Naterstad K., Martens H. Interpreting several types of measurements in bioscience. Biomedical Vibrational Spectroscopy 2008, 333-356. John Wiley & Sons, Inc.