The equivalence of partial least squares and principal component regression in the sufficient dimension reduction framework

Chemometrics and Intelligent Laboratory Systems

Volumn 150, Issue , 2016, Pages 58-64

  Lin, You Wu ^a   Deng, Bai Chuan ^b   Xu, Qing Song ^a   Yun, Yong Huan ^a   Liang, Yi Zeng ^a  

^a CENTRAL SOUTH UNIVERSITY   (China)

^b SOUTH CHINA AGRICULTURAL UNIVERSITY   (China)

Author keywords

Central subspace; Partial least squares; Principal component regression; Sufficient dimension reduction

Indexed keywords

ARTICLE; CHEMOMETRICS; CONTROLLED STUDY; INTERMETHOD COMPARISON; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; PARTIAL LEAST SQUARES REGRESSION; PREDICTIVE VALUE; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; PROCESS MODEL; STATISTICAL CONCEPTS; STATISTICAL MODEL; SUFFICIENT DIMENSION REDUCTION FRAMEWORK; VALIDATION PROCESS;

EID: 84949238988     PISSN: 01697439     EISSN: 18733239     Source Type: Journal    
DOI: 10.1016/j.chemolab.2015.11.003     Document Type: Article

References (51)

1. Martens H., Næs T. Multivariate Calibration 1989, Wiley, New York.
2. Cai T.T., Shen X.T. High-dimensional Data Analysis 2010, Higher Education Press, Beijing.
3. Bellman R. Adaptive Control Processes 1961, Princeton University Press, Princeton.
4. Fan J.Q., Li R.Z. Statistical Challenges with High Dimensionality: Feature Selection in Knowledge Discovery 2006, Madrid.
5. Tibshirani R. Regression shrinkage and selection via the LASSO. J. R. Stat. Soc. Ser. B 1996, 55:267-288.
6. Xu Q.S., Liang Y.Z., Du Y.P. Monte Carlo cross-validation for selecting a model and estimating the prediction error in multivariate calibration. J. Chemom. 2004, 18:112-120.
7. Deng B.C., Yun Y.H., Liang Y.Z., Yi L.Z. A novel variable selection approach that iteratively optimizes variable space using weighted binary matrix sampling. Analyst 2014, 139:4836-4845.
8. Deng B.C., Yun Y.H., Ma P., Lin C., Ren D.B., Liang Y.Z. A new method for wavelength interval selection that intelligently optimizes the locations, widths and combinations of the intervals. Analyst 1876-1885, 140(2015).
9. Hartnett M.K., Lightbody G., Irwin G. Dynamic inferential estimation using principal components regression. Chemom. Intell. Lab. 1998, 40:215-224.
10. Wold S., Esbensen K., Geladi P. Principal component analysis. Chemom. Intell. Lab. 1987, 2:37-52.
11. Næs T., Martens H. Principal component regression in NIR analysis: viewpoints, background details and selection of components. J. Chemom. 1988, 2:155-167.
12. Jong S.D. SIMPLS: an alternative approach to partial least squares regression. Chemom. Intell. Lab. 1993, 18:251-263.
13. Xu Q.S., Liang Y.Z., Shen H.L. Generalized PLS regression. J. Chemom. 2001, 15:135-148.
14. Wold S., Sjöström M., Eriksson L. PLS-regression: a basic tool of chemometrics. Chemom. Intell. Lab. 2001, 58:109-130.
15. Guyon I., Weston J., Barnhill S., Vapnik V. Gene selection for cancer classification using support vector machines. Mach. Learn. 2002, 46:389-422.
16. Stone M., Brooks R. Continuum regression: cross-validated sequentially constructed prediction embracing ordinary least squares, partial least squares and principal components regression. J. R. Stat. Soc. Ser. B 1990, 52:237-269.
17. Bjorkstrom A., Sundberg R. A generalized view on continuum regression. Scand. J. Stat. 1999, 26:17-30.
18. Li K.C. Sliced inverse regression for dimension reduction (with discussion). J. Am. Stat. Assoc. 1991, 86:316-342.
19. Cook R.D., Weisberg S. Sliced inverse regression for dimension reduction: comment. J. Am. Stat. Assoc. 1991, 86:328-332.
20. Cook R.D. Regression Graphics: Ideas for Studying Regressions Through Graphics 1998, Wiley, New York.
21. Li L.X., Cook R.D., Tsai C.L. Partial inverse regression. Biometrika 2007, 94:615-625.
22. Cook R.D., Helland I.S., Su Z.H. Envelopes and partial least squares regression. J. R. Stat. Soc. Ser. B 2013, 75:851-877.
23. Cook R.D., Li B., Chiaromonte F. Envelope models for parsimonious and efficient multivariate linear regression. Stat. Sin. 2010, 20:927-1010.
24. Zhu L.P., Zhu L.X. On distribution-weighted partial least squares with diverging number of highly correlated predictors. J. R. Stat. Soc. Ser. B 2009, 71:525-548.
25. Cox D. Notes on some aspects of regression analysis. J. R. Stat. Soc. Ser. A 1968, 131:265-279.
26. Frank I.E., Friedman J.H. A statistical view of some chemometrics regression tools. Technometrics 1993, 35:109-148.
27. Helland I.S. On the structure of partial least squares regression. Commun. Stat. Simul. 1988, 17:581-607.
28. Helland I.S. Partial least squares regression and statistical models. Scand. J. Stat. 1990, 17:97-114.
29. Helland I.S. Maximum likelihood regression on relevant components. J. R. Stat. Soc. Ser. B 1992, 54:637-647.
30. Næs T., Helland I.S. Relevant components in regression. J. Scand. J. Stat. 1993, 20:239-250.
31. Helland I.S., Almøy T. Comparison of prediction methods when only a few components are relevant. J. Am. Stat. Assoc. 1994, 89:583-591.
32. Helland I.S. Some theoretical aspects of partial least squares regression. Chemom. Intell. Lab. 2001, 58:97-107.
33. Rosen D.V. PLS, linear models and invariant spaces. Scand. J. Stat. 1994, 21:179-186.
34. Li H.D., Liang Y.Z., Xu Q.S. Uncover the path from PCR to PLS via elastic component regression. Chemom. Intell. Lab. 2010, 104:341-346.
35. Jong S.D. PLS fits closer than PCR. J. Chemom. 1993, 7:551-557.
36. Wentzell P., Montoto L. Comparison of principal components regression and partial least squares regression through generic simulations of complex mixtures. Chemom. Intell. Lab. 2003, 65:257-279.
37. He Z.M., Zhou H.Y., Wang J.Q., Zhai S.C. A unified framework for contrast research of the latent variable multivariate regression methods. Chemom. Intell. Lab. 2015, 143:136-145.
38. Ling Y., Bhandarkar S., Yin X., Lu Q. Saveface and Sirface: appearance-based recognition of faces and facial expressions. IEEE Int. Conf. 2005, 2:466-469.
39. Chiaromonte F., Martinelli J. Dimension reduction strategies for analyzing global gene expression data with a response. Math. Biosci. 2002, 176(1):123-144.
40. Li L.X., Li H. Dimension reduction methods for microarrays with application to censored survival data. Bio. inform. 2004, 20:3406-3412.
41. Li L.X. Survival prediction of diffuse large-B-cell lymphoma based on both clinical and gene expression information. Bioinformatics 2006, 22:466-471.
42. Zhu H., Li L.X. Biological pathway selection through nonlinear dimension reduction. Biostatistics 2011, 12:429-444.
43. Tian C. Density Functional Investigation of the Electronic Structures of Some Transition Metal Magnetic Solids and Statistical Methods on Drug Discovery 2011, (PhD. Thesis), North Carolina State University.
44. Fisher R. On the mathematical foundations of theoretical statistics. Philos. Trans. R. Soc. Lond. A 1922, 222:309-368.
45. Hall P., Li K.C. On almost linearity of low dimensional projection from high dimensional data. Ann. Stat. 1993, 21:867-889.
46. Eaton M. A characterization of spherical distributions. J. Multivar. Anal. 1986, 34:439-446.
47. Xu Q.S., Liang Y.Z. Monte Carlo cross validation. Chemom. Intell. Lab. 2001, 56:1-11.
48. Deng B.C., Yun Y.H., Liang Y.Z., Cao D.S., Xu Q.S., Yi L.Z., Huang L.X. A new strategy to prevent overfitting in partial least squares models based on model population analysis. Anal. Chim. Acta 2015, 23:32-41.
49. Kalivas J. Two data sets of near infrared spectra. Chemom. Intell. Lab. 1997, 37:255-259.
50. http://software.eigenvector.com/Data/index.html.
51. Naik P., Tsai C.L. Partial least squares estimator for single-index models. J. R. Stat. Soc. Ser. B 2000, 62:763-771.