Principal component regression (PCR) and partial least squares regression (PLSR)

Mathematical and Statistical Methods in Food Science and Technology

Volumn , Issue , 2013, Pages 121-142

  Ergon, Rolf ^a  

^a UNIVERSITY OF SOUTH EASTERN NORWAY   (Norway)

Author keywords

Model reduction; OLS; Optimal estimation; PCR; PCR and PLSR practices; PLSR; PLSR residuals; Score loading correspondence

Indexed keywords

LEAST SQUARES APPROXIMATIONS; PROCESS MONITORING; REGRESSION ANALYSIS;

MODEL REDUCTION; OPTIMAL ESTIMATIONS; PCR AND PLSR PRACTICES; PLSR; PLSR RESIDUALS; SCORE-LOADING CORRESPONDENCE;

PRINCIPAL COMPONENT ANALYSIS;

EID: 85017003625     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781118434635.ch08     Document Type: Chapter

References (64)

1. Aikaike, H. (1974) A new look at the statistical model identification. IEEE Transactions on Automatic Control AC -1 9 , 716-723.
2. Andersen, C.M. and Bro, R. (2010) Variable selection in regression -a tutorial. Journal of Chemometrics 24, 728-737.
3. Andersson, M. (2009) A comp arison of nine PLS1 algorithms. Journal of Chemometric s 23, 518-529.
4. Brereton, R.G. (2003) Chemometrics . John Wiley & Sons Ltd, Chichester, UK.
5. Bro, R. and Eld en, L. (2009) PLS works. Journal of Chemometrics 23 , 69-71.
6. Di Ruscio, D. (2000) A weighted view on the partial least-squares algorithm. Automatica 36, 831-850.
7. Eigenvector Research, Inc . (2005) Data set . [Online] Available: http://www.eigenvector.com/data/Corn/index.html (last accessed 9 June 2013).
8. Ergon, R. (1999) Dynamic System Multivariate Calibration for Optimal Primary Output Estimation, PhD thesis, Norwegian University of Science and Technology, Norway.
9. Ergon, R. (2002a) Noise handling capabilities of multivariate calibration methods. Modeling, Identification and Control 23, 259-273.
10. Ergon, R. (2002b) PLS score-loading correspondence and a bi-diagonal factorization. Journal of Chemometrics 16, 368-373.
11. Ergon R. (2003a) Constrained numerical optimization of PCR/PLSR predictors. Chemometrics and Intelligent Laboratory Systems 65, 293-303.
12. Ergon, R. (2003b) Compression into two-component PLS factorizations. Journal of Chemometrics 17, 303-312.
13. Ergon, R. (2004) Informative PLS score-loading plots for process understanding and monitoring. Journal of Process Control 14, 889-897.
14. Ergon, R. (2005) PLS post-processing by similarity transformation (PLS ST): a simple alternative to OPLS. Journal of Chemometrics 19, 1-4.
15. Ergon R. (2006) Reduced RCR/PLSR models by subspace projections. Chemometrics and Intelligent Laboratory Systems 81, 68-73.
16. Ergon, R. (2007) Finding Y-relevant part of X by use of PCR and PLSR model reduction methods. Journal of Chemometrics 21, 537-546.
17. Ergon, R. (2009) Re-interpretation of NIPALS results solves PLSR inconsistency problem. Journal of Chemometrics 23, 72-75.
18. Ergon, R. and Esbensen K.H. (2001) A didactically motivated PLS prediction algorithm. Modeling, Identification and Control 22, 131-139.
19. Ergon, R. and Esbensen K.H. (2002) PCR/PLSR optimization based on noise covariance estimation and Kalman filtering theory. Journal of Chemometrics 16, 401-407.
20. Ergon, R., Halstensen, M. and Esbensen, K.H. (2011) Model choice and squared prediction errors in PLS regression. Journal of Chemometrics 25, 301-312.
21. Esbensen, K.H. (2010) Multivariate Data Analysis in Practice. Camo, Oslo, Norway.
22. Esbensen, K.H. and Geladi, P. (2010) Principles of proper validation: use and abuse of re-sampling for validation. Journal of Chemometrics 24, 168-187.
23. Faber, N.M. (2009) The X-residuals calculated by partial least squares are problematic for uncertainty estimation. Chemometrics and Intelligent Laboratory Systems 96, 264-265.
24. Feudale, R.N.,Woody, N.A., Tan, H. et al. (2002) Transfer of multivariate calibration models: a review. Chemometrics and Intelligent Laboratory Systems 64, 181-192.
25. Geladi, P. (2002) Some trends in the calibration literature. Chemometrics and Intelligent Laboratory Systems 60, 211-224.
26. Gelb, A. (1974) Applied Optimal Estimation. MIT Press, Cambridge, MA.
27. Golub, G.H. and Kahan, W. (1965) Calculating the singular values and pseudoinverse of a matrix. SIAM Journal on Numerical Analysis, Series B 2, 205-224.
28. Grewal, M.S. and Andrews A.P. (1993) Kalman filtering: Theory and Practice. Prentice-Hall, Englewood Cliffs, NJ.
29. Gujral, P., Amrhein, M., Ergon, R. et al. (2011) On multivariate calibration with unlabeled data. Journal of Chemometrics 25 , 456-465.
30. Halstensen, M. and Esbensen, K.H. (2010) Acoustic chemometric monitoring of industrial production processes. In: Process Analytical Technology (ed. K. A. Bakeev), 2nd edn. John Wiley & Sons Ltd, Chichester, UK.
31. Høskuldsson, A. (1996) Prediction Methods in Science and Technology, Vol. 1 Basic Theory. Thor Publishing, Copenhagen, Denmark.
32. Johnson, R.A. and Wichern, D.W. (1992) Applied Multivariate Statistical Analysis. Prentice-Hall, Englewood Cliffs, NJ.
33. Kalman, R.E. (1960) A new approach to linear filtering and prediction problems Journal of Basic Engineering 82, 35-45. [Online] Available: http://www.elo.utfsm.cl/
34. Kemsley E.K. and Tapp H.S. (2009) OPLS filtered data can be obtained directly from non-orthogonalized PLS1. Journal of Chemometrics 23 263-264.
35. Kemsley, E.K., Tapp, H.S., Le Gall, G. and Colquhou, I.J. (2010) A Statistical Toolkit for Metabolomics. [Online] Available: http://www.ifr.ac.uk/Bioinformatics/BSResources/Metabolomics_Boston08_Kemsley_et_al.pdf (last accessed 9 June 2013).
36. Kourti, T. and MacGregor, J.F. (1996) Multivariate SPC methods for process and product monitoring. Journal of Quality Technology 28, 409-428.
37. Kvalheim, O.M., Rajalahti, T. and Arneberg, R. (2008) X-tended target projection (XTP) -comparison with orthogonal partial least squares (OPLS) and PLS post-processing by similarity transformation (PLSST). Journal of Chemometrics 23, 49-55.
38. Langsrud, Ø. and Næs, T. (2003) Optimised score plot by principal components of predictions. Journal of Chemometrics 24, 168-187.
39. Måge, I., Menichelli, E. and Næs, T. (2012) Preference mapping by PO-PLS: Separating common and unique information in several data block. Food Quality and Preference 24, 8-16.
40. Mallows, C.L. (1973) Some comments on Cp. Technometrics 15, 661-675.
41. Manne, R. (1987) Analysis of two partial-least-squares algorithms for multivariate calibration. Chemometrics and Intelligent Laboratory Systems 81, 68-73.
42. Manne, R., Pell R.J. and Ramos, L. S. (2009) The PLS model space: the inconsistency persists. Journal of Chemometrics 23, 76-77.
43. Martens, H. and Næs, T. (1987) Multivariate calibration by data compression. In Near Infra-red Technology in Agricultural and Food Industries (eds P. C. Williams and K. Norris). American Association of Cereal Chemists, St Paul, MN, pp. 57-87.
44. Martens, H. and Næs, T. (1989) Multivariate calibration. John Wiley & Sons, Inc., New York.
45. Næs, T. and Martens, H. (1988) Principal component regression in NIR analysis: Viewpoints, background details and selection of components. Journal of Chemometrics 2(2), 155-167.
46. Næs, T. and Mevik, B-H. (2001) Understanding the collinearity problem in regression and discriminant analysis. Journal of Chemometrics 15, 413-426.
47. Næs, T., Isaksson, T., Fearn, T. and Davies, T.A. (2004) A User-friendly Guide to Multivariate Calibration and Classification. NIR Publications, Chichester, UK.
48. Næs, T., Måge, I. and Segtnan, V.H (2011) Incorporating interactions in multiblock sequential and orthogonalised partial least squares regression. Journal of Chemometrics 25, 601-609.
49. Nomikos, P. and MacGregor, J.F. (1994) Monitoring of batch processes using multiway principal component analysis. AIChE Journal 40, 1361-1375.
50. Nomikos, P. and MacGregor, J.F. (1995a) Multi-way partial least squares in monitoring batch processes. Chemometrics and Intelligent Laboratory Systems 30, 97-108.
51. Nomikos, P. and MacGregor, J.F. (1995b) Multivariate SPC charts for monitoring batch processes. Technometrics 37, 41-59.
52. Olivieri, A.C., Faber, N.M., Ferr e, J. et al. (2006) Uncertainty estimation and figures of merit for multivariate calibration. Pure and Applied Chemistry 78, 633-661.
53. Otto, M. (2007) Chemometrics. Wiley-VCH, Weinheim, Germany.
54. Pell, R.J., Ramos, L.S. and Manne, R. (2007). The model space in partial least squares regression. Journal of Chemometrics 21, 165-172.
55. Pereira, C.F., Pimentel, M.F., Galavo, R.K.H. et al. (2008) A comparative study of calibration transfer methods for determination of gasoline quality parameters in three different near infrared spectrometers. Analytica Chimica Acta 611, 41-47.
56. Strang, G. (2006) Linear Algebra and Its Application, 2nd edn. Cengage Learning, Boston, MA.
57. Tapp, H.S. and Kemsley, E.K. (2009) Notes on the practical utility of OPLS. Trends in Analytical Chemistry 28, 1322-1327.
58. Tapp, H.S., Penfold, R. and Kemsley, E.K. (2011) TinyLVR: A utility for viewing single predictor multivariate models in terms of a two factor latent vector model. Chemometrics and Intelligent Laboratory Systems 105, 19-26.
59. Thielemans, A., Lewi, P.J. and Massart, D.L. (1988) Similarities and differences among multivariate display techniques illustrated by Belgian cancer mortality distribution data. Chemometrics and Intelligent Laboratory Systems 3, 277-300.
60. Trygg, J. and Wold, S. (2002) Orthogonal projections to latent structures, O-PLS. Journal of Chemometrics 16, 119-128.
61. Westerhuis J.A., Kourti, T. and MacGregor, J.F. (1999) Comparing alternative approaches for multivariate statistical analysis of batch process data. Journal of Chemometrics 13, 397-413.
62. Wise, B.M. and Gallagher, N.B. (1996) The process chemometrics approach to process monitoring and fault detection. Journal of Process Control 6, 329-348.
63. Wold, S., Martens, H. and Wold, H. (1983) The multivariate calibration problem in chemistry solved by PLS method. Lecture Notes in Mathematics 973, 286-293.
64. Wold, S., Høy, M., Martens, H. et al. (2009) The PLS model space revisited. Journal of Chemometrics 23, 67-68.