Robust partial least squares regression: Part I, algorithmic developments

Journal of Chemometrics

Volumn 22, Issue 1, 2008, Pages 1-13

  Kruger, Uwe ^a,b   Zhou, Yan ^b   Wang, Xun ^b   Rooney, David ^b   Thompson, Jillian ^b  

^a KHALIFA UNIVERSITY   (United Arab Emirates)

^b QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

Author keywords

Iteratively reweighted least squares; Outlyingness; Partial least squares; Robust estimation

Indexed keywords

ITERATIVE METHODS; LEAST SQUARES APPROXIMATIONS;

ALGORITHMIC ANALYSIS; ALGORITHMICS; ITERATIVELY REWEIGHTED LEAST-SQUARES; OUTLYINGNESS; PARTIAL LEAST-SQUARES; RECENT RESEARCHES; RESEARCH ACTIVITIES; ROBUST ESTIMATION; ROBUST FORMULATIONS; ROBUST PARTIAL LEAST SQUARES REGRESSIONS;

COMPUTATIONAL EFFICIENCY;

EID: 53649087137     PISSN: 08869383     EISSN: 1099128X     Source Type: Journal    
DOI: 10.1002/cem.1093     Document Type: Article

References (52)

1. Wold H. In Research Papers in Statistics, David F (ed.). Wiley: New York, USA, 1966; 411-444.
2. Wold H. Estimation of Principal Components and Related Models by Iterative Least Squares, Multivariate Analysis. Academic Press: New York, USA, 1966; 391-420.
3. Hemmateenejad B, Miri R, Akhond M, Shamsipur M. QSAR study of the calcium channel antagonist activity of some recently synthesized dihydropyridine derivatives: an application of genetic algorithm for variable selection in MLR and PLS methods. Chemom. Intell. Lab. Syst. 2002; 64(1): 91-99.
4. Guha R, Jurs PC. Development of QSAR models to predict and interpret the biological activity of artemisinin analogues. J. Chem. Inf. Comput. Sci. 2004; 44(4): 1440-1449.
5. Freitas MP, Brown SD, Martins JA. MIA-QSAR: a simple 2D image-based approach for quantitative structure-activity relationship analysis. J. Mol. Struct. 2005; 738(1-3): 149-154.
6. Marquez AJ, Diaz AM, Reguera MIP. Using optical NIR sensor for on-line virgin olive oils characterization. Sensor. Actuator. B (Chem.) 2005; 107(1): 64-68.
7. Sripada RP, Heiniger RW, White JG, Weisz R. Aerial color infrared photography for determining late-season nitrogen requirements in corn. Agronom J. 2005; 97(5): 1443-1451.
8. Watari M, Ozaki Y. Calibration models for the vinyl acetate concentration in ethylene-vinyl acetate copolymers and its on-line monitoring by near-infrared spectroscopy and chemometrics: use of band shifts associated with variations in the vinyl acetate concentration to improve the models. Appl. Spectrosc. 2005; 59(7): 912-919.
9. Mello C, Ribeiro D, Novaes F, Poppi RJ. Rapid differentiation among bacteria that cause gastroenteritis by use of low-resolution Raman spectroscopy and PLS discriminant analysis. Analyt. Bioanalyt. Chem. 2005; 383(4): 701-706.
10. Elizalde O, Asua JM, Leiza JR. Monitoring of high solids content starved-semi-batch emulsion copolymerization reactions by fourier transform Raman spectroscopy. Appl. Spectrosc. 2005; 59(10): 1270-1279.
11. Johnson KJ, Morris RE, Rose-Pehrsson SL. Evaluating the predictive powers of spectroscopy and chromatography for fuel quality assessment. Energ Fuel 2006; 20(2): 727-733.
12. Kourti T, MacGregor JF. Multivariate SPC methods for process and product monitoring. J. Qual. Technol. 1996; 28(4): 409-428.
13. Stavropoulos Y, Kammona O, Chatzi EG, Kiparissides C Multivariate statistical analysis of mid-infrared spectra for the online monitoring of 2-ethylhexyl acrylate/styrene emulsion copolymerization. J. Appl. Polym. Sci. 2001; 82(7): 1776-1787.
14. Komulainen T, Sourander M, Jamsa-Jounela SL. An online application of dynamic PLS to a dearomatization process. Comput. Chem. Eng. 2005; 28(12): 2611-2619.
15. Geladi P. Notes on the history and nature of partial least squares (PLS) modeling. J. Chemometrics 1988; 2(4): 231-246.
16. Wold S, Ruhe A, Wold H, Dunn WJ. The collinearity problem in linear regression: the partial least-squares (PLS) approach to generalised inverses. SIAM J. Sci. Comput. 1984; 5(3): 735-743.
17. Naes T, Martens H. Comparison of prediction methods for multicollinear data. Commun. Stat - Simul. Comput. 1985; 14(3): 545-576.
18. Burnham AJ, Viveros R, MacGregor JF. Framework for latent variable multivariate regression. J. Chemometrics 1996; 10(1): 31-45.
19. Huber PJ. Robust Statistics. Wiley: Toronto, Canada, 1981.
20. Rousseeuw PJ. Least median of squares regression. J. Am. Stat. Assoc. 1984; 79(388): 871-880.
21. Siegel AF. Robust regression using repeated median. Biometrika 1982; 69(1): 242-244.
22. Gemperline PJ, Webber LD, Cox FO. Raw materials testing using soft independent modeling of class analogy analysis of near-infrared reflectance spectra. Anal. Chem. 1989; 61(2): 138-144.
23. Mark H. Use of Mahalanobis distances to evaluate sample preparation methods for near-infrared reflectance analysis. Anal. Chem. 1987; 59(5): 790-795.
24. Penny Kl. Appropriate critical values when testing for a single multivariate outlier by using the mahalanobis distance. Appl. Stat. 1996; 45(1): 73-81.
25. Lleti R, Melendez E, Ortiz MC, Sarabia LA, Sanchez MS. Outliers in partial least squares regression application to calibration of wine grade with mean infrared data. Anal. Chim. Acta 2005; 544(1, 2): 60-70.
26. Lorber A, Kowalski BR. Alternatives to cross-validatory estimation of the number of factors in multivariate calibration. Appl. Spectrosc. 1990; 44(9): 1464-1470.
27. Paul SR, Fung KY. A generalized extreme studentized residual murtiple-outlier-detection procedure in linear regression. Technometrics 1991; 33(3): 339-348.
28. Wakeling IN, Macfie HJH. A robust PLS procedure. J. Chemometrics 1992; 6(4): 189-198.
29. Møller SF, von Frese J, Bra R. Robust methods for multivarite data analysis. J. Chemometrics 2005; 19(10): 549-563.
30. Griep MI, Wakeling IN, Vankeerberghen P, Massart DL. Comparison of semirobust and robust partial least squares procedures. Chemom. Intell. Lab. Syst. 1995; 29(1): 37-50.
31. Cummins DJ, Andrews CW. Iteratively reweighted partial least squares - a performance analysis by Monte-Carlo simulation. J. Chemometrics 1995; 9(6): 489-507.
32. Gil JA, Romera R. On robust partial least squares (PLS) methods. J. Chemometrics 1998; 12(6): 365-378.
33. Pell RJ. Multiple outlier detection for multivariate calibration using robust statistical techniques. Chemom. Intell. Lab. Syst. 2000; 52(1): 87-104.
34. Forina M, Casolino C, Almansa EM. The refinement of PLS models by iterative weighting of predictor variables and objects. Chemometr. Intell. Lab. Syst. 2003; 68(1, 2): 29-40.
35. Serneels S, Croux C, Filzmoser P, van Espen PJ. Partial robust M-regression. Chemom. Intell. Lab. Syst. 2005; 79(1, 2): 55-64.
36. Chen D, Shao XG, Hu B, Su Q. Simultaneous wavelength selection and outlier detection in multivariate regression of near-infrared spectra. Anal. Sci. 2005; 21(2): 161-166.
37. Lee HW, Lee MW, Park JM. Robust adaptive partial least squares modeling of a full-scale industrial wastewater treatment process. Ind. Eng. Chem. Res. 2007; 46(3): 955-964.
38. Hubert M, Vanden Branden BK. Robust methods for partial least squares regression. J. Chemometrics 2003; 17(10): 537-549.
39. Geladi P, Kowalski BR. Partial least-squares regression: a tutorial. Anal. Chim,Acta 1986; 185: 1-17.
40. de Jong S. SIMPLS, an alternative approach to partial least squares regression. Chemom. Intell. Lab. Syst. 1993; 18(3): 251-263.
41. Hubert M, Rousseeuw PJ, Vanden BK. ROBPCA: a new approach to robust principal component analysis. Technometrks 2005; 47(1): 64-79.
42. Zhang MH, Xu QS, Massart DL. Robust principal component regression based on principal sensitivity vectors. Chemom. Intell. Lab. Syst. 2003; 67(2): 175-185.
43. Coakley CW, Hettamansperger TP. A bounded influence, high breakdown, efficient regression estimator. J. Am. Stat. Assoc. 1993; 88(423): 872-880.
44. Hampel FR. General qualitative definition of robustness. Ann. Math. Stat. 1971; 42(6): 1887-1896.
45. Juan J, Prieto FJ. A subsampling method for the computation of multivariate estimators with high breakdown point. J. Comp. Graph. Statist 1995; 4(4): 319-334.
46. Kaspar MH, Ray WH. Partial least-squares modeling as successive singular value decompositions. Comput. Chem. Eng. 1993; 17(10): 985-989.
47. Qin SJ. Recursive PLS algorithms for adaptive data modeling. Comput. Chem. Eng. 1998; 22(4, 5): 503-514.
48. Phillips GR, Eyring ME. Comparison of conventional and robust regression in analysis of chemical data. Anal. Chem. 1983; 55(7): 1134-1138.
49. Helland IS. Partial least squares regression and statistical models. Scand. J. Stat. 1990; 17(2): 97-114.
50. Stone M. Cross-validatory choice and assessment of statistical predictions. J. R. Stat. Soc. B Stat. Meth. - Methodological 1974; 36(2): 111-147.
51. Cramer JA, Shah SS, Battaglia TM, Banerji SN, Obando LA, Booksh KS. Outlier detection in chemical data by fractal analysis. J. Chemometrics 2004; 18(7,8): 317-326.
52. Stahel WA. Robust estimation: infinitisimal optimality and covariance matrix estimator. Ph.D. thesis, ETH Zurich, Switzerland, 1981.