Tikhonov regularization in standardized and general form for multivariate calibration with application towards removing unwanted spectral artifacts

Journal of Chemometrics

Volumn 20, Issue 1-2, 2006, Pages 22-33

  Stout, Forrest ^a   Kalivas, John H ^a  

^a IDAHO STATE UNIVERSITY   (United States)

Author keywords

Noise reduction; Ridge regression; Spectral smoothing; Temperature effects; Tikhonov regularization; Wavelength selection

Indexed keywords

FORECASTING; LEAST SQUARES APPROXIMATIONS; MATRIX ALGEBRA; MEAN SQUARE ERROR; PRINCIPAL COMPONENT ANALYSIS; REGRESSION ANALYSIS; STANDARDIZATION; TEMPERATURE; VECTOR SPACES; VECTORS;

DERIVATIVE OPERATORS; MULTIVARIATE CALIBRATION; PRINCIPAL COMPONENTS; REGRESSION VECTORS; RIDGE REGRESSION; SPECTRAL ARTIFACTS; SPECTRAL DATA; SPECTRAL SMOOTHING; TIKHONOV REGULARIZATION; WAVELENGTH SELECTION;

NOISE ABATEMENT;

EID: 33847267364     PISSN: 08869383     EISSN: 1099128X     Source Type: Journal    
DOI: 10.1002/cem.975     Document Type: Article

References (39)

1. Hansen PC. Rank Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion. SIAM: Philadelphia, 1998.
2. Brown CD, Wentzell PD. Hazards of digital smoothing filters as a preprocessing tool in multivariate calibration. J. Chemom. 1999; 13: 133-152.
3. Goutis C, Fearn T. Partial least squares regression on smooth factors. J. Am. Statist. Assoc. 1996; 91: 627-632.
4. Rutledge DN, Barros A, Delgadillo I. PoLiSh - smoothed partial least squares regression. Anal. Chim. Acta 2001; 446: 281-296.
5. Alsberg B. Representation of spectra by continuous functions. J. Chemom. 1993; 7: 177-193.
6. Denham MC, Brown PJ. Calibration with many variables. Appl. Statist. 1993; 42: 515-528.
7. Marx BD, Eilers PHC. Generalized linear regression on sampled signals and curves: a P-spline approach. Technometrics 1999; 41: 1-13.
8. Hastie T, Mallows C. Discussion of a statistical view of some chemometric regression tools. Technometrics 1993; 35: 140-143.
9. Wülfert F, Kok WT, Smilde AK. Influence of temperature on vibrational spectra and consequences for the predictive ability of multivariate models. Anal. Chem. 1998; 70: 1761-1767.
10. Hagerman JA, Westerhuis JA, Smilde AK. Temperature robust multivaraite calibration: an overview of methods for dealing with temperature influences on near infrared spectra. J. Near Infrared Spectrosc. 2005; 13: 53-62.
11. Wise BM, Gallagher NB, Bro R, Shaver JM. PLS_Toolbox 3.0 for use with MATLAB. Eigenvector Research: Manson, WA, 2003.
12. Kalivas JH. Two data sets of near infrared spectra. Chemom. Intell. Lab. Syst. 1997; 37: 255-259.
13. Swierenga H, Wülfert F, de Noord OE, de Weijer AP, Smilde AK, Buydens LMC. Development of robust calibration models in near infra-red spectrometric applications. Anal. Chim. Acta. 2000; 411: 121-135.
14. Wülfert F, Kok WT, de Noord OE, Smilde AK. Correction of temperature-induced spectral variation by continuous piecewise direct standardization. Anal. Chem. 2000; 72: 1639-1644.
15. Wülfert F, Kok WT, de Noord OE, Smilde AK. Linear techniques to correct for temperature-induced spectral variation in multivariate calibration. Chemom. Intell. Lab. Syst. 2000; 51: 189-200.
16. Marx BD, Eilers PHC. Multivariate calibration stability: a comparison of methods. J. Chemom. 2002; 16: 129-140.
17. Eilers PHC, Marx BD. Multivariate calibration with temperature interaction using two-dimensional penalized signal regression. Chemom. Intell. Lab. Syst. 2003; 66: 159-174.
18. Thissen U, Üstün B, Melssen WJ, Buydens LMC. Multivariate calibration with least-squares support vector machines. Anal. Chem. 2004; 76: 3099-3105.
19. Kalivas JH. Pareto calibration with built-in wavelength selection. Anal. Chim. Acta 2004; 505: 9-14.
20. Forrester JB, Kalivas JH. Ridge regression optimization using a harmonious approach. J. Chemom. 2004; 18: 372-384.
21. Hansen PC. Regularization tools: a Matlab package for analysis and solution of discrete ill-posed problems. Num. Algorithms 1994; 6: 1-35.
22. Hansen PC. [Online] Available: http://www.netlib.org/numeralgo/na4/ [April 28, 2005].
23. Hansen PC. Regularization. GSVD and truncated GSVD. BIT 1989; 29: 491-504.
24. Hansen PC, Seki T, Shibahashi H. The modulated truncated SVD method for regularization in general form. SIAM J. Sci. Stat. Comput. 1992; 13: 1142-1150.
25. Vogt F, Rebstock K, Tacke M. Correction of background drifts in otpical spectrs by means of "pseudo principle components". Chemom. Intell. Lab. Syst. 2000; 50: 175-178.
26. Vogt F, Steiner H, Booksh K, Mizaikoff B. Chemometric correction of drift effects in optical spectra. Appl. Spectrosc. 2004; 58: 683-692.
27. Green RL, Kalivas JH. Pareto optimal multivariate calibration for spectroscopic data. Appl. Spectrosc. 2001; 55: 1645-1652.
28. Brown CD. Discordance between net analyte signal theory and practical multivariate calibration. Anal. Chem. 2004; 76: 4364-4373.
29. Westerhaus M. Improving repeatability of NIR calibrations across instruments. In Proc. Third Intl. Conf. Near Infrared Spectrosc., Biston R, Bartiaux-Thill N (eds). Agricultural Research Centre Publishing: Gemblous, Belgium, 1990, 671-674.
30. Tillman P, Reinhardt T, Paul C. Networking of near infrared spectroscopy instruments for rapeseed analysis: a comparison of different procedures. J. Near Infrared Spectrosc. 2000; 8: 103-107.
31. Faber K, Kowalski BR. Propagation of measurement error for the validation of predictions obtained by principal components regression and partial least squares. J. Chemom. 1997; 11: 181-238.
32. Seipel HA, Kalivas JH. Effective rank for multivariate calibration methods. J. Chemom. 2004; 18: 306-311.
33. Ye J. On measuring and correcting the effects of data mining and model selection. J. Am. Statist. Assoc. 1998; 93: 120-131.
34. Shao J. Linear model selection by cross-validation. J. Am. Statist. Assoc. 1993; 88: 486-494.
35. Kalivas JH, Green RL. Pareto optimal multivariate calibration for spectroscopic data. Appl. Spectrosc. 2001; 55: 1645-1652.
36. Anderson KJ, Kalivas JH. Assessment of Pareto calibration, stability, and wavelength selection. Appl. Spectrosc. 2003; 57: 309-316.
37. Eliers PHC. A perfect smoother. Anal. Chem. 2003; 75: 3631-3636.
38. Yeow YL, Leon YK. A general computational method for converting normal spectra into derivative spectra. Appl. Spectrosc. 2005; 59: 584-592.
39. Stout F, Héberger K, Kalivas JH. Tikhonov regularization for wavelength selection. Submitted.