Impartial graphical comparison of multivariate calibration methods and the harmony/parsimony tradeoff

Journal of Chemometrics

Volumn 20, Issue 11-12, 2006, Pages 464-475

  Stout, Forrest ^a   Baines, Maurita R ^a   Kalivas, John H ^a  

^a IDAHO STATE UNIVERSITY   (United States)

Author keywords

Degrees of freedom; Effective rank; Harmonious; L curve; Meta parameter selection; Multivariate calibration; Parsimonious

Indexed keywords

CALIBRATION; COMPUTATIONAL CHEMISTRY; DEGREES OF FREEDOM (MECHANICS); ERRORS; LEAST SQUARES APPROXIMATIONS; MEAN SQUARE ERROR; PRINCIPAL COMPONENT ANALYSIS;

DEGREE OF FREEDOM; EFFECTIVE RANK; HARMONIOUS; L-CURVE; META-PARAMETER SELECTION; METAPARAMETERS; MULTIVARIATE CALIBRATION; PARAMETER SELECTION; PARSIMONIOUS; PARSIMONIOUS MODELLING;

MULTIPLE LINEAR REGRESSION;

EID: 34249328882     PISSN: 08869383     EISSN: 1099128X     Source Type: Journal    
DOI: 10.1002/cem.1025     Document Type: Article

References (59)

1. Næs T, Isaksson T, Fern T, Davies T. A User Friendly Guide to Multivariate Calibration and Classification. NIR Publications: Chichester, 2002.
2. Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer: New York, 2001.
3. American Society for Testing and Materials, Annual Book of ASTM Standards, Vol. 3. 06, E1655, Standard Practices for Infrareds Multivariate, Quantitative Analysis, ASTM International: West Conshohocken, Pennsylvania, 1998, page 10.
4. Frank IE, Friedman JH. A statistical view of some chemometrics regression tools. Technometrics 1993; 35: 109-148.
5. Forrester JB, Kalivas JH. Ridge regression optimization using a harmonious approach. J. Chemom. 2004; 18: 372-384.
6. Stout F, Kalivas JH. Tikhonov regularization in standardized and general form for multivariate calibration with application towards removing unwanted spectral artifacts. J. Chemom. 2006; 20: 22-33.
7. Seipel HA, Kalivas JH. Effective rank for multivariate calibration methods. J. Chemom. 2004; 18: 306-311.
8. Seipel HA, Kalivas JH. Erratum to Seipel HA, Kalivas JH. Effective rank for multivariate calibration methods. J. Chemometrics 2004; 18: 306-311.
9. J. Chemom. 2005; 19: 64.
10. Kalivas JH. Multivariate calibration, an overview. Anal. Let. 2005; 38: 2259-2279.
11. Kalivas JH, Green RL. Pareto optimal multivariate calibration for spectroscopic data. Appl. Spectrosc. 2001; 55: 1645-1652.
12. Green RL, Kalivas JH. Graphical diagnostics for regression model determinations with consideration of the bias/variance trade-off. Chemom. Intell. Lab. Syst. 2002; 60: 173-188.
13. Kalivas JH. Pareto calibration with built-in wavelength selection. Anal. Chim. Acta 2004; 505: 9-14.
14. Höskuldsson A. The H-principle in modeling with applications to chemometrics. Chemom. Intell. Lab. Syst. 1992; 14: 139-153.
15. Hansen PC. Rank Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion. SIAM: Philadelphia, 1998.
16. Hansen PC. The L-curve and its use in the numerical treatment of inverse problems. In Computational Inverse Problems in Electrocardiography, Johnson P (ed.). WIT Press: South Hampton, 2001; 119-142.
17. Belge M, Kilmer ME, Miller E. Efficient determination of multiple regularization parameters in a generalized L-curve framework. Inverse Probl. 2002; 18: 1161-1183.
18. Anderson KJ, Kalivas JH. Assessment of Pareto calibration, stability, and wavelength selection. Appl. Spectrosc. 2003; 57: 309-316.
19. Geladi P, Swerts J, Lindgren F. Multiwavelength microscopic analysis of a piece of painted chinaware: classification and regression. Chemom. Intell. Lab. Syst. 1994; 24: 145-167.
20. Geladi P. The regression model comparison plot (REMOCOP). In Frontiers in Analytical Spectroscopy, Proceedings of Spectroscopy Across the Spectrum IV, Andrews D, Davies A, (eds). Royal Society of Chemistry 1995; 225-236.
21. Kalivas JH. Interrelationships of multivariate regression methods using eigenvector basis sets. J. Chemom. 1999; 13: 111-132.
22. Kalivas JH. Basis sets for multivariate regression. Anal. Chim. Acta 2001; 428: 31-40.
23. Myers RH. Classical and Modern Regression With Applications (2nd edn). Duxbury: Pacific Grove, CA, 1990.
24. O'Sullivan F. A statistical perspective on ill-posed inverse problems. Stat. Sci. 1986; 1: 502-527.
25. Ye J. On measuring and correcting the effects of data mining and model selection. J. Am. Stat. Assoc. 1998; 93: 120-131.
26. van der Voet H. Pseudo-degrees of freedom for complex predictive models: the example of partial least squares. J. Chemom. 1999; 13: 195-208.
27. Faber K, Kowalski BR. Propagation of measurement error for the validation of predictions obtained by principal components regression and partial least squares. J. Chemom. 1997; 11: 181-238.
28. Mark H. Principles and Practices of Spectroscopic Calibration. Wiley: New York, 1991.
29. Fearn T. Shrinking calibrations. In Making Light Work: Advances in Near Infrared Spectroscopy, Murray I, Cowe IA (eds). VCH Publishers: New York, NY, 1992; 147-152.
30. Geladi P, Esbensen K. Regression on multivariate images: principal component regression for modeling, prediction and visual diagnostic tools. J. Chemom. 1991; 5: 97-112.
31. Booksh KS, Wang Z. Extension and application of univariate figures of merit to multivariate calibration. In Chemometrics in Environmental Chemistry - Statistical Methods, Einay J (Ed.). Springer-Verlag: Berlin, 1995; 209-227.
32. Booksh KS, Kowalski BR. Theory of analytical chemistry. Anal. Chem. 1994; 66: 782A-791A.
33. Dax A. On regularized least norm problems. SIAM J. Optimization 1992; 2: 602-618.
34. Claerbout JF, Muir F. Robust modeling with erratic data. Geophysics 1973; 38: 826-844.
35. 1 norm. Geophysics 1979; 44: 39-52.
36. Santosa F, Symes W. Linear inversion of band-limited reflection seismograms. SIAM J. Sci. Stat. Comput. 1986; 7: 1307-1330.
37. Öjelund H, Madsen H, Thyregod P. Calibration with absolute shrinkage. J. Chemom. 2001; 15: 497-509.
38. Öjelund H, Madsen H, Thyregod P. Calibration with empirically weighted mean subset. Appl. Spectrosc. 2002; 56: 887-896.
39. Öjelund H, Madsen H, Brown PJ, Thyregod P. Prediction based mean subset. Technometrics 2002; 44: 369-378.
40. Fu WJ. Penalized regressions: the bridge versus the lasso. J. Computnl. Graph. Statist. 1998; 7: 397-416.
41. van de Geer S. Least squares estimation with complexity penalties. Math. Meth. Statist. 2001; 10: 355-375.
42. Fan J, Li R. Variable selection via nonconcave penalized likelihood and its oracle properties. J. Am. Statist. Assoc. 2001; 96: 1348-1360.
43. Tibshirani R. Regression shrinkage and selection via the lasso. J. R. Statist. Soc. B 1996; 58: 267-288.
44. Stout F, Héberger K, Kalivas JH. Wavelength selection for multivariate calibration using Tikhonov regularization. Appl. Spectrosc. 2007; 61: 85-95.
45. Stout F, Kalivas JH. Evaluation of multivariate calibration using a Tikhonov regularization approach and the generalized pair-correlation method with non-linear data. Anal. Let. (in press).
46. p. Technometrics 1973; 42: 87-94.
47. Myers RH. Classical and Modern Regression With Applications (2nd edn). Duxbury: Pacific Grove, CA, 1990.
48. Golub GH, Heath M, Wahba G. Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics 1979; 21: 215-223.
49. Capron X, Walczak B, de Noord OE, Massart DL. A modification of ICOMP criterion for estimation of optimum complexity of PCR models. J. Chemom. 2005; 19: 308-316.
50. Wise BM, Gallagher NB, Bro R, Shaver JM. PLS_Toolbox 3.0 for use With MATLAB. Eigenvector Research: Manson, WA, 2003.
51. Mattioni BE, Jurs PC. J. Chem. Inf. Comput. Sci. 2003; 42: 94.
52. Shao J. Linear model selection by cross-validation. J. Am. Statist. Assoc. 1993; 88: 486-494.
53. Steinberg DM, Hunter WG. Experimental design: review and comment. Technometrics 1984; 26: 71-97.
54. Duineveld CAA, Smilde AK, Doornbos DA. Designs for mixture and process variables applied in tablet formulations. Anal. Chim. Acta 1993; 277: 455-465.
55. DiFoggio R. Desensitizing models using covariance matrix transforms or counter-balanced distortions. J. Chemom. 2005; 19: 203-215.
56. Westerhaus M. Improving repeatability of NIR calibrations across instruments. In Proceedings of Third International Conference. Near Infrared Spectrosc. Biston R, Bartiaux-Thill N (eds). Agricultural Research Centre Publishing: Gemblous, Belgium, 1990; 671-674.
57. Tillman P, Reinhardt T, Paul C. Networking of near infrared spectroscopy instruments for rapeseed analysis: a comparison of different procedures. J. Near Infrared Spectrosc. 2000; 8: 103-107.
58. Eliers PHC. A perfect smoother. Anal. Chem. 2003; 75: 3631-3636.
59. Yeow YL, Leon YK. A general computational method for converting normal spectra into derivative spectra. Appl. Spectrosc. 2005; 59: 584-592.