Optimization criteria in sample selection step of local regression for quantitative analysis of large soil NIRS database

Chemometrics and Intelligent Laboratory Systems

Volumn 110, Issue 1, 2012, Pages 168-176

  Goge F ^a   Joffre, R ^a   Jolivet, C ^b   Ross, I ^a   Ranjard, L ^c  

^a CENTRE D ECOLOGIE FONCTIONNELLE ET EVOLUTIVE   (France)

^b Centre de recherche d'Orléans   (France)

^c UNIVERSITÉ DE BOURGOGNE   (France)

Author keywords

Compression methods; Fast Fourier Transform; Local calibration; Near Infrared Spectroscopy; Sample selection; Soil spectral database

Indexed keywords

ARTICLE; CALIBRATION; CATION EXCHANGE; CLAY; CONTROLLED STUDY; CORRELATION COEFFICIENT; FOURIER TRANSFORMATION; MAHALANOBIS DISTANCE; NEAR INFRARED REFLECTANCE SPECTROSCOPY; PARTIAL LEAST SQUARES REGRESSION; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; PROCESS OPTIMIZATION; QUANTITATIVE ANALYSIS; REGRESSION ANALYSIS; SAMPLING; SAND; SOIL ANALYSIS; STATISTICAL CONCEPTS; TOTAL ORGANIC CARBON;

EID: 83655167381     PISSN: 01697439     EISSN: 18733239     Source Type: Journal    
DOI: 10.1016/j.chemolab.2011.11.003     Document Type: Article

References (59)

1. Dardenne P., Welle R. New approach for calibration from a local database to a global database. J Near Infrared Spectrosc. 1998, 6:55-60.
2. Williams P., Norris K. Near-Infrared technology in the agricultural and food industries. American Association of Cereal Chemists, St. Paul, Minnesota, USA 1987, 330.
3. Brown D.J. Using a global VNIR soil-spectral library for local soil characterization and landscape modeling in a 2nd-order Uganda watershed. Geoderma 2007, 140:444-453.
4. Williams P., Norris K. Near-Infrared Technology in the Agricultural and Food Industries 2001, 296. American Association of Cereal Chemists, St. Paul, Minnesota, USA.
5. Shepherd K.D., Walsh M.G. Development of reflectance spectral libraries for characterization of soil properties. Soil Sci. Soc. Am. J. 2002, 66:988-998.
6. Viscarra Rossel R.A., Chappell A., De Caritat P., McKenzie N.J. On the soil information content of visible-near infrared reflectance spectra. Eur. J. Soil Sci. 2011, 62:442-453.
7. Stenberg B., Rossel R.A.V., Mouazen A.M., Wetterlind J. Visible and near infrared spectroscopy in soil science. Adv. Agron. 2010, 107(107):163-215.
8. Wold S., Sjostrom M., Eriksson L. PLS-regression: a basic tool of chemometrics, Chemometrics Intell. Lab. Syst. 2001, 58:109-130.
9. Martens H., Naes T. Multivariate Calibration 1989, John Wiley & Sons, Chichester, UK.
10. Cogdill R.P., Dardenne P. Least-squares support vector machines for chemometrics: an introduction and evaluation. J. Near Infrared Spectrosc. 2004, 12:93-100.
11. Perez-Marin D., Garrido-Varo A., Guerrero J.E. Non-linear regression methods in NIRS quantitative analysis. Talanta 2007, 72:28-42.
12. Brown D.J., Shepherd K.D., Walsh M.G., Mays M.D., Reinsch T.G. Global soil characterization with VNIR diffuse reflectance spectroscopy. Geoderma 2006, 132:273-290.
13. Genot V., Colinet G., Bock L., Vanvyve D., Reusen Y., Dardenne P. Near infrared reflectance spectroscopy for estimating soil characteristics valuable in the diagnosis of soil fertility. J. Near Infrared Spectrosc. 2011, 19:117-138.
14. Dardenne P., Sinnaeve G., Baeten V. Multivariate calibration and chemometrics for near infrared spectroscopy: which method?. J. Near Infrared Spectrosc. 2000, 8:229-237.
15. Fidencio P.H., Poppi R.J., de Andrade J.C. Determination of organic matter in soils using radial basis function networks and near infrared spectroscopy. Anal. Chim. Acta 2002, 453:125-134.
16. Igne B., Reeves J.B., McCarty G., Hively W.D., Lund E., Hurburgh C.R. Evaluation of spectral pretreatments, partial least squares, least squares support vector machines and locally weighted regression for quantitative spectroscopic analysis of soils. J. Near Infrared Spectrosc. 2010, 18:167-176.
17. Pierna J.A.F., Dardenne P. Soil parameter quantification by NIRS as a Chemometric challenge at 'Chimiometrie 2006'. 9th Annual Chemometrics Congress 2006, 94-98. Elsevier Science Bv, Paris, France.
18. Vasques G.M., Grunwald S., Sickman J.O. Comparison of multivariate methods for inferential modeling of soil carbon using visible/near-infrared spectra. Geoderma 2008, 146:14-25.
19. Igne B., Hurburgh C.R. Using the frequency components of near infrared spectra: optimising calibration and standardisation processes. J. Near Infrared Spectrosc. 2010, 18:39-47.
20. Naes T., Isaksson T., Fearn T., Davies A.M.C. A user-friendly guide to multivariate calibration and classification 2002, NIR Publications, Chichester, UK.
21. Fearn T., Davies A.M.C. Locally-biased regression. J. Near Infrared Spectrosc. 2003, 11:467-478.
22. Shenk J.S., Berzaghi P., Westerhaus M.O. Investigation of a LOCAL calibration procedure for near infrared instruments. J. Near Infrared Spectrosc. 1997, 5:223-232.
23. Roweis S.T., Saul L.K. Nonlinear dimensionality reduction by locally linear embedding. Science 2000, 290:2323-+.
24. Igne B., Jr C.R.H. Local chemometrics for samples and variables: optimizing calibration and standardization processes. J. Chemometr. 2010, 24:75-86.
25. Berzaghi P., Shenk J.S., Westerhaus M.O. LOCAL prediction with near infrared multi-product databases. J. Near Infrared Spectrosc. 2000, 8:1-9.
26. Barton F.E., Shenk J.S., Westerhaus M.O., Funk D.B. The development of near infrared wheat quality models by locally weighted regressions. J. Near Infrared Spectrosc. 2000, 8:201-208.
27. Davies A.M.C., Britcher H.V., Franklin J.G., Ring S.M., Grant A., McClure W.F. The application of Fourier-transformed near-infrared spectra to quantitative-analysis by comparison of similarity indexes (CARNAC). Mikrochim. Acta 1988, 1:61-64.
28. Zamora-Rojas E., Garrido-Varo A., Van den Berg F., Guerrero-Ginel J.E., Pérez-Marín D.C. Evaluation of a new local modelling approach for large and heterogeneous NIRS data sets, Chemometrics Intell. Lab. Syst. 2010, 101:87-94.
29. Sankey J.B., Brown D.J., Bernard M.L., Lawrence R.L. Comparing local vs. global visible and near-infrared (VisNIR) diffuse reflectance spectroscopy (DRS) calibrations for the prediction of soil clay, organic C and inorganic C. Geoderma 2008, 148:149-158.
30. Davies A.M.C., Fearn T. Quantitative analysis via near infrared databases: comparison analysis using restructured near infrared and constituent data-deux (CARNAC-D). J. Near Infrared Spectrosc. 2006, 14:403-411.
31. Perez-Marin D., Garrido-Varo A., Guerrero J.E., Fearn T., Davies A.M.C. Advanced nonlinear approaches for predicting the ingredient composition in compound feedingstuffs by near-infrared reflection spectroscopy. Appl. Spectrosc. 2008, 62:536-541.
32. Arrouays D., Jolivet C., Boulonne L., Bodineau G., Saby N., Grolleau E. A new initiative in France: a multi-institutional soil quality monitoring network. C R Acad Agric Fr 2002, 88:93-105.
33. Saby N., Arrouays D., Boulonne L., Jolivet C., Pochot A. Geostatistical assessment of pb in soil around Paris, France. Sci. Total. Environ. 2006, 367:212-221.
34. Jolivet C., Arrouays D., Boulonne L., Ratié C., Saby N. Le Réseau de Mesures de la Qualité des Sols de France (RMQS), Etat d'avancement et premiers résultats. Etudes et Gestion des Sols 2006, 13:149-164.
35. AFNOR NF ISO 11464. Qualité du sol. Prétraitement des échantillons pour analyses physico-chimiques 1994, 8.
36. AFNOR NF ISO 14869-1. Qualité du sol. Mise en solution pour la détermination des teneurs élémentaires totales: Partie 1. Mise en solution par l'acide fluorhydrique et l'acide perchlorique 2001, 12.
37. Shenk J.S., Westerhaus M.O. ISI NIRS-2. Software for near-infrared instruments. User Manual 1991, Infrasoft International, Silverspring.
38. Rajer-Kanduc K., Zupan J., Majcen N. Separation of data on the training and test set for modelling: a case study for modelling of five colour properties of a white pigment, Chemometrics Intell. Lab. Syst. 2003, 65:221-229.
39. Puzyn T., Mostrag-Szlichtyng A., Gajewicz A., Skrzynski M., Worth A.P. Investigating the influence of data splitting on the predictive ability of QSAR/QSPR models. Struct. Chem. 2011, 22:795-804.
40. Kennard R.W., Stone L.A. Computer aided design of experiments. Technometrics 1969, 11. 137-&.
41. Galvao R.K.H., Araujo M.C.U., Jose G.E., Pontes M.J.C., Silva E.C., Saldanha T.C.B. A method for calibration and validation subset partitioning. Talanta 2005, 67:736-740.
42. Wu W., Walczak B., Massart D.L., Heuerding S., Erni F., Last I.R., Prebble K.A. Artificial neural networks in classification of NIR spectral data: Design of the training set, Chemometrics Intell. Lab. Syst. 1996, 33:35-46.
43. Hruschka W.R. Data analysis: wavelength selection methods. Near-infraed technology in the agricultural and food industries American Association of Cereal Chemists, Minnesota USA 2001, 39-58. P. Williams, K. Norris (Eds.).
44. Wold S., Esbensen K., Geladi P. Principal componnet analysis, Chemometrics Intell. Lab. Syst. 1987, 2:37-52.
45. Mahalanobis P. On the generalized distance in statistics. Proc. Nat. Inst. Sci. India 1936, 12:49-55.
46. Wu W., Walczak B., Penninckx W., Massart D.L. Feature reduction by Fourier transform in pattern recognition of NIR data. Anal. Chim. Acta 1996, 331:75-83.
47. McClure W.F., Hamid A., Giesbrecht F.G., Weeks W.W. Fourier-Analysis enhances Nir diffuse reflectance spectroscopy. Appl. Spectrosc. 1984, 38:322-329.
48. Fearn T., Davies A.M.C. A comparison of Fourier and wavelet transforms in the processing of near infrared spectroscopic data: Part 1. Data compression. J. Near Infrared Spectrosc. 2003, 11:3-15.
49. McClure W.F. 204 years of near infrared technology: 1800-2003. J. Near Infrared Spectrosc. 2003, 11:487-518.
50. Naes T., Isaksson T., Kowalski B. Locally weighted regression and scatter correction for near-infrared reflectance data. Anal. Chem. 1990, 62:664-673.
51. Cohen M.J., Prenger J.P., DeBusk W.F. Visible-near infrared reflectance spectroscopy for rapid, nondestructive assessment of wetland soil quality. J. Environ. Qual. 2005, 34:1422-1434.
52. Dunn B.W., Beecher H.G., Batten G.D., Ciavarella S. The potential of near-infrared reflectance spectroscopy for soil analysis - a case study from the Riverine Plain of south-eastern Australia. Aust. J. Exp. Agric. 2002, 42:607-614.
53. Saeys W., Mouazen A.M., Ramon H. Potential for onsite and online analysis of pig manure using visible and near infrared reflectance spectroscopy. Biosyst. Eng. 2005, 91:393-402.
54. Zornoza R., Guerrero C., Mataix-Solera J., Scow K.M., Arcenegui V., Mataix-Beneyto J. Near infrared spectroscopy for determination of various physical, chemical and biochemical properties in Mediterranean soils. Soil Biol. Biochem. 2008, 40:1923-1930.
55. Chang C.W., Laird D.A., Mausbach M.J., Hurburgh C.R. Near-infrared reflectance spectroscopy-principal components regression analyses of soil properties. Soil Sci. Soc. Am. J. 2001, 65:480-490.
56. Mouazen A.M., Karoui R., De Baerdemaeker J., Ramon H. Characterization of soil water content using measured visible and near infrared spectra. Soil Sci. Soc. Am. J. 2006, 70:1295-1302.
57. Miller C.E. Chemical principles of near-infrared technology. Near-infrared technology in the agriculture and food industries 2001, 19-37. American Association of Cereal Chemists, St. Paul, Minnesota, USA. P.C. Williams, K. Norris (Eds.).
58. Wetterlind J., Stenberg B. Near-infrared spectroscopy for within-field soil characterization: small local calibrations compared with national libraries spiked with local samples. Eur. J. Soil Sci. 2010, 61:823-843.
59. Guerrero C., Zornoza R., Gomez I., Mataix-Beneyto J. Spiking of NIR regional models using samples from target sites: Effect of model size on prediction accuracy. Geoderma 2010, 158:66-77.