Improving the prediction performance of a large tropical vis-NIR spectroscopic soil library from Brazil by clustering into smaller subsets or use of data mining calibration techniques

European Journal of Soil Science

Volumn 65, Issue 5, 2014, Pages 718-729

  Araujo S R ^a   Wetterlind, J ^b   Dematte J A M ^a   Stenberg, B ^b  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

^b SWEDISH UNIVERSITY OF AGRICULTURAL SCIENCES   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

AGRICULTURAL MANAGEMENT; CALIBRATION; CLAY MINERAL; DATA MINING; NUMERICAL MODEL; PERFORMANCE ASSESSMENT; PREDICTION; SOIL ORGANIC MATTER; SOIL SURVEY; SOIL TYPE; SPECTROSCOPY; TROPICAL ENVIRONMENT;

BRAZIL;

EID: 85027936542     PISSN: 13510754     EISSN: 13652389     Source Type: Journal    
DOI: 10.1111/ejss.12165     Document Type: Article

References (43)

1. Brown, D.J. 2007. Using a global VNIR soil-spectral library for local soil characterization and landscape modeling in a 2nd-order Uganda watershed. Geoderma, 140, 444-453.
2. Cambule, A.H., Rossiter, D.G., Stoorvogel, J.J. & Smaling, E.M.A. 2012. Building a near infrared spectral library for soil organic carbon estimation in the Limpopo National Park, Mozambique. Geoderma, 183, 41-48.
3. Chang, C.W. & Laird, D.A. 2002. Near-infrared reflectance spectroscopic analysis of soil C and N. Soil Science, 167, 110-116.
4. Chang, C.W., Laird, D.A., Mausbach, M.J. & Hurburgh, C.R. 2001. Near-infrared reflectance spectroscopy-principal components regression analyses of soil properties. Soil Science Society of America Journal, 65, 480-490.
5. Chang, G.W., Laird, D.A. & Hurburgh, G.R. 2005. Influence of soil moisture on near-infrared reflectance spectroscopic measurement of soil properties. Soil Science, 170, 244-255.
6. Clark, R.N. 1999. Spectroscopy of rocks and minerals and principles of spectroscopy. In: Remote Sensing for the Earth Sciences (ed. A.N. Rencz ), pp. 3-58. John Wiley & Sons, Chichester.
7. Demattê, J.A.M. & Garcia, G.J. 1999. Alteration of soil properties through a weathering sequence as evaluated by spectral reflectance. Soil Science Society of America Journal, 63, 327-342.
8. Demattê, J.A.M., Sousa, A.A., Alves, M.C., Nanni, M.R., Fiorio, P.R. & Campos, R.C. 2006. Determining soil water status and other soil characteristics by spectral proximal sensing. Geoderma, 135, 179-195.
9. Dunn, B.W., Beecher, H.G., Batten, G. D. & Ciavarella, S. 2002. The potential of near-infrared reflectance spectroscopy for soil analysis - a case study from the Riverine Plain of south- eastern Australia. Australian Journal of Experimental Agriculture, 42, 607-614.
10. Friedman, J.H. 2001. Greedy function approximation: a gradient boosting machine. Annals of Statistics, 29, 1189-1232.
11. Fystro, G. 2002. The prediction of C and N content and their potential mineralisation in heterogeneous soil samples using Vis-NIR spectroscopy and comparative methods. Plant & Soil, 246, 139-149.
12. Gee, G.W. & Bauder, J.W. 1986. Particle-size analysis. In: Methods of Soil Analysis. Part 1: Physical and Mineralogical Methods, 2nd edn (ed. A. Klute ), pp. 383-411. Soil Science Society of America, Madison, WI.
13. Goge, F., Joffre, R., Jolivet, C., Ross, I. & Ranjard, L. 2012. Optimization criteria in sample selection step of local regression for quantitative analysis of large soil NIRS database. Chemometrics & Intelligent Laboratory Systems, 110, 168-176.
14. Hunt, G.R. & Salisbury, J.W. 1970. Visible and near-infrared specta of minerals and rocks: I. Silicate minerals. Modern Geology, 1, 283-300.
15. Islam, K., Singh, B. & McBratney, A. 2003. Simultaneous estimation of several soil properties by ultra-violet, visible, and near-infrared reflectance spectroscopy. Australian Journal of Soil Research, 41, 1101-1114.
16. IUSS Working Group WRB. 2006. World Reference Base for Soil Resources 2006. 2nd edition. World Soil Resources Reports No. 103. FAO, Rome. ISBN 92-5-105511-4, 128 pp.
17. Jain, P., Kulis, B., Davis, J.V. & Dhillon, I.S. 2012. Metric and kernel learning using a linear transformation. Journal of Machine Learning Research, 13, 519-547.
18. Jalabert, S.S.M., Martin, M.P., Renaud, J.P., Boulonne, L., Jolivet, C., Montanarella, L. et al. 2010. Estimating forest soil bulk density using boosted regression modelling. Soil Use & Management, 26, 516-528.
19. Kovačević, M., Bajat, B., Trivic, B. & Pavlovic, R. 2009. Geological units classification of multispectral images by using support vector machines. In: 2009 International Conference on Intelligent Networking and Collaborative Systems (eds Y.K. Badr, S. Caballe, F. Xhafa, A. Abraham & B. Gros ), pp. 267-272. Ieee, New York.
20. Kuang, B. & Mouazen, A.M. 2011. Calibration of visible and near infrared spectroscopy for soil analysis at the field scale on three European farms. European Journal of Soil Science, 62, 629-636.
21. Malley, D.F., Martin, P.D., McClintock, L.M., Yesmin, L., Eilers, R.G. & Haluschak, P. 2000. Feasibility of analysing archived Canadian prairie agricultural soils by near infrared reflectance spectroscopy. In: Near Infrared Spectroscopy: Proceedings of the 9th International Conference (eds A.M.C. Davies & R. Giangiacomo ), pp. 579-585. NIR Publications, Chichester.
22. McDowell, M.L., Bruland, G.L., Deenik, J.L. & Grunwald, S. 2012. Effects of subsetting by carbon content, soil order, and spectral classification on prediction of soil total carbon with diffuse reflectance spectroscopy. Applied & Environmental Soil Science, 2012, Article ID 294121.
23. Moron, A. & Cozzolino, D. 2002. Application of near infrared reflectance spectroscopy for the analysis of organic C, total N and pH in soils of Uruguay. Journal of Near Infrared Spectroscopy, 10, 215-221.
24. Nocita, M., Kooistra, L., Bachmann, M., Mueller, A., Powell, M. & Weel, S. 2011. Predictions of soil surface and topsoil organic carbon content through the use of laboratory and field spectroscopy in the Albany Thicket Biome of Eastern Cape Province of South Africa. Geoderma, 167-68, 295-302.
25. Pierna, J.A.F. & Dardenne, P. 2008. Soil parameter quantification by NIRS as a chemometric challenge at 'Chimiometrie 2006'. Chemometrics & Intelligent Laboratory Systems, 91, 94-98.
26. Post, J.L. & Noble, P.N. 1993. The near-infrared combination band frequencies of dioctahedral smectites, micas, and illites. Clays & Clay Minerals, 41, 639-644.
27. Sankey, J.B., Brown, D.J., Bernard, M.L. & Lawrence, R.L. 2008. Comparing local vs. global visible and near-infrared (VisNIR) diffuse reflectance spectroscopy (DRS) calibrations for the prediction of soil clay, organic C and inorganic C. Geoderma, 148, 149-158.
28. Savitzky, A. & Golay, M. 1964. Smoothing and differentiation of data by simplified least squares procedures. Analytical Chemistry, 36, 1627-1639.
29. Scheinost, A.C., Chavernas, A., Barron, V. & Torrent, J. 1998. Use and limitations of second-derivative diffuse reflectance spectroscopy in the visible to near-infrared range to identify and quantify Fe oxide minerals in soils. Clays & Clay Minerals, 46, 528-536.
30. Sherman, D.M. & Waite, T.D. 1985. Electronic spectra of Fe3+ oxides and oxiyhydroxides in the near infrared to ultraviolet. American Mineralogist, 70, 1262-1269.
31. Sørensen, L.K. & Dalsgaard, S. 2005. Determination of clay and other soil properties by near infrared spectroscopy. Soil Science Society of America Journal, 69, 159-167.
32. Stenberg, B. 2010. Effects of soil sample pretreatments and standardised rewetting as interacted with sand classes on Vis-NIR predictions of clay and soil organic carbon. Geoderma, 158, 15-22.
33. Stenberg, B., Jonsson, A. & Börjesson, T. 2002. Near infrared technology for soil analysis with implications for precision agriculture. In: Near Infrared Spectroscopy: Proceedings of the 10th International Conference (eds A. Davies & R. Cho ), pp. 279-284. NIR Publications, Chichester.
34. Stenberg, B., Viscarra Rossel, R.A., Mouazen, A.M. & Wetterlind, J. 2010. Visible and near infrared spectroscopy in soil science. Advances in Agronomy, 107, 163-215.
35. Stevens, A., Nocita, M., Toth, G., Montanarella, L. & van Wesemael, B. 2013. Prediction of soil organic carbon at the European scale by visible and near-infrared reflectance spectroscopy. PLoS One, 8, e66409. doi: 10.1371/journal.pone.0066409.
36. Tekin, Y., Tumsavas, Z. & Mouazen, A.M. 2012. Effect of moisture content on prediction of organic carbon and pH using visible and near-infrared spectroscopy. Soil Science Society of America Journal, 76, 188-198.
37. Todorova, M., Atanassova, S. & Ilieva, R. 2009. Determination of soil organic carbon using near-infrared spectroscopy. Agricultural Science and Technology, 1, 45-50.
38. Udelhoven, T., Emmerling, C. & Jarmer, T. 2003. Quantitative analysis of soil chemical properties with diffuse reflectance spectrometry and partial least-square regression: a feasibility study. Plant & Soil, 251, 319-329.
39. van Raij, B., Andrade, J.C., Cantarela, H. & Quaggio, J.A. 2001. Análise química para avaliação de solos tropicais. IAC, Campinas.
40. Vasques, G.M., Grunwald, S. & Sickman, J.O. 2008. Comparison of multivariate methods for inferential modeling of soil carbon using visible/near-infrared spectra. Geoderma, 146, 14-25.
41. Viscarra Rossel, R.A. & Behrens, T. 2010. Using data mining to model and interpret soil diffuse reflectance spectra. Geoderma, 158, 46-54.
42. Vohland, M., Besold, J., Hill, J. & Fruend, H.-C. 2011. Comparing different multivariate calibration methods for the determination of soil organic carbon pools with visible to near infrared spectroscopy. Geoderma, 166, 198-205.
43. Wetterlind, J. & Stenberg, B. 2010. Near-infrared spectroscopy for within-field soil characterization: small local calibrations compared with national libraries spiked with local samples. European Journal of Soil Science, 61, 823-843.