Support vector machines and gradient boosting for graphical estimation of a slate deposit

Stochastic Environmental Research and Risk Assessment

Volumn 18, Issue 5, 2004, Pages 309-323

  Matias J M ^a   Vaamonde, A ^a   Taboada, J ^a   Gonzalez Manteiga W ^b  

^a UNIVERSITY OF VIGO   (Spain)

^b UNIVERSITY OF SANTIAGO DE COMPOSTELA   (Spain)

Author keywords

Boosting; Kernels; Slate; Spatial statistics; SVM

Indexed keywords

BUILDING STONE; GEOSTATISTICS; MINING; RESOURCE MANAGEMENT; SLATE;

EID: 7544230053     PISSN: 14363240     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00477-004-0185-5     Document Type: Article

References (61)

1. Abrahamsen P (1997) A review of gaussian random fields and correlation functions. Technical Report, Norwegian Computing Center, Oslo
2. Anguita D, Ridella S, Rivieccio F, Zunino R (2002) Automatic hyperparameter tuning for support vector machines. In: Dorronsoro J (ed) Proceedings of the International Conference on Artificial Neural Networks, ICANN 2002, Springer, pp 1345-1350
3. Boser B, Guyon I, Vapnik V (1992) A training algorithm for optimal margin classifiers. In: Haussler D (ed) Proceedings of the Fifth Annual ACM Workshop on Comput Learn Theory. ACM Press
4. Breiman L (1999) Prediction games and arcing algorithms. Neural Comput 11:1493-1517
5. Chakraborty K, Mehrotra K, Mohan CK, Ranka S (1992) Forecasting the behavior of multivariate time series using neural networks. Neural Netw 5:961-970
6. Chen S, Cowan CFN, Grant PM (1991) Orthogonal least squares learning algorithm for radial basis function networks. IEEE Transactions on Neural Netw 2:302-309
7. Chen S (2002) Locally regularised orthogonal least squares algorithm for the construction of sparse kernel regression models. In: Proceedings of the 6th international conference on signal processing pp 1229-1232
8. Chen SS, Donoho DL, Saunders MA (1998) Atomic decomposition by basis pursuit. SIAM J Sci Comput 20:33-61
9. Cherkassky V, Shao X, Mulier FM, Vapnik VN (1999) Model complexity control for regression using VC generalization bounds. IEEE Trans Neural Netw 10:1075-1088
10. Christakos G (2000) Modern Spatiotemporal Geostatistics. Oxford University Press
11. Collobert R, Bengio S (2001) SVMTorch: Support vector machines for large-scale regression problems. J Mach Learn 1:143-160
12. Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20:273-297
13. Cressie N (1993) Statistics for spatial data. John Wiley
14. Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines. Cambridge University Press
15. Demyanov V, Soltani S, Kanevski M, Canu S, Maignan M, Savelieva E, Timonin V, Pisarenko V (2001) Wavelet analysis residual kriging vs. neural network residual kriging. Stochastic Environ Res Risk Assessment 15:18-32
16. Donoho DL, Johnstone IM (1989) Projection-based approximation and a duality with kernel methods. Ann Stat 17:58-106
17. Drucker H, Burges C, Kaufman L, Smola A, Vapnik V (1997) Support vector regression machines. In: Mozer M, Jordan M, Petsche T (eds) Advances in Neural Information Processing Systems 9. MIT press, pp 155-161
18. Evgeniou T, Pontil M, Poggio T (2000) Regularization networks and support vector machines. Advances in Comput Math 13:1-50
19. Foresee FD, Hagan T (1997) Gauss-Newton approximation to bayesian regularization. In: Proceedings of the 1997 international joint conference on neural networks, pp 1930-1935
20. Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Compu Syst Sci 55:119-139
21. Friedman JH, Stuetzle W (1981) Projection pursuit regression. J Am Stat Assoc 76:817-823
22. Friedman JH (1999) Greedy function approximation: A gradient boosting machine. Technical report, Stanford University
23. Friedman JH, Hastie T, Tibshirani R (2000) Additive Logistic Regression: A statistical view of boosting. Ann Stat 28:337-407
24. García-Guinea J, Lombardero M, Roberts B, Taboada J, Peto A (1998) Mineralogía y microestructura de la pizarra de techar: comportamiento termoóptico y fisilidad. Materiales de Construcción 48:37-48
25. Genton MG (2001) Classes of kernels for machine learning: A statistical perspective. J Mach Learn Res 2:299-312
26. Gilardi N, Bengio S (2000) Local machine learning models for spatial data analysis. J Geogra Inform Dec Anal 4:11-28
27. Gilardi N, Bengio S (2003) Comparison of four machine learning algorithms for spatial data analysis. In: Dubois G, Malczewski J, De Cort M (eds) Mapping radioactivity in the environment. Spatial interpolation comparison 97. european comissioin joint research centre. Office for official publications of the European Communities, pp 222-237
28. Girosi F, Jones M, Poggio T (1995), Regularization theory and neural networks architectures. Neural Comput 7:219-269
29. Haykin S (1999) Neural networks: A comprehensive foundation. Prentice Hall
30. Hwang JN, Lay SR, Maechler M, Martin RD, Schimert J (1994) Regression modeling in back-propagation and projection pursuit learning. IEEE Trans Neural Netw 5:342-353
31. Joachims T (1999) Making large-scale support vector machine learning practical. In: Schölkopf B, Burges C Smola A (eds) Advances in Kernel Methods. MIT Press
32. Jones LK (1987) On a conjecture of Huber concerning the convergence of projection pursuit regression. Ann Stat 15:880-882
33. Kanevski M, Arutyunyan R, Bolshov L, Demyanov V, Maignan M (1996) Artificial neural networks and spatial estimations of chernobyl fallout. Geoinformatics 7:5-11
34. Kanevski M, Pozdnukhov A, Canu S, Maignan M, Wong PM, Shibli S (2001) Support vector machines for classification and mapping of reservoir data. In: Wong PM, Aminzadeh F, Kikravesh M (eds) Soft computing for reservoir characterization and modelling. Springer Verlag, pp 531-558
35. Kanevski M, Pozdnukhov A, Canu S, Maignan M (2002) Advanced spatial data analysis and modelling with support vector machines. Int J Fuzzy Sys 4:606-616
36. Kimeldorf G, Wahba G (1970) A correspondence between bayesian estimation on stochastic processes and smoothing by splines. Ann Math Stat 41:495-502
37. Koike K, Matsuda S, Gu B (2001) Evaluation of interpolation accuracy of neural kriging with application to temperature-distribution analysis. Math Geol 33:421-448
38. MacKay DJC (1998) Introduction to Gaussian processes. In: Bishop CM (ed) Neural networks and machine learning. NATO Asi Series F, Computer and Systems Sciences. Morgan Kaufmann, pp 133-165
39. Mallat S, Zhang Z (1993) Matching pursuit in a time-frequency dictionary. IEEE Trans Signal Process 41:3397-3415
40. Matías JM, Vaamonde A, Taboada J, González-Manteiga W (2003) Comparison of Kriging and Neural Networks with Application to the Exploitation of a Slate Mine. Accepted for publication in Math Geol
41. Matías JM, González-Manteiga W (2003) Regularized kriging: The support vectors method applied to kriging. In: Artificial neural networks and neural information processing, ICANN-ICONIP'2003. Lecture notes in computer science, vol. 2714, Springer
42. Osuna E, Freund R, Girosi F (1997) An improved training algorithm for support vector machines. In: Principe J, Gile L, Morgan N, Wilson E (eds) Neural networks for signal processing VII. Proceedings of the 1997 IEEE workshop, pp 276-285
43. Pati YC, Rezahfar R, Krishnaprasad PS (1993) Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition. In: Singh A (ed) Proceedings of the 27th Annual asilomar conference on signals systems and computers. IEEE Soc. Press
44. Platt J (1999) Fast training of support vector machines using sequential minimal optimization. In: Schölkopf B, Burges C, Smola A (eds) Advances in Kernel Methods. MIT Press
45. Rätsch G, Onoda T, Müller K-R (2001) Soft Margins for Ada-Boost. Mach Learn 42:287-320
46. Ribeiro J, Pereira HG, Sousa AJ, Albuquerque T, Tirabasso F, Taboada J, Rico JG (1997) Geostatistical characterization of natural stone quarries. In: Baafi EY, Schofield NA (eds) Geostatistics Wollongong'96. Kluwer, pp 905-915
47. Schapire RE (1990) The strength of weak learnability. Mach Learn 5:197-227
48. Schapire RE, Freund Y, Bartlett Y, Lee W (1998) Boosting the margin: A new explanation for the effectiveness of voting methods. Ann Stat 26:1651-1686
49. Schölkopf B, Smola AJ (2002) Learning with kernels. MIT Press
50. Schölkopf B, Herbrich R, Smola AJ, Williamson R (2000) A generalized representer theorem. Technical report NC2-TR-2000-81, NeuroCOLT2, http://www.neurocolt.com
51. Smola A, Frieâ J, Schölkopf B (1999) Semiparametric support vector and linear programming machines. In: Kearns MS, Solla SA, Cohn DA (eds) Advances in neural information processing systems 11. MIT press, pp 585-591
52. Smola A, Schölkopf B (1998) A tutorial on support vector regression. Technical report NC2-TR-1998-030, NeuroCOLT2, http://www.neurocolt.com
53. Taboada J, Vaamonde A, Saavedra A, Alejano L (1997) Application of geostatistical techniques to exploitation planning in slate quarries. Eng Geol 47:269-277
54. Taboada J, Vaamonde A, Saavedra A, Argüelles A (1998) Quality index for ornamental slate deposits. Eng Geol 50:203-210
55. Taboada J, Saavedra A, Vaamonde A (2001) Evaluation of a slate extraction bank. Trans Inst mining metallurgy A 110:40-46
56. Vanderbei RJ (1998) LOQO: An interior point code for quadratic programming. Technical report, SOR-94-15, Statistics and operations research, princeton university, http://www.princeton. edu/rvdb /techrepspshtml
57. Vapnik V (1982) Estimation of dependences based on empirical data. Springer-Verlag
58. Vapnik V (1998) Statistical learning theory. John Wiley&Sons
59. Wahba G (1990) Spline Models for Observational Data. SIAM
60. Weber DD, Englund EJ (1992) Evaluation and comparison of spatial interpolators. Math Geol 24:381-391
61. Weber DD, Englund EJ (1994) Evaluation and comparison of spatial interpolators, II. Math Geol 26:589-603