Techniques for evaluating the performance of landslide susceptibility models

Engineering Geology

Volumn 111, Issue 1-4, 2010, Pages 62-72

  Frattini, Paolo ^a   Crosta, Giovanni ^a   Carrara, Alberto ^b  

^a UNIVERSITY OF MILANO BICOCCA   (Italy)

^b CNR   (Italy)

Author keywords

Accuracy; Cost curve; Landslide susceptibility; Misclassification costs; Model evaluation; ROC curve

Indexed keywords

COST CURVES; LANDSLIDE SUSCEPTIBILITY; MISCLASSIFICATION COSTS; MODEL EVALUATION; ROC CURVES;

DEBRIS; LAND USE; LANDSLIDES; PLANNING; RISK ANALYSIS; RISK MANAGEMENT;

COSTS;

DEBRIS FLOW; LANDSLIDE; MODELING; PERFORMANCE ASSESSMENT; STATISTICAL ANALYSIS;

EID: 75849134535     PISSN: 00137952     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.enggeo.2009.12.004     Document Type: Article

References (64)

1. Adams N.M., and Hand D.J. Comparing classifiers when the misallocation costs are uncertain. Pattern Recognition 32 (1999) 1139-1147
2. Ardizzone F., Cardinali M., Carrara A., Guzzetti F., and Reichenbach P. Impact of mapping errors on the reliability of landslide hazard models. Natural Hazard and Earth Systems Science 2 (2002) 3-14
3. Atckinson P.M., and Massari R. Generalised linear modelling of susceptibility lo landsliding in the Central Apennines, Italy. Computers & Geosciences 24 4 (1998) 373-385
4. Baeza C., and Corominas J. Assessment of shallow landslide susceptibility by means of multivariate statistical techniques. Earth Surface Processes and Landforms 26 12 (2001) 1251-1263
5. Barredo J.I., Benavides A., Hervas J., and Van Westen C.J. Comparing heuristic landslide hazard assessment techniques using GIS in the Trijana basin, Gran Canaria Island, Spain. JAG 2 1 (2000) 9-23
6. Begueria S. Validation and evaluation of predictive models in hazard assessment and risk management. Natural Hazards 37 3 (2006) 315-329
7. Brabb E.E. Innovative approaches to landslide hazard mapping. 4th International Symposium on Landslides, Toronto Vol 1 (1984) 307-324
8. Binaghi E., Luzi L., Madella P., Pergalani F., and Rampini A. Slope instability zonation: a comparison between certainty factor and fuzzy Dempster-Shafer approaches. Natural Hazards 17 (1998) 77-97
9. Briggs W.M., and Ruppert D. Assessing the skill of yes/no predictions. Biometrics 61 (2005) 799-807
10. Carrara A. Multivariate models for landslide hazard evolution. Mathematical Geology 15 (1983) 403-427
11. Carrara A., Crosta G.B., and Frattini P. Geomorphological and historical data in assessing landslide hazard. Earth Surface Processes and Landforms 28 10 (2003) 1125-1142
12. Carrara A., Crosta G.B., and Frattini P. Comparing models of debris-flow susceptibility in the alpine environment. Geomorphology 94 3-4 (2008) 353-378
13. Chung C.F., and Fabbri A.G. Validation of spatial prediction models for landslide hazard mapping. Natural Hazards 30 3 (2003) 451-472
14. Chung C.F., Fabbri A.G., and Van Westen C.J. Multivariate regression analysis for landslide hazard zonation. In: Carrara A., and Guzzetti F. (Eds). Geographical Information Systems in Assessing Natural Hazards (1995), Kluwer Academic Publishers, Dordrecht, The Netherlands 107-133
15. Crosta G.B., and Frattini P. Distributed modeling of shallow landslides triggered by intense rainfall. Natural Hazards and Earth System Sciences 3 1-2 (2003) 81-93
16. Dai F.C., and Lee C.F. Landslide characteristics and slope instability modelling using GIS, Lantau Island, Hong Kong. Geomorphology 42 (2002) 213-228
17. Davis, P.A., Goodrich, M.T., 1990. A proposed strategy for the validation of ground-water flow and solute transport models. Technical Report, Sandia National Labs., Albuquerque, NM (USA).
18. Drummond C., and Holte R.C. Explicitly representing expected cost: an alternative to ROC representation. Proc. of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2000) 198-207
19. Drummond C., and Holte R.C. Cost curves: an improved method for visualizing classifier performance. Machine Learning 65 1 (2006) 95-130
20. Egan J.P. Signal Detection Theory and ROC Analysis. Series in Cognition and Perception (1975), Academic Press, New York
21. Ercanoglu M., and Gokceoglu C. Assessment of landslide susceptibility for a landslide-prone area (north of Yenice, NW Turkey) by fuzzy approach. Environmental Geology 41 6 (2002) 720-730
22. Ercanoglu M., and Gokceoglu C. Use of fuzzy relations to produce landslide susceptibility map of a landslide prone area (West Black Sea Region, Turkey). Engineering Geology 75 (2004) 229-250
23. Ermini L., Catani F., and Casagli N. Artificial neural networks applied to landslide susceptibility assessment. Geomorphology 66 (2005) 327-343
24. Fabbri A.G., Chung C.F., Cendrero A., and Remondo J. Is prediction of future landslides possible with a GIS?. Natural Hazards 30 33 (2003) 487-499
25. Fernández T., Irigaray C., El Hamdouni R., and Chacón J. Methodology for landslide susceptibility mapping by means of a GIS. Application to the Contraviesa Area (Granada, Spain). Natural Hazards 30 (2003) 297-308
26. Finley J.P. Tornado predictions. American Meteorological Journal 1 (1884) 85-88
27. Frattini P., Crosta G.B., Fusi N., and Dal Negro P. Shallow landslides in pyroclastic soil: a distributed modeling approach for hazard assessment. Engineering Geology 73 (2004) 277-295
28. Frattini P., Crosta G.B., Carrara A., and Agliardi F. Assessment of rockfall susceptibility by integrating statistical and physically-based approaches. Geomorphology 94 3-4 (2008) 419-437
29. Gilbert G.F. Finley's tornado predictions. American Meteorological Journal 1 (1884) 166-172
30. Godt J.W., Baum R.L., Savage W.Z., Salciarini D., Schulz W.H., and Harp E.L. Requirements for integrating transient deterministic shallow landslide models with GIS for hazard and susceptibility assessments. Engineering Geology 103 (2008) 214-226
31. Gökceoglu C., and Aksoy H. Landslide susceptibility mapping of the slopes in the residual soils of the Mengen region (Turkey) by deterministic stability analyses and image processing techniques. Engineering Geology 44 (1996) 147-161
32. Goodenough D.J., Rossmann K., and Lusted L.B. Radiographic applications of receiver operating characteristic (ROC) analysis. Radiology 110 (1974) 89-95
33. Gorsevski P.V., Gessler P.E., Foltz R.B., and Elliot W.J. Spatial prediction of landslide hazard using logistic regression and ROC analysis. Transactions in GIS 10 3 (2006) 395-415
34. Guzzetti F., Reichenbach P., Ardizzone F., Cardinali M., and Galli M. Estimating the quality of landslide susceptibility models. Geomorphology 81 1-2 (2006) 166-184
35. Hanley J.A., and McNeil B.J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143 1 (1982) 29-36
36. Hanssen A.W., and Kuipers W.J.A. On the relationship between the frequency of rain and various meteorological parameters. Mededelingenen Verhandelingen 81 (1965) 2-15
37. Heidke P. Berechnung des Erfolges und der Güte der Windstärkevorhersagen im Sturmwarnungdienst (Calculation of the success and goodness of strong wind forecasts in the storm warning service). Geografika Annaler 8 (1926) 301-349
38. Irigaray C., Fernández T., El Hamdouni R., and Chacón J. Verification of landslide susceptibility mapping: a case study. Earth Surface Processes and Landforms 24 (1999) 537-544
39. Lee S. Application of logistic regression model and its validation for landslide susceptibility mapping using GIS and remote sensing data. International Journal of Remote Sensing 26 7 (2005) 1477-1491
40. Lee S., and Min K. Statistical analysis of landslide susceptibility at Yongin, Korea. Environmental Geology 40 (2001) 1095-1113
41. Lee S., Ryu J.H., Min K., and Won J.S. Landslide susceptibility analysis using GIS and artificial neural network. Earth Surface Processes and Landforms 28 (2003) 1361-1376
42. Mason I.B. Binary events. In: Jolliffe I.T., and Stephenson D.B. (Eds). Forecast Verification. A Practitioner's Guide in Atmospheric Science (2003), Wiley & Sons Ltd, Chichester 37-76
43. Melchiorre C., Matteucci M., and Remondo J. Artificial neural networks and robustness analysis in landslide susceptibility zonation. Proc. International Joint Conference on Neural Networks, Vancouver, BC, Canada, July 16-21, 2006 (2006)
44. Melchiorre C., Matteucci M., Azzoni A., and Zanchi A. Artificial neural networks and cluster analysis in landslide susceptibility zonation. Geomorphology 94 3-4 (2008) 379-400
45. Montgomery D.R., and Dietrich W.E. A physically based model for the topographic control on shallow landsliding. Water Resources Research 30 4 (1994) 1153-1171
46. Murphy A.H. The Finley affair: a signal event in the history of forecast verification. Weather Forecasting 11 (1996) 3-20
47. Nefeslioglu H.A., Gokceoglu C., and Sonmez H. An assessment on the use of logistic regression and artificial neural networks with different sampling strategies for the preparation of landslide susceptibility maps. Engineering Geology 97 3-4 (2008) 171-191
48. Ohlmacher G.C., and Davis J.C. Using multiple logistic regression and GIS technology to predict landslide hazard in northeast Kansas, USA. Engineering Geology 69 33 (2003) 331-343
49. Peirce C.S. The numerical measure of the success of predictions. Science 4 (1884) 453-454
50. Pepe M.S. The Statistical Evaluation of Medical Tests for Classification and Prediction (2003), Oxford University Press, New York
51. Phoon K.K., and Kulhawy F.H. Characterization of geotechnical variability. Canadian Geotechnical Journal 36 4 (1999) 612-624
52. Provost F., and Fawcett T. Analysis and visualization of classifier performance: comparison under imprecise class and cost distributions. Proceedings of the Third International Conference on Knowledge Discovery and Data Mining (1997), AAAI Press, Menlo Park, CA 43-48
53. Provost F., and Fawcett T. Robust classification for imprecise environments. Machine Learning 42 3 (2001) 203-231
54. Rawls W.J., Brakensiek D.L., and Miller N. Green-Ampt infiltration parameters from soils data. Journal of Hydraulic Engineering 109 11 (1983) 62-70
55. Remondo J., González A., Díaz de Terán J.R., Cendrero A., Fabbri A., and Chung C.F. Validation of landslide susceptibility maps; examples and applications from a case study in northern Spain. Natural Hazards 30 3 (2003) 437-449
56. Schaefer J.T. The critical success index as an indicator of warning skill. Weather Forecasting 5 (1990) 570-575
57. Stephenson D.B. Use of the "odds ratio" for diagnosing forecast skill. Weather Forecasting 15 (2000) 221-232
58. Swets J.A. Measuring the accuracy of diagnostic systems. Science 240 4857 (1988) 1285-1293
59. Van den Eeckhaut M., Vanwalleghem T., Poesen J., Govers G., Verstraeten G., and Vandekerckhove L. Prediction of landslide susceptibility using rare events logistic regression: a case-study in the Flemish Ardennes (Belgium). Geomorphology 76 3-4 (2006) 392-410
60. Van Westen C.J., and Terlien M.T.J. An approach towards deterministic landslide hazard analysis in GIS. A casa study from Manizales (Colombia). Earth Surface Processes and Landforms 21 (1996) 853-868
61. Yesilnacar E., and Topal T. Landslide susceptibility mapping: a comparison of logistic regression and neural networks methods in a medium scale study, Hendek region (Turkey). Engineering Geology 79 3-4 (2005) 251-266
62. Yule G.U. On the association of attributes in statistics. Philosophical Transactions of the Royal Society of London 194A (1900) 257-319
63. Zêzere J.L., Reis E., Garcia R., Oliveira S., Rodrigues M.L., Vieira G., and Ferreira A.B. Integration of spatial and temporal data for the definition of different landslide hazard scenarios in the area north of Lisbon (Portugal). Natural Hazard and Earth Systems Science 4 1 (2004) 133-146
64. Zinck J.A., López J., Metternicht G.I., Shrestha D.P., and Vázquez-Selem L. Mapping and modelling mass movements and gullies in mountainous areas using remote sensing and GIS techniques. International Journal of Applied Earth Observation and Geoinformation 3 1 (2001) 43-53