Revisiting Kappa to account for change in the accuracy assessment of land-use change models

Ecological Modelling

Volumn 222, Issue 8, 2011, Pages 1367-1375

  van Vliet, Jasper ^a   Bregt, Arnold K ^b   Hagen Zanker, Alex ^c  

^a Research Institute for Knowledge Systems   (Netherlands)

^b WAGENINGEN UNIVERSITY   (Netherlands)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Accuracy assessment; Kappa statistic; Land use change; Map comparison; Model calibration

Indexed keywords

ACCURACY ASSESSMENT; KAPPA STATISTIC; LAND-USE CHANGE; MAP COMPARISON; MODEL CALIBRATION;

CALIBRATION; COMPUTER SIMULATION; FORESTRY; LAND USE; RATING; STATISTICS; STOCHASTIC SYSTEMS; TEACHING;

STOCHASTIC MODELS;

ACCURACY ASSESSMENT; CALIBRATION; COMPARATIVE STUDY; DATA SET; ECOLOGICAL MODELING; LAND USE CHANGE; MAPPING; NUMERICAL MODEL; STOCHASTICITY;

EID: 79953027902     PISSN: 03043800     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ecolmodel.2011.01.017     Document Type: Article

References (42)

1. Allouche O., Tsoar A., Kadmon R. Assessing the accuracy of species distribution models: prevalence, kappa and the true skill statistic (TSS). Journal of Applied Ecology 2006, 43:1223-1232.
2. Batty M., Longley P.A. Fractal Cities 1994, Academic press, San Diego.
3. Batty M., Torrens P. Modelling and prediction in a complex world. Futures 2005, 37:745-766.
4. Brown D.G., Page S., Riolo R., Zellner M., Rand W. Path dependence and the validation of agent-based spatial models of land use. International Journal of Geographical Information Systems 2005, 19(2):153-174.
5. Chen H., Pontius R.G. Diagnostic tools to evaluate a spatial land change projection along a gradient of an explanatory variable. Landscape Ecology 2010, 25:1319-1331.
6. Cohen J.A. Coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960, 20:37-46.
7. Couto P. Assessing the accuracy of spatial simulation models. Ecological Modelling 2003, 167:181-198.
8. Dendoncker N., Rounsevell M., Bogaert P. Spatial analysis and modelling of land use distributions in Belgium. Computers Environment and Urban Systems 2007, 31(2):188-205.
9. Doswell C.A., Davies-Jones R., Keller D.L. On summary measures of skill in rare event forecasting based on contingency tables. Weather and Forecasting 1990, 5:576-585.
10. Foody G.M. Status of land cover accuracy assessment. Remote Sensing of Environment 2002, 80:185-201.
11. Foody G.M. Harshness in image classification accuracy assessment. International Journal of Remote Sensing 2008, 29(11):3137-3158.
12. Hagen. A., 2002. Multi method assessment of map similarity. In: Ruiz, M., Gould, M., and Ramon, J. (eds.) Proceedings of the 5th AGILE Conference on Geographic Information Science: 171-182. Universitat de les Illes Balears, Palma, Spain.
13. Hagen A. Fuzzy set approach to assessing similarity of categorical maps. International Journal of Geographical Information Science 2003, 17(3):235-249.
14. Hagen-Zanker A., Lajoie G. Neutral models of landscape change as benchmarks in the assessment of model performance. Landscape and Urban Planning 2008, 86(3-4):284-296.
15. Hagen-Zanker A., Martens P. Map comparison methods for comprehensive assessment of geosimulation models. Lecture Notes in Computer Science, Proceedings of the 2008 International Conference on Computational Science and Its Applications ICCSA 2008 2008, 194-209. Springer, Berlin, Germany. O. Gervasi, B. Murgante, A. Lagana, D. Taniar, Y. Mun, M. Gavrilova (Eds.).
16. Haines-Young R., Weber J.L. Land Accounts for Europe 1990-2000. EEA Report 11/2006 2006, European Environment Agency, Copenhagen.
17. Heidke P. Berechnung des Erfolges und der Gute der Windstarkevorhersagen im Sturmwarnungsdienst. Geografiske Annaler 1926, 8:301-349.
18. Manson S.M. Challenges in evaluating models of geographic complexity. Environment and Planning B 2007, 34:245-260.
19. Monserud R.A., Leemans R. Comparing global vegetation maps with the Kappa statistic. Ecological Modelling 1992, 62:275-293.
20. Oreskes N., Shrader-Frechette K., Belitz K. Verification, validation and confirmation of numerical models in the earth sciences. Science 1994, 263(5147):641-646.
21. Pontius R.G., Huffaker D., Denman K. Useful techniques of validation for spatially explicit land change models. Ecological Modelling 2004, 179:445-461.
22. Pontius R.G., Shusas E., McEachren M. Detecting important categorical land changes while accounting for persistence. Agriculture, Ecosystems and Environment 2004, 101:251-268.
23. Pontius R.G., Malanson J. Comparison of the structure and accuracy of two land change models. International Journal of Geographical Information Science 2005, 19(2):243-265.
24. Pontius R.G., Boersma W., Castella J.C., Clarke K., de Nijs T., Dietzel C., Duan Z., Fotsing E., Goldstein N., Kok K., Koomen E., Lippitt C.D., McConnell W., Pijanowski B., Pithadia S., Sood A.M., Sweeney S., Trung T.N., Veldkamp A.T., Verburg P.H. Comparing the input, output, and validation maps for several models of land change. Annals of Regional Science 2008, 42:11-47.
25. Power M. The predictive validation of ecological and environmental models. Ecological Modelling 1993, 68(1-2):33-50.
26. Power C., Simms A., White R. Hierarchical fuzzy pattern matching for regional comparison of land-use maps. International Journal of Geographical Information Science 2001, 15(1):77-100.
27. Refsgaard J.C., Henriksen H.J. Modelling guidelines-terminology and guiding principles. Advances in Water Resources 2004, 27:71-82.
28. Riiters K.H., Wickham J.D., Wade T.G. An indicator of forest dynamics using a shifting landscape mosaic. Ecological Indicators 2009, 9:107-117.
29. RIKS Metronamica-Model descriptions 2009, RIKS, Maastricht, The Netherlands.
30. Rutherford G.N., Bebi P., Edwards P.J., Zimmerman N.E. Assessing land-use statistics to model land cover change in a mountainous landscape in the European Alps. Ecological Modelling 2008, 212:460-471.
31. Rykiel E.J. Testing ecological models: the meaning of validation. Ecological Modelling 1996, 90(3):229-244.
32. Sargent R.G. Verification and validation of simulation models. Proceedings of the 1998 Winter Simulation Conference 1998, 121-130. D.J. Medeiros, E.F. Watson, J.S. Carson, M.S. Manivannan (Eds.).
33. Sieber S., Zander P., Verburg P.H., Van Ittersum M. Model-based systems to support impact assessment-methods, tools and applications. Ecological Modelling 2010, 221(18):2133-2135.
34. Thomlinson J.R., Bolstad P.V., Cohen W.B. Coordinating methodologies for scaling landcover classifications from site-specific to global: steps toward validating global map products. Remote Sensing of Environment 1999, 70:16-28.
35. Turner M.G., Constanza R., Sklar F. Methods to evaluate the performance of spatial simulation models. Ecological Modelling 1989, 48(1-2):1-18.
36. Van Delden H., Stuczynski T., Ciaian P., Paracchini M.L., Hurkens J., Lopatka A., Gomez O., Calvo S., Shi Y., van Vliet J., Vanhout R. Integrated assessment of agricultural policies with dynamic land use change modelling. Ecological Modelling 2010, 221(18):2153-2166.
37. van Vliet J., White R., Dragicevic S. Modelling urban growth in a variable grid cellular automaton. Computers, Environment and Urban Systems 2009, 33(1):35-43.
38. Verburg P.H., Schot P.P., Dijst M.J., Veldkamp A. Land-use change modeling: current practice and research priorities. GeoJournal 2004, 61:309-324.
39. Visser H., de Nijs A.C.M. The Map Comparison Kit. Environmental Modelling and Software 2006, 21(3):346-358.
40. Wear D.N., Turner M.G., Nadman R.J. Land cover along an urban gradient: implications for water quality. Ecological Applications 1998, 8(3):619-630.
41. White R. Pattern based map comparisons. Journal of Geographical Systems 2006, 8::145-164.
42. Wilkinson G.G. Results and implications of a study of fifteen years of satellite image classification experiments. IEEE Transactions on Geoscience and Remote Sensing 2005, 43:433-440.