Evaluation of model validation techniques in land cover dynamics

ISPRS International Journal of Geo-Information

Volumn 2, Issue 3, 2013, Pages 577-597

  Ahmed, Bayes ^a   Ahmed, Raquib ^b   Zhu, Xuan ^a  

^a MONASH UNIVERSITY   (Australia)

^b UNIVERSITY OF RAJSHAHI   (Bangladesh)

Author keywords

Artificial neural network; Cellular automata; Fuzzy; Kappa; Land cover change; Map comparison; Markov chain; Model validation; Three map comparison

Indexed keywords

EID: 84904665774     PISSN: None     EISSN: 22209964     Source Type: Journal    
DOI: 10.3390/ijgi2030577     Document Type: Article

References (55)

1. Pontius, R.G., Jr.; Boersma, W.; Castella, J.-C.; Clarke, K.; de Nijs, T.; Dietzel, C.; Duan, Z.; Fotsing, E.; Goldstein, N.; Kok, K.; et al. Comparing the input, output, and validation maps for several models of land change. Ann. Reg. Sci. 2008, 42, 11-47.
2. Chen, H.; Pontius, R.G., Jr. Diagnostic tools to evaluate a spatial land change projection along a gradient of an explanatory variable. Landsc. Ecol. 2010, 25, 1319-1331.
3. Visser, H.; de Nijs, T. The map comparison kit. Environ. Model. Softw. 2006, 21, 346-358.
4. Pontius, R.G., Jr.; Walker, R.; Yao-Kumah, R.; Arima, E.; Aldrich, S.; Caldas, M.; Vergara, D. Accuracy assessment for a simulation model of Amazonian deforestation. Ann. Assn. Amer. Geogr. 2007, 97, 677-695.
5. Hagen, A. Fuzzy set approach to assessing similarity of categorical maps. Int. J. Geogr. Inf. Sci. 2003, 17, 235-249.
6. Metternicht, G. Change detection assessment using fuzzy sets and remotely sensed data: An application of topographic map revision. ISPRS J. Photogramm. 1999, 54, 221-233.
7. Boots, B.; Csillag, F. Categorical maps, comparisons, and confidence. J. Geograph. Syst. 2006, 8, 109-118.
8. Hagen-Zanker, A. An improved Fuzzy Kappa statistic that accounts for spatial autocorrelation. Int. J. Geogr. Inf. Sci. 2009, 23, 61-73.
9. Richter, O.; Söndgerath, D. Parameter Estimation in Ecology: The Link between Data and Models; VCH Publishers: New York, NY, USA, 1990.
10. Gardner, R.; Urban, D. Model Validation and Testing: Past Lessons, Present Concerns, Future Prospects. In Models in Ecosystem Science; Canham, C.D., Cole, J.J., Lauenroth, W.K., Eds.; Princeton University Press: Princeton, NJ, USA, 2004; pp. 184-203.
11. Pontius, R.G., Jr.; Silvia, H.P. Assessing a predictive model of land change using uncertain data. Environ. Model. Softw. 2010, 25, 299-309.
12. Van Rompaey, A.J.J.; Govers, C. Data quality and model complexity for regional scale soil erosion prediction. Int. J. Geogr. Inf. Sci. 2002, 16, 663-680.
13. Foody, G.M. The impact of imperfect ground reference data on the accuracy of land cover change estimation. Int. J. Remote Sens. 2009, 30, 3275-3281.
14. Rykiel, E.J. Testing ecological models: The meaning of validation. Ecol. Model. 1996, 90, 229-244.
15. Vliet, J.V.; Bregt, A.K.; Hagen-Zanker, A. Revisiting Kappa to account for change in the accuracy assessment of land-use change models. Ecol. Model. 2011, 222, 1367-1375.
16. Hagen-Zanker, A.; Martens, P. Map Comparison Methods for Comprehensive Assessment of Geosimulation Models. In Proceedings of the International Conference on Computational Science and Its Applications, Perugia, Italy, 30 June-3 July 2008; Gervasi, O., Murgante, B., Lagana, A., Taniar, D., Mun, Y., Gavrilova, M., Eds.; Springer: Berlin, Germany; pp. 194-209.
17. Jensen, J.R.; Ramsey, E.W.; Halkard, E.M.; Christensen, E.J.; Sharitz, R.R. Inland wetland change detection using aircraft MSS data. Photogramm. Eng. Remote Sensing 1987, 53, 521-529.
18. Power, C.; Simms, A.; White, R. Hierarchical fuzzy pattern matching for the regional comparison of land use maps. Int. J. Geogr. Inf. Sci. 2001, 15, 77-100.
19. White, R.; Engelen, G.; Injee, I. The use of constrained cellular automata for high-resolution modelling of urban land use dynamics. Environ. Plan. 1997, 24, 323-343.
20. Hagen-Zanker, A.; Lajoie, G. Neutral models of landscape change as benchmarks in the assessment of model performance. Landscape Urban Plan. 2008, 86, 284-296.
21. Fewster, R.M.; Buckland, S.T. Similarity indices for spatial ecological data. Biometrics 2001, 57, 495-501.
22. Ebert, E.E.; McBride, J.L. Verification of precipitation in weather systems: Determination of systematic errors. J. Hydrol. 2000, 239, 179-202.
23. Pijanowski, B.C.; Brown, D.G.; Shellito, B.A.; Manik, G.A. Using neural networks and GIS to forecast land use changes: A land transformation model. Comput. Environ. Urban Syst. 2002, 26, 553-575.
24. Briggs, W.M.; Levine, R.A. Wavelets and field forecast verification. Mon. Weather Rev. 1997, 125, 1329-1341.
25. Barredo, J.I.; Demicheli, L. Urban sustainability in developing countries' megacities: Modelling and predicting future urban growth in Lagos. Cities 2003, 20, 297-310.
26. Turner, M.G.; Costanza, R.; Sklar, F.H. Methods to evaluate the performance of spatial simulation-models. Ecol. Model 1989, 48, 1-18.
27. Urban Strategy. Structure Plan, Master Plan and Detailed Area Plan (2001-2020) for Khulna City; Aqua-Sheltech Consortium, Khulna Development Authority: Khulna, Bangladesh, 2002; Volume I.
28. Ahmed, B.; Ahmed, R. Modeling urban land cover growth dynamics using multi-temporal satellite images: A case study of Dhaka, Bangladesh. ISPRS Int. J. Geo-Inf. 2012, 1, 3-31.
29. Liu, H.; Zhou, Q. Accuracy analysis of remote sensing change detection by rule-based rationality evaluation with post-classification comparison. Int. J. Remote Sens. 2004, 5, 1037-1050.
30. Eastman, J.R. IDRISI Taiga Guide to GIS and Image Processing, Manual Version 16.02 (Software); Clark Labs: Worcester, MA, USA, 2009.
31. Basharin, G.P.; Langville, A.N.; Naumov, V.A. The life and work of A.A. Markov. Linear Algebr. Appl. 2004, 386, 3-26.
32. Weng, Q. Land use change analysis in the Zhujiang Delta of China using satellite remote sensing, GIS and stochastic modelling. J. Environ. Manage. 2002, 64, 273-284.
33. Maerivoet, S.; Moor, B.D. Cellular automata models of road traffic. Phys. Rep. 2005, 419, 1-64.
34. Malczewski, J. GIS-based land-use suitability analysis: A critical overview. Prog. Plan. 2004, 62, 3-65.
35. Karul, C.; Soyupak, S. A Comparison between Neural Network Based and Multiple Regression Models for Chlorophyll-A Estimation. In Ecological Informatics; Recknagel, F., Ed.; Springer: Berlin, Germany, 2006; pp. 309-323.
36. Atkinson, P.M.; Tatnall, A.R.L. Introduction neural networks in remote sensing. Int. J. Remote Sens. 1997, 18, 699-709.
37. Vliet, J.V. Map Comparison Kit 3 User Manual, Manual Version 3.2 (Software); Research Institute for Knowledge Systems BV: Maastricht, The Netherlands, 2009.
38. Pontius, R.G., Jr. Quantification error versus location error in the comparison of categorical maps. Photogramm. Eng. Remote Sensing 2000, 66, 1011-1016.
39. Pontius, R.G., Jr. Statistical methods to partition effects of quantity and location during comparison of categorical maps at multiple resolutions. Photogramm. Eng. Remote Sensing 2002, 68, 1041-1049.
40. Cohen, J. A coefficient of agreement for nominal scales. Educ. Psychol. Meas. 1960, 20, 37-46.
41. Kitada, K.; Fukuyama, K. Land-use and land-cover mapping using a gradable classification method. Remote Sens. 2012, 4, 1544-1558.
42. Ahmed, B. Modelling spatio-temporal urban land cover growth dynamics using remote sensing and GIS techniques: A case study of Khulna City. J. Bangladesh Instit. Plan. 2011, 4, 16-33.
43. Long, J.B.; Giri, C. Mapping the Philippines' mangrove forests using landsat imagery. Sensors 2011, 11, 2972-2981.
44. Pontius, R.G., Jr.; Millones, M. Death to Kappa: Birth of quantity disagreement and allocation disagreement for accuracy assessment. Int. J. Remote Sens. 2011, 32, 4407-4429.
45. Pontius, R.G., Jr.; Millones, M. Problems and Solutions for Kappa-Based Indices of Agreement. In Proceedings of the Conference Studying, Modeling and Sense Making of Planet Earth, Mytilene, Greece, 1-6 June 2008.
46. Pontius, R.G., Jr.; Peethambaram, S.; Castella, J.C. Comparison of three maps at multiple resolutions: A case study of land change simulation in Cho Don District, Vietnam. Ann. Assn. Amer. Geogr. 2011, 101, 45-62.
47. Singh, A. Digital change detection using remote-sensing data. Int. J. Remote Sens. 1989, 10, 989-1003.
48. Mas, J.F. Monitoring land-cover changes: A comparison of change detection techniques. Int. J. Remote Sens. 1999, 20, 139-152.
49. Jensen, J.R. Urban change detection mapping using Landsat digital data. Amer. Cartographer 1981, 8, 127-147.
50. Macleod, R.D.; Congalton, R.G. A quantitative comparison of change detection algorithms for monitoring eelgrass from remotely sensed data. Photogramm. Eng. Remote Sensing 1998, 64, 207-216.
51. Zadeh, L.A. Fuzzy sets. Inf. Control 1965, 8, 338-353.
52. Bandemer, H.; Gottwald, S. Fuzzy Sets, Fuzzy Logic, Fuzzy Methods with Applications; Wiley: New York, NY, USA, 1995.
53. Cheng, T.; Molenaar, M.; Lin, H. Formalizing fuzzy objects from uncertain classification results. Int. J. Geogr. Inf. Sci. 2001, 15, 27-42.
54. Lewis, H.G.; Brown, M. A generalized confusion matrix for assessing area estimates from remotely sensed data. Int. J. Remote Sens. 2001, 22, 3223-3235.
55. Hagen-Zanker, A. Comparing Continuous Valued Raster Data: A Cross Disciplinary Literature Scan; Research Institute for Knowledge Systems BV: Maastricht, The Netherlands, 2006.