A Bayesian approach to classification accuracy inference

Forestry

Volumn 82, Issue 2, 2009, Pages 211-226

  Magnussen, Steen ^a  

^a LAURENTIAN FORESTRY CENTRE   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY ASSESSMENT; BAYESIAN ANALYSIS; CLASSIFICATION; ESTIMATION METHOD; LAND COVER; MONTE CARLO ANALYSIS; QUALITATIVE ANALYSIS; SAMPLING; STATISTICAL ANALYSIS;

EID: 65349123077     PISSN: 0015752X     EISSN: 14643626     Source Type: Journal    
DOI: 10.1093/forestry/cpp001     Document Type: Article

References (79)

1. Agresti, A. 1992 A survey of exact inference for contingency tables. Stat. Sci. 7, 131-153.
2. Agresti, A. 1996 An Introduction to Categorical Data Analysis. Wiley, New York.
3. Agresti, A. and Caffo, B. 2000 Simple and effective confidence intervals for proportions and differences of proportions result from adding two successes and two failures. Am. Stat. 54, 280-288.
4. Agresti, A. and Coull, B.A. 1998 Approximate is better than "Exact" for interval estimation of binomial proportions. Am. Stat. 52, 119-126.
5. Aronoff, S. 1982 The map accuracy report: a user's view. Photogr. Eng. Rem. Sens. 48, 1309-1312.
6. Aronoff, S. 1985 The minimum accuracy value as an index of classifi cation accuracy. Photogr. Eng. Rem. Sens. 51, 99-111.
7. Biging, G.S., Colby, D.R., Congalton, R.G., Lunetta, R.S. and Elvidge, C.D. 1999 Sampling systems for change detection accuracy assessment. In Remote Sensing Change Detection. Taylor and Francis, London, pp. 281-308.
8. Bishop, Y.M.M., Fienberg, S.E. and Holland, P.W. 1975 Discrete Multivariate Analysis: Theory and Practice. MIT Press, Cambridge, MS.
9. Briggs, A. 2003 Probabilistic sensitivity analysis for decision trees with multiple branches: use of the Dirichlet distribution in a Bayesian framework. Med. Decis. Mak. 23, 341-350.
10. Chen, D., Stow, D.A. and Gong, P. 2004 Examining the effect of spatial resolution and texture window size on classification accuracy: an urban environment case. Int. J. Rem. Sens. 25, 2177-2192.
11. Cihlar, J., Latifovic, R., Beaubien, J., Guindon, B. and Palmer, M. 2003 Thematic mapper (TM) based accuracy assessment of a land cover product for Canada derived from SPOT VEGETATION (VGT) data. Can. J. Rem. Sens. 29, 154-170.
12. Clopper, C.J. and Pearson, E.S. 1934 The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika. 26, 404-413.
13. Cochran, W.G. 1977 Sampling Techniques. Wiley, New York.
14. Conaway, M.R. 1990 A random effects model for binary data. Biometrics. 46, 317-328.
15. Conese, C. and Maselli, F. 1992 Use of error matrices to improve area estimates with maximum likelihood classifi cation procedures. Rem. Sens. Env. 40, 113-124.
16. Congalton, R.G. 1983 Assessing Landsat classifi cation accuracy using discrete multivariate analysis statistical techniques. Photogr. Eng. Rem. Sens. 49, 1671-1678.
17. Congalton, R.G. 1991 A review of assessing the accuracy of classification of remotely sensed data. Rem. Sens. Env. 37, 35-45.
18. Congalton, R.G. 2001 Accuracy assessment and validation of remotely sensed and other spatial information. Int. J. Wildl. Fire. 10, 321-328.
19. Congalton, R.G. and Biging, G.S. 1992 A pilot study evaluation ground reference data collection efforts for use in forest inventory. Photogr. Eng. Rem. Sens. 58, 1669-1671.
20. Congdon, P. 2006 Bayesian Statistical Modelling. Wiley, Chichester, England.
21. Czaplewski, R.L. 2003 Statistical design and methodological considerations for the accuracy assessment of maps of forest conditions. In Remote Sensing of Forest Environments: Concepts and Case Studies. M.A. Wulder and J. Franklin (ed). Kluwer Academy Publisher, Boston, pp. 115-129.
22. Czaplewski, R.L. and Catts, C.P. 1992 Calibration of remotely sensed proportion or area estimates for misclassifi cation error. Rem. Sens. Env. 39, 29-43.
23. De Mast, J. 2007 Agreement and kappa-type indices. Am. Stat. 61, 148-153.
24. Denham, R., Mengersen, K. and Witte, C. 2009 Bayesian analysis of thematic map accuracy data. Rem. Sens. Env. doi: 10.1016/j.rese.2008.10. 008.
25. Denison, D.G.T., Holmes, C.C., Mallick, B.K. and Smith, A.F.M. 2002 Bayesian Methods for Nonlinear Classification and Regression. Wiley, New York.
26. Devroye, L. 1986 Non-uniform Random Variate Generation. Springer, New York.
27. Dobbertin, M. and Biging, G.S. 1996 A simulation study of the effect of scene autocorrelation, training sample size and sampling method on classifi cation accuracy. Can. J. Rem. Sens. 22, 360-367.
28. Efron, B. 1986 How biased is the apparent error rate of a prediction rule. J. Am. Stat. Assoc. 81, 461-470.
29. Finley, A.O.B., Sudipto, B. and McRoberts, R.E. 2008 A Bayesian approach to multi-source forest area estimation. Env. Ecol. Stat. 15, 17.
30. Foody, G.M. 1992 On the compensation for chance agreement in image classifi cation accuracy assessment. Photogr. Eng. Rem. Sens. 58, 1459-1460.
31. Foody, G.M. 2002 Status of land cover classifi cation accuracy assessment. Rem. Sens. Env. 80, 185-201.
32. Frigessi, A. and Stander, J. 1994 Informative priors for the Bayesian classification of satellite images. J. Am. Stat. Assoc. 89, 703-709.
33. Ge, J.J., Qi, J.G., Lofgren, B.M., Moore, N., Torbick, N. and Olson, J.M. 2007 Impacts of land use/cover classifi cation accuracy on regional climate simulations - art. no. D05107. J. Geophys. Res. Atmosph. 112, 5107-5107.
34. Gilks, W.R., Richardson, S. and Spiegelhalter, D.J. 1996 Introducing Markov chain Monte Carlo. In Markov Chain Monte Carlo in Practice. Chapman & Hall/ CRC, Bacon Raton, pp. 1-19.
35. Gopalan, R. and Berry, D.A. 1998 Bayesian multiple comparisons using Dirichlet process priors. J. Am. Stat. Assoc. 93, 1130-1139.
36. Green, E.J. and Strawderman, W.E. 1994 Determining accuracy of thematic maps. Statistician. 43, 77-85.
37. Gregoire, T.G. 1998 Design-based and model-based inference in survey sampling: appreciating the difference. Can. J. For. Res. 28, 1429-1447.
38. Hyyppä, J., Hyyppä, H., Inkinen, M., Engdahl, M., Linko, S. and Zhu, Y.H. 2000 Accuracy comparison of various remote sensing data sources in the retrieval of forest stand attributes. For. Ecol. Mgmt. 128, 109-120.
39. Johnson, N.L., Kotz, S. and Wu, X. 1991 Inspection Errors for Attributes in Quality Control. Chapman & Hall, London.
40. Kalkhan, M.A., Reich, R.M. and Czaplewski, R.L. 1997 Variance estimates and confidence intervals for the Kappa measure of classifi cation accuracy. Can. J. Rem. Sens. 23, 210-216.
41. Kalkhan, M.A., Reich, R.M. and Stohlgren, T.J. 1998 Assessing the accuracy of Landsat Thematic Mapper classifi cation using double sampling. Int. J. Rem. Sens. 19, 2049-2060.
42. Klein, R. and Press, S.J. 1992 Adaptive Bayesian classifi cation of spatial data. J. Am. Stat. Assoc. 87, 844-851.
43. Korn, E.L. and Graubard, B.I. 1998 Confi dence intervals for proportions with small expected number of positive counts estimated from survey data. Surv. Meth. 24, 193-201.
44. Kyriakidis, P.C. and Dungan, J.L. 2002 A geostatistical approach for mapping thematic classification accuracy and evaluating the impact of inaccurate spatial data on ecological predictions. Env. Ecol. Stat. 8, 311-330.
45. Landis, J.R. and Koch, G.G. 1977 The measurement of observer agreement for categorical data. Biometrics. 33, 159-174.
46. Little, R.J. 2006 Calibrated Bayes: a Bayes/frequentist roadmap. Am. Stat. 60, 213-223.
47. Ma, Z. and Redmond, R.L. 1995 Tau coefficients for accuracy assessment of classification of remote sensing data. Photogr. Eng. Rem. Sens. 61, 435-439.
48. Magnussen, S. 2002 Joint versus separate estimation of state and change in category frequencies from repeat stratifi ed two-phase sampling with a fallible classifi er. Env. Monit. Assess. 78, 63-87.
49. Magnussen, S., Boudewyn, P. and Wulder, M.A. 2004a Contextual classifi cation of Landsat TM images to forest inventory cover types. Int. J. Rem. Sens. 25, 2421-2440.
50. Magnussen, S., Boudewyn, P., Wulder, M.A. and Seemann, D. 2000 Predictions of forest inventory cover type proportions using Landsat TM. Silv. Fenn. 34, 351-370.
51. Magnussen, S. and De Bruin, S. 2003 Updating cover type maps using sequential indicator simulation. Rem. Sens. Env. 87, 161-170.
52. Magnussen, S., Stehman, S.V., Corona, P. and Wulder, M.A. 2004b A Pòlya-urn resampling scheme for estimating precision and confidence intervals under one-stage cluster sampling: application to map classification accuracy and cover-type frequencies. For. Sci. 50, 810-822.
53. Mason, R.L. and Young, J.C. 2002 Multivariate Statistical Process Control with Industrial Applications. Society for Industrial and Applied Mathematics, American Statistical Association, Alexandria, VI.
54. McIver, D.K. and Friedl, M.A. 2002 Using prior probabilities in decision-tree classifi cation of remotely sensed data. Rem. Sens. Env. 81, 253-261.
55. Meeden, G. 1999 A noninformative Bayesian approach for two-stage cluster sampling. Sankhya. B. 61, 133-144.
56. Metha, M.L. 1991 Random Matrices. 2nd ed. Academic Press. Enlarged and revised.
57. Mirkin, B. 2001 Eleven ways to look at the Chisquared coefficient for contingency tables. Am. Stat. 55, 111-120.
58. Prentice, R.L. 1988 Correlated binary regression with covariates specific to each binary observation. Biometrics. 44, 1033-1048.
59. Prisley, S.P. and Smith, J.L. 1987 Using classification error matrices to improve the accuracy of weighted land-cover models. Photogr. Eng. Rem. Sens. 53, 1259-1263.
60. Ricotta, C. 2004 Evaluating the classification accuracy of fuzzy thematic maps with a simple parametric measure. Int. J. Rem. Sens. 25, 2169-2176.
61. Rosenfield, G.H. and Fitzpatrick-Lins, K. 1986 A coefficient of agreement as a measure of thematic classification accuracy. Photogr. Eng. Rem. Sens. 52, 223-227.
62. Rosner, B. and Milton, R.C. 1988 Significance testing for correlated binary outcome data. Biometrics. 44, 505-512.
63. Santner, T.J. and Duffy, D.E. 1989 The Statistical Analysis of Discrete Data. Springer, New York.
64. Särndal, C.E. 1996 Effi cient estimators with simple variance in unequal probability sampling. J. Am. Stat. Assoc. 91, 1289-1300.
65. Staudte, R.G. and Sheather, S.J. 1990 Robust Estimation and Testing. Wiley, New York.
66. Steele, B.M., Winne, J.C. and Redmond, R.L. 1998 Estimation and mapping of misclassifi cation probabilities for thematic land cover maps. Rem. Sens. Env. 66, 192-202.
67. Stehman, S.V. 1995 Thematic map accuracy assessment from the perspective of finite population sampling. Int. J. Rem. Sens. 16, 589-593.
68. Stehman, S.V. 1999a Basic probability sampling designs for thematic map accuracy. Int. J. Rem. Sens. 20, 2423-2441.
69. Stehman, S.V. 1999b Comparing thematic maps based on map value. Int. J. Rem. Sens. 20, 2347-2366.
70. Stehman, S.V. and Czaplewski, R.L. 1998 Design and analysis for thematic map accuracy assessment: fundamental principles. Rem. Sens. Env. 64, 331-344.
71. Tenenbein, A. 1972 A double sampling scheme for estimating from misclassified multinomial data with applications to sampling inspections. Technometrics. 14, 187-202.
72. Tuyl, F., Gerlach, R. and Mengersen, K. 2008 A comparison of Bayes-Laplace, Jeffreys, and other priors: the case of zero events. Am. Stat. 62, 40-44.
73. Walsh, T.A. and Burk, T.E. 1993 Calibration of satellite classifications of land area. Rem. Sens. Env. 46, 281-290.
74. Wendell, J.P. and Schmee, J. 2001 Likelihood confi-dence intervals for proportions in finite populations. Am. Stat. 55, 55-61.
75. Wulder, M.A. 2003 Operational mapping of the land cover of the forested area of Canada with Landsat data: EOSD land cover program. For. Chron. 79, 1-9.
76. Wulder, M.A., Franklin, S.E., White, J., Linke, J. and Magnussen, S. 2006 An accuracy assessment framework for large area land cover classification products derived from medium resolution satellite data. Int. J. Rem. Sens. 27, 663-683.
77. Wulder, M.A., White, J., Magnussen, S. and McDonald, S. 2007 Validation of a large land cover product using purpose-acquired airborne video. Rem. Sens. Env. 106, 480-491.
78. Yates, F. 1934 Contingency tables involving small numbers and the Chi-squared test. J. R. Stat. Soc. Suppl. 1, 18.
79. Zhao, L.P. and Prentice, R.L. 1990 Correlated binary regression using a quadratic exponential model. Biometrika. 77, 642-648.