Assessing reference dataset representativeness through confidence metrics based on information density

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 78, Issue , 2013, Pages 129-147

  Mountrakis, Giorgos ^a   Xi, Bo ^a  

^a 402 Baker Laboratory   (United States)

Author keywords

Classification; Quality; Reference data; Reliability; Representativeness; Training

Indexed keywords

DECISION TREES; IMAGE CLASSIFICATION; IMAGE QUALITY; NEURAL NETWORKS; PERSONNEL TRAINING; RELIABILITY; REMOTE SENSING; STATISTICAL TESTS;

ACQUISITION COSTS; BACK PROPAGATION NEURAL NETWORKS; CLASSIFICATION ACCURACY; CLASSIFICATION CONFIDENCE; CLASSIFICATION TASKS; CONFIDENCE MAPS; ENVIRONMENTAL MONITORING; FEATURE SPACE; IMAGE CLASSIFIERS; INFORMATION DENSITY; LAND COVER MAPS; MODELING TASK; RANDOMLY DISTRIBUTED; REFERENCE DATA; REMOTELY SENSED IMAGERY; REPRESENTATIVENESS; SPATIAL SAMPLING; SPATIAL STATISTICS; SPECTRAL BAND; SUPERVISED CLASSIFICATION; UNDER-REPRESENTED;

CLASSIFICATION (OF INFORMATION);

ARTIFICIAL NEURAL NETWORK; ASSESSMENT METHOD; DATA SET; ENVIRONMENTAL MONITORING; ERROR ANALYSIS; IMAGE CLASSIFICATION; LAND COVER; NUMERICAL MODEL; RELIABILITY ANALYSIS; REMOTE SENSING; SPATIAL ANALYSIS; TRAINING;

EID: 84874802882     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2013.01.011     Document Type: Article

References (50)

1. Barandela R., Valdovinos R.M., Sánchez J.S., Ferri F.J. The imbalanced training sample problem: under or over sampling?. Lecture Notes in Computer Science 2004, 3138:806-814.
2. Binaghi E., Brivio P.A., Ghezzi P., Rampini A. A fuzzy set-based accuracy assessment of soft classification. Pattern Recognition Letters 1999, 20:935-948.
3. Campbell J.B. Introduction to Remote Sensing 2007, Guilford Press, New York, p. 626.
4. Cano J.R., Herrera F., Lozano M. Evolutionary stratified training set selection for extracting classification rules with trade off precision-interpretability. Data & Knowledge Engineering 2007, 60:90-108.
5. Card D.H. Using known map category marginal frequencies to improve estimates of thematic map accuracy. Photogrammetric Engineering &Remote Sensing 1982, 48:431-439.
6. Chen D., Stow D. The effect of training strategies on supervised classification at different spatial resolutions. Photogrammetric Engineering & Remote Sensing 2002, 68(11):1155-1162.
7. Civco, D.L., Hurd, J.D., 1997. Impervious surface mapping for the state of Connecticut. In: Proceedings of 1997 ASPRS/ACSM Annual Convention, April 7-10, 1997, Seattle, WA, vol. 3, pp. 124-135.
8. Congalton R.G. A review of assessing the accuracy of classifications of remotely sensed data. Remote Sensing of Environment 1991, 37:35-46.
9. Congalton R., Green K. Assessing the Accuracy of Remotely Sensed Data: Principles and Practices 2009, CRC/Taylor & Francis, Boca Raton, FL, 183p. second ed.
10. Czaplewski R.L., Catts G.P. Calibration of remotely sensed proportion or area estimates for misclassification error. Remote Sensing of Environment 1992, 39:29-43.
11. Edwards T.C., Cutler D.R., Zimmermann N.E., Geiser L., Moisen G.G. Effects of sample survey design on the accuracy of classification tree models in species distribution models. Ecological Modelling 2006, 199:132-141.
12. ENVI, 1999. ENVI Tutorials; version 3.2. Better Solutions Consulting, Lafayette, Colorado, USA.
13. Foody G.M. Approaches for the production and evaluation of fuzzy land cover classifications from remotely-sensed data. International Journal of Remote Sensing 1996, 17:1317-1340.
14. Foody G.M. Status of land cover classification accuracy assessment. Remote Sensing of Environment 2002, 80:185-201.
15. Foody G.M. Sample size determination for image classification accuracy assessment and comparison. International Journal of Remote Sensing 2009, 30:5273-5291.
16. Foody G.M., Mathur A. Toward intelligent training of supervised image classifications: directing training data acquisition for SVM classification. Remote Sensing of Environment 2004, 93:107-117.
17. Foody G.M., Mathur A. The use of small training sets containing mixed pixels for accurate hard image classification: training on mixed spectral responses for classification by a SVM. Remote Sensing of Environment 2006, 103:179-189.
18. Homer C., Dewitz J., Fry J., Coan M., Hossain N., Larson C., Herold N., McKerrow A., Van Driel J.N., Wickham J.D. Completion of the 2001 national land cover database for the conterminous United States. Photogrammetric Engineering &Remote Sensing 2007, 73:337-341.
19. Jain A.K., Duin R.P.W., Mao Jianchang. Statistical pattern recognition: a review. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000, 22:4-37.
20. Kandrika S., Roy P.S. Land use land cover classification of Orissa using multi-temporal IRS-P6 awifs data: a decision tree approach. International Journal of Applied Earth Observation and Geoinformation 2008, 10:186-193.
21. Kavzoglu T. Increasing the accuracy of neural network classification using refined training data. Environmental Modelling & Software 2009, 24:850-858.
22. Lesparre, J., Gorte, B.G.H., 2006. Using mixed pixels for the training of a maximum likelihood classification. In: Proceedings of ISPRS Commission VII Mid-term Symposium, pp. 632-637.
23. Lillesand T.M., Kiefer R.W., Chipman J.W. Remote Sensing and Image Interpretation 2004, Wiley, New York, p. 763.
24. Liu W., Gopal S., Woodcock C. Uncertainty and confidence in land cover classification using a hybrid classifier approach. Photogrammetric Engineering and Remote Sensing 2004, 70:963-971.
25. Lu D., Mausel P., Batistella M., Moran E. Comparison of land-cover classification methods in the Brazilian Amazon basin. Photogrammetric Engineering and Remote Sensing 2004, 70:723-731.
26. Luo L., Mountrakis G. Integrating intermediate inputs from partially classified images within a hybrid classification framework: an impervious surface estimation example. Remote Sensing of Environment 2010, 114(6):1220-1229.
27. McCaffrey T., Franklin S. Automated training site selection for large-area remote-sensing image analysis. Computers & Geosciences 1993, 19:1413-1428.
28. Mitchell S., Remmel T., Csillag F., Wulder M. Distance to second cluster as a measure of classification confidence. Remote Sensing of Environment 2008, 112:2615-2626.
29. Mountrakis G., Im J., Ogole C. Support vector machines in remote sensing: a review. ISPRS Journal of Photogrammetry and Remote Sensing 2011, 66(3):247-259.
30. Pontius R.G. Quantification error versus location error in comparison of categorical maps. Photogrammetric Engineering and Remote Sensing 2000, 66:1011-1016.
31. Pontius R.B., Millones M. Death to Kappa: birth of quantity disagreement and allocation disagreement for accuracy assessment. International Journal of Remote Sensing 2011, 32(15):4407-4429.
32. Quinlan J.R. Induction of decision trees. Machine Learning 1986, 1:81-106.
33. Raudys S.J., Jain A.K. Small sample size effects in statistical pattern recognition: recommendations for practitioners. IEEE Transactions on Pattern Analysis and Machine Intelligence 1991, 13:252-264.
34. Rebbapragada, U., Lomasky, R., Brodley, C.E., & Friedl, M.A., 2008. Generating high-quality training data for automated land-cover mapping. In: IEEE International Geoscience & Remote Sensing Symposium, vol. 4, pp. IV-546-IV-548.
35. Reeves C.R., Bush D.R. Instance Selection and Construction for Data Mining 2001, Kluwer Academic Publishers, pp. 339-356.
36. Richards J.A., Jia X. Remote Sensing Digital Image Analysis: An Introduction 1999, Springer, Berlin; New York, p. 363.
37. Ripley B.D. The second-order analysis of stationary point processes. Journal of Applied Probability 1976, 13:255-266.
38. Rumelhart D.E., Hinton G.E., Williams R.J. Learning internal representations by error propagation. Parallel Distributed Processing 1986, 318-362. MIT Press, Cambridge, MA. D.E. Rumelhart, J.L. McClelland (Eds.).
39. Sebban M., Nock R., Chauchat J., Rakotomalala R. Impact of learning set quality and size on decision tree performances. International Journal of Computer System and Signal 2000, 1:85-105.
40. Shahshahani B.M., Landgrebe D.A. The effect of unlabeled samples in reducing the small sample size problem and mitigating the Hughes phenomenon. IEEE Transactions on Geoscience and Remote Sensing 1994, 32:1087-1095.
41. Shine, J.A., Wakefiled, G.I., 1999. A Comparison of Supervised Imagery Classification Using Analyst-chosen and Geostatistically-chosen Training Sets. GeoComputation' 99. http://www.geovista.psu.edu/sites/geocomp99/Gc99/044/gc_044.htm.
42. Steele B., Winne J.C., Redmond R. Estimation and mapping of misclassification probabilities for thematic land cover maps. Remote Sensing of Environment 1998, 66:192-202.
43. Stehman S.V. Basic probability sampling designs for thematic map accuracy assessment. International Journal of Remote Sensing 1999, 20:2423-2441.
44. Stehman S.V. A critical evaluation of the normalized error matrix in map accuracy assessment. Photogrammetric Engineering and Remote Sensing 2004, 70(6):743-751.
45. Stehman S.V. Sampling designs for accuracy assessment of land cover. International Journal of Remote Sensing 2009, 30(20):5243-5272.
46. Stehman S.V., Foody G.M. Accuracy assessment. The SAGE Handbook of Remote Sensing 2009, 297-309. Sage Publications, New York. T.A. Warner, M.D. Nellis, G.M. Foody (Eds.).
47. Swain P.H., Davis S.M. Remote Sensing: The Quantitative Approach 1978, McGraw-Hill International Book Co., London; New York.
48. Van der Wel F.J.M., Van der Gaag L.C., Gorte B.G.H. Visual exploration of uncertainty in remote-sensing classification. Computers & Geosciences 1998, 24:335-343.
49. Van Niel T.G., McVicar T.R., Datt B. On the relationship between training sample size and data dimensionality: Monte Carlo analysis of broadband multi-temporal classification. Remote Sensing of Environment 2005, 98:468-480.
50. Washer M.J., Landgrebe D.A. A binary tree feature selection technique for limited training sample size. Remote Sensing of Environment 1984, 16:183-194.