Statistical Properties of Error Estimators in Performance Assessment of Recognition Systems

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn PAMI-4, Issue 2, 1982, Pages 215-220

  Devijver, P A ^b  

^a RUTHERFORD APPLETON LABORATORY   (United Kingdom)

^b PHILIPS RESEARCH LABORATORIES   (Netherlands)

Author keywords

Average conditional error estimator; classification error probability; empirical error count estimator

Indexed keywords

PATTERN RECOGNITION SYSTEMS;

EID: 0020100273     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.1982.4767229     Document Type: Article

References (21)

1. S. John, “Errors in discrimination,” Ann. Math. Statist., vol. 32, pp. 1125-1144, 1961.
2. M. Okamoto, “An asymptotic expansion for the distribution of the linear discriminant function,” Ann. Math. Statist., vol. 34, pp. 1286-1301, 1963.
3. C. A. B. Smith, “Some examples of discrimination,” Ann. Eugen., vol. 18, p. 272.1947.
4. W. H. Highleyman, “The design and analysis of pattern recognition experiments,” Bell Syst. Tech. J., vol. 41, pp. 723-744, 1962.
5. P. A. Laehenbruch, “An almost unbiased method of obtaining confidence intervals for the probability of misclassification in discriminant analysis,” Biometrics, vol. 23, pp. 639-645.1967.
6. T. M. Cover, “Learning in pattern recognition,” in Methodologies of Pattern Recognition, S. Watanabe, Ed. New York: Academic, 1969, pp. 111-132.
7. G. T. Toussaint, “Bibliography on estimation of misclassification,” IEEE Trans. Inform. Theory, vol. IT-20, pp. 472-479, 1974.
8. K. Fukunaga and D. Kessel, “Nonparametric Bayes error estimation using unclassified samples,” IEEE Trans. Inform. Theory, vol. IT-19, pp. 434-439, 1973.
9. L. Kanal, “Patterns in pattern recognition: 1968-1974,” IEEE Trans. Inform. Theory, vol. IT-20, pp. 697-722, 1974.
10. K. Fukunaga and L. Hostetler, “k-nearest neighbor Bayes risk estimation,” IEEE Trans. Inform. Theory, vol. IT-21, pp. 285-293.1975.
11. P. A. Devijver, “A note on ties in voting with the k-NN rule,” Pattern Recog., vol. 10, pp. 297-298, 1978.
12. P. A. Devijver and M. M. Dekesel, “K-NN estimates of information measures,” in Proc. Seminar Pattern Recog., Liege, 1977, pp. 9.4.1-9.4.6.
13. T. Lissack and K. S. Fu, “Error estimation in pattern recognition via L∞-distance between posterior functions,” IEEE Trans. Inform. Theory, vol. IT-22, pp. 34-45, 1974.
14. J. M. Garnett and S. S. Yau, “Nonparametric estimation of the Bayes error of feature extractors using ordered nearest neighbor sets,” IEEE Trans. Comput., vol. C-26, pp. 46-54, 1977.
15. Z. Chen and K. S. Fu, “Nonparametric Bayes risk estimation for classification,” IEEE Trans. Syst, Man, Cybern., vol. SMC-7, pp. 651-656, 1977.
16. P. A. Devijver, “Nonparametric estimation by the method of ordered nearest neighbour sample sets,” in Proc. 4th IJCPR, Kyoto, Japan, 1978, pp. 217-223.
17. “Nonparametric estimation of feature evaluation criteria,” in Pattern Recognition and Signal Processing, C. H. Chen, Ed. Groningen, The Netherlands: Noordhoff, 1978.
18. K. Fukunaga, Introduction to Statistical Pattern Recognition. New York: Academic. 1972.
19. L. Kanal and B. Chandrasekaran, “On dimensionality and sample size in statistical pattern recognition,” Pattern Recog., vol. 3, pp. 225-234, 1971.
20. J. Kittler and L. F. Pau, “Small sample properties of pattern recognition systems in lot acceptance sampling,” in Proc. 4th IJCPR, Kyoto, Japan, 1978, pp. 249-257.
21. J. Kittler and P. A. Devijver, “The probability distribution of the conditional classification error,” IEEE Trans. Pattern Anal. Machine Intell, vol. PAMI-2, pp. 259-261, 1980.