Bias of Nearest Neighbor Error Estimates

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn PAMI-9, Issue 1, 1987, Pages 103-112

  Fukunaga, Keinosuke ^a   Hummels, Donald M ^a  

^a PURDUE UNIVERSITY   (United States)

Author keywords

Bayes error estimation; bias; convergence; finite sample; k NN; nearest neighbor; sample size

Indexed keywords

INFORMATION THEORY; PROBABILITY - RANDOM PROCESSES; STATISTICAL METHODS;

BAYES ERROR ESTIMATION;

IMAGE PROCESSING;

EID: 0023120274     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.1987.4767875     Document Type: Article

References (18)

1. T. M. Cover and P. E. Hart, Nearest neighbor pattern classification IEEE Trans. Inform. Theory, vol. IT-13, pp. 21-27, Jan. 1967
2. T. M. Cover, “Rates of convergence for nearest neighbor procedures,” in Proc. Hawaii Int. Conf. Syst. Sci., 1968, pp. 413–415.
3. T. J. Wagner, “Convergence of the nearest neighbor rule,” IEEE Trans. Inform. Theory, vol. IT-17, pp. 566–571, 1971.
4. J. Fritz, “Distribution-free exponential error bounds for nearest neighbor pattern classification,” IEEE Trans. Inform. Theory, vol. IT-21, pp. 552–557, 1975.
5. C. J. Stone, “Consistent nonparametric regression,” Ann. Stat., vol. 5, pp. 595–645, 1977.
6. L. Devroye, “On the almost everywhere convergence of nonparametric metric regression function estimates,” Ann. Stat., vol. 9, pp. 1310–1319, 1319, 1981.
7. “On the inequality of Cover and Hart in nearest neighbor discrimination,” IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-3, 3, pp. 75–78, Jan. 1981.
8. L. Devroye and T. J. Wagner, “Distribution free consistency results for nonparametric discrimination and regression function estimation,” Ann. Stat., vol. 8, pp. 231–239, 1980.
9. W. H. Rogers and T. J. Wagner, “A finite sample distribution free performance bound for local discrimination rules,” Ann. Stat., vol. 6, pp. 506–514, 1978.
10. J. Beck, “The exponential rate of convergence of error for k n -NN nonparametric regression and decision,” Prob. Contr. Inform. Theory, vol. 8, pp. 303–311, 1979.
11. L. Györfi, “The rate of convergence of k n -NN regression estimates and classification rules,” IEEE Trans. Inform. Theory, vol. IT-27, pp. 362–364, 1981.
12. R. D. Short and K. Fukunaga, “The optimal distance measure for nearest neighbor classification,” IEEE Trans. Inform. Theory, vol. IT-27, pp. 622–627, Sept. 1981.
13. K. Fukunaga and T. E. Flick, “An optimal global nearest neighbor metric,” IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-6, pp. 314–318, May 1984.
14. D. A. S. Fraser, Nonparametric Methods in Statistics. New York: Wiley, 1957, ch. 4.
15. K. W. Pettis, T. A. Bailey, A. K. Jain, and R. C. Dubes, “An intrinsic dimensionality estimator from near-neighbor information,” IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-1, pp. 25–37, Jan. 1979.
16. K. Fukunaga and T. E. Flick, “Classification error for a very large number of classes,” IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-6, pp. 779–788, Nov. 1984.
17. K. Fukunaga and L. D. Hostetler, “Optimization of k-nearest neighbor density estimates,” IEEE Trans. Inform. Theory, vol. IT-19, pp. 320–326, May 1973.
18. K. Fukunaga, Introduction to Statistical Pattern Recognition. New York: Academic, 1972, ch. 2.