Nearest neighbor classification with dependent training sequences

Annals of Statistics

Volumn 29, Issue 5, 2001, Pages 1424-1442

  Holst, M ^b   Irle, A ^a  

^a UNIVERSITY OF KIEL   (Germany)

^b NONE

Author keywords

Asymptotic risk; Dependent training samples; Nearest neighbor classification

Indexed keywords

EID: 0035566471     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/aos/1013203460     Document Type: Article

References (26)

1. ADAMS, T. M. and NOBEL, A. B. (1998). On density estimation from ergodic processes. Ann. Probab. 26 794-804.
2. BICKEL, P. J., RITOV, Y. and RYDEN, T. (1998). Asymptotic normality of the maximum-likelihood estimator for general hidden Markov models. Ann. Statist. 26 1614-1635.
3. COVER, T. M. and THOMAS, J. A. (1991). Elements of Information Theory. Wiley, New York.
4. COVER, T. M. and HART, P. E. (1967). Nearest neighbor pattern classification. IEEE Trans. Inform. Theory 13 21-27.
5. DASARATHY, B. (1991). Nearest Neighbor Classification Techniques. IEEE, Los Alamitos, CA.
6. Devroye, L. (1981a). On the inequality of Cover and Hart in nearest neighbor discrimination. IEEE Trans. Pattern Anal. Mach. Intelligence 3 75-78.
7. DEVROYE, L. (1981b). On the asymptotic probability of error in nonparametric discrimination. Ann. Statist. 9 1320-1327.
8. DEVROYE, L., GYÖRFI, L., KRZYZAK, A. and LUGOSI, G. (1994). On the strong universal consistency of nearest neighbor regression function estimates. Ann. Statist. 22 1371-1385.
9. DEVROYE, L., GYÖRFI, L. and LUGOSI G. (1996). A Probabilistic Theory of Pattern Recognition. Springer, New York.
10. FIX, E. and HODGES, J. (1951). Discriminatory analysis. Nonparametric discrimination: consistency properties. Technical report, USAF School of Aviation Medicine, Randolph Field.
11. FIX, E. and HODGES, J. (1952). Discriminatory analysis: small sample performance. Technical report, USAF School of Aviation Medicine, Randolph Field.
12. GYÖRFI, L., HÄRDLE, W., SARDA, P. and VIEU, V. (1989). Nonparametric Curve Estimation from Time Series. Lecture Notes Statistics 60 Springer, Berlin.
13. GYÖRFI, L. and LUGOSI, G. (1992). Kernel density estimation from ergodic samples is not universally consistent. Comp. Statist. Data Anal. 24 437-442.
14. HUANG, X. D., ARIKI, Y. and JACK, M. A. (1990). Hidden Markov Models for Speech Recognition. Edinburgh Univ. Press.
15. IRLE, A. (1997). On consistency in nonparametric estimation under mixing assumptions. J. Multivariate Anal. 60 123-147.
16. KAHAN, S., PAVLIDES, T. and BAIRD, H. S. (1987). On the recognition of printed characters of any font and size. IEEE Trans. Pattern Anal. Mach. Intelligence 9 274-288.
17. KULKARNI, S. R. and POSNER, S. E. (1995). Rates of convergence of nearest neighbor estimation under arbitrary sampling. IEEE Trans. Inform. Theory 41 1028-1039.
18. LEADBETTER, M. R., LINDGREN, G. and ROOTZEN, H. (1983). Extremes and Related Properties of Random Sequences and Processes. Springer, New York.
19. MACDONALD, I. and ZUCCHINI, W. (1997). Hidden Markov and Other Models for Discrete-valued Time-series. Chapman and Hall, London.
20. MORVAI, G., YAKOWITZ, S. and GYÖRFI, L. (1996). Nonparametric inference for ergodic stationary time series. Ann. Statist. 24 370-379.
21. NOBEL, A. B., MORVAI, G. and KULKARNI, S. R. (1998). Density estimation from an individual numerical sequence. IEEE Trans. Inform. Theory 44 537-541.
22. SHANNON, C. E. (1951). Prediction and entropy of handwritten English. Bell Systems Tech. J. 30 50-64.
23. SMITH, S. J., BOURGOIN, M. O., SIMS, K. and VOORHEES, H. L. (1994). Handwritten character classification using nearest neighbor in large databases. IEEE Trans. Pattern Anal. Mach. Intelligence 3 75-78.
24. SNAPP, R. S. and VENKATESH, S. S. (1998). Asymptotic expansion of the k nearest neighbor risk. Ann. Statist. 26 850-878.
25. STONE, C. (1977). Consistent nonparametric regression. Ann. Statist. 5 595-645.
26. WHEEDEN, R. L. and ZYGMUND A. (1977). Measure and Integral. Marcel Dekker, New York.