Likelihood inference in nearest-neighbour classification models

Biometrika

Volumn 90, Issue 1, 2003, Pages 99-112

  Holmes, Christopher C ^a   Adams, Niall M ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

k nearest neighbour; Maximum pseudolikelihood; Nonparametric classification; Probabilistic nearest neighbour

Indexed keywords

EID: 3843108856     PISSN: 00063444     EISSN: None     Source Type: Journal    
DOI: 10.1093/biomet/90.1.99     Document Type: Article

References (33)

1. AHA, W. D. (1977). Lazy Learning. Dordrecht: Kluwer.
2. AKAIKE, H. (1977). On entropy minimization principle. In Application of Statistics, Ed. P. R. Krishnaiah, pp. 27-42. Amsterdam: North Holland.
3. AKAIKE, H. (1978). A Bayesian analysis of the minimum AIC procedure. Ann. Inst. Statist. Math. 30A, 9-14.
4. BESAG, J. E. (1972). Nearest-neighbour systems and the auto-logistic model for binary data. J. R. Statist. Soc. B 34, 75-83.
5. BESAG, J. E. (1974). Spatial interaction and the statistical analysis of lattice systems (with Discussion). J. R. Statist. Soc. B 36, 192-236.
6. BESAG, J. E. (1986). On the statistical analysis of dirty pictures (with Discussion). J. R. Statist. Soc. B 48, 259-302.
7. BLACK, D. M., PALERMO, L., NEVITT, M. C., GENANT, H. K., EPSTEIN, R., SAN VALENTIN, R. & CUMMINS, S. R. (1995). Comparison of methods for defining prevalent vertebral deformities: The study of osteoporotic fractures. J. Bone Miner. Res. 10, 890-902.
8. BLAKE, C. L. & MERZ, C. J. (1998). UCI repository of machine learning databases [http://www.ics.uci.edu/~mlearn/MLRepository.html]. Irvine, CA: University of California, Department of Information and Computer Science.
9. DASARATHY, B. V. (1991). Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques. Los Alamitos, CA: IEEE Computer Society Press.
10. DASARATHY, B. V., SANCHEZ, J. S. & TOWNSEND, S. (2000). Nearest neighbour editing and condensing tools-synergy exploitation. Pat. Anal. Applic. 3, 19-30.
11. DRAPER, N. R. & SMITH H. (1981). Applied Regression Analysis. New York: Wiley.
12. FRIEDMAN, J. H. (1997). On bias, variance, 0/1-loss, and the curse-of-dimensionality. Data Mining Know. Discov. 1, 55-77.
13. GEMAN, D. & GEMAN, S. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE. Trans. Pat. Anal. Mach. Intel. 6, 721-41.
14. HANSEN, M. H. & Yu, B. (2001). Model selection and the principle of minimum description length. J. Am. Statist. Assoc. 96, 746-74.
15. HASTIE, T., TIBSHIRANI, R. & FRIEDMAN, J. (2001). The Elements of Statistical Learning. New York: Springer-Verlag.
16. HOLMES, C. C. & ADAMS, N. M. (2002). A probabilistic nearest-neighbour method for statistical pattern recognition. J. R. Statist. Soc. B 64, 295-306.
17. HOSMER, D. W. & LEMESHOW, S. (2000). Applied Logistic Regression. New York: Wiley.
18. JENSEN, J. L. & KUNSCH, H. R. (1994). On asymptotic normality of pseudo likelihood estimates for pairwise interaction processes. Ann. Appl. Prob. 46, 445-61.
19. LUNT, M., FELSENBERG, D., REEVE, J., BENEVOLENSKAYA, L., CANNATA, J., DEQUEKER, J., DODENHOF, C., FALCH, J. A., MASARYK, P., POLS, H., POOR, G., REID, D., SCHEIDT-NAVE, C., WEBER, K., VARLOW, J., KANIS, J., O'NEILL, T. & SILMAN, A. J. (1997). Bone density variation and its effects on risk of vertebral deformity in men and women studied in 13 European centres: the EVOS study. J. Bone Miner. Res. 12, 1883-94.
20. MASE, S. (1995). Consistency of the maximum pseudo-likelihood estimator of the continuous state-space Gibbsian processes. Ann. Appl. Prob. 5, 603-12.
21. MCCLOSKEY, E., SPECTOR, T. D., EYRES, K. S., FERN, E. D., O'ROURKE, N., WASIKARAN, S. & KANIS, J. A. (1993). The assessment of vertebral deformity: a method for use in population studies and clinical trials. Osteoporosis Int. 3, 138-47.
22. MCCULLAGH, P. & NELDER, J. A. (1989). Generalised Linear Models, 2nd ed. London: Chapman and Hall.
23. MELTON, L. J., LANE, A. W., COOPER, C. EASTELL, R., O'FALLON, W. M. & BIGGS, R. L. (1993). Prevalence and incidence of vertebral deformities. Osteoporosis Int. 3, 113-9.
24. MICHIE, D., SPIEGELHALTER, D. J. & TAYLOR, C. C. (1994). Machine Learning, Neural and Statistical Classification. New York: Ellis Horwood.
25. MINNIE, H. W., LEIDIG, G., WÜSTER, C., SIROMACHKOSTOV, L., BALDAUF, G., BICKEL, R., SAUER, P., LOJEN, M. & ZIEGLER, R. (1988). A newly developed spine deformity index (SDI) to quantitate vertebral crush fractures in patients with Osteoporosis. Bone Miner. 3, 335-49.
26. MITCHELL, T. M. (1997). Machine Learning. New York: McGraw Hill.
27. PREGIBON, D. (1981). Logistic regression diagnostics. Ann. Statist. 9, 705-24.
28. PRESS, W. H., FLANNERY, B. P., TEUKOLSKY, S. A. & VETTERING, W. T. (1990). Numerical Recipes in C. Cambridge University Press.
29. RIPLEY, B. D. (1994). Neural networks and related methods for classification (with Discussion). J. R. Statist. Soc. B 56, 409-56.
30. RIPLEY, B. D. (1996). Pattern Recognition and Neural Networks. Cambridge University Press.
31. SCHWARZ, G. (1978). Estimating the dimension of a model. Ann. Statist. 6, 461-4.
32. STRAUSS, D. J. (1977). Clustering on coloured lattices. J. Appl. Prob. 14, 135-43.
33. VENABLES, W. N. & RIPLEY, B. D. (1999). Modern Applied Statistics with S-PLUS, 1: Data Analysis. New York: Springer Verlag.