Probabilistic characterization of nearest neighbor classifier

International Journal of Machine Learning and Cybernetics

Volumn 4, Issue 4, 2013, Pages 259-272

  Dhurandhar, Amit ^a   Dobra, Alin ^b  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b UNIVERSITY OF FLORIDA   (United States)

Author keywords

kNN; Moments

Indexed keywords

CLASSIFICATION ALGORITHM; HAND WRITTEN CHARACTER RECOGNITION; JOINT PROBABILITY DISTRIBUTIONS; K-NEAREST NEIGHBOR CLASSIFICATION; KNN; MOMENTS; MONTE-CARLO APPROXIMATIONS; NEAREST NEIGHBOR CLASSIFIER;

ASYMPTOTIC ANALYSIS; CHARACTER RECOGNITION; DATA MINING; MONTE CARLO METHODS; PROBABILITY DISTRIBUTIONS; TEXT PROCESSING;

LEARNING ALGORITHMS;

EID: 84880439002     PISSN: 18688071     EISSN: 1868808X     Source Type: Journal    
DOI: 10.1007/s13042-012-0091-y     Document Type: Article

References (25)

1. Abello J, Pardalos P, Resende M (eds) (2002) Handbook of massive data sets. Kluwer, Norwell.
2. Blum A, Kalai A, Langford J (1999) Beating the hold-out: bounds for k-fold and progressive cross-validation. In: Computational learing theory.
3. Bremner D, Demaine E, Erickson J, Iacono J, Langerman S, Morin P, Toussaint G (2005) Output-sensitive algorithms for computing nearest-neighbor decision boundaries. Discrete Comput Geom 33: 593-604.
4. Connor-Linton J (2003) Chi square tutorial. http://www. georgetown. edu/faculty/ballc/webtools/web_chi_tut. html.
5. Dhurandhar A, Dobra A (2008) Probabilistic characterization of random decision trees. J Mach Learn Res 9: 2287-2314.
6. Dhurandhar A, Dobra A (2009) Semi-analytical method for analyzing models and model selection measures based on moment analysis. ACM Trans Knowl Discov Data 3: 1-51.
7. Duda R, Hart P, Stork D (2001) Pattern classification, 2 edn. Wiley, New York.
8. Hall M, Holmes G (2003) Benchmarking attribute selection techniques for discrete class data mining. IEEE Trans KDE.
9. Hu Q, Pan W, An S, Ma P, Wei J (2010) An efficient gene selection technique for cancer recognition based on neighborhood mutual information. Int J Mach Learn Cybern 1: 63-74.
10. Kohavi R (1995) A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proceedings of the fourteenth IJCAI.
11. Krause E (1987) Taxicab geometry: an adventure in non-Euclidean geometry. Dover, New York.
12. Liu W, White A (1997) Metrics for nearest neighbour discrimination with categorical attributes. In: Research and development in expert systems XIV: Proceedings of the 17th annual technicial conference of the BCES Specialist Group, pp 51-59.
13. Maggini M, Giles C, Horne B (1997) Financial time series forecasting using k-nearest neighbors classification. In: Nonlinear financial forecasting, pp 169-181.
14. Moore A, Lee M (1994) Efficient algorithms for minimizing cross validation error. In: International conference on machine learning, pp 190-198.
15. Nigsch F, Bender A, Buuren B, Tissen J, Nigsch E, Mitchell J (2006) Melting point prediction employing k-nearest neighbor algorithms and genetic parameter optimization. J Chem Inf Model 46: 2412-2422.
16. Park B, Samworth R (2008) Choice of neighbor order in nearest-neighbor classification. Ann Stat 36: 2135-2152.
17. Qin Y, Zheng D, Zhao T (2012) Research on search results optimization technology with category features integration. Int J Mach Learn Cybern 3: 71-76.
18. Rajagopalan B, Lall U (1999) A k-nearest neighbor simulator for daily precipitation and other weather variables. Water Resour Res 35: 3089-3101.
19. Shao J (2003) Mathematical statistics. Springer, Berlin.
20. Sidorov G, Koeppen M, Cruz-Corts N (2011) Recent advances in machine learning techniques and applications. Int J Mach Learn Cybern 2: 123-124.
21. Sim J, Kim S, Lee J (2005) Prediction of protein solvent accessibility using fuzzy k-nearest neighbor method. Bioinform Comput Appl Biosci 21: 2844-2849.
22. Stanfill C, Waltz D (1986) Toward memory-based reasoning. Commun ACM 29(12): 1213-1228.
23. Stone C (1977) Consistent nonparametric regression. Ann Stat 5(4): 595-645.
24. Vapnik V (1998) Statistical learning theory. Wiley, New York.
25. Yang K, Shahabi C (2007) An efficient k nearest neighbor search for multivariate time series. Inf Comput 205: 65-98.