Extended k-nearest neighbours based on evidence theory

Computer Journal

Volumn 47, Issue 6, 2004, Pages 662-672

  Wang, Hui ^a   Bell, David ^b  

^a UNIVERSITY OF ULSTER   (United Kingdom)

^b QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; MATHEMATICAL MODELS; OPTIMIZATION; PROBABILITY DENSITY FUNCTION;

BELIEF FUNCTION; CLASS MEMBERSHIP; EVIDENCE THEORY; PIGNISTIC PROBABILITY;

PATTERN RECOGNITION;

EID: 8644282861     PISSN: 00104620     EISSN: None     Source Type: Journal    
DOI: 10.1093/comjnl/47.6.662     Document Type: Article

References (36)

1. Shafer, G. (1976) A Mathematical Theory of Evidence. Princeton University Press, Princeton, NJ.
2. Denoeux, T. and Yaghlane, A. B. (2002) Approximating the combination of belief functions using the fast möbius transform in a coarsened frame. Int. J. Approx. Reason., 31, 77-101.
3. Denoeux, T. (1995) A k-nearest neighbor classification rule based on Dempster-Shafer theory. IEEE Trans. Syst. Man Cybernet., 25, 804-813.
4. Smets, P. (1998) The transferable belief model for quantified belief representation. In Gabbay, D. M. and Smets, P. (eds), Handbook of Defeasible Reasoning and Uncertainty Management Systems, Vol. 1, pp. 267-301. Kluwer, Dordrecht, The Netherlands.
5. Smets, P. and Kennes, R. (1994) The transferable belief model. Artif. Intell., 66, 191-234.
6. Zouhal, L. M. and Denoeux, T. (1998) An evidence-theoretic k-NN rule with parameter optimization. IEEE Trans. Syst. Man Cybernet., 28, 263-271.
7. Wilson, N. (2000) Algorithms for Dempster-Shafer theory. In Gabbay, D. M. and Smets, P. (eds), Handbook of Defeasible Reasoning and Uncertainty Management, pp. 421-475. Kluwer Academic Publishers, Boston, MA.
8. Bauer, M. (1997) Approximation algorithms and decision making in the Dempster-Shafer theory of evidence - an empirical study. Int. J. Approx. Reason., 17, 217-237.
9. Denoeux, T. (2001) Inner and outer approximation of belief structures using a hierarchical clustering approach. Int. J. Uncertain. Fuzz. Knowl.-based Syst., 9, 437-460.
10. Harmanec, D. (1999) Faithful approximations of belief functions. In Laskey, K. B. and Prade, H. (eds), Uncertainty in Artificial Intelligence 15 (UAI99), Stockholm, Sweden, pp. 271-278, Morgan Kaufmann.
11. Lowrance, J. D., Garvey, T. D. and Strat, T. M. (1986) A framework for evidential reasoning systems. In Kehler, T. et al. (eds), Proc. AAAI86, Vol. 2, Philadelphia, August, pp. 896-903. AAAI Press.
12. Tessem, B. (1993) Approximations for efficient computation in the theory of evidence. Artif. Intell., 61, 315-329.
13. Fix, E. and Hodges, J. L. (1951) Discriminatory Analysis, Nonparametric Discrimination: Consistency Properties. Technical Report TR4, USAF School of Aviation Medicine, Randolph Field, TX.
14. Cover, T. M. and Hart, P. E. (1967) Nearest neighbour pattern classification. IEEE Trans. Inform. Theory, IT-13, 21-27.
15. Dudani, S. A. (1976) The distance-weighted k-nearest-neighbor rule. IEEE Trans. Syst. Man Cybernet., 6, 325-327.
16. Baily, T. and Jain, A. K. (1978) A note on distance-weighted k-nearest neighbor rules. IEEE Trans. Syst. Man Cybernet., 8, 311-313.
17. Morin, R. L. and Raeside, D. E. (1981) A reappraisal of distance-weighted k-nearest neighbor classification for pattern recognition with missing data. IEEE Trans. Syst. Man Cybernet., 11, 241-243.
18. Dasarathy, B. V. (ed.) (1991) Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques. IEEE Computer Society Press, Los Alamitos, CA.
19. Bennett, P., Dumais, S. and Horvitz, E. (2002) Probabilistic combination of text classifiers using reliability indicators: models and results. In Proc. 25th Ann. Int. ACM Conf. on Research and Development in Information Retrieval (SIGIR02), Tampere, Finland, pp. 207-214. ACM Press, New York.
20. Bennett, P., Dumais, S. and Horvitz, E. (2003) The Combination of Text Classifiers using Reliability Indicators. Technical Report, Microsoft. To appear in Information Retrieval. http://research.microsoft.com/~horvitz/tclass_combine.htm.
21. Xu, L., Krzyzak, A and Suen, C. (1992) Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Trans. Syst. Man Cybernet., 22, 418-435.
22. Kittler, J., Hatel, J., Duin, R. and Matas, J. (1998) On combining classifiers. IEEE PAMI, 20, 226-239.
23. Kittler, J. and Roli, F. (eds) (2000) MCS2000: Proc. 1st Int. Workshop on Multiple Classifier Systems, LNCS 1857, Springer-Verlag, Berlin, Cagliari, Italy.
24. Kittler, J. and Roli, F. (eds) (2001) MCS2001: Proc. 2nd Int. Workshop on Multiple Classifier Systems, LNCS 2096, Springer-Verlag, Berlin, Cambridge, UK.
25. Larkey, L. S. and Croft, W. B. (1996) Combining classifiers in text categorization. In Frei, H.-P., Harman, D., Schäuble, P. and Wilkinson, R. (eds), Proc. SIGIR-96, 19th ACM Int. Conf. on Research and Development in Information Retrieval, Zürich, CH, pp. 289-297. ACM Press, New York.
26. Hull, D. A., Pedersen, J. O. and Schütze, H. (1996) Method combination for document filtering. In Frei, H.-P., Harman, D., Schauble, P. and Wilkinson, R. (eds), Proc. SIGIR-96, 19th ACM Int. Conf. on Research and Development in Information Retrieval, Zürich, CH, pp. 279-288. ACM Press, New York.
27. Yang, Y., Ault, T. and Pierce, T. (2000) Combining multiple learning strategies for effective cross-validation. In Langley, P. (ed.), Proc. of ICML-00, 17th Int. Conf. on Machine Learning, Stanford, CA, pp. 1167-1182. Morgan Kaufmann Publishers, San Francisco.
28. Li, Y. and Jain, A. (1998) Classification of text documents. Comput. J., 41, 537-546.
29. Lam, W. and Lai, K. (2001) A meta-learning approach for text categorization. In Croft, W. B., Harper, D. J., Kraft, D., H. and Zobel, J. (eds), Proc. SIGIR01, 24th ACM Int. Conf. on Research and Development in Information Retrieval, New Orleans, LA, pp. 303-309. ACM Press, New York.
30. Smets, P. (1990) The combination of evidence in the transferable belief model. IEEE Trans. Pattern Anal. Mach. Intell., 12, 447-458.
31. Macleod, J. E., Luk, A. and Titterington, D. M. (1987) A re-examination of the distance weighted k-nearest neighbor classification rule. IEEE Trans. Syst. Man Cybernet., 17, 689-696.
32. Hand, D., Mannila, H. and Smyth, P. (2001) Principles of Data Mining. The MIT Press.
33. Jain, A. K., Duin, R. P. W. and Mao, J. (2000) Statistical pattern recognition: a review. IEEE Trans. Pattern Anal. Mach. Intell., 22, 4-37.
34. Buxton, B. F., Langdon, W. B. and Barrett, S. J. (2001) Data fusion by intelligent classifier combination. Measurement and Control, 34, 229-234.
35. Piatetsky-Shapiro, G. (2003) Poll: what data mining techniques you use regularly? http://www.kdnuggets.com/news/2003/n22/li.html.
36. Chang, C.-C. and Lin, C.-J. (2004) Libsvm - A Library for Support Vector Machines. Technical Report, National Taiwan University. http://www.csie.ntu.edu.tw/~cjlin/libsvm/index.html.