Possibilistic instance-based learning

Artificial Intelligence

Volumn 148, Issue 1-2, 2003, Pages 335-383

  Hüllermeier, Eyke ^a  

^a PHILIPPS UNIVERSITY MARBURG   (Germany)

Author keywords

Fuzzy set theory; Instance based learning; Machine learning; Nearest neighbor classification; Possibility theory; Probability

Indexed keywords

FUZZY SETS; LEARNING SYSTEMS; PROBABILITY;

POSSIBILITY THEORY;

KNOWLEDGE REPRESENTATION;

EID: 0042129877     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0004-3702(03)00019-5     Document Type: Article

References (86)

1. Aha D.W. Incremental, instance-based learning of independent and graded concept descriptions. Proc. 6th Internat. Workshop on Machine Learning, Ithaca, NY. 1989;387-391 Morgan Kaufmann, San Mateo, CA.
2. Aha D.W. Tolerating noisy, irrelevant and novel attributes in instance-based learning algorithms. Internat. J. Man-Machine Stud. 36:1992;267-287.
3. Aha D.W. Lazy Learning. 1997;Kluwer Academic, Dordrecht.
4. Aha D.W., Kibler D., Albert M.K. Instance-based learning algorithms. Machine Learning. 6:(1):1991;37-66.
5. Bailey T., Jain A.K. A note on distance-weighted k-nearest neighbor rules. IEEE Trans. Systems Man Cybernet. 8:(4):1978;311-313.
6. Béreau M., Dubuisson B. A fuzzy extended k-nearest neighbors rule. Fuzzy Sets and Systems. 44:1991;17-32.
7. Bezdek J.C. Pattern Recognition with Fuzzy Objective Function Algorithm. 1981;Plenum Press, New York.
8. Bezdek J.C., Chuah K., Leep D. Generalized k-nearest neighbor rules. Fuzzy Sets and Systems. 18:1986;237-256.
9. Bradley R., Swartz N. Possible Worlds. 1979;Basil Blackwell, Oxford, UK.
10. Brodley C.E. Addressing the selective superiority problem: Automatic algorithm for model class selection. Proc. 10th Machine Learning Conference. 1993;17-24.
11. Chang C.L. Finding prototypes for nearest neighbor classifiers. IEEE Trans. Comput. 23:(11):1974;1179-1184.
12. Chow C.K. On optimum recognition error and reject tradeoff. IEEE Trans. Inform. Theory. 16:1970;41-46.
13. Cohen L.J. An Introduction to the Philosophy of Induction and Probability. 1989;Clarendon Press, Oxford.
14. Cover T.M., Hart P.E. Nearest neighbor pattern classification. IEEE Trans. Inform. Theory. 13:1967;21-27.
15. Dasarathy B.V. Nosing around the neighborhood: A new system structure and classification rule for recognition in partially exposed environments. IEEE Trans. Pattern Analysis and Machine Intelligence. 2:(1):1980;67-71.
16. Dasarathy B.V. Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques. 1991;IEEE Computer Society Press, Los Alamitos, CA.
17. Davies E.R. Training sets and a priori probabilities with the nearest neighbor method of pattern classification. Pattern Recognition Lett. 8:(1):1988;11-13.
18. Lopez de Mantaras R., Armengol E. Machine learning from examples: Inductive and lazy methods. Data Knowledge Engrg. 25:1998;99-123.
19. Denoeux T. A k-nearest neighbor classification rule based on Dempster-Shafer Theory. IEEE Trans. Systems Man Cybernet. 25:(5):1995;804-813.
20. Dixon J.K. Pattern recognition with partly missing data. IEEE Trans. Systems Man Cybernet. 9:(10):1979;617-621.
21. Domingos P. Rule induction and instance-based learning: A unified approach. Mellish C.S. Proc. IJCAI-95, Montreal, Quebec. 1995;1226-1232 Morgan Kaufmann, San Mateo, CA.
22. Domingos P. Unifying instance-based and rule-based induction. Machine Learning. 24:1996;141-168.
23. Dubois D., Esteva F., Garcia P., Godo L., Lopez de Mantaras R., Prade H. Fuzzy set modelling in case-based reasoning. Internat. J. Intelligent Syst. 13:1998;345-373.
24. Dubois D., Hajek P., Prade H. Knowledge driven vs. data driven logics. J. Logic Language Inform. 9:2000;65-89.
25. Dubois D., Hüllermeier E., Prade H. Flexible control of case-based prediction in the framework of possibility theory. Blanzieri E., Portinale L. Advances in Case-Based Reasoning, Proc. EWCBR-2000, 5th European Workshop on Case-Based Reasoning, Trento, Italy. 2000;61-73 Springer, Berlin.
26. Dubois D., Hüllermeier E., Prade H. Formalizing case-based inference using fuzzy rules. Pal S.K., So D.Y., Dillon T. Soft Computing in Case-Based Reasoning. 2000;47-72 Springer, Berlin.
27. Dubois D., Hüllermeier E., Prade H. Fuzzy set-based methods in instance-based reasoning. IEEE Trans. Fuzzy Systems. 10:(3):2002;322-332.
28. Dubois D., Prade H. Fuzzy sets and statistical data. European J. Oper. Res. 25:1986;345-356.
29. Dubois D., Prade H. Possibility Theory. 1988;Plenum Press, New York.
30. Dubois D., Prade H. Possibility theory as a basis for preference propagation in automated reasoning. Proc. 1st IEEE Internat. Conference on Fuzzy Systems (FUZZ-IEEE-92), San Diego, CA. 1992;821-832.
31. Dubois D., Prade H. When upper probabilities are possibility measures. Fuzzy Sets and Systems. 49:1992;65-74.
32. Dubois D., Prade H. What are fuzzy rules and how to use them. Fuzzy Sets and Systems. 84:1996;169-185.
33. Dubois D., Prade H. Possibility theory: Qualitative and quantitative aspects. Gabbay D.M., Smets P. Handbook of Defeasible Reasoning and Uncertainty Management Systems, Vol. 1. 1998;169-226 Kluwer Academic, Dordrecht.
34. Dubois D., Prade H., Smets P. Not impossible vs. guaranteed possible in fusion and revision. Proc. ESCQARU-2001, Toulouse, France. Lecture Notes in Comput. Sci. 2143:2001;522-531 Springer, Berlin.
35. Dubois D., Prade H., Ughetto L. A new perspective on reasoning with fuzzy rules. Pal N.R., Sugeno M. Advances in Soft Computing, Proc. AFSS International Conference on Fuzzy Systems, Calcutta, India. Lecture Notes in Artificial Intelligence. 2275:2002;1-11 Springer, Berlin.
36. Dubuisson B., Masson M. A statistical decision rule with incomplete knowledge about classes. Pattern Recognition. 26:(1):1993;155-165.
37. Dudani S.A. The distance-weighted k-nearest-neighbor rule. IEEE Trans. Systems Man Cybernet. 6:(4):1976;325-327.
38. Fix E., Hodges J.L. Discriminatory analysis: nonparametric discrimination: consistency principles. Dasarathy B.V. Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques. 1991;IEEE Computer Society Press, Los Alamitos, CA. Reprint of original work from 1951.
39. Fix E., Hodges J.L. Discriminatory analysis: Nonparametric discrimination: Small sample performance. Dasarathy B.V. Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques. 1991;IEEE Computer Society Press, Los Alamitos, CA. Reprint of original work from 1952.
40. Friedman J.H., Baskett F., Shustek L.J. An algorithm for finding nearest neighbors. IEEE Trans. Comput. 24:1975;1000-1006.
41. Hart P.E. The condensed nearest neighbor rule. IEEE Trans. Inform. Theory. 14:1968;515-516.
42. Hellman M.E. The nearest neighbor classification rule with a reject option. IEEE Trans. Systems Man Cybernet. 6:1970;179-185.
43. Hüllermeier E. Toward a probabilistic formalization of case-based inference. Dean T. Proc. IJCAI-99, Stockholm, Sweden. 1999;248-253 Morgan Kaufmann, San Mateo, CA.
44. Hüllermeier E. On the representation and combination of evidence in instance-based learning. Proc. ECAI-2002, 15th European Conference on Artificial Intelligence, Lyon, France. 2002;360-364 IOS Press, Amsterdam.
45. Hume D. An Enquiry concerning Human Understanding. 1999;Oxford University Press, New York.
46. Józwik A. A learning scheme for a fuzzy k-NN rule. Pattern Recognition Lett. 1:1983;287-289.
47. Keller J.M., Gray M.R., Givens J.A. A fuzzy k-nearest neighbor algorithm. IEEE Trans. Systems Man Cybernet. 15:(4):1985;580-585.
48. Kibler D., Aha D.W. Instance-based prediction of real-valued attributes. Comput. Intelligence. 5:1989;51-57.
49. Kim B.S., Park S.B. A fast k nearest neighbor finding algorithm based on the ordered partition. IEEE Trans. Pattern Analysis and Machine Intelligence. 8:(6):1985;761-766.
50. Kolodner J.L. Case-based Reasoning. 1993;Morgan Kaufmann, San Mateo, CA.
51. Krishnapuram R., Keller J.M. A possibilistic approach to clustering. IEEE Trans. Fuzzy Systems. 1:(2):1993;98-110.
52. Lewis D.K. Counterfactuals and comparative possibility. J. Philos. Logic. 2:1973.
53. Loftsgaarden D.O., Quesenberry C.P. A nonparametric estimate of a multivariate density function. Ann. Math. Stat. 36:1965;1049-1051.
54. Macleod J., Lik A., Titterington D. A re-examination of the distance-weighted k-nearest neighbor classification rule. IEEE Trans. Systems Man Cybernet. 17:(4):1987;689-696.
55. McKenna E., Smyth B. Competence-guided edition methods for lazy learning. Proc. 14th European Conference on Artificial Intelligence (ECAI-2000), Berlin. 2000;60-64.
56. T.M. Mitchell, The need for biases in learning generalizations, Technical Report TR CBM-TR-117, Rutgers University, New Brunswick, NJ, 1980.
57. Niiniluoto I. Analogy and similarity in scientific reasoning. Helman D.H. Analogical Reasoning. 1988;271-298 Kluwer Academic, Dordrecht.
58. Parthasarathy G., Chatterji B.N. A class of new KNN methods for low sample problems. IEEE Trans. Systems Man Cybernet. 20:(3):1990;715-718.
59. Parzen E. On estimation of a probability density function and mode. Ann. Math. Statist. 33:1962;1065-1076.
60. Patrick E.A., Fischer F.P. A generalized k-nearest neighbor rule. Inform. and Control. 16:(2):1970;128-152.
61. Quinlan J.R. Unknown attribute values in induction. Proc. 6th International Workshop on Machine Learning. 1989;164-168 Morgan Kaufmann, San Mateo, CA.
62. Quinlan R. Combining instance-based and model-based learning. Proc. 10th International Conference of Machine Learning. 1993;236-243 Morgan Kaufmann, San Mateo, CA.
63. Rosenblatt M. Remarks on some nonparametric estimates of a density function. Ann. Math. Statist. 27:1956;832-837.
64. Salzberg S. A nearest hyperrectangle learning method. Machine Learning. 6:1991;251-276.
65. Sanchez E. On possibility qualification in natural languages. Inform. Sci. 15:1978;45-76.
66. Shafer G. A Mathematical Theory of Evidence. 1976;Princeton University Press, Princeton, NJ.
67. Shepard D. A two-dimensional interpolation function for irregularly spaced data. Proc. 23rd National Conference of the ACM. 1968;517-523.
68. Silverman B.W. Density Estimation for Statistics and Data Analysis. 1986;Chapman and Hall, London.
69. Smets P., Kennes R. The transferable belief model. Artificial Intelligence. 66:1994;191-234.
70. Stanfill C., Waltz D. Toward memory-based reasoning. Comm. ACM. 1986;1213-1228.
71. Tan M. Cost-sensitive learning of classification knowledge and its application to robotics. Machine Learning. 13:(7):1993;7-34.
72. Tomek I. A generalization of the k-NN rule. IEEE Trans. Systems Man Cybernet. 6:1976;121-126.
73. Vapnik V.N. Statistical Learning Theory. 1998;Wiley, New York.
74. Wand M.P., Jones M.C. Kernel Smoothing. 1995;Chapman and Hall, London.
75. Weisbrod J. A new approach to fuzzy reasoning. Soft Comput. 2:1998;89-99.
76. Wess S., Althoff K.D., Derwand G. Using k-d trees to improve the retrieval step in case-based reasoning. Wess S., Althoff K.D., Richter M.M. Topics in Case-Based Reasoning. 1994;167-181 Springer, Berlin.
77. Wettschereck D., Aha D.W., Mohri T. A review and empirical comparison of feature weighting methods for a class of lazy learning algorithms. AI Rev. 11:1997;273-314.
78. Wilson D.L. Asymptotic properties of nearest neighbor rules using edited data. IEEE Trans. Systems Man Cybernet. 2:(3):1972;408-421.
79. D.R. Wilson, Advances in instance-based learning algorithms, PhD Thesis, Department of Computer Science, Brigham Young University, Provo, UT, 1997.
80. Wilson D.R., Martinez T.R. Improved heterogeneous distance functions. J. Artificial Intelligence Res. 6:1997;1-34.
81. Yunck T.P. A technique to identify nearest neighbors. IEEE Trans. Systems Man Cybernet. 6:(10):1976;678-683.
82. Zadeh L.A. Fuzzy sets as a basis for a theory of possibility. Fuzzy Sets and Systems. 1:1978;3-28.
83. Zadeh L.A. PRUF: A meaning representation language for natural language. Internat. J. Man-Machine Stud. 10:1978;395-460.
84. Zadeh L.A. Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets and Systems. 90:(2):1997;111-127.
85. Zhang J. Selecting typical instances in instance-based learning. Proc. 9th International Conference on Machine Learning (ICML-92), Aberdeen, Scotland. 1992;470-479.
86. Zhang J., Yim Y., Yang J. Intelligent selection of instances for prediction in lazy learning algorithms. Artificial Intelligence Rev. 11:1997;175-191.