Machine learning from examples: Inductive and Lazy methods

Data and Knowledge Engineering

Volumn 25, Issue 1-2, 1998, Pages 99-123

  Lopez De Mantaras, Ramon ^a,b   Armengol, Eva ^a  

^a CSIC   (Spain)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Case based reasoning; Inductive learning; Inductive logic programming; Instance based learning; Lazy learning; Machine learning

Indexed keywords

ARTIFICIAL INTELLIGENCE; FEEDBACK; INTERACTIVE DEVICES; KNOWLEDGE ACQUISITION; LOGIC PROGRAMMING;

LEARNING METHODS;

LEARNING SYSTEMS;

EID: 0032026327     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0169-023X(97)00053-0     Document Type: Article

References (92)

1. A. Aamodt, A knowledge-intensive, integrated approach to problem solving and sustained learning, Ph. Dissertation (University of Trondheim, Norwegian Institute of Technology, Department of Electrical Engineering and Computer Science, 1991).
2. A. Aamodt and E. Plaza, Case-based reasoning: Foundational issues, methodological variations and system approaches, Artificial Intelligence Communications 7 (1994) 39-59.
3. R. Aarts and J. Rousu, Towards CBR for bioprocess planning, in I. Smith, B. Faltings (eds.), Advances in Case-based Reasoning, Third European Workshop on Case-based Reasoning, Lausanne, Switzerland, Lecture Notes in Artificial Intelligence, Vol. 1168 (Springer-Verlag, 1996) pp. 16-27.
4. D.W. Aha, Incremental constructive induction: An Instance-based approach, Proc. 8th Intl. Workshop on Machine Learning (Morgan Kaufmann, San Mateo, CA) (1991) pp. 117-121.
5. D.W. Aha, D. Kibler, M.K. Albert, Instance-based learning algorithms, Machine Learning 6 (1991) 37-66.
6. R. Alterman, An adaptive planner, in Proc. of AAAI-86 (AAAI Press/MIT Press, Cambridge, MA, 1986).
7. E.R. Bareiss, Exemplar-based knowledge acquisition: A unified approach to concept representation, classification and learning (Academic Press, 1989).
8. E.R. Bareiss, B.W. Porter, K.S. Murray, Supporting start-to-finish development of knowledge bases, Machine Learning 4(3/4) (1989) 259-283.
9. B. Bartsch-Spörl, Towards the integration of case-based, schema-based and model-based reasoning for supporting complex design tasks, in M. Veloso, A. Aamodt (eds.), Case-based Reasoning Research and Development, First Intl. Conf., ICCBR-95, Sesimbra, Portugal, Lecture Notes in Artificial Intelligence, Vol. 1010 (Springer-Verlag, 1995) 145-156.
10. F. Bergadano, D. Gunetti, Inductive Logic Programming, From Machine Learning to Software Engineering (Massachusetts Institute of Technology, 1996).
11. F. Bergadano, A. Giordana, L. Saitta, Concept acquisition in noisy environments, IEEE Transactions on Pattern Analysis and Machine Intelligence 10 (1998) 555-578.
12. G. Bisson, Learning in FOL with a similarity measure, Proc. of the AAAI-1992 (1992) pp. 82-87.
13. I. Bratko, S. Muggleton, A. Varsek, Learning qualitative models of dynamic systems, in Proc. 8th Intl. Workshop on Machine Learning (Morgan-Kaufmann, San Mateo, CA, 1991) 385-388.
14. L. Breiman, J.H. Friedman, R.A. Olshen, C.J. Stone, Classification and Regression Trees (Wadsworth, Belmont, CA, 1984).
15. W. Buntine, Generalized subsumption and its applications to induction and redundancy, Artificial Intelligence 36(2) (1988) 149-176.
16. J.G. Carbonell, Derivational analogy: A theory of reconstructive problem solving and expertise acquisition, in R.S. Michalski, J.G. Carbonell, T.M. Mitchell (eds.), Machine Learning: An Artificial Intelligence Approach, Vol. II (Tioga Publishing Company, Palo Alto, CA, 1986) pp. 371-392.
17. B. Cestnik, I. Kononenko, I. Bratko, ASSISTANT 86: A knowledge elicitation tool for sophisticated users, in I. Bratko, N. Lavrac (eds.), Progress in Machine Learning (Sigma Press, Wilmslow, 1987) pp. 31-45.
18. P. Clark, T. Niblett, The CN2 induction algorithm, Machine Learning 3 (1989) 261-284.
19. W. Cohen, Gramatically biased learning: Learning logic programs using an explicit antecedent description language, Artificial Intelligence (1994) pp. 301-366.
20. B.V. Dasarathy, Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques (IEEE Computer Society Press, Los Alamitos, CA, 1991).
21. L. De Raedt, Interactive Theory Revision: An Inductive Logic Programming Approach (Academic Press, 1992).
22. L. De Raedt, M. Bruynooghe, A theory of clausal discovery, Proc. 13th Intl. Joint Conf. on Artificial Intelligence (Morgan Kaufmann, 1993) 1058-1063.
23. B. Dolsak, S. Muggleton, The application of inductive logic programming to finite element mesh design, in S. Muggleton (ed.), Inductive Logic Programming (Academic Press, London, 1992) 453-472.
24. W. Emde, D. Wettschereck, Relational instance-based learning, in Lorenza Saitta (ed.), Intl. Conf. on Machine Learning, Bari, Italy (1996) pp. 122-130.
25. P. Flach, Logical approaches to machine learning: An overview, THINK 1(2) (1992) 25-36.
26. J.H. Friedman, R. Kohavi, Y. Yun, Lazy decision trees, Proc. AAAI-96 (1996) 717-724.
27. A. Goel, A model-based approach to case adaptation, in Proc. 8th Intl. Machine Learning Workshop (Morgan Kaufmann, 1991).
28. A. Goel, B. Chandrasekaran, Use of device models in adaptation of design cases, in K.J. Hammond (ed.), Proc. 2nd Workshop on Case-Based Reasoning, Pensacola Beach, FL (Morgan Kaufmann, 1989).
29. M. Goodman, CBR in battle planning, in Proc. Workshop on Case-based Reasoning (DARPA), Pensacola Beach, FL (Morgan Kaufmann, 1989).
30. M. Grobelnik, Markus: An optimized model inference system, Proc. ECAI Workshop on Logical Approaches to Machine Learning (1992).
31. K.Z. Haigh, M. Veloso, Route planning by analogy, in M. Veloso, A. Aamodt (eds.), Case-based Reasoning Research and Development, 1st Intl. Conf., ICCBR-95, Sesimbra, Portugal, Lecture Notes in Artificial Intelligence, Vol. 1010 (Springer Verlag, 1995) pp. 169-180.
32. K.J. Hammond, Case-based planning, Viewing planning as a memory task, Perspectives in Artificial Intelligence, Vol. 1 (Academic Press, 1989).
33. T. Hinrichs, J. Kolodner, The roles of adaptation in case-based design, in Proc. AAAI-91 (AAAI Press/MIT Press, Cambridge, MA, 1991) pp. 28-33.
34. N. Hurtley, Evaluating the application of CBR in mesh design for simulation problems, in M. Veloso, A. Aamodt (eds.), Case-based Reasoning Reasearch and Development, 1st Intl. Conf., ICCBR-95, Sesimbra, Portugal, Lecture Notes in Artificial Intelligence, Vol. 1010 (Springer-Verlag, 1995) pp. 193-204.
35. P. Idestam-Almquist, Generalization under implication using or-introduction, in Proc. 6th European Conf. on Machine Learning, Vol. 667, Lecture Notes in Artificial Intelligence (1993) pp. 56-64.
36. D. Kibler, D.W. Aha, Learning representative exemplars of concepts: An initial case study, Proc. 4th Intl. Workshop on Machine Learning (University of California, Irvine, 1987) pp. 24-30.
37. J.U. Kietz, S. Wrobel, Controlling the complexity of learning in logic through syntactic and task-oriented models, in S. Muggleton (ed.), Inductive Logic Programming (Academic Press, 1992) pp. 335-359.
38. M. Kirschenbaum, L. Sterling, Refinement strategies for inductive learning of simple prolog programs, in Proc. 12th Intl. Joint Conf. on Artificial Intelligence (Morgan-Kaufmann, Darling Harbour, Sidney, Australia, 1991) pp. 757-761.
39. J. Kolodner, Maintaining organization in a dynamic long-term memory, Cognitive Science 7 (1983) 243-280.
40. J.L. Kolodner, Proc. Workshop on Case-based Reasoning (DARPA), Clearwater, FL (Morgan Kaufmann, San Mateo, CA, 1988).
41. J.L. Kolodner, Case-Based Reasoning (Morgan Kaufman, 1993).
42. P. Koton, Reasoning about evidence in causal explanation, in Proc. of AAAI-88 (AAAI Press/MIT Press, Cambridge, MA, 1988) pp. 256-261.
43. I. Kononenko, On biases in estimating multi-valued attributes, in Proc. Intl. Joint Conf. on Artificial Intelligence, Montreal, Canada, 1995) pp. 1031-1040.
44. S. Lapointe, S. Matwin, Sub-unif cation: A tool for efficient induction of recursive programs, in Proc. 9th Intl. Workshop on Machine Learning (Morgan Kaufmann, 1992) pp. 273-281.
45. N. Lavrac, S. Dzeroski, Inductive Logic Programming Ellis Horwood Series in Artificial Intelligence (Ellis Horwood, 1994).
46. N. Lavrac, S. Dzeroski, M. Grobelnik, Learning non-recursive definitions of relations with LINUS, in Yves Kodratoff (ed.), Proc. 5th European Working Session on Learning, Vol. 482, Lecture Notes in Artificial Intelligence (Springer-Verlag, 1991) pp. 265-281.
47. D.B. Leake, Evaluating Explanations: A Content Theory (Erlbaum, Northvale, NJ, 1992).
48. M. Lenz, H.D. Burkhard, S. Brückner, Applying case retrieval nets to diagnostic tasks in technical domains, in I. Smith, B. Faltings (eds.), Advances in Case-based Reasoning, 3rd European Workshop on Case-based Reasoning, Lausanne, Switzerland, Lecture Notes in Artificial Intelligence, Vol. 1168 (Springer Verlag, 1996) pp. 219-233.
49. C. Ling, Inventing necessary theoretical terms in scientific discovery and inductive logic programming, Technical Report 302 (Dept. of Computer Science, University of Western Ontario, 1991).
50. J. Lloyd, in J. Lloyd (ed.), Computational Logic (Springer-Verlag, Berlin, 1990).
51. R. Lopez de Mantaras, A distance-based attribute selection measure for decision tree induction, Machine Learning 6 (1991) 81-92.
52. R.S. Michalski, A theory and methodology of inductive learning, in R.S. Michalski, J.G. Carbonell, T.M. Mitchell (eds.), Machine Learning: An Artificial Intelligence Approach, Vol. I (Tioga Publishing Company, Palo Alto, CA, 1983) pp. 83-134.
53. R.S. Michalski, J.B. Larson, Selection of most representative training examples and incremental generation of VL1 hypotheses: The underlying methodology and the description of programs ESEL and AQ11, Report No. 867 (Dept. of Computer Science, University of Illinois, Urbana, 1978).
54. R.S. Michalski, I. Mozetic, J. Hong, N. Lavrac, The Multi-purpose incremental learning system AQ15 and its testing application on three medical domains, in Proc. 5th National Conf. on Artificial Intelligence (Morgan Kauffman, San Mateo, CA, 1986).
55. T.M. Mitchell, Generalization as search, Artificial Intelligence 18(2) (1982) 203-226.
56. T.M. Mitchell, The need for biases in learning generalizations, in Readings in Machine Learning (Morgan Kaufmann, 1991) pp. 184-191.
57. K. Morik, Balanced cooperative modelling, Proc. 1st Intl. Workshop on Multistrategy Learning (George Mason University, Fairfax, VA, 1991) pp. 65-80.
58. S. Muggleton, Duce, An oracle based approach to constructive induction, Proc. 10th Intl. Joint Conf. on Artificial Intelligence (Morgan-Kaufmann, 1987) pp. 287-292.
59. S. Muggleton, W. Buntine, Machine invention of first-order predicates by inverting resolution, in Proc. 5th Intl. Conf. on Machine Learning (Morgan-Kaufmann, 1988) pp. 339-352.
60. S. Muggleton, C. Feng, Efficient induction of logic programs, in Proc. 1st Conf. on Algorithmic Learning Theory, Ohmsha, Tokyo (1990).
61. S. Muggleton, R. King, M. Sternberg, Protein secondary structure prediction using logic-based machine learning, Protein Engineering 5(7) (1992) 647-657.
62. S. Muggleton, L. DeRaedt, Inductive logic programming: Theory and methods, Journal of Logic Programming (19-20) (1994) 629-679.
63. H. Muñoz-Avila, J. Hüllen, Feature weighting by explaining case-based planning episodes, in I. Smith, B. Faltings (eds.), Advances in Case-based Reasoning, Third European Workshop on Case-based Reasoning, Lausanne, Switzerland, Lecture Notes in Artificial Intelligence, Vol. 1168 (Springer-Verlag, 1996) pp. 280-294.
64. D. Navichandra, Case-based reasoning in CYCLOPS, A design problem solver, in Proc. Workshop on Case-based Reasoning (DARPA), Clearwater, FL (Morgan Kaufmann, San Mateo, CA, 1988) pp. 286-301.
65. C. Nédellec, C. Rouveirol, H. Adé, F. Bergadano, B. Tausend, Declarative bias in inductive logic programming, in L. De Ruedt (ed.), Advances in Inductive Logic Programming (IOS Press, 1996) pp. 82-103.
66. B.D. Netten, R.A. Vingerhoeds, Large-scale fault diagnosis for on-board train systems, in M. Veloso, A. Aamodt (eds.), Case-based Reasoning Research and Development, First Intl. Conf., ICCBR-95, Sesimbra, Portugal, Lecture Notes in Artificial Intelligence, Vol. 1010 (Springer-Verlag, 1995) pp. 67-76.
67. G. Pagallo, D. Haussler, Two algorithms that learn DNF by discovering relevant features, Proc. 6th Intl. Workshop on Machine Learning (Ithaca, NY, 1989) pp. 119-123.
68. M. Pazzani, D. Kibler, The utility of knowledge in inductive learning, Machine Learning 9 (1992) 57-94.
69. G. Plotkin, A note on inductive generalization, in B. Meltzer, D. Michie (eds.), Machine Intelligence 5 (1969) 153-163 (Edinburgh University Press, Edinburgh).
70. L. Portinale, P. Torasso, ADAPTER: An integrated diagnostic system combining case-based and abductive reasoning, in M. Veloso, A. Aamodt (eds.), Case-based Reasoning Research and Development, 1st Intl. Conf., ICCBR-95, Sesimbra, Portugal, Lecture Notes in Artificial Intelligence, Vol. 1010 (Springer-Verlag, 1995) pp. 277-288.
71. J.R. Quinlan, Induction of decision trees, Machine Learning 1 (1986) 81-106.
72. J.R. Quinlan, Learning logical definitions from relations, Machine Learning 5 (1990) 239-266.
73. H. Ragavan, L. Rendell, Lookahead feature construction for learning hard concepts, Proc. 10th Intl. Conf. on Machine Learning (University of Massachusetts, Amherst, 1994) pp. 252-259.
74. C. Rouveirol, Extensions of inversion of resolution applied to theory completion, in S. Muggleton (ed.), Inductive Logic Programming (Academic Press, London, 1992) pp. 63-92.
75. C. Sammut, R.B. Banerji, Learning concepts by asking questions, in R. Michalski, J. Carbonell, T. Mitchell (eds.), Machine Learning: An Artificial Intelligence Approach, Vol. 2 (Kaufmann, Los Altos, CA, 1986) pp. 167-192.
76. M. Schmidt-Schauss, Implication of clauses is undecidable, Theoretical Computer Science 59 (1988) 287-296.
77. R. Schank, Dynamic Memory: A Theory of Learning in Computers and People (Cambridge Univ. Press, New York, 1982).
78. R. Schank, R. Abelson, Scripts, Goals and Understanding (Erlbaum, Northvale, NJ, 1977).
79. E.Y. Shapiro, Algorithmic Program Debugging (MIT Press, 1983).
80. R.L. Simpson, A computer model of case-based reasoning in problem Solving: An investigation in the domain of dispute mediation, Technical Report GIT-ICS-85118 (Georgia Institute of Technology, 1985).
81. E.E. Smith, D.L. Medin, Categories and Concepts (Harvard University Press, Cambridge, MA, 1981).
82. B. Smyth, M.T. Keane, Experiments on adaptation-guided retrieval in case-based design, in M. Veloso, A. Aamodt (eds.), Case-based Reasoning Research and Development, First Intl. Conf., ICCBR-95, Sesimbra, Portugal, Lecture Notes in Artificial Intelligence, Vol. 1010 (Springer-Verlag, 1995) pp. 313-324.
83. J. Surma, B. Braunschweig, REPRO: Supporting flowsheet design by case-based retrieval, in I. Smith, B. Faltings (eds.), Advances in Case-based Reasoning, 3rd European Workshop on Case-based Reasoning, Lausanne, Switzerland, Lecture Notes in Artificial Intelligence, Vol. 1168 (Springer-Verlag, 1996) pp. 400-412.
84. K. Sycara, Using case-based reasoning for plan adaptation and repair, in Proc. Workshop on Case-based Reasoning (DARPA), Clearwater, FL (Morgan Kaufmann, San Mateo, CA, 1988).
85. P.E. Utgoff, Machine Learning of Inductive Bias (Kluwer Academic Publishers, 1986).
86. P.E. Utgoff, T.N. Mitchell, Acquisition of appropriate bias for inductive concept learning, in Proc. National Conf. on Artificial Intelligence (Morgan Kaufmann, Los Altos, CA, 1982) pp. 414-417.
87. V.N. Vapnik, YA. Chervonenkis, Necessary and sufficient conditions for the uniform convergence of means to their expectations, Theory of Probability and its Applications 26 (1981) 532-553.
88. D. Wettschereck, D.W. Aha, T. Mohri, A review and empirical evaluation of feature weighting methods for a class of lazy learning algorithms, AI-Review 11(1-5) (1997) 273-314, Special Issue on Lazy Learning.
89. J. Wnek, R.S. Michalski, Hypothesis-driven constructive induction in AQ17: A method and experiments, in Proc. Intl. Joint Conf. on Artificial Intelligence (Sydney, Australia, 1991).
90. S. Wrobel, Automatic representetion adjustment in an observational discovery system, in Proc. 3rd European Working Session on Learning (Pitman, 1988) pp. 253-262.
91. S. Wrobel, First order theory refinement, in L. De Raedt (ed.), Advances in Inductive Logic Programming (IOS Press, 1996) pp. 14-33.
92. Z. Zdrahal, E. Motta, Case-based problem solving methods for parametric design tasks, in I. Smith and B. Faltings (eds.), Advances in Case-based Reasoning, 3rd European Workshop on Case-based Reasoning, Lausanne, Switzerland, Lecture Notes in Artificial Intelligence, Vol. 1168 (Springer Verlag, 1996) pp. 473-486.