How to upgrade propositional learners to first order logic: A case study

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2049 LNAI, Issue , 2001, Pages 102-126

  Van Laer, Wim ^a   De Raedt, Luc ^b  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b UNIVERSITY OF FREIBURG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 72949118010     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-44673-7_5     Document Type: Conference Paper

References (73)

1. R. Agrawal, H. Mannila, R. Srikant, H. Toivonen, and A.I. Verkamo. Fast discovery of association rules. In U. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy, editors, Advances in Knowledge Discovery and Data Mining, pages 307-328. The MIT Press, 1996.
2. Rakesh Agrawal, Tomasz Imielinski, and Arun Swami. Mining association rules between sets of items in large databases. In P. Buneman and S. Jajodia, editors, Proceedings of ACM SIGMOD Conference on Management of Data, pages 207-216, Washington, D.C., USA, May 1993. ACM.
3. D. Angluin, M. Frazier, and L. Pitt. Learning conjunctions of Horn clauses. Machine Learning, 9:147-162, 1992.
4. F. Bergadano and D. Gunetti. An interactive system to learn functional logic programs. In Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence, pages 1044-1049. Morgan Kaufmann, 1993.
5. A.L. Berger, V.J. Della Pietra, and S.A. Della Pietra. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39-71, 1996.
6. G. Bisson. Conceptual clustering in a first order logic representation. In Proceedings of the Tenth European Conference on Artificial Intelligence, pages 458-462. John Wiley & Sons, 1992.
7. H. Blockeel. Top-down induction of first order logical decision trees. PhD thesis, Department of Computer Science, Katholieke Universiteit Leuven, 1998. http://www.cs.kuleuven.ac.be/~ml/PS/blockeel98:phd.ps.gz.
8. H. Blockeel and L. De Raedt. Experiments with top-down induction of logical decision trees. Technical Report CW 247, Dept. of Computer Science, K.U. Leuven, January 1997. Also in Periodic Progress Report ESPRIT Project ILP2, January 1997. http://www.cs.kuleuven.ac.be/publicaties/rapporten/CW1997.html.
9. H. Blockeel and L. De Raedt. Top-down induction of first order logical decision trees. Artificial Intelligence, 101(1-2):285-297, June 1998.
10. M. Bongard. Pattern Recognition. Spartan Books, 1970.
11. I. Bratko and S. Muggleton. Applications of inductive logic programming. Communications of the ACM, 38(11):65-70, 1995.
12. L. Breiman, J.H. Friedman, R.A. Olshen, and C.J. Stone. Classification and Regression Trees. Wadsworth, Belmont, 1984.
13. P. Clark and R. Boswell. Rule induction with CN2: Some recent improvements. In Yves Kodratoff, editor, Proceedings of the Fifth European Working Session on Learning, volume 482 of Lecture Notes in Artificial Intelligence, pages 151-163. Springer-Verlag, 1991.
14. P. Clark and T. Niblett. The CN2 algorithm. Machine Learning, 3(4):261-284, 1989.
15. W. Cohen. Fast effective rule induction. In Proceedings of the twelfth International Conference on Machine Learning, pages 115-123. Morgan Kaufmann, 1995.
16. W. Cohen. Learning to classify English text with ILP methods. In Luc De Raedt, editor, Advances in inductive logic programming, pages 124-143. IOS Press, Amsterdam, NL, 1996.
17. W.W. Cohen. Grammatically biased learning: learning logic programs using an explicit antecedent description language. Artificial Intelligence, 68:303-366, 1994.
18. L. De Raedt. Logical settings for concept learning. Artificial Intelligence, 95:187-201, 1997.
19. L. De Raedt. Attribute-value learning versus inductive logic programming: the missing links (extended abstract). In D. Page, editor, Proceedings of the Eighth International Conference on Inductive Logic Programming, volume 1446 of Lecture Notes in Artificial Intelligence, pages 1-8. Springer-Verlag, 1998.
20. L. De Raedt and L. Dehaspe. Clausal discovery. Machine Learning, 26:99-146, 1997.
21. L. De Raedt and S. Džeroski. First order jk-clausal theories are PAC-learnable. Artificial Intelligence, 70:375-392, 1994.
22. L. De Raedt, N. Lavrač, and S. Džeroski. Multiple predicate learning. In Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence, pages 1037-1042. Morgan Kaufmann, 1993.
23. L. De Raedt and W. Van Laer. Inductive constraint logic. In Klaus P. Jantke, Takeshi Shinohara, and Thomas Zeugmann, editors, Proceedings of the Sixth International Workshop on Algorithmic Learning Theory, volume 997 of Lecture Notes in Artificial Intelligence, pages 80-94. Springer-Verlag, 1995.
24. L. Dehaspe. Maximum entropy modeling with clausal constraints. In Proceedings of the Seventh International Workshop on Inductive Logic Programming, volume 1297 of Lecture Notes in Artificial Intelligence, pages 109-124. Springer-Verlag, 1997.
25. L. Dehaspe. Frequent Pattern Discovery in First-Order Logic. PhD thesis, Department of Computer Science, Katholieke Universiteit Leuven, 1998. http://www.cs.kuleuven.ac.be/~ldh/.
26. L. Dehaspe and L. De Raedt. Mining association rules in multiple relations. In Proceedings of the Seventh International Workshop on Inductive Logic Programming, volume 1297 of Lecture Notes in Artificial Intelligence, pages 125-132, Berlin, 1997. Springer-Verlag.
27. B. Dolsak, I. Bratko, and A. Jezernik. Finite element mesh design: An engineering domain for ILP application. In S. Wrobel, editor, Proceedings of the Fourth International Workshop on Inductive Logic Programming, volume 237 of GMD-Studien, Sankt Augustin, Germany, 1994. Gesellschaft für Mathematik und Datenverarbeitung MBH.
28. Pedro Domingos. A process-oriented heuristic for model selection. In Proceedings of the Fifteenth International Conference on Machine Learning, pages 127-135. Morgan Kaufmann, San Francisco, CA, 1998.
29. J. Dougherty, R. Kohavi, and M. Sahami. Supervised and unsupervised discretization of continuous features. In A. Prieditis and S. Russell, editors, Proceedings of the Twelfth International Conference on Machine Learning. Morgan Kaufmann, 1995.
30. 13C NMR spectra with inductive logic programming. Applied Artificial Intelligence, 12(5):363-384, July-August 1998.
31. S. Džeroski and I. Bratko. Applications of inductive logic programming. In L. De Raedt, editor, Advances in inductive logic programming, volume 32 of Frontiers in Artificial Intelligence and Applications, pages 65-81. IOS Press, 1996.
32. S. Džeroski, B. Cestnik, and I. Petrovski. Using the m-estimate in rule induction. Journal of Computing and Information Technology, 1(1):37 - 46, 1993.
33. S. Džeroski, N. Jacobs, M. Molina, and C. Moure. ILP experiments in detecting traffic problems. In Proceedings of the Tenth European Conference on Machine Learning, Lecture Notes in Artificial Intelligence, pages 61-66. Springer-Verlag, August 1998.
34. S. Džeroski, N. Jacobs, M. Molina, C. Moure, S. Muggleton, and W. Van Laer. Detecting traffic problems with ILP. In Proceedings of the Eighth International Conference on Inductive Logic Programming, volume 1446 of Lecture Notes in Artificial Intelligence. Springer-Verlag, 1998.
35. S. Džeroski, H. Blockeel, S. Kramer, B. Kompare, B. Pfahringer, and W. Van Laer. Experiments in predicting biodegradability. In S. Džeroski and P. Flach, editors, Proceedings of the Ninth International Workshop on Inductive Logic Programming, volume 1634 of Lecture Notes in Artificial Intelligence, pages 80-91. Springer-Verlag, 1999.
36. W. Emde and D. Wettschereck. Relational instance-based learning. In L. Saitta, editor, Proceedings of the Thirteenth International Conference on Machine Learning, pages 122-130. Morgan Kaufmann, 1996.
37. U.M. Fayyad and K.B. Irani. Multi-interval discretization of continuous-valued attributes for classification learning. In Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence, pages 1022-1027, San Mateo, CA, 1993. Morgan Kaufmann.
38. P.A. Flach. Strongly typed inductive concept learning. In D. Page, editor, Proceedings of the Eighth International Conference on Inductive Logic Programming, volume 1446, pages 185-194. Springer-Verlag, 1998.
39. J.G. Ganascia and Y. Kodratoff. Improving the generalization step in learning. In R.S Michalski, J.G. Carbonell, and T.M. Mitchell, editors, Machine Learning: an artificial intelligence approach, volume 2, pages 215-241. Morgan Kaufmann, 1986.
40. F. Hayes-Roth and J. McDermott. An interference matching technique for inducing abstractions. Communications of the ACM, 21:401-410, 1978.
41. D. Kazakov, L. Popelinsky, and O. Stepankova. ILP datasets page [http://www.gmd.de/ml-archive/datasets/ilp-res.html], 1996.
42. J-U. Kietz and S. Wrobel. Controlling the complexity of learning in logic through syntactic and task-oriented models. In S. Muggleton, editor, Inductive logic programming, pages 335-359. Academic Press, 1992.
43. R.D. King, M.J.E. Sternberg, A. Srinivasan, and S.H. Muggleton. Relating chemical activity to structure: an examination of ILP successes. New Generation Computing, 13(3-4):411-434, 1995.
44. M. Kirsten and S. Wrobel. Relational distance-based clustering. In Proceedings of the Eighth International Conference on Inductive Logic Programming, Lecture Notes in Artificial Intelligence, pages 261-270. Springer-Verlag, 1998.
45. D. Koller. Probabilistic relational models. In Proceedings of the Ninth International Workshop on Inductive Logic Programming, volume 1634 of Lecture Notes in Artificial Intelligence, pages 3-13. Springer-Verlag, 1999.
46. Stefan Kramer. Structural regression trees. In Proceedings of the Thirteenth National Conference on Artificial Intelligence, pages 812-819, Cambridge/Menlo Park, 1996. AAAI Press/MIT Press.
47. R. Michalski, I. Mozetic, J. Hong, and N. Lavrac. The AQ15 inductive learning system: an overview and experiments. In Proceedings of IMAL 1986, Orsay, 1986. Université de Paris-Sud.
48. R.S. Michalski. A theory and methodology of inductive learning. In R.S Michalski, J.G. Carbonell, and T.M. Mitchell, editors, Machine Learning: an artificial intelligence approach, volume 1. Morgan Kaufmann, 1983.
49. S. Muggleton. Inverse entailment and Progol. New Generation Computing, Special issue on Inductive Logic Programming, 13(3-4):245-286, 1995.
50. S. Muggleton and L. De Raedt. Inductive logic programming: Theory and methods. Journal of Logic Programming, 19,20:629-679, 1994.
51. S. Muggleton and C. Feng. Efficient induction of logic programs. In Proceedings of the First Conference on Algorithmic Learning Theory, pages 368-381. Ohmsma, Tokyo, Japan, 1990.
52. C. Nédellec, H. Adé, F. Bergadano, and B. Tausend. Declarative bias in ILP. In L. De Raedt, editor, Advances in Inductive Logic Programming, volume 32 of Frontiers in Artificial Intelligence and Applications, pages 82-103. IOS Press, 1996.
53. S.-H. Nienhuys-Cheng and R. Wolf. Foundations of inductive logic programming, volume 1228 of Lecture Notes in Computer Science and Lecture Notes in Artificial Intelligence. Springer-Verlag, New York, NY, USA, 1997.
54. G. Plotkin. A note on inductive generalization. In B. Meltzer and D. Michie, editors, Machine Intelligence, volume 5, pages 153-163. Edinburgh University Press, 1970.
55. U. Pompe and I. Kononenko. Probabilistic first-order classification. In Proceedings of the Seventh International Workshop on Inductive Logic Programming. Springer-Verlag, 1997.
56. J. Ross Quinlan. C4.5: Programs for Machine Learning. Morgan Kaufmann series in machine learning. Morgan Kaufmann, 1993.
57. J.R. Quinlan. Induction of decision trees. Machine Learning, 1:81-106, 1986.
58. J.R. Quinlan. Learning logical definitions from relations. Machine Learning, 5:239-266, 1990.
59. J.R. Quinlan. Determinate Literals in Inductive Logic Programming. In Proceedings of the Eighth International Workshop on Machine Learning, pages 442-446. Morgan Kaufmann, 1991.
60. J.R. Quinlan. Learning first-order definitions of functions. Journal of Artificial Intelligence Research, 5:139-161, 1996.
61. C. Reddy and P. Tadepalli. Learning first-order acyclic Horn programs from entailment. In David Page, editor, Proceedings of the Eighth International Conference on Inductive Logic Programming, volume 1446 of LNAI, pages 23-37. Springer, 1998.
62. E.Y. Shapiro. An algorithm that infers theories from facts. In Proceedings of the Seventh International Joint Conference on Artificial Intelligence, pages 446-452. Morgan Kaufmann, 1981.
63. A. Srinivasan, R. D. King, S. H. Muggleton, and M. Sternberg. The predictive toxicology evaluation challenge. In Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence), pages 1-6. Morgan Kaufmann, 1997.
64. A. Srinivasan, R.D. King, and D.W. Bristol. An assessment of ILP-assisted models for toxicology and the PTE-3 experiment. In Proceedings of the Ninth International Workshop on Inductive Logic Programming, volume 1634 of Lecture Notes in Artificial Intelligence, pages 291-302. Springer-Verlag, 1999.
65. A. Srinivasan, S.H. Muggleton, M.J.E. Sternberg, and R.D. King. Theories for mutagenicity: A study in first-order and feature-based induction. Artificial Intelligence, 85(1,2), 1996.
66. H. Toivonen, M. Klemettinen, et al. Pruning and grouping discovered association rules. In Y. Kodratoff, G. Nakhaeizadeh, and G. Taylor, editors, Proceedings of the MLnet Familiarization Workshop on Statistics, Machine Learning and Knowledge Discovery in Databases, pages 47-52, Heraklion, Crete, Greece, 1995.
67. L. Valiant. A theory of the learnable. Communications of the ACM, 27:1134-1142, 1984.
68. Patrick R. J. van der Laag and Shan-Hwei Nienhuys-Cheng. Completeness and properness of refinement operators in inductive logic programming. Journal of Logic Programming, 34(3):201-225, 1998.
69. W. Van Laer, L. De Raedt, and S. Džeroski. On multi-class problems and discretization in inductive logic programming. In Zbigniew W. Ras and Andrzej Skowron, editors, Proceedings of the Tenth International Symposium on Methodologies for Intelligent Systems, volume 1325 of Lecture Notes in Artificial Intelligence, pages 277-286. Springer-Verlag, 1997.
70. W. Van Laer, S. Džeroski, and L. De Raedt. Multi-class problems and discretization in ICL (extended abstract). In Proceedings of the MLnet Familiarization Workshop on Data Mining with Inductive Logic Programming, pages 53-60, 1996.
71. S.A. Vere. Induction of concepts in the predicate calculus. In Proceedings of the Fourth International Joint Conference on Artificial Intelligence, pages 282-287. Morgan Kaufmann, 1975.
72. C. Vrain. Ogust: A system that learns using domain properties expressed as theorems. In Y. Kodratoff and R.S. Michalski, editors, Machine Learning: an artificial intelligence approach, volume 3, pages 360-381. Morgan Kaufmann, 1990.
73. P.H. Winston. Learning structural descriptions from examples. In P.H. Winston, editor, Psychology of Computer Vision. The MIT Press, 1975.