Kernels on prolog proof trees: Statistical learning in the ILP setting

Journal of Machine Learning Research

Volumn 7, Issue , 2006, Pages 307-342

  Passerini, Andrea ^a   Frasconi, Paolo ^a   De Raedt, Luc ^b  

^a UNIVERSITY OF FLORENCE   (Italy)

^b UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Inductive logic programming; Kernel methods; Learning from program traces; Prolog

Indexed keywords

CLASSIFICATION (OF INFORMATION); FORMAL LOGIC; KNOWLEDGE REPRESENTATION; LOGIC PROGRAMMING; PROBLEM SOLVING; STATISTICAL METHODS; THEOREM PROVING; TREES (MATHEMATICS);

INDUCTIVE LOGIC PROGRAMMING; KERNEL METHODS; LEARNING FROM PROGRAM TRACES; PROLOG;

LEARNING SYSTEMS;

EID: 33646340423     PISSN: 15337928     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (55)

1. A. W. Biermann and R. Krishnaswamy. Constructing programs from example computations. IEEE Transactions on Software Engineering, 2(3): 141-153, 1976.
2. H. Blockeel and L. De Raedt. Top-down induction of first-order logical decision trees. Artificial Intelligence, 101(1-2):285-297, 1998.
3. H. Blockeel, S. Dzeroski, B. Kompare, S. Kramer, B. Pfahringer, and W. Van Laer. Experiments in predicting biodegradability. Applied Artificial Intelligence, 18(2):157-181, 2004.
4. M. Bongard. Pattern Recognition, Spartan Books, 1970.
5. M. Collins and N. Duffy. New ranking algorithms for parsing and tagging: Kernels over discrete structures, and the voted perceptron. In Proceedings of the Fortieth Annual Meeting on Association for Computational Linguistics, pages 263-270, Philadelphia, PA, USA, 2002.
6. C, Cortes, P. Haffner, and M. Mohri. Rational kernels: Theory and algorithms. Journal of Machine Learning Research, 5:1035-1062, 2004.
7. C. Cortes and V. N. Vapnik. Support vector networks. Machine Learning, 20:1-25, 1995.
8. F. Cucker and S. Smale. On the mathematical foundations of learning. Bulletin (New Series) of the American Mathematical Society, 39(1): 1-49, 2002.
9. C. M. Cumby and D. Roth. Learning with feature description logics. In S. Matwin and C. Sammut, editors, Proceedings of the Twelfth International Conference on Inductive Logic Programming, volume 2583 of LNAI, pages 32-47. Springer-Verlag, 2002.
10. C. M. Cumby and D. Roth. On kernel methods for relational learning. In Proceedings of the Twentieth International Conference on Machine Learning, pages 107-114, Washington, DC, USA, 2003.
11. L. De Raedt, K. Kersting, and S. Torge. Towards learning stochastic logic programs from proofbanks. In Proceedings of the Twentieth National Conference on Artificial Intelligence (AAAI'05), pages 752-757, 2005.
12. P. Frasconi, A. Passerini, S. Muggleton, and H. Lodhi. Declarative kernels. Technical Report RT 2/2004, Dipartimento di Sistemi e Informatica, Università di Firenze, 2004.
13. Y. Freund and R. E. Schapire. Large margin classification using the perceptron algorithm. Machine Learning, 37(3):277-296, 1999.
14. T. Gàrtner. A survey of kernels for structured data. SIGKDD Explorations Newsletter, 5(1):49-58, 2003.
15. T. Gärtner, J. W. Lloyd, and P. A. Flach. Kernels and distances for structured data. Machine Learning, 57(3):205-232, 2004.
16. D. Haussler. Convolution kernels on discrete structures. Technical Report UCSC-CRL-99-10, University of California, Santa Cruz, 1999.
17. T. Horváth, T. Gärtner, and S. Wrobel. Cyclic pattern kernels for predictive graph mining. In Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 158-167. ACM Press, 2004.
18. T. Horvath, S. Wrobel, and U. Bohnebeck. Relational instance-based learning with lists and terms. Machine Learning, 43(1/2):53-80, April 2001.
19. T. Jaakkola and D. Haussler. Exploiting generative models in discriminative classifiers. In Advances in Neural Information Processing Systems 11, pages 487-493, Cambridge, MA, USA, 1999. MIT Press.
20. A. Karalič and I. Bratko. First order regression. Machine Learning, 26(2-3): 147-176, 1997.
21. H. Kashima, K. Tsuda, and A. Inokuchi. Marginalized kernels between labeled graphs. In Proceedings of the Twentieth International Conference on Machine Learning, pages 321-328, Washington, DC, USA, 2003.
22. G. S. Kimeldorf and G. Wahba. A correspondence between Bayesian estimation on stochastic processes and smoothing by splines. The Annals of Mathematical Statistics, 41:495-502, 1970.
23. A. J. Knobbe, A. Siebes, and B. Marseille. Involving aggregate functions in multi-relational search. In Proceedings of the Sixth European Conference on Principles and Practice of Knowledge Discovery in Databases, volume 2431 of LNCS, pages 287-298. Springer-Verlag, 2002.
24. S. Kramer. Structural regression trees. In Proceedings of the Thirteenth National Conference on Artificial Intelligence, pages 812-819, Cambridge/Menlo Park, 1996. AAAI Press/MIT Press.
25. S. Kramer. Relational Learning vs. Propositionalization: Investigations in Inductive Logic Programming and Propositional Machine Learning. PhD thesis, Technischen Universität Wien, Wien, Austria, 1999.
26. S. Kramer, N. Lavrac, and P. Flach. Propositionalization approaches to relational data mining. In Relational Data Mining, pages 262-286. Springer-Verlag, NY, 2000.
27. T. K. Lakshman and U. S. Reddy. Typed prolog: A semantic reconstruction of the mycroft-O'keefe type system. In V Saraswat and K. Ueda, editors, Proceedings of the 1991 International Symposium on Logic Programming, pages 202-220, San Diego, CA, October 1991. MIT Press.
28. C. Leslie, E. Eskin, and W. S. Noble. The spectrum kernel: a string kernel for svm protein classification. In Proceedings of the Seventh Pacific Symposium on Biocomputing, pages 564-575, Lihue, Hawaii, USA, 2002.
29. J. W. Lloyd. Logic for learning: learning comprehensible theories from structured data. Springer-Verlag, 2003.
30. H. Lodhi, C. Saunders, J. Shawe-Taylor, N. Cristianini, and C. Watkins. Text classification using string kernels. Journal of Machine Learning Research, 2:419-444, 2002.
31. P. Mahé, N. Ueda, T. Akutsu, J.-L. Perret, and J.-P. Vert. Extensions of marginalized graph kernels. In R. Greiner and ACM Press D. Schuurmans, editors, Proceedings of the Twenty-first International Conference on Machine Learning, pages 552-559, Banff, Alberta, Canada, 2004.
32. S. Menchetti, F. Costa, and P. Frasconi. Weighted decomposition kernels. In Proceedings of the Twenty-second International Conference on Machine Learning, pages 585-592, New York, NY, USA, 2005. ACM Press.
33. T. M. Mitchell, R. M. Keller, and S. T. Kedar-Cabelli. Explanation based generalization: a unifying view. Machine Learning, 1:47-80, 1986.
34. T. M. Mitchell, P. E. Utgoff, and R. Banerji. Learning by experimentation: Acquiring and refining problem-solving heuristics. In Machine learning: An artificial intelligence approach, volume 1, pages 163-190. Morgan Kaufmann, 1983.
35. S. Muggleton. Inverse entailment and Progol. New Generation Computing, Special issue on Inductive Logic Programming, 13(3-4):245-286, 1995.
36. S. H. Muggleton, H. Lodhi, A. Amini, and M. J. E. Sternberg. Support vector inductive logic programming. In Proceedings of the Eighth International Conference on Discovery Science, volume 3735 of LNAI, pages 163-175, 2005.
37. C. Nédellec, H. Adé, F. Bergadano, and B. Tausend. Declarative bias in ILP. In L. De Raedt, editor, Advances in Inductive Logic Programming, volume 32 of Frontiers in Artificial Intelligence and Applications, pages 82-103. IOS Press, 1996.
38. A. Passerini and P. Frasconi. Kernels on prolog ground terms. In Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence, pages 1626-1627, Edinburgh, Scotland, UK, 2005.
39. C. Perlich and F. Provost. Aggregation-based feature invention and relational concept classes. In Proceedings of the Ninth SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 167-176. ACM Press, 2003.
40. T. Poggio and S. Smale. The mathematics of learning: Dealing with data. Notices of the American Mathematical Society, 50(5):537-544, 2003.
41. J. R. Quinlan. Combining instance-based and model-based learning. In Proceedings of the Tenth International Conference on Machine Learning, pages 236-243, Amherst, Massachusetts, 1993. Morgan Kaufmann.
42. J. Ramon and M. Bruynooghe. A framework for defining distances between first-order logic objects. In D. Page, editor, Proceedings of the Eighth International Conference on Inductive Logic Programming, volume 1446 of LNAI, pages 271-280. Springer-Verlag, 1998.
43. S. Russell and P. Norvig. Artifical Intelligence: A Modern Approach. Prentice-Hall, 2nd edition, 2002.
44. B. Schölkopf and M. K. Warmuth, editors. Kernels and Regularization on Graphs, volume 2777 of LNCS, 2003. Springer.
45. E. Y. Shapiro. Algorithmic program debugging. MIT Press, 1983.
46. J. Shawe-Taylor and N. Cristianini. Kernel Methods for Pattern Analysis. Cambridge University Press, 2004.
47. A. Srinivasan, S. Muggleton, M. J. E. Sternberg, and R. D. King. Theories for mutagenicity: A study in first-order and feature-based induction. Artificial Intelligence, 85(1-2):277-299, 1996.
48. M. Turcotte, S. H. Muggleton, and M. J. E. Sternberg. The effect of relational background knowledge on learning of protein three-dimensional fold signatures. Machine Learning, 43(1,2):81-96, April-May 2001.
49. W. Van de Velde. IDL, or taming the multiplexer. In K. Morik, editor, Proceedings of the Third European Working Session on Machine Learning, pages 211-226. Pitmnann, 1989.
50. F. Van Harmelen and A. Bundy. Explanation based generalization = partial evaluation. Artificial Intelligence, 36:401-412, 1988.
51. V. N. Vapnik. The Nature of Statistical Learning Theory. Springer, New York, 1995.
52. A. C. Varzi. Parts, wholes, and part-whole relations: the prospects of mereotopology. Data and Knowledge Engineering, 20:259-286, 1996.
53. S. V. N. Viswanathan and A. J. Smola. Fast kernels for string and tree matching. In S. Thrun S. Becker and K. Obermayer, editors, Advances in Neural Information Processing Systems 15, pages 569-576. MIT Press, Cambridge, MA, 2003.
54. Y. Wang and I. Witten. Inducing model trees for continuous classes. In Proceedings of the Ninth European Conference on Machine Learning, pages 128-137, Prague, Czech Republic, 1997.
55. J. M. Zelle and R. J. Mooney. Combining FOIL and EBG to speed-up logic programs. In Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence, pages 1106-1111, Chambéry, France, 1993.