Markov logic: An interface layer for artificial intelligence

Synthesis Lectures on Artificial Intelligence and Machine Learning

Volumn 7, Issue , 2009, Pages 1-153

  Domingos, Pedro ^a   Lowd, Daniel ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Belief propagation; First order logic; Graphical models; Inductive logic programming; Machine learning; Markov chain Monte Carlo; Markov logic; Markov networks; Markov random fields; Probabilistic logic; Satisfiability; Statistical relational learning

Indexed keywords

BELIEF PROPAGATION; FIRST-ORDER LOGIC; GRAPHICAL MODELS; INDUCTIVE LOGIC PROGRAMMING; MACHINE LEARNING; MARKOV CHAIN MONTE CARLO; MARKOV LOGIC; MARKOV NETWORKS; MARKOV RANDOM FIELDS; SATISFIABILITY; STATISTICAL RELATIONAL LEARNING;

ARTIFICIAL INTELLIGENCE; BIOINFORMATICS; BIOLOGY; COMBINES; COMPUTATIONAL LINGUISTICS; CONVEX OPTIMIZATION; EDUCATION; GRAPHIC METHODS; HIDDEN MARKOV MODELS; INFERENCE ENGINES; INTERFACES (COMPUTER); LEARNING ALGORITHMS; LINGUISTICS; LOGIC PROGRAMMING; MARKOV PROCESSES; MONTE CARLO METHODS; NATURAL LANGUAGE PROCESSING SYSTEMS; QUERY LANGUAGES; ROBOT LEARNING; SECURITY OF DATA;

PROBABILISTIC LOGICS;

EID: 68049142277     PISSN: 19394608     EISSN: 19394616     Source Type: Book Series    
DOI: 10.2200/S00206ED1V01Y200907AIM007     Document Type: Article

References (156)

1. F. Bacchus. Representing and Reasoning with Probabilistic Knowledge. MIT Press, Cambridge, MA, 1990.
2. F. Bacchus, A. J. Grove, J. Y. Halpern, and D. Koller. From statistical knowledge bases to degrees of belief. Artificial Intelligence, 87:75-143, 1996.DOI: 10.1016/S0004-3702(96)00003-3
3. M. Banko, M. J. Cafarella, S. Soderland, M. Broadhead, and O. Etzioni. Open information extraction from the web. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, pages 2670-2676, Hyderabad, India, 2007. AAAI Press.DOI: 10.1145/1409360.1409378
4. J. O. Berger. Statistical Decision Theory and Bayesian Analysis. Springer, New York, NY, 1985.
5. T. Berners-Lee,J. Hendler, and O. Lassila. The Semantic Web. Scientific American, 284(5):34-43, 2001.
6. J. Besag. Statistical analysis of non-lattice data. The Statistician, 24:179-195, 1975. DOI: 10.2307/2987782
7. J. Besag. On the statistical analysis of dirty pictures. Journal of the Royal Statistical Society, Series B, 48:259-302, 1986. DOI:
8. M. Biba, S. Ferilli, and F. Esposito. Discriminative structure learning of Markov logic networks. In Proceedings of Eighteenth International Conference on Inductive Logic Programming, pages 59-76, Prague, Czech Republic, 2008. Springer. DOI: 10.1007/978-3-540-85928-4-9
9. P. Billingsley. Probability and Measure. John Wiley and Sons, New York, 1995.
10. Boutilier, R. Reiter, and B. Price. Symbolic dynamic programming for first-order MDPs. In Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence, pages 690-697, Seattle, WA, 2001. Morgan Kaufmann.
11. Braz, E. Amir, and D. Roth. Lifted first-order probabilistic inference. In Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence, pages 1319-1325, Edinburgh, UK, 2005. Morgan Kaufmann.
12. R. Braz, E. Amir, and D. Roth. MPE and partial inversion in lifted probabilistic variable elimination. In Proceedings of the Twenty-First National Conference on Artificial Intelligence, pages 1123-1130, Boston, MA, 2006. AAAI Press.
13. F. Bromberg, D. Margaritis, and V. Honavar. Efficient Markov network structure discovery from independence tests. In SIAM International Conference on Data Mining, pages 141-152, Bethesda, MD, 2006.
14. W. Buntine. Operations for learning with graphical models. Journal of Artificial Intelligence Research, 2:159-225,1994.
15. M. Collins. Discriminative training methods for hidden Markov models: Theory andexperiments with perceptron algorithms. In Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing, pages 1-8, Philadelphia, PA, 2002. ACL. DOI: 10.3115/1118693.1118694
16. M. Craven and S. Slattery. Relational learning with statistical predicate invention: Better models for hypertext. MachineLearning, 43(1/2):97-119,2001.DOI: 10.1023/A:1007676901476
17. J. Cussens. Loglinear models for first-order probabilistic reasoning. In Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, pages 126-133, Stockholm, Sweden, 1999. Morgan Kaufmann.
18. J. Cussens. Individuals, relations and structures in probabilistic models. In Proceedings of the IJCAI-2003 Workshop on Learning Statistical Models from Relational Data, pages 32-36, Acapulco, Mexico, 2003. IJCAII.
19. P. Damien, J. Wakefield, and S. Walker. Gibbs sampling for Bayesian non-conjugate and hierarchical models by auxiliary variables. Journal of the Royal Statistical Society, Series B, 61:331-344, 1999. DOI: 10.1111/1467-9868.00179
20. J. Davis and P. Domingos. Deep transfer via second-order Markov logic. In Proceedings of thTwenty-Sixth International Conference on Machine Learning, Montreal, Canada, 2009. ACM Press.
21. J. Davis, I. Ong, J. Struyf, E. Burnside, D. Page, and V. S. Costa. Change of representation for statistical relational learning. In Proceedings of the Twentieth InternationalJoint Conference on Artificial Intelligence, pages 2719-2726, Hyderabad, India, 2007. AAAI Press.
22. L. De Raedt and L. Dehaspe. Clausal discovery. Machine Learning, 26:99-146, 1997. DOI: 10.1023/A:1007361123060
23. L. Dehaspe. Maximum entropy modeling with clausal constraints. In Proceedings of the Seventh International Workshop on Inductive Logic Programming, pages 109-125, Prague, Czech Republic, 1997. Springer.
24. S. Della Pietra, V. Della Pietra, and J. Lafferty. Inducing features of random fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19:380-392, 1997. DOI: 10.1109/34.588021
25. A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39:1-38, 1977. DOI: 10.2307/2984875
26. W. Denham. The detection of patterns in Alyawarra nonverbal behavior. PhD thesis, Department of Anthropology, University of Washington, Seattle, WA, 1973.
27. P. Denis and J. Baldridge. Joint determination of anaphoricity and coreference resolutiusing integer programming. In Proceedings of NAACL HLT2007, pages 236-243, Rochester, New York, 2007. ACL.
28. I. S. Dhillon, S. Mallela, and D. S. Modha. Information-theoretic co-clustering. In Proceedingsof the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining,pages 89-98, Washington, DC, 2003. ACM Press. DOI: 10.1145/956750.956764
29. T. Dietterich and X. Bao. Integrating multiple learning components through Markov logic. In Proceedings of the Twenty-Third National Conference on Artificial Intelligence, pages 622-627, Chicago, IL, 2008. AAAI Press.
30. P. Domingos and M. Pazzani. On the optimality of the simple Bayesian classifier under zero-one loss. Machine Learning, 29:103-130,1997. DOI: 10.1023/A:1007413511361
31. K. Driessens, J. Ramon, and T. Croonenborghs. Transfer learning for reinforcement learning through goal and policy parametrization. In Proceedings of the ICML 2006 Workshop on Structural Knowledge Transfer for Machine Learning, 2006.
32. S. Dzeroski and L. De Raedt. Relational reinforcement learning. In Proceedings of the Fifteenth International Conference on Machine Learning, pages 136-143, Madison, WI, 1998. Morgan Kaufmann. DOI: 10.1023/A:1007694015589
33. S. Dzeroski and N. Lavrac, editors. Relational Data mining. Springer, Berlin, Germany, 2001.
34. C. Fellbaum, editor. WordNet: An Electronic Lexical Database. MIT Press, Cambridge, MA, 1998.
35. R. Fletcher. Practical Methods of Optimization. Wiley-Interscience, New York, NY, second edition, 1987.
36. N. Friedman, L. Getoor, D. Koller, and A. Pfeffer. Learning probabilistic relational models. In Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, pages 1300-1307, Stockholm, Sweden, 1999. Morgan Kaufmann.
37. M. R. Genesereth and N. J. Nilsson. Logical Foundations of Artificial Intelligence. Morgan Kaufmann, San Mateo, CA, 1987.
38. H Georgii. Gibbs Measures and Phase Transitions. Walter de Gruyter, Berlin, 1988.
39. L. Getoor and B. Taskar, editors. Introduction to Statistical Relational Learning. MIT Press, Cambridge, MA, 2007.
40. W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, editors. Markov Chain Monte Carlo in Practice. Chapman and Hall, London, UK, 1996.
41. T. Grenager, D. Klein, and C. D. Manning. Unsupervised learning of field segmentation models for information extraction. In Proceedings of the Forty-Third Annual Meeting on Association for Computational Linguistics, pages 371-378, Ann Arbor, Michigan, 2005. Association for Computational Linguistics. DOI: 10.3115/1219840.1219886
42. A. Haghighi and D. Klein. Unsupervised coreference resolution in a nonparametric Bayesian model. In Proceedings of the 45 th Annual Meeting of the Association for Computational Linguistics, pages 848-855, Prague, Czech Republic, 2007. ACL.
43. J. Halpern. An analysis of first-order logics of probability. Artificial Intelligence, 46:311-350, 1990. DOI: 10.1016/0004-3702(90) 90019-V
44. D. Heckerman, D. M. Chickering, C. Meek, R. Rounthwaite, and C. Kadie. Dependency networks for inference, collaborative filtering, and data visualization. Journal of Machine Learning Research, 1:49-75, 2000. DOI: 10.1162/153244301753344614
45. D. Heckerman, D. Geiger, and D. M. Chickering. Learning Bayesian networks: Thcombination of knowledge and statistical data. Machine Learning, 20:197-243, 1995. DOI: 10.1007/BF00994016
46. D. Heckerman, C. Meek, and D. Koller. Probabilistic entity-relationship models, PRMs, and plate models. In Proceedings of the ICML-2004 Workshop on Statistical Relational Learning and its Connections to Other Fields, pages 55-60, Banff, Canada, 2004. IMLS.
47. G. E. Hinton. Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8):1771-1800, 2002. DOI: 10.1162/089976602760128018
48. R. A. Howard and J. E. Matheson. Influence diagrams. Decision Analysis, 2(3):127-143,2005. DOI: 10.1287/deca.1050.0020
49. G. Hulten and P. Domingos. Mining complex models from arbitrarily large databases in constant time. In Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 525-531, Edmonton, Canada, 2002. ACM Press. DOI: 10.1145/775047.775124
50. T. Huynh and R. Mooney. Discriminative structure and parameter learning for Markov logicnetworks. In Proceedings of the Twenty-Fifth International Conference on Machine Learning, pages 416-423, Helsinki, Finland, 2008. ACM Press. DOI: 10.1145/1390156.1390209
51. A. Jaimovich, O. Meshi, and N. Friedman. Template based inference in symmetric relational Markov random fields. In Proceedings of the Twenty-Third Conference on Uncertainty in Artificial Intelligence, pages 191-199, Vancouver, Canada, 2007. AUAI Press.
52. H. Kautz and B. Selman. Planning as satisfiability. In Proceedings of the Tenth European Conference on Artificial Intelligence, pages 359-363, New York, NY, 1992. Wiley.
53. H. Kautz, B. Selman, and Y. Jiang. A general stochastic approach to solving problems with hard and soft constraints. In D. Gu, J. Du, and P. Pardalos, editors, The Satisfiability Problem: Theory and Applications, pages 573-586. American Mathematical Society, New York, NY, 1997.
54. C. Kemp, J. B. Tenenbaum, T. L. Griffiths, T. Yamada, and N Ueda. Learning systemsof concepts with an infinite relational model. In Proceedings of the Twenty-First National Conference on Artificial Intelligence, pages 381-388, Boston, MA, 2006. AAAI Press.
55. K. Kersting and L. De Raedt. Towards combining inductive logic programming with Bayesian networks. In Proceedings of the Eleventh International Conference on Inductive Logic Programming, pages 118-131, Strasbourg, France, 2001. Springer. DOI: 10.1007/3-540-44797-0
56. D. Klein and C. Manning. Accurate unlexicalized parsing. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pages 423-430, Sapporo, Japan, 2003. ACL. DOI: 10.3115/1075096.1075150
57. S. Kok and P. Domingos. Learning the structure of Markov logic networks. In Proceedings of the Twenty-Second International Conference on Machine Learning, pages 441-448, Bonn, Germany, 2005. ACM Press. DOI: 10.1145/1102351.1102407
58. S. Kok and P. Domingos. Statistical predicate invention. In Proceedings of the Twenty-Fourth International Conference on Machine Learning, pages 433-440, Corvallis, OR, 2007. ACM Press. DOI: 10.1145/1273496.1273551
59. S. Kok and P. Domingos. Extracting semantic networks from text via relational clustering. In Proceedings of the Nineteenth European Conference on Machine Learning, pages 624-639, Antwerp, Belgium, 2008. Springer. DOI: 10.1007/978-3-540-87479-9-59
60. S. Kok, M. Sumner, M. Richardson, P. Singla, H. Poon, D. Lowd, and P. Domin- gos. The Alchemy system for statistical relational AI. Technical report, Department of Computer Science and Engineering, University of Washington, Seattle, WA, 2007.〈http://alchemy.cs.washington.edu〉.
61. D. Koller and N. Friedman. Structured Probabilistic Models: Principles and Techniques.MIT Press, Cambridge, MA, 2009.
62. F. R. Kschischang, B. J. Frey, and H.-A. Loeliger. Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory, 47:498-519,2001. DOI: 10.1109/18.910572
63. N. Kushmerick. Wrapper induction: Efficiency and expressiveness. Artificial Intelligence, 118(1-2):15-68, 2000. DOI: 10.1016/S0004- 3702(99)00100-9
64. J. Laffar and J.-L. Lassez. Constraint logic programming. In Proceedings of the Fourteenth ACM Conference on Principles of Programming Languages, pages 111-119, Munich, Germany, 1987. ACM Press. DOI: 10.1145/41625.41635
65. N. Lavrac and S. Dzeroski. Inductive Logic Programming: Techniques and Applications. Ellis Horwood, Chichester, UK, 1994.
66. S. Lawrence, K. Bollacker, and C. L. Giles. Autonomous citation matching. In Proceedings of the Third International Conference on Autonomous Agents, pages 392-393, New York, 1999. ACM Press. DOI: 10.1145/301136.301255
67. S.-I. Lee, V. Chatalbashev, D. Vickrey, and D. Koller. Learning a meta-level prior for feature relevance from multiple related tasks. In Proceedings of the Twenty-Fourth International Conference on Machine Learning, pages 489-496, Corvallis, OR, 2007. DOI: 10.1145/1273496.1273558
68. P. Liang and M. I. Jordan. An asymptotic analysis of generative, discriminative, and pseudolikelihood estimators. In Proceedings of the Twenty-Fifth International Conference on Machine Learning, pages 584-591, Helsinki, Finland, 2008. ACM Press. DOI: 10.1145/1390156.1390230
69. B. Limketkai, L. Liao, and D. Fox. Relational object maps for mobile robots. In Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence, pages 1471-1476, Edinburgh, UK, 2005. Morgan Kaufmann.
70. M. Lippi and P. Frasconi. Markov logic improves protein /-partners prediction. In Proceedings of the Sixth International Workshop on Mining and Learning with Graphs, Helsinki, Finland, 2008.
71. D. C. Liu and J. Nocedal. On the limited memory BFGS method for large scale optimization. Mathematical Programming, 45(3):503-528,1989. DOI: 10.1007/BF01589116
72. J. W. Lloyd. Foundations of Logic Programming. Springer, Berlin, Germany, 1987.
73. E. Lloyd-Richardson, A. Kazura, C. Stanton, R. Niaura, and G. Papandonatos. Differentiating stages of smoking intensity among adolescents: Stage-specific psychologicaland social influences. Journal of Consulting and Clinical Psychology, 70(4):998-1009, 2002. DOI: 10.1037/0022-006X.70.4.998
74. B. Long, Z. M. Zhang, X. Wu, and P. S. Yu. Spectral clustering for multi-type relational data. In Proceedings of the Twenty-Third International Conference on Machine Learning, pages 85-592, Pittsburgh, PA, 2006. ACM Press. DOI: 10.1145/1143844.1143918
75. D. Lowd and P. Domingos. Efficient weight learning for Markov logic networks. In Proceedings of the Eleventh European Conference on Principles and Practice of Knowledge Discovery in Databases, pages 200-211, Warsaw, Poland, 2007. Springer. OI: 10.1007/978-3-540-74976-9-21
76. D. Lowd and P. Domingos. Recursive random fields. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, pages 950-955, Hyderabad, India, 2007. AAAI Press.
77. X. Luo, A. Ittycheriah, H. Jing, N. Kambhatla, and S. Roukos. A mention-synchronous coreference resolution algorithm based on the Bell tree. In Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics, pages 135-142, Barcelona, Spain, 2004. ACL. DOI: 10.3115/1218955.1218973
78. A. McCallum. Efficiently inducing features of conditional random fields. In Proceedings of the Nineteenth Conference on Uncertainty in Artificial Intelligence, Acapulco, Mexico, 2003. Morgan Kaufmann.
79. A. McCallum, R. Rosenfeld, T. Mitchell, and A. Y. Ng. Improving text classification by shrinkage in a hierarchy of classes. In Proceedings of the Fifteenth International Conference on Machine Learning, pages 359-367, Madison, WI, 1998. Morgan Kaufmann.
80. A. McCallum and B. Wellner. Conditional models of identity uncertainty with application to noun coreference. In Advances in Neural Information Processing Systems 17, pages 905-912, Cambridge, MA, 2005. MIT Press.
81. A.T. McCray. An upper level ontology for the biomedical domain. Comparative and Functional Genomics, 4:80-84, 2003. DOI: 10.1002/cfg.255
82. L. Mihalkova, T. Huynh, and R. J. Mooney. Mapping and revising Markov logic networks for transfer learning. In Proceedings of the Twenty-Second National Conference on Artificial Intelligence, pages 608-614, Vancouver, Canada, 2007. AAAI Press.
83. L. Mihalkova and R. Mooney. Bottom-up learning of Markov logic network structure. In Proceedings of the Twenty-Fourth International Conference on Machine Learning, pages 625-632, Corvallis, OR, 2007. ACM Press. DOI: 10.1145/1273496.1273575
84. B. Milch, B. Marthi, S. Russell, D. Sontag, D. L. Ong, and A. Kolobov. BLOG: Probabilistic models with unknown objects. In Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence, pages 1352-1359, Edinburgh, UK, 2005. Morgan Kaufmann.
85. B. Milch, L. S. Zettlemoyer, K. Kersting, M. Haimes, and L. P. Kaelbling. Lifted probabilistic inference with counting formulas. In Proceedings of the Twenty-Third National Conference on Artificial Intelligence, pages 1062-1068, Chicago, IL, 2008. AAAI Press.
86. M. Meller. A scaled conjugate gradient algorithm for fast supervised learning. Neural Networks, 6:525-533, 1993. DOI: 10.1016/S0893-6080(05) 80056-5
87. S. Muggleton. Stochastic logic programs. In L. De Raedt, editor, Advances in Inductive Logic Programming, pages 254-264. IOS Press, Amsterdam, Netherlands, 1996.
88. S. Muggleton and C. Feng. Efficient induction of logic programs. In S. Muggleton, editor, Inductive Logic Programming, pages 281-298. Morgan Kaufmann, 1992.
89. A. Nath and P. Domingos. A language for relational decision theory. In Proceedings of the International Workshop on Statistical Relational Learning, Leuven, Belgium, 2009.
90. J. Neville and D. Jensen. Collective classification with relational dependency networks. In S. Dzeroski, L. De Raedt, and S. Wrobel, editors, Proceedings of the Second International Workshop on Multi-Relational Data Mining, pages 77-91, Washington, DC, 2003. ACM Press.
91. J. Neville and D.Jensen. Leveraging relational autocorrelation with latent group models. In Proceedings of the Fifth IEEE International Conference on Data Mining, pages 49-55, New Orleans, LA, 2005. IEEE Computer Society Press. DOI: 10.1109/ICDM.2005.89
92. V. Ng. Machine learning for coreference resolution: From local classification to global ranking.In Proceedings of the 43 th Annual Meeting of the Association for Computational Linguistics, pages 157-164, Ann Arbor, MI, 2005. ACL. DOI: 10.3115/1219840.1219860
93. L. Ngo and P. Haddawy. Answering queries from context-sensitive probabilistic knowledge bases. Theoretical Computer Science, 171:147-177, 1997. DOI: 10.1016/S0304-3975(96)00128-4
94. N. Nilsson. Probabilistic logic. Artificial Intelligence, 28:71-87, 1986. DOI: 10.1016/0004-3702(86)90031-7]
95. J. Nocedal and S. Wright. Numerical Optimization. Springer, NewYork, NY, 2006.
96. D. N. Osherson, J. Stern, O. Wilkie, M. Stob., and E. E. Smith. Default probability. Cognitive Science, 15:251-269, 1991. DOI: 10.1016/0364-0213(91)80007-R
97. M. Paskin. Maximum entropy probabilistic logic. Technical Report UCB/CSD-01-1161, Computer Science Division, University of California, Berkeley, CA, 2002
98. H. Pasula, B. Marthi, B. Milch, S. Russell, and I. Shpitser. Identity uncertainty and citation matching. In Advances in Neural Information Processing Systems 14, Cambridge, MA, 2002. MIT Press.
99. J. Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Francisco, CA, 1988.
100. B. Pearlmutter. Fast exact multiplication by the Hessian. Neural Computation, 6(1):147-160, 1994. DOI: 10.1162/neco.1994.6.1.147
101. A. Pfeffer, D. Koller, B. Milch, and K.T.Takusagawa. Spook: A system for probabilistic object-oriented knowledge representation. In Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, pages 541-550, Stockholm, Sweden, 1999. Morgan Kaufmann.
102. J. Pitman. Combinatorial stochastic processes. Technical Report 621, Department of Statistics, University of California at Berkeley, Berkeley, CA, 2002.
103. D. Poole. Probabilistic Horn abduction and Bayesian networks. Artificial Intelligence, 64:81129, 1993. DOI: 10.1016/0004-3702(93)90061- F
104. D. Poole. First-order probabilistic inference. In Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence, pages 985-991, Acapulco, Mexico, 2003. Morgan Kaufmann.
105. H. Poon and P. Domingos. Sound and efficient inference with probabilistic and deterministic dependencies. In Proceedings of the Twenty-First National Conference on Artificial Intelligence, pages 458-463, Boston, MA, 2006. AAAI Press.
106. H. Poon and P. Domingos. Joint inference in information extraction. In Proceedings of the Twenty-Second National Conference on Artificial Intelligence, pages 913-918, Vancouver, Canada, 2007. AAAI Press.
107. H. Poon and P. Domingos. Joint unsupervised coreference resolution with Markov logic. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, pages 650-659, Honolulu, HI, 2008. ACL.
108. H. Poon, P. Domingos, and M. Sumner. A general method for reducing the complexity of relational inference and its application to MCMC. In Proceedings of the Twenty-Third National Conference on Artificial Intelligence, pages 1075-1080, Chicago, IL, 2008. AAAI Press.
109. A. Popescul and L. H. Ungar. Structural logistic regression for link analysis. In S. Džeroski, L. De Raedt, and S. Wrobel, editors, Proceedings of the Second International Workshop on Multi- Relational Data Mining, pages 92-106, Washington, DC, 2003. ACM Press.
110. A. Popescul and L. H. Ungar. Cluster-based concept invention for statistical relational learning. In Proceedings of the Tenth ACM SIGKDD International ConferencKnowledge Discovery and Data Mining, pages 665-664, Seattle, WA, 2004. ACM Press. DOI: 10.1145/1014052.1014137
111. A. Puech and S. Muggleton. A comparison of stochastic logic programs and Bayesian logic programs. In Proceedings of the IJCAI-2003 Workshop on Learning Statistical Models from Relational Data, pages 121-129, Acapulco, Mexico, 2003. IJCAII.
112. M. R. Quillian. Semantic memory. In M. L. Minsky, editor, Semantic Information Processing, pages 216-270. MIT Press, Cambridge, MA, 1968.
113. J. R. Quinlan. Learning logical definitions from relations. Machine Learning, 5:239-266, 1990. DOI: 10.1007/BF00117105
114. B. L. Richards and R.J. Mooney. Learning relations by pathfinding. In Proceedings of the Tenth National Conference on Artificial Intelligence, pages 50-55, San Jose, CA, 1992. AAAI Press.
115. B. L. Richards and R.J. Mooney. Automated refinement of first-order Horn-clause domain theories. Machine Learning, 19(2):95-131, 1995. DOI: 10.1007/BF01007461
116. M. Richardson and P. Domingos. Building large knowledge bases by mass collaboration. In Proceedings of the Second International Conference on Knowledge Capture, pages 129-137, Sanibel Island, FL, 2003. ACM Press. DOI: 10.1145/945645.945665
117. M. Richardson and P. Domingos. Markov logic networks. Machine Learning, 62:107-136, 2006. DOI: 10.1007/s10994-006-5833-1
118. S. Riedel. Improving the accuracy and efficiency of MAP inference for Markov logic. In Proceedings of the Twenty-Fourth Conference on Uncertainty in Artificial Intelligence, pages 468-475, Helsinki, Finland, 2008. AUAI Press.
119. S. Riedel and E. Klein. Genic interaction extraction with semantic and syntactic chains. In Proceedings of the Fourth Workshop on Learning Language in Logic, pages 69-74, Bonn, Germany, 2005. IMLS.
120. S. Riedel and I. Meza-Ruiz. Collective semantic role labelling with Markov logic. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, pages 188-192, Honolulu, HI, 2008. ACL.
121. S. Riezler. Probabilistic Constraint Logic Programming. PhD thesis, University of Tubingen, Tubingen, Germany, 1998.
122. J. A. Robinson. A machine-oriented logic based on the resolution principle. Journal of the ACM, 12:23-41, 1965. DOI: 10.1145/321250.321253
123. D. Roth. On the hardness of approximate reasoning. Artificial Intelligence, 82:273-302,1996. DOI: 10.1016/0004-3702(94)00092-1
124. D. Roy, C. Kemp, V. K. Mansinghka, and J. B.Tenenbaum. Learning annotated hierarchies from relational data. In Advances in Neural Information Processing Systems 19, pages 1210-1217, Cambridge, MA, 2006. MIT Press.
125. D. M. Roy and L. P. Kaelbling. Efficient Bayesian task-level transfer learning. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, pages 2599-2604, Hyderabad, India, 2007. AAAI Press.
126. R. J. Rummel. Dimensionality of nations project: attributes of nations and behavior of nation dyads, 1950 -1965. ICPSR data file. 1999. DOI: 10.3886/ICPSR05409
127. S. Sanner. First-Order Decision-Theoretic Planning in Structured Relational Environments. PhD thesis, University of Toronto, 2008.
128. V. Santos Costa, D. Page, M. Qazi, and J. Cussens. CLP(BN): Constraint logic programming for probabilistic knowledge. In Proceedings of the Nineteenth Conference on Unctainty in Artificial Intelligence, pages 517-524, Acapulco, Mexico, 2003. Morgan Kaufmann. DOI: 10.1007/978-3-540-78652-8
129. T. Sato and Y. Kameya. PRISM: A symbolic-statistical modeling language. In Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence, pages 1330-1335, Nagoya, Japan, 1997. Morgan Kaufmann.
130. S. Schoenmackers, O. Etzioni, and D. S. Weld. Scaling textual inference to the Web. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, pages 79-88, Honolulu, HI, 2008. ACL.
131. F. Sha and F. Pereira. Shallow parsing with conditional random fields. In Proceedings of the 2003 Human Language Technology Conference and North American Chapter of the Association fComputational Linguistics, pages 134-141. Association for Computational Linguistics, 2003. DOI: 10.3115/1073445.1073473
132. J. Shewchuck. An introduction to the conjugate gradient method without the agonizing pain. Technical Report CMU-CS-94-125, School of Computer Science, Carnegie Mellon University, 1994.
133. P. Singla and P. Domingos. Discriminative training of Markov logic networks. In Proceedings of the Twentieth National Conference on Artificial Intelligence, pages 868-873, Pittsburgh, PA, 2005. AAAI Press.
134. P. Singla and P. Domingos. Entity resolution with Markov logic. In Proceedings of the Sixth IEEE International Conference on Data Mining, pages 572-582, Hong Kong, 2006. IEEE Computer Society Press. DOI: 10.1109/ICDM.2006.65
135. P. Singla and P. Domingos. Memory-efficient inference in relational domains. In Proceedings of the Twenty-First National Conference on Artificial Intelligence, pages 488-493, Boston, MA, 2006. AAAI Press.
136. P. Singla and P. Domingos. Markov logic in infinite domains. In Proceedings of the Twenty-Third Conference on Uncertainty in Artificial Intelligence, pages 368-375, Vancouver, Canada, 2007. AUAI Press.
137. P. Singla and P. Domingos. Markov logic in infinite domains. Technical report, Dept. Comp. Sci. &Eng., Univ. Washington, 2007.〈http://alchemy. cs.washington.edu/papers/singla07/tr.pdf〉.
138. P. Singla and P. Domingos. Lifted first-order belief propagation. In Proceedings of the Twenty-Third National Conference on Artificial Intelligence, pages 1094-1099, Chicago, IL, 2008. AAAI Press.
139. P. Singla, H. Kautz, J. Luo, and A. Gallagher. Discovery of social relationships in consumer photo collections using Markov logic. In 2008 CVPR Workshop on Semantic Learning and Applications in Multimedia, Anchorage, Alaska, 2008. DOI: 10.1109/CVPRW.2008.4563047
140. A. Srinivasan. The Aleph manual. Technical report, Computing Laboratory, Oxford University, 2000.
141. B. Taskar, P. Abbeel, and D. Koller. Discriminative probabilistic models for relationaldata. In Proceedings of the Eighteenth Conference on Uncertainty in Artificial Intelligence, pages 485-492, Edmonton, Canada, 2002. Morgan Kaufmann.
142. M. E. Taylor, A. Fern, and K. Driessens, editors. Proceedings of the AAAI-2008 Workshop on Transfer Learning for Complex Tasks. AAAI Press, Chicago, IL, 2008.
143. M. E. Taylor and P. Stone. Cross-domain transfer for reinforcement learning. In Proceedingsof the Twenty-Fourth International Conference on Machine Learning, pages 879-886, Corvallis, OR, 2007. ACM Press. DOI: 10.1145/1273496.1273607
144. L.Torrey, T.Walker, J. Shavlik, and R. Maclin. Relational macros for transfer in reinforcement learning. In Proceedings of the Seventeenth International Conference on Inductive Logic Programming, pages 254-268, Corvallis, OR, 2007. Springer. DOI: 10.1007/978-3-540-78469-2
145. G. G. Towell and J. W. Shavlik. Knowledge-based artificial neural networks. Artificial Intelligence, 70:119-165, 1994. DOI: 10.1016/0004-3702(94)90105-8
146. M. van Otterlo. A survey of reinforcement learning in relational domains. Technical report, University of Twente, 2005.
147. M. Vilain, J. Burger, J. Aberdeen, D. Connolly, and L. Hirschman. A model-theoretic coref- erence scoring scheme. In Proceedings of the 6th conference on message understanding, pages 45-52, Columbia, MD, 1995. ACL. DOI: 10.3115/1072399.1072405
148. J. Wang and P. Domingos. Hybrid Markov logic networks. In Proceedings of the Twenty-Third National Conference on Artificial Intelligence, pages 1106-1111,Chicago,IL,2008. AAAI Press.
149. S. Wasserman and K. Faust. Social Network Analysis: Methods and Applications. Cambridge University Press, Cambridge, UK, 1994.
150. W. Wei, J. Erenrich, and B. Selman. Towards efficient sampling: Exploiting random walk strategies. In Proceedings of the Nineteenth National Conference on Artificial Intelligence, pages 670-676, San Jose, CA, 2004. AAAI Press.
151. M. Wellman, J. S. Breese, and R. P. Goldman. From knowledge bases to decision models. Knowledge Engineering Review, 7:35-53, 1992.
152. B. Wellner, A. McCallum, F. Peng, and M. Hay. An integrated, conditional model of information extraction and coreference with application to citation matching. In Proceedings of the Twentieth Conference on Uncertainty in Artificial Intelligence, pages 593-601, Banff, Canada, 2004. AUAI Press.
153. A. P. Wolfe and D. Jensen. Playing multiple roles: discovering overlapping roles in social networks. In Proceedings of the ICML-2004 Workshopon Statistical Relational Learning and its Connections to Other Fields, pages 49-54, Banff, Canada, 2004. IMLS.
154. F. Wu and D. Weld. Automatically refining the Wikipedia infobox ontology. In Proceedings of the 17th International World Wide Web Conference, pages 635-644, Beijing,China, 2008. ACM Press. DOI: 10.1145/1367497.1367583
155. Z. Xu, V. Tresp, K. Yu, S. Yu, and H.-P. Kriegel. Dirichlet enhanced relational learning. In Proceedings of the Twenty-Second International Conference on Machine Learning, pages 10041011, Bonn, Germany, 2005. ACM Press. DOI: 10.1145/1102351.1102478
156. J. S. Yedidia, W. T. Freeman, and Y. Weiss. Generalized belief propagation. In T. Leen, T. Dietterich, and V. Tresp, editors, Advances in Neural Information Processing Systems 13, pages 689-695. MIT Press, Cambridge, MA, 2001.