A soft version of predicate invention based on structured sparsity

IJCAI International Joint Conference on Artificial Intelligence

Volumn 2015-January, Issue , 2015, Pages 3918-3924

  Wang, William Yang ^a   Mazaitis, Kathryn ^a   Cohen, William W ^a  

^a Carnegie Mellon University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

LOGICAL THEORIES; STRUCTURE-LEARNING; STRUCTURED SPARSITIES;

PATENTS AND INVENTIONS;

EID: 84949805508     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (34)

1. Reid Andersen, Fan R. K. Chung, and Kevin J. Lang. Local partitioning for directed graphs using pagerank. Internet Mathematics, 5(1):3-22, 2008.
2. Mikhail Belkin, Partha Niyogi, and Vikas Sindhwani. Manifold regularization: A geometric framework for learning from labeled and unlabeled examples. JMLR, 2006.
3. Andrew Carlson, Justin Betteridge, Bryan Kisiel, Burr Settles, Estevam R. Hruschka Jr., and Tom M. Mitchell. Toward an architecture for never-ending language learning. In AAAI, 2010.
4. Bob Carpenter. Lazy sparse stochastic gradient descent for regularized multinomial logistic regression. Alias-i, Inc., Tech. Rep, pages 1-20, 2008.
5. Andrew Cropper and Stephen H Muggleton. Can predicate invention in meta-interpretive learning compensate for incomplete background knowledge? Proc. of ILP, 2014.
6. Kroly Csalogny, Dniel Fogaras, Balzs Rcz, and Tams Sarls. Towards scaling fully personalized PageRank: Algorithms, lower bounds, and experiments. Internet Mathematics, 2(3):333-358, 2005.
7. James Cussens. Parameter estimation in stochastic logic programs. Machine Learning, 44(3):245-271, 2001.
8. John Duchi and Yoram Singer. Efficient online and batch learning using forward backward splitting. Journal of Machine Learning Research, 10:2899-2934, 2009.
9. George Forman. An extensive empirical study of feature selection metrics for text classification. The Journal of machine learning research, 3:1289-1305, 2003.
10. Jerome Friedman, Trevor Hastie, and Robert Tibshirani. A note on the group lasso and a sparse group lasso. arXiv preprint arXiv:1001.0736, 2010.
11. Xavier Glorot and Yoshua Bengio. Understanding the difficulty of training deep feedforward neural networks. In International Conference on Artificial Intelligence and Statistics, pages 249-256, 2010.
12. Geoffrey E Hinton. Learning distributed representations of concepts. In Proceedings of the eighth annual conference of the cognitive science society, pages 1-12. Amherst, MA, 1986.
13. Charles Kemp, Joshua B Tenenbaum, Thomas L Griffiths, Takeshi Yamada, and Naonori Ueda. Learning systems of concepts with an infinite relational model. In AAAI, 2006.
14. Hassan Khosravi, Oliver Schulte, Tong Man, Xiaoyuan Xu, and Bahareh Bina. Structure learning for Markov logic networks with many descriptive attributes. In AAAI, pages 487-493, 2010.
15. Tushar Khot, Sriraam Natarajan, Kristian Kersting, and Jude W. Shavlik. Learning Markov logic networks via functional gradient boosting. In ICDM, 2011.
16. Boonserm Kijsirikul, Masayuki Numao, and Masamichi Shimura. Discrimination-based constructive induction of logic programs. In AAAI, 1992.
17. Stanley Kok and Pedro Domingos. Statistical predicate invention. In Proc. of ICML, 2007.
18. Saskia Le Cessie and JC Van Houwelingen. Ridge estimators in logistic regression. Applied statistics, pages 191-201, 1992.
19. Quinn McNemar. Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika, 12(2):153-157, 1947.
20. Stephen Muggleton and Wray Buntine. Machine invention of first-order predicates by inverting resolution. In Proceedings of the fifth international conference on machine learning, pages 339-352, 1992.
21. Stephen H Muggleton, Dianhuan Lin, Jianzhong Chen, and Alireza Tamaddoni-Nezhad. Metabayes: Bayesian meta-interpretative learning using higher-order stochastic refinement. In Inductive Logic Programming, pages 1-17. Springer, 2014.
22. Stephen Muggleton. Stochastic logic programs. Advances in inductive logic programming, 32:254-264, 1996.
23. Vinod Nair and Geoffrey E Hinton. Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th International Conference on Machine Learning (ICML-10), pages 807-814, 2010.
24. Masaaki Nishino, Akihiro Yamamoto, and Masaaki Nagata. A sparse parameter learning method for probabilistic logic programs. In StarAI, 2014.
25. Bruno A Olshausen and David J Field. Sparse coding with an overcomplete basis set: A strategy employed by v1? Vision research, 37(23):3311-3325, 1997.
26. Larry Page, Sergey Brin, R. Motwani, and T. Winograd. The PageRank citation ranking: Bringing order to the web. In Technical Report, Computer Science department, Stanford University, 1998.
27. Robert Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological), pages 267-288, 1996.
28. Dries Van Daele, Angelika Kimmig, and Luc De Raedt. Pagerank, proppr, and stochastic logic programs. 2014.
29. William Yang Wang, Kathryn Mazaitis, and William W Cohen. Programming with personalized pagerank: a locally groundable first-order probabilistic logic. In Proc. of CIKM, 2013.
30. William Yang Wang, Kathryn Mazaitis, and William W Cohen. Structure learning via parameter learning. Proc. of CIKM, 2014.
31. William Yang Wang, Kathryn Mazaitis, Ni Lao, Tom Mitchell, and William W Cohen. Efficient inference and learning in a large knowledge base: Reasoning with extracted information using a locally groundable first-order probabilistic logic. arXiv:1404.3301, 2014.
32. James Wogulis and Pat Langley. Improving efficiency by learning intermediate concepts. In IJCAI, pages 657-662. Citeseer, 1989.
33. John Wright, Yi Ma, Julien Mairal, Guillermo Sapiro, Thomas S Huang, and Shuicheng Yan. Sparse representation for computer vision and pattern recognition. Proceedings of the IEEE, 98(6):1031-1044, 2010.
34. Ming Yuan and Yi Lin. Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 68(1):49-67, 2006.