Fusion of domain knowledge with data for structural learning in object oriented domains

Journal of Machine Learning Research

Volumn 4, Issue 3, 2004, Pages 339-368

  Langseth, Helge ^a,b   Nielsen, Thomas D ^a  

^a AALBORG UNIVERSITY   (Denmark)

^b NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

Author keywords

Bayesian networks; Knowledge fusion; Object orientation; Structural learning

Indexed keywords

ALGORITHMS; DATABASE SYSTEMS; INFORMATION ANALYSIS; LEARNING SYSTEMS; MATHEMATICAL MODELS; NEURAL NETWORKS; OBJECT ORIENTED PROGRAMMING;

BAYESIAN NETWORKS (BN); KNOWLEDGE FUSION; OBJECT ORIENTATION; STRUCTURAL LEARNING;

KNOWLEDGE ENGINEERING;

EID: 2342533144     PISSN: 15324435     EISSN: None     Source Type: Journal    
DOI: 10.1162/153244304773633852     Document Type: Article

References (60)

1. Olav Bangsø, Helge Langseth, and Thomas D. Nielsen. Structural learning in object oriented domains. In Proceedings of the Fourteenth International Florida Artificial Intelligence Research Society Conference, pages 340-344. AAAI Press, 2001.
2. Olav Bangsø and Pierre-Henri Wuillemin. Object oriented Bayesian networks. A framework for topdown specification of large Bayesian networks with repetitive structures. Technical report CIT-87.2-00-obphwl, Department of Computer Science, Aalborg University, 2000a.
3. Olav Bangsø and Pierre-Henri Wuillemin. Top-down construction and repetitive structures representation in Bayesian networks. In Proceedings of the Thirteenth International Florida Artificial Intelligence Research Society Conference, pages 282-286. AAAI Press, 2000b.
4. John Binder, Daphne Koller, Stuart Russell, and Keiji Kanazawa. Adaptive probabilistic networks with hidden variables. Machine Learning, 29(2-3):213-244, 1997.
5. Wray L. Buntine. A guide to the literature on learning probabilistic networks from data. IEEE Transactions on Knowledge and Data Engineering, 8:195-210, 1996.
6. Peter Cheeseman and John Stutz. Bayesian classification (AutoClass): Theory and results. In Usama M. Fayyad, Gregory Piatetsky-Shapiro, Padhraic Smyth, and Ramasamy Uthurusamy, editors, Advances in knowledge discovery and data mining, pages 153-180. AAAI/MIT Press, 1996. ISBN 0-262-56097-6.
7. David M. Chichering and David Heckerman. Efficient approximations for the marginal likelihood of Bayesian networks with hidden variables. Machine Learning, 29(2-3):181-212, 1997.
8. Gregory F. Cooper and Edward Herskovits. A Bayesian method for constructing Bayesian belief networks from databases. In Proceedings of the Seventh Conference on Uncertainty in Artificial Intelligence, pages 86-94. Morgan Kaufmann Publishers, 1991.
9. Gregory F. Cooper and Edward Herskovits. A Bayesian method for the induction of probabilistic networks from data. Machine Learning, 9:309-347, 1992.
10. Thomas M. Cover and Joy A. Thomas. Elements of Information Theory. Wiley, New York, 1991. ISBN 0-471-06259-6.
11. Robert G. Cowell, A. Phillip Dawid, Steffen L. Lauritzen, and David J. Spiegelhalter. Probabilistic Networks and Expert Systems. Statistics for Engineering and Information Sciences. Springer Verlag, New York, 1999. ISBN 0-387-98767-3.
12. Sanjoy Dasgupta. The sample complexity of learning fixed-structure Bayesian networks. Machine Learning, 29(2-3):165-180, 1997.
13. Arthur P. Dempster, Nan M. Laird, and Donald B. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39:1-38, 1977.
14. Gal Elidan and Nir Friedman. Learning the dimensionality of hidden variables. In Proceedings of the Seventeenth Conference on Uncertainty of Artificial Intelligence, pages 144-151. Morgan Kaufmann Publishers, 2001.
15. Gal Elidan, Noam Lotner, Nir Friedman, and Daphne Koller. Discovering hidden variables: A structure-based approach. In Advances in Neural Information Processing Systems 13, pages 479-485. MIT Press, 2000.
16. Nir Friedman. The Bayesian structural EM algorithm. In Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, pages 129-138. Morgan Kaufmann Publishers, 1998.
17. Nir Friedman, Dan Geiger, and Moises Goldszmidt. Bayesian network classifiers. Machine Learning, 29(2-3):131-163, 1997a.
18. Nir Friedman, Lise Getoor, Daphne Koller, and Avi Pfeffer. Learning probabilistic relational models. In Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, pages 1300-1309. Morgan Kaufmann Publishers, 1999.
19. Nir Friedman and Moises Goldszmidt. Learning Bayesian networks with local structure. In Proceedings of the Twelfth Conference on Uncertainty in Artificial Intelligence, pages 252-262. Morgan Kaufmann Publishers, 1996.
20. Nir Friedman, Moises Goldszmidt, David Heckerman, and Stuart Russell. Challenge: Where is the impact of Bayesian networks in learning? In Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence. Morgan Kaufmann Publishers, 1997b. URL: http://www.cs.huji.ac.il/labs/compbio/ Repository/.
21. Nir Friedman and Daphne Koller. Being Bayesian about network structure: A Bayesian approach to structure discovery in Bayesian networks. Machine Learning, 50(1-2):99-125, 2003.
22. Nir Friedman, Kevin P. Murphy, and Stuart Russell. Learning the structure of dynamic probabilistic networks. In Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, pages 139-147. Morgan Kaufmann Publishers, 1998.
23. Nir Friedman and Zohar Yakhini. On the sample complexity of learning Bayesian networks. In Proceedings of the Twelfth Conference on Uncertainty in Artificial Intelligence, pages 274-282. Morgan Kaufmann Publishers, 1996.
24. Dan Geiger, David Heckerman, and Christopher Meek. Asymptotic model selection with hidden variables. In Proceedings of the Twelfth Conference on Uncertainty in Artificial Intelligence, pages 283-290. Morgan Kaufmann Publishers, 1996.
25. Lise Getoor, Nir Friedman, Daphne Koller, and Avi Pfeffer. Learning probabilistic relational models. In Saso Dzeroski and Nada Lavrac, editors, Relational Data Mining, pages 307-338. Springer Verlag, Berlin, Germany, 2001. ISBN 3-540-42289-7. See also (Friedman et al., 1999).
26. Peter J. Green. On use of the EM algorithm for penalized likelihood estimation. Journal of the Royal Statistical Society, Series B, 52(3):443-452, 1990.
27. Russell Greiner, Adam J. Grove, and Dale Schuurmans. Learning Bayesian nets that perform well. In Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence, pages 198-207. Morgan Kaufmann Publishers, 1997.
28. David Heckerman. A Bayesian approach to learning causal networks. Technical Report MSR-TR-95-04, Microsoft Research, 1995a.
29. David Heckerman. A tutorial on learning with Bayesian networks. Technical Report MSR-TR-95-06, Microsoft Research, 1995b.
30. David Heckerman, Dan Geiger, and David M. Chickering. Learning Bayesian networks: The combination of knowledge and statistical data. Machine Learning, 20(3): 197-243, 1995.
31. Daniel F. Heitjan and Srabashi Basu. Distinguishing "Missing At Random" and "Missing Completely At Random". The American Statistician, 50(3):207-213, 1996.
32. Finn V. Jensen. An introduction to Bayesian networks. UCL Press, London, UK, 1996. ISBN 1-857-28332-5.
33. Finn V. Jensen. Bayesian Networks and Decision Graphs. Springer Verlag, New York, 2001. ISBN 0-387-95259-4.
34. Uffe Kjærulff. A computational scheme for reasoning in dynamic probabilistic networks. In Proceedings of the Eighth Conference on Uncertainty in Artificial Intelligence, pages 121-129. Morgan Kaufmann Publishers, 1992.
35. Daphne Koller and Avi Pfeffer. Object-oriented Bayesian networks. In Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence, pages 302-313. Morgan Kaufmann Publishers, 1997.
36. Paul J. Krause. Learning probabilistic networks. The Knowledge Engineering Review, 13(4):321-351, 1998.
37. Solomon Kullback and Richard A. Leibler. On information and sufficiency. Annals of Mathematical Statistics, 22:79-86, 1951.
38. Wai Lam and Fahiem Bacchus. Learning Bayesian belief networks: An approach based on the MDL principle. Computational Intelligence, 10(4):269-293, 1994.
39. Helge Langseth and Olav Bangsø. Parameter learning in object oriented Bayesian networks. Annals of Mathematics and Artificial Intelligence, 31(1/4):221-243, 2001.
40. Kathryn B. Laskey and Suzanne M. Mahoney. Network fragments: Representing knowledge for constructing probabilistic models. In Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence, pages 334-341. Morgan Kaufmann Publishers, 1997.
41. Roderick J. A. Little and Donald B. Rubin. Statistical Analysis with Missing Data. John Wiley & Sons, New York, 1987. ISBN: 0-471-80254-9.
42. Suzanne M. Mahoney and Kathryn B. Laskey. Network engineering for complex belief networks. In Proceedings of the Twelfth Conference on Uncertainty in Artificial Intelligence, pages 389-396. Morgan Kaufmann Publishers, 1996.
43. Lars Mathiasen, Andreas Munk-Nielsen, Peter A. Nielsen, and Jan Stage. Object-oriented analysis & design. Marko Publishing ApS, Aalborg, Denmark, 2000. ISBN 8-777-51150-6.
44. James W. Myers, Kathryn B. Laskey, and Tod S. Levitt. Learning Bayesian networks from incomplete data with stochastic search algorithms. In Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, pages 476-485. Morgan Kaufmann Publishers, 1999.
45. Judea Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann Publishers, San Mateo, CA., 1988. ISBN 0-934-61373-7.
46. Avrom J. Pfeffer. Probabilistic Reasoning for Complex Systems. Ph.D. thesis, Stanford University, 2000.
47. Malcolm Pradhan, Gregory Provan, Blackford Middleton, and Max Henrion. Knowledge engineering for large belief networks. In Proceedings of the Tenth Conference on Uncertainty in Artificial Intelligence, pages 484-490. Morgan Kaufmann Publishers, 1994.
48. Brian D. Ripley. Pattern Recognition and Neural Networks. Cambridge University Press, Cambridge, UK, 1996. ISBN 0-521-46086-7.
49. Jorma Rissanen. Stochastic complexity (with discussion). Journal of the Royal Statistical Society, Series B, 49(3):223-239 and 253-265, 1987.
50. Robert W. Robinson. Counting labeled acyclic digraphs. In Frank Harary, editor, New directions in the theory of graphs, pages 239-273. Academic Press, New York, 1973.
51. Gideon Schwarz. Estimating the dimension of a model. Annals of Statistics, 6:461-464, 1978.
52. Bernard W. Silverman. Density Estimation for Statistics and Data Analysis. Monographs on statistics and applied probability. Chapman and Hall, London, UK, 1986. ISBN 0-412-24620-1.
53. Peter Spirtes, Clark Glymour, and Richard Scheines. Causation, Prediction, and Search. Springer Verlag, New York, 1993. ISBN 0-387-97979-4.
54. Harald Steck and Volker Tresp. Bayesian belief networks for data mining. In Proceedings of the 2. Workshop on Data Mining und Data Warehousing als Grundlage moderner entscheidungsunterstützender Systeme, pages 145-154, University of Magdeburg, Germany, 1996. ISBN 3-92975726-5.
55. Benjamin Taskar, Eran Segal, and Daphne Koller. Probabilistic classification and clustering in relational data. In Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence, pages 870-876. Morgan Kaufmann Publishers, 2001.
56. Robert A. van Engelen. Approximating Bayesian belief networks by arc removal. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(8):916-920, 1997.
57. Mike West and Jeff Harrison. Bayesian Forecasting and Dynamic Models. Springer Verlag, New York, 2nd edition, 1997. ISBN 0-387-94725-6.
58. Joe Whittaker. Graphical models in applied multivariate statistics. Wiley, Chichester, 1990. ISBN 0-471-91750-8.
59. Yang Xiang and Finn V. Jensen. Inference in multiply sectioned Bayesian networks with extended Shafer-Shenoy and lazy propagation. In Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, pages 680-687. Morgan Kaufmann Publishers, 1999.
60. Yang Xiang, David Poole, and Michael P. Beddoes. Multiply sectioned Bayesian networks and junction forests for large knowledge-based systems. Computational Intelligence, 9(2): 171-220, 1993.