Dense structural expectation maximisation with parallelisation for efficient large-network structural inference

International Journal on Artificial Intelligence Tools

Volumn 22, Issue 3, 2013, Pages

  Fogelberg, Christopher ^a   Palade, Vasile ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Bayesian networks; large networks; parallelisation; SEM; structural inference

Indexed keywords

EXPECTATION-MAXIMISATION; LARGE NETWORKS; PARALLELISATION; SEM ALGORITHMS; STRUCTURAL INFERENCE;

BAYESIAN NETWORKS; ITERATIVE METHODS; SCANNING ELECTRON MICROSCOPY;

ALGORITHMS;

EID: 84879388040     PISSN: 02182130     EISSN: 17936349     Source Type: Journal    
DOI: 10.1142/S0218213013500115     Document Type: Article

References (43)

1. H. Akaike. Information theory and an extension of the maximum likelihood principle. In B. N. Petrov and F. Csaki, editors, 2nd International Symposium on Information Theory, pages 267-281, 1973
2. Y. Cao, P. P.Wang, and A. Tokuta. Reverse engineering of NK boolean network and its extensions-Fuzzy logic network (FLN). New Mathematics and Natural Computation 3(1) (2007) 68-87
3. X. Chen, G. Anantha, and X. Wang. An effective structure learning method for constructing gene networks. Bioinformatics 22(11) (2006) 1367-1374
4. D. M. Chickering. Learning Bayesian networks is NP-Complete. In D. Fisher and H. J. Lenz, editors, Learning from Data: Artificial Intelligence and Statistics V (Springer-Verlag, 1996), pages 121-130
5. D. M. Chickering and T. Paek. Personalizing influence diagrams: Applying online learning strategies to dialogue management. User Model. User-Adapt. Interact. 17(1-2) (2007) 71-91
6. R. D. Dowell and S. R. Eddy. Efficient pairwise RNA structure prediction and alignment using sequence alignment constraints. BMC Bioinformatics 7 (2006) 400
7. M. E. Driscoll and T. S. Gardner. Identification and control of gene networks in living organisms via supervised and unsupervised learning. Journal of Process Control 16(3) (March 2006) 303-311
8. C. Fogelberg. The Structural Inference of Large Regulatory Networks. PhD thesis,Computing Laboratory, Oxford University, September 2010
9. C. Fogelberg and V. Palade. Evaluating clustering algorithms for genetic regulatory network structural inference. In Research and Development in Intelligent Systems XXVI: Proceedings of AI-2009, The Twenty-Ninth SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence (AI2009), volume 29,pages 137-150, Cambridge, UK, December 2009. Springer-Verlag
10. C. Fogelberg and V. Palade. Genetic regulatory networks: A review and a roadmap. In A. Abraham, A.-E. Hassanien, A. Vasilakos, W. Pedrycz, F. Herrera, P. Siarry,A. de Carvalho, and A. P. Engelbrecht, editors, Foundations of Computational Intel-ligence (Springer-Verlag, 2009), Chapter 1:1.
11. C. Fogelberg and V. Palade. Greensim: A network simulator for comprehensively validating and evaluating new machine learning techniques for network structural inference. In IEEE ICTAI2010, volume 2, pages 225-230, Arras, France, October 2010. IEEE Computer Society
12. M. Forster and E. Sober. How to tell when simpler, more unified, or less ad hoc theories will provide more accurate predictions. The British Journal for the Philosophy of Science 45(1) (1994) 1-35
13. N. Friedman. Learning belief networks in the presence of missing values and hidden variables. In D. H. Fisher, editor, ICML (Morgan Kaufmann, 1997), pages 125-133
14. N. Friedman, K. Murphy, and S. Russell. Learning the structure of dynamic probabilistic networks. In Proceedings of the 14th Annual Conference on Uncertainty in Artificial Intelligence (UAI-98), volume 14, pages 139-147, San Francisco, CA, 1998. Morgan Kaufmann
15. A. M. Gholami and K. Fellenberg. Cross-species common regulatory network inference without requirement for prior gene affiliation. Bioinformatics 26(8) (2010) 1082-1090
16. R. N. Gutenkunst, J. J. Waterfall, F. P. Casey, K. S. Brown, C. R. Myers, and J. P. Sethna. Universally sloppy parameter sensitivities in systems biology models. PLoS Compututational Biology 3(10) (October 2007) e189
17. B. Hayete, T. S. Gardner, and J. J. Collins. Size matters: Network inference tackles the genome scale. Molecular Systems Biology 3(77) (February 2007) 1-3.
18. D. Heckerman. A tutorial on learning with Bayesian networks. Technical report, Microsoft Research, Redmond, Washington, 1995
19. Z. Huang, J. Li, H. Su, G. S. Watts, and H. Chen. Large-scale regulatory networkanalysis from microarray data: Modified Bayesian network learning and association rule mining. Decision Support Systems 43(4) (2007) 1207-1225
20. R. Jurgelenaite and P. J. F. Lucas. Exploiting causal independence in large Bayesian networks. Knowledge-Based Systems 18(4-5) (2005) 153-162
21. D. Koller and N. Friedman. Probabilistic Graphical Models: Principles and Techniques (MIT Press, 2009
22. H. L ähdesm äki, I. Shmulevich, and O. Yli-Harja. On learning gene regulatory networks under the Boolean network model. Machine Learning 52(1-2) (2003) 147-167
23. H. Langseth and T. D. Nielsen. Fusion of domain knowledge with data for structural learning in object oriented domains. Journal of Machine Learning Research, 4:339-368, 2003
24. S. Mani, P. Spirtes, and G. Cooper. A theoretical study of Y structures for causal discovery. In Proceedings of the Twenty-Second Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI-06), pages 314-323, Arlington, Virginia,2006. AUAI Press
25. O. J. Mengshoel, S. Poll, and T. Kurtoglu. Developing large-scale Bayesian networks by composition: Fault diagnosis of electrical power systems in aircraft and spacecraft. In Proc. of the IJCAI-09 Workshop on Self-* and Autonomous Systems (SAS): Reasoning and Integration Challenges, 2009
26. S. Natarajan, I. Ong, D. Haight, D. Page, and V. S. Costa. Modeling temporal biomedical data by SRL. In J. Ramon, F. Costa, C. Costa, and J. Kok, editors,ECML08 Workshop on Statistical and Relational Learning in Bioinformatics (StReBio), Antwerp, Belgium, September 2008
27. J. Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Infer-ence (Morgan Kaufmann, September 1988
28. F. Pernkopf and M. Wohlmayr. On discriminative parameter learning of Bayesian network classifiers. In W. L. Buntine, M. Grobelnik, D. Mladenic, and J. Shawe-Taylor, editors, ECML/PKDD (2), volume 5782 of Lecture Notes in Computer Science,pages 221-237. Springer, 2009
29. M. Pritsker, Y.-C. Liu, M. A. Beer, and S. Tavazoie. Whole-genome discovery of transcription factor binding sites by network-level conservation. Genome Research 14(1) (January 2004) 99-108
30. D. Reiss, N. Baliga, and R. Bonneau. Integrated biclustering of heterogeneous genomewide datasets for the inference of global regulatory networks. BMC Bioinformatics 7(1) (2006) 280
31. S. Roy, S. Plis, M. Werner-Washburne, and T. Lane. Scalable learning of large networks. Systems Biology, IET 3(5) (September 2009) 404-413
32. T. Schlitt and A. Brazma. Modelling gene networks at different organisational levels. FEBS Letters 579 (March 2005) 1859-1866
33. T. Schlitt and A. Brazma. Current approaches to gene regulatory network modelling. BMC Bioinformatics 8 Suppl 6 (2007
34. M. M. Sondhi, J. Benesty, and Y. Huang, editors. Springer Handbook of Speech Pro-cessing (Springer-Verlag, January 2010
35. P. Spirtes. Introduction to causal inference. Journal of Machine Learning Research 11 (2010) 1643-1662
36. M. Stetter, G. Deco, and M. Dejori. Large-scale computational modeling of genetic regulatory networks. Artificial Intelligence Review 20(1-2) (October 2003) 75-93
37. J. Tegner, M. K. Yeung, J. Hasty, and J. J. Collins. Reverse engineering gene networks: Integrating genetic perturbations with dynamical modeling. Proceedings of the National Academy of Sciences, USA, 100(10):5944-5949, May 2003
38. J. Yu, V. A. Smith, P. P. Wang, A. J. Hartemink, and E. D. Jarvis. Using Bayesian network inference algorithms to recover molecular genetic regulatory networks. In International Conference on Systems Biology (ICSB02), December 2002
39. J. Yu, V. A. Smith, P. P. Wang, A. J. Hartemink, and E. D. Jarvis. Advances to Bayesian network inference for generating causal networks from observational biological data. Bioinformatics 20(18) (2004) 3594-3603
40. Y. Zhang, Z. Deng, H. Jiang, and P. Jia. Dynamic Bayesian network (DBN) with structure expectation maximization (SEM) for modeling of gene network from time series gene expression data. In H. R. Arabnia and H. Valafar, editors, BIOCOMP (CSREA Press, 2006), pages 41-47
41. A. Zollmann, A. Venugopal, F. J. Och, and J. M. Ponte. A systematic comparison of phrase-based, hierarchical and syntax-augmented statistical MT. In D. Scott and H. Uszkoreit, editors, COLING (2008), pages 1145-1152
42. G. G. Zweig. Speech Recognition with Dynamic Bayesian Networks. PhD thesis, Computer Science, University of California Berkeley, April/May 1998
43. G. G. Zweig. Bayesian network structures and inference techniques for automatic speech recognition. Computer Speech and Language 17 (2003) 173-193