Accelerating bayesian network parameter learning using hadoop and mapreduce

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2012, Pages 101-108

  Basak, Aniruddha ^a   Brinster, Irina ^a   Ma, Xianheng ^a   Mengshoel, Ole J ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS (BNS); CONDITIONAL PROBABILITY TABLES; DATA SET SIZE; DATA SETS; DIFFERENT SIZES; EXPECTATION-MAXIMIZATION ALGORITHMS; HIDDEN NODES; INCOMPLETE DATA; JUNCTION TREES; MAP-REDUCE; MEMORY RESOURCES; NETWORK PARAMETERS; PARAMETER LEARNING;

ALGORITHMS; COMPUTER SYSTEMS PROGRAMMING; SIGNAL RECONSTRUCTION;

BAYESIAN NETWORKS;

EID: 84866621641     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2351316.2351330     Document Type: Conference Paper

References (14)

1. W. L. Buntine. Operations for Learning with Graphical Models. Journal of Artificial Intelligence Research, 2:159-225, 1994.
2. C. Chu, S. Kim, Y. Lin, Y. Yu, G. Bradski, A. Ng, and K. Olukotun. Map-reduce for machine learning on multicore. Advances in neural information processing systems, NIPS-07, 19:281, 2007.
3. J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. Communications of the ACM, 51(1):107-113, 2008.
4. A. Dempster, N. Laird, and D. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B (Methodological), pages 1-38, 1977.
5. C. Do and S. Batzoglou. What is the expectation maximization algorithm? Nature biotechnology, 26(8):897-899, 2008.
6. D. Gillick, A. Faria, and J. DeNero. Mapreduce: Distributed computing for machine learning. Technical Report, Berkeley, 2006.
7. J. Gonzalez, Y. Low, and C. Guestrin. Residual splash for optimally parallelizing belief propagation. AISTATS-09, 2009.
8. H. Jeon, Y. Xia, and V. Prasanna. Parallel exact inference on a CPU-GPGPU heterogenous system. In Parallel Processing (ICPP), 2010 39th International Conference on, pages 61-70. IEEE, 2010.
9. D. Koller and N. Friedman. Probabilistic graphical models: principles and techniques. The MIT Press, 2009.
10. S. Lauritzen and D. Spiegelhalter. Local computations with probabilities on graphical structures and their application to expert systems. Journal of the Royal Statistical Society. Series B (Methodological), pages 157-224, 1988.
11. V. Namasivayam and V. Prasanna. Scalable parallel implementation of exact inference in Bayesian net- works. In 12th International Conference on Parallel and Distributed Systems, 2006. ICPADS 2006., volume 1. IEEE, 2006.
12. J. Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Mateo, CA, 1988.
13. D. J. Spiegelhalter and S. L. Lauritzen. Sequential up- dating of conditional probabilities on directed graphical structures. Networks, 20:579-605, 1990.
14. L. Zheng, O. Mengshoel, and J. Chong. Belief propagation by message passing in junction trees: Computing each message faster using gpu parallelization. In Proc. of the 27th Conference on Uncertainty in Artificial Intelligence (UAI-11), 2011.