Measure transformer semantics for Bayesian machine learning

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6602 LNCS, Issue , 2011, Pages 77-96

  Borgström, Johannes ^a   Gordon, Andrew D ^a   Greenberg, Michael ^b   Margetson, James ^a   Van Gael, Jurgen ^a  

^a MICROSOFT RESEARCH   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATE INFERENCE; BAYESIAN; BAYESIAN APPROACHES; BAYESIAN MODEL; COMBINATORS; CORE CALCULUS; FACTOR GRAPHS; FUNCTIONAL CALCULUS; IMPERATIVE LANGUAGES; INFERENCE ALGORITHM; MACHINE-LEARNING; MARGINAL DISTRIBUTION; MEASURE THEORY; POSTERIOR DISTRIBUTIONS; PRIOR DISTRIBUTION; PROBABILISTIC MODELS; PROBABILISTIC PROGRAMS; REALISTIC MODEL; TRANSFORMER SEMANTICS;

BAYESIAN NETWORKS; CALCULATIONS; DATA STRUCTURES; FUNCTIONAL PROGRAMMING; INFERENCE ENGINES; LEARNING SYSTEMS; RANDOM VARIABLES; SEMANTICS;

PROBABILITY DISTRIBUTIONS;

EID: 79953175643     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-19718-5_5     Document Type: Conference Paper

References (38)

1. Abadi, M., Rogaway, P.: Reconciling two views of cryptography (the computational soundness of formal encryption). J. Cryptology 15(2), 103-127 (2002)
2. Barthe, G., Grégoire, B., Béguelin, S.Z.: Formal certification of code-based cryptographic proofs. In: POPL, pp. 90-101. ACM, New York (2009)
3. Billingsley, P.: Probability and Measure, 3rd edn. Wiley, Chichester (1995)
4. Bonawitz, K.A.: Composable Probabilistic Inference with Blaise. PhD thesis,MIT, Available as Technical Report MIT-CSAIL-TR-2008-044 (2008)
5. Borgstr̈om, J., Gordon, A.D., Greenberg, M., Margetson, J., Van Gael, J.: Measure transformer semantics for Bayesian machine learning. Technical report, Microsoft Research (2011)
6. Dalvi, N.N., Ré, C., Suciu, D.: Probabilistic databases: diamonds in the dirt. Commun. ACM 52(7), 86-94 (2009)
7. Erwig, M., Kollmansberger, S.: Functional pearls: Probabilistic functional programming in Haskell. J. Funct. Program. 16(1), 21-34 (2006)
8. Fraser, D.A.S., McDunnough, P., Naderi, A., Plante, A.: On the definition of probability densities and sufficiency of the likelihood map. J. Probability and Mathematical Statistics 15, 301-310 (1995)
9. Goodman, N., Mansinghka, V.K., Roy, D.M., Bonawitz, K., Tenenbaum, J.B.: Church: a language for generative models. In: UAI, pp. 220-229. AUAI Press (2008)
10. Gupta, V., Jagadeesan, R., Panangaden, P.: Stochastic processes as concurrent constraint programs. In: POPL 1999, pp. 189-202 (1999)
11. Herbrich, R., Minka, T., Graepel, T.: TrueSkill(TM): A Bayesian skill rating system. In: Advances in Neural Information Processing Systems 20 (2007)
12. Jaynes, E.T.: 15.7 The Borel-Kolmogorov paradox. In: Probability Theory: The Logic of Science, pp. 467-470. CUP (2003)
13. Jones, C., Plotkin, G.D.: A probabilistic powerdomain of evaluations. In: LICS, pp. 186-195. IEEE Computer Society, Los Alamitos (1989)
14. Kiselyov, O., Shan, C.: Monolingual probabilistic programming using generalized coroutines. In: UAI (2009)
15. Koller, D., Friedman, N.: Probabilistic Graphical Models. The MIT Press, Cambridge (2009)
16. Koller, D., McAllester, D.A., Pfeffer, A.: Effective Bayesian inference for stochastic programs. In: AAAI/IAAI, pp. 740-747 (1997)
17. Kozen, D.: Semantics of probabilistic programs. J. Comput. Syst. Sci. 22(3), 328-350 (1981)
18. Kschischang, F.R., Frey, B.J., Loeliger, H.-A.: Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory 47(2), 498-519 (2001)
19. Kwiatkowska, M.Z., Norman, G., Parker, D.: Quantitative analysis with the probabilistic model checker PRISM. ENTCS 153(2), 5-31 (2006)
20. Lowe, G.: Quantifying information flow. In: CSFW, pp. 18-31. IEEE Computer Society, Los Alamitos (2002)
21. MacKay, D.J.C.: Information Theory, Inference, and Learning Algorithms. CUP (2003)
22. McCallum, A., Schultz, K., Singh, S.: FACTORIE: Probabilistic programming via imperatively defined factor graphs. In: Poster at 23rd Annual Conference on Neural Information Processing Systems, NIPS (2009)
23. McIver, A., Morgan, C.: Abstraction, refinement and proof for probabilistic systems. Monographs in computer science. Springer, Heidelberg (2005)
24. McSherry, F.: Privacy integrated queries: an extensible platform for privacy-preserving data analysis. In: SIGMOD Conference, pp. 19-30. ACM, New York (2009)
25. Minka, T.,Winn, J., Guiver, J., Kannan, A.: Infer.NET 2.3 (November 2009), Software available from http://research.microsoft.com/infernet
26. Minka, T., Winn, J.M.: Gates. In: NIPS, pp. 1073-1080. MIT Press, Cambridge (2008)
27. Minka, T.P.: Expectation Propagation for approximate Bayesian inference. In: UAI, pp. 362-369. Morgan Kaufmann, San Francisco (2001)
28. Ntzoufras, I.: Bayesian Modeling Using WinBUGS.Wiley, Chichester (2009)
29. Panangaden, P.: Labelled Markov processes. Imperial College Press, London (2009)
30. Park, S., Pfenning, F., Thrun, S.: A probabilistic language based upon sampling functions. In: POPL, pp. 171-182. ACM, New York (2005)
31. Pfeffer, A.: IBAL: A probabilistic rational programming language. In: Nebel, B. (ed.) IJCAI, pp. 733-740. Morgan Kaufmann, San Francisco (2001)
32. Pfeffer, A.: The design and implementation of IBAL: A General-Purpose Probabilistic Language. In: Statistical Relational Learning. MIT Press, Cambridge (2007)
33. Ramsey, N., Pfeffer, A.: Stochastic lambda calculus and monads of probability distributions. In: POPL, pp. 154-165 (2002)
34. Reed, J., Pierce, B.C.: Distance makes the types grow stronger: A calculus for differential privacy. In: ICFP, pp. 157-168 (2010)
35. Saheb-Djahromi, N.: Probabilistic LCF. In:Winkowski, J. (ed.) MFCS 1978. LNCS, vol. 64, pp. 442-451. Springer, Heidelberg (1978)
36. Syme, D., Granicz, A., Cisternino, A.: Expert F#. Apress (2007)
37. Winn, J., Minka, T.: Probabilistic programming with Infer.NET. Machine Learning Summer School lecture notes (2009), http://research.microsoft.com/ ~minka/papers/mlss2009/
38. Winn, J.M., Bishop, C.M.: Variational message passing. Journal of Machine Learning Research 6, 661-694 (2005)