Backward simulation methods for Monte Carlo statistical inference

Foundations and Trends in Machine Learning

Volumn 6, Issue 1, 2013, Pages 1-143

  Lindsten, Fredrik ^a   Schön, Thomas B ^a  

^a LINKÖPING UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

BACKWARD SIMULATIONS; BAYESIAN APPROACHES; INTERACTING PARTICLE SYSTEM; LATENT VARIABLE MODELS; MARKOV CHAIN MONTE CARLO METHOD; PROBABILISTIC MODELS; SEQUENTIAL MONTE CARLO; STATISTICAL INFERENCE;

ALGORITHMS; BAYESIAN NETWORKS; DATA HANDLING; LEARNING SYSTEMS; MARKOV PROCESSES; STATISTICAL METHODS;

MONTE CARLO METHODS;

EID: 84887937591     PISSN: 19358237     EISSN: 19358245     Source Type: Journal    
DOI: 10.1561/2200000045     Document Type: Article

References (148)

1. D. Aldous, "Exchangeability and related topics", in École d'Été de Probabilités de Saint-Flour XIII-1983, (P. L. Hennequin, ed.), Springer, 1985.
2. C. Andrieu, N. De Freitas, A. Doucet, and M. I. Jordan, "An introduction to MCMC for machine learning", Machine Learning, vol. 50, no. 1, pp. 5-43, 2003.
3. C. Andrieu, A. Doucet, and R. Holenstein, "Particle Markov chain Monte Carlo methods", Journal of the Royal Statistical Society: Series B, vol. 72, no. 3, pp. 269-342, 2010.
4. C. Andrieu and S. J. Godsill, "A particle filter for model based audio source separation", in Proceedings of the 2000 International Workshop on Independent Component Analysis and Blind Signal Separation (ICA), Helsinki, Finland, June 2000.
5. C. Andrieu, E. Moulines, and P. Priouret, "Stability of stochastic approximation under verifiable conditions", SIAM Journal on Control and Optimization, vol. 44, no. 1, pp. 283-312, 2005.
6. C. Andrieu and G. O. Roberts, "The pseudo-marginal approach for efficient Monte Carlo computations", The Annals of Statistics, vol. 37, no. 2, pp. 697-725, 2009.
7. C. Andrieu and M. Vihola, "Markovian stochastic approximation with expanding projections", arXiv.org, arXiv:1111.5421, November 2011.
8. C. Andrieu and M. Vihola, "Convergence properties of pseudo-marginal Markov chain Monte Carlo algorithms", arXiv.org, arXiv:1210.1484, October 2012.
9. C. E. Antoniak, "Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems", The Annals of Statistics, vol. 2, no. 6, pp. 1152-1174, 1974.
10. M. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp, "A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking", IEEE Transactions on Signal Processing, vol. 50, no. 2, pp. 174-188, 2002.
11. M. A. Beaumont, "Estimation of population growth or decline in genetically monitored populations", Genetics, vol. 164, no. 3, pp. 1139-1160, 2003.
12. A. Benveniste, M. Métivier, and P. Priouret, Adaptive Algorithms and Stochastic Approximations. w, 1990.
13. C. M. Bishop, Pattern Recognition and Machine Learning, Information Science and Statistics. New York, USA: Springer, 2006.
14. D. Blackwell and J. B. MacQueen, "Ferguson distributions via Polya urn schemes", The Annals of Statistics, vol. 1, no. 2, pp. 353-355, 1973.
15. A. Blake, P. Kohli, and C. Rother, eds., Markov Random Fields For Vision And Image Processing. MIT Press, 2011.
16. A. Bouchard-Côté, S. Sankararaman, and M. I. Jordan, "Phylogenetic inference via sequential Monte Carlo", Systematic Biology, vol. 61, no. 4, pp. 579-593, 2012.
17. Y. Bresler, "Two-filter formulae for discrete-time non-linear bayesian smoothing", International Journal of Control, vol. 43, no. 2, pp. 629-641, 1986.
18. M. Briers, A. Doucet, and S. Maskell, "Smoothing algorithms for state-space models", Annals of the Institute of Statistical Mathematics, vol. 62, no. 1, pp. 61-89, February 2010.
19. M. Briers, A. Doucet, and S. S. Singh, "Sequential auxiliary particle belief propagation", in Proceedings of the International Conference on Information Fusion (FUSION), July 2005.
20. S. Brooks, A. Gelman, G. L. Jones, and X.-L. Meng, eds., Handbook of Markov Chain Monte Carlo. Chapman & Hall/CRC, 2011.
21. P. Bunch and S. Godsill, "Improved particle approximations to the joint smoothing distribution using Markov chain Monte Carlo", IEEE Transactions on Signal Processing (submitted), 2012.
22. O. Cappé, S. J. Godsill, and E. Moulines, "An overview of existing methods and recent advances in sequential Monte Carlo", Proceedings of the IEEE, vol. 95, no. 5, pp. 899-924, 2007.
23. O. Cappé, E. Moulines, and T. Rydén, Inference in Hidden Markov Models. Springer, 2005.
24. C. K. Carter and R. Kohn, "On Gibbs sampling for state space models", Biometrika, vol. 81, no. 3, pp. 541-553, 1994.
25. R. Chen and J. S. Liu, "Mixture Kalman filters", Journal of the Royal Statistical Society: Series B, vol. 62, no. 3, pp. 493-508, 2000.
26. R. Chen, X. Wang, and J. S. Liu, "Adaptive joint detection and decoding in flat-fading channels via mixture Kalman filtering", IEEE Transactions on Information Theory, vol. 46, no. 6, pp. 2079-2094, 2000.
27. M. Chesney and L. Scott, "Pricing European currency options: A comparison of the modified Black-Scholes model and a random variance model", The Journal of Financial and Quantitative Analysis, vol. 24, no. 3, pp. 267-284, 1989.
28. N. Chopin, "Central limit theorem for sequential Monte Carlo methods and its application to Bayesian inference", The Annals of Statistics, vol. 32, no. 6, pp. 2385-2411, 2004.
29. N. Chopin and S. S. Singh, "On the particle Gibbs sampler", arXiv.org, arXiv:1304.1887, April 2013.
30. P. De Jong and N. Shephard, "The simulation smoother for time series models", Biometrika, vol. 82, no. 2, pp. 339-350, 1995.
31. P. Del Moral, Feynman-Kac Formulae - Genealogical and Interacting Particle Systems with Applications, Probability and its Applications. Springer, 2004.
32. B. Delyon, M. Lavielle, and E. Moulines, "Convergence of a stochastic approximation version of the EM algorithm", The Annals of Statistics, vol. 27, no. 1, pp. 94-128, 1999.
33. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm", Journal of the Royal Statistical Society, Series B, vol. 39, no. 1, pp. 1-38, 1977.
34. S. Donnet and A. Samson, "EM algorithm coupled with particle filter for maximum likelihood parameter estimation of stochastic differential mixed-effects models", Technical Report hal-00519576, v2, Université Paris Descartes, MAP5, 2011.
35. R. Douc, A. Garivier, E. Moulines, and J. Olsson, "Sequential Monte Carlo smoothing for general state space hidden Markov models", Annals of Applied Probability, vol. 21, no. 6, pp. 2109-2145, 2011.
36. R. Douc and E. Moulines, "Limit theorems for weighted samples with applications to sequential Monte Carlo", The Annals of Statistics, vol. 36, no. 5, pp. 2344-2376, 2008.
37. R. Douc, E. Moulines, and J. Olsson, "Optimality of the auxiliary particle filter", Probability and Mathematical Statistics, vol. 29, pp. 1-28, 2009.
38. A. Doucet, N. De Freitas, and N. Gordon, eds., Sequential Monte Carlo Methods in Practice. New York, USA: Springer Verlag, 2001.
39. A. Doucet, S. J. Godsill, and C. Andrieu, "On sequential Monte Carlo sampling methods for Bayesian filtering", Statistics and Computing, vol. 10, no. 3, pp. 197-208, 2000.
40. A. Doucet, S. J. Godsill, and M. West, "Monte Carlo filtering and smoothing with application to time-varying spectral estimation", in P roceedings of the 2000 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Istanbul, Turkey, June 2000.
41. A. Doucet and A. Johansen, "A tutorial on particle filtering and smoothing: Fifteen years later", in The Oxford Handbook of Nonlinear Filtering, (D. Crisan and B. Rozovsky, eds.), Oxford University Press, 2011.
42. A. Doucet, A. M. Johansen, and V. B. Tadić, "On solving integral equations using Markov chain Monte Carlo methods", Applied Mathematics and Computation, vol. 216, pp. 2869-2880, 2010.
43. A. Doucet, M. K. Pitt, and R. Kohn, "Efficient implementation of Markov chain Monte Carlo when using an unbiased likelihood estimator", arXiv.org, arXiv:1210.1871, October 2012.
44. S. Duane, A. D. Kennedy, B. J. Pendleton, and D. Roweth, "Hybrid Monte Carlo", Physics Letters B, vol. 195, no. 2, pp. 216-222, 1987.
45. C. Dubarry and S. L. Corff, "Non-asymptotic deviation inequalities for smoothed additive functionals in non-linear state-space models", arXiv.org, arXiv:1012.4183v2, April 2012.
46. C. Dubarry and R. Douc, "Particle approximation improvement of the joint smoothing distribution with on-the-fly variance estimation", arXiv.org, arXiv:1107.5524, July 2011.
47. J. Durbin and S. J. Koopman, "A simple and efficient simulation smoother for state space time series analysis", Biometrika, vol. 89, no. 3, pp. 603-616, 2002.
48. P. Fearnhead, "Particle filters for mixture models with an unknown number of components", Statistics and Computing, vol. 14, pp. 11-21, 2004.
49. P. Fearnhead, "Using random quasi-Monte-Carlo within particle filters, with application to financial time series", Journal of Computational and Graphical Statistics, vol. 14, no. 4, pp. 751-769, 2005.
50. P. Fearnhead, O. Papaspiliopoulos, and G. O. Roberts, "Particle filters for partially observed diffusions", Journal of the Royal Statistical Society: Series B, vol. 70, no. 4, pp. 755-777, 2008.
51. P. Fearnhead, D. Wyncoll, and J. Tawn, "A sequential smoothing algorithm with linear computational cost", Biometrika, vol. 97, no. 2, pp. 447-464, 2010.
52. T. S. Ferguson, "A Bayesian analysis of some nonparametric problems", The Annals of Statistics, vol. 1, no. 2, pp. 209-230, 1973.
53. W. Fong, S. J. Godsill, A. Doucet, and M. West, "Monte Carlo smoothing with application to audio signal enhancement", IEEE Transactions on Signal Processing, vol. 50, no. 2, pp. 438-449, February 2002.
54. G. Fort and E. Moulines, "Convergence of the Monte Carlo expectation maximization for curved exponential families", The Annals of Statistics, vol. 31, no. 4, pp. 1220-1259, 2003.
55. R. Frigola, F. Lindsten, T. B. Schön, and C. E. Rasmussen, "Bayesian inference and learning in Gaussian process state-space models with particle MCMC", arXiv.org, arXiv:1306.2861, June 2013.
56. S. Frühwirth-Schnatter, "Data augmentation and dynamic linear models", Journal of Time Series Analysis, vol. 15, no. 2, pp. 183-202, 1994.
57. A. E. Gelfand and A. F. M. Smith, "Sampling-based approaches to calculating marginal densities", Journal of the American Statistical Association, vol. 85, no. 410, pp. 398-409, 1990.
58. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 6, no. 6, pp. 721-741, 1984.
59. R. Gerlach, C. Carter, and R. Kohn, "Efficient Bayesian inference for dynamic mixture models", Journal of the American Statistical Association, vol. 95, no. 451, pp. 819-828, 2000.
60. W. R. Gilks and C. Berzuini, "Following a moving target - Monte Carlo inference for dynamic Bayesian models", Journal of the Royal Statistical Society. Series B (Statistical Methodology), vol. 63, no. 1, pp. 127-146, 2001.
61. M. Girolami and B. Calderhead, "Riemann manifold Langevin and Hamiltonian Monte Carlo methods", Journal of the Royal Statistical Society: Series B, vol. 73, no. 2, pp. 1-37, 2011.
62. S. J. Godsill, A. Doucet, and M. West, "Monte Carlo smoothing for nonlinear time series", Journal of the American Statistical Association, vol. 99, no. 465, pp. 156-168, March 2004.
63. A. Golightly and D. J. Wilkinson, "Bayesian inference for nonlinear multivariate diffusion models observed with error", Computational Statistics & Data Analysis, vol. 52, no. 3, pp. 1674-1693, 2008.
64. N. J. Gordon, D. J. Salmond, and A. F. M. Smith, "Novel approach to nonlinear/non-Gaussian Bayesian state estimation", Radar and Signal Processi ng, IEEE Proceedings F, vol. 140, no. 2, pp. 107-113, April 1993.
65. P. J. Green, "Reversible jump Markov chain Monte Carlo computation and Bayesian model determination", Biometrika, vol. 82, no. 4, pp. 711-732, 1995.
66. F. Gustafsson, "Particle filter theory and practice with positioning applications", IEEE Aerospace and Electronic Systems Magazine, vol. 25, no. 7, pp. 53-82, 2010.
67. J. Hall, M. K. Pitt, and R. Kohn, "Bayesian inference for nonlinear structural time series models", arXiv.org, arXiv:1209.0253v2, September 2012.
68. F. Hamze and N. De Freitas, "From fields to trees", in Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI), 2004.
69. F. Hamze, J.-N. Rivasseau, and N. De Freitas, "Information theory tools to rank MCMC algorithms on probabilistic graphical models", in Proceedings of the UCSD Information Theory Workshop, 2006.
70. J. Handschin and D. Mayne, "Monte Carlo techniques to estimate the conditional expectation in multi-stage non-linear filtering", International Journal of Control, vol. 9, no. 5, pp. 547-559, May 1969.
71. W. K. Hastings, "Monte Carlo sampling methods using Markov chains and their applications", Biometrika, vol. 57, no. 1, pp. 97-109, 1970.
72. S. E. Hills and A. F. M. Smith, "Parameterization issues in Bayesian inference (with discussion)", in Bayesian Statistics 4, (J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, eds.), pp. 641-649, Oxford University Press, 1992.
73. N. L. Hjort, C. Holmes, P. Müller, and S. G. Walker, eds., Bayesian Nonparametrics. Cambridge University Press, 2010.
74. M. Hoffman, N. De Freitas, A. Doucet, and J. Peters, "An expectation maximization algorithm for continuous Markov decision processes with arbitrary rewards", in Proceedings of the International Conference on Artificial Intel ligence and Statistics, Clearwater Beach, FL, USA, 2009.
75. M. Hoffman, H. Kueck, N. De Freitas, and A. Doucet, "New inference strategies for solving Markov decision processes using reversible jump MCMC", in Proceedings of the Conference on Uncertainty in Artificial Intel ligence (UAI), pp. 223-231, Corvallis, OR, USA, 2009.
76. A. Ihler and D. McAllester, "Particle belief propagation", in Proceedings of the International Conference on Artificial Intelligence and Statistics, Clearwater Beach, FL, USA, 2009.
77. M. Isard and A. Blake, "Condensation - conditional density propagation for visual tracking", International Journal of Computer Vision, vol. 29, no. 1, pp. 5-28, 1998.
78. H. Ishwaran, "Applications of hybrid Monte Carlo to Bayesian generalized linear models: Quasicomplete separation and neural networks", Journal of Computational and Graphical Statistics, vol. 8, no. 4, pp. 779-799, 1999.
79. A. M. Johansen and A. Doucet, "A note on auxiliary particle filters", Statistics & Probability Letters, vol. 78, no. 12, pp. 1498-1504, 2008.
80. T. Kailath, A. H. Sayed, and B. Hassibi, Linear Estimation. Upper Saddle River, NJ, USA: Prentice Hall, 2000.
81. R. E. Kalman, "A new approach to linear filtering and prediction problems", Transactions of the ASME-Journal of Basic Engineering, vol. 82, no. Series D, pp. 35-45, 1960.
82. R. Karlsson and F. Gustafsson, "Particle filter for underwater navigation", in Proceedings of the 2003 IEEE Workshop on Statistical Signal Processing (SSP), pp. 509-512, St. Louis, USA, September 2003.
83. G. Kitagawa, "Monte Carlo filter and smoother for non-Gaussian nonlinear state space models", Journal of Computational and Graphical Statistics, vol. 5, no. 1, pp. 1-25, 1996.
84. M. Klaas, M. Briers, N. De Freitas, A. Doucet, S. Maskell, and D. Lang, "Fast particle smoothing: if I had a million particles", in Proceedings of the International Conference on Machine Learning, Pittsburgh, USA, June 2006.
85. M. Klaas, D. Lang, and N. De Freitas, "Fast maximum a posteriori inference in Monte Carlo state spaces", in Proceedings of the 10th Interna tionalWorkshop on Artificial Intelligence and Statistics, 2005.
86. E. Kuhn and M. Lavielle, "Coupling a stochastic approximation version of EM with an MCMC procedure", ESAIM: Probability and Statistics, vol. 8, pp. 115-131, 2004.
87. H. R. Künsch, "Recursive Monte Carlo filters: Algorithms and theoretical analysis", The Annals of Statistics, vol. 33, no. 5, pp. 1983-2021, 2005.
88. H. J. Kushner and G. G. Yin, Stochastic Approximation Algorithms and Applications. Springer, 1997.
89. D. Lang and N. De Freitas, "Beat tracking the graphical model way", in Proceedings of the 2004 Conference on Neural Information Processing Systems (NIPS), Vancouver, Canada, December 2004.
90. E. L. Lehmann and G. Casella, Theory of Point Estimation. Springer Texts in Statistics. New York, USA: Springer, 2nd ed., 1998.
91. F. Lindsten, "An efficient stochastic approximation EM algorithm using conditional particle filters", in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, Canada, May 2013.
92. F. Lindsten, P. Bunch, S. J. Godsill, and T. B. Schön, "Rao-Blackwellized particle smoothers for mixed linear/nonlinear state-space models", in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, Canada, May 2013.
93. F. Lindsten, M. I. Jordan, and T. B. Schön, "Ancestor sampling for particle Gibbs", in Advances in Neural Information Processing Systems 25, (P. Bartlett, F. C. N. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger, eds.), pp. 2600-2608, 2012.
94. F. Lindsten and T. B. Schön, "On the use of backward simulation in the particle Gibbs sampler", in Proceedin gs of the 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Kyoto, Japan, March 2012.
95. F. Lindsten, T. B. Schön, and M. I. Jordan, "Bayesian semiparametric Wiener system identification", Automatica, vol. 49, no. 7, pp. 2053-2063, 2013.
96. F. Lindsten, T. B. Schön, and J. Olsson, "An explicit variance reduction expression for the Rao-Blackwellised particle filter", in P roceedin gs of the 18th IFAC World Congress, Milan, Italy, August 2011.
97. J. S. Liu, Monte Carlo Strategies in Scientific Computing. Springer, 2001.
98. J. S. Liu and R. Chen, "Sequential Monte Carlo methods for dynamic systems", Journal of the American Statistical Association, vol. 93, no. 443, pp. 1032-1044, 1998.
99. S. N. MacEachern, M. Clyde, and J. S. Liu, "Sequential importance sampling for nonparametric Bayes models: The next generation", The Canadian Journal of Statistics, vol. 27, no. 2, pp. 251-267, 1999.
100. G. McLachlan and T. Krishnan, The EM Algorithm and Extensions. Whiley Series in Probability and Statistics. New York, USA: John Wiley & Sons, second ed., 2008.
101. A. Melino and S. M. Turnbull, "Pricing foreign currency options with stochastic volatility", Journal of Econometrics, vol. 45, no. 1-2, pp. 239-265, 1990.
102. N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller, "Equation of state calculations by fast computing machines", Journal of Chemical Physics, vol. 21, no. 6, pp. 1087-1092, 1953.
103. N. Metropolis and S. Ulam, "The Monte Carlo method", Journal of the American Statistical Association, vol. 44, no. 247, pp. 335-341, 1949.
104. S. Meyn and R. L. Tweedie, Markov Chains and Stochastic Stability. Cambridge University Press, 2nd ed., 2009.
105. M. Montemerlo and S. Thrun, FastSLAM: A scalable method for the simultaneous localization and mapping problem in robotics. Berlin, Germany: Springer, 2007.
106. M. Montemerlo, S. Thrun, D. Koller, and B. Wegbreit, "FastSLAM: A factored solution to the simultaneous localization and mapping problem", in Proceedings of the AAAI National Conference on Artificial Intelligence, Edmonton, Canada, 2002.
107. P. D. Moral, A. Doucet, and A. Jasra, "Sequential Monte Carlo samplers", Journal of the Royal Statistical Society: Series B, vol. 68, no. 3, pp. 411-436, 2006.
108. L. M. Murray, E. M. Jones, and J. Parslow, "On collapsed state-space models and the particle marginal Metropolis-Hastings sampler", arXiv.org, arXiv:1202.6159v1, February 2012.
109. R. M. Neal, "MCMC using Hamiltonian dynamics", in Handbook of Markov Chain Monte Carlo, (S. Brooks, A. Gelman, G. L. Jones, and X.-L. Meng, eds.), pp. 113-162, Chapman & Hall/CRC, 2011.
110. R. M. Neal, M. J. Beal, and S. T. Roweis, "Inferring state sequences for non-linear systems with embedded hidden Markov models", in Proceedings of the 2003 Conference on Neural Information Processing Systems (NIPS), Vancouver, Canada, December 2003.
111. M. L. A. Netto, L. Gimeno, and M. J. Mendes, "A new spline algorithm for non-linear filtering of discrete time systems", in Proceedings of the 7th Triennial World Congress, pp. 2123-2130, Helsinki, Finland, 1979.
112. J. Olsson, R. Douc, O. Cappé, and E. Moulines, "Sequential Monte Carlo smoothing with application to parameter estimation in nonlinear state-space models", Bernoulli, vol. 14, no. 1, pp. 155-179, 2008.
113. J. Olsson and T. Rydén, "Rao-Blackwellization of particle Markov chain Monte Carlo methods using forward filtering backward sampling", IEEE Transactions on Signal Processing, vol. 59, no. 10, pp. 4606-4619, 2011.
114. O. Papaspiliopoulos, G. O. Roberts, and M. Sköld, "Non-centered parameterisations for hierarchical models and data augmentation", in Bayesian Statistics 7, (J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith, and M. West, eds.), pp. 307-326, Oxford University Press, 2003.
115. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausble Inference. San Francisco, CA, USA: Morgan Kaufmann, 2nd ed., 1988.
116. M. K. Pitt and N. Shephard, "Filtering via simulation: Auxiliary particle filters", Journal of the American Statistical Association, vol. 94, no. 446, pp. 590-599, 1999.
117. M. K. Pitt, R. S. Silva, P. Giordani, and R. Kohn, "On some properties of Markov chain Monte Carlo simulation methods based on the particle filter", Journal of Econometrics, vol. 171, pp. 134-151, 2012.
118. C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning. MIT Press, 2006.
119. H. E. Rauch, F. Tung, and C. T. Striebel, "Maximum likelihood estimates of linear dynamic systems", AIAA Journal, vol. 3, no. 8, pp. 1445-1450, August 1965.
120. C. P. Robert and G. Casella, Monte Carlo Statistical Methods. Springer, 2004.
121. G. O. Roberts and S. K. Sahu, "Updating schemes, correlation structure, blocking and parameterization for the Gibbs sampler", Journal of the Royal Statistical Society: Series B, vol. 59, no. 2, pp. 291-317, 1997.
122. D. B. Rubin, "A noniterative sampling/importance resampling alternative to the data augmentation algorithm for creating a few imputations when fractions of missing information are modest: The SIR algorithm", Journal of the American Statistical Association, vol. 82, no. 398, pp. 543-546, June 1987. Comment to Tanner and Wong: The Calculation of Posterior Distributions by Data Augmentation.
123. S. Särkkä, P. Bunch, and S. Godsill, "A backward-simulation based Rao-Blackwellized particle smoother for conditionally linear Gaussian models", in Proceedings of the 16th IFAC Symposium on System Identification, Brussels, Belgium, July 2012.
124. M. N. Schmidt, "Function factorization using warped Gaussian processes", in Proceedings of the International Conference on Machine Learning, pp. 921-928, 2009.
125. T. Schön, F. Gustafsson, and P.-J. Nordlund, "Marginalized particle filters for mixed linear/nonlinear state-space models", IEEE Transactions on Signal Processing, vol. 53, no. 7, pp. 2279-2289, July 2005.
126. T. B. Schön and F. Lindsten, Computational Learning in Dynamical Systems. 2013. (forthcoming, draft manuscript is available from the authors).
127. T. B. Schön, A. Wills, and B. Ninness, "System identification of nonlinear state-space models", Automatica, vol. 47, no. 1, pp. 39-49, 2011.
128. J. C. Spall, "Estimation via Markov chain Monte Carlo", IEEE Control Systems Magazine, vol. 23, no. 2, pp. 34-45, 2003.
129. L. Stewart and P. McCarty, "The use of Bayesian belief networks to fuse continuous and discrete information for target recognition, tracking, and situation assessment", in Proceedin gs of the SPIE 1699, Signal Processing, Sensor Fusion, and Target Recognition, 1992.
130. E. B. Sudderth, A. T. Ihler, M. Isard, W. T. Freeman, and A. S. Willsky, "Nonparametric belief propagation", Communications of the ACM, vol. 53, no. 10, pp. 95-103, 2010.
131. E. Taghavi, F. Lindsten, L. Svensson, and T. B. Schön, "Adaptive stopping for fast particle smoothing", in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, Canada, May 2013.
132. M. A. Tanner and W. H. Wong, "The calculation of posterior distributions by data augmentation", Journal of the American Statistical Association, vol. 82, no. 398, pp. 528-540, June 1987.
133. Y. W. Teh, H. Daumé III, and D. Roy, "Bayesian agglomerative clustering with coalescents", Advances in Neural Information Processing, pp. 1473-1480, 2008.
134. L. Tierney, "Markov chains for exploring posterior distributions", The Annals of Statistics, vol. 22, no. 4, pp. 1701-1728, 1994.
135. M. Toussaint and A. Storkey, "Probabilistic inference for solving discrete and continuous state Markov decision processes", in Proceedings of the Interna - tional Conference on Machine Learning, Pittsburgh, PA, USA, 2006.
136. D. A. Van Dyk and X.-L. Meng, "The art of data augmentation", Journal of Computational and Graphical Statistics, vol. 10, no. 1, pp. 1-50, March 2001.
137. D. A. Van Dyk and T. Park, "Partially collapsed Gibbs samplers: Theory and methods", Journal of the American Statistical Association, vol. 103, no. 482, pp. 790-796, 2008.
138. M. J. Wainwright and M. I. Jordan, "Graphical models, exponential families, and variational inference", Foundations and Trends in Machine Learning, vol. 1, no. 1-2, pp. 1-305, 2008.
139. X. Wang, R. Chen, and D. Guo, "Delayed-pilot sampling for mixture Kalman filter with application in fading channels", IEEE Transactions on Signal Processing, vol. 50, no. 2, pp. 241-254, 2002.
140. G. C. G. Wei and M. A. Tanner, "A Monte Carlo implementation of the EM algorithm and the poor man's data augmentation algorithms", Journal of the American Statistical Association, vol. 85, no. 411, pp. 699-704, 1990.
141. N. Whiteley, "Discussion on Particle Markov chain Monte Carlo methods", Journal of the Royal Statistical Society: Series B, vol. 72, no. 3, pp. 306-307, 2010.
142. N. Whiteley, C. Andrieu, and A. Doucet, "Efficient Bayesian inference for switching state-space models using discrete particle Markov chain Monte Carlo methods", Technical report, Bristol Statistics Research Report 10:04, 2010.
143. N. Whiteley, C. Andrieu, and A. Doucet, "Bayesian computational methods for inference in multiple change-points models", Submitted, 2011.
144. D. Whitley, "A genetic algorithm tutorial", Statistics and Computing, vol. 4, pp. 65-85, 1994.
145. P. Wild and W. R. Gilks, "Algorithm AS 287: Adaptive rejection sampling from log-concave density functions", Journal of the Royal Statistical Society: Series C, vol. 42, no. 4, pp. 701-709, 1993.
146. D. J. Wilkinson and S. K. H. Yeung, "Conditional simulation from highly structured Gaussian systems, with application to blocking-MCMC for the Bayesian analysis of very large linear models", Statistics and Computing, vol. 12, no. 3, pp. 287-300, July 2002.
147. A. Wills, T. B. Schön, L. Ljung, and B. Ninness, "Identification of Hammerstein-Wiener models", Automatica, vol. 49, no. 1, pp. 70-81, 2013.
148. C. F. J. Wu, "On the convergence properties of the EM algorithm", The Annals of Statistics, vol. 11, no. 1, pp. 95-103, 1983.