Sequential Monte Carlo methods to train neural network models

Neural Computation

Volumn 12, Issue 4, 2000, Pages 955-993

  De Freitas, J F G ^a   Niranjan, M ^a   Gee, A H ^a   Doucet, A ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0000979403     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976600300015664     Document Type: Article

References (66)

1. Akashi, H., & Kumamoto, H. (1977). Random sampling approach to state estimation in switching environments. Automatica, 13, 429-434.
2. Avitzour, D. (1995). A stochastic simulation Bayesian approach to multitarget tracking. IEE Proceedings on Radar, Sonar and Navigation, 142(2), 41-44.
3. Bar-Shalom, Y., & Li, X. R. (1993). Estimation and tracking: Principles, techniques and software. Boston: Artech House.
4. Beadle, E. R., & Djuric, P. M. (1997). A fast weighted Bayesian bootstrap filter for nonlinear model state estimation. IEEE Transactions on Aerospace and Electronic Systems, 33(1), 338-343.
5. Berzuini, C., Best, N. G., Gilks, W. R., & Larizza, C. (1997). Dynamic conditional independence models and Markov chain Monte Carlo methods. Journal of the American Statistical Association, 92(440), 1403-1412.
6. Bishop, C. M. (1995). Neural networks for pattern recognition. Oxford: Clarendon Press.
7. Brass, A., Pendleton, B. J., Chen, Y., & Robson, B. (1993). Hybrid Monte Carlo simulations theory and initial comparison with molecular dynamics. Biopolymers, 33(8), 1307-1315.
8. Carpenter, J., Clifford, P., & Fearnhead, P. (1997). An improved particle filter for nonlinear problems (Tech. Rep.). Oxford: Department of Statistics, Oxford University. Available online at http://www.stats.ox.ac.uk/clifford/index.htm.
9. Collings, I. B., Krishnamurthy, V., & Moore, J. B. (1994). On-line identification of hidden Markov models via recursive prediction error techniques. IEEE Transactions on Signal Processing, 42(12), 3535-3539.
10. Cybenko, G. (1989). Approximation by superpositions of a sigmoidal function. Mathematics of Control, Signals, and Systems, 2(4), 303-314.
11. de Freitas, J. F. G., Niranjan, M., & Gee, A. H. (1997). Hierarchical Bayesian-Kalman models for regularisation and ARD in sequential learning (Tech. Rep. No. CUED/F-INFENG/TR 307). Cambridge: Cambridge University. Available online at: http://svr-www.eng.cam.ac.uk/jfgf.
12. de Freitas, J. F. G., Niranjan, M., & Gee, A. H. (1998a). The EM algorithm and neural networks for nonlinear state space estimation (Tech. Rep. CUED/F-INFENG/TR 313). Cambridge: Cambridge University. Available online at: http://svr-www.eng.cam.ac.uk/jfgf.
13. de Freitas, J. F. G., Niranjan, M., & Gee, A. H. (1998b). Nonlinear state space learning with EM and neural networks. In IEEE International Workshop on Neural Networks in Signal Processing. Cambridge, England.
14. de Freitas, J. F. G., Niranjan, M., & Gee, A. H. (1998c). Regularisation in sequential learning algorithms. In M. I. Jordan, M. J. Kearns, & S. A. Solla (Eds.), Advances in neural information processing systems, 10. Cambridge, MA: MIT Press.
15. Depster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society Series B, 39, 1-38.
16. Doucet, A. (1997). Monte Carlo methods for Bayesian estimation of hidden Markov models: Application to radiation signals. Unpublished doctoral dissertation, University Paris-Sud, Orsay, France.
17. Doucet, A. (1998). On sequential simulation-based methods for Bayesian filtering (Tech. Rep. No. CUED/F-INFENG/TR 310). Cambridge: Cambridge University. Available online at: http://www.stats.bris.ac.uk:81/ MCMC/pages/list.html.
18. Duane, S., Kennedy, A. D., Pendleton, B. J., & Roweth, D. (1987). Hybrid Monte Carlo. Physics Letters B, 195(2), 216-222.
19. Efron, B. (1982). The bootstrap, jacknife and other resampling plans. Philadelphia: SIAM.
20. Elliott, R. J. (1994). Exact adaptive filters for Markov chains observed in gaussian noise. Automatica, 30(9), 1399-1408.
21. Gelfand, A. E., Dey, D. K., & Chang, H. (1992). Model determination using predictive distributions with implementation via sampling-based methods. In J. M. Bernardo, J. O. Berger, A. P. Dawid, & A. F. M. Smith (Eds.), Bayesian statistics 4 (pp. 147-167). Oxford: Oxford University Press.
22. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (1995). Bayesian data analysis. London: Chapman and Hall.
23. Geweke, J. (1989). Bayesian inference in econometric models using Monte Carlo integration. Econometrica, 24, 1317-1399.
24. Gilks, W. R., Richardson, S., & Spiegelhalter, D. J. (Eds.). (1996). Markov chain Monte Carlo in practice. Suffolk: Chapman and Hall.
25. Gordon, N., & Whitby, A. (1995). A Bayesian approach to target tracking in the presence of a glint. In O. E. Drummond (Ed.), Signal and data processing of small targets (pp. 472-483). Bellingham, WA: SPIE Press.
26. Gordon, N. J. (1994). Bayesian methods for tracking. Unpublished doctoral dissertation, Imperial College, University of London.
27. Gordon, N. J., Salmond, D. J., & Smith, A. F. M. (1993). Novel appraoch to nonlinear/nonGaussian Bayesian state estimation. IEE Proceedings-F, 140(2), 107-113.
28. Hammersley, J. H., & Handscomb, D. C. (1968). Monte Carlo methods. London: Methuen.
29. Handschin, J. E. (1970). Monte Carlo techniques for prediction and filtering of non-linear stochastic processes. Automatica, 6, 555-563.
30. Handschin, J. E., & Mayne, D. Q. (1969). Monte Carlo techniques to estimate the conditional expectation in multi-stage non-linear filtering. International Journal of Control, 9(5), 547-559.
31. Harvey, A. C. (1970). Forecasting, structural time series models, and the Kalman filter. Cambridge: Cambridge University Press.
32. Hull, J. C. (1997). Options, futures, and other derivative (3rd ed.). Englewood Cliffs, NJ: Prentice Hall.
33. Hutchinson, J. M., Lo, A. W., & Poggio, T. (1994). A nonparametric approach to pricing and hedging derivative securities via learning networks. Journal of Finance, 49(3), 851-889.
34. Isard, M., & Blake, A. (1996). Contour tracking by stochastic propagation of conditional density. In European Conference on Computer Vision (pp. 343-356). Cambridge, UK.
35. Jazwinski, A. H. (1969). Adaptive filtering. Automatica, 5, 475-485.
36. Jazwinski, A. H. (1970). Stochastic processes and filtering theory. Orlando, FL: Academic Press.
37. Kadirkamanathan, V., & Kadirkamanathan, M. (1995). Recursive estimation of dynamic modular RBF networks. In D. S. Touretzky, M. C. Mozer, & M. E. Hasselmo (Eds.), Advances in neural information processing systems, 8 (pp. 239-245). Cambridge, MA: MIT Press.
38. Kitagawa, G. (1987). Non-Gaussian state-space modeling of nonstationary time series. Journal of the American Statistical Association, 82(400), 1032-1063.
39. Kitagawa, G. (1996). Monte Carlo filter and smoother for non-Gaussian non-linear state space models. Journal of Computational and Graphical Statistics, 5, 1-25.
40. Kong, A., Liu, J. S., & Wong, W. H. (1994). Sequential imputations and Bayesian missing data problems. Journal of the American Statistical Association, 89(425), 278-288.
41. Kramer, S. C., & Sorenson, H. W. (1988). Recursive Bayesian estimation using piece-wise constant approximations. Automatica, 24(6), 789-801.
42. Krishnamurthy, V., & Moore, J. B. (1993). On-line estimation of hidden Markov model parameters based on the Kullback-Leibler information measure. IEEE Transactions on Signal Processing, 41(8), 2557-2573.
43. Le Cun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., & Hubbard, W. (1989). Backpropagation applied to handwritten zip code recognition. Neural Computation, 1, 541-551.
44. Li, X. R., & Bar-Shalom, Y. (1994). A recursive multiple model approach to noise identification. IEEE Transactions on Aerospace and Electronic Systems, 30(3), 671-684.
45. Liu, J. S., & Chen, R. (1995). Blind deconvolution via sequential imputations. Journal of the American Statistical Association, 90(430), 567-576.
46. Liu, J. S., & Chen, R. (1998). Sequential Monte Carlo methods for dynamic systems. Journal of the American Statistical Association, 93, 1032-1044.
47. Mackay, D. J. C. (1992). Bayesian interpolation. Neural Computation, 4(3), 415-447.
48. Müller, P. (1991). Monte Carlo integration in general dynamic models. Contemporary Mathematics, 115, 145-163.
49. Müller, P. (1992). Posterior integration in dynamic models. Computer Science and Statistics, 24, 318-324.
50. Müller, P., & Rios Insua, D. (1998). Issues in Bayesian analysis of neural network models. Neural Computation, 10, 571-592.
51. Neal, R. M. (1996). Bayesian learning for neural networks. New York: Springer-Verlag.
52. Niranjan, M. (1996). Sequential tracking in pricing financial options using model based and neural network approaches. In M. C. Mozer, M. I. Jordan, & T. Petsche (Eds.), Advances in neural information processing systems 9 (pp. 960-966). Cambridge, MA: MIT Press.
53. Pitt, M. K., & Shephard, N. (1997). Filtering via simulation: Auxiliary particle filters (Tech. Rep.). London: Department of Statistics, Imperial College of London. Available online at: http://www.nuff.ox.ac.uk/economics/papers.
54. Pole, A., & West, M. (1990). Efficient Bayesian learning on non-linear dynamic models. Journal of Forecasting, 9, 119-136.
55. Puskorious, G. V., & Feldkamp, L. A. (1991). Decoupled extended Kalman filter training of feedforward layered networks. International Joint Conference on Neural Networks (pp. 307-312). Seattle.
56. Puskorius, G. V., Feldkamp, L. A., & Davis, L. I. (1996). Dynamic neural network methods applied to on-vehicle idle speed control. Proceedings of the IEEE, 84(10), 1407-1420.
57. Rauch, H. E., Tung, F., & Striebel, C. T. (1965). Maximum likelihood estimates of linear dynamic systems. AIAA Journal, 3(8), 1445-1450.
58. Robinson, T. (1994). The application of recurrent nets to phone probability estimation. IEEE Transactions on Neural Networks, 5(2), 298-305.
59. Rubin, D. B. (1988). Using the SIR algorithm to simulate posterior distributions. In J. M. Bernardo, M. H. DeGroot, D. V. Lindley, & A. F. M. Smith (Eds.), Bayesian statistics, 3 (pp. 395-402). Oxford: Oxford University Press.
60. Ruck, D. W., Rogers, S. K., Kabrisky, M., Maybeck, P. S., & Oxley, M. E. (1992). Comparative analysis of backpropagation and the extended Kalman filter for training multilayer perceptrons. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(6), 686-690.
61. Shah, S., Palmieri, F., & Datum, M. (1992). Optimal filtering algorithms for fast learning in feedforward neural networks. Neural Networks, 5, 779-787.
62. Sibisi, S. (1989). Regularization and inverse problems. In J. Skilling (Ed.), Maximum entropy and Bayesian methods (pp. 389-396). Norwell, MA: Kluwer.
63. Singhal, S., & Wu, L. (1988). Training multilayer perceptrons with the extended Kalman algorithm. In D. S. Touretzky (Ed.), Advances in neural information processing systems, 1 (pp. 133-140). San Mateo, CA: Morgan Kaufmann.
64. Smith, A. F. M., & Gelfand, A. E. (1992). Bayesian statistics without tears: A sampling-resampling perspective. American Statistician, 46, 84-88.
65. Sorenson, H. W., & Alspach, D. L. (1971). Recursive Bayesian estimation using gaussian sums. Automatica, 7, 465-479.
66. Zaritskii, V. S., Svetnik, V. B., & Smihelevich, L. I. (1975). Monte-Carlo techniques in problems of optimal information processing. Automatic Remote Control, 36, 2015-2022.