Approximate inference for disease mapping with sparse Gaussian processes

Statistics in Medicine

Volumn 29, Issue 15, 2010, Pages 1580-1607

  Vanhatalo, Jarno ^a   Pietiläinen, Ville ^a   Vehtari, Aki ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Compact support covariance; Expectation propagation; Laplace approximation; Sparse Gaussian process

Indexed keywords

ALCOHOLISM; ARTICLE; COMPUTATIONAL FLUID DYNAMICS; CONTROLLED STUDY; COVARIANCE; DISEASE COURSE; EXPECTATION PROPAGATION ALGORITHM; FUZZY SYSTEM; KERNEL METHOD; LAPLACE APPROXIMATION; LEARNING ALGORITHM; MACHINE LEARNING; MONTE CARLO METHOD; PROBABILITY; RISK FACTOR; SPATIAL AUTOCORRELATION ANALYSIS; STATISTICAL DISTRIBUTION; STOCHASTIC MODEL; THEORETICAL MODEL;

ALCOHOL-RELATED DISORDERS; ALGORITHMS; COMPUTER SIMULATION; DISEASE; EPIDEMIOLOGIC STUDIES; FINLAND; HUMANS; LIKELIHOOD FUNCTIONS; MARKOV CHAINS; MODELS, STATISTICAL; MONTE CARLO METHOD; NORMAL DISTRIBUTION; POISSON DISTRIBUTION; RISK; STOCHASTIC PROCESSES;

EID: 77953768713     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.3895     Document Type: Article

References (62)

1. Williams CKI, Barber D. Bayesian classification with Gaussian processes. IEEE Transactions on Pattern Analysis and Machine Intelligence 1998;20(12):1342-1351. DOI: 10.1109/34.735807.
2. Minka T. A family of algorithms for approximate Bayesian inference. Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge, MA, 2001.
3. Kuss M, Rasmussen CE. Assessing approximate inference for binary Gaussian process classification. Journal of Machine Learning Research 2005; 6:1679-1704.
4. Snelson E, Ghahramani Z. Sparse Gaussian process using pseudo-inputs. In Advances in Neural Information Processing Systems 18, Weiss Y, Schölkopf B, Platt J (eds). The MIT Press: Cambridge, MA, 2006.
5. Quiñonero-Candela J, Rasmussen CE. A unifying view of sparse approximate Gaussian process regression. Journal of Machine Learning Research 2005; 6(3):1939-1959. (Pubitemid 41798128)
6. Vanhatalo J, Vehtari A. Modelling local and global phenomena with sparse Gaussian processes. Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence. AUAI Press: Corvallis, OR, 2008.
7. Rasmussen CE, Williams CKI. Gaussian Processes for MachineLearning. The MIT Press: Cambridge, MA, 2006.
8. Diggle PJ, Ribeiro PJ. Model-based Geostatistics. Springer: Berlin, 2007.
9. Möller J, Syversveen AR, Waagepetersen RP. Log Gaussian Cox processes. Scandinavian Journal of Statistics 1998; 25:451-482. DOI: 10.1111/1467-9469.00115.
10. Rue H, Held L. Gaussian Markov Random Fields Theory and Applications. Chapman & Hall/CRC: London/Boca Raton, 2005.
11. Best N, Richardson S, Thomson A. A comparison of Bayesian spatial models for disease mapping. Statistical Methods in Medical Research 2005; 14:35-59. DOI: 10.1191/0962280205sm388oa.
12. Elliot P, Wakefield J, Best N, Briggs D (eds). Spatial Epidemiology Methods and Applications. Oxford University Press: Oxford, 2001.
13. Rue H, Martino S, Chopin N. Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations. Journal of Royal Statistical Society B 2009; 71(2):1-35. DOI: 10.1111/j.1467-9868.2008. 00700.x.
14. Csató L, Opper M. Sparse online Gaussian processes. Neural Computation 2002; 14(3):641-669. DOI: 10.1162/089976602317250933.
15. Seeger M, Williams CKI, Lawrence N. Fast forward selection to speed up sparse Gaussian process regression. In Ninth International Workshop on Artificial Intelligence and Statistics, Bishop CM, Frey BJ (eds). Society for Artificial Intelligence and Statistics: New Jersey, U.S.A., 2003.
16. Wikle CK, Cressie N. A dimension-reduced approach to space-time Kalman filtering. Biometrica 1999; 86:815-829. DOI: 10.1093/biomet/86.4.815.
17. Cornford D, Csató L, Opper M. Sequential, Bayesian geostatistics: a principle method for large data sets. Geographical Analysis 2005; 37:183-199. DOI: 10.1111/j.1538-4632.2005.00635.x.
18. Paciorek CJ. Computational techniques for spatial logistic regression with large datasets. Computational Statistics and Data Analysis 2007;51:3631-3653. DOI: 10.1016/j.csda.2006.11.008.
19. Banerjee S, Gelfand AE, Finley AO, Sang H. Gaussian predictive process models for large spatial data sets. Journal of Royal statistical Society B 2008; 70(4):825-848. DOI: 10.1111/j.1467-9868.2008.00663.x.
20. Wendland H. Scattered Data Approximation. Cambridge University Press: Cambridge, 2005.
21. Storkey A. Efficient covariance matrix methods for Bayesian Gaussian processes and Hopfield neural networks. Ph.D. Thesis, University of London, U.K., 1999.
22. Gibbs MN, Mackay DJC. Variational Gaussian process classifiers. IEEE Transactions on Neural Networks 2000; 11(6):1458-1464.
23. Csató L, Fokoué E, Opper M, Schottky B. Efficient approaches to Gaussian process classification. Neural Information Processing Systems. MIT Press: Cambridge, MA, 2000; 251-257.
24. Nickisch H, Rasmussen CE. Approximations for binary Gaussian process classification. Journal of Machine Learning Research 2008; 9:2035-2078.
25. Snelson E. Flexible and efficient Gaussian process models for machine learning. Ph.D. Thesis, University College London, London, U.K., 2007.
26. Ahmad OB, Boschi-Pinto C, Lopez AD, Murray CJ, Lozano R, Inoue M. Age standardization of rates: a new WHO standard. GPE Discussion Paper Series, World Health Organization, 2000; 31.
27. Gneiting T. Compactly supported correlation functions. Journal of Multivariate Analysis 2002; 83:493-508. DOI: 10.1006/jmva.2001.2056.
28. Gelman A. Prior distributions for variance parameters in hierarchical models. Bayesian Analysis 2006; 1(3):515-533. DOI: 10.1214/06-BA117A.
29. Gelman A, Carlin JB, Stern HS, Rubin DB. Bayesian Data Analysis, Second Edition. Chapman and Hall/CRC: London/Boca Raton, 2004.
30. Seeger M. Expectation propagation for exponential families. Technical Report, Max Planck Institute for Biological Cybernetics, Tübingen, Germany, 2005.
31. Zoeter O, Heskes T. Gaussian quadrature based expectation propagation. In Proceedings of the Ninth International Workshop on Artificial Intelligence and Statistics, Cowell RG, Ghahramani Z (eds). Society for Artificial Intelligence and Statistics: New Jersey, U.S.A., 2005; 445-452.
32. Shampine LF. Vectorized adaptive quadrature in MATLAB. Journal of Computational and Applied Mathematics 2008; 211:131-140. DOI: 10.1016/j.cam.2006.11.021.
33. Neal RM. Bayesian Learning for Neural Networks. Springer: Berlin, 1996.
34. Niederreiter H. Random Number Generation and Quasi-Monte Carlo Methods. Society for Industrial and Applied Mathematics: Philadelphia, U.S.A., 1992.
35. Morokoff WJ, Caflisch RE. Quasi-Monte Carlo integration. Journal of Computational Physics 1995; 122:218-230. DOI: 10.1006/jcph.1995.1209.
36. Geweke J. Bayesian inference in econometric models using Monte Carlo integration. Econometrica 1989; 57(6):721-741.
37. Vehtari A. Bayesian model assessment and selection using expected utilities. Ph.D. Thesis, Helsinki University of Technology, Finland, 2001.
38. Hammersley JM. Monte Carlo methods for solving multivariate problems. Annals of the New York Academy of Sciences 1960; 86(3):844-874. DOI: 10.1111/j.1749-6632.1960.tb42846.x.
39. Sanchez SM, Sanchez PJ. Very large fractional factorials and central composite designs. ACM Transactions on Modeling and Computer Simulation 2005; 15:362-377. DOI: 10.1145/1113316.1113320.
40. Martino S. Approximate Bayesian inference for latent Gaussian models. Ph.D. Thesis, Norwegian University of Science and Technology, Trondheim, 2007.
41. Tierney L, Kadane JB. Accurate approximations for posterior moments and marginal densities. Journal of the American Statistical Association 1986; 81(393):82-86.
42. Spiegelhalter DJ, Best NG, Carlin BP, van der Linde A. Bayesian measures of model complexity and fit. Journal of Royal Statistical Society B 2002; 64(4):583-639. DOI: 10.1111/1467-9868.00353.
43. Paquet U, Winther O, Opper M. Perturbation corrections in approximate inference: mixture modelling applications. Journal of Machine Learning Research 2009; 10:1263-1304.
44. Snelson E, Ghahramani Z. Local, global sparse Gaussian process approximations. In Proceedings of the Eleventh International Workshop on Artificial Intelligence and Statistics, Meila M, Shen X (eds). Omnipress: New Jersey, 2007.
45. Lawrence N. Learning for larger datasets with the Gaussian process latent variable model. In Proceedings of the Eleventh International Workshop on Artificial Intelligence and Statistics, Meila M, Shen X (eds). Omnipress: New Jersey, U.S.A., 2007.
46. Harville DA. Matrix Algebra from a Statistician's Perspective. Springer: Berlin, 1997.
47. Naish-Guzman A, Holden S. The generalized FITC approximation. In Advances in Neural Information Processing Systems 20, Platt J, Koller D, Singer Y, Roweis S (eds). MIT Press: Cambridge, MA, 2008.
48. Amestoy P, Davis TA, Duff IS. Algorithm 837: AMD, an approximate minimum degree ordering algorithm. ACM Transactions on Mathematical Software 2004; 30(3):381-388. DOI: 10.1145/1024074.1024081.
49. Davis TA. Direct Methods for Sparse Linear Systems. SIAM: Philadelphia, PA, 2006.
50. Takahashi K, Fagan J, Chen MS. Formation of a sparse bus impedance matrix and its application to short circuit study. Power Industry Computer Application Conference Proceedings. IEEE Power Engineering Society: Minneapolis, U.S.A., 1973.
51. Niessner H, Reichert K. On computing the inverse of a sparse matrix. International Journal for Numerical Methods in Engineering 1983;19:1513-1526. DOI: 10.1002/nme.1620191009.
52. Rue H, Martino S. Approximate Bayesian inference for hierarchical Gaussian Markov random field models. Journal of Statistical Planning and Inference 2007; 137:3177-3192. DOI: 10.1016/j.jspi.2006.07.016.
53. Davis TA, Hager WW. Row modifications of a sparse Cholesky factorization. SIAM Journal on Matrix Analysis and Applications 2005; 26(3):621-639. DOI: 10.1137/S089547980343641X.
54. George A, William G, Poole J, Voigt RG. Incomplete nested dissection for solving n by n grid problems. SIAM Journal on Numerical Analysis 1978; 15(4):662-673. DOI: 10.1137/0715044.
55. Vanhatalo J, Vehtari A. Sparse log Gaussian processes via MCMC for spatial epidemiology. JMLR Workshop and Conference Proceedings 2007;1:73-89.
56. Brooks SP, Gelman A. General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics 1998; 7(4):434-455. (Pubitemid 128635035)
57. Robert CP, Casella G. Monte Carlo Statistical Methods (2nd edn). Springer: Berlin, 2004.
58. Geyer CJ. Practical Markov chain Monte Carlo. Statistical Science 1992; 7(4):473-511. DOI: 10.1214/ss/1177011137.
59. Neal RM. Annealed importance sampling. Statistics and Computing 2001; 11:125-139. DOI: 10.1023/A:1008923215028.
60. Vehtari A, Lampinen J. Bayesian model assessment and comparison using cross-validation predictive densities. Neural Computation 2002;14(10):2439-2468.
61. Gelfand AE, Dey DK, Chang H. Model determination using predictive distributions with implementation via sampling-based methods (with Discussion). In Bayesian Statistics 4, Bernardo JM, Berger JO, Dawid AP, Smith AFM (eds). Oxford University Press: Oxford, 1992; 147-167.
62. Zhang H. Inconsistent estimation and asymptotically equal interpolations in model-based geostatistics. Journal of the American Statistical Association 2004; 99(465):250-261. DOI: 10.1198/016214504000000241. (Pubitemid 38545211)