A tutorial on Bayes factor estimation with the product space method

Journal of Mathematical Psychology

Volumn 55, Issue 5, 2011, Pages 331-347

  Lodewyckx, Tom ^a   Kim, Woojae ^b   Lee, Michael D ^c   Tuerlinckx, Francis ^a   Kuppens, Peter ^a   Wagenmakers, Eric Jan ^d  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b OHIO STATE UNIVERSITY   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Bayes factor; Bayesian statistics; Graphical modeling; Hierarchical modeling; Hypothesis testing; Model selection; Product space method; Transdimensional MCMC

Indexed keywords

EID: 80053201944     PISSN: 00222496     EISSN: 10960880     Source Type: Journal    
DOI: 10.1016/j.jmp.2011.06.001     Document Type: Review

References (66)

1. Besag J. Comment on "Bayesian analysis of mixtures with an unknown number of components". Journal of the Royal Statistical Society, Series B 1997, 59:774.
2. Boivin D.B. Influence of sleep-wake and circadian rhythm disturbances in psychiatric disorders. Journal of Psychiatry and Neuroscience 2006, 25:446-458.
3. Bolger N., Davis A., Rafaeli E. Diary methods: capturing life as it is lived. Annual Review of Psychology 2003, 54:579-616.
4. Carlin B.P., Chib S. Bayesian model choice via Markov chain Monte Carlo methods. Journal of the Royal Statistical Society, Series B 1995, 57:473-484.
5. Chib S. Marginal likelihood from the Gibbs output. Journal of the American Statistical Association 1995, 90:1313-1321.
6. Conte S.D., De Boor C.W. Elementary numerical analysis: an algorithmic approach 1980, McGraw-Hill. 3rd ed.
7. Dehaene S., Naccache L., Cohen L., Bihan D.L., Mangin J.F., Poline J.B., Rivière D. Cerebral mechanisms of word masking and unconscious repetition priming. Neuroscience 2001, 4:752-758.
8. Dehaene S., Naccache L., Le Clec'H G., Koechlin E., Mueller M., Dehaene-Lambertz G., van de Moortele P.F., Le Bihan D. Imaging unconscious semantic priming. Nature 1998, 395:597-600.
9. Dellaportas P., Forster J.J., Ntzoufras I. On Bayesian model and variable selection using MCMC. Statistics and Computing 2002, 12:27-36.
10. DiCiccio T.J., Kass R.E., Raftery A.E., Wasserman L. Computing Bayes factors by combining simulation and asymptotic approximations. Journal of the American Statistical Association 1997, 92:903-915.
11. Gallistel C.R. The importance of proving the null. Psychological Review 2009, 116:439-453.
12. Gelman A., Carlin J.B., Stern H.S., Rubin D.B. Bayesian data analysis 2004, Chapman & Hall, CRC, Boca Raton, FL. 2nd ed.
13. Geweke J. Bayesian inference in econometric models using Monte Carlo integration. Econometrica 1989, 57:1317-1339.
14. Gilks W.R., Thomas A., Spiegelhalter D.J. A language and program for complex Bayesian modelling. The Statistician 1994, 43:169-177.
15. Godsill S.J. On the relationship between Markov chain Monte Carlo methods for model uncertainty. Journal of Computational and Graphical Statistics 2001, 10:230-248.
16. Green P.J. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 1995, 82:711-732.
17. Hoijtink H. Confirmatory latent class analysis: model selection using Bayes factors and (pseudo) likelihood ratio statistics. Multivariate Behavioral Research 2001, 36:563-588.
18. Jeffreys H. Theory of probability 1961, Oxford University Press, Oxford, UK.
19. Jordan M.I. Graphical models. Statistical Science 2004, 19:140-155.
20. Kahneman D., Krueger A.B., Schkade D.A., Schwartz N., Stone A.A. A survey method for characterizing daily life experience: the day reconstruction method. Science 2004, 306:1776-1780.
21. Kass R.E., Raftery A.E. Bayes factors. Journal of the American Statistical Association 1995, 90:377-395.
22. Kemp C., Shafto P., Berke A., Tenenbaum J.B. Combining causal and similarity-based reasoning. Advances in neural information processing systems 2007, Vol. 19. MIT Press, Cambridge, MA.
23. Kemp C., Tenenbaum J.B. The discovery of structural form. Proceedings of the National Academy of Sciences 2008, 105:10687-10692.
24. Koller D., Friedman N., Getoor L., Taskar B. Graphical models in a nutshell. Introduction to statistical relational learning 2007, MIT Press, Cambridge, MA. L. Getoor, B. Taskar (Eds.).
25. Kouider S., Dupoux E. Subliminal speech priming. Psychological Science 2005, 16:617-625.
26. Kuppens P., Allen N.B., Sheeber L.B. Emotional inertia and psychological maladjustment. Psychological Science 2010, 21:984-991.
27. Kuss M., Jäkel F., Wichmann F.A. Bayesian inference for psychometric functions. Journal of Vision 2005, 5:478-492.
28. Lee M.D. Generating additive clustering models with limited stochastic complexity. Journal of Classification 2002, 19:69-85.
29. Lee M.D. A Bayesian data analysis of retention functions. Journal of Mathematical Psychology 2004, 48:310-321.
30. Lee M.D. A hierarchical Bayesian model of human decision-making on an optimal stopping problem. Cognitive Science 2006, 30:555-580.
31. Lee M.D. Three case studies in the Bayesian analysis of cognitive models. Psychonomic Bulletin & Review 2008, 15:1-15.
32. Lee M.D. How cognitive modeling can benefit from hierarchical Bayesian models. Journal of Mathematical Psychology 2011, 55:1-7.
33. Lee M.D., Wagenmakers E.-J. Bayesian statistical inference in psychology: comment on Trafimow (2003). Psychological Review 2005, 112:662-668.
34. Lepore L., Brown R. Category and stereotype activation: is prejudice inevitable?. Journal of Personality and Social Psychology 1997, 72:275-287.
35. Lewis S.M., Raftery A.E. Estimating Bayes factors via posterior simulation with the Laplace-Metropolis estimator. Journal of the American Statistical Association 1997, 92:648-655.
36. Lunn D.J., Best N., Whittaker J.C. Generic reversible jump MCMC using graphical models. Statistics and Computing 2009, 19:395-408.
37. Lunn D.J., Thomas A., Best N., Spiegelhalter D. WinBUGS-a Bayesian modelling framework: concepts, structure and extensibility. Statistics and Computing 2000, 10:325-337.
38. Massar K., Buunk A.P. Judging a book by its cover: jealousy after subliminal priming with attractive and unattractive faces. Personality and Individual Differences 2010, 49:634-638.
39. Mikulincer M., Hirschberger G., Nachmias O., Gillath O. The affective component of the secure base schema: affective priming with representations of attachment security. Journal of Personality and Social Psychology 2001, 81:305-321.
40. Myung I.J., Balasubramanian V., Pitt M.A. Counting probability distributions: differential geometry and model selection. Proceedings of the National Academy of Sciences 2000, 97:11170-11175.
41. Myung I.J., Pitt M.A. Applying Occam's razor in modeling cognition: a Bayesian approach. Psychonomic Bulletin & Review 1997, 109:472-491.
42. Ntzoufras I. Bayesian modeling using WinBUGS 2009, John Wiley & Sons Inc., Hoboken, NJ.
43. Peeters F., Berkhof J., Delespaul P., Rottenberg J., Nicolson N.A. Diurnal mood variation in major depressive disorder. Emotion 2006, 6:383-391.
44. Pitt M.A., Myung I.J., Zhang S. Toward a method of selecting among computational models of cognition. Psychological Review 2002, 109:472-491.
45. Raftery A.E. Bayesian model selection in social research. Sociological methodology 1995, 111-196. Blackwells, Cambridge. P.V. Marsden (Ed.).
46. Ratcliff R., McKoon G. Bias in the priming of object decisions. Journal of Experimental Psychology: Learning, Memory, and Cognition 1995, 21:754-767.
47. Ratcliff R., McKoon G. Bias effects in implicit memory tasks. Journal of Experimental Psychology: General 1996, 125:403-421.
48. R Development Core Team. (2010). R: a language and environment for statistical computing. Organization R foundation for statistical computing. Vienna, Austria.
49. Reinitz M.T., Alexander R. Mechanisms of facilitation in primed perceptual identification. Memory & Cognition 1996, 24:129-135.
50. Roberts G.O., Smith A.F.M. Simple conditions for the convergence of the Gibbs sampler and Metropolis-Hastings algorithms. Stochastic Processes and their Applications 1994, 2:207-216.
51. Rouder J.N., Lu J. An introduction to Bayesian hierarchical models with an application in the theory of signal detection. Psychonomic Bulletin & Review 2005, 12:573-604.
52. Rouder J.N., Lu J., Morey R.D., Sun D., Speckman P.L. A hierarchical process dissociation model. Journal of Experimental Psychology: General 2008, 137:370-389.
53. Rouder J.N., Lu J., Speckman P.L., Sun D., Morey R.D., Naveh-Benjamin M. Signal detection models with random participant and item effects. Psychometrika 2007, 72:621-642.
54. Rouder J.N., Morey R.D., Speckman P.L., Pratte M.S. Detecting chance: a solution to the null sensitivity problem in subliminal priming. Psychonomic Bulletin & Review 2007, 14:597-605.
55. Rouder J.N., Speckman P.L., Sun D., Morey R.D., Iverson G. Bayesian t-tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review 2009, 16:225-237.
56. Schacter D. Priming and multiple memory systems: perceptual mechanisms of implicit memory. Journal of Cognitive Neuroscience 1992, 4:244-256.
57. Shiffrin R.M., Lee M.D., Kim W.-J., Wagenmakers E.-J. A survey of model evaluation approaches with a tutorial on hierarchical Bayesian methods. Cognitive Science 2008, 32:1248-1284.
58. Steyvers M., Lee M.D., Wagenmakers E.-J. A Bayesian analysis of human decision-making on bandit problems. Journal of Mathematical Psychology 2009, 53:168-179.
59. Suls J., Green P., Hillis S. Emotional reactivity to everyday problems, affective inertia, and neuroticism. Personality and Social Psychology Bulletin 1998, 24:127.
60. Tierney L., Kadane J.B. Accurate approximations for posterior moments and marginal densities. Journal of the American Statistical Association 1986, 81:82-86.
61. Vickers D., Lee M.D., Dry M., Hughes P. The roles of the convex hull and number of intersections upon performancee on visually presented traveling salesperson problems. Memory & Cognition 2003, 31:1094-1104.
62. Wagenmakers E.-J. A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review 2007, 14:779-804.
63. Wagenmakers E.-J., Lodewyckx T., Kuriyal H., Grasman R.P.P.P. Bayesian hypothesis testing for psychologists: a tutorial on the Savage-Dickey method. Cognitive Psychology 2010, 60:158-189.
64. Wetzels R., Matzke D., Lee M.D., Rouder J.N., Iverson G.J., Wagenmakers E.J. Statistical evidence in experimental psychology: an empirical comparison using 855 t tests. Perspectives on Psychological Science 2011, 6:291-298.
65. Wetzels R., Raaijmakers J.G.W., Jakab E., Wagenmakers E.-J. How to quantify support for and against the null hypothesis: a flexible WinBUGS implementation of a default Bayesian t-test. Psychological Bulletin & Review 2009, 16:752-760.
66. Zeelenberg R., Wagenmakers E.-J., Raaijmakers J.G.W. Priming in implicit memory tasks: prior study causes enhanced discrimability, not only bias. Journal of Experimental Psychology: General 2002, 131:38-47.