An introduction to Bayesian model selection for evaluating informative hypotheses

European Journal of Developmental Psychology

Volumn 8, Issue 6, 2011, Pages 713-729

  van de Schoot, Rens ^a   Mulder, Joris ^a   Hoijtink, Herbert ^a   van Aken, Marcel A G ^a   Dubas, Judith Semon ^a   de Castro, Bram Orobio ^a   Meeus, Wim ^a   Romeijn, Jan Willem ^b  

^a UTRECHT UNIVERSITY   (Netherlands)

^b UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

Bayes factors; Bayesian model selection; Inequality constraints; Informative hypothesis; Personality; Psychosocial functioning

Indexed keywords

EID: 84855951946     PISSN: 17405629     EISSN: 17405610     Source Type: Journal    
DOI: 10.1080/17405629.2011.621799     Document Type: Article

References (47)

1. Akaike, H. 1981. Likelihood of a model and information criteria. Journal of Econometrics, 16: 3-14.
2. Berger, J O and Pericchi, L. 1996. The intrinsic Bayes factor for model selection and prediction. Journal of the American Statistical Association, 91: 109-122.
3. Berger, J and Pericchi, L. R. 2004. Training samples in objective Bayesian model selection. The Annals of Statistics, 32: 841-869.
4. Chib, S. 1995. Marginal likelihood from the Gibbs output. Journal of the American Statistical Association, 90: 1313-1321.
5. Edwards, W., Lindman, H and Savage, L J. 1963. Bayesian statistical inference for psychological research. Psychological Review, 70: 193-242.
6. Gallistel, C R. 2009. The importance of proving the null. Psychological Review, 116: 439-453.
7. Gerris, J RM., Houtmans, M JM., Kwaaitaal-Roosen, E MG., Schipper, J C., Vermulst, A A and Janssens, J MAM. 1998. Parents, adolescents, and young adults in Dutch families: A longitudinal study, Nijmegen, The Netherlands: Institute of Family Studies, University of Nijmegen.
8. Halpern, J Y. 2003. Reasoning about uncertainty, London, UK: MIT Press.
9. Hoijtink, H. 1998. Constrained latent class analysis using the Gibbs sampler and posterior predictive. p-values: Applications to educational testing. Statistica Sinica, 8: 691-712.
10. Hoijtink, H. 2000. Posterior inference in the random intercept model based on samples obtained with Markov chain Monte Carlo methods. Computational Statistics, 3: 315-336.
11. Hoijtink, H. 2001. Confirmatory latent class analysis: Model selection using Bayes factors and (pseudo) likelihood ratio statistics. Multivariate Behavioral Research, 36: 563-588.
12. Hoijtink, H and Klugkist, I. 2007. Comparison of hypothesis testing and Bayesian model selection. Quality and Quantity, 41: 73-91.
13. Hoijtink, H., Klugkist, I. and Boelen, P. A. 2008. Bayesian evaluation of informative hypotheses, New York, NY: Springer.
14. Howard, G S., Maxwell, S E and Fleming, K. 2000. The proof of the pudding: An illustration of the relative strengths of null hypothesis, meta-analysis, and Bayesian analysis. Psychological Methods, 5: 315-332.
15. Jaynes, E T. 2003. Probability theory, the logic of science, Cambridge, UK: Cambridge University Press.
16. Kammers, M PM., Mulder, J., De Vignemont, F and Dijkerman, H C. 2009. The weight of representing the body: Addressing the potentially indefinite number of body representations in healthy individuals. Experimental Brain Research, 3: 333-342.
17. Kass, R. E. and Raftery, R. 1995. Bayes factors. Journal of the American Statistical Association, 90: 773-795.
18. Klugkist, I and Hoijtink, H. 2007. The Bayes factor for inequality and about equality constrained models. Computational Statistics and Data Analysis, 51: 6367-6379.
19. Klugkist, I., Laudy, O and Hoijtink, H. 2005. Inequality constrained analysis of variance: A Bayesian approach. Psychological Methods, 10: 477-493.
20. Kuiper, R M and Hoijtink, H. 2010. Comparisons of means using confirmatory and exploratory approaches. Psychological Methods, 15: 69-86.
21. Kuiper, R M., Klugkist, I and Hoijtink, H. 2010. A Fortran 90 program for confirmatory analysis of variance. Journal of Statistical Software, 34: 1-31.
22. Laudy, O., Boom, J and Hoijtink, H. 2005. "Bayesian computational methods for inequality constrained latent class analysis". In New development in categorical data analysis for the social and behavioural sciences, Edited by: Van der Ark, A and Sijtsma, M ACK. 63-82. London, UK: Lawrence Erlbaum Associates, Ltd.
23. Laudy, O and Hoijtink, H. 2007. Bayesian methods for the analysis of inequality constrained contingency tables. Statistical Methods in Medical Research, 16: 123-138.
24. Laudy, O., Zoccolillo, M., Baillargeon, R., Boom, J., Tremblay, R and Hoijtink, H. 2005. Applications of confirmatory latent class analysis in developmental psychology. European Journal of Developmental Psychology, 2: 1-15.
25. Lee, S.-Y. 2007. Structural equation modeling: A Bayesian approach, Chichester, UK: Wiley.
26. Lynch, S M. 2007. Introduction to applied Bayesian statistics and estimation for social scientists, New York, NY: Springer.
27. Meeus, W., Van de Schoot, R., Keijsers, L., Schwartz, S J and Branje, S. 2010. On the progression and stability of adolescent identity formation. A five-wave longitudinal study in early-to-middle and middle-to-late adolescence. Child Development, 81: 1565-1581.
28. Meeus, W., Van de Schoot, R., Klimstra, T. and Branje, S. 2011. Change and stability of personality types in adolescence: A five-wave longitudinal study in early-to-middle and middle-to-late adolescence. Developmental Psychology, 47(4): 1181-1195.
29. Mulder, J., Hoijtink, H and Klugkist, I. 2010. Equality and inequality constrained multivariate linear models: Objective model selection using constrained posterior priors. Journal of Statistical Planning and Inference, 140: 887-906.
30. Mulder, J., Klugkist, I., Van de Schoot, R., Meeus, W., Selfhout, M and Hoijtink, H. 2009. Informative hypotheses for repeated measurements: A Bayesian approach. Journal of Mathematical Psychology, 53: 530-546.
31. Myung, I J and Pitt, M A. 1997. Applying Occam's razor in modelling cognition: A Bayesian approach. Psychonomic Bulletin & Review, 4: 79-95.
32. O'Hagan, A. 1995. Fractional Bayes factors for model comparison. Journal of the Royal Statistical Society, Series B, 57: 99-138.
33. Perez, J M and Berger, J. 2002. Expected posterior prior distributions for model selection. Biometrika, 89: 491-511.
34. Rosenthal, R., Rosnow, R L and Rubin, D B. 2000. Contrasts and effect sizes in behavioral research: A correlational approach, Cambridge, UK: Cambridge University Press.
35. Rosnow, R L and Rosenthal, R. 1989. Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44: 1276-1284.
36. Rouder, J N., Speckman, P L., Sun, D., Morey, R D and Iverson, G. 2009. Bayesian. t-tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16: 225-237.
37. Scholte, R HJ., Van Lieshout, C FM and Van Aken, M AG. 2001. Relational support in adolescence: Factors, types, and adjustment. Journal of Research in Adolescence, 11: 71-94.
38. Schwarz, G E. 1978. Estimating the dimension of a model. Annals of Statistics, 6: 461-464.
39. Van Aken, M AG and Dubas, J D. 2004. Personality type, social relationships, and problem behaviour in adolescence. European Journal of Developmental Psychology, 1: 331-348.
40. Van de Schoot, R. 2010. Informative hypotheses. How to move beyond classical null hypothesis testing, Utrecht, The Netherlands: Utrecht University, PhD thesis. (Accessible at: http://igitur-archive.library.uu.nl/dissertations/2010-0909-200248/UUindex.html)
41. Van de Schoot, R., Hoijtink, H. and Deković, M. 2010. Testing inequality constrained hypotheses in SEM models. Structural Equation Modeling: A Multidisciplinary Journal, 17: 443-463.
42. Van de Schoot, R., Hoijtink, H., Mulder, J., Van Aken, M AG., Orobio de Castro, B.Meeus, W. 2011. Evaluating expectations about negative emotional states of aggressive boys using Bayesian model selection. Developmental Psychology, 47: 203-212.
43. Van de Schoot, R., Hoijtink, H and Romeijn, J.-W. 2011. Moving beyond traditional null hypothesis testing: Evaluating expectations directly. Frontiers in Quantitative Psychology and Measurement, 2(24) doi:10.3389/fpsyg.2011.00024
44. Van de Schoot, R and Strohmeier, D. 2011. Testing informative hypotheses in SEM increases power: An illustration contrasting classical hypothesis testing with a parametric bootstrap approach. International Journal of Behavioural Development, 35: 180-190.
45. Van de Schoot, R. and Wong, T. 2011. Do antisocial young adults have a high or a low level of self-concept?. Self and Identity, doi:10.1080/15298868.2010.517713
46. Van Well, S., Kolk, A M and Klugkist, I. 2008. The relationship between sex, gender role identification, and the gender relevance of a stressor on physiological and subjective stress responses: Sex and gender (mis)match effects. Behavior Modification, 32: 427-449.
47. Wagenmakers, E.-J., Lodewyckx, T., Kuriyal, H and Grasman, R. 2010. Bayesian hypothesis testing for psychologists: A tutorial on the Savage-Dickey method. Cognitive Psychology, 60: 158-189.