Moving beyond traditional null hypothesis testing: Evaluating expectations directly

Frontiers in Psychology

Volumn 2, Issue FEB, 2011, Pages

  Van de Schoot, Rens ^a   Hoijtink, Herbert ^a   Jan Willem, Romeijn ^b  

^a UTRECHT UNIVERSITY   (Netherlands)

^b UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

Bayesian analysis; Inequality constraints; Informative hypothesis; Null hypothesis testing

Indexed keywords

EID: 84855918886     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2011.00024     Document Type: Article

References (51)

1. Akaike, H. (1973). "Information theory as an extension of the maximum likelihood principle," in Second International Symposium on Information Theory, eds B. N. Petrov and F. Csaki (Budapest: Akademiai Kiado), 267-281.
2. American Psychological Association. (2001). Publication Manual of the American Psychological Association, 5th Edn. Washington, DC: Author.
3. Anraku, K. (1999). An information criterion for parameters under a simple order restriction. J. R. Stat. Soc. Series B 86, 141-152.
4. Cohen, J. (1990). Things I have learned (so far). Am. Psychol. 45, 1304-1312.
5. Cohen, J. (1994). The Earth is round (p < .05) Am. Psychol. 49, 997-1003.
6. Coulson, M., Healey, M., Fidler, F., and Cumming, G. (2010). Confidence intervals permit, but do not guarantee, better inference than statistical significance testing. Front. Quant. Psychol. Meas. 1:26. doi: 10.3389/ fpsyg.2010.00026
7. Dayton, C. M. (1998). Information criteria for paired-comparison problem. Am. Stat. 52, 144-151.
8. Dayton, C. M. (2001). SUBSET: best subsets using information criteria. J. Stat. Softw. 6, 1-10.
9. Dayton, C. M. (2003). Information criteria for pairwise comparisons. Psychol. Methods 8, 61-71.
10. Gonzalez, R., and Griffin, D. (2001). Testing parameters in structural equation modelling: every "one" matters. Psychol. Methods 6, 258-269.
11. Fidler, F. (2002). The fifth edition of the APA publication manual: why its statistics recommendations are so controversial. Educ. Psychol. Meas. 62, 749-770.
12. Fidler, F., and Thompson, B. (2001). Computing correct confidence intervals for ANOVA fixed-and random-effects effect sizes. Educ. Psychol. Meas. 61, 575-604.
13. Hoijtink, H. (2001). Confirmatory latent class analysis: model selection using Bayes factors and (pseudo) likelihood ratio statistics. Multivariate Behav. Res. 36, 563-588.
14. Hoijtink, H., Huntjes, R., Reijntjes, A., Kuiper, R., and Boelen, P. (2008a). "An evaluation of Bayesian inequality constrained analysis of variance," in Bayesian Evaluation of Informative Hypothesis, Chapter 5, eds H. Hoijtink, I. Klugkist, and P. A. Boelen (New York: Springer), 27-52.
15. Hoijtink, H., Klugkist, I., and Boelen, P. A. (2008b). Bayesian Evaluation of Informative Hypotheses. New York: Springer.
16. Hoijtink, H., and Klugkist, I. (2007). Comparison of hypothesis testing and Bayesian model selection. Qual. Quant. 41, 73-91.
17. Hothorn, L., Vaeth, M., and Hothorn, T. (2009). Trend tests for the evaluation of exposure-response relationships in epidemiological exposure studies. Epidemiol. Perspect. Innov. doi:10.1186/1742-5573-6-1 [Epub ahead of print].
18. Kammers, M., Mulder, J., De Vignemont, F., and Dijkerman, H. (2009). The weight of representing the body: addressing the potentially indefinite number of body representations in healthy individuals. Exp. Brain Res. 204, 333-342.
19. Klugkist, I., Laudy, O., and Hoijtink, H. (2005). Inequality constrained analysis of variance: a Bayesian approach. Psychol. Methods 10, 477-493.
20. Klugkist, I., Laudy, O., and Hoijtink, H. (2010). Bayesian evaluation of inequality and equality constrained hypotheses for contingency tables. Psychol. Methods 15, 281-299.
21. Kuiper, R. M., and Hoijtink, H. (2010). Comparisons of means using exploratory and confirmatory approaches. Psychol. Methods 15, 69-86.
22. Kuiper, R. M., Hoijtink, H. and Silvapulle, M. J. (in press). An Akaike-type information criterion for model selection under inequality constraints. Biometrika.
23. Kuiper, R. M., Klugkist, I., and Hoijtink, H. (2010). A fortran 90 program for confirmatory analysis of variance. J. Stat. Softw. 34, 1-31.
24. Laudy, O., Boom, J., and Hoijtink, H. (2005a). "Bayesian computational methods for inequality constrained latent class analysis," in New Development in Categorical Data Analysis for the Social and Behavioral Sciences, eds A. V. der Ark and M. A. C. K. Sijtsma (London: Erlbaum), 63-82.
25. Laudy, O., Zoccolillo, M., Baillargeon, R., Boom, J., Tremblay, R., and Hoijtink, H. (2005b). Applications of confirmatory latent class analysis in developmental psychology. Eur. J. Dev. Psychol. 2, 1-15.
26. Laudy, O., and Hoijtink, H. (2007). Bayesian methods for the analysis of inequality constrained contingency tables. Stat. Methods Med. Res. 16, 123-138.
27. Meeus, W., Van de Schoot, R., Keijsers, L., Schwartz, S. J., and Branje, S. (2010). On the progression and stability of adolescent identity formation. A five-wave longitudinal study in early-to-middle and middle-to-late adolescence. Child Dev. 81, 1565-1581.
28. Meeus, W., Van de Schoot, R., Klimstra, T., and Branje, S. (in press). Change and stability of personality types in adolescence: A five-wave longitudinal study in early-to-middle and middle-to-late adolescence. Dev. Psychol.
29. Mulder, J., Hoijtink, H., and Klugkist, I. (2009a). Equality and inequality constrained multivariate linear models: objective model selection using constrained posterior priors. J. Stat. Plan. Inference 140, 887-906.
30. Mulder, J., Klugkist, I., Van de Schoot, R., Meeus, W., Selfhout, M., and Hoijtink, H. (2009b). Bayesian model selection of informative hypotheses for repeated measurements. J. Math. Psychol. 53, 530-546.
31. Muthén, L. K., and Muthén, B. O. (2007). Mplus: Statistical Analysis with Latent Variables: User's Guide. Los Angeles, CA: Muthén & Muthén.
32. Neyman, J., and Pearson, E. (1967). Joint Statistical Papers. Cambridge: Cambridge University Press.
33. Osborne, J. W. (2010). Challenges for quantitative psychology and measurement in the 21st century. Front. Psychol. 1:1. doi: 10.3389/fpsyg.2010.00001
34. R Development Core Team. (2005). R: A Language and Environment for Statistical Computing [Computer software]. Vienna: R Foundation for Statistical Computing.
35. Romeijn, J. W., and Van de Schoot, R. (2008). "A philosopher's view on Bayesian evaluation of informative hypotheses," in Bayesian Evaluation of Informative Hypotheses, eds H. Hoijtink, I. Klugkist, and P. Boelen (New York: Springer), 329-358.
36. Rosenthal, R., Rosnow, R. L., and Rubin, D. B. (2000). Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach. Cambridge: Cambridge University Press.
37. Rusell, J. B. (1997). Inventing the Flat Earth: Columbus and Modern Historians. Burnham: Greenwood Press.
38. Schwarz, G. (1978). Estimating the dimension of a model. Ann. Stat. 6, 461-464.
39. Silvapulle, M. J., and Sen, P. K. (2004). Constrained Statistical Inference: Order, Inequality, and Shape Constraints. London: John Wiley Sons.
40. Silvapulle, M. J., Silvapulle, P., and Basawa, I. V. (2002). Tests against inequality constraints in semiparametric models. J. Stat. Plan. Inference 107, 307-320.
41. Spiegelhalter, D. J., Best, N. G., Carlin, B. P., and Van Der Linde, A. (2002). Bayesian measures of model complexity and fit. J. R. Stat. Soc. Series B 64, 583-639.
42. Stoel, R. D., Galindo-Garre, F., Dolan, C., and Van Den Wittenboer, G. (2006). On the likelihood ratio test in structural equation modeling when parameters are subject to boundary constraints. Psychol. Methods 4, 439-455.
43. Taylor, S., Zvolensky, M. J., Cox, B. J., Deacon, B., Heimberg, R. G., Ledley, D. R., Abramowitz, J. S., Holaway, R. M., Sandin, B., Stewart, S. H., Coles, M., Eng, W., Daly, E. S., Arrindell, W. A., Bouvard, M., and Cardenas, S. J. (2007). Robust dimensions of anxiety sensitivity: development and initial validation of the anxiety sensitivity index-3. Psychol. Assess. 19, 176-188.
44. Van de Schoot, R., Hoijtink, H., and Deković, M. (2010). Testing inequality constrained hypotheses in SEM models. Struct. Equ. Modeling 17, 443-463.
45. Van de Schoot, R., Hoijtink, H., Mulder, J., Van Aken, M. A. G., Orobio de Castro, B., Meeus, W., and Romeijn, J.-W. (2011). Evaluating expectations about negative emotional states of aggressive boys using Bayesian model selection. Dev. Psychol. 47, 203-212.
46. Van de Schoot, R., Mulder, J., Hoijtink, H., van Aken, M. A. G., Dubas, J. S., de Castro, B. O., Meeus, W., and Romeijn, J.-W. (in press). Psychological functioning, personality and support from family: an introduction Bayesian model selection. Eur. J. Dev. Psychol.
47. Van de Schoot, R., and Strohmeier, D. (in press). Testing informative hypotheses in SEM Increases Power: An illustration contrasting classical hypothesis testing with a parametric bootstrap approach. Int. J. Behav. Dev.
48. Van de Schoot, R., and Wong, T. (in press). Do antisocial young adults have a high or a low level of self-concept? Self Identity. doi:10.1080/15298868.2010. 517713 [Epub ahead of print].
49. Van Well, S., Kolk, A. M., and Klugkist, I. (2009). The relationship between sex, gender role identification, and the gender relevance of a stressor on physiological and subjective stress responses: sex and gender (mis)match effects. Int. J. Psychophysiol. 32, 427-449.
50. Van Wesel, F., Hoijtink, H., and Klugkist, I. (2010). Choosing priors for constrained analysis of variance: methods based on training data. Scand. J. Stat. doi: 10.1111/j.1467-9469.2010.00719.x
51. Wagenmakers, E.-J., Lee, M. D., Lodewyckx, T., and Iverson, G. (2008). "Bayesian versus frequentist inference," in Bayesian Evaluation of Informative Hypotheses, eds H. Hoijtink, I. Klugkist, and P. A. Boelen (New York: Springer), 181-207.