Turning the hands of time again: A purely confirmatory replication study and a Bayesian analysis

Frontiers in Psychology

Volumn 6, Issue APR, 2015, Pages

  Wagenmakers, Eric Jan ^a   Beek, Titia F ^a   Rotteveel, Mark ^a   Gierholz, Alex ^a   Matzke, Dora ^a   Steingroever, Helen ^a   Ly, Alexander ^a   Verhagen, Josine ^a   Selker, Ravi ^a   Sasiadek, Adam ^a   Gronau, Quentin F ^a   Love, Jonathon ^a   Pinto, Yair ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Bayes factor; Null hypothesis testing; Preregistration; Replication; Statistical evidence

Indexed keywords

EID: 84930670170     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2015.00494     Document Type: Article

References (18)

1. Berger, J. O., and Mortera, J. (1999). Default Bayes factors for nonnested hypothesis testing. J. Am. Stat. Assoc. 94, 542-554. doi: 10.1080/01621459.1999.10474149.
2. Berger, J. O., and Wolpert, R. L. (1988). The Likelihood Principle. Hayward, CA: Institute of Mathematical Statistics.
3. Chambers, C. D. (2013). Registered reports: a new publishing initiative at cortex. Cortex 49, 609-610. doi: 10.1016/j.cortex.2012.12.016.
4. Costa, P. T., and McCrae, R. R. (1992). NEO Personality Inventory Professional Manual. Odessa, FL: Psychological Assessment Resources.
5. De Groot, A. D. (1956/2014). The meaning of "significance" for different types of research [translated and annotated by Eric-Jan Wagenmakers, Denny Borsboom, Josine Verhagen, Rogier Kievit, Marjan Bakker, Angelique Cramer, Dora Matzke, Don Mellenbergh, and Han L. J. van der Maas]. Acta Psychol. 148, 188-194. doi: 10.1016/j.actpsy.2014.02.001.
6. Edwards, W., Lindman, H., and Savage, L. J. (1963). Bayesian statistical inference for psychological research. Psychol. Rev. 70, 193-242. doi: 10.1037/h0044139.
7. Francis, G. (2013). Replication, statistical consistency, and publication bias. J. Math. Psychol. 57, 153-169. doi: 10.1016/j.jmp.2013.02.003.
8. Hoekstra, H. A., Ormel, J., and de Fruyt, F. (1996). Handleiding bij de NEO Persoonlijkheids Vragenlijsten NEO-PIR, NEO-FFI [Manual for the NEO Personality Inventories NEO-PI-R and NEO-FFI]. Lisse: Swets & Zeitlinger.
9. Jeffreys, H. (1961). Theory of Probability. Oxford: Oxford University Press.
10. Love, J., Selker, R., Marsman, M., Jamil, T., Verhagen, A. J., Ly, A., et al. (2015). JASP (Version 0.6.6) [Computer software].
11. Rouder, J. N. (2014). Optional stopping: no problem for Bayesians. Psychon. Bull. Rev. 21, 301-308. doi: 10.3758/s13423-014-0595-4.
12. Rouder, J. N., Morey, R. D., Speckman, P. L., and Province, J. M. (2012). Default Bayes factors for ANOVA designs. J. Math. Psychol. 56, 356-374. doi: 10.1016/j.jmp.2012.08.001.
13. Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., and Iverson, G. (2009). Bayesian t-tests for accepting and rejecting the null hypothesis. Psychon. Bull. Rev. 16, 225-237. doi: 10.3758/PBR.16.2.225.
14. Topolinski, S., and Sparenberg, P. (2012). Turning the hands of time: clockwise movements increase preference for novelty. Soc. Psychol. Personal. Sci. 3, 308-314. doi: 10.1177/1948550611419266.
15. Wagenmakers, E.-J. (2007). A practical solution to the pervasive problems of p values. Psychon. Bull. Rev. 14, 779-804. doi: 10.3758/BF03194105.
16. Wagenmakers, E.-J., Beek, T., Rotteveel, M., Gierholz, A., Matzke, D., Steingroever, H., et al. (2013). Turning the Hands of Time Again: A Purely Confirmatory Replication Study and a Bayesian Analysis, OSF pre registration document. Available at: https://osf.io/p3isc/.
17. Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., and Kievit, R. A. (2012). An agenda for purely confirmatory research. Perspect. Psychol. Sci. 7, 632-638. doi: 10.1177/1745691612463078.
18. Wetzels, R., Raaijmakers, J. G. W., Jakab, E., and Wagenmakers, E.-J. (2009). How to quantify support for and against the null hypothesis: a flexible WinBUGS implementation of a default Bayesian t test. Psychon. Bull. Rev. 16, 752-760. doi: 10.3758/PBR.16.4.752.