Replication unreliability in psychology: Elusive phenomena or "elusive" statistical power?

Frontiers in Psychology

Volumn 3, Issue JUL, 2012, Pages

  Tressoldi, Patrizio E ^a  

^a UNIVERSITY OF PADOVA   (Italy)

Author keywords

Incubation effect; Non local perception; Power; Subliminal priming; Unconscious thought theory

Indexed keywords

EID: 84867076591     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2012.00218     Document Type: Article

References (37)

1. Alcock, J. E. (2003). Give the null hypothesis a chance: reasons to remain doubtful about the existence of PSI. J. Conscious. Stud. 10, 29-50. American Psychological Association. (2010). Publication manual of the American Psychological Association, 6th Edn, Washington, DC: American Psychological Association.
2. Bezeau, S., and Graves, R. (2001). Statistical power and effect sizes of clinical neuropsychology research. J. Clin. Exp. Neuropsychol. 23, 399-406.
3. Bouwmeester, D., Pan, J. W., Mattle, K., Eibl, M., Weinfurter, H., and Zeilinger, A. (1997). Experimental quantum teleportation. Nature 390, 575-579.
4. Busemeyer, J. R., Pothos, E. M., Franco, R., and Trueblood, J. S. (2011). A quantum theoretical explanation for probability judgment errors. Psychol. Rev. 118, 2, 193-218.
5. Cohen, J. (1992). A power primer. Psychol. Bull. 112, 1, 155-1, 159.
6. Cohen, J. (1994). The earth is round (p < .085). Am. Psychol. 49, 997-1003.
7. Cumming, G. (2012). Understanding the New Statistics: Effect Sizes, Confi- dence Intervals, and Meta-Analysis. New York: Routledge.
8. Dijksterhuis, A., Bos, M. W., Nordgren, L. F., and Van Baaren, R. B. (2006). On making the right choice: the deliberation-without attention effect. Science 311, 1005-1007.
9. Faul, F., Erdfelder, E., Lang, A.-G., and Buchner, A. (2007). G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 39, 175-191.
10. Genovese, M. (2005). Research on hidden variable theories, a review of recent progresses. Phys. Rep. 413, 319-396.
11. Genovese, M. (2010). Interpretations of quantum mechanics and measurement problem. Adv. Sci. Lett. 3, 249-258.
12. Gigerenzer, G., Krauss, S., and Vitouch, O. (2004). "The null ritual what you always wanted to know about significance testing but were afraid to ask," in The Sage Handbook of Quantitative Methodology for the Social Sciences, ed. D. Kaplan (Thousand Oaks, CA: Sage), 391-408.
13. Gutiérrez, R., Caetano, R., Woiczikowski, P. B., Kubar, T., Elstner, M., and Cuniberti, G. (2010). Structural fluctuations and quantum transport through DNA molecular wires, a combined molecular dynamics and model Hamiltonian approach. New J. Phys. 12, 023022
14. Kennedy, J. E. (2001). Why is PSY so elusive? A review and proposed model. J. Parapsychol. 65, 219-246.
15. Khrennikov, A. Y. (2010). Ubiquitous Quantum Structure from Psychology to Finance. Berlin: Springer-Verlag.
16. Kline, R. B. (2004). Beyond Signifi- cance Testing. Reforming Data Analy- sis Methods in Behavioral Research. Washington, DC: APA.
17. Kruschke, J. (2011). Bayesian assessment of null values via parameter estimation and model comparison. Perspect. Psychol. Sci. 6, 299-312.
18. Kuiper, R. M., and Hoijtink, H. (2010). Comparisons of means using exploratory and confirmatory approaches. Psychol. Methods 15, 69-86.
19. Levine, T. R., Weber, R., Sun Park, H., and Hullett, C. R. (2008). A communication researchers' guide to null hypothesis significance testing and alternatives. Hum. Commun. Res. 34, 188-209.
20. Maxwell, S. E. (2004). The persistence of underpowered studies in psychological research: causes, consequences, and remedies. Psychol. Methods 9, 147-163.
21. Milton, J. (1997). Meta-analysis of freeresponse ESP studies without altered states of consciousness. J. Parapsy- chol. 61, 279-319.
22. Nickerson, R. S. (2000). Null hypothesis significance testing: a review of an old and continuing controversy. Psychol. Methods 5, 241-301.
23. Pratte, M. S., and Rouder, J. N. (2009). A task-difficulty artifact in subliminal priming. Atten. Percept. Psychophys. 71, 1276-1283.
24. Richard, F. D., Bond, C. F., and Stokes-Zoota, J. J. (2003). One hundred years of social psychology quantitatively described. Rev. Gen. Psychol. 7, 331-363.
25. Schmidt, S. (2009). Shall we really do it again? The powerful concept of replication is neglected in the social sciences. Rev. Gen. Psychol. 13, 90-100.
26. Sedlmeier, P., and Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychol. Bull. 105, 309-316.
27. Sio, U. N., and Ormerod, T. C. (2009). Does incubation enhance problem solving?A meta-analytic review. Psy- chol. Bull. 135, 94-120.
28. Storm, L., Tressoldi, P. E., and Di Risio, L. (2010). Meta-analysis of freeresponse studies, 1992-2008: assessing the noise reduction model in parapsychology. Psychol. Bull. 136, 471-485.
29. Storm, L., Tressoldi, P. E., and Di Risio, L. (in press). Meta-analysis of ESP studies, 1987-2010, assessing the success of the forced-choice design in parapsychology.
30. Strick, M., Dijksterhuis, A., Bos, M. W., Sjoerdsma, A., van Baaren, R. B., and Nordgren, L. F. (2011). A metaanalysis on unconscious thought effects. Soc. Cogn. 29, 738-762.
31. Valentine, J. C., Pigott, T. D., and Rothstein, H. R. (2009). How many studies to you need? A primer on statistical power for metaanalysis. J. Educ. Behav. Stat. 35, 215-247.
32. Van de Schoot, R., Hoijtink, H., and Jan-Willem, R. (2011). Moving beyond traditional null hypothesis testing: evaluating expectations directly. Front. Psychol. 2:24. doi:10.3389/fpsyg.2011.00024
33. Van den Bussche, E., den Noortgate, W., and Reynvoet, B. (2009). Mechanisms of masked priming: a meta-analysis. Psychol. Bull. 135, 452-477.
34. von Lucadou, W., Römer, H., and WAlach, H. (2007). Synchronistic phenomena as entanglement correlations in generalized quantum theory. J. Conscious. Stud. 14, 4, 50-74.
35. Wagenmakers, E. J., Wetzels, R., Borsboom, D., and Van der Maas, H. (2011). Why psychologists must change the way they analyze their data: the case of psi. J. Pers. Soc. Psychol. 100, 426-432.
36. Walach, H., and von Stillfried, N. (2011). Generalised quantum theory. Basic idea and general intuition: a background story and overview. Axiomathes 21, 185-209.
37. Waroquier, L., Marchiori, D., Klein, O., and Cleeremans, A. (2009). Methodological pitfalls of the unconscious thought paradigm. Judgm. Decis. Mak. 4, 601-610.