Testing the storm et al.(2010) meta-analysis using bayesian and frequentist approaches: Reply to rouder et al.(2013)

Psychological Bulletin

Volumn 139, Issue 1, 2013, Pages 248-254

  Storm, Lance ^a   Tressoldi, Patrizio E ^b   Utts, Jessica ^c  

^a UNIVERSITY OF ADELAIDE   (Australia)

^b UNIVERSITY OF PADOVA   (Italy)

^c Ringgold Standard Institution Informatics   (United States)

Author keywords

Bayesian analysis; ESP; Ganzfeld; Meta analysis; Null hypothesis significance testing; Parapsychology

Indexed keywords

EID: 84886279128     PISSN: 00332909     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0029506     Document Type: Article

References (35)

1. Barad, K. M. (2007). Meeting the universe halfway: Quantum physics and the entanglement of matter and meaning. Durham, NC: Duke University Press
2. Bem, D. J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100, 407-425.
3. Bem, D. J., Utts, J., & Johnson, W. O. (2011). Must psychologists change the way they analyze their data? Journal of Personality and Social Psychology, 101, 716-719.
4. Chambless, D. L., & Ollendich, T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52, 685-716.
5. Christensen, R., Johnson, W., Branscum, A., & Hanson, T. E. (2011) Bayesian ideas and data analysis: An introduction for scientists and statisticians. Boca Raton, FL: CRC Press
6. Dalton, K. (1997). Exploring the links: Creativity and psi in the ganzfeld In Proceedings of the 40th Annual Convention of the Parapsychological Association (pp. 119-134). Durham, NC: Parapsychological Association
7. Del Prete, G., & Tressoldi, P. E. (2005). Anomalous cognition in hypnagogic state with OBE induction: An experimental study. Journal of Parapsychology, 69, 329-339
8. Glass, G. V., McGaw, B., & Smith, M. L. (1981). Meta-analysis in social research. London, England: Sage
9. Holt, N. J. (2007). Are artistic populations psi-conducive? Testing the relationship between creativity and psi with an experience-sampling protocol. In Proceedings of the 50th Annual Convention of the Parapsychological Association (pp. 31-47). Petaluma, CA: Parapsychological Association
10. Hyman, R., & Honorton, C. (1986). A joint communiqué: The psi ganzfeld controversy. Journal of Parapsychology, 50, 351-364
11. Hyman, R. (2010). Meta-analysis that conceals more than it reveals: Comment on Storm et al. (2010). Psychological Bulletin, 136, 486-490
12. Kruschke, J. K. (2011a). Doing Bayesian data analysis: A tutorial with R and BUGS. Burlington, MA: Academic Press/Elsevier
13. Kruschke, J. K. (2011b). Extrasensory perception (ESP): Bayesian estimation approach to meta-analysis. Retrieved from http:// doingbayesiandataanalysis.blogspot.com
14. May, E. C. (2007). Advances in anomalous cognition analysis: A judgefree and accurate confidence-calling technique. In Proceedings of the 50th Annual Convention of the Parapsychological Association (pp 57-63). Petaluma, CA: Parapsychological Association
15. Parker, A. (2000). A review of the ganzfeld work at Gothenburg University Journal of the Society for Psychical Research, 64, 1-15
16. Parker, A. (2006). A ganzfeld study with identical twins. In Proceedings of the 49th Annual Convention of the Parapsychological Association (pp 330-334). Petaluma, CA: Parapsychological Association
17. Parker, A. (2010). A ganzfeld study using identical twins. Journal of the Society for Psychical Research, 74, 118-126
18. Parker A., & Westerlund, J. (1998). Current research in giving the ganzfeld an old and a new twist. In Proceedings of the 41st Annual Convention of the Parapsychological Association (pp. 135-142). Durham, NC: Parapsychological Association
19. Roe, C. A., & Flint, S. (2007). A remote viewing pilot study using a ganzfeld induction procedure. Journal of the Society for Psychical Research, 71, 230-234
20. Rouder, J. N., & Morey, R. D. (2011). A Bayes factor meta-analysis of Bem's ESP claim. Psychonomic Bulletin & Review, 18, 682-689.
21. Rouder, J. N., Morey, R. D., & Province, J. M. (2013). A Bayes factor meta-analysis of recent extrasensory perception experiments: Comment on Storm, Tressoldi, and Di Risio (2010). Psychological Bulletin, 139, 241-247.
22. Simmonds, C. A., & Fox, J. (2004). A pilot investigation into sensory noise, schizotypy, and extrasensory perception. Journal of the Society for Psychical Research, 68, 253-261
23. Simmonds-Moore, C., & Holt, N. J. (2007). Trait, state, and psi: A comparison of psi performance between clusters of scorers on schizotypy in a ganzfeld and waking control condition. Journal of the Society for Psychical Research, 71, 197-215
24. Stanford, R. G. (1977). Experimental psychokinesis: A review from diverse perspectives. In B. B. Wolman (Ed.), Handbook of parapsychology (pp. 324-381). New York, NY: Van Nostrand Reinhold
25. Storm, L. (2003). Remote viewing by committee: RV using a multiple agent/multiple percipient design. Journal of Parapsychology, 67, 325- 342
26. Storm, L., Tressoldi, P. E., & Di Risio, L. (2010). Meta-analysis of free-response studies, 1992-2008: Assessing the noise reduction modelin parapsychology. Psychological Bulletin, 136, 471-485.
27. Targ, R., & Katra, J. E. (2000). Remote viewing in a group setting. Journal of Scientific Exploration, 14, 107-114
28. Tressoldi, P. E. (2011). Extraordinary claims require extraordinary evidence: The case of non-local perception, a classical and Bayesian review of evidences. Frontiers in Psychology, 2, 117.
29. Tressoldi, P. E., & Del Prete, G. (2007). ESP under hypnosis: The role of induction instructions and personality characteristics. Journal of Parapsychology, 71, 125-137
30. Tressoldi, P. E., & Khrennikov, A. (in press). Remote state preparation of mental information: A theoretical model and a summary of experimental evidence. NeuroQuantology
31. Utts, J. (1999). The significance of statistics in mind-matter research Journal of Scientific Exploration, 13, 615-638
32. Utts, J., Norris, M., Suess, E., & Johnson, W. (2010). The strength of evidence versus the power of belief: Are we all Bayesians? In C Reading (Ed.), Data and context in statistics education: Towards an evidence-based society: Proceedings of the Eighth International Conference on Teaching Statistics. Voorburg, the Netherlands: International Statistical Institute
33. Wagenmakers, E. J., Wetzels, R., Borsboom, D., & van der Maas, H (2011). Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011). Journal of Personality and Social Psychology, 100, 426-432.
34. Watt, C., & Wiseman, R. (2002). Experimenter differences in cognitive correlates of paranormal belief, and in psi. Journal of Parapsychology, 66, 371-385
35. Williams, B. J. (2011). Revisiting the ganzfeld ESP debate: A basic review and assessment. Journal of Scientific Exploration, 25, 639-661