A bayes factor meta-analysis of recent extrasensory perception experiments: Comment on Storm, Tressoldi, and Di Risio (2010)

Psychological Bulletin

Volumn 139, Issue 1, 2013, Pages 241-247

  Rouder, Jeffrey N ^a   Morey, Richard D ^b   Province, Jordan M ^a  

^a UNIVERSITY OF MISSOURI   (United States)

^b UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

Bayes factor; Bayesian meta analysis; ESP; Psi phenomena

Indexed keywords

EID: 84886247533     PISSN: 00332909     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0029008     Document Type: Article

References (41)

1. Bem, D. J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100, 407-425.
2. Bem, D. J., Utts, J., & Johnson, W. O. (2011). Must psychologists change the way they analyze their data? Journal of Personality and Social Psychology, 101, 716-719.
3. Berger, J. O., & Berry, D. A. (1988). Statistical analysis and the illusion of objectivity. American Scientist, 76, 159-165
4. Dalton, K. (1997). Exploring the links: Creativity and psi in the ganzfeld In Proceedings of the 40th Annual Convention of the Parapsychological Association (pp. 119-134). Durham, NC: Parapsychological Association
5. Dalton, K., Steinkamp, F., & Sherwood, S. J. (1999). A dream GESP experiment using dynamic targets and consensus vote. Journal of the American Society for Psychical Research, 96, 145-166
6. Dalton, K., Utts, J., Novotny, G., Sickafoose, L., Burrone, J., & Phillips, C (2000). Dream GESP and consensus vote: A replication. In Proceedings of the 43rd Annual Convention of the Parapsychological Association (pp. 74-85). Durham, NC: Parapsychological Association
7. da Silva, F. E., Pilato, S., & Hiraoka, R. (2003). Ganzfeld vs. no ganzfeld: An exploratory study of the effects of ganzfeld conditions on ESP. In Proceedings of the 46th Annual Convention of the Parapsychological Association (pp. 31-49). Durham, NC: Parapsychological Association
8. Del Prete, G., & Tressoldi, P. E. (2005). Anomalous cognition in hypnagogic state with OBE induction: An experimental study. Journal of Parapsychology, 69, 329-339
9. Edwards, W., Lindman, H., & Savage, L. J. (1963). Bayesian statistical inference for psychological research. Psychological Review, 70, 193- 242.
10. Gallistel, C. R. (2009). The importance of proving the null. Psychological Review, 116, 439-453.
11. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2004). Bayesian data analysis (2nd ed.). London, England: Chapman & Hall
12. Givens, G. H., Smith, D. D., & Tweedie, R. L. (1997). Publication bias in meta-analysis: A Bayesian data-augmentation approach to account for issues exemplified in the passive smoking debate. Statistical Science, 12, 221-250.
13. Hyman, R. (2010). Meta-analysis that conceals more than it reveals: Comment on Storm et al. (2010). Psychological Bulletin, 136, 486-490
14. Hyman, R., & Honorton, C. (1986). A joint communiqué: The psi ganzfeld controversy. Journal of Parapsychology, 50, 351-364
15. Jeffreys, H. (1961). Theory of probability (3rd ed.). New York, NY: Oxford University Press
16. Kass, R. E. (1992). Bayes factors in practice. The Statistician, 42, 551-560
17. Laplace, P. S. (1986). Memoir on the probability of the causes of events Statistical Science, 1, 364-378.
18. Lau, M. (2004). The psi phenomena: A Bayesian approach to the ganzfeld procedure. (Unpublished master's thesis). University of Notre Dame, South Bend, IN
19. Liu, C. C., & Aitkin, M. (2008). Bayes factors: Prior sensitivity and model generalizability. Journal of Mathematical Psychology, 52, 362-375
20. May, E. C. (2007). Advances in anomalous cognition analysis: A judgefree and accurate confidence-calling technique. In Proceedings of the 50th Annual Convention of the Parapsychological Association (pp 57-63). Petaluma, CA: Parapsychological Association
21. Parker, A., & Westerlund, J. (1998). Current research in giving the ganzfeld an old and a new twist. In Proceedings of the 41st Annual Convention of the Parapsychological Association (pp. 135-142). Durham, NC: Parapsychological Association
22. Parra, A., & Villanueva, J. (2004). Are musical themes better than visual images as ESP-targets? An experimental study using the ganzfeld technique Australian Journal of Parapsychology, 4, 114-127
23. Parra, A., & Villanueva, J. (2006). ESP under the ganzfeld, in contrast with the induction of relaxation as a psi-conducive state. Australian Journal of Parapsychology, 6, 167-185
24. Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, F. P. (1992) Numerical recipes in C: The art of scientific computing (2nd ed.) Cambridge, England: Cambridge University Press
25. Roe, C. A., & Flint, S. (2007). A remote viewing pilot study using a ganzfeld induction procedure. Journal of the Society for Psychical Research, 71, 230-234
26. Roe, C. A., McKenzie, E. A., & Ali, A. N. (2001). Sender and receiver creativity scores as predictors of performance at a ganzfeld ESP task Journal of the Society for Psychical Research, 65, 107-121
27. Rouder, J. N., & Morey, R. D. (2011). A Bayes factor meta-analysis of Bem's ESP claim. Psychonomic Bulletin & Review, 18, 682-689.
28. Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G (2009). Bayesian t tests for accepting and rejecting the null hypothesis Psychonomic Bulletin & Review, 16, 225-237.
29. Simmonds-Moore, C., & Holt, N. J. (2007). Trait, state, and psi: A comparison of psi performance between clusters of scorers on schizo-typy in a ganzfeld and waking control condition. Journal of the Society for Psychical Research, 71, 197-215
30. Smith, M. D., & Savva, L. (2008). Experimenter effects in the ganzfeld. In Proceedings of the 51st Annual Convention of the Parapsychological Association (pp. 238-249). Columbus, OH: Parapsychological Association
31. Storm, L. (2003). Remote viewing by committee: RV using a multiple agent/multiple percipient design. Journal of Parapsychology, 67, 325- 342
32. Storm, L., & Barrett-Woodbridge, M. (2007). Psi as compensation for modality impairment-A replication study using sighted and blind participants European Journal of Parapsychology, 22, 73-89
33. Storm, L., & Thalbourne, M. A. (2001). Paranormal effects using sighted and vision-impaired participants in a quasi-ganzfeld task. Australian Journal of Parapsychology, 1, 133-170
34. Storm, L., Tressoldi, P. E., & Di Risio, L. (2010). Meta-analysis of free-response studies, 1992-2008: Assessing the noise reduction model in parapsychology. Psychological Bulletin, 136, 471-485.
35. Targ, R., & Katra, J. E. (2000). Remote viewing in a group setting. Journal of Scientific Exploration, 14, 107-114
36. Tressoldi, P. E. (2011). Extraordinary claims require extraordinary evidence: The case of non-local perception, a classical and Bayesian review of evidences. Frontiers in Quantitative Psychology and Measurement, 2, 117.
37. Tressoldi, P. E., & Del Prete, G. (2007). ESP under hypnosis: The role of induction instructions and personality characteristics. Journal of Parapsychology, 71, 125-137
38. Wagenmakers, E.-J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14, 779-804.
39. Wagenmakers, E.-J., Wetzels, R., Borsboom, D., & van der Maas, H (2011). Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011). Journal of Personality and Social Psychology, 100, 426 - 432.
40. Wetzels, R., Matzke, D., Lee, M. D., Rouder, J. N., Iverson, G., & Wagenmakers, E.-J. (2011). Statistical evidence in experimental psychology: An empirical comparison using 855 t tests. Perspectives on Psychological Science, 6, 291-298.
41. Wezelman, R., Gerding, J. L. F., & Verhoeven, I. (1997). Eigensender ganzfeld psi: An experiment in practical philosophy. European Journal of Parapsychology, 13, 28-39