Can parapsychology move beyond the controversies of retrospective meta-analyses?

Journal of Parapsychology

Volumn 77, Issue 1, 2013, Pages 21-37

  Kennedy, J E ^a  

^a NONE

Author keywords

Experimenter effects; Heterogeneity; Meta analysis; Power analysis; Synthesis generated evidence

Indexed keywords

EID: 84883662553     PISSN: 00223387     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (76)

1. Bailar, J. C. (1997). The promise and problems of meta-analysis. New England Journal of Medicine, 337, 559-561.
2. Bakker, M., van Dijik, A., 8cWichertsJ. M. (2012). The rules of the game called psychological science. Perspectives on Psychological Science, 7, 543-554. Retrieved from http://pps.sagepub.eom/content/7/6/543.full. pdf+html
3. Begg, C. B. (1994). Publication bias. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis and meta-analysis (1st ed.) (pp. 399-409). New York: Sage.
4. Bem, D. J. & Honorton, F. (1994). Does psi exist? Replicable evidence for an anomalous process of information transfer. Psychological Bulletin, 115, 4-18.
5. Bern, D. J., Palmer, J., & Broughton, R. S. (2001a). Updating the ganzfeld database: A victim of its own success? Journal of Parapsychology, 65, 207-218.
6. Bem, D.J., Palmer, J., & Broughton, R. S. (2001b). Errata. Journal of Parapsychology, 65, 427-428.
7. Borenstein, F., Hedges, L. V., Higgins, J. P. T. , & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester, UK: Wiley.
8. Bösch, H., Steinkamp, E., & Boiler, E. (2006a). Examining psychokinesis: The interaction of human intention with random number generators-A meta-analysis. Psychological Bulletin, 132, 497-523.
9. Bösch, H., Steinkamp, E., & Boller, E. (2006b). In the eye of the beholder: Reply to Wilson and Shadish (2006) and Radin, Nelson, Dobyns, and Houtkooper (2006). Psychological Bulletin, 132, 533-537.
10. Broughton, R. S. (1991). Parapsychology: The controversial science. New York: Ballantine Books.
11. Broughton, R. S., 8c Alexander, C. H (1997). Autoganzfeld II: An attempted replication of the PRL ganzfeld research, foumal of Parapsychology, 61, 209-226.
12. Carpenter, J. C., & Palmer, J. (1998). Comments on the extraversion-ESP meta-analysis by Honorton, Ferrari, & Bern. Journal of Parapsychology, 62, 277-282.
13. Cohen,J. (1988). Statistical power analyses for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
14. Cooper, H., & Hedges, L. V. (2009). Potential and limitations. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed.) (pp. 561-572). New York: Sage.
15. Cooper, H., Hedges, L. V., & Valentine, J. C. (Eds.). (2009). The handbook of research synthesis and meta-analysis (2nd ed.). New York: Sage.
16. Dalton, K. (1997a). Exploring the links: Creativity and psi in the ganzfeld. Proceedings of Presented Papers: The Parapsychological Association 40th Annual Convention, 119-134.
17. Dalton, K. (1997b). Is there a formula for success in the ganzfeld? Observations on predictors of psi-ganzfeld performance. European Journal of Parapsychology, 13, 71-82.
18. Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple graphical test. British Medical Journal, 315, 629-634. Retrieved from http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2127453/ pdf/9310563.pdf
19. Faul, F., Erdfelder, E., Lang, A.-G., 8c Buchner, A. (2007). GPower 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175-191.
20. Faul, F., Erdfelder, E., Lang, A.-G., 8c Buchner, A. (2012). GPower 3. Software retrieved from http://www. psycho.uni-duesseldorf.de/abteilungen/aap/ gpower3/
21. Ferguson, C.J., & Heene, M. (2012). A vast graveyard of undead theories: Publication bias and psychological science's aversion to the null. Perspectives on Psychological Science, 7, 555-561. Retrieved from http://pps.sagepub.com/content/7/6/555.full.pdf+html
22. Food and Drug Administration. (1998). Guidance for industry: E9 statistical principles for clinical trials. Retrieved from http://www.fda.gov/ downloads/Drugs/GuidanceComplianceRegulatoryInformation/ Guidances/ucm073137.pdf
23. Green, S., Benedetti, J., 8c Crowley, J. (2003). Clinical trials in oncology (2nd ed.). New York: Chapman & Hall/CRC.
24. Honorton, C. (1977). Psi and internal attention states. In B. B. Wolman (Ed.), Handbook of parapsychology (pp.435-472). New York: Van Nostrand Reinhold.
25. Honorton, C. (1985). Meta-analysis of psi ganzfeld research: A response to Hyman.Journal ofParapsychology, 49, 51-91.
26. Honorton, C., 8c Ferrari, D. (1989).''Future telling": A meta-analysis of forced-choice precognition experiments, 1935-1987. Journal of Parapsychology, 53, 281-308.
27. Hyman, R. (1985). The ganzfeld psi experiment: A critical appraisal. Journal of Parapsychology, 49, 3-49.
28. Hyman, R. (2010). Meta-analysis that conceals more than it reveals: Comment on Storm et al. (2010). Psychobgical Bulletin, 136, 486-490.
29. Ioannidis, J. P. A. (2005). Why most published research findings are false. PLoS Medicine, 2, 0696-0701. Retrieved from http://cmajopen.eom/content/ 176/8/1091.full.pdffhtml
30. Ioannidis.J. P. A., & Trikalinos, T. A. (2007a). The appropriateness of asymmetry tests for publication bias in meta-analyses: A large survey. Canadian Medical Association Journal, 176, 1091-1096. Retrieved from http://cmajopen.com/content/176/8/1091.full.pdf+html
31. Ioannidis, J. P. A., & Trikalinos, T.A. (2007b). An exploratory test for an excess of significant findings. Clinical Trials, 4, 245-253.
32. Kanthamani, H., & Broughton, R. S. (1994). Institute for Parapsychology ganzfeld-ESP experiments: The manual series. Proceedings of Presented Papers: The Parapsychological Association 37th Annual Convention, 182-189. Retrieved from http://jeksite.org/others/hk-1994-pa.pdf.
33. Kennedy, J. E. (1978). The role of task complexity in PK: A review.Journal of Parapsychology, 42, 89-122. Retrieved from http://jeksite.org/psi/jp78.pdf.
34. Kennedy, J. E. (1994). Exploring the limits of science and beyond: Research strategy and status. Journal of Parapsychology, 58, 63-82.
35. Kennedy, J. E. (1995). Methods for investigating goal-oriented psi. Journal of Parapsychology, 59, 47-62.
36. Kennedy, J. E. (2003). The capricious, actively evasive, unsustainable nature of psi: A summary and hypotheses. Journal of Parapsychology, 67, 53-74.
37. Kennedy, J. E. (2004). A proposal and challenge for proponents and skeptics of psi. Journal of Parapsychology, 68, 157-167.
38. Kennedy, J. E. (2013). Experimenter misconduct in parapsychology: Analysis manipulation and fraud. Retrieved from http://jeksite.org/psi/ misconduct.pdf.
39. Kennedy, J. E., & Taddonio, J. L. (1976). Experimenter effects in parapsychological research. Journal of Parapsychology, 40, 1-33. Retrieved from http://jeksite.org/psi/jp76.pdf.
40. Koestler Parapsychology Unit. (2012). Registry for Parapsychological Experiments. Retrieved from http:// www.koestler-parapsychology.psy.ed.ac.uk/ TrialRegistry.html
41. Kraemer, H. C., Gardner C., Brooks J. O., & YesavageJ. A. (1998). Advantages of excluding underpowered studies in meta-analysis: Inclusionist versus exclusionist viewpoints. Psychological Methods, 3, 23-31.
42. Lawrence, T. R. (1998). Gathering in the sheep and goats: A meta-analysis of forced-choice sheep-goat studies, 1947-1993 [Abstract]. In N. L. Zingrone, M. J. Schlitz, G. S. Alvarado, & J. Milton (Eds.), Research in parapsychology 1993 (pp. 27-30). Lanham, MD: Scarecrow Press.
43. Laws, K. R. (2013). Negativland-a home for all findings in psychology. BMC Psychology, 1, 1-8. Retrieved from http://www.biomedcentral.com/content/pdf/ 2050-72834-2.pdf
44. Milton, J. (1999). Should ganzfeld research continue to be crucial in the search fora replicable psi effect? Part I. Discussion paper and introduction to an electronic-mail discussion. Journal of Parapsychology, 63, 309-333.
45. Milton, J., & Wiseman, R. (1999). Does psi exist? Lack of replication of an anomalous process of information transfer. Psychobgical Bulletin, 125, 387-391.
46. Murray, A. L. (2011). The validity of the meta-analytic method in addressing the issue of psi replicability. Journal of Parapsychology, 75, 261-277.
47. Nash, C. (1989). Intra-experiment and intra-subject scoring declines in Extrasensory Perception After Sixty Years. Journal of the Society for Psychical Research, 55, 412-416.
48. Palmer, J. (1997). The challenge of experimenter psi. European Journal of Parapsychology, 13, 110-125.
49. Pashler, H., & Wagenmakers, E. (2012). Editors' introduction to the special section on replicability in psychological science: A crisis of confidence? Perspectives on Psychological Science, 7,528-530. Retrieved from http://pps.sagepub.com/content/7/6.toc
50. Radin, D. I. (1997). The conscious universe. San Francisco: HarperEdge.
51. Radin, D. I, & Ferrari, D. C. (1991). Effects of consciousness on the fall of dice: A meta-analysis. Journal of Scientific Exploration, 5, 61-83.
52. Radin, D. I., May, E. C., & Thomson, M. J. (1985). Psi experiments ivith random number generators: Meta-analysis Part 1. Unpublished manuscript.
53. Radin, D. I., & Nelson, R. D. (1989). Evidence for consciousness-related anomalies in random physical systems. Foundations of Physics, 19, 1499-1514.
54. Radin, D. I., & Nelson, R. D. (2003). Research on mind-matter interactions (MMI): Individual intention. In W. B. Jonas & C. C. Crawford (Eds.), Healing, intention and energy medicine: Research and clinical implications (pp. 39-48). Edinburgh, UK: Churchill Livingstone.
55. Radin, D., Nelson, R., Dobyns, Y., 8c Houtkooper, J. (2006). Reexamining psychokinesis: Comment on Bösch, Steinkamp, and Boller (2006). Psychological Bulletin, 132, 529-532.
56. Rao, K. R. (1965). The bidirectionality of psi .Journal of Parapsychology, 29, 230-250.
57. Rao, K. R. (2011). Cognitive anomalies, consciousness, and yoga. New Delhi, India: Centre for Studies in Civilization.
58. Rosenthal, R. (1986). Meta-analytic procedures and the nature of replication: The ganzfeld debate. Journal of Parapsychology, 50, 315-336.
59. Schmeidler, G. R., & Edge, H. (1999). Should ganzfeld research continue to be crucial in the search for a replicable psi effect? Part II. Edited ganzfeld debate, foumal of Parapsychology, 63, 335-388.
60. Schmidt, H. (1973). PK tests with a high-speed random number generator. Journal of Parapsychology, 37, 105-118.
61. Schmidt, H. (1987). The strange properties of psychokinesis, foumal of Scientific Exploration, 1, 103-118. Retrieved from http://www. scientificexploration.org/journal/jse-01-2-schmidt.pdf
62. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359-1366. Retrieved from http://pss.sagepub.eom/content/22/ll/1359.full.pdf+html
63. Slavin, R. E. (1986). Best evidence synthesis: An intelligent alternative to meta-analysis and traditional reviews. Educational Researcher, 9, 5-11.
64. Slavin, R. E. (1995). Best evidence synthesis: An intelligent alternative to meta-analysis. Journal of Clinical Epidemiology, 48, 9-18.
65. Stanford, R. G. (1977). Experimental psychokinesis: A review from diverse perspectives. In B.B. Wolman (Ed.), Handbook of parapsychology (pp. 324-381). New York: Van Nostrand Reinhold.
66. Sterne, J. A., Egger, M., & Smith, G. D. (2001). Systematic reviews of health care: Investigating and dealing with publication bias and other biases in meta-analysis. British Medical Journal, 323, 101-105. Retrieved from http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11207l4/
67. Sterne, J. A., Gavaghan, D., & Egger, M. (2000). Publication and related bias in meta-analysis: Power of statistical tests and presence in the literature. Journal of Clinical Epidemiology, 53, 1119-1129.
68. Storm, L. (2000). Research note: Replicable evidence of psi: A revision of Milton's (1999) meta-analysis of ganzfeld databases. Journal of Parapsychology, 64, 411-416.
69. Storm, L., Tressoldi, P. E., 8c Di Risio, L. (2010a). Meta-analysis of free-response studies, 1992-2008: Assessing the noise reduction model and parapsychology. Psychological Bulletin, 136, 471-485.
70. Storm, L., Tressoldi, P. E., 8c Di Risio, L. (2010b). A meta-analysis with nothing to hide: Reply to Hyman (2010). Psychological Bulletin, 136, 491-494.
71. Sutton, A. J. (2009). Publication bias. In H. Cooper, L.V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed.) (pp. 435-452). New York: Sage.
72. SWOG. (n.d.). One sample binomial. Online power calculator retrieved from http://www.swogstat.org/stat/public/one-binomial.htm
73. Utts,J. (1986). Successful replication versus statistical significance. Journal of Parapsychology, 52, 305-320.
74. Utts,J. (1991). Replication and meta-analysis in parapsychology. Statistical Science, 6, 363-403.
75. White, R. A. (1976). The limits of experimenter influence of psi test results: Can any be set? Journal of the American Society for Psychical Research, 70, 333-369. Retrieved from http://www.aspr.com/limits. htm.
76. Wood, W., & Eagly, A. H. (2009). Advantages of certainty and uncertainty. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed.) (pp. 455-472). New York: Sage.