Replication and meta-analysis in parapsychology

Statistical Science

Volumn 6, Issue 4, 1991, Pages 363-378

  Utts, Jessica ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Effect size; Psychic research; Randomness; Statistical controversies; Vote counting

Indexed keywords

EID: 84972492572     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/ss/1177011577     Document Type: Article

References (70)

1. ATKINSON, R. L., ATKINSON, R. C., SMITH, E. E. and BEM, D. J. (1990). Introduction to Psychology, 10th ed. Harcourt Brace Jovanovich, San Diego.
2. BELOFF, J. (1985). Research strategies for dealing with unstable phenomena. In The Repeatability Problem in Parapsychology (B. Shapin and L. Coly, eds.) 1-21. Parapsychology Foundation, New York.
3. BLACKMORE, S. J. (1985). Unrepeatability: Parapsychology’s only finding. In The Repeatability Problem in Parapsychology (B. Shapin and L. Coly, eds.) 183-206. Parapsychology Foundation, New York.
4. BURDICK, D. S. and KELLY, E. F. (1977). Statistical methods in parapsychological research. In Handbook of Parapsychology (B. B. Wolman, ed.) 81-130. Van Nostrand Reinhold, New York.
5. CAMP, B. H. (1937). (Statement in Notes Section.) Journal of Parapsychology 1 305.
6. COHEN, J. (1990). Things I have learned (so far). American Psychologist 45 1304-1312.
7. COOVER, J. E. (1917). Experiments in Psychical Research at Leland Stanford Junior University. Stanford Univ.
8. DAWES, R. M., LANDMAN, J. and WILLIAMS, J. (1984). Reply to Kurosawa. American Psychologist 39 74-75.
9. DIACONIS, P. (1978). Statistical problems in ESP research. Science 201 131-136.
10. DOMMEYER, F. C. (1975). Psychical research at Stanford University. Journal of Parapsychology 39 173-205.
11. DRUCKMAN, D. and SWETS, J. A., eds. (1988) Enhancing Human Performance: Issues, Theories, and Techniques. National Academy Press, Washington, D.C.
12. EDGEWORTH, F. Y. (1885). The calculus of probabilities applied to psychical research. In Proceedings of the Society for Psychical Research 3 190-199.
13. EDGEWORTH, F; Y. (1886). The calculus of probabilities applied to psychical research. II. In Proceedings of the Society for Psychical Research 4 189-208.
14. FELLER, W. K. (1940). Statistical aspects of ESP. Journal of Parapsychology 4 271-297.
15. FELLER, W. K. (1968). An Introduction to Probability Theory and Its Applications 1, 3rd ed. Wiley, New York.
16. FISHER, R. A. (1924). A method of scoring coincidences in tests with playing cards. In Proceedings of the Society for Psychical Research 34 181-185.
17. FISHER, R. A. (1929). The statistical method in psychical research. In Proceedings of the Society for Psychical Research 39 189-192.
18. GALLUP, G. H., JR., and NEWPORT, F. (1991). Belief in paranormal phenomena among adult Americans. Skeptical Inquirer 15 137-146.
19. GARDNER, M. J. and ALTMAN, D. G. (1986). Confidence intervals rather than p-values: Estimation rather than hypothesis testing. British Medical Journal 292 746-750.
20. GILMORE, J. B. (1989). Randomness and the search for psi. Journal of Parapsychology 53 309-340.
21. GILMORE, J. B. (1990). Anomalous significance in pararandom and psi-free domains. Journal of Parapsychology 54 53-58.
22. GREELEY, A. (1987). Mysticism goes mainstream. American Health 7 47-49.
23. GREENHOUSE, J. B. and GREENHOUSE, S. W. (1988). An aspirin a day… ? Chance 1 24-31.
24. GREENWOOD, J. A. and STUART, C. E. (1940). A review of Dr. Feller’s critique. Journal of Parapsychology 4 299-319.
25. HACKING, I. (1988). Telepathy: Origins of randomization in experimental design. Isis 79 427-451.
26. HANSEL, C. E. M. (1980). ESP and Parapsychology: A Critical Re-evaluation. Prometheus Books, Buffalo, N.Y.
27. HARRIS, M. J. and ROSENTHAL, R. (1988a). Interpersonal Expectancy Effects and Human Performance Research. National Academy Press, Washington, D.C.
28. HARRIS, M. J. and ROSENTHAL, R. (1988b). Postscript to Interpersonal Expectancy Effects and Human Performance Research. National Academy Press, Washington, D.C.
29. HEDGES, L. V. and OLKIN, I. (1985). Statistical Methods for Meta-Analysis. Academic, Orlando, Fla.
30. HONORTON, C. (1977). Psi and internal attention states. In Handbook of Parapsychology (B. B. Wolman, ed.) 435-472. Van Nostrand Reinhold, New York.
31. HONORTON, C. (1985a). How to evaluate and improve the replicability of parapsychological effects. In The Repeatability Problem in Parapsychology (B. Shapin and L. Coly, eds.) 238-255. Parapsychology Foundation, New York.
32. HONORTON, C. (1985b). Meta-analysis of psi ganzfeld research: A response to Hyman. Journal of Parapsychology 49 51-91.
33. HONORTON, C., BERGER, R. E., VARVOGLIS, M. P., QUANT, M., DERR, P., SCHECHTER, E. I. and FERRARI, D. C. (1990). Psi communication in the ganzfeld: Experiments with an automated testing system and a comparison with a metaanalysis of earlier studies. Journal of Parapsychology 54 99-139.
34. HONORTON, C. and FERRARI, D. C. (1989). "Future telling": A meta-analysis of forced-choice precognition experiments, 1935-1987. Journal of Parapsychology 53 281-308.
35. HONORTON, C., FERRARI, DrC. and BEM, D. J. (1991). Extraversión and ESP performance: A meta-analysis and a new confirmation. Research in Parapsychology 1990. The Scarecrow Press, Metuchen, N.J. To appear.
36. HYMAN, R. (1985a). A critical overview of parapsychology. In A Skeptic’s Handbook of Parapsychology (P. Kurtz, ed.) 1-96. Prometheus Books, Buffalo, N.Y.
37. HYMAN, R. (1985b). The ganzfeld psi experiment: A critical appraisal. Journal of Parapsychology 49 3-49.
38. HYMAN, R. and HONORTON, C. (1986). Joint communiqué: The psi ganzfeld controversy. Journal of Parapsychology 50 351-364.
39. IVERSEN, G. R., LONGCOR, W. H., MOSTELLER, F., GILBERT, J. P. and YOUTZ, C. (1971). Bias and runs in dice throwing and recording: A few million throws. Psychometrika 36 1-19.
40. JEFFREYS, W. H. (1990). Bayesian analysis of random event generator data. Journal of Scientific Exploration 4 153-169.
41. LINDLEY, D. V. (1957). A statistical paradox. Biometrika 44 187-192.
42. MAUSKOPF, S. H. and MCVAUGH, M,. (1979). The Elusive Science: Origins of Experimental Psychical Research. Johns Hopkins Univ. Press.
43. MCVAUGH, M. R. and MAUSKOPF, S. H. (1976). J. B. Rhine’s Extrasensory Perception and its background in psychical research. Isis 67 161-189.
44. NEULIEP, J. W., ed. (1990). Handbook of replication research in the behavioral and social sciences. Journal of Social Behavior and Personality 5 (4) 1-510.
45. OFFICE OF TECHNOLOGY ASSESSMENT (1989). Report of a workshop on experimental parapsychology. Journal of the American Society for Psychical Research 83 317-339.
46. PALMER, J. (1989). A reply to Gilmore. Journal of Parapsychology 53 341-344.
47. PALMER, J. (1990). Reply to Gilmore: Round two. Journal of Parapsychology 54 59-61.
48. PALMER, J. A., HONORTON, C. and UTTS, J. (1989). Reply to the National Research Council study on parapsychology. Journal of the American Society for Psychical Research 83 31-49.
49. RADIN, D. I. and FERRARI, D. C. (1991). Effects of consciousness on the fall of dice: A meta-analysis. Journal of Scientific Exploration 5 61-83.
50. RADIN, D. I. and NELSON, R. D. (1989). Evidence for consciousness-related anomalies in random physical systems. Foundations of Physics 19 1499-1514.
51. RAO, K. R. (1985). Replication in conventional and controversial sciences. In The Repeatability Problem in Parapsychology (B. Shapin and L. Coly, eds.) 22-41. Parapsychology Foundation, New York.
52. RHINE, J. B. (1934). Extrasensory Perception. Boston Society for Psychical Research, Boston. (Reprinted by Branden Press, 1964.)
53. RHINE, J. B. (1977). History of experimental studies. In Handbook of Parapsychology (B. B. Wolman, ed.) 25-47. Van Nostrand Reinhold, New York.
54. RICHET, C. (1884). La suggestion mentale et le calcul des probabilités. Revue Philosophique 18 608-674.
55. ROSENTHAL, R. (1984). Meta-Analytic Procedures for Social Research. Sage, Beverly Hills.
56. ROSENTHAL, R. (1986). Meta-analytic procedures and the nature of replication: The ganzfeld debate. Journal of Parapsychology 50 315-336.
57. ROSENTHAL, R. (1990a). How are we doing in soft psychology? American Psychologist 45 775-777.
58. ROSENTHAL, R. (1990b). Replication in behavioral research. Journal of Social Behavior and Personality 5 1-30.
59. SAUNDERS, D. R. (1985). On Hyman’s factor analysis. Journal of Parapsychology 49 86-88.
60. SHAPIN, B. and COLY, L., eds. (1985). The Repeatability Problem in Parapsychology. Parapsychology Foundation, New York.
61. SPENCER-BROWN, G. (1957). Probability and Scientific Inference. Longmans Green, London and New York.
62. STUART, C. E. and GREENWOOD, J. A. (1937). A review of criticisms of the mathematical evaluation of ESP data. Journal of Parapsychology 1 295-304.
63. TVERSKY, A. and KAHNEMAN, D. (1982). Belief in the law of small numbers. In Judgment Under Uncertainty: Heuristics and Biases (D. Kahneman, P. Slovic and A. Tversky, eds.) 23-31. Cambridge Univ. Press.
64. UTTS, J. (1986). The ganzfeld debate: A statistician’s perspective. Journal of Parapsychology 50 395-402.
65. UTTS, J. (1987). Psi, statistics, and society. Behavioral and Brain Sciences 10 615-616.
66. UTTS, J. (1988). Successful replication versus statistical significance. Journal of Parapsychology 52 305-320.
67. UTTS, J. (1989). Randomness and randomization tests: A reply to Gilmore. Journal of Parapsychology 53 345-351.
68. UTTS, J. (1991). Analyzing free-response data: A progress report. In Psi Research Methodology: A Re-examination (L. Coly, ed.). Parapsychology Foundation, New York. To appear.
69. WILKS, S. S. (1965a). Statistical aspects of expeirments in telepath. N.Y. Statistician 16 (6) 1-3.
70. WILKS, S. S. (1965b). Statistical aspects of experiments in telepathy. N.Y. Statistician 16 (7) 4-6.