Critical Differences in Bayesian and Non-Bayesian Inference and why the Former is Better

Statistics in the Social Sciences: Current Methodological Developments

Volumn , Issue , 2010, Pages 135-157

  Gill, Jeff ^a  

^a WASHINGTON UNIVERSITY   (United States)

Author keywords

Bayesian inference; Change point analysis; Count data; Non Bayesian inference; Prior distributions

Indexed keywords

EID: 85032068614     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9780470583333.ch5     Document Type: Chapter

References (100)

1. Antoniak, C. E. (1974). Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems. Annals of Statistics, 2, 1152-1174.
2. Barnett, V. (1973). Comparative statistical inference. New York: Wiley.
3. Bayes, T. (1763). An essay towards solving a problem in the doctrine of chances. Philosophical Transactions of the Royal Society of London, 53, 370-418.
4. Berger, J. O., Boukai, B., & Wang, Y. (1997). Unified frequentist and Bayesian testing of a precise hypothesis. Statistical Science, 12, 133-160.
5. Berger, J. O., & Sellke, T. (1987). Test of a point null hypothesis: The irreconcilability of significance levels and evidence. With discussion. Journal of the American Statistical Association, 82, 112-139.
6. Berkhardt, H., & Schoenfeld, A. H. (2003). Improving educational research: Toward a more useful, more influential, and better-funded enterprise. Educational Researcher, 32, 3-14.
7. Bernardo, J. M. (1984). Monitoring the 1982 Spanish socialist victory: A Bayesian analysis. Journal of the American Statistical Association, 79, 510-515.
8. Billingsley, P. (1986). Probability and measure. New York: Wiley.
9. Birnbaum, A. (1962). On the foundations of statistical inference. Journal of the American Statistical Association, 57, 269-306.
10. Brodsky, B. E., & Darkhovsky, B. W. (1993). Nonparametric methods in change point problems. Dordrecht, The Netherlands: Kluwer.
11. Carlin, B. P., & Louis, T. A. (2001). Bayes and empirical Bayes methods for data analysis. 2nd ed. New York: Chapman & Hall.
12. Carver, R. P. (1978). The case against statistical significance testing. Harvard Education Review, 48, 378-399.
13. Carver, R. P. (1993). The case against statistical significance testing, revisited. Journal of Experimental Education, 61, 287-292.
14. Cohen, J. (1962). The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145-153.
15. Cohen, J. (1977). Statistical power analysis for the behavioral sciences. New York: Academic Press.
16. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates.
17. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 115-159.
18. Cohen, J. (1994). The Earth is round (p < .05). American Psychologist, 12, 997-1003.
19. Dalai, S. R., & Hall, G. J., Jr. (1980). On approximating parametric Bayes models by nonparametric Bayes models. Annals of Statistics, 8, 664-772.
20. Darkhovsky, B. S. (1994). Nonparametric methods in change-point problems: A general approach and some concrete algorithms. In E. Carlstein, H. Möller, & D. Siegmund (Eds,), Change-point problems, pp.99-107. Hayward, CA: Institute of Mathematical Statistics.
21. deFinetti, B. (1972). Probability, induction, and statistics. New York: Wiley.
22. de Finetti, B. (1974). Theory of probability, Vol. 1. New York: Wiley.
23. de Finetti, B. (1975). Theory of probability, Vol. 2. New York: Wiley.
24. DeGroot, G. J. (2004). The bomb: A life. Cambridge, MA: Harvard University Press.
25. Denis, D. J. (2005). The modern hypothesis testing hybrid: R. A. Fisher's fading influence. Journal de la Société Frangaise de Statistique, 145, 5-26.
26. Efronv B. (1986). Why isn't everyone a Bayesian? American Statistician, 40, 1-11.
27. Falk, R., & Greenbaum, C. W. (1995). Significance tests die hard. Theory and Psychology, 5, 396-400.
28. Ferguson, T. S. (1973). A Bayesian analysis of some nonparametric problems. Annals of Statistics, 1, 209-230.
29. Gelfand, A. E., & Smith, A. F. M. (1990). Sampling based approaches to calculating marginal densities. Journal of the American Statistical Association, 85, 398-409.
30. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003). Bayesian data analysis. New York: Chapman & Hall.
31. Gigerenzer, G. (1987). Probabilistic thinking and the fight against subjectivity. In L. Krüger, G. Gigerenzer, & M. Morgan (Eds.), The probabilistic revolution, Vol. 2. Cambridge, MA: MIT Press.
32. Gigerenzer, G. (1993). The superego, the ego, and the id in statistical reasoning. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences: Methodological issues. Hillsdale, NJ: Lawrence Erlbaum Associates.
33. Gigerenzer, G. (1998). Surrogates for theories. Theory and Psychology, 8, 195-204.
34. Gigerenzer, G., & Murray, D. J. (1987). Cognition as intuitive statistics. Hillsdale, NJ: Lawrence Erlbaum Associates.
35. Gill, J. (1999). The insignificance of null hypothesis significance testing. Political Research Quarterly, 52, 647-674.
36. Gill, J. (2007). Bayesian methods for the social and behavioral sciences. 2nd ed. New York: Chapman & Hall.
37. Gliner, J. A., Vaske, J. J., & Morgan, G. A. (2004). Null hypothesis significance testing: Effect size matters. Journal of Human Dimensions of Wildlife Issues, 6, 291-301.
38. Grayson, D. A. (1998). The frequentist facade and the flight from evidential inference. British Journal of Psychology, 89, 325-345.
39. Greenwald, A. G. (1975). Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82, 1-20.
40. Greenwald, A. G., Gonzalez, R., Harris, R. J., & Guthrie, D. (1996). Effect sizes and p-values: What should be reported and what should be replicated? Psychophysiology, 33, 175-183.
41. Hager, W. (2000). About some misconceptions and the discontent with statistical tests in psychology. Methods on Psychological Research, 5, 1-31.
42. Howson, C, & Urbach, P. (1993). Scientific reasoning: The Bayesian approach, 2nd ed. Chicago: Open Court.
43. Hunter, J. E. (1997). Needed: A ban on the significance test. Psychological Science, 8, 3-7.
44. Hunter, J. E., & Schmidt, F. L. (1990). Methods ofmeta-analysis: Correcting error and bias in research findings. Beverly Hills, CA: Sage.
45. Jeffreys, H. (1961). The theory of probability. Oxford, UK: Oxford University Press.
46. Kass, R. E., & Raftery, A. E. (1995). Bayes factors. Journal of the American Statistical Association, 90, 773-795.
47. Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746-759.
48. Krueger, J. (2001). Null hypothesis significance testing: On the survival of a flawed method. American Psychologist, 56, 16-26.
49. Laplace, P. S. (1774). Mémoire sur la Probabilité des Causes par le Événemens. Mémoires de l'Académie Royale des Sciences Presentes par Divers Savans, 6, 621-656.
50. Laplace, P. S. (1781). Mémoire sur la Probabilités. Mémoires de l'Académie Royale des Sciences de París, 1778, 227-332.
51. Laplace, P. S. (1811). Mémoire sur les Integrales Définies et leur Application aux Probabilités, et Specialemement ä Recherche du Milieu Qu'il Faut Chosier Entre les Resultats des Observations. Mémoires de l'Académie des Sciences de Paris, 279-347.
52. Laplace, P. S. (1814). Essai Philosophique sur les la Probabilités. Paris: Ve Courcier.
53. Lecoutre, B., Lecoutre, M. R, & Poitevineau, J. (2001). Uses, abuses and misuses of significance tests in the scientific community: Won't the Bayesian choice be unavoidable? International Statistical Review, 69, 399-18.
54. Lindsay, R. M. (1995). Reconsidering the status of tests of significance: An alternative criterion of adequacy. Accounting, Organizations and Society, 20, 35-53.
55. Little, R.J. A. (2006). Calibrated Bayes: A Bayes/Frequentist roadmap. American Statistician, 60,213-223.
56. Little, R. J. A. & Rubin, D. B. (1983). On jointly estimating parameters and missing data by maximizing the complete-data likelihood. The American Statistician, 37, 218-220.
57. Little, R. J. A., & Rubin, D. B. (1987). Statistical analysis with missing data. New York: Wiley.
58. Liu, J. S. (1996). Nonparametric hierarchical Bayes via sequential imputations. Annals of Statistics, 24,911-930.
59. Loftus, G. R. (1991). On the tyranny of hypothesis testing in the social sciences. Contemporary Psychology, 36, 102-105.
60. Loftus, G. R. (1993a). Editorial comment. Memory and Cognition, 21, 1-3.
61. Loftus, G. R. (1993b). Visual data representation and hypothesis testing in the microcomputer age. Behavior Research Methods, Instrumentation, and Computers, 25, 250-256.
62. Loftus, G. R. (1994). The reality of repressed memories. American Psychologist, 48,518-537.
63. Loftus, G. R. (1996). Psychology will be a much better science when we change the way we analyze data. Current Directions in Psychological Science, 5, 161-171.
64. Loftus, G. R. & Bamber, D. (1990). Weak models, strong models, unidimensional models, and psycho-logical time. Journal of Experimental Psychology: Learning, Memory, and Cognition, 76,916-926.
65. López, E. (2003) Las pruebas de significación: una polémica abierta. Bordón, 55, 241-252.
66. Macdonald, R. R. (1997). On statistical testing in psychology. British Journal of Psychology, 88, 333-349.
67. McGilchrist, C. A., & Woodyer, K. D. (1975). Note on a distribution-free CUSUM technique. Technometrics, 77, 321-325.
68. Meehl, P. E. (1967). Theory-testing in psychology and physics: A methodological paradox. Philosophy of Science, 34, 103-115.
69. Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Counseling and Clinical Psychology, 46, 806-834.
70. Meehl, P. E. (1990). Why summaries of research on psychological theories are often uninterpretable. Psychological Reports, 66, 195-244.
71. Menon, R. (1993). Statistical significance testing should be discontinued in mathematics education research. Mathematics Education Research Journal, 5,4-18.
72. Morris, C.N. (1983). Parametric empirical Bayes inference: Theory and applications. Journal of the American Statistical Association, 78, 47-65.
73. Neyman, J., & Pearson, E. S. (1928a). On the use and interpretation of certain test criteria for purposes of statistical inference. Part I. Biometrika, 20A, 175-240.
74. Neyman, J., & Pearson, E. S. (1928b). On the use and interpretation of certain test criteria for purposes of statistical inference. Part II. Biometrika, 20A, 263-294.
75. Neyman, J., & Pearson, E. S. (1933a). On the problem of the most efficient test of statistical hypotheses. Philosophical Transactions of the Royal Statistical Society, Series A, 231, 289-337.
76. Neyman, J., & Pearson, E. S. (1933b). The testing of statistical hypotheses in relation to probabilities. Proceedings of the Cambridge Philosophical Society, 24, 492-510.
77. Neyman, J., & Pearson, E. S. (1936a). Contributions to the theory of testings statistical hypotheses. Statistical Research Memorandum, 1, 1-37.
78. Neyman, J., & Pearson, E. S. (1936b). Sufficient statistics and uniformly most powerful tests of statistical hypotheses. Statistical Research Memorandum, 1, 113-137.
79. Nickerson, R. S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5, 241-301.
80. Oakes, M. (1986). Statistical inference: A commentary for the social and behavioral sciences. New York: Wiley.
81. Page, E. S. (1957). On problems in which a change in parameter occurs at an unknown point. Biometrika, 44, 248-252.
82. Pettitt, A. N. (1979). A non-parametric approach to the change-point problem. Applied Statistics, 28,126-135.
83. Pollard, P. (1993). How significant is "significance"? In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences: Methodological issues, Hillsdale, NJ: Lawrence Erlbaum Associates.
84. Pollard, P., & Richardson, J. T. E. (1987). On the probability of making type one errors. Psychological Bulletin, 102, 159-163.
85. Robinson D. H., & Levin, J. R. (1997). Reflections on statistical and substantive significance, with a slice of replication. Educational Researcher, 26, 21-26.
86. Rosnow, R. L., & Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44, 1276-84.
87. Rozeboom, W. W. (1960). The fallacy of the null hypothesis significance test. Psychological Bulletin, 57,416-428.
88. Rubin, D. B. (1987). Multiple imputation for nonresponse in surveys. New York: Wiley.
89. Schaefer, J. L. (1997). Analysis of incomplete multivariate data. London: Chapman & Hall.
90. Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for the training of researchers. Psychological Methods, 1, 115-129.
91. Schmidt, F. L., & Hunter, J. E. (1977). Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, 529-540.
92. Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies. Psychological Bulletin, 105, 309-316.
93. Sen, A., & Srivastava, M. S. (1975a). On tests for detecting change in mean. Annals of Statistics, 3, 98-108.
94. Sen, A., & Srivastava, M. S. (1975b). Some one-sided tests for changes in level. Technometrics, 17, 61-64.
95. Shaban, S. A. (1980). Change point problem and two-phase regression: An annotated bibliography. International Statistical Review, 48, 83-93.
96. Thompson, B. 2002. What future quantitative social science research could look like: Confidence intervals for effect sizes. Educational Researcher, 31, 25-32.
97. Wald, A. (1950). Statistical decision functions. New York: Wiley.
98. Wilkinson, G. N. (1977). On resolving the controversy in statistical inference. Journal of the Royal Statistical Society, Series B, 39, 119-171.
99. Woodward, W. A., & Gray, H. L. (1993). Global warming and the problem of testing for trend in time-series data. Journal of Climate, 6, 953-962.
100. Yoccoz, N. G. (1991). Use, overuse, and misuse of significance tests in evolutionary biology and ecology. Bulletin of the Ecological Society of America, 72, 106-111.