Severe testing as a basic concept in a Neyman-Pearson philosophy of induction

British Journal for the Philosophy of Science

Volumn 57, Issue 2, 2006, Pages 323-357

  Mayo, Deborah G ^a   Spanos, Aris ^a  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33745505741     PISSN: 00070882     EISSN: 14643537     Source Type: Journal    
DOI: 10.1093/bjps/axl003     Document Type: Article

References (110)

1. Achinstein, P. [2003]: The Book of Evidence, Oxford: Oxford University Press.
2. Armitage, P. [1961]: 'Contribution to the discussion in Smith, C.A.B., "Consistency in Statistical Inference and Decision" ', Journal of the Royal Statistical Society, B, 23, pp. 1-37.
3. Bailey, D. E. [1971]: Probability and Statistics, New York: Wiley.
4. Barnard, G. A. [1949]: 'Statistical Inference (with Discussion)', Journal of the Royal Statistical Society, B, 11, pp. 115-139.
5. Barnard, G. A. [1971]: 'Scientific Inferences and Day to Day Decisions,' pp. 289-300 in V. Godambe and D. Sprott (eds.), Foundations of Statistical Inference: A Symposium, Holt, Rinehart and Winston of Canada, Toronto.
6. Berger, J. O. [2003]: 'Could Fisher, Jeffreys and Neyman Have Agreed?', Statistical Science, 18, pp. 1-12.
7. Birnbaum, A. [1969]: 'Concepts of Statistical Evidence', in S. Morgenbesser, P. Suppes, and M. White (eds.), Philosophy, Science, and Method: Essays in Honor of Ernest Nagel, New York: St. Martin's Press, pp. 112-43.
8. Birnbaum, A. [1977]: 'The Neyman-Pearson Theory as Decision Theory, and as Inference Theory; with a Criticism of the Lindley-Savage Argument for Bayesian Theory', Synthese, 36, pp. 19-49.
9. Carnap, R. [1962]: Logical Foundations of Probability, 2nd edn. The University of Chicago Press, Routledge & Kegan Paul, London.
10. Cohen, J. [1988]: Statistical Power Analysis for the Behavioral Sciences, 2nd edn., Hillsdale, NJ: Erlbaum.
11. Cox, D. R. [1958]: 'Some Problems Connected with Statistical Inference,' Annals of Mathematical Statistics, 29, pp. 357-72.
12. Cox, D. R. [1977]: 'The Role of Significance Tests (with discussion)', Scandinavian Journal of Statistics, 4, pp. 49-70.
13. Cox, D. R. [1997]: 'The Nature of Statistical Inference: Johann Bernoulli Lecture 1997', Vierde Serie Deel, 15, pp. 233-42.
14. Cox, D. R. [2006]: Principles of Statistical Inference, Cambridge: Cambridge University Press.
15. Cox, D. R. and Hinkley, D. V. [1974]: Theoretical Statistics, London: Chapman & Hall.
16. De Finetti, B. [1972]: Probability, Induction and Statistics: The Art of Guessing, New York: John Wiley & Sons.
17. Earman, J. [1992]: Bayes or Bust? A Critical Examination of Bayesian Confirmation Theory, Cambridge, MA: MIT Press.
18. Edwards, A. W. F. [1972]: Likelihood: An Account of the Statistical Concept of Likelihood and its Application to Scientific Inference, Cambridge: Cambridge University Press.
19. Edwards, W., Lindman, H. and Savage, L. [1963]: 'Bayesian Statistical Inference for Psychological Research', Psychological Review, 70, pp. 193-242.
20. Efron, B. [1986]: 'Why Isn't Everyone a Bayesian?' The American Statistician, 40, pp. 1-4.
21. Fetzer, J. H. [1981]: Scientific Knowledge: Causation, Explanation, and Corroboration, Dordrecht: D. Reidel.
22. Fisher, R. A. [1930]: 'Inverse Probability,' Proceedings of the Cambridge Philosophical Society, 26, pp. 528-35.
23. Fisher, R. A. [1935]: 'The Logic of Inductive Inference', Journal of the Royal Statistical Society, 98, pp. 39-54.
24. Fisher, R. A. [1955]: 'Statistical Methods and Scientific Induction,' Journal of the Royal Statistical Society, B, 17 pp. 69-78.
25. Fisher, R. A. [1956]: Statistical methods and scientific inference, Edinburgh: Oliver and Boyd.
26. Freedman, D. A. [1995]: 'Some Issues in the Foundations of Statistics,' Foundations of Science, 1, pp. 19-83 (with discussion).
27. Gibbons, J. D. and Pratt, J. W. [1975]: 'P-values: Interpretation and Methodology,' The American Statistician, 29, pp. 20-5.
28. Giere, R. N. [1976]: 'Empirical Probability, Objective Statistical Methods, and Scientific Inquiry', in W. L. Harper and C. A. Hooker (eds.), Foundations of Probability Theory, Statistical Inference and Statistical Theories of Science, Vol. II, Boston: D. Reidel, pp. 63-101.
29. Giere, R. N. [1984]: Understanding Scientific Reasoning, 2nd edn., New York: Holt, Rinehart and Winston.
30. Gigerenzer, G. [1993]: 'The superego, the ego, and the id in statistical reasoning,' in G. Keren and C. Lewis (eds.), A Handbook of Data Analysis in the Behavioral Sciences: Methodological Issues, Hillsdale, New Jersey: Lawrence Erlbaum Associates, pp. 311-39.
31. Gillies, D. A. [1973]: An Objective Theory of Probability, London: Methuem.
32. Glymour, C. [1980]: Theory and Evidence, Princeton: Princeton University Press.
33. Glymour, C., Scheines, R., Spirtes, P. and Kelly, K. [1987]: Discovering Causal Structure: Artificial Intelligence, Philosophy of Science, and Statistical Modeling, Orlando: Academic Press.
34. Godambe, V. and Sprott, D. (eds.) [1971]: Foundations of Statistical Inference, Toronto: Holt, Rinehart and Winston of Canada.
35. Good, I. J. [1983]: Good Thinking, Minneapolis: University of Minnesota Press.
36. Hacking, I. [1965]: Logic of Statistical Inference, Cambridge: Cambridge University Press.
37. Hacking, I. [1980]: The Theory of Probable Inference: Neyman, Peirce and Braithwaite', in D. H. Mellor (ed.), Science, Belief and Behavior: Essays in Honour of R. B. Braithwaite, Cambridge: Cambridge University Press, pp. 141-60.
38. Harlow, L. L., Mulaik, S. A. and Steiger, J. H. [1997]: What if there were no Significance Tests? Mahwah, NJ: Erlbaum.
39. Harper, W. L. and Hooker C. A. (eds.) [1976]: Foundations of Probability Theory, Statisical Inference and Statistical Theories of Science. Vol. 2, Dordrecht, The Netherlands: D. Reidel.
40. Horwich, P. [1982]: Probability and Evidence, Cambridge: Cambridge University Press.
41. Howson, C. [1995]: 'Theories of Probability,' British Journal for the Philosophy of Science, 46, pp. 1-32.
42. Howson, C. [1997]: 'A Logic of Induction', Philosophy of Science, 64, pp. 268-90.
43. Howson, C. and Urbach, P. [1989]: Scientific Reasoning: The Bayesian Approach 2nd edn, 1993, La Salle, IL: Open Court.
44. Jeffreys, H. [1939]: Theory of Probability, 3rd edn., 1961, Oxford: Oxford University Press.
45. Kass, R. E. and Wasserman, L. [1996]: 'Formal rules of selecting prior distributions: a review and annotated bibliography,' Journal of the American Statistical Association, 91, pp. 1343-70.
46. Kempthorne, O. [1976]: 'Statistics and the Philosophers,' in W. L. Harper and C. A. Hooker (eds.). Foundations of Probability Theory, Statistical Inference and Statistical Theories of Science, Vol. II, Boston: D. Reidel, pp. 273-314.
47. Kempthorne, O. and Folks, L. [1971]: Probability, Statistics, and Data Analysis, Ames, IA: The Iowa State University Press.
48. Kiefer, J. [1977]: 'Conditional Confidence Statements and Confidence Estimators,' Journal of the American Statistical Association, 72, pp. 789-827.
49. Kyburg, H. E. Jr. [1974]: The Logical Foundations of Statistical Inference, Dordrecht: Reidel.
50. Lakatos, I. [1978]: The Methodology of Research Programmes, edited by J. Worrall and G. Currie (eds.), vol. 1, Philosophical Papers, Cambridge: Cambridge University Press.
51. LeCam, L. [1977]: 'A Note on Metastatistics or "An Essay Toward Stating a Problem in the Doctrine of Chances" ', Synthese, 36, pp. 133-60.
52. Lehmann, E. L. [1986]: Testing Statistical Hypothesen, 2nd edition, New York: Wiley:
53. Lehmann, E. L. [1993]: 'The Fisher and Neyman-Pearson Theories of Testing Hypotheses: One Theory or Two?' Journal of the American Statistical Association, 88, pp. 1242-9.
54. Lehmann, E. L. [1995]: 'Neyman's Statistical Philosophy', Probability and Mathematical Statistics, 15, pp. 29-36.
55. Levi, I. [1980]: The Enterprise of Knowledge: An Essay on Knowledge, Credal Probability and Chance, Cambridge, MA: MIT Press.
56. Lindley, D. V. [1957]: 'A Statistical Paradox', Biometrika, 44, pp. 187-92.
57. Mayo, D. G. [1983]: 'An Objective Theory of Statistical Testing,' Synthese, 57, pp. 297-340.
58. Mayo, D. G. [1985]: 'Behavioristic, Evidentialist, and Learning Models of Statistical Testing', Philosophy of Science, 52, pp. 493-516.
59. Mayo, D. G. [1991 a]: 'Novel Evidence and Severe Tests', Philosophy of Science, 58, pp. 523-52.
60. Mayo, D. G. [1991b]: 'Sociological vs. Metascientific Theories of Risk Assessment', in D. Mayo and R. Hollander (eds.), Acceptable Evidence: Science and Values in Risk Management, New York: Oxford University Press, pp. 249-79.
61. Mayo, D. G. [1992]: 'Did Pearson Reject the Neyman-Pearson Philosophy of Statistics?', Synthese, 90, pp. 233-62.
62. Mayo, D. G. [1996]: Error and the Growth of Experimental Knowledge, Chicago, IL: The University of Chicago Press.
63. Mayo, D. G. [2000]: 'Models of Error and the Limits of Experimental Testing', in M. Carrier, G. J. Massey and L. Reutsche (eds,), Science at Century's End: Philosophical Questions on the Progress and Limits of Science, Pittsburgh: University of Pittsburgh/University of Konstanz Press, pp. 317-44.
64. Mayo, D. G. [2002]: 'Theory Testing, Statistical Methodology, and the Growth of Experimental Knowledge', Proceedings of the International Congress for Logic, Methodology, and Philosophy of Science, Dordrecht: Kluwer.
65. Mayo, D. G. [2003a]: 'Severe Testing as a Guide for Inductive Learning,' in H. Kyburg (ed.), Probability Is the Very Guide in Life, Open Court, Chicago, pp. 89-117.
66. Mayo, D. G. [2003b]: 'Could Fisher, Jeffreys and Neyman Have Agreed? Commentary on J. Berger's Fisher Address', Statistical Science, 18, pp. 19-24.
67. Mayo, D. G. [2004a]: 'An Error-Statistical Philosophy of Evidence,' in M. Taper and S. Lele (eds.), The Nature of Scientific Evidence: Statistical, Philosophical, and Empirical Consideration,' Chicago, IL: University of Chicago Press, pp. 79-97; 101-18.
68. Mayo, D. G. [2004b]: 'Evidence as Passing Severe Tests: Highly Probed vs. Highly Proved,' in P. Achinstein (ed.), Scientific Evidence, Baltimore, MD: Johns Hopkins University Press, pp. 95-127.
69. Mayo, D. G. [2005]: 'Philosophy of Statistics,' in S. Sarkar and J. Pfeifer (eds.), Philosophy of Science: An Encyclopedia, London: Routledge, pp. 802-15.
70. Mayo, D. G. [2006]: 'Critical Rationalism and Its Failure to Withstand Critical Scrutiny', in C. Cheyne and J. Worrall (eds.), Rationality and Reality: Conversations with Alan Musgrave, Kluwer series Studies in the History and Philosophy of Science, Dordrecht: Springer, pp. 63-96.
71. Mayo, D. G. and Cox, D. R. [2006]: 'Frequentist Statistics as a Theory of Inductive Inference,' forthcoming in The Second Erich L. Lehmann Symposium, Institute of Mathematical Statistics.
72. Mayo, D. G. and Kruse, M. [2001]: 'Principles of Inference and their Consequences', in D. Cornfield and J. Williamson (eds.), Foundations of Bayesianism, Dordrecht: Kluwer Academic Publishers, pp. 381-403.
73. Mayo, D. G. and Spanos, A. [2004]: 'Methodology in Practice: Statistical Misspecification Testing,' Philosophy of Science, 71, pp. 1007-25.
74. Meehl, P. E. [1967/1970]: Theory-Testing in Psychology and Physics: A Methodological Paradox,' Philosophy of Science, 34, pp. 103-15. Reprinted in Morrison, D. E. and Henkel, R. [1970].
75. Meehl, P. E. [1997]: 'The Problem is Epistemology, not Statistics: Replacing Tests by Confidence Intervals and Quantify Accuracy of Risk Numerical Predictions,' in Harlow, L. L., Mulaik, S. A. and Steiger, J. H. [1997].
76. Morrison, D. and Henkel, R. (eds.) [1970]: The Significance Test Controversy, Chicago, IL: Aldine.
77. MSERA [1998]: 'Special Issue: Statistical Significance Testing,' Research in the Schools, 5.
78. Musgrave, A. [1999]: Essays in Realism and Rationalism, Atlanta, GA: Rodopi.
79. Neyman, J. [1937]: 'Outline of a theory of statistical estimation based on the classical theory of probability,' Philosophical Transactions of the Royal Society, A, 236, pp. 333-80.
80. Neyman, J. [1952]: Lectures and conferences on mathematical statistics and probability, 2nd edn., Washington, DC: U.S. Department of Agriculture.
81. Neyman, J. [1955]: 'The Problem of Inductive Inference,' Communications on Pure and Applied Mathematics, VIII, pp. 13-46.
82. Neyman, J. [1956]: 'Note on an Article by Sir Ronald Fisher,' Journal of the Royal Statistical Society, Series B (Methodological), 18, pp. 288-94.
83. Neyman, J. [1957a]: 'Inductive Behavior as a Basic Concept of Philosophy of Science,' Revue d'Instituts International da Statistique, 25, pp. 7-22.
84. Neyman, J. [1957b]: 'The Use of the Concept of Power in Agricultural Experimentation,' Journal of the Indian Society of Agricultural Statistics, IX, pp. 9-17.
85. Neyman, J. [1971]: 'Foundations of Behavioristic Statistics,' in V. Godambe and D. Sprott (eds.), Foundations of Statistical Inference: A Symposium, Toronto: Holt, Rinehart and Winston of Canada, pp. 1-13 (comments and reply, pp. 14-9).
86. Neyman, J. [1976]: 'Tests of Statistical Hypotheses and their use in Studies of Natural Phenomena,' Communications in Statistics - Theory and Methods, 5, pp. 737-51.
87. Neyman, J. [1977]: 'Frequentist Probability and Frequentist Statistics,' Synthese, 36, pp. 97-131.
88. Neyman, J. and Pearson, E. S. [1933]: 'On the problem of the most efficient tests of statistical hypotheses', Philosophical Transactions of the Royal Society, A, 231, pp. 289-337. Reprinted in Neyman, J. and Pearson, E. S. [1966].
89. Neyman, J. and E. S. Pearson [1966]: Joint Statistical Papers, Berkeley, CA: University of California Press.
90. Pearson, E. S. [1947]: 'The Choice of Statistical Tests Illustrated on the Interpretation of Data Classed in a 2 × 2 Table,' Biometrika, 34, pp. 139-67.
91. Pearson, E. S. [1950]: 'On Questions Raised by the Combination of Tests Based on Discontinuous Distributions,' Biometrika, 39 pp. 383-98. Reprinted in Pearson, E. S. [1966].
92. Pearson, E. S. [1955]: 'Statistical Concepts in Their Relation to Reality,' Journal of the Royal Statistical Society, B, 17, pp. 204-7. Reprinted in Pearson, E. S. [1966].
93. Pearson, E. S. [1962]: 'Some Thoughts on Statistical Inference,' Annals of Mathematical Statistics, 33: pp. 394-403. Reprinted in Pearson, E. S. [1966].
94. Pearson, E. S. [1966]: The Selected Papers of E.S. Pearson, Cambridge: Cambridge University Press.
95. Pierce, C. S. [1931-5]: Collected Papers, Vols. 1-6, Hartshorne and Weiss, P. (eds.), Cambridge: Harvard University Press.
96. Popper, K. [1959]: The Logic of Scientific Discovery, New York: Basic Books.
97. Popper, K. [1983]: Realism and the aim of science, Totowa, NJ: Rowman and Littlefield.
98. Popper, K. [1994]: The Myth of the Framework', in N. A. Notturno (ed.), Defence of Science and Rationality, London: Routledge.
99. Pratt, J. W. [1976]: 'A Discussion of the Question: for What Use are Tests of Hypotheses and Tests of Significance', Communications in Statistics-Theory and Methods, 5, pp. 779-87.
100. Rosenkrantz, R. [1977]: Inference, Method and Decision: Towards a Bayesian Philosophy of Science, Dordrecht: Reidel.
101. Rosenthal, R. [1994]: 'Parametric Measures of Effect Sizes,' in H. M. Cooper and L. V. Hedges (eds.), The Handbook of Research Synthesis, Newbury, CA: Sage, pp. 231-44.
102. Rosenthal, R. and Gaito, J. [1963]: 'The Interpretation of Levels of Significance by Psychological Researchers,' Journal of Psychology, 55, pp. 33-8.
103. Royall, R. [1997]: Statistical Evidence: A Likelihood Paradigm, London: Chapman & Hall.
104. Salmon, W. [1966]: The Foundations of Scientific Inference, Pittsburgh: University of Pittsburgh Press.
105. Savage, L. J. [1964]: 'The Foundations of Statistics Reconsidered', in H. E. Kyburg and H. E. Smokier (eds.), Studies in Subjective Probability, New York: John Wiley and Sons, pp. 173-88.
106. Seidenfeld, T. [1979]: Philosophical Problems of Statistical Inference: Learning from R. A. Fisher, Dordrecht: D. Reidel.
107. Spanos, A. [1999]: Probability Theory and Statistical Inference: Econometric Modeling with Observational Data, Cambridge: Cambridge University Press.
108. Spanos, A. [2006]: 'Revisiting the Omitted Variables Argument: Substantive vs. Statistical Adequacy,' forthcoming in the Journal of Economic Methodology.
109. Spielman, S. [1973]: 'A Refutation of the Neyman-Pearson Theory of Testing', British Journal for the Philosophy of Science, 24, pp. 201-22.
110. Thompson, B. [1996]: 'AERA Editorial Policies regarding Statistical Significance Testing: Three suggested Reforms,' Educational Researcher, 25, pp. 26-30.