Sound and fury: McCloskey and significance testing in economics

Journal of Economic Methodology

Volumn 15, Issue 1, 2008, Pages 1-37

  Hoover, Kevin D ^a   Siegler, Mark V ^b  

^a DUKE UNIVERSITY   (United States)

^b CALIFORNIA STATE UNIVERSITY   (United States)

Author keywords

Deidre McCloskey; Economic significance; Neyman Pearson testing; R.A. Fisher; Significance tests; Specification search; Statistical significance; Stephen Ziliak

Indexed keywords

EID: 41249085631     PISSN: 1350178X     EISSN: 14699427     Source Type: Journal    
DOI: 10.1080/13501780801913298     Document Type: Article

References (75)

1. Becker, G.S., Grossman, M., and Murphy, K.M. (1994), "An Empirical Analysis of Cigarette Addiction," American Economic Review, 84(3), 396-418.
2. Bernanke, B.S., and Blinder, A.S. (1992), "The Federal Funds Rate and the Channels of Monetary Transmission," American Economic Review, 82(4), 901-921.
3. Bernheim, B.D., and Wantz, A. (1995), "A Tax-Based Test of the Dividend Signaling Hypothesis," American Economic Review, 85(3), 532-551.
4. Blank, R.M. (1991), "The Effects of Double-Blind versus Single-Blind Reviewing: Experimental Evidence in the American Economic Review", 81(5), 1041-1067.
5. Chen, Y.T., Cook, A.H., and Metherell, A.J.F. (1984), "An Experimental Test of the Inverse Square Law of Gravitation at Range of 0.1 m," Proceedings of the Royal Society of London, Ser. A (Mathematical and Physical Sciences), 394(1806), 47-68.
6. Cooley, T.F., and LeRoy, S.F. (1981), "Identification and Estimation of the Money Demand," American Economic Review, 71(5), 825-844.
7. Darby, M.R. (1984), "The U.S. Productivity Slowdown: A Case of Statistical Myopia," American Economic Review, 74(3), 301-322.
8. Economist (2004), "Signifying Nothing?," The Economist, 370(8360) January 31, 2004, 71.
9. Edgeworth, F.Y. (1885), "Methods of Statistics," Jubilee Volume of the Statistical Society, Royal Statistical Society of Britain, pp. 181-217.
10. Elliott, G., and Granger, C.W.J. (2004), "Evaluating Significance: Comments on 'Size Matters'," Journal of Socio-Economics, 33(5), 547-550.
11. Feynman, R.P. (1985), Surely You're Joking, Mr. Feynman, New York: Norton.
12. Fisher, R.A. (1946), Statistical Methods for Research Workers (10th ed.), Edinburgh: Oliver and Boyd.
13. Fogel, R.W. (1964), Railroads and American Economic Growth: Essays in Econometric History, Baltimore: Johns Hopkins Press.
14. Haavelmo, T. (1944), "The Probability Approach in Econometrics," Econometrica, 12(Supplement), 1-115.
15. Hendry, D.F. (1980), "Econometrics: Alchemy or Science?," in Econometrics: Alchemy or Science (2nd ed.), Oxford: Blackwell, pp. 1-28.
16. Hendry, D.F., and Krolzig, H.-M. (1999), "Improving on 'Data Mining Reconsidered' by K.D. Hoover and S.J. Perez," Econometrics Journal, 2(2), 202-218.
17. Hendry, D.F., and Krolzig, H.-M. (2004), "Automatic Model Selection: A New Instrument for Social Science," Electoral Studies, 23, 525-544.
18. Hennekens, C.H., et al. (1988), "Preliminary Report: Findings from the Aspirin Component of the Ongoing Physicians' Health Study," New England Journal of Medicine, 318(4), 262-264.
19. Hoover, K.D. (1994), "Econometrics as Observation: The Lucas Critique and the Nature of Econometric Inference," Journal of Econometric Methodology, 1(1), 65-80.
20. Hoover, K.D. (1995), "In Defense of Data Mining: Some Preliminary Thoughts," in Monetarism and the Methodology of Economics: Essays in Honour of Thomas Mayer, eds. K.D. Hoover and S.M. Sheffrin, Aldershot: Edward Elgar, pp. 242-257.
21. Hoover, K.D. (2001), Causality in Macroeconomics, Cambridge: Cambridge University Press.
22. Hoover, KD., and Perez, S.J. (1999), "Data Mining Reconsidered: Encompassing and the General-to-Specific Approach to Specification Search," Econometrics Journal, 2(2), 167-191.
23. Hoover, K.D., and Perez, S.J. (2000), "Three Attitudes Towards Data Mining," Journal of Economic Methodology, 7(2), 195-210.
24. Hoover, K.D., and Perez, S.J. (2004), "Truth and Robustness in Cross Country Growth Regressions," Oxford Bulletin of Economics and Statistics, 66(5), 765-798.
25. Horowitz, J.L. (2004), "Comments on 'Size Matters'," Journal of Socio-Economics, 3(5), 551-554.
26. Johansen, S. (2006), "Confronting the Data," in Post Walrasian Macroeconomics, ed. D. Colander, Cambridge: Cambridge University Press, pp. 287-300.
27. Johnston, J. (1972), Econometric Methods (2nd ed.), New York: McGraw-Hill.
28. Kahn, J.A., Landsburg, S.E., and Stockman, A.C. (1996), "The Positive Economics of Methodology," Journal of Economic Theory, 68(1), 64-76.
29. Keuzenkamp, H.A. (2000), Probability, Econometrics, and Truth, Cambridge: Cambridge University Press.
30. Keuzenkamp, H.A., and Magnus, J. (1995), "On Tests and Significance in Econometrics," Journal of Econometrics, 67(1), 5-24.
31. Krolzig, H.-M., and Hendry, D.F. (2001), "Computer Automation of General-to-Specific Model Selection Procedures," Journal of Economic Dynamics and Control, 25(6-7), 831-866.
32. Kruskal, W.H. (1968a), "Tests of Significance," in International Encylopedia of Social Sciences (Vol. 14), ed. D. Sills, New York: Macmillan and Free Press, pp. 238-250.
33. Kruskal, W.H. (1968b), "Statistics: The Field," in International Encylopedia of Social Sciences (Vol. 15), ed. D. Sills, New York: Macmillan and Free Press, pp. 206-224.
34. Learner, E.E. (1978), Specification Searches: Ad Hoc Inference with Nonexperimental Data, Boston: John Wiley.
35. Learner, E.E. (1983), "Let's Take the Con out of Econometrics," American Economic Review, 73(1), 31-43.
36. Levine, R., and Renelt, D. (1992), "A Sensitivity Analysis of Cross-Country Growth Regressions," American Economic Review, 82(4), 942-963.
37. Lovell, M.C. (1983), "Data Mining," Review of Economics and Statistics, 65(1), 1-12.
38. Mayo, D. (1996), Error and the Growth of Experimental Knowledge, Chicago: University of Chicago Press.
39. McAleer, M., Pagan, A.F., and Volker, P.A. (1985), "What Will Take the Con out of Econometrics," American Economic Review, 75(3), 293-307.
40. McCloskey, D.N. (1985a), The Rhetoric of Economics (1st ed.), Madison: University of Wisconsin Press.
41. McCloskey, D.N. (1985b), "The Loss Function Has Been Mislaid: The Rhetoric of Significance Tests," American Economic Review, 75(2), 201-205.
42. McCloskey, D.N. (1992), "Other Things Equal: The Bankruptcy of Statistical Significance," Eastern Economic Journal, 18(3), 359-361.
43. McCloskey, D.N. (1994a), Knowledge and Persuasion in Economics, Cambridge: Cambridge University Press.
44. McCloskey, D. (1994b), "How Economists Persuade," Journal of Economic Methodology, 1(1), 15-32.
45. McCloskey, D.N. (1995a), "The Insignificance of Statistical Significance," Scientific American, 272(4), 32-33.
46. McCloskey, D.N. (1995b), "Computation Outstrips Analysis," Scientific American, 272(7), 26.
47. McCloskey, D.N. (1997), "Other Things Equal: Aunt Deirdre's Letter to a Graduate Student," Eastern Economic Journal, 23(2), 241-244.
48. McCloskey, D.N. (1998), The Rhetoric of Economics (2nd ed.), Madison, WI: University of Wisconsin Press.
49. McCloskey, D.N. (1999), "Other Things Equal: Cassandra's Open Letter to Her Economist Colleagues," Eastern Economic Journal, 25(3), 357-363.
50. McCloskey, D. (2000), How to be Human Though an Economist, Ann Arbor: University of Michigan Press.
51. McCloskey, D.N. (2002), The Secret Sins of Economics, Chicago, IL: Prickly Paradigm Press. www.prickly-paradigm.com/paradigm4.pdf.
52. McCloskey, D.N. (2005), "The Trouble with Mathematics and Statistics in Economics," unpublished typescript, University of Illinois, Chicago and Erasmus University Rotterdam.
53. McCloskey, D.N., and Zecher, J.N. (1984), "The Success of Purchasing Power Parity," in A Retrospective on the Classical Gold Standard, 1821-1931, eds. M.D. Bordo and A.J. Schwartz, Chicago: University of Chicago Press and the National Bureau of Economic Research, pp. 121-170.
54. McCloskey, D.N., and Ziliak, S.T. (1996), "The Standard Error of Regressions," Journal of Economic Literature, 34(1), 97-114.
55. Mizon, G.E. (1995), "Progressive Modelling of Economic Time Series: The LSE Methodology," in Macroeconometrics: Developments, Tensions, and Prospects, ed. K.D. Hoover, Dordrecht: Kluwer, pp. 107-170.
56. Morgan, M.S. (1990), The History of Econometric Ideas, Cambridge: Cambridge University Press.
57. Peirce, C.S. (1958), "Note on the Theory of the Economy of Research," in Science and Philosophy, Vol. 7 of the Collected Papers of Charles Sanders Peirce, ed. A.W. Burks, Cambridge, MA: Belknapp Press, pp. 76-88.
58. Peirce, C.S. (1934), Pragmatism and Pragmaticism, Vol. 5 of the Collected Papers of Charles Sanders Peirce, eds. C. Hartshorne and P. Weiss, Cambridge, MA: Belknap Press.
59. Savage, L.J. (1954 [1972]), The Foundations of Statistics, New York: Dover.
60. Solon, G. (1992), "Intergenerational Income Mobility in the United States," American Economic Review, 82(3), 393-408.
61. Southon, J.R., Stark, J.W., Vogel, J.S., and Waddington, J.C. (1990), "Upper Limit for Neutron Emission from Cold d-t Fusion," Physical Review, C, 41, R1899-R1900.
62. Spanos, A. (1995), "On Theory Testing in Econometrics: Modeling with Nonexperimental Data," Journal of Econometrics, 67(1), 189-226.
63. Staley, K.W. (2004), The Evidence for the Top Quark: Objectivity and Bias in Collaborative Experimentation, Cambridge: Cambridge University Press.
64. Stigler, S.M. (1986), The History of Statistics: Measurement of Uncertainty Before 1900, Cambridge, MA: Belknap Press.
65. Stigler, S.M. (1999), Statistics on the Table, Cambridge, MA: Harvard University Press.
66. Summers, L.H. (1991), "The Scientific Illusion in Empirical Macroeconomics," Scandinavian Journal of Economics, 93(2), 129-148.
67. Von Eye, A., and Mun, E.Y. (2004), Analyzing Rater Agreement: Manifest Variable Methods, Mahwah, NJ: Erlbaum.
68. White, H. (1990), "A Consistent Model Selection Procedure Based on m-Testing," in Modelling Economic Series: Readings in Econometric Methodology, ed. C.W.J. Granger, Oxford: Clarendon Press, pp. 369-383.
69. Wible, J.R. (1994), "Charles Sanders Peirce's Economy of Research", 1(1), 135-160.
70. Wible, J.R. (1998), The Economics of Science: Methodology and Epistemology as if Economics Really Mattered, London: Routledge.
71. Woodbury, S.A., and Spiegelman, R.G. (1987), "Bonuses to Workers and Employers to Reduce Unemployment: Randomized Trials in Illinois", American Economic Review, 77(4), 513-530.
72. Woodward, J. (2003), Making Things Happen: A Theory of Causal Explanation, Oxford: Oxford University Press.
73. Wooldridge, J.M. (2004), "Statistical Significance Is OK, Too: Comment on 'Size Matters'," Journal of Socio-Economics, 33(5), 577-579.
74. Ziliak, S.T., and McCloskey, D.N. (2004a), "Size Matters: The Standard Error of Regressions in the American Economic Review," Journal of Socio-Economics, 33(5), 527-546 (also published in Econ Journal Watch, 1(2), 331-358. www.econjournalwatch.org/main/ index.php?issues_id=3).
75. Ziliak, S.T., and McCloskey, D.N. (2004b), "Significance Redux," Journal of Socio-Economics, 33(5), 665-675.