How robust standard errors expose methodological problems they do not fix, and what to do about it

Political Analysis

Volumn 23, Issue 2, 2015, Pages 159-179

  King, Gary ^a   Roberts, Margaret E ^b  

^a HARVARD UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84929671519     PISSN: 10471987     EISSN: 14764989     Source Type: Journal    
DOI: 10.1093/pan/mpu015     Document Type: Article

References (43)

1. Abadie, Alberto, Guido W. Imbens, and Fanyin Zheng. 2011. Robust inference for misspecified models conditional on covariates. The National Bureau of Economic Research Working Paper.
2. Arceneaux, Kevin, and David W. Nickerson. 2009. Modeling certainty with clustered data: A comparison of methods. Political Analysis 17(2):177-90.
3. Arellano, Manuel. 1987. Computing robust standard errors for within-groups estimators. Oxford Bulletin of Economics and Statistics 49(4):431-4.
4. Beck, Nathaniel, and Jonathan Katz. 1995. What to do (and not to do) with time-series-cross-section data. American Political Science Review 89:634-47.
5. Bertrand, Marianne, Esther Duflo, and Sendhil Mullainathan. 2004. How much should we trust differences-in-differences estimates? Quarterly Journal of Economics 119(1):249-75.
6. Breusch, T. S., and A. R. Pagan. 1979. Simple test for heteroscedasticity and random coefficient variation. Econometrica 47(5):1287-94.
7. Büthe, Tim, and Helen V. Milner. 2008. The politics of foreign direct investment into developing countries: Increasing FDI through international trade agreements? American Journal of Political Science 52(4):741-62.
8. Chesher, Andrew, and Richard Spady. 1991. Asymptotic expansions of the information matrix test statistic. Econometrica: Journal of the Econometric Society 59:787-815.
9. Davidson, Russell, and James G. MacKinnon. 1992. A new form of the information matrix test. Econometrica: Journal of the Econometric Society 54:145-57.
10. Dean, C., and J. F. Lawless. 1989. Tests for detecting overdispersion in Poisson regression models. Journal of the American Statistical Association 84(406):467-72.
11. Dhaene, Geert, and Dirk Hoorelbeke. 2004. The information matrix test with bootstrap-based covariance matrix estimation. Economics Letters 82(3):341-47.
12. Dreher, Axel, and Nathan M. Jensen. 2007. Independent actor or agent? An empirical analysis of the impact of U.S. interests on international monetary fund conditions. Journal of Law and Economics 50(1):105-24.
13. Driscoll, John C., and Aart C. Kraay. 1998. Consistent covariance matrix estimation with spatially dependent panel data. Review of Economics and Statistics 80:549-60.
14. Eicker, F. 1963. Asymptotic normality and consistency of the least squares estimators for families of linear regressions. Annals of Mathematical Statistics 34:447-56.
15. Fisher, Ronald A. 1935. The design of experiments. London: Oliver and Boyd.
16. Freedman, David A. 2006. On the so-called "Huber sandwich estimator" and "robust standard errors." American Statistician 60(4):299-302.
17. Gartzke, Erik A., and Kristian Skrede Gleditsch. 2008. The ties that bias: Specifying and operationalizing components of dyadic dependence in international conflict. Working paper.
18. Goldberger, Arthur. 1991. A course in econometrics. Cambridge, MA: Harvard University Press.
19. Green, Donald P., and Lynn Vavreck. 2008. Analysis of cluster-randomized experiments: A comparison of alternative estimation approaches. Political Analysis 15(2):138-52.
20. Hoff, Peter D., and Michael D. Ward. 2004. Modeling dependencies in international relations networks. Political Analysis 12(2):160-75.
21. Huber, Peter J. 1967. The behavior of maximum likelihood estimates under nonstandard conditions. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability 1:221-233.
22. Imai, Kosuke, Gary King, and Olivia Lau. 2008. Toward a common framework for statistical analysis and development. Journal of Computational Graphics and Statistics 17(4):1-22.
23. Kiefer, Nicholas M. 1980. Estimation of fixed effect models for time series of cross-sections with arbitrary intertemporal covariance. Journal of Econometrics 14(2):195-202.
24. King, Gary. 1989a. Unifying political methodology: The likelihood theory of statistical inference. Ann Arbor: Michigan University Press.
25. King, Gary. 1989b. Variance specification in event count models: From restrictive assumptions to a generalized estimator. American Journal of Political Science 33(3):762-84.
26. King, Gary, and Langche Zeng. 2006. The dangers of extreme counterfactuals. Political Analysis 14(2):131-59.
27. King, Gary, and Margaret Roberts. 2014. Replication data for: How robust standard errors expose methodological problems they do not fix, and what to do about it. UNF:5:Bc1yVsbYLpjnS0Bx6FDnNA1/41/4 http://dx.doi.org/10. 7910/DVN/26935 IQSS Dataverse Network [Distributor].
28. King, Gary, Michael Tomz, and Jason Wittenberg. 2000. Making the most of statistical analyses: Improving interpretation and presentation. American Journal of Political Science 44(2):341-55.
29. King, Gary, Robert O. Keohane, and Sidney Verba. 1994. Designing social inquiry: Scientific inference in qualitative research. Princeton, NJ: Princeton University Press.
30. Koenker, Roger. 1981. A note on studentizing a test for heteroscedasticity. Journal of Econometrics 17(1):107-12.
31. Koenker, Roger, and Gilber Bassett. 1982. Robust for heteroscedasticity based on regression quantiles. Econometrica 50(1):43-61.
32. Lancaster, Tony. 1984. The covariance matrix of the information matrix test. Econometrica: Journal of the Econometric Society 52:1051-53.
33. Leamer, Edward E. 2010. Tantalus on the road to asymptopia. Journal of Economic Perspectives 24(2):31-46.
34. Moulton, Brent R. 1986. Random group effects and the precision of regression estimates. Journal of Econometrics 32:385-97.
35. Neumayer, Eric. 2003. The determinants of aid allocation by regional multilateral development banks and United Nations agencies. International Studies Quarterly 47(1):101-22.
36. Newey, Whitney K., and Kenneth D. West. 1987. A simple, positive definite, heteroskedasticity and autocorrelation consistent covariance matrix. Econometrica 55(3):703-8.
37. Neyman, J. 1923. On the application of probability theory to agricultural experiments. Essay on principles. Section 9. Statistical Science 5:465-80.
38. Orme, Chris. 1988. The calculation of the information matrix test for binary data models. Manchester School 56(4):370-6.
39. Orme, Chris. 1990. The small-sample performance of the information-matrix test. Journal of Econometrics 46(3):309-31.
40. Petersen, Mitchell. 2009. Estimating standard errors in finance panel data sets: Comparing approaches. Review of Financial Studies 22(1):435-80.
41. Taylor, Larry W. 1987. The size bias of White's information matrix test. Economics Letters 24(1):63-67.
42. White, Halbert. 1980. A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica 48(4):817-38.
43. White, Halbert. 1996. Estimation, inference, and specification analysis. New York: Cambridge University Press.