Model Uncertainty and Robustness: A Computational Framework for Multimodel Analysis

Sociological Methods and Research

Volumn 46, Issue 1, 2017, Pages 3-40

  Young, Cristobal ^a   Holsteen, Katherine ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

computational methods; model dependence; model uncertainty; multimodel analysis; robust

Indexed keywords

EID: 85006355811     PISSN: 00491241     EISSN: 15528294     Source Type: Journal    
DOI: 10.1177/0049124115610347     Document Type: Article

References (56)

1. Andersen Robert. 2008. Modern Methods for Robust Regression. Thousand Oaks, CA: Sage.
2. Angrist Joshua, Krueger Alan. 2001. “Instrumental Variables and the Search for Identification: from Supply and Demand to Natural Experiments.” Journal of Economic Perspectives 15:69–85.
3. Begley Glenn, Ellis Lee M.. 2012. “Drug Development: Raise Standards for Preclinical Cancer Research.” Nature 483:531–33.
4. Berk Richard, Brown Lawrence, Zhao Linda. 2009. “Statistical Inference after Model Selection.” Journal of Quantitative Criminology 26:217–36.
5. Brady David, Beckfield Jason, Seeleib-Kaiser Martin. 2005. “Economic Globalization and the Welfare State in Affluent Democracies, 1975-2001.” American Sociological Review 70:921–48.
6. Brand Jennie, Halaby Charles. 2006. “Regression and Matching Estimates of the Effects of Elite College Attendance on Educational and Career Achievement.” Social Science Research 35:749–70.
7. Chabris Christopher, Hebert Benjamin, Benjamin Daniel, Beauchamp Jonathan, Cesarini David, van der Loos Matthijs, Johannesson Magnus, Magnusson Patrik, Lichtenstein Paul, Atwood Craig, Freese Jeremy, Hauser Taissa, Hauser Robert M., Christakis Nicholas, Laibson David. 2012. “Most Genetic Associations with General Intelligence Are Probably False Positives.” Psychological Science 23:1314–23.
8. Ciccone Antonio, Jarociński Marek. 2010. “Determinants of Economic Growth: Will Data Tell?” American Economic Journal: Macroeconomics 2:222–46.
9. Clarke Kevin. 2005. “The Phantom Menace: Omitted Variable Bias in Econometric Research.” Conflict Management and Peace Science 22:341–52.
10. Clarke Kevin. 2009. “Return of the Phantom Menace: Omitted Variable Bias in Political Research.” Conflict Management and Peace Science 26:46–66.
11. Clogg Clifford, Petkova Eva, Haritou Adamantios. 1995. “Statistical Methods for Comparing Regression Coefficients between Models.” American Journal of Sociology 100:1261–93.
12. Conway Karen, Rork Jonathan. 2012. “No Country for Old Men (or Women)—Do State Tax Policies Drive Away the Elderly?” National Tax Journal 65:313–56.
13. Cook Dennis. 1977. “Detection of Influential Observations in Linear Regression.” Technometrics 19:15–18.
14. Durlauf Steven, Chao Fu, Navarro Salvador. 2012. “Assumptions Matter: Model Uncertainty and the Deterrent Effect of Capital Punishment.” American Economic Review 102:487–92.
15. Durlauf Steven, Chao Fu, Navarro Salvador. 2013. “Capital Punishment and Deterrence: Understanding Disparate Results.” Journal of Quantitative Criminology 29:103–21.
16. Durlauf Steven, Johnson Paul, Temple Jonathan. 2005. “Growth Econometrics.” Pp. 555–678 in Handbook of Economic Growth, Vol. 1A, edited by Aghion Philippe, Durlauf Steven. Amsterdam, the Netherlands: Elsevier B.V.
17. Efron Bradley. 1981. “Nonparametric Estimates of Standard Error: The Jackknife, the Bootstrap and Other Methods.” Biometrika 68:589–99.
18. Efron Bradley. 2014. “Estimation and Accuracy after Model Selection.” Journal of the American Statistical Association 109:991–1007.
19. Efron Bradley, Tibshirani Robert. 1993. An Introduction to the Bootstrap. New York: Chapman & Hall.
20. Elwert Felix, Winship Christopher. 2014. “Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable.” Annual Review of Sociology 40:31–53.
21. Glaeser Edward. 2008“Researcher Incentives and Empirical Methods.” Pp. 300–19 in Foundations of Positive and Normative Economics: A Handbook edited by Caplin Andrew, Schotter Andrew. Oxford: Oxford University Press.
22. Gross Emily. 2003. U.S. Population Migration Data: Strengths and Limitations. Washington, DC: Internal Revenue Service Statistics of Income Division.
23. Hahn Jinyong, Hausman Jerry. 2003. “Weak Instruments: Diagnosis and Cures in Empirical Econometrics.” American Economic Review 93:118–25.
24. Heckman James. 2005. “The Scientific Model of Causality.” Sociological Methodology 35:1–97.
25. Herting Jerald, Grusky David, Van Rompaey Stephen. 1997. “The Social Geography of Interstate Mobility and Persistence.” American Sociological Review 62:267–87.
26. Hirsch Barry. 2004. “Reconsidering Union Wage Effects: Surveying New Evidence on an Old Topic.” Journal of Labor Research 25:233–66.
27. Ho Daniel, Imai Kosuke, King Gary, Stuart Elizabeth. 2007. “Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference.” Political Analysis 15:199–236.
28. Hoeting Jennifer, Madigan David, Raftery Adrian, Volinsky Chris. 1999. “Bayesian Model Averaging: A Tutorial.” Statistical Science 14:382–417.
29. Ioannidis John. 2005. “Why Most Published Research Findings Are False.” PLoS Medicine 2:696–701.
30. Kane Jennifer, Morgan Philip, Harris Kathleen, Guilkey David. 2013. “The Educational Consequences of Teen Childbearing: Comparisons across Ordinary Least Squares Regression, Propensity Score Matching, Parametric and Semi-parametric Maximum Likelihood Estimation.” Demography 50:2129–50.
31. King Gary, Zeng Langche. 2006. “The Dangers of Extreme Counterfactuals.” Political Analysis 14:131–59.
32. Kleven Henrik, Landais Camille, Saez Emmanuel. 2013. “Taxation and International Migration of Superstars: Evidence from the European Football Market.” American Economic Review 103:1892–924.
33. Koenker Roger, Hallock Kevin F.. 2001. “Quantile Regression.” Journal of Economic Perspectives 15:143–56.
34. Leamer Edward E., 1983. “Let’s Take the Con Out of Econometrics.” American Economic Review 73:31–43.
35. Leamer Edward E., 1985. “Sensitivity Analyses Would Help.” American Economic Review 75:308–13.
36. Leamer Edward E. 2008. “Extreme Bounds Analysis.” In The New Palgrave Dictionary of Economics, 2nd ed., edited by Durlauf Steven, Blume Lawrence. Palgrave Macmillan. doi:10.1057/9780230226203.0539.
37. Leigh Andrew. 2007. “How Closely Do Top Income Shares Track Other Measures of Inequality?” Economic Journal 117:F619–33.
38. Lochner Kimberly, Kawachi Ichiro, Kennedy Bruce. 1999. “Social Capital: A Guide to its Measurement.” Health and Place 5: 259–70.
39. McGranahan David A., 1999. “Natural Amenities Drive Rural Population Change.” Agricultural Economic Report 781. Washington, DC: United States Department of Agriculture.
40. Montez Jennifer, Hummer Robert, Hayward Mark. 2012. “Education Attainment and Adult Mortality in the United States: A Systematic Analysis of Functional Form.” Demography 49:315–36.
41. Munnell Alicia, Tootell Geoffery, Browne Lynne, McEneany James. 1996. “Mortgage Lending in Boston: Interpreting HMDA Data.” American Economic Review 86:25–53.
42. Payton Antony. 2009. “The Impact of Genetic Research on Our Understanding of Normal Cognitive Ageing: 1995 to 2009.” Neuropsychology Review 19:451–77.
43. Pearl Judea. 2011. “Understanding Bias Amplification.” American Journal of Epidemiology 174:1223–27.
44. Prinz Florian, Schlange Thomas, Asadullah Khusru. 2011. “Believe It or Not: How Much Can We Rely on Published Data on Potential Drug Targets?” Nature Reviews Drug Discovery 10:712.
45. Raftery Adrian. 1995. “Bayesian Model Selection in Social Research.” Sociological Methodology 25:111–65.
46. Rosenfeld Jake. 2014. What Unions No Longer Do. Cambridge, MA: Harvard University Press.
47. Sala-i-Martin Xavier. 1997. “I Just Ran Two Million Regressions.” American Economic Review 87:178–83.
48. Sala-i-Martin Xavier, Doppelhofer Gernot, Miller Ronald. 2004. “Determinants of Long-term Growth: A Bayesian Averaging of Classical Estimates Approach.” American Economic Review 94:813–35.
49. Santos Silva J., Tenreyro Silvana. 2006. “The Log of Gravity.” Review of Economics and Statistics 88:641–58.
50. Simmons Joseph, Nelson Leif, Simonsohn Uri. 2011. “False-positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant.” Psychological Science 22:1359–66.
51. Stanley T. D., Doucouliagos Hristos. 2012. Meta-regression Analysis in Economics and Business. New York: Routledge.
52. van Raalte Alyson, Caswell Hal. 2013. “Perturbation Analysis of Indices of Lifespan Variability.” Demography 50:1615–40.
53. Western Bruce. 1996. “Vague Theory and Model Uncertainty in Macrosociology.” Sociological Methodology 26:165–92.
54. Wildeman Christopher, Turney Kristin. 2014. “Positive, Negative, or Null? The Effects of Maternal Incarceration on Children’s Behavioral Problems.” Demography 51:1041–68.
55. Young Cristobal. 2009. “Model Uncertainty in Sociological Research: An Application to Religion and Economic Growth.” American Sociological Review 74:380–97.
56. Young Cristobal, Varner Charles. 2011. “Millionaire Migration and State Taxation of Top Incomes: Evidence from a Natural Experiment.” National Tax Journal 64:255–84.