Model Uncertainty and the Crisis in Science

Socius

Volumn 4, Issue , 2018, Pages 1-7

  Young, Cristobal ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

computational methods; model uncertainty; multimodel analysis; robustness

Indexed keywords

EID: 85138073825     PISSN: None     EISSN: 23780231     Source Type: Journal    
DOI: 10.1177/2378023117737206     Document Type: Article

References (25)

1. Brodeur, Abel, Mathias Lé, Marc Sangnier, and Yanos Zylberberg. 2016. “Star Wars: The Empirics Strike Back.” American Economic Journal: Applied Economics 8(1):1–32.
2. Doucouliagos, C., and T. D. Stanley. 2013. “Are All Economic Facts Greatly Exaggerated? Theory Competition and Selectivity.” Journal of Economic Surveys 27(2):316–39.
3. Durlauf, Steven, Fu Chao, and Salvador Navarro. 2012. “Assumptions Matter: Model Uncertainty and the Deterrent Effect of Capital Punishment.” American Economic Review 102(3):487–92.
4. Elwert, Felix, and Christopher Winship. 2014. “Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable.” Annual Review of Sociology 40:31–53.
5. Fisher, Ronald. 1925. Statistical Methods for Research Workers. Edinburgh, United Kingdom: Genesis Publishing.
6. Gelman, Andrew, and Eric Loken. 2014. “The Statistical Crisis in Science Data Dependent Analysis—a “Garden of Forking Paths”—Explains Why Many Statistically Significant Comparisons Don’t Hold Up.” American Scientist 102(6):460.
7. Grier, David Alan. 2005. When Computers Were Human. Princeton, NJ: Princeton University Press.
8. Heckman, James. 2005. “The Scientific Model of Causality.” Sociological Methodology 35:1–97.
9. Heckman, James, and Edward Leamer, eds. 2007. Handbook of Econometrics. Vol. 6, Part B. Amsterdam, the Netherlands: North-Holland.
10. Ho, Daniel, Kosuke Imai, Gary King, and Elizabeth Stuart. 2007. “Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference.” Political Analysis 15:199–236.
11. Ioannidis, John. 2005. “Why Most Published Research Findings Are False.” PLoS Medicine 2:696–701.
12. Leamer, Edward E. 1983. “Let’s Take the Con out of Econometrics.” American Economic Review 73(1):31–43.
13. Leamer, Edward E. 1985. “Sensitivity Analyses Would Help.” American Economic Review 75(3):308–13.
14. Magnus, Jan and Mary Morgan. 1999. Methodology and Tacit Knowledge: Two Experiments in Econometrics. New York: John Wiley.
15. Mellers, Barbara, Ralph Hertwig, and Daniel Kahneman. 2001. “Do Frequency Representations Eliminate Conjunction Effects? An Exercise in Adversarial Collaboration.” Psychological Science 12(4):269–75.
16. Muñoz, John, and Cristobal Young. 2017. “We Ran 9 Billion Regressions: Eliminating False Positives through Computational Model Robustness.” Working Paper.
17. Raftery, Adrian. 1995. “Bayesian Model Selection in Social Research.” Sociological Methodology 25:111–65.
18. Rawls, John. 1971. A Theory of Justice. Cambridge, MA: Belknap.
19. Rosenfeld, Jake. 2014. What Unions No Longer Do. Cambridge, MA: Harvard University Press.
20. Sala-i-Martin, Xavier. 1997. “I Just Ran Two Million Regressions.” American Economic Review 87(2):178–83.
21. Silberzahn, R, et al. 2015. “Many Analysts, One Dataset: Making Transparent how Variations in Analytical Choices Affect Results.” Retrieved October 10, 2017 (https://osf.io/gvm2z/).
22. Winship, Christopher, and Bruce Western. 2016. “Multicollinearity and Model Misspecification.” Sociological Science 3:627–49.
23. Young, Cristobal. 2009. “Model Uncertainty in Sociological Research: An Application to Religion and Economic Growth.” American Sociological Review 74(3):380–97.
24. Young, Cristobal, and Katherine Holsteen. 2017. “Model Uncertainty and Robustness: A Computational Framework for Multi-model Analysis.” Sociological Methods and Research 46(1):3–40.
25. Young, Cristobal, Charles Varner, Ithai Lurie, and Richard Prisinzano. 2016. “Millionaire Migration and the Taxation of the Elite: Evidence from Administrative Data.” American Sociological Review 81(3):421–46.