What is meant by "Replication" and why does it encounter resistance in economics?

American Economic Review

Volumn 107, Issue 5, 2017, Pages 46-51

  Duvendack, Maren ^a   Palmer Jones, Richard ^a   Reed, W Robert ^b  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^b UNIVERSITY OF CANTERBURY   (New Zealand)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85019618786     PISSN: 00028282     EISSN: None     Source Type: Journal    
DOI: 10.1257/aer.p20171031     Document Type: Conference Paper

References (33)

1. Anderson, Christopher J., Štêpán Bahník, Michael Barnett-Cowan, Frank A. Bosco, Jesse Chandler, Christopher R. Chartier, Felix Cheung, et al. 2016. "Response to Comment on 'Estimating the Reproducibility of Psychological Science.'" Science 351 (6277): 1037-39.
2. Bohannon, John. 2014. "Replication Effort Provokes Praise- and 'Bullying' Charges." Science 344 (6186): 788-89.
3. Camerer, Colin F., Anna Dreber, Eskil Forsell, Teck-Hua Ho, Jürgen Huber, Magnus Johannesson, Michael Kirchler, et al. 2016. "Evaluating Replicability of Laboratory Experiments in Economics." Science 351 (6280): 1433-36.
4. Chang, Andrew C., and Phillip Li. 2015. "Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say 'Usually Not.'" Board of Governors of the Federal Reserve System Finance and Economics Discussion Series Paper 2015-83.
5. Clemens, Michael A. 2017. "The Meaning of Failed Replications: A Review and Proposal." Journal of Economic Surveys 31 (1): 326-42.
6. Dewald, William G., Jerry G. Thursby, and Richard G. Anderson. 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project." American Economic Review 76 (4): 587-603.
7. Dialogue on DA-RT. 2015. Petition to Delay DA-RT Implementation. https://docs.google.com/forms/d/e/1FAIpQLSc-cmfNLxUeUYF6EIgtvNHtnfQaoEYo-T-ocpcu9kUxduj0cA/viewform (accessed December 2, 2016).
8. Duvendack, Maren, and Richard W. Palmer-Jones. 2013. "Replication of Quantitative Work in Development Studies: Experiences and Suggestions." Progress in Development Studies 13 (4): 307-22.
9. Duvendack, Maren, Richard W. Palmer-Jones, and W. Robert Reed. 2015. "Replications in Economics: A Progress Report." Econ Journal Watch 12 (2): 164-91.
10. Feigenbaum, Susan, and David M. Levy. 1993. "The Market for (Ir)reproducible Econometrics." Social Epistemology 7 (3): 215-32.
11. Gilbert, Daniel T., Gary King, Stephen Pettigrew, and Timothy D. Wilson. 2016. "Comment on 'Estimating the Reproducibility of Psychological Science.'" Science 351 (6277): 1037.
12. Hamermesh, Daniel S. 2007. "Viewpoint: Replication in Economics." Canadian Journal of Economics 40 (3): 715-33.
13. Harvey, Campbell R. 2014. "Reflections on Editing the Journal of Finance, 2006-2012." In Secrets of Economics Editors, edited by Michael Szenberg and Lall Ramrattan, 67-82. Cambridge: MIT Press.
14. Hubbard, Raymond. 2016. Corrupt Research: The Case for Reconceptualizing Empirical Management and Social Science. Thousand Oaks: SAGE Publications, Inc.
15. International Initiative for Impact Evaluation. 2016. Impact Evaluation Replication Programme. http://www.3ieimpact.org/en/evaluation/impact-evaluation-replicationprogramme/ (accessed December 2, 2016).
16. Ioannidis, John P.A. 2005. "Why Most Published Research Findings Are False." PLoS Med 2: 124.
17. Johnson, Valen E., Richard D. Payne, Tianying Wang, Alex Asher, and Soutrik Mandal. 2016. "On the Reproducibility of Psychological Science." Journal of the American Statistical Association. http://dx.doi.org/10.1080/0162145 9.2016.1240079.
18. Kerr, Norbert L. 1998. "HARKing: Hypothesizing After the Results Are Known." Personality and Social Psychology Review 2 (3): 196-217.
19. Longo, Dan L., and Jeffrey M. Drazen. 2016. "Data Sharing." New England Journal of Medicine 374: 276-77.
20. McCullough, B. D. 2009. "Open Access Economics Journals and the Market for Reproducible Economic Research." Economic Analysis and Policy 39 (1): 117-26.
21. National Academy of Sciences. 2016. Statistical Challenges in Assessing and Fostering the Reproducibility of Scientific: Summary of a Workshop. Washington, DC: National Academies Press.
22. Nosek, Brian A., and Daniël Lakens. 2013. "Replications of Important Results in Social Psychology: Special Issue of Social Psychology." Social Psychology 44 (1): 59-60.
23. Nosek, Brian A., and Daniël Lakens. 2014. "Registered Reports: A Method to Increase the Credibility of Published Results." Social Psychology 45 (3): 137-41.
24. Open Science Collaboration. 2015. "Estimating the Reproducibility of Psychological Science." Science 349 (6251).
25. Patil, Prasad, Roger D. Peng, and Jeffrey T. Leek. 2016. "What Should Researchers Expect When They Replicate Studies? A Statistical View of Replicability in Psychological Science." Perspectives on Psychological Science 11 (4): 539-44.
26. Pesaran, Hashem. 2003. "Introducing a Replication Section." Journal of Applied Econometrics 18 (1): 111.
27. Simons, Daniel J., and Alex O. Holocombe. 2014. "Registered Replication Reports." Observer 27 (3).
28. Simons, Daniel J., Alex O. Holcombe, and Barbara A. Spellman. 2014. "An Introduction to Registered Replication Reports at Perspectives on Psychological Science." Perspectives on Psychological Science 9 (5): 552-55.
29. Social Sciences Replication Project. 2016. "Social Sciences Replication Project." http://www.socialsciencesreplicationproject.com/ (accessed December 2, 2016).
30. Stanley, T. D., and Hristos Doucouliagos. 2012. Meta-Regression Analysis in Economics and Business. London: Routledge.
31. Vlaeminck, Sven. 2013. "Data Management in Scholarly Journals and Possible Roles for Libraries-Some Insights from EdaWaX." LIBER Quarterly 23 (1): 48-79.
32. Vlaeminck, Sven, and Lisa-Kristin Herrmann. 2015. "Data Policies and Data Archives: A New Paradigm for Academic Publishing in Economic Sciences?" EconStor Open Access Articles 2015: 145-55.
33. Ziliak, Stephen T., and Deirdre N. McCloskey. 2008. The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives. Ann Arbor: University of Michigan Press.