Quis custodiet ipsos custodes?: Despite evidence to the contrary, the American Economic Review concluded that all was well with its archive

Economics

Volumn 12, Issue 1, 2018, Pages

  McCullough, B D ^a  

^a DREXEL UNIVERSITY   (United States)

Author keywords

Replication; reproducible research

Indexed keywords

EID: 85059046037     PISSN: None     EISSN: 18646042     Source Type: Journal    
DOI: 10.5018/economics-ejournal.ja.2018-52     Document Type: Review

References (25)

1. Bernanke, B. S. (2004). Editorial statement. American Economic Review, 94(1): 404. http://www.climateaudit.info/pdf/aereditorial.pdf
2. Baker, M. (2016). Muddled meanings hamper efforts to fix reproducibility crisis. Nature News. https://www.nature.com/news/muddled-meanings-hamper-efforts-to-fix-reproducibility-crisis-1.20076
3. Breure, L. and Hoogerwerf, M. (2011). Data availability policies: ideal and practice. Working paper. Department of Informatics, University of Utrecht. https://xposre.nl/cliodap/DAP_Ideal+Practice_1-1.pdf
4. Camerer, C. F., Anna, D., Eskil, F., Ho, T. H., Jürgen, H., Johannesson, M., Kirchler, M., Almenberg, J., Altmejd, A., Chan, T., Heikensten, E., Holzmeister, F., Imai, T., Isaksson, S., Nave, G., Pfeiffer, T.,Razen, M. and Wu, H. (2016). Evaluating replicability of laboratory experiments in economics. Science. http://science.sciencemag.org/content/early/2016/03/02/science.aaf0918
5. Chang, A. C. and Li, P. (2018). Is economics research replicable? Sixty published papers from thirteen journals say "often not". Critical Finance Review, 7. https://www.nowpublishers.com/article/Details/CFR-0053
6. Christensen, G. S. and Miguel, E. (2018). Transparency, reproducibility, and the credibility of economics research. Journal of Economic Literature. Forthcoming.
7. Clemens, M. A.(2015). The meaning of failed replications: a review and proposal. Journal of Economic Surveys, 31(1): 326-342. https://doi.org/10.1111/joes.12139
8. Dewald, W. G., Thursby, J. G. and Anderson, R.G. (1986). Replication in empirical economics: the Journal of Money, Credit and Banking Project. The American Economic Review, 76(4): 587-603. https://www.jstor.org/stable/1806061?seq=1#page_scan_tab_contents
9. Dewald, W. G., Anderson, R. G. (2014). Replication and reflection: A decade at the Jouranl of Money, Credit and Banking. In Szenberg, M. and Ramrattan, L. Secrets of economics editors. The MIT Press.
10. Donohue, J. and Levitt, S. (2001). The impact of legalized abortion on crime. Quarterly Journal of Economics, 116: 379-420. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=174508.
11. Easterbrook, S. M. (2014). Open code for open science? Nature Geoscience, 7: 779-781. https://www.nature.com/articles/ngeo2283
12. Foote, C. L. and Goetz, C. F. (2008). The impact of legalized abortion on crime: comment. The Quarterly Journal of Economics, 123(1): 407-423. https://www.jstor.org/stable/25098902?seq=1#page_scan_tab_contents
13. Glandon, P. (2010). Appendix to the report of the editor: report on the American Economic Review data availability compliance project. Vanderbilt University. https://digital.kenyon.edu/cgi/viewcontent.cgi?referer= https://www.google.com/&httpsredir=1&article=1011&context=economics_publications
14. Goldberg, P. K. (2016). Report of the Editor: American Economic Review. The American Economic Review, 106(5): 700-712. https://www.aeaweb.org/articles?id=10.1257/aer.106.5.700
15. Hoxby, C. M. (2000). Does competition among public schools benefit students and taxpayers?. American Economic Review, 90(5): 1209-1238. https://www.jstor.org/stable/2677848?origin=JSTOR-pdf&seq=1#page_scan_tab_contents
16. Karolyi, G. A. (2011). The ultimate irrelevance proposition in finance? The Financial Review, 46(4): 485-512. https://doi.org/10.1111/j.1540-6288.2011.00309.x
17. Levitt, S. D. (1997). Using electoral cycles in police hiring to estimate the effect of police on crime. The American Economic Review, 87(3): 270-290. https://www.jstor.org/stable/2951346?seq=1#page_scan_tab_contents
18. Levitt, S. D. (2002). Using electoral cycles in police hiring to estimate the effect of police on crime: reply. The American Economic Review, 92(4): 1244-1250. http://pricetheory.uchicago.edu/levitt/Papers/LevittUsingElectoralCycles2002.pdf
19. McCrary, J. (2002). Using electoral cycles in police hiring to estimate the effect of police on crime: comment. The American Economic Review, 92(4): 1236-1243. https://www.jstor.org/stable/3083311?seq=1#page_scan_tab_contents
20. McCullough, B. D. and Vinod, H. D. (1999). The numerical reliability of econometric software. Journal of Economic Literature, 37(2): 633-665. https://ideas.repec.org/a/aea/jeclit/v37y1999i2p633-665.html
21. McCullough, B. D. and Vinod, H. D. (2003). Verifying the solution from a nonlinear solver: A case study. American Economic Review, 93(3): 873-892. https://www.aeaweb.org/articles?id=10.1257/000282803322157133
22. McCullough, B. D., McGeary, K. A. and Harrison, T. D. (2008). Do economics journal archives promote replicable research? The Canadian Journal of Economics, 41(4): 1406-1420. https://www.jstor.org/stable/25478330?seq=1#page_scan_tab_contents
23. Moffitt, R. A. (2011). Report of the editor: American Economic Review (with Appendix by Philip J. Glandon). American Economic Review, 101(3): 684-693. https://www.aeaweb.org/articles?id=10.1257/aer.101.3.684
24. Nylan, B. (2015). Increasing the credibility of political sciences research: A proposal for journal reforms. Political Science & Politics, 48(S1): 78-83. https://doi.org/10.1017/S1049096515000463
25. Rothstein, J. (2007). Does competition among public schools benefit students and taxpayers? A comment on Hoxby (2000). The American Economic Review, 97(5):2026-2037. https://www.jstor.org/stable/30034599?seq=1#page_scan_tab_contents