Tests for identifying "red flags" in empirical findings: Demonstration and recommendations for authors, reviewers, and editors

Academy of Management Learning and Education

Volumn 16, Issue 1, 2017, Pages 110-124

  Bergh, Donald D ^a   Sharp, Barton M ^b   Li, Ming ^c  

^a UNIVERSITY OF DENVER   (United States)

^b NORTHERN ILLINOIS UNIVERSITY   (United States)

^c UNIVERSITY OF LIVERPOOL MANAGEMENT SCHOOL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85018476585     PISSN: 1537260X     EISSN: None     Source Type: Journal    
DOI: 10.5465/amle.2015.0406     Document Type: Review

References (23)

1. Abelson, R. P. 1995. On suspecting fishiness. Statistics as principled argument: 78-88. Hillsdale, NJ: L. Erlbaum Associates.
2. Bakker, M., & Wicherts, J. 2011. The (mis)reporting of statistical results in psychology journals. Behavior Research Methods, 43(3): 666-678.
3. Bedeian, A. G., Taylor, S. G., & Miller, A. N. 2010. Management science on the credibility bubble: Cardinal sins and various misdemeanors. Academy of Management Learning & Education, 9(4): 715-725.
4. Bettis, R. A. 2012. The search for asterisks: Compromised statistical tests and flawed theories. Strategic Management Journal, 33(1): 108-113.
5. Bettis, R. A., Ethiraj, S., Gambardella, A., Helfat, C., & Mitchell, W. 2016. Creating repeatable cumulative knowledge in strategic management. Strategic Management Journal, 37: 257-261.
6. Bohannon, J. 2013. Who's afraid of peer review? Science, 342(6154): 60-65.
7. Boyd, B. K., Bergh, D. D., & Ketchen, D. J., Jr. 2010. Reconsidering the reputation-performance relationship: A resource-based view. Journal of Management, 36(3): 588-609.
8. Chang, A. C., & Li, P. 2015. Is economics research replicable? Sixty published articles from thirteen journals say "usually not." Finance and Economics Discussion Series 2015-083. Washington, DC: Board ofGovernors of the Federal Reserve System, Retrieved from: Http://dx.doi.org/10.17016/FEDS.2015.083.Available at https://www.federalreserve.gov/econresdata/feds/2015/files/2015083pap.pdf.
9. Dewald,W.G., Thursby, J.G., & Anderson, R.G. 1986. Replication in empirical economics: The Journal of Money, credit and banking project. The American Economic Review, 76(4): 587-603.
10. Epskamp, S., & Nuijten, M. B. 2016. statcheck: Extract statistics from articles and recompute p values. R package version 1.0.1. http://CRAN.R-project.org/package5statcheck.
11. Godlee, F., Gale, C. R.,&Martyn, C. N. 1998. Effect on the quality of peer review of blinding reviewers and asking them to sign their reports: A randomized controlled trial. Journal of the American Medical Association, 280(3): 237-240.
12. Goldfarb, B. D., & King, A. A. 2016. Scientific apophenia in strategic management research: Significance tests & mistaken inference. Strategic Management Journal, 37: 167-176.
13. Hubbard, R., Vetter, D. E., & Little, E. L. 1998. Replication in strategic management: Scientific testing for validity, generalizability and usefulness. Strategic Management Journal, 19: 243-254.
14. Kepes, S., Bennett, A., & McDaniel, M. 2014. Evidence-based management and the trustworthiness of cumulative scientific knowledge: Implications for teaching, research and practice. Academy of Management Learning & Education, 13: 446-466.
15. Kepes, S., & McDaniel, M. A. 2013. How trustworthy is the scientific literature in industrial and organizational psychology? Industrial and Organizational Psychology: Perspectives on Science and Practice, 6: 252-268.
16. Lichtenthaler, U., & Ernst, H. 2012. Integrated knowledge exploitation: The complementarity of product development and technology licensing. Strategic Management Journal, 33: 513-534. (Retraction published 2012. Strategic Management Journal, 33: 1341.)
17. Nuijten, M., Hartgerink, C. J., van Assen, M. L. M., Epskamp, S., & Wicherts, J. 2016. The prevalence of statistical reporting errors in psychology (1985-2013). Behavior Research Methods, 48: 1205-1226.
18. Pfeffer, J. 2007. Truth's consequences. Journal of Organizational Behavior, 28: 837-839.
19. Schminke, M. 2009. Editor's comments: The better angels of our nature-Ethics and integrity in the publishing process. Academy of Management Review, 34(4): 586-591.
20. Schroter, S., Black, N., Evans, S., Godlee, F., Osorio, L., & Smith, R. 2008. What errors do peer reviewers detect, and does training improve their ability to detect them? Journal of the Royal Society of Medicine, 101(10): 507-514.
21. Shaver, J. M. 2005. Testing for mediating variables in management research: Concerns, implications, and alternative strategies. Journal of Management, 31(3): 330-353.
22. Simonsohn, U. 2013. Just post it: The lesson from two cases of fabricated data detected by statistics alone. Psychological Science, 24(10): 1875-1888.
23. Strategic Management Journal, 2012. Retraction: Integrated knowledge exploitation: The complementarity of product development and technology licensing. Strategic Management Journal, 33: 1341.