Is there a credibility crisis in strategic management research? Evidence on the reproducibility of study findings

Strategic Organization

Volumn 15, Issue 3, 2017, Pages 423-436

  Bergh, Donald D ^a   Sharp, Barton M ^b   Aguinis, Herman ^c   Li, Ming ^d  

^a UNIVERSITY OF DENVER   (United States)

^b NORTHERN ILLINOIS UNIVERSITY   (United States)

^c GEORGE WASHINGTON UNIVERSITY   (United States)

^d UNIVERSITY OF LIVERPOOL   (United Kingdom)

Author keywords

knowledge credibility; replication; reproducibility

Indexed keywords

EID: 85026636738     PISSN: 14761270     EISSN: 1741315X     Source Type: Journal    
DOI: 10.1177/1476127017701076     Document Type: Article

References (34)

1. Aguinis H, (2004) Regression Analysis for Categorical Moderators. New York, NY: Guilford Press.
2. Aguinis H, Edwards J, Bradley K, (2016) Improving our understanding of moderation and mediation in strategic management research. Organizational Research MethodsEpub ahead of print 27 January. DOI: 10.1177/1094428115562749.
3. Aguinis H, Whitehead R, (1997) Sampling variance in the correlation coefficient under indirect range restriction, implications for validity generalization. Journal of Applied Psychology 82: 528–538.
4. Aguinis H, Gottfredson RK, Joo H, (2013) Best-practice recommendations for defining, identifying, and handling outliers. Organizational Research Methods 16: 270–301.
5. Aytug Z, Rothstein H, Zhou Z, Kern M, (2012) Revealed or concealed? Transparency of procedures, decisions, and judgments calls in meta-analyses. Organizational Research Methods 15: 103–133.
6. Baker R, (2012) Independent labs to verify high-profile articles. Nature. DOI: 10.1038.2012.1/176.
7. Bakker M, Wicherts J, (2011) The (mis)reporting of statistical results in psychology journals. Behavior Research Methods 43: 666–678.
8. Banks GC, O’Boyle EH, Pollack JM, White CD, Batchelor JH, (2016) Questions about questionable research practices in the field of management, A guest commentary. Journal of Management 42: 5–20.
9. Begley CG, Ellis LM, (2012) Drug development, raise standards for pre-clinical cancer research. Nature 483: 531–532.
10. Bergh DD, Fairbank JF, (2002) Measuring and testing change in strategic management research. Strategic Management Journal 23: 359–366.
11. Bergh DD, Sharp B, Li M, (2017) Tests for identifying “Red Flags” in empirical findings: Demonstration and recommendations for authors, reviewers, and editors. The Academy of Management Learning and Education 16: 110–124.
12. Berle D, Starcevic V, (2007) Inconsistencies between reported test statistics and p-values in two psychiatry journals. International Journal of Methods in Psychiatric Research 16: 202–207.
13. Bettis RA, Ethiraj S, Gambardella A. (2016) Creating repeatable cumulative knowledge in strategic management. Strategic Management Journal 37: 257–261.
14. Bissell M, (2013) Reproducibility, the risks of the replication drive. Nature 503: 333–334.
15. Bosco FA, Aguinis H, Field JG. (2016) HARKing’s threat to organizational research, evidence from primary and meta-analytic sources. Personnel Psychology 69: 709–750. DOI: 10.1111/peps.12111.
16. Boyd BK, Bergh DD, Ketchen DJ, Jr (2010) Reconsidering the reputation-performance relationship, a resource-based view. Journal of Management 36: 588–609.
17. Butler N, Delaney H, Spoelstra S, (2017) The grey zone: Questionable research practices in the business school. The Academy of Management Learning and Education 16: 94–109.
18. Carpenter S, (2012) Psychology’s bold initiative. Science 335: 1558–1561.
19. Chang AC, Li P, (2015) Is economics research replicable? Sixty published articles from thirteen journals say “usually not.” Finance and economics discussion series 2015-083. Washington, DC: Board of Governors of the Federal Reserve System. Available at: http://dx.doi.org/10.17016/FEDS.2015.083; https://www.federalreserve.gov/econresdata/feds/2015/files/2015083pap.pdf
20. Cortina JM, Aguinis H, DeShon RP, (2017) Twilight of dawn or of evening? A Century of Research Methods in the Journal of Psychology 102: 274–290.
21. Ferguson TD, Ketchen DJ, Jr (1999) Organizational configuration and performance: The role of statistical power in extant research. Strategic Management Journal 20: 385–396.
22. Garcia-Berthou E, Alcaraz C, (2004) Incongruence between test statistics and p values in medical articles. BMC Medical Research Methodology 4: 13.
23. Goldfarb BD, King AA, (2016) Scientific apophenia in strategic management research: Significance tests and mistaken inference. Strategic Management Journal 37: 167–176.
24. Ioannidis JPA, (2012) Why science is not necessarily self-correcting. Perspectives on Psychological Science 7: 645–654.
25. Kepes S, McDaniel MA, (2013) How trustworthy is the scientific literature in industrial and organizational psychology? Industrial and Organizational Psychology 6: 252–268.
26. Kepes S, Bennett A, McDaniel M, (2014) Evidence-based management and the trustworthiness of cumulative scientific knowledge: Implications for teaching, research and practice. The Academy of Management Learning and Education 13: 446–466.
27. Landis RS, Edwards BD, Cortina JM, (2009) On the practice of allowing correlated residuals among indicators in structural equation models. In: Lance CE, Vandenberg RJ, (eds) Statistical and Methodological Myths and Urban Legends. New York: Routledge, pp. 193–214.
28. Myung IJ, (2003) Tutorial on maximum likelihood estimation. Journal of Mathematical Psychology 47: 90–100.
29. O’Boyle EH, Banks GC, Gonzalez-Mulé E, (2014) The Chrysalis effect: How ugly initial results metamorphosize into beautiful articles. Journal of Management 43: 376–399.
30. Park UD, Borah A, Kotha S, (2016) Signaling revisited: The use of signals in the market for IPOs. Strategic Management Journal 37: 2362–2377.
31. Schwab A, Starbuck W, (2017) A call for openness in research reporting: How to turn covert practices into helpful tools. The Academy of Management Learning and Education 16: 125–141.
32. Shaver JM, (2005) Testing for mediating variables in management research, concerns, implications, and alternative strategies. Journal of Management 31: 330–353.
33. Shook CL, Ketchen DJ, Cycyota CS. (2003) Data analytic trends and training in strategic management. Strategic Management Journal 24: 1231–1237.
34. Wright PM, (2016) Ensuring research integrity: An editor’s perspective. Journal of Management 42: 1037–1043.