Solutions to the credibility crisis in management science

Academy of Management Learning and Education

Volumn 16, Issue 1, 2017, Pages 142-162

  Byington, Eliza K ^a   Felps, Will ^b  

^a UNIVERSITY OF SYDNEY   (Australia)

^b UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85018463123     PISSN: 1537260X     EISSN: None     Source Type: Journal    
DOI: 10.5465/amle.2015.0035     Document Type: Article

References (116)

1. Aquino, K., Freeman, D., Reed, I. I. A., Lee, K., & Felps, W. 2009. Testing a social-cognitive model of moral behavior: The interactive influence of situations and moral identity centrality. Journal of Personality and Social Psychology, 97(1): 123-141.
2. Association for Psychological Science 2015a. Registered replication reports. http://www.psychologicalscience.org/index. php/replication.
3. Association for Psychological Science 2015b. Authors leading the way in open science. http://www.psychologicalscience. org/index.php/publications/journals/psychological-science/badge-earners.
4. Atwater, L. E.,Mumford,M. D., Schriesheim, C. A., & Yammarino, F. J. 2014. Retraction of leadership articles: Causes and prevention. The Leadership Quarterly, 25(6): 1174-1180.
5. Bakker, M., &Wicherts, J. M. 2011. The (mis)reporting of statistical results in psychology journals. Behavior Research Methods, 43(3): 666-678.
6. Balliet, D. 2010. Communication and cooperation in social dilemmas: A meta-analytic review. The Journal of Conflict Resolution, 54(1): 39-57.
7. Bartunek, J. M., Rynes, S. L., & Ireland, R. D. 2006. What makes management research interesting, and why does it matter? Academy of Management Journal, 49(1): 9-15.
8. Bedeian, A. G., Taylor, S. G., & Miller, A. N. 2010. Management science on the credibility bubble: Cardinal sins and various misdemeanors. Academy of Management Learning & Education, 9: 715-725.
9. Benjamini, Y. 2010. Discovering the false discovery rate. Journal of the Royal Statistical Society. Series B, Statistical Methodology, 72(4): 405-416.
10. Bettis, R. A. 2012. The search for asterisks: Compromised statistical tests and flawed theories. Strategic Management Journal, 33(1): 108-113.
11. Beyer, J. M., Chanove, R. G., & Fox, W. B. 1995. The review process and the fates of manuscripts submitted to AMJ. Academy of Management Journal, 38: 1219-1260.
12. Beyer, J. M., Chattopadhyay, P., George, E., Glick, W. H., Ogilvie, D. T., & Pugliese, D. 1997. The selective perception of managers revisited. Academy ofManagement Journal, 40: 716-737.
13. Bhattacharjee, Y. 2013, April 23. The mind of a con man. The New York Times, MM44.
14. Biel, A., & Thøgersen, J. 2007. Activation of social norms in social dilemmas: A review of the evidence and reflections on the implications for environmental behaviour. Journal of Economic Psychology, 28(1): 93-112.
15. Blanton, H., et al. 2009a. Strong claims and weak evidence: Reassessing the predictive validity of the IAT. The Journal of Applied Psychology, 94: 567-582.
16. Blanton, H., et al. 2009b. Transparency should trump trust: Rejoinder to McConnell and Leibold (2009) and Ziegert and Hanges (2009). The Journal of Applied Psychology, 94: 598-603.
17. Bosco, F. A., Aguinis, H., Field, J. G., Pierce, C. A., & Dalton, D. R. 2015. HARKing's threat to organizational research: Evidence from primary and meta-analytic sources. Personnel Psychology, 69(3): 709-750.
18. Briner, R. B., &Walshe, N. D. 2013. The causes and consequences of a scientific literature we cannot trust: An evidence-based practice perspective. Industrial and Organizational Psychology: Perspectives on Science and Practice, 6(3): 269-272.
19. Ceci, S. J., & Walker, E. 1983. Private archives and public needs. The American Psychologist, 38(4): 414-423.
20. Center for Open Science 2015a. Improving the credibility of scientific research. http://centerforopenscience.org/pr/2014-05-19/.
21. Center for Open Science 2015b, January 24. Badges to acknowledge open practices. https://osf.io/tvyxz/wiki/1.%20View% 20the%20Badges/.
22. Chen, X. P. 1996. The group-based binding pledge as a solution to public goods problems. Organizational Behavior and Human Decision Processes, 66: 192-202.
23. Chen, X., & Komorita, S. S. 1994. The effects of communication and commitment in a public goods social dilemma. Organizational Behavior and Human Decision Processes, 60: 367-386.
24. Colquitt, J. A., & Zapata-Phelan, C. P. 2007. Trends in theory building and theory testing: A five-decade study of the Academy of Management Journal. Academy of Management Journal, 50(6): 1281-1303.
25. Credé, M., & Harms, P. D. 2015. 25 years of higher-order confirmatory factor analysis in the organizational sciences: A critical review and development of reporting recommendations. Journal of Organizational Behavior, 36(6): 845-872.
26. Dawes, R. M. 1980. Social dilemmas. Annual Review of Psychology, 31: 169-193.
27. Deutsch, M., & Gerard, H. B. 1955. A study of normative and informational social influences upon individual judgment. Journal of Abnormal and Social Psychology, 51(3): 629-636.
28. Drazin, R., & Kazanjian, R. K. 1990. A reanalysis of Miller and Friesen's life cycle data. Strategic Management Journal, 11: 319-325.
29. DRYAD 2015. Frequently asked questions: Do I have the option to embargo release of my data? http://datadryad.org/pages/faq.
30. Edwards, J. R., Scully, J. A., & Brtek, M. D. 2000. The nature and outcomes of work: A replication and extension of interdisciplinary work-design research. The Journal of Applied Psychology, 85: 860-868.
31. Fanelli, D. 2009. How many scientists fabricate and falsify research? A systematic review and meta-analysis of survey data. PLoS One, 4(5): E5738.
32. Fanelli, D. 2011. Negative results are disappearing from most disciplines and countries. Scientometrics, 90(3): 891-904.
33. Felps, W., van Eck, N. J., Waltman, L., & Meuers, J. 2014. The management discipline: A bibliometric and qualitative synthesis. Presented at the Annual meeting of the Academy of Management, Philadelphia, PA.
34. Fox, M. 2010. Erratum response to Beamish and Bapuji. Management and Organization Review, 6(1): 151-155.
35. Francis, G. 2014. The frequency of excess success for articles in Psychological Science. Psychonomic Bulletin & Review, 21(5): 1180-1187.
36. Friedman, M. 1999. Consumer boycotts: Effecting change through the marketplace and the media. New York, NY: Routledge.
37. Friedman, R. A., & Currall, S. C. 2003. Conflict escalation: Dispute exacerbating elements of e-mail communication. Human Relations, 56(11): 1325-1347.
38. Goldfarb, B. D., & King, A. A. 2016. Scientific apophenia in strategic management research. Strategic Management Journal, 37(1): 167-176.
39. Gong, H., et al. 2014. Commentaries and rejoinder on ?Ze?zelj and Jokíc (2014). Social Psychology, 45(4): 327-334.
40. Greenwald, A. G. 1975. Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82: 1-20.
41. Hambrick, D. C. 2007. The field of management's devotion to theory: Too much of a good thing? Academy of Management Journal, 50(6): 1346-1352.
42. Handelsblatt Business Administration Ranking 2009. Top 100 researchers under 40 ranking. Handelsblatt. http://tool. handelsblatt.com/tabelle/?id530.
43. Harrison, J. S., Banks, G. C., Pollack, J. M., O'Boyle, E. H., & Short, J. 2017. Publication bias in strategic management research. Journal of Management, 43(2): 400-425.
44. Hollenbeck, J. R. 2008. The role of editing in knowledge development: Consensus shifting and consensus creation. In Y. Baruch, A. M. Konrad, H. Aguinus, & W. H. Starbuck (Eds.), Journal editing: Opening the black box: 16-26. San Francisco, CA: Jossey Bass.
45. Honig, B., Lampel, J., Siegel, D., & Drnevich, P. 2014. Ethics in the production and dissemination of management research: Institutional failure or individual fallibility? Journal of Management Studies, 51(1): 118-142.
46. Hubbard, R. 2015. Corrupt research: The case for reconceptualizing empirical management and social science. Newcastle upon Tyne, UK: Sage.
47. Hubbard, R., & Armstrong, J. S. 1994. Replications & extensions in marketing: Rarely published but quite contrary. International Journal of Research in Marketing, 11: 233-248.
48. Hubbard, R., & Lindsay, R. M. 2013. From significant difference to significant sameness: Proposing a paradigm shift in business research. Journal of Business Research, 66(9): 1377-1388.
49. Hubbard, R., & Vetter, D. E. 1996. An empirical comparison of published replication research in accounting, economics, finance, management, and marketing. Journal of Business Research, 35(2): 153-164.
50. Hubbard, R., Vetter, D. E., & Little, E. L. 1998. Replication in strategic management: Scientific testing for validity, generalizability, and usefulness. Strategic Management Journal, 19(3): 243-254.
51. Ioannidis, J. P. A. 2005. Why most published research findings are false. PLoS Medicine, 2: 0696-0701.
52. Ireland, R. D. 2008. From the editors: Your manuscript's journey through the AMJ review process. Academy of Management Journal, 51(3): 409-412.
53. JBP Provisional Acceptance Special Initiative resource site. 2015, January 19. https://jbp.uncc.edu/.
54. John, L. K., Loewenstein, G., & Prelec, D. 2012. Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23(5): 524-532.
55. Jones, S. R. G. 1992. Was there a Hawthorne Effect? American Journal of Sociology, 98(3): 451-468.
56. Judge, T. A., Cable, D. M., Colbert, A. E., & Rynes, S. L. 2007. What causes a management article to be cited - Article, author, or journal? Academy of Management Journal, 50(3): 491-506.
57. Karabag, S. F., & Berggren, C. 2012. Retraction, dishonesty and plagiarism: Analysis of a crucial issue for academic publishing, and the inadequate responses from leading journals in economics and management disciplines. Journal of Applied Economics and Business Research, 2(4): 172-183.
58. Kepes, S., Bennett, A., & McDaniel, M. 2014. Evidence-based management and the trustworthiness of our cumulative scientific knowledge: Implications for teaching, research, and practice. Academy of Management Learning & Education, 13: 446-466.
59. Kepes, S., & McDaniel, M. A. 2013. How trustworthy is the scientific literature in industrial and organizational psychology? Industrial and Organizational Psychology: Perspectives on Science and Practice, 6(3): 252-268.
60. Kerr, N. L. 1989. Illusions of efficacy: The effects of group size on perceived efficacy in social dilemmas. Journal of Experimental Social Psychology, 25(4): 287-313.
61. Kerr, N. L. 1998. HARKing: Hypothesizing after the results are known. Personality and Social Psychology Review, 2(3): 196-217.
62. Kerr, S., Tolliver, J., & Petree, D. 1977. Manuscript characteristics which influence acceptance for management and social science journals. Academy of Management Journal, 20(1): 132-141.
63. King, G. 1995. Replication, replication. PS, Political Science & Politics, 28(3): 444-452.
64. Landis, R. S., James, L. R., Lance, C. E., Pierce, C. A., & Rogelberg, S. G. 2014. When is nothing something? Editorial for the null results special issue of Journal of Business and Psychology. Journal of Business and Psychology, 29(2): 163-167.
65. Landis, R. S., & Rogelberg, S. G. 2013. Our scholarly practices are derailing our progress: The importance of "nothing" in the organizational sciences. Industrial and Organizational Psychology: Perspectives on Science and Practice, 6(3): 299-302.
66. Lehrer, J. 2010, December 13. The truth wears off. Is there something wrong with the scientific method? The New Yorker.
67. Leung, K. 2011. Presenting post hoc hypotheses as a-priori: Ethical and theoretical issues. Management and Organization Review, 7(3): 471-479.
68. Mahoney, M. J. 1977. Publication prejudices: An experimental study of confirmatory bias in the peer review system. Cognitive Therapy and Research, 1(2): 161-175.
69. Marcus, A., & Oransky, I. 2014. What studies of retractions tell us. Journal of Microbiology & Biology Education, 15(2): 151-154.
70. Marcus, E. 2014. Credibility and reproducibility. Cell, 159(5): 965-966.
71. Matlack, C. 2013, June 24. Research fraud allegations trail a German B-school wunderkind. BloombergView. http://www. bloomberg.com/bw/articles/2013-06-24/research-fraud-allegations- trail-a-german-b-school-wunderkind.
72. McCullough, B. D., McGeary, K. A., & Harrison, T. D. 2006. Lessons from the JMCB Archive. Journal of Money, Credit and Banking, 38(4): 1093-1107.
73. McCullough, B. D., McGeary, K. A., & Harrison, T. D. 2008. Do economics journal archives promote replicable research? The Canadian Journal of Economics. Revue Canadienne d'Economique, 41(4): 1406-1420.
74. Messick, D. M., & Brewer,M. B. 1983. Solving social dilemmas: A review. Review of Personality and Social Psychology, 4(1): 11-44.
75. Mezias, S. J., & Regnier,M. O. 2007. Walking the walk aswell as talking the talk: Replication and the normal science paradigm in strategic management research. Strategic Organization, 5(3): 283-296.
76. Mittelstaedt, R. A., & Zorn, T. S. 1984. Econometric replication: Lessons from the experimental sciences. Quarterly Journal of Business and Economics, 23(1): 9-15.
77. Mone, M. A., & McKinley, W. 1993. The uniqueness value and its consequences for organization studies. Journal of Management Inquiry, 2: 284-296.
78. National Institutes of Health 2015, February 19. Principles and guidelines for reporting preclinical research. http://www.nih. gov/about/reporting-preclinical-research.htm.
79. Nature. 2015. Recommended repositories: Scientific data. Retrieved from: Http://bit.ly/1SCmpjb.
80. Newcombe, R. G. 1987. Towards a reduction in publication bias. British Medical Journal, 295(12): 656-659.
81. Nord, W. R. 1985. Looking at ourselves as we look at others: An exploration of the publication system for organization research. In L. L. Cummings & P. J. Frost (Eds.), Publishing in the organizational sciences: 76-88. Homewood, IL: Irwin.
82. Nosek, B. A., Spies, J. R., & Motyl, M. 2012. Scientific utopia II. Restructuring incentives and practices to promote truth over publishability. Perspectives on Psychological Science, 7(6): 615-631.
83. O'Boyle, E. H., Rutherford, M. W., & Banks, G. C. 2014. Publication bias in entrepreneurship research: An examination of dominant relations to performance. Journal of Business Venturing, 29(6): 773-784.
84. OECD 2007. OECD principles and guidelines for access to research data from public funding. Organisation for Economic Co-Operation and Development. http://www.oecd.org/sti/sci-tech/38500813.pdf.
85. Open Science Collaboration 2015. Estimating the reproducibility of psychological science. Science, 349(6251): Aac4716.
86. Opp, K.-D. 2009. Theories of political protest and social movements. New York: Routledge.
87. Oransky, I. 2012. Three papers by German management prof retracted for duplication, statistical issues. Retraction Watch. http://retractionwatch.com/2012/07/17/three-papers-by-germanmanagement- prof-retracted-for-duplication-statistical-issues/.
88. Orlitzky, M. 2011. Institutional logics in the study of organizations: The social construction of the relationship between corporate social and financial performance. Business Ethics Quarterly, 21(3): 409-444.
89. Pampel, H., Vierkant, P., Scholze, F., Bertelmann, R., & Kindling, M., et al. 2013. Making research data repositories visible: The re3data.org registry.
90. Peterson, M. J. 1995. Community and individual stakes in the collection, analysis, and availability of data. PS, Political Science & Politics, 28(3): 462-464.
91. Pfeffer, J. 2007. A modest proposal: How we might change the process and product of managerial research. Academy of Management Journal, 50: 1334-1345.
92. Pillutla, M. M., & Chen, X.-P. 1999. Social norms and cooperation in social dilemmas: The effects of context and feedback. Organizational Behavior and Human Decision Processes, 78(2): 81-103.
93. Pillutla, M. M., & Thau, S. 2013. Organizational sciences' obsession with "that's interesting!": Consequences and an alternative. Organizational Psychology Review, 3(2): 187-194.
94. PubPeer 2015. Journal activity. https://pubpeer.com/journals.
95. Rasmussen, K. B., & Blank,G. 2007. The data documentation initiative: Apreservation standard for research. Archival Science, 7(1): 55-71. re3data.org 2014, April 14. Registry of research data repositories. http://www.re3data.org/.
96. Renkewitz, F., Fuchs, H. M., & Fiedler, S. 2011. Is there evidence of publication biases in JDM research. Judgment and Decision Making, 6(8): 870-881.
97. Rosenthal, R. 1979. The file drawer problem and tolerance for null results. Psychological Bulletin, 86: 638-641.
98. Rynes, S. L. 2007. Time flies when you're having fun: AMJ, 2005-2007. Academy of Management Journal, 50(6): 1273-1276.
99. Scandura, T. A., & Williams, E. A. 2000. Research methodology in management: Current practices, trends, and implications for future research. Academy ofManagement Journal, 43(6): 1248-1264.
100. Schmidt, G. B., & Landers, R. N. 2013. Solving the replication problem in psychology requires much more than a website. Industrial and Organizational Psychology: Perspectives on Science and Practice, 6(3): 305-309.
101. Schmidt, S. 2009. Shall we really do it again? The powerful concept of replication is neglected in the social sciences. Review of General Psychology, 13(2): 90-100.
102. Shaffer, J. P. 1995. Multiple hypothesis testing. Annual Review of Psychology, 46(1): 561-584.
103. Simmons, J. P., Nelson, L. D., & Simonsohn, U. 2011. False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22(11): 1359-1366.
104. Simonsohn, U. 2013. Just post it: The lesson from two cases of fabricated data detected by statistics alone. Psychological Science, 24(10): 1875-1888.
105. Singh, K., Ang, S. H., & Leong, S. M. 2003. Increasing replication for knowledge accumulation in strategy research. Journal of Management, 29(4): 533-549.
106. SMJ editors. 2014. Call for papers for a special issue: Replication in Strategic Management. http://bit.ly/23gB4lE.
107. Sutton, S. C. 2013. Open access, publisher embargoes, and the voluntary nature of scholarship: An analysis. College & Research Libraries News, 74(9): 468-472.
108. Terpstra, D. E., & Rozell, E. J. 1998. Human resource executives' perceptions of academic research. Journal of Business and Psychology, 13(1): 19-29.
109. Tsang, E. W. K., & Kwan, K. 1999. Replication and theory development in organizational science: A critical realist perspective. Academy of Management Review, 24(4): 759-780.
110. Van Iddekinge, C. H., Roth, P. L., Raymark, P. H., & Odle- Dusseau, H. N. 2012. The criterion-related validity of integrity tests: An updated meta-analysis. The Journal of Applied Psychology, 97(3): 499-530.
111. Wagenmakers, E., Wetzels, R., Borsboom, D., & van der Maas, H. L. 2011. Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011). Journal of Personality and Social Psychology, 100(3): 426-432.
112. Webster, E. J., & Starbuck, W. H. 1988. Theory building in industrial and organizational psychology. InC. L. Cooper& I. T. Robertson (Eds.), International review of industrial and organizational psychology: 93-138. London: Wiley.
113. Wicherts, J.M., Bakker,M., &Molenaar, D. 2011. Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results. PLoSOne, 6(11): E26828.
114. Wicherts, J. M., Borsboom, D., Kats, J., & Molenaar, D. 2006. The poor availability of psychological research data for reanalysis. The American Psychologist, 61(7): 726-727.
115. Williams, R. 2015. Can't get no reproduction: Leading researchers discuss the problem of irreproducible results. Circulation Research, 117(8): 667-670.
116. Zeng, M., & Chen, X. P. 2003. Achieving cooperation in multiparty alliances: A social dilemma approach to partnership management. Academy of Management Review, 28: 587-605.