Publication Bias in Strategic Management Research

Journal of Management

Volumn 43, Issue 2, 2017, Pages 400-425

  Harrison, Jeffrey S ^a   Banks, George Christopher ^b   Pollack, Jeffrey M ^c   O’Boyle, Ernest H ^d   Short, Jeremy ^e  

^a UNIVERSITY OF RICHMOND   (United States)

^b LONGWOOD UNIVERSITY   (United States)

^c NORTH CAROLINA STATE UNIVERSITY   (United States)

^d UNIVERSITY OF IOWA   (United States)

^e UNIVERSITY OF OKLAHOMA   (United States)

Author keywords

firm performance; meta analysis; publication bias; research methods; strategic management research

Indexed keywords

EID: 85009499673     PISSN: 01492063     EISSN: 15571211     Source Type: Journal    
DOI: 10.1177/0149206314535438     Document Type: Article

References (117)

1. Acedo J. A., Barroso C., Galan J. L., 2006. The resource-based theory: Dissemination and main trends. Strategic Management Journal, 27: 621-636.
2. Banks G. C., Batchelor J. H., McDaniel M. A., 2010. Smarter people are (a bit) more symmetrical: A meta-analysis of the relationship between intelligence and fluctuating asymmetry. Intelligence, 38: 393-401.
3. Banks G. C., Kepes S., Banks K. P., 2012. Publication bias: The antagonist of meta-analytic reviews and effective policy making. Educational Evaluation and Policy Analysis, 34: 259-277.
4. Banks G. C., Kepes S., McDaniel M. A., 2012. Publication bias: A call for improved meta-analytic practice in the organizational sciences. International Journal of Selection and Assessment, 20: 182-196.
5. Banks G. C., McDaniel M. A., 2011. The Kryptonite of evidence-based I-O psychology. Industrial and Organizational Psychology, 4: 40-44.
6. Barney J. B., 1991. Firm resources and sustained competitive advantage. Journal of Management, 27: 643-650.
7. Bausch A., Krist M., 2007. The effect of context-related moderators on the internationalization-performance relationship: Evidence from meta-analysis. Management International Review, 47: 319-347.
8. Begg C. B., Mazumdar M., 1994. Operating characteristics of a rank correlation test for publication bias. Biometrics, 50: 1088-1101.
9. Bergh D. D., Holbein G. F., 1997. Assessment and redirection of longitudinal analysis demonstration with a study of the diversification and divestiture relationship. Strategic Management Journal, 18: 557-571.
10. Bettis R. A., 1991. Strategic management and the straightjacket: An editorial essay. Strategic Management Journal, 2: 35-319.
11. Bettis R. A., 2012. The search for asterisks: Compromised statistical tests and flawed theories. Strategic Management Journal, 33: 108-113.
12. Borenstein M., Hedges L. V., Higgins J. P., Rothstein H. R., 2005. Comprehensive Meta-Analysis (Version 2). Englewood, NJ: Biostat.
13. Borenstein M., Hedges L. V., Higgins J. P. T., Rothstein H. R., 2009. Introduction to meta-analysis. Chichester, UK: Wiley.
14. Bowen F., 2007. Corporate social strategy: Competing views from two theories of the firm. Journal of Business Ethics, 75: 97-113.
15. Boyd B. K., 1991. Strategic planning and financial performance: A meta-analytic review. Journal of Management Studies, 28: 353-374.
16. Boyd B. K., Gove S., Hitt M. A., 2005. Construct measurement in strategic management research: Illusion or reality? Strategic Management Journal, 26: 239-257.
17. Brinckmann J., Grichnik D., Kapsa D., 2010. Should entrepreneurs plan or just storm the castle? A meta-analysis on contextual factors impacting the business planning-performance relationship in small firms. Journal of Business Venturing, 25: 24-40.
18. Briner R. B., Rousseau D. M., 2011. Evidence-based I-O psychology: Not there yet but now a little nearer? Industrial and Organization Psychology: Perspectives on Science and Practice, 4: 76-82.
19. Calantone R. J., Harmancioglu N., Droge C., 2010. Inconclusive innovation “returns”: A meta-analysis of research on innovation in new product development. Journal of Product Innovation Management, 27: 1065-1081.
20. Campbell-Hunt C., 2000. What have we learned about generic competitive strategy? A meta-analysis. Strategic Management Journal, 21: 127-154.
21. Capon N., Farley J. U., Hoenig S., 1990. Determinants of financial performance: A meta-analysis. Management Science, 36: 1143-1159.
22. Carney M., Gedajlovic E. R., Heugens P. P. M.A. R., Van Oosterhout J., 2011. Business group affiliation, performance, context, and strategy: A meta-analysis. Academy of Management Journal, 54: 437-460.
23. Combs J. G., Crook T. R., Shook C., 2005. The dimensionality of organizational performance and its implications for strategic management research. In Ketchen D., Bergh D., (Eds.), Research methodology in strategy and management: 259-286. San Diego, CA: Elsevier.
24. Combs J., Liu Y., Hall A., Ketchen D., 2006. How much do high-performance work practices matter? A meta-analysis of their effects on organizational performance. Personnel Psychology, 59: 501-528.
25. Cooper H., 2010. Research synthesis and meta-analysis: A step-by-step approach (4th ed.). Thousand Oaks, CA.: Sage.
26. Crook T. R., Bratton V. K., Street V. L., Ketchen D. J., 2006. Has strategic management shed the normal science straightjacket? Revisiting Bettis’ (1991) critiques. Journal of Managerial Issues, 18: 409-423.
27. Crook T. R., Ketchen D., Combs J. G., Todd S. Y., 2008. Strategic resources and performance: A meta-analysis. Strategic Management Journal, 29: 1141-1154.
28. Crook T. R., Todd S. Y., Combs J. G., Ketchen D. J., 2011. Does human capital matter? A meta-analysis of the relationship between human capital and firm performance. Journal of Applied Psychology, 96: 443-456.
29. Daily C. M., Certo S. T., Dalton D. R., Roengpitya R., 2003. IPO underpricing: A meta-analysis and research synthesis. Entrepreneurship Theory and Practice, 27: 271-295.
30. Dalton D. R., Aguinis H., Dalton C. A., Bosco F. A., Pierce C. A., 2012. Revisiting the file drawer problem in meta-analysis: An empirical assessment of published and non-published correlation matrices. Personnel Psychology, 65: 221-249.
31. Dalton D. R., Daily C. M., Ellstrand A. E., Johnson J. L., 1998. Meta-analytic reviews of board composition, leadership structure, and financial performance. Strategic Management Journal, 19: 269-290.
32. Dalton D. R., Daily C. M., Johnson J. L., Ellstrand A. E., 1999. Number of directors and financial performance: A meta-analysis. Academy of Management Journal, 42: 674-686.
33. Damanpour F., 1991. Organizational innovation: A meta-analysis of effects of determinants and moderators. Academy of Management Journal, 34: 555-590.
34. Damanpour F., 2010. An integration of research findings of effects of firm size and market competition on product and process innovations. British Journal of Management, 21: 996-1010.
35. Daniel D., Lohrke F. T., Fornaciari C. J., Turner R. A., 2004. Slack resources and firm performance: A meta-analysis. Journal of Business Research, 57: 565-574.
36. Datta D. K., Narayanan V. K., 1989. A meta-analytic review of the concentration-performance relationship: Aggregating findings in strategic management. Journal of Management, 15: 469-463.
37. Dickersin K., 2005. Publication bias: Recognizing the problem, understanding its origins and scope, and preventing harm. In Rothstein H. R., Sutton A. J., Borenstein M., (Eds.), Publication bias in meta analysis: Prevention, assessment, and adjustments: 11-34. Chichester, UK: Wiley.
38. Dickersin K., Min Y., 1993. Publication bias: The problem that won’t go away. Annals of the New York Academy of Sciences, 703: 135-148.
39. Duval S., 2005. The trim and fill method. In Rothstein H. R., Sutton A. J., Borenstein M., (Eds.), Publication bias in meta-analysis: Prevention, assessment and adjustments: 127-144. Chichester, UK: Wiley.
40. Duval S. J., Tweedie R. L., 2000a. A non-parametric “trim and fill” method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association, 95: 89-98.
41. Duval S. J., Tweedie R. L., 2000b. Trim and fill: A simple funnel plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56: 276-284.
42. Editors. 1909. The reporting of unsuccessful cases (editorial). Boston Medical and Surgical Journal, 161: 263-264.
43. Ellis P. D., 2006. Market orientation and performance: A meta-analysis and cross-national comparisons. Journal of Management Studies, 43: 1089-1107.
44. Emerson G. B., Winston M. D., Warme W. J., Wolf F. M., Heckman J. D., Brand R. A., Leopold S. S., 2010. Testing for the presence of positive-outcome bias in peer review. Archives of Internal Medicine, 170: 1934-1939.
45. Evangelou E., Trikalinos T. A., Ioannidis J. P., 2005. Unavailability of online supplementary scientific information from articles published in major journals. FASEB Journal, 19: 1943-1944.
46. Ferguson C. J., Brannick M. T., 2012. Publication bias in psychological science: Prevalence, methods for identifying and controlling, and implications for the use of meta-analyses. Psychological Methods, 17: 120-128.
47. Ferrier J., 1792. Medical histories and reflections, vol. 1. London: Cadell & Davies.
48. Field A. P., Gillett R., 2010. How to do a meta-analysis. British Journal of Mathematical and Statistical Psychology, 63: 665-694.
49. Fleiss J. L., 1981. Statistical methods for rates and proportions (2nd ed.). New York: John Wiley.
50. Gerber A. S., Malhotra N., 2008a. Do statistical reporting standards affect what is published? Publication bias in two leading political science journals. Sociological Methods and Research, 37: 3-30.
51. Gerber A. S., Malhotra N., 2008b. Publication bias in empirical sociological research: Do arbitrary significance levels distort published results? Quarterly Journal of Political Science, 3: 313-326.
52. Geyskens I., Steenkamp J.-B. E. M., Kumar N., 2006. Make, buy, or ally: A transaction cost theory meta-analysis. Academy of Management Journal, 49: 519-543.
53. Gooding R. Z., Wagner J. A., III. 1985. A meta-analytic review of the relationship between size and performance: The productivity and efficiency of organizations and their subunits. Administrative Science Quarterly, 30: 462-481.
54. Grinstein A., 2008. The effect of market orientation and its components on innovation consequences: A meta-analysis. Journal of the Academy of Marketing Science, 36: 166-173.
55. Hall M. B., 1965. In defense of experimental essays. In Robert Boyle on natural philosophy: 119-131. Bloomington: Indiana University Press.
56. Hambrick D. C., 1980. Operationalizing the concept of business-level strategy in research. Academy of Management Review, 5: 567-575.
57. Hancock J. I., Allen D. G., Bosco F. A., McDaniel K. R., Pierce C. A., 2013. Meta-analytic review of employee turnover as a predictor of firm performance. Journal of Management, 39: 573-603.
58. Hedges L. V., Olkin I., 1985. Statistical methods for meta-analysis. New York: Academic Press.
59. Hedges L. V., Vevea J. L., 2005. Selection methods approaches. In Rothstein H. R., Sutton A., Borenstein M., (Eds.), Publication bias in meta analysis: Prevention, assessment, and adjustments: 145-174. Chichester, UK: Wiley.
60. Heugens P. P. M. A. R., Van Essen M., Van Oosterhout J., 2009. Meta-analyzing ownership concentration and firm performance in Asia: Towards a more fine-grained understanding. Asia Pacific Journal of Management, 26: 481-512.
61. Hitt M. A., 2005. Spotlight on strategic management. Business Horizons, 48: 371-377.
62. Hitt M. A., Haynes K. T., Serpa R., 2010. Strategic leadership for the 21st century. Business Horizons, 53: 437-444.
63. Horváthová E., 2010. Does environmental performance affect financial performance? A meta-analysis. Ecological Economics, 70: 52-59.
64. Hubbard R., Vetter D. E., Little E. L., 1998. Replication in strategic management: Scientific testing for validity, generalizability, and usefulness. Strategic Management Journal, 19: 243-254.
65. Jensen M. C., Meckling W. H., 1976. Theory of the firm, managerial behavior, agency costs and ownership structure. Journal of Financial Economics, 13: 187-221.
66. Jick T. D., 1979. Mixing qualitative and quantitative methods: Triangulation in action. Administrative Science Quarterly, 24: 602-611.
67. Kepes S., Banks G. C., McDaniel M. A., Whetzel D. L., 2012. Publication bias in the organizational sciences. Organizational Research Methods, 15: 624-662.
68. Kepes S., McDaniel M. A., 2013. How trustworthy is the scientific literature in I-O psychology? Industrial and Organizational Psychology: Perspectives on Science and Practice, 6: 252-268.
69. Ketchen D. J., Boyd B. K., Bergh D. D., 2013. Research methodology in strategic management: Past accomplishment and future challenges. Organizational Research Methods, 16: 643-658.
70. Ketchen D. J., Combs J. G., Russell C. J., Shook C., Dean M. A., Runge J., Lamoureux S., 1997. Organizational configurations and performance: A meta-analysis. Academy of Management Journal, 40: 223-240.
71. Ketchen D. J., Palmer T. B., 1999. Strategic responses to poor organizational performance: A test of competing perspectives. Journal of Management, 25: 683-706.
72. King D. R., Dalton D. R., Daily C. M., Covin J. G., 2004. Meta-analyses of post-acquisition performance: Indications of unidentified moderators. Strategic Management Journal, 25: 187-200.
73. Kirca A. H., Hult G. T. M., Perry M. Z., Cavusgil S. T., 2012. A multilevel examination of the drivers of firm multinationality: A meta-analysis. Journal of Management, 38: 502-530.
74. Kor Y. Y., Leblebici H., 2005. How do interdependencies among human-capital deployment, development, and diversification strategies affect firms’ financial performance? Strategic Management Journal, 26: 967-985.
75. Krasnikov A., Jayachandran S., 2008. The relative impact of marketing, research-and-development, and operations capabilities on firm performance. Journal of Marketing, 72: 1-11.
76. Landis R. S., Rogelberg S. G., 2013. Our scholarly practices are derailing or progress: The importance of “nothing” in the organizational sciences. Industrial and Organizational Psychology: Perspectives on Science and Practice, 6: 299-302.
77. Le Breton-Miller I., Miller D., 2009. Agency vs. stewardship in public family firms: A social embeddedness reconciliation. Entrepreneurship: Theory and Practice, 33: 1169-1191.
78. Lee D., Madhavan R., 2010. Divestiture and firm performance: A meta-analysis. Journal of Management, 36: 1345-1371.
79. Li J., Lam K., Sun J. J. M., Liu S. X. Y., 2008. Strategic human resource management, institutionalization, and employment modes: An empirical study in China. Strategic Management Journal, 29: 337-342.
80. Lim J. H., Dehning B., Richardson V. J., Smith R. E., 2011. A meta-analysis of the effects of IT investment on firm financial performance. Journal of Information Systems, 25: 145-169.
81. Lux S., Crook R. T., Woehr D. J., 2011. Mixing business with politics: A meta-analysis of the antecedents and outcomes of corporate political activity. Journal of Management, 37: 223-247.
82. Margolis J. D., Elfenbein H. A., Walsh J. P., 2007. Does it pay to be good? What a meta-analysis of CSP and CFP can (and cannot) tell us. Paper presented at the 67th meeting of the Academy of Management, Philadelphia.
83. Meyer K. E., Sinani E., 2009. When and where does foreign direct investment generate positive spillovers? A meta-analysis. Journal of International Business Studies, 40: 1075-1094.
84. Miller C. C., Glick W. H., Wang Y.-D., Huber G. P., 1991. Understanding technology-structure relationships: Theory development and meta-analytic theory testing. Academy of Management Journal, 34: 370-399.
85. Miller K. D., Tsang E. W. K., 2011. Testing management theories: Critical realist philosophy and research methods. Strategic Management Journal, 32: 139-158.
86. Orlitzky M., Schmidt F. L., Rynes S. L., 2003. Corporate social and financial performance: A meta-analysis. Organization Studies, 24: 403-441.
87. Orwin R. G., 1994. Evaluating coding decisions. In Cooper H., Hedges L. V., (Eds.), The handbook of research synthesis: 139-162. New York: Russell Sage.
88. Pagell M., Kristal M. M., 2011. Is the supply chain management file drawer empty? Journal of Supply Chain Management, 4: 3-10.
89. Peters J. L., Sutton A. J., Jones D. R., Abrams K. R., Rushton L., 2007. Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity. Statistics in Medicine, 26: 4544-4562.
90. Porter M. E., 1980. Competitive strategy. New York: Free Press.
91. Rhoades D. L., Rechner P. L., Sandaramurthy C., 2000. Board composition and financial performance: A meta-analysis of the influence of outside directors. Journal of Managerial Issues, 12: 76-91.
92. Richter A. W., Dawson J. F., West M. A., 2011. The effectiveness of teams in organizations: A meta-analysis. International Journal of Human Resource Management, 22: 2749-2769.
93. Rosenthal R., 1984. Applied social research methods series, Vol. 6. Meta-analytic procedures for social research. Newbury Park, CA: Sage.
94. Rosenzweig E. D., Easton G. S., 2010. Tradeoffs in manufacturing: A meta-analysis and critique of the literature. Production and Operations Management, 19: 127-141.
95. Rothstein H. R., Sutton A. J., Borenstein M., 2005. Publication bias in meta-analysis. Prevention, assessment and adjustments. Chichester, UK: Wiley.
96. Rumelt R. P., Schendel D., Teece D. J., 1994. Fundamental issues in strategy. Boston: Harvard Business School Press.
97. Sackett P. R., Larson J. R., Jr. 1990. Research strategies and tactics in industrial and organizational psychology. In Dunnette M. D., Hough L. M., (Eds.), Handbook of industrial and organizational psychology, vol. 1: 419-489. Palo Alto, CA: Consulting Psychologists Press.
98. Scandura T. A., Williams E. A., 2000. Research methodology in management: Current practices, trends, and implications for future research. Academy of Management Journal, 43: 1248-1264.
99. Schmidt F. L., Hunter J. E., in press. Methods of meta-analysis: Correcting error and bias in research findings (3rd ed.). Newbury Park, CA: Sage.
100. Schmidt G. B., Landers R. N., 2013. Solving the replication problem in psychology requires much more than a website. Industrial and Organizational Psychology: Perspective on Science and Practice, 6: 305-309.
101. Shook C. L., Ketchen D. J., Hult G. T., Kacmar K. M., 2004. An assessment of the use of structural equation modeling in strategic management research. Strategic Management Journal, 25: 397-404.
102. Short J. C., Ketchen D. J., Palmer T. B., 2002. The role of sampling in strategic management research on performance: A two-study analysis. Journal of Management, 28: 363-385.
103. Snow C. C., Thomas J. B., 1994. Field research methods in strategic management: Contributions to theory building and testing. Journal of Management Studies, 31: 457-480.
104. Stanley T. D., 2005. Beyond publication bias. Journal of Economic Surveys, 19: 309-337.
105. Sterne J., Becker B., Egger M., 2005. The funnel plot. In Rothstein H., Sutton A., Borenstein M., (Eds.), Publication bias in meta-analysis: Prevention, assessment and adjustments: 75-98. Chichester, UK: Wiley.
106. Sterne J. A. C., Sutton A. J., Ioannidis J. P. A., Terrin N., Jones D. R., Lau J., Carpenter J., Rucker G., Harbord R. M., Schmid C. H., Tetzlaff J., Deeks J. J., Peters J., Macaskill P., Schwarzer G., Duval S., Altman D. G., Moher D., Higgins J. P. T., 2011. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. British Medical Journal, 343: d4002.
107. St. John C. H., Harrison J. S., 1999. Manufacturing-based relatedness, synergy, and coordination. Strategic Management Journal, 20: 129-145.
108. Subramony M., 2009. A meta-analytic investigation of the relationship between HRM bundles and firm performance. Human Resource Management, 48: 745-768.
109. Tihanyi L., Griffith D. A., Russell C. J., 2005. The effect of cultural distance on entry mode choice, international diversification, and MNE performance: A meta-analysis. Journal of International Business Studies, 26: 270-283.
110. Tosi H. L., Werner S., Katz J. P., Gomez-Mejia L. R., 2000. How much does performance matter: A meta-analysis of CEO pay studies. Journal of Management, 26: 301-339.
111. Tsang E. W. K., Kwan K., 1999. Replication and theoretical development in organizational science: A critical realist perspective. Academy of Management Review, 24: 759-780.
112. Van Essen M., Van Oosterhout J. H., Carney M., 2012. Corporate boards and the performance of Asian firms: A meta-analysis. Asia Pacific Journal of Management, 29: 873-905.
113. Van Wijk R., Jansen J. P., Lyles M. A., 2008. Inter- and intra-organizational knowledge transfer: A meta-analytic review and assessment of its antecedents and consequences. Journal of Management Studies, 45: 830-853.
114. Vermeulen F., 2012. Publication bias (or, why you can’t trust any of the research you read). Forbes. Retrieved from http://www.forbes.com/
115. Vevea J. L., Woods C. M., 2005. Publication bias in research synthesis: Sensitivity analysis using a priori weight functions. Psychological Methods, 10: 428-443.
116. Weinhandl E. D., Duval S., 2012. Generalization of trim and fill for application in meta-regression. Research Synthesis Methods, 3: 51-67.
117. Williamson O. E., 1975. Markets and hierarchies. New York: Free Press.