From significant difference to significant sameness: Proposing a paradigm shift in business research

Journal of Business Research

Volumn 66, Issue 9, 2013, Pages 1377-1388

  Hubbard, Raymond ^a   Murray Lindsay, R ^b  

^a DRAKE UNIVERSITY   (United States)

^b UNIVERSITY OF LETHBRIDGE   (Canada)

Author keywords

(Overlapping) confidence intervals; Abductive inference; Critical realism; Hypothetico deductive inference; P Values; Replication research; Theory development; Theory testing

Indexed keywords

EID: 84878116718     PISSN: 01482963     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbusres.2012.05.002     Document Type: Article

References (132)

1. Akerlof G., Shiller R. Animal spirits: How human psychology drives the economy, and why it matters for global capitalism 2009, Princeton University Press, Princeton, NJ.
2. Aram J., Salipante P. Bridging scholarship in management: Epistemological reflections. British Journal of Management 2003, 14:189-205.
3. Barwise P. Good empirical generalizations. Marketing Science 1995, 14(3):G29-G35.
4. Bass F. Empirical generalizations and marketing science: A personal view. Marketing Science 1995, 14:G6-G19.
5. Bauer H. Scientific literacy and the myth of the scientific method 1992, University of Illinois Press, Urbana.
6. Bayarri M., Mayoral A. Bayesian design of "successful" replications. American Statistician 2002, 56(August):207-214.
7. Bennis W., O'Toole J. How business schools lost their way. Harvard Business Review 2005, 8(3):96-104. (May).
8. Berger J., Berry D. Statistical analysis and the illusion of objectivity. American Scientist 1988, 76:159-165. (March-April).
9. Bhaskar R. A realist theory of science 1978, Harvester Press, Hassocks.
10. Bhaskar R. The possibility of naturalism 1979, Harvester Press, Hassocks.
11. Bishop R. The philosophy of the social sciences 2007, Continuum, New York.
12. Bound J., Ehrenberg A. Significant sameness. Journal of the Royal Statistical Society. Series A 1989, 152:241-247.
13. Box G. Statistics and quality improvement. Journal of the Royal Statistical Society. Series A 1994, 157:209-229.
14. Brinberg D., McGrath J. Validity and the research process 1985, Sage, Newbury Park, CA.
15. Brown R. Explanation in social science 1963, Aldine, Chicago.
16. Brown S., Coney K. Building a replication tradition in marketing. Marketing 1776-1976 and beyond 1976, 622-625. American Marketing Association, Chicago. K.L. Bernhardt (Ed.).
17. Chalmers A. What is this thing called science? 1999, Open University Press, Maidenhead, UK. 3rd ed.
18. Chatfield C. Model uncertainty, data mining and statistical inference (with discussion). Journal of the Royal Statistical Society. Series A 1995, 158:419-466.
19. Chatfield C. Confessions of a pragmatic statistician. Statistician 2002, 51:1-20.
20. Christensen C., Raynor M. Why hard-nosed executives should care about management theory. Harvard Business Review 2003, 81(September):66-74.
21. Christensen C., Raynor M. The innovator's solution: Creating and sustaining successful growth 2003, Harvard Business School Press, Cambridge.
22. Clegg S., Ross-Smith A. Revising the boundaries: Management education and learning in a postpositivist world. The Academy of Management Learning and Education 2003, 2:85-99.
23. Cohen J. Statistical power analysis for the behavioral sciences 1988, Erlbaum, Hillsdale, NJ. 2nd ed.
24. Cook T., Campbell D.T. Quasi-experimentation: Design & analysis issues for field settings 1979, Houghton Mifflin, Boston.
25. Danermark B., Ekström M., Jakobsen L., Karlsson J. Explaining society: Critical realism in the social sciences 2002, Routledge, London.
26. Deming W. On probability as a basis for action. American Statistician 1975, 29(4):146-152.
27. Denrell J. Vicarious learning, undersampling of failure, and the myths of management. Organization Science 2003, 14(3):227-243.
28. Easley R., Madden C., Dunn M. Conducting marketing science: The role of replication in the research process. Journal of Business Research 2000, 48(April):83-92.
29. Easton G. Marketing: A critical realist approach. Journal of Business Research 2002, 55(February):103-109.
30. Ehrenberg A. Data reduction. Revised reprint 1975, Wiley, Chichester.
31. Ehrenberg A. Theory or well-based results: Which comes first?. Research traditions in marketing 1993, 79-108. Kluwer, Boston. G. Laurent, G. Lilien, B. Pras (Eds.).
32. Ehrenberg A., Bound A. Predictability and prediction (with discussion). Journal of the Royal Statistical Society. Series A 1993, 156:167-206.
33. Evanschitzky H., Baumgarth C., Hubbard R., Armstrong S. Replication research's disturbing trend. Journal of Business Research 2007, 46(April):411-415.
34. Fay B. Contemporary philosophy of social science 1996, Blackwell, Oxford.
35. Ferguson T., Ketchen D. Organizational configurations and performance: The role of power in extant research. Strategic Management Journal 1999, 20:385-395.
36. Fisher R. Statistical methods for research workers 1925, Oliver and Boyd, Edinburgh.
37. Fisher R. The arrangement of field experiments. J Min Agric Gr Brit 1926, 33:503-513.
38. Fisher R. The design of experiments 1999, Oliver and Boyd, Edinburgh. 8th ed.
39. Fisher R. Statistical methods and scientific inference 1973, Hafner, New York. 3rd rev. ed.
40. Flyvbjerg B. Making social science matter: Why social inquiry fails and how it can succeed again 2001, Cambridge University Press, Cambridge.
41. Freedman D., Pisani R., Purves R. Statistics 1978, W. W. Norton, New York.
42. Frick R. The appropriate use of null hypothesis testing. Psychological Methods 1996, 1(4):379-390.
43. Fuess S. On replications in business and economics research: The QJBE case. Quarterly Journal of Business & Economics 1996, 35:3-13.
44. Gendall P., Hoek J., Brennan M. The tea bag experiment: More evidence on incentives in mail surveys. Journal of the Market Research Society 1998, 40(October):347-351.
45. Giere R. Science without laws 1999, University of Chicago Press, Chicago.
46. Glymour C. Hypothetico-deductivism is hopeless. Philosophy in Science 1980, 47:322-325.
47. Glymour C. Theory and evidence 1980, Princeton University Press, Princeton.
48. Gorn G. The effects of music in advertising on choice behavior: A classical conditioning approach. Journal of Marketing 1982, 46(Winter):94-101.
49. Green H. Consumer theory 1976, Macmillan, London.
50. Greenwald A. Consequences of prejudice against the null hypothesis. Psychological Bulletin 1975, 82(January):1-20.
51. Hahn G., Meeker W. Assumptions for statistical inference. American Statistician 1993, 47(February):1-11.
52. Haig B. An abductive theory of scientific method. Psychological Methods 2005, 10(4):371-388.
53. Hambrick D. The field of management's devotion to theory: Too much of a good thing?. Academy of Management Journal 2007, 50(December):1346-1352.
54. Harman G. Inference to the best explanation. Philosophical Review 1965, 74(January):88-95.
55. Hartshorne C., Weiss P. Collected papers of Charles Sanders Peirce 1934, vols. 1-5. Harvard University Press, Cambridge, MA.
56. Hausman D. The inexact and separate science of economics 1992, Cambridge University Press, Cambridge.
57. Hempel C. Aspects of scientific explanation 1965, The Free Press, New York.
58. Hicks J. Causality in economics 1979, Blackwell, Oxford.
59. Hubbard R., Armstrong J. Replications and extensions in marketing: rarely published but quite contrary. International Journal of Research in Marketing 1994, 11(June):233-248.
60. Hubbard R., Bayarri M. Confusion over measures of evidence (p's) versus errors (α's) in classical statistical testing (with discussion). American Statistician 2003, 57(August):171-182.
61. Hubbard R., Lindsay R. How the emphasis on "original" empirical marketing research impedes knowledge development. Market Theory 2002, 2(December):381-402.
62. Hubbard R., Vetter D. Replications in the finance literature: An empirical study. Quarterly Journal of Business & Economics 1991, 30(Autumn):70-81.
63. Hubbard R., Vetter D. The publication incidence of replications and critical commentary in economics. The American Economist 1992, 36(Spring):29-34.
64. Hubbard R., Vetter D. An empirical comparison of published replication research in accounting, economics, finance, management, and marketing. Journal of Business Research 1996, 35(February):153-164.
65. Hubbard R., Vetter D. Journal prestige and the publication frequency of replication research in the finance literature. Quarterly Journal of Business & Economics 1997, 36(Autumn):3-14.
66. Hubbard R., Vetter D., Little E. Replication in strategic management: Scientific testing for validity, generalizability, and usefulness. Strategic Management Journal 1998, 19(March):243-254.
67. Hunt S. Controversy in marketing theory: For reason, realism, truth, and objectivity 2003, ME Sharpe, Armonk, NY.
68. Hunter J. The desperate need for replications. Journal of Consumer Research 2001, 28(June):149-158.
69. Keen S. Debunking economics: The naked emperor of the social sciences 2001, Zed Books, London.
70. Kellaris J., Cox A. The effect of background music in advertising: A reassessment. Journal of Consumer Research 1989, 16(June):113-118.
71. Keuzenkamp H. Probability, econometrics and truth: The methodology of econometrics 2000, Cambridge University Press, Cambridge.
72. Keuzenkamp H., McAleer M. Simplicity, scientific inference and econometric modelling. The Econometrics Journal 1995, 105(January):1-21.
73. Kingman J. Statistical responsibility. Journal of the Royal Statistical Society. Series A 1989, 152:277-285.
74. Kirk R. Practical significance: A concept whose time has come. Educational and Psychological Measurement 1996, 56(October):746-759.
75. Krebs R. Scientific laws, principles, and theories: A reference guide 2001, Greenwood Press, Westport, CT.
76. Lakatos I. Falsification and the methodology of research programmes. Criticism and the growth of knowledge 1970, 91-196. Cambridge University Press, Cambridge. I. Lakatos, A. Musgrave (Eds.).
77. Lawson T. Economics and reality 1997, Routledge, London.
78. Lawson T. Reorienting economics 2003, Routledge, London.
79. Leone R., Schultz R. A study of marketing generalizations. Journal of Marketing 1980, 44(Winter):10-18.
80. Leviton L. External validity. International encyclopedia of the social and behaviour sciences 2001, 5:195-200. Elsevier, Oxford. N.J. Smelser, P.B. Baltes (Eds.).
81. Lindsay R. Incorporating statistical power into the test of significance procedure: A methodological and empirical inquiry. Behavioral Research in Accounting 1993, 5:211-236.
82. Lindsay R. Publication system biases associated with the statistical testing paradigm. Contemporary Accounting Research 1994, 11:33-57.
83. Lindsay R. Reconsidering the status of tests of significance: An alternative criterion of adequacy. Accounting, Organizations and Society 1995, 20(1):35-53.
84. Lindsay R., Ehrenberg A. The design of replicated studies. American Statistician 1993, 47(August):217-228.
85. Lipton P. Inference to the best explanation 2004, Routledge, London. 2nd ed.
86. Locke E. The case for inductive theory building. Journal of Management 2007, 33(December):867-890.
87. Losee J. A historical introduction to the philosophy of science 2001, Oxford University Press, Oxford. 4th ed.
88. Lynch J. Theory and external validity. Journal of the Academy of Marketing Science 1999, 27(Summer):367-376.
89. Magnani L. Abduction, reason, and science: Processes of discovery and explanation 2001, Kluwer, Dordrecht.
90. McKelvey B. Organizational systematics: Taxonomic lessons from biology. Management Science 1978, 24:1428-1440.
91. Meehl P. Theory-testing in psychology and physics: A methodological paradox. Philosophy in Science 1967, 34(June):103-115.
92. Mone M., Mueller G., Mauland W. The perceptions and usage of statistical power in applied psychology and management research. Personnel Psychology 1996, 49:103-120.
93. Nelder J. Comment on Chatfield. Journal of the Royal Statistical Society. Series A 1985, 148:238.
94. Nelder J. Statistics, science and technology (with discussion). Journal of the Royal Statistical Society. Series A 1986, 149:109-121.
95. Nelder J. From statistics to statistical science (with discussion). Statistician 1999, 48:257-269.
96. Nickerson R. Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods 2000, 5(2):241-301.
97. Nola R., Sankey H. Theories of scientific method 2007, McGill-Queen's University Press, Montreal.
98. November P. Seven reasons why marketing practitioners should ignore marketing academic research. Australasian Marketing Journal 2004, 12(2):39-50.
99. Ormerod P. The death of economics 1997, Wiley, Chichester.
100. Otley D. Management control and performance management: Whence and whither?. British Accounting Review 2003, 35:309-326.
101. Ottenbacher K. The power of replications and replications of power. American Statistician 1996, 50(August):271-275.
102. Phlips L. Applied consumption analysis 1974, Elsevier, New York.
103. Poole C. Low p-values or narrow confidence intervals; Which are more durable?. Epidemiology 2001, 12(May):291-294.
104. Popper K. The logic of scientific discovery 1959, Hutchinson, London.
105. Popper K. Conjectures and refutations 1963, Routledge, London.
106. Psillos S. Scientific realism: How science tracks truth 1999, Routledge, London.
107. Ravetz J. Scientific knowledge and its social problems 1971, Oxford University Press, Oxford.
108. Reid L., Soley L., Wimmer R. Replication in advertising research: 1977, 1978, 1979. Journal of Advertising 1981, 10:3-13.
109. Rosenthal R. The "file drawer problem" and tolerance for null results. Psychological Bulletin 1979, 86(May):638-641.
110. Rosenthal R., Rosnow R. Essentials of behavioral research: Methods and data analysis 1984, McGraw-Hill, New York.
111. Rozeboom W. Good science is abductive, not hypothetico-deductive. What if there were no significance tests? 1997, 335-391. Erlbaum, Mahwah, NJ. L.L. Harlow, S.A. Mulaik, J.H. Steiger (Eds.).
112. Sayer A. Method in social science: A realist approach 1992, Routledge, London. 2nd ed.
113. Sayer A. Realism and social science 2000, Sage, London.
114. Schmidt F. Statistical significance testing and cumulative knowledge in psychology: Implications for the training of researchers. Psychological Methods 1996, 1(1):115-129.
115. Shadish W., Cook T., Campbell D. Experimental and quasi-experimental designs for generalized causal inference 2002, Houghton Mifflin, Boston.
116. Smith M. Overcoming theory-practice inconsistencies: Critical realism and information systems research. Inform Organiz 2006, 16:191-211.
117. Starbuck W. Keeping a butterfly and an elephant in a house of cards: The elements of exceptional success. Journal of Management Studies 1993, 30:885-921.
118. Starbuck W. The production of knowledge: The challenge of social science research 2006, Oxford University Press, Oxford.
119. Steiger J. Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research 1990, 25(April):173-180.
120. Sterling T., Rosenbaum W., Weinkam J. Publication decisions revisited: The effect of the outcome of statistical tests on the decision to publish and vice versa. American Statistician 1995, 49(February):108-112.
121. Suppe F. Critical introduction and afterword. The structure of scientific theories 1977, 3-241. University of Illinois Press, Urbana, and 617-730. 2nd ed. F. Suppe (Ed.).
122. Trusted J. The logic of scientific inference 1979, Macmillan, London.
123. Tsang E., Kwan K. Replication and theory development in organizational science: A critical realist perspective. Academy of Management Review 1999, 24(October):759-780.
124. Tukey J. Conclusions vs. decisions. Technometrics 1960, 2:423-433.
125. Tukey J. We need both exploratory and confirmatory. American Statistician 1980, 34(February):23-25.
126. Van de Ven A., Johnson E. Knowledge for theory and practice. Academy of Management Review 2006, 31(October):802-821.
127. Wells W. The perils of n=1. Journal of Consumer Research 2001, 28(December):494-498.
128. Winer R. Experimentation in the 21st century: The importance of external validity. Journal of the Academy of Marketing Science 1999, 27(Summer):349-358.
129. Yates F. The influence of statistical methods for research workers on the development of the science of statistics. Journal of the American Statistical Association 1951, 46(March):19-34.
130. Ziliak S., McCloskey D. The cult of statistical significance: How the standard error cost us jobs, justice, and lives 2008, University of Michigan Press, Ann Arbor.
131. Ziman J. Reliable knowledge: An exploration of the grounds for belief in science 1978, Cambridge University Press, Cambridge.
132. Zinkhan G.M., Jones M.Y., Gardial S., Cox K.K. Methods of knowledge development in marketing and macromarketing. Journal of Macromarketing 1990, 10:3-17. (Fall).