Commentaries the design of replicated studies

American Statistician

Volumn 47, Issue 3, 1993, Pages 217-228

  Lindsay, R Murray ^a   Ehrenberg, A S C ^b,c  

^a UNIVERSITY OF SASKATCHEWAN   (Canada)

^b LONDON SOUTH BANK UNIVERSITY   (United Kingdom)

^c NEW YORK UNIVERSITY   (United States)

Author keywords

Close replications; Differential replications; One off studies; Varying more than one condition

Indexed keywords

EID: 84953202889     PISSN: 00031305     EISSN: 15372731     Source Type: Journal    
DOI: 10.1080/00031305.1993.10475983     Document Type: Article

References (63)

1. Abdolmohammadi, M. J., Menon, K., Olever, T. W., and Umapathy, S. (1985), “The Role of the Doctoral Dissertation in Accounting Research Careers,” Issues in Accounting Research, 5976.
2. Acree, M. C. (1978), “Theories of Statistical Inference in Psychological Research: A Historic-Critical Study,” unpublished Ph.D. dissertation, Clark University.
3. Barlow, D. H., and Hersen, M. (1984), Single Case Experimental Designs, New York: Pergamon Press.
4. Bound, J. A., and Ehrenberg, A. S. C. (1993), “Model Extension and Model Tuning: A Case Study,” Working Paper.
5. Brownell, P. (1982), “The Role of Accounting Data on Performance Evaluation, Budgetary Participation, and Organizational Effectiveness,” Journal of Accounting Research, 20, 12-27.
6. Brownell, P. (1985), “Budgeting Systems and Control of Functionally Differentiated Organizational Activities,” Journal of Accounting Research, 23, 502-512.
7. Brownell, P. (1987), “The Use of Accounting Information in Management Control,” in Management Planning and Control (rev. ed.), eds. K. R. Ferris and J. L. Livingstone, Beavercreek, OH: Century VII, pp. 177-196.
8. Brownell, P., and Hirst, M. (1986), “Reliance on Accounting Information, Budgeting Participation, and Task Uncertainty: Tests of a Three-Way Interaction,” Journal of Accounting Research, 24, 241-249.
9. Burgstahler, D. (1987), “Influence From Empirical Research,” The Accounting Review, LXII, 203-207.
10. Burgstahler, D., and Sundem, G. L. (1989), “The Evolution of Behavioral Accounting Research in the United States, 1968-1987,” Behavioral Research in Accounting, 1, 75-108.
11. Campbell, D. T. (1969), “Reforms in Experiments,” American Psychologist, 24, 409-429.
12. Campbell, D. T. (1986), “Science’s Social System of Validity-Enhancing Collective Belief Change and the Problems of the Social Sciences,” in Metatheory in Social Science: Pluralisms and Subjectivities, eds. D. W. Fiske and R. A. Shweder, Chicaco: University of Chicago Press, pp. 108-135.
13. Carver, R. P. (1978), “The Case Against Statistical Significance Testing,” Harvard Educational Review, 48, 378-399.
14. Chase, J. M. (1970), “Normative Criteria for Scientific Publications,” American Sociologist, 5, 262-265.
15. Collins, H. M. (1984), “Discussion: When Do Scientists Prefer to Vary Their Experiments,” Studies in the History and Philosophy of Science, 15, 169-174.
16. Collins, H. M. (1985), Changing Order: Replication and Induction in Scientific Practice, London: Sage Publications.
17. Dall’Olmo Riley, F. (1992), “Consumer Promotions: A Literature Review,” London Business School, CMaC Working Paper.
18. Deming, W. E. (1950), Some Theory of Sampling, New York: John Wiley.
19. Deming, W. E. (1975), “On Probability as a Basis for Action,” The American Statistician, 29, 146-152.
20. Denzin, N. K. (1970), The Research Act, Chicago: Aldine.
21. Ehrenberg, A. S. C. (1966), “Laws in Marketing: A Tail-Piece,” Applied Statistics, 15, 257-267.
22. Ehrenberg, A. S. C. (1975), Data Reduction, New York: John Wiley.
23. Ehrenberg, A. S. C. (1982), A Primer in Data Reduction, New York: John Wiley.
24. Ehrenberg, A. S. C. (1990), “A Hope for the Future of Statistics: MSoD,” The American Statistician, 44, 195-196.
25. Ehrenberg, A. S. C., and England, L. R. (1990), “Generalising a Pricing Effect,” Journal of Industrial Economics, 39a, 47-68.
26. Ehrenberg, A. S. C., and Bound, J. A. (1993, in press), “Predictability and Prediction,” Journal of the Royal Statistical Society, Ser. A.
27. Ehrenberg, A. S. C., and Lindsay, R. M. (1993), “The Analysis of Replicated Studies,” Working Paper.
28. Finifter, B. M. (1972), “The Generation of Confidence: Evaluating Research Findings by Random Subsample Replication,” in Sociological Methodology, ed. H. L. Costner, San Francisco: Jossey-Bass, pp. 112-175.
29. Fisher, R. A. (1935), The Design of Experiments, Edinburgh: Oliver and Boyd.
30. Gigerenzer, G. (1987), “Probabilistic Thinking and the Fight Against Subjectivity,” in The Probabilistic Revolution (Vol. 2), eds. L. Kruger, G. Gigerenzer, and M. S. Morgan, Cambridge, MA: MIT Press, pp. 11-34.
31. Gigerenzer, G., Swijtink, Z., Porter, T., Daston, L., Beatty, J., and Krugger, L. (1989), The Empire of Chance: How Probability Changed Science and Everyday Life, Cambridge: Cambridge University Press.
32. Govindarajan, V. (1984), “Appropriateness of Accounting Data in Performance Evaluation: An Empirical examination of Environmental Uncertainty as an Intervening Variable,” Accounting, Organizations and Society, 9, 125-135.
33. Guttman, L. (1985), “The Illogic of Statistical Inference for Cumulative Science,” Applied Stochastic Models and Data Analysis, 1, 3-10.
34. Harré, R. (1990), Great Scientific Experiments, New York: Oxford University Press.
35. Hedges, L. W., and Olkin, I. (1985). Statistical Analysis in Metaanalysis, Orlando: Academic Press.
36. Hirst, M. K. (1981), “Accounting Information and the Evaluation of Subordinate Performance,” The Accounting Review, LVI, 771-784.
37. Hirst, M. K. (1983), “Reliance on Accounting Performance Measures, Task Uncertainty, and Dysfunctional Behaviour: Some Extensions,” Journal of Accounting Research, 596-605.
38. Hopwood, A. (1972), “An Empirical Study of the Role of Accounting Data in Performance Evaluation,” Journal of Accounting Research (suppl.), 156-182.
39. Hubbard, R., and Armstrong, J. S. (1989), “Replication and the Development of Marketing Science,” 1989 Summer Educators Conference, Chicago: American Marketing Association.
40. Johnstone, D. J. (1986), “Tests of Significance in Theory and Practice,” The Statistician, 35, 491-498.
41. Kempthorne, O. (1978), “Logical, Epistemological and Statistical Aspects of Nature-Nurture Data Interpretation,” Biometrics, 34, 1-23.
42. Kerr, S., Tolliver, J., and Petree, D. (1977), “Manuscript Characteristics Which Influence Acceptance for Management and Social Science Journals,” Academy of Management Review, 20, 132-141.
43. Kuhn, T. S. (1970), The Structure of Scientific Revolutions (2nd ed.), Chicago: The University of Chicago Press.
44. Lindsay, R. M. (1990), “An Examination of the ‘Negative Result’ Bias: Some Empirical Evidence and a Statistical Redress,” Canadian Academic Accounting Conference, Victoria.
45. Lykken, D. T. (1968), “Statistical Significance in Psychological Research,” Psychological Bulletin, 70, 151-159.
46. Mack, R. W. (1951), “The Need for Replication Research in Sociology,” American Sociological Review, 16, 93-94.
47. Mahoney, M. J. (1985), “Open Exchange and Epistemic Progress,” American Psychologist, 40, 29-39.
48. Mulkay, M., and Gilbert, G. N. (1986), “Replication and Mere Replication,” Philosophy of the Social Sciences, 16, 21-37.
49. Nelder, J. A. (1986), “Statistics, Science and Technology,” (Presidential Address), Journal for the Royal Statistical Society, Ser. A, 149, 109-121.
50. Oakes, M. (1986), Statistical Inference: A Commentary for the Social and Behavioral Sciences, New York: John Wiley.
51. Otley, D. T. (1978), “Budget Use and Managerial Performance,” Journal of Accounting Research, 16, 324-335.
52. Pearson, E. S. (1938), “Student as Statistician,” Biometrika, 30, 210-250.
53. Popper, K. R. (1959), The Logic of Scientific Discovery, London: Hutchinson.
54. Ravetz, J. R. (1971), Scientific Knowledge and Its Social Problems, New York: Oxford University Press.
55. Rosenthal, R. (1976), Experimenter Effects in Behavioral Research (enlarged ed.), New York: Irvington.
56. Rowney, J. A., and Zenisek, T. J. (1980), “Manuscript Characteristics Influencing Reviewers’ Decisions,” Canadian Psychology, 21, 17-21.
57. Scherr, G. H. (1983), “Irreproducible Science: Editor’s Introduction,” The Best of the Journal of Irreproducible Results, New York: Workman Publishing.
58. Smith, N. C. (1970), “Replication Studies: A Neglected Aspect of Psychological Research,” American Psychologist, 25, 970-975.
59. Umapathy, S. (1987), “Unfavorable Variances in Budgeting: Analysis and Recommendations,” in Management Planning and Control (rev. ed), eds. K. R. Ferris and J. L. Livingstone, Beavercreek, OH: Century VII, pp. 163-176.
60. Uncles, M. D., Hammond, K. A., Ehrenberg, A. S. C., and Davis, R. E. (in press), “A Replication Study of Two Brand Loyalty Measures,” European Journal of Operational Research.
61. Wachter, K. W., and Straf, M. L. (1990), The Future of Meta-Analysis, New York: Russell Sage Foundation.
62. Walster, G. W., and Cleary, T. A. (1970), “A Proposal for a New Editorial Policy in the Social Sciences,” The American Statistician, 24, 16-19.
63. Yates, F. (1951), “The Influence of Statistical Methods for Research Workers on the Development of the Science of Statistics,” Journal of the American Statistical Association, 46, 19-34.