The replication problem and its implications for policy studies

Critical Policy Studies

Volumn 6, Issue 2, 2012, Pages 182-200

  Morrell, Kevin ^a   Lucas, Jeffrey W ^b  

^a UNIVERSITY OF WARWICK   (United Kingdom)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

best practice; episteme; evidence based; policy; replication

Indexed keywords

EID: 84865051811     PISSN: 19460171     EISSN: 1946018X     Source Type: Journal    
DOI: 10.1080/19460171.2012.689738     Document Type: Article

References (99)

1. Abbott, A. 2007. Notes on replication. Sociological methods & research, 36(2): 210-219.
2. Amir, Y. and Sharon, I. 1991. "Replication research: a must for the scientific advancement of psychology". In Replication research in the social sciences, Edited by: Neuliep, J.W. 51-69. Thousand Oaks, CA: Sage.
3. 1995, Aristotle. "The complete works of Aristotle". In The revised Oxford translation, 6th printing with corrections, Edited by: Barnes, J. Princeton, NJ: Princeton University Press.
4. Armstrong, J. 2004. The secret power of beauty, New York: Penguin.
5. Arnold, R. 2001. Looking to the light, Slough: EMIE/NFER.
6. Arnold, R. 2002. Gleams from the Beacon. Good practice in transition in education: the Beacon Council scheme, 2002-03, Slough: EMIE/NFER.
7. Becker, H. 1982. Art worlds, Berkeley, CA: University of California Press.
8. Bevir, M. 2003. Narrating the British state: an interpretive critique of New Labour's institutionalism. Review of international political economy, 10(3): 455-480.
9. Beyerlein, K. and Hipp, J.R. 2005. Social capital, too much of a good thing? American religious traditions and community crime. Social forces, 84(2): 995-1013.
10. Blume, S.S. 2005. Lock in, the state and vaccine development: lessons from the history of the polio vaccines. Research policy, 34(1): 159-173.
11. Boaz, A., Ashby, D. and Young, K. 2002. Systematic reviews: what have they got to offer evidence based policy and practice? Working Paper 2, ESRC UK Centre for Evidence Based Policy and Practice.
12. Bourdieu, P. 1984. Distinction: a social critique of the judgement of taste, London: Routledge.
13. Bourdieu, P. 1993. The field of cultural production, Cambridge, MA: Polity Press.
14. Bovaird, A. and Löffler, E. 2009. More quality through competitive quality awards? An impact assessment framework. International review of administrative sciences, 75(3): 383-401.
15. Bridges, D. 2010. n = 1: The science and art of the single case in educational research. Educational research, 5(1): 79-96.
16. Briner, R., Denyer, D. and Rousseau, D. 2009. Evidence-based management: concept cleanup time?. Academy of management perspectives, 23(4): 19-32.
17. Brown, R.H. and Malone, E.L. 2004. Reason, politics, and the politics of truth: how science is both autonomous and dependent. Sociological theory, 22(1): 106-122.
18. Bulkeley, H. 2006. Urban sustainability: learning from best practice?. Environment and planning A, 38(6): 1029-1044.
19. Campbell, D.T. 1979. A tribal model of the social system vehicle carrying scientific knowledge. Knowledge: creation, diffusion, utilization, 1(1): 181-201.
20. Cole, S. 1983. The hierarchy of the sciences?. American journal of sociology, 89(1): 111-139.
21. Colebatch, H.K. and Degeling, P.J. 2007. Interpretation, reflexivity and policy practice in clinical care. Critical policy studies, 1(3): 235-251.
22. Cooper, C.L. and Robertson, I. International review of industrial & organisational psychology, New York: Wiley. (Annual volumes from 1986 to 2005)
23. Davies, H.T.O., Nutley, S.M. and Smith, P.C. 2000. What works? Evidence based policy and practice in public services, Bristol: The Policy Press.
24. Delanty, G. 2001. The university in the knowledge society. Organization, 8(2): 149-153.
25. Dickie, G. 1974. Art and the aesthetic, New York: Cornell University Press.
26. Dolowitz, D.P. and Marsh, D. 2000. Learning from abroad: the role of policy transfer in contemporary policy-making. Governance, 13(1): 5-23.
27. Eden, D. 2002. Replication, meta-analysis, scientific progress and AMJs publication policy. Academy of management journal, 45(5): 841-846.
28. Eden, D. 2004. Reflections on the AMJ associate editor role. Academy of management journal, 47(2): 167-172.
29. Elgert, L. 2009. Politicizing sustainable development: the co-production of globalized evidence-based policy. Critical policy studies, 3(3): 375-390.
30. Feynman, R. 1965. The character of physical law, New York: Modern Library.
31. Firebaugh, G. 2007. Replication data sets and favored-hypothesis bias: comment on Freese (2007) and King (2007). Sociological methods & research, 36(2): 200-210.
32. Flyvbjerg, B. 2001. Making social science matter, Cambridge: Cambridge University Press.
33. Foucault, M. 2002a. The archaeology of knowledge, Edited by: Sheridan Smith, A. London: Routledge.
34. Foucault, M. 2002b. The order of things, London: Routledge.
35. Fox, N.J. 2003. Practice-based evidence: towards collaborative and transgressive research. Sociology, 37(1): 81-102.
36. Free, M.D. 2005. Prosecutorial decision making and minority group-threat theory. Criminal justice studies, 18(1): 7-28.
37. Freese, J. 2007. Replication standards for quantitative social science: why not sociology?. Sociological methods & research, 36: 152-72.
38. Gell-Mann, M. 1964. Particles and principles. Physics today, 17(11): 22-29.
39. Gibbons, M. 1994. The new production of knowledge, London: Sage.
40. Giddens, A. 1990. The consequences of modernity, Stanford, CA: Stanford University Press.
41. Glass, G., 2000. Meta-analysis at 25 [online]. http://www.gvglass.info/papers/meta25.html
42. Hassard, J. and Kelemen, M. 2002. Production and consumption in organizational knowledge. Organization, 9(2): 331-355.
43. Hendrick, C. 1991. "Replications, strict replications, and conceptual replications: are they important?". In Replication research in the social sciences, Edited by: Neuliep, J.W. 41-49. Thousand Oaks, CA: Sage.
44. Hope, T. 2004. Pretend it works: evidence and governance in the evaluation of the reducing burglary initiative. Criminal justice, 4(3): 287-308.
45. Hubbard, R. and Vetter, D.E. 1996. An empirical comparison of published replication research in accounting, economics, finance, management, and marketing. Journal of business research, 35(2): 153-164.
46. Hubbard, R., Vetter, D.E. and Little, E.L,. 1998. Replication in strategic management. Strategic management journal, 19(3): 243-254.
47. Kilduff, M. 2006. Publishing theory. Academy of management review, 31(2): 252-255.
48. King, G. 1995. Replication, replication. Political science and politics, 28(3): 444-452.
49. Kuhn, T.S. 1962. The structure of scientific revolutions, Chicago, IL: Chicago Press.
50. Learmonth, M. and Harding, N. 2006. Evidence-based management: the very idea. Public administration, 84(2): 245-266.
51. Lee, T.W. 1999. The unfolding model of voluntary turnover: a replication and extension. Academy of management journal, 42(4): 450-462.
52. Lowndes, V. and Wilson, D. 2003. Balancing revisability and robustness? A new institutionalist perspective on local government modernization. Public administration, 81(2): 275-298.
53. May, C. 2005. Methodological pluralism, British sociology and the evidence-based state: a reply to Payne et al. Sociology, 39(3): 519-528.
54. McKinley, W., Mone, M.A. and Moon, G. 1999. Determinants and development of schools in organization theory. Academy of management review, 24(4): 634-648.
55. McLaughlin, J. 2001. EBM and risk: rhetorical resources in the articulation of professional identity. Journal of management in medicine, 15(4-5): 352-363.
56. Mills, J. 1997. The false dasein: from Heidegger to Sartre and psychoanalysis. Journal of phenomenological psychology, 28(1): 42-65.
57. Mitchell, T.R. and James, L.R. 2001. Building better theory. Academy of management review, 26(4): 530-547.
58. Mone, M.A. and McKinley, W. 1993. The uniqueness value and its consequences for organizational studies. Journal of management inquiry, 2(3): 284-296.
59. Morrell, K. 2008. The narrative of evidence based management: a polemic. Journal of management studies, 45(3): 613-635.
60. Morrell, K. in press. Evidence-based dialectics, Organization. Available through Sage online early. doi:10.1177/1350508411414229
61. Neuliep, J.W. 1991. Replication research in the social sciences, Thousand Oaks, CA: Sage.
62. Neuliep, J.W. and Crandall, R. 1991. "Editorial bias against replication research". In Replication research in the social sciences, Edited by: Neuliep, J.W. 85-90. Thousand Oaks, CA: Sage.
63. Neylan, J. 2008. Social policy and the authority of evidence. Australian journal of public administration, 67(1): 12-19.
64. O'Leary, M. and Chia, R. 2007. Epistemes and structures of sensemaking in organizational life. Journal of management inquiry, 16(4): 392-406.
65. Osigweh, C.A.B. 1989. Concept fallibility in organizational science. Academy of management review, 14(4): 579-594.
66. Parsons, W. 2002. From muddling through to muddling up: evidence based policy-making and the modernisation of British government. Public policy and administration, 17(3): 43-60.
67. Pfeffer, J. 1993. Barriers to the advance of organizational science: paradigm development as a dependent variable. Academy of management review, 18(4): 599-620.
68. Pfeffer, J. 1995. Mortality, reproducibility and the persistence of styles of theory. Organization science, 6(6): 681-686.
69. Pfeffer, J. 1997. New directions for organization theory: problems and prospects, New York: Oxford University Press.
70. Plutarch, 75 AD. Theseus. Trans. J. Dryden. http://classics.mit.edu/Plutarch/theseus.html
71. Popper, K.R. 1959. The logic of scientific discovery, New York: Basic Books.
72. Popper, K.R. 1962. Conjectures and refutations, New York: Basic Books.
73. Radnor, Z. 2009. Understanding the relationship between a national award scheme and performance. International review of administrative sciences, 75(3): 437-457.
74. Ray, C. 2001. "Logical positivism". In A companion to the philosophy of science, Edited by: Newton-Smith, W.H. 243-251. Oxford: Blackwell.
75. Reed, I. 2008. Justifying sociological knowledge: from realism to interpretation. Sociological theory, 26(2): 101-128.
76. Rosenthal, R. 1991. "Replication in behavioral research". In Replication research in the social sciences, Edited by: Neuliep, J.W. 1-30. Thousand Oaks, CA: Sage.
77. Rousseau, D.M. 2006. Is there such a thing as evidence-based management?. Academy of management review, 31(2): 256-259.
78. Rousseau, D.M. and McCarthy, S. 2007. Educating managers from an evidence-based perspective. Academy of management learning & education, 6(1): 84-101.
79. Russell, B. 1991. The problems of philosophy, Oxford: Oxford University Press.
80. Sackett, D.L. 1996. Evidence based medicine: what it is and what it isn't. British medical journal, 312: 71-72.
81. Shillabeer, A., Buss, T.F. and Rousseau, D.M. 2011. Evidence-based public management: practices, issues, and prospects, New York: M.E. Sharpe.
82. Singh, K., Siah, H.A. and Leong, S.M. 2003. Increasing replication for knowledge accumulation in strategy research. Journal of management, 29(4): 533-549.
83. Spitz, B. and Abramson, J. 2005. When health policy is the problem: a report from the field. Journal of health politics, policy and law, 30(3): 327-365.
84. Starkey, K. 2001. In defence of modes one, two and three: a response. British journal of management, 12: S77-S80.
85. Strati, A. and de Montoux, P.G. 2002. Organizing aesthetics. Human relations, 55(7): 755-766.
86. Thorpe, C. 2001. Science against modernism: the relevance of the social theory of Michael Polanyi. British journal of sociology, 52(1): 19-35.
87. Tranfield, D., Denyer, D. and Smart, P. 2003. Towards a methodology for developing evidence-informed management knowledge by means of systematic review. British journal of management, 14(3): 207-222.
88. Tsang, E.W.K. and Kwan, K. 1999. Replication and theory development in organizational science. Academy of management review, 24(4): 759-780.
89. Van Maanen, J. 1995. Style as theory. Organization science, 6(1): 133-143.
90. Walshe, K. and Rundall, T.G. 2001. Evidence based management: from theory to practice in health care. The Millbank quarterly, 79(3): 429-457.
91. Weber, M. 1958. "Science as a vocation". In From Max Weber: essays in sociology, Edited by: Gerth, H.H. and Mills, C.W. 129-156. New York: Oxford University Press.
92. Weick, K.E. 1989. Theory construction as disciplined imagination. Academy of management review, 14(9): 516-531.
93. Whetten, D.A. 1989. What constitutes a theoretical contribution?. Academy of management review, 14(4): 490-495.
94. Whitelaw, S., Watson, J. and Hennessy, S. 2004. Promoting health in hospitals: the role of Beacon. Health education, 104(5): 272-280.
95. Wilson, F.D., Smoke, G.L. and Martin, J.D. 1973. The replication problem in sociology: a report and a suggestion. Sociological inquiry, 43(1): 141-149.
96. Worren, N., Moore, K. and Elliott, R. 2002. When theories become tools: toward a framework for pragmatic validity. Human relations, 55(10): 1227-1250.
97. Yanow, D. 2007. Interpretation in policy analysis: on methods and practice. Critical policy studies, 1(1): 110-122.
98. Young, K. 2002. Social science and the evidence-based policy movement. Social policy and society, 1(1): 215-224.
99. Zald, M.N. 1996. More fragmentation? Unfinished business in linking the social sciences and the humanities. Administrative science quarterly, 41(2): 251-261.