The new randomised controlled trials (RCT) movement in public policy: challenges of epistemic governance

Policy Sciences

Volumn 47, Issue 4, 2014, Pages 387-402

  Pearce, Warren ^a   Raman, Sujatha ^a,b  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

^b ARIZONA STATE UNIVERSITY   (United States)

Author keywords

Evidence based policy; Governance; Randomised controlled trials (RCTs); Science and technology studies (STS)

Indexed keywords

GOVERNANCE APPROACH; PLANNING THEORY; POLICY APPROACH; PUBLIC ADMINISTRATION; SCIENCE AND TECHNOLOGY; THEORETICAL STUDY;

UNITED KINGDOM;

EID: 84912523433     PISSN: 00322687     EISSN: 15730891     Source Type: Journal    
DOI: 10.1007/s11077-014-9208-3     Document Type: Article

References (83)

1. Allen, R. (2013, March 14). Evidence-based practice: Why number-crunching tells only part of the story. Retrieved June 18, 2013, from http://ioelondonblog.wordpress.com/2013/03/14/evidence-based-practice-why-number-crunching-tells-only-part-of-the-story/.
2. Archer, G. (2011, September 2). Abortion reform: Listen to your prejudices. Telegraph.co.uk. Retrieved May 10, 2013, from http://www.telegraph.co.uk/health/8737694/Abortion-reform-listen-to-your-prejudices.html.
3. BBC (2013). “Nudge unit” to be part privatised. BBC. Retrieved from http://www.bbc.co.uk/news/uk-22362727.
4. Bonell, C., Fletcher, A., Morton, M., Lorenc, T., & Moore, L. (2012). Realist randomised controlled trials: A new approach to evaluating complex public health interventions. Social Science and Medicine,75(12), 2299–2306. doi:10.1016/j.socscimed.2012.08.032.
5. Brown, M. B. (2009). Science in democracy: Expertise, institutions, and representation. Cambridge, MA: MIT Press.
6. Cabinet Office. (2012). Open Data white paper: Unleashing the potential (Cm 8353). Norwich: The Stationery Office.
7. Campbell Collaboration (n.d.). Background. Retrieved June 18, 2013, from http://www.campbellcollaboration.org/background/index.php.
8. Campbell, D. T. (1984). Can we be scientific in applied social science. Evaluation Studies Review Annual, 9, 26–48.
9. Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Boston: Houghton Mifflin.
10. Cannadine, D. (2013, March 13). The future of History. Times Literary Supplement. Retrieved June 18, 2013, from http://www.the-tls.co.uk/tls/public/article1228938.ece.
11. Cartwright, N. (2007). Are RCTs the gold standard? BioSocieties,2(1), 11–20. doi:10.1017/S1745855207005029.
12. Chalmers, I. (2005). If evidence-informed policy works in practice, does it matter if it doesn’t work in theory? Evidence & Policy: A Journal of Research, Debate and Practice,1(2), 227–242. doi:10.1332/1744264053730806.
13. Conservatives. (n.d.). The conservative party people members of parliament Chris Grayling MP. Retrieved May 10, 2013, from http://www.conservatives.com/People/Members_of_Parliament/Grayling_Chris.aspx.
14. Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008). Developing and evaluating complex interventions: The new Medical Research Council guidance. London: Medical Research Council.
15. CRASH trial collaborators. (2005). Final results of MRC CRASH, a randomised placebo-controlled trial of intravenous corticosteroid in adults with head injury—outcomes at 6 months. The Lancet,365(9475), 1957–1959. doi:10.1016/S0140-6736(05)66552-X.
16. Department for Education. (2013, May 3). New randomised controlled trials will drive forward evidence-based research. Retrieved June 18, 2013, from https://www.gov.uk/government/news/new-randomised-controlled-trials-will-drive-forward-evidence-based-research.
17. Diggle, R. (2007) Regulatory science and uncertainty in the risk assessment of pesticide residues, Ph.D. thesis, University of Nottingham http://etheses.nottingham.ac.uk/1451/.
18. Dunn, W. N. (1998). The experimenting society: Essays in honor of Donald T. Campbell (Vol. 11). Transaction Publishers.
19. Dunt, I. (2014, February 5). Nudge nudge, say no more. Brits’ minds will be controlled without us knowing it. The Guardian. Retrieved from http://www.theguardian.com/commentisfree/2014/feb/05/nudge-say-no-more-behavioural-insights-team.
20. Ezrahi, Y. (1990). The descent of Icarus: Science and the transformation of contemporary democracy. Cambridge, MA: Harvard University Press.
21. Fuller, S. (1997). Science. Buckingham: Open University Press.
22. Goldacre, B. (2011, May 14). How can you tell if a policy is working? Run a trial. Retrieved September 18, 2014, from http://www.theguardian.com/commentisfree/2011/may/14/bad-science-ben-goldacre-randomised-trials.
23. Goldacre, B. (2012a). Here’s our Cabinet Office paper on randomised trials of government policies. Read it. Bad Science. Retrieved from http://www.badscience.net/2012/06/heres-a-cabinet-office-paper-i-co-authored-about-randomised-trials-of-government-policies/.
24. Goldacre, B. (2012b). Five Minutes With: Ben Goldacre. Retrieved May 9, 2013, from http://www.bbc.co.uk/news/science-environment-19517224.
25. Goldacre, B. (2012c). Bad pharma: How drug companies mislead doctors and harm patients. London: Fourth Estate.
26. Goldacre, B. (2013a). Building evidence into education. Bad Science. Retrieved from http://media.education.gov.uk/assets/files/pdf/b/ben%20goldacre%20paper.pdf.
27. Goldacre, B. (2013b, March 18). Teachers need to drive the research agenda. The Guardian. Retrieved from http://www.guardian.co.uk/education/2013/mar/18/teaching-research-michael-gove?CMP=twt_gu&commentpage=1.
28. Greenhalgh, T. (2012). Why do we always end up here? Evidence-based medicine’s conceptual cul-de-sacs and some off-road alternative routes. Journal of Primary Health Care,4(2), 92–97.
29. Greenhalgh, T., & Russell, J. (2009). Evidence-based policymaking: A critique. Perspectives in Biology and Medicine,52(2), 304–318. doi:10.1353/pbm.0.0085.
30. Greenhalgh, T., Howick, J., Maskrey, N., & for the Evidence Based Medicine Renaissance Group. (2014, June 13). Evidence based medicine: a movement in crisis? BMJ, 348, g3725. doi:10.1136/bmj.g3725.
31. Guston, D. H. (2001). Boundary organizations in environmental policy and science: An introduction. Science, Technology and Human Values,26(4), 399–408.
32. Hajer, M. A. (2010). Authoritative Governance: Policy making in the age of mediatization. Oxford: Oxford University Press.
33. Hammersley, M. (2005). Is the evidence-based practice movement doing more good than harm? Reflections on Iain Chalmers’ case for research-based policy making and practice. Evidence & Policy: A Journal of Research, Debate and Practice,1(1), 85–100. doi:10.1332/1744264052703203.
34. Hansard. (2013, January 09): Column 315. Transforming Rehabilitation. Retrieved May 10, 2013, from http://www.publications.parliament.uk/pa/cm201213/cmhansrd/cm130109/debtext/130109-0001.htm#13010946001447.
35. Haynes, L., Service, D., Goldacre, B., & Torgerson, D. (2012). Test, learn, adapt: Developing public policy with randomised controlled trials. London: Cabinet Office.
36. Heyman, B., Harrington, B., Heyman, A., & The National Energy Action Research. (2011). A randomised controlled trial of an energy efficiency intervention for families living in fuel poverty. Housing Studies,26(1), 117–132. doi:10.1080/02673037.2010.512787.
37. HM Government. (2012). The Civil Service Reform Plan.
38. Hisschemöller, M., & Hoppe, R. (1995). Coping with intractable controversies: The case for problem structuring in policy design and analysis. Knowledge and Policy,8(4), 40–60. doi:10.1007/BF02832229.
39. Hood, L. (2013, May 29). Nudge unit brings Midas touch to growth agenda. Research Fortnight, 4.
40. Hoppe, R. (2005). Rethinking the puzzles of the science-policy nexus: From knowledge utilization and science technology studies to types of boundary arrangements. Poiesis & Praxis,3(3), 191–215.
41. Hoppe, R., Wesselink, A., & Cairns, R. (2013). Lost in the problem: The role of boundary organisations in the governance of climate change. Wiley Interdisciplinary Reviews Climate Change,4(4), 283–300.
42. James, M. (2013, March 20). New (or not new) directions in evidence-based policy. Response to Ben Goldacre. British Educational Research Association. Retrieved from http://www.bera.ac.uk/system/files/Mary%20james%20-%20New%20%28or%20not%20new%29%20directions%20in%20evidence-based%20policy.%20Response%20to%20Ben%20Goldacre.pdf.
43. Jasanoff, S. (1991). Acceptable evidence in a pluralistic society. In D. Mayo & R. Hollander (Eds.), Acceptable evidence: Science and values in risk management (pp. 29–47). New York: Oxford University Press.
44. Jasanoff, S. (2003a). Technologies of humility: Citizen participation in governing science. Minerva,41, 223–244.
45. Jasanoff, S. (2003b). (No?) Accounting for expertise. Science and Public Policy,30(3), 157–162.
46. Jasanoff, S. (2012). Science and public reason. London: Routledge.
47. Jasanoff, S., & Winickoff, D. (2002, November 18). Hard facts and soft law: what’s the evidence? openDemocracy. Retrieved June 13, 2013, from http://www.opendemocracy.net/theme_9-wmd/article_762.jsp.
48. John, P., Cotterill, S., Richardson, L., Moseley, A., Stoker, G., Wales, C., et al. (2011). Nudge, nudge, think, think: Using experiments to change civic behaviour. London: Bloomsbury Academic.
49. Lasswell, H. D. (1948). Power and personality. New York: W.W. Norton & Company.
50. Lipsky, M. (1980). Street-level bureaucracy: Dilemmas of the individual in public service. New York: Russell Sage Foundation.
51. Macintyre, S., & Petticrew, M. (2000). Good intentions and received wisdom are not enough. Journal of Epidemiology and Community Health,54(11), 802–803.
52. Marchal, B., Westhorp, G., Wong, G., Van Belle, S., Greenhalgh, T., Kegels, G., & Pawson, R. (2013). Realist RCTs of complex interventions—an oxymoron. Social Science & Medicine, 94, 124–128. doi:10.1016/j.socscimed.2013.06.025.
53. Maynard-Moody, S., & Musheno, M. (2006). Stories for research. In D. Yanow & P. Schwartz-Shea (Eds.), Interpretation and method. Empirical research methods and the interpretive turn (pp. 316–330). Armonk: M. E. Sharpe.
54. Mayo, E. (2013, May 3). Nudged out: This is mutualisation, but not as we know it. The Guardian. Retrieved from http://www.guardian.co.uk/commentisfree/2013/may/03/nudge-unit-mutualisation-but-not-as-we-know-it.
55. Miller, C. A. (2008). Civic epistemologies: Constituting knowledge and order in political communities. Sociology Compass,2(6), 1896–1919. doi:10.1111/j.1751-9020.2008.00175.x.
56. Mulgan, G., & Puttick, R. (2013). Making evidence useful: The case for new institutions. London: NESTA.
57. National Audit Office. (2013). Access to Clinical Trial Information and the Stockpiling of Tamiflu (Memorandum for the Committee of Public Accounts, HC125 Session 2013–14). Norwich: The Stationery Office.
58. Oakley, A. (1998a). Experimentation and social interventions: A forgotten but important history. BMJ. British Medical Journal,317(7167), 1239.
59. Oakley, A. (1998b). Public policy experimentation: Lessons from America. Policy Studies,19(2), 93–114.
60. Oakley, A., Strange, V., Bonell, C., Allen, E., Stephenson, J., & RIPPLE Study Team. (2006). Process evaluation in randomised controlled trials of complex interventions. BMJ,332(7538), 413–416. doi:10.1136/bmj.332.7538.413.
61. Priestland, D. (2013, April 18). Michael Gove’s disdain for experts is typical of the laissez-faire ideologues. The Guardian. Retrieved from http://www.guardian.co.uk/commentisfree/2013/apr/18/michael-gove-disdain-experts-typical-ideologues.
62. Prime Minister’s Office. (2010, May 29). PM’s podcast on transparency. Retrieved December 3, 2013, from https://www.gov.uk/government/news/pms-podcast-on-transparency.
63. Puttick, R. (2011). Where is the evidence? NESTA Retrieved from http://www.nesta.org.uk/blog/where-evidence.
64. Puttick, R. (2013, May 28). Randomise Me: How you can set up and run your own trial. Policy Innovation Blog. Retrieved from http://www.nesta.org.uk/assets/blog_entries/randomise_me_how_you_can_set_up_and_run_your_own_trial.
65. Raman, S. (2015). Science, uncertainty and the normative question of epistemic governance in policymaking. In E. Cloatre & M. Pickersgill (Eds.), Knowledge, Technology and Law: Interrogating the Nexus (pp. 17–32). London: Routledge.
66. Rayner, S. (2012). Uncomfortable knowledge: The social construction of ignorance in science and environmental policy discourses. Economy and Society,41(1), 107–125. doi:10.1080/03085147.2011.637335.
67. Rhodes, R. A. W. (2011). Everyday life in British Government. Oxford: Oxford University Press.
68. Sanderson, I. (2004). Getting evidence into practice: Perspectives on rationality. Evaluation,10(3), 366–379.
69. Sarewitz, D. (2004). How science makes environmental controversies worse. Environmental Science & Policy,7(5), 385–403. doi:10.1016/j.envsci.2004.06.001.
70. Sense about Science. (2013, January 9). AllTrials campaign launch. Retrieved June 17, 2013, from http://www.senseaboutscience.org/news.php/292/alltrials-campaign-launch.
71. Stilgoe, J. (2007). The (co-) production of public uncertainty: UK scientific advice on mobile phone health risks. Public Understanding of Science,16(1), 45–61.
72. Stilgoe, J., Irwin, A., & Jones, K. (2006). The Received wisdom: Opening up expert advice. London: Demos.
73. Stirling, A. (2012). Opening up the politics of knowledge and power in bioscience. PLoS Biology,10(1), e1001233.
74. Stoker, G. (2010). Exploring the promise of experimentation in political science: Micro-foundational insights and policy relevance. Political Studies,58(2), 300–319.
75. Stoker, G., & John, P. (2009). Design experiments: Engaging policy makers in the search for evidence about what works. Political Studies,57(2), 356–373.
76. Torgerson, C. J., & Torgerson, D. J. (2013). Randomised trials in education: An introductory handbook. London: Educational Endowment Foundation. Retrieved from http://educationendowmentfoundation.org.uk/uploads/pdf/Randomised_trials_in_education_revised.pdf.
77. Triantafillou, P. (2013). The political implications of performance management and evidence-based policymaking. The American Review of Public Administration, Online first, April 9, 2013. doi:10.1177/0275074013483872.
78. Tzabar, R. (2013, January 1). Ben Goldacre’s Bad Evidence. BBC Radio 4.
79. Weingart, P. (1999). Scientific expertise and political accountability: Paradoxes of science in politics. Science and Public Policy,26(3), 151–161.
80. Wesselink, A. J., & Hoppe, R. (2011). If post-normal science is the solution, what is the problem? The politics of activist science. Science, Technology and Human Values,36(3), 389–412.
81. Whitty, G. (2013, March 19). Evidence-informed policy and practice—we should welcome it, but also be realistic! Retrieved June 18, 2013, from https://cerp.aqa.org.uk/perspectives/evidence-informed-policy-practice.
82. Wynne, B. (1992). Uncertainty and environmental learning. Global Environmental Change,2(2), 111–127.
83. Wynne, B. (2010). When doubt becomes a weapon. Nature,466(7305), 441–442.