Real-world approaches to assessing the impact of environmental research on policy

Research Evaluation

Volumn 20, Issue 3, 2011, Pages 227-237

  Bell, Sarah ^a   Shaw, Ben ^a   Boaz, Annette ^b  

^a POLICY STUDIES INSTITUTE   (United Kingdom)

^b KING'S COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 80053595944     PISSN: 09582029     EISSN: None     Source Type: Journal    
DOI: 10.3152/095820211X13118583635792     Document Type: Article

References (30)

1. BBSRC, Biotechnology and Biological Sciences Research Council 2010. Science Making an Economic Difference. http://www.bbsrc.ac.uk/science/impact/economic-impacts.aspx, last accessed 13 July 2011.
2. Best, A and B Holmes 2010. Systems thinking, knowledge and action: towards better models and methods. Evidence and Policy, 6(2), 145-159.
3. Best, A, J L Terpstra, G Moor, B Riley, C D Norman and R E Glasgow 2009. Building knowledge integration systems for evidence-informed decisions. Journal of Health Organisation and Management, 23(6), 627-641.
4. Boaz, A, S Fitzpatrick and B Shaw 2008. Assessing the Impact of Research on Policy: a Review of the Literature for a Project on Bridging Research and Policy through Outcome Evaluation. http://www.psi.org.uk/pdf/2008/bridgingproject_report_with_appendices.pdf, last accessed 13 July 2011.
5. Boaz, A, S Fitzpatrick and B Shaw 2009. Assessing the impact of research on policy: a literature review. Science and Public Policy, 36(4), May, 255-270.
6. Boyatzis, R 1998 Transforming Qualitative Information: Thematic Analysis and Code Development. California: Sage.
7. CGIAR, Consultative Group on International Agricultural Research 2008. Impact Assessment of Policy-Oriented Research in the CGIAR: Evidence and Insights from Case Studies. www.sciencecouncil.cgiar.org/fileadmin/user_upload/sciencecouncil/Impact_Assessment/PORIA2008_pr_4_F_l-r_3_pdf, last accessed 13 July 2011.
8. Crang, M 1997. Analysing qualitative materials. In Methods in Human Geography, eds. R Flowerdew and D Martin, pp. 183-196. Harlow: Longman.
9. DEST, Department for Education, Science and Training 2006. Research Quality Framework: Assessing the Quality and Impact of Research in Australia. http://www.dest.gov.au/NR/rdonlyres/7E5FDEBD-3663-4144-8FBE-AE5E6EE47D29/17543/RecommendedRQF2.pdf, last accessed 13 July 2011.
10. Donovan, C 2008. The Australian Research Quality Framework: a live experiment in capturing the social, economic, environmental and cultural returns of publicly funded research. New Directions for Evaluation, 118, 47-60.
11. ESRC, Economic and Social Research Council 2010. Impact Case Studies. http://www.esrc.ac.uk/impacts-and-findings/features-casestudies/case-studies/, last accessed 13 July 2011.
12. EPA, Environmental Protection Agency 2009. Innovation for a Green Economy. Environment and Technology: A win-win story. www.epa.ie/downloads/pubs/research/tech/EPA%20STRIVE%20ET%20Report_Final.pdf, last accessed 13 July 2011.
13. Ferraro, P 2009. Counterfactual thinking and impact evaluation in environmental policy. New Directions for Evaluation, 122, 75-84.
14. Forrester, J, M Nilsson, C Lee, H Moora, L Persson, K Peterson, J Simon and H Tuhkanen 2009. Getting to Policy Impact: Lessons from 20 Years of Bridging Science and Policy with Sustainability Knowledge. Stockholm: Stockholm Environment Institute. http://research.fit.edu/sealevelriselibrary/documents/doc_mgr/470/Global_Getting_to_Policy_Impact_-_SEI_2009.pdf, last accessed 13 July 2011.
15. FRST, Foundation for Research, Science and Technology 2003. Natural Ecosystem Research Evaluation. http://www.frst.govt.nz/files/Natural_Ecosystem_Research_Evaluation.pdf, last accessed 13 July 2011.
16. Gerring, J 2004. What is a case study and what is it good for? American Political Science Review, 98(2), 341-354.
17. Hanney, S, M Buxton, C Green, D Coulson and J Raftery 2007. An assessment of the impact of NHS Health Technology Assessment Programme. NHS Health Technology Assessment Programme, 11, 53. http://www.hta.ac.uk/project/1440.asp, last accessed 13 July 2011.
18. Hodkinson, P and H Hodkinson 2001. The strengths and limitations of case study research. Paper presented to the Learning and Skills Development Agency Conference, Making an impact on policy and practice, Cambridge, 5-7 December 2001.
19. Holmes, J and J Savgård 2008. Dissemination and Implementation of Environmental Research, SKEP Work Package 4. A report for the SKEP-ERA Network.
20. Lewison, G 2005. Beyond SCI citations: new ways to evaluate research. Current Science, 89(9), 1524-1530.
21. Nilsson, M 2006. The role of assessments and institutions for policy learning: a study on Swedish climate and nuclear policy formation. Policy Sciences, 38, 225-249.
22. Nutley S, I Walter and H Davies 2007. Using Evidence: How Research can Inform Public Services. Bristol: Policy Press.
23. O'Leary, G, R Boyle, B Donlon and L Sheils 2008. Providing a framework for accountability and learning in environmental research. Administration, 55(4), 159-170.
24. Pawson, R and N Tilley 1997. Realistic Evaluation. London: Sage
25. Ryan, J 2002. Assessing the impact of food policy research: rice trade policies in Vietnam. Food Policy, 27, 1-29.
26. Ryan, J G and J L Garrett 2004. The impact of economic policy research: lessons on attribution and evaluation from IFPRI. In Global Knowledge Networks and International Development: Bridges Across Boundaries, eds. D Stone and S Maxwell. Routledge: London.
27. Shaw, B and S Bell 2009. How to Evaluate the Impact of Research on Environmental Policy: a Seven Step Guide. Research report to SKEP network. Bristol: SKEP network.
28. Weiss, C 1979. The many meanings of research utilisation. Public Administration Review, 5, 426-431.
29. Wemaere, A, G Kilroy, L Sheils and B Donlon 2009. An evaluation of the role of EPA research in the Water Framework Directive implementation in Ireland. Biology and Environment: Proceedings of the Royal Irish Academy, 109B(3), 385-402.
30. Yin, R K 2003. Case Study Research: Design and Methods, 3rd edn. Applied Social Research Methods Series Volume 5. London: Sage.