Progressing research impact assessment: A 'contributions' approach

Research Evaluation

Volumn 24, Issue 4, 2015, Pages 405-419

  Morton, Sarah ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

assessment; cont; impact; research

Indexed keywords

EID: 84944399363     PISSN: 09582029     EISSN: 14715449     Source Type: Journal    
DOI: 10.1093/reseval/rvv016     Document Type: Article

References (61)

1. Adam, P., et al. (2012) 'Assessment of the Impact of a Clinical and Health Services Research Call in Catalonia', Research Evaluation, 21/4: 319-28.
2. Bannister, J. and O'Sullivan A. (2013) 'Knowledge Mobilisation and the Civic Academy: The Nature of Evidence, the Roles of Narrative and the Potential of Contribution Analysis', Contemporary Social Science, 8/3: 249-62.
3. Bell, S., et al. (2011) 'Real-world Approaches to Assessing the Impact of Environmental Research on Policy', Research Evaluation, 20/3: 227-37.
4. Bennett, J. W., et al. (2012) 'Integration of Environmental Impacts into Ex-post Assessments of International Agricultural Research: Conceptual Issues, Applications, and the Way Forward', Research Evaluation, 21/3: 216-28.
5. Best, A. and Holmes B. (2010) 'Systems Thinking, Knowledge and Action: Towards Better Models and Methods', Evidence and Policy: A Journal of Research, Debate and Practice, 6: 145-59.
6. Biggs, J. S., et al. (2014) 'A Practical Example of Contribution Analysis to a Public Health Intervention', Evaluation, 20(2): 214-29.
7. Boaz, A., et al. (2009) 'Assessing the Impact of Research on Policy: A Literature Review', Science and Public Policy, 36/4: 255-70.
8. Bryman, A. (2004) Social Research Methods. Oxford; New York: Oxford University Press.
9. Buxton, M. (2011) 'The Payback of 'Payback': Challenges in Assessing Research Impact', Research Evaluation, 20/3: 259-60.
10. Court, J. and Young J. (2004) 'Bridging Research and Policy in International Development :An Analytical and Practical Framework', in Research and Policy in Development Programme Briefinng Paper. London: Overseas Development Institute.
11. Crew, E. and Young J. (2002) Bridging Research and Policy:Context, Evidence, Links. London: Overseas Development Institute.
12. Delahais, T. and Toulemonde J. (2012) 'Applying Contribution Analysis: Lessons from Five Years of Practice', Evaluation, 18/3: 281-93.
13. Donovan, C. (2008) 'The Australian Research Quality Framework: A Live Experiment in Capturing the Social, Economic, Environmental, and Cultural Returns of Publicly Funded Research', New Directions for Evaluation, 118: 47-60.
14. - (2011) 'State of the Art in Assessing Research Impact: Introduction to a Special Issue', Research Evaluation, 20/3: 175-9.
15. Douthwaite, B., et al. (2003) 'Impact Pathway Evaluation: An Approach for Achieving and Attributing Impact in Complex Systems', Agricultural Systems, 78/2: 243-65.
16. Eisenhardt, K. M. (2002) 'Building Theories from Case Study Research', in Huberman A. M. and Miles M. B. (eds), The Qualitative Researcher's Companion. London, Sage.
17. Forss, K., et al. (2011) Evaluating the Complex : Attribution, Contribution, and Beyond. New Brunswick: Transaction Publishers.
18. Gabbay, J. and le May A. (2004) 'Evidence Based Guidelines or Collectively Constructed "Mindlines?". Ethnographic Study of Knowledge Management in Primary Care', BMJ, 329: 2013.
19. Graham, K. E. R., et al. (2012) 'Evaluating Health Research Impact: Development and Implementation of the Alberta Innovates - Health Solutions Impact Framework', Research Evaluation, 21/5: 354-67.
20. Grant, J., et al. (2000) 'Evaluating "Payback" on Biomedical Research from Papers Cited in Clinical Guidelines: Applied Bibliometric Study', BMJ, 320: 1107-1111.
21. Hanney, S., et al. (2004) 'Proposed Methods for Reviewing the Outcomes of Health Research: The Impact of Funding by the UK's 'Arthritis Research Campaign'', Health Research Policy and Systems, 2/1: 4.
22. -. (2003) 'The Utilisation of Health Research In Policymaking: Concepts, Examples and Methods of Assessment', Health Research Policy and Systems, 1/1: 2.
23. Hawe, P., et al. (2009) 'Knowledge Theories can Inform Evaluation Practice: What can a Complexity Lens Add?', New Directions for Evaluation, 2009/124: 89-100.
24. Hicks, D. M. (2004) 'Bibliometric Evaluation of Federally Funded Research in the United States', Research Evaluation, 13.2: 76-86.
25. Higher Education Funding Council (2011) REF Assessment Framework and Guidance on Submissions. Bristol, HEFC.
26. Jones, L. R., et al. (2004) Strategies for Public Management Reform. Amsterdam; London, Elsevier.
27. Jung, T. and Nutley S. M. (2008) 'Evidence and Policy Networks', Evidence and Policy, 4/2: 187-207.
28. Knight, P. (2002) Small Scale Research. London, Sage.
29. Kuruvilla, S., et al. (2006) 'Describing the Impact of Health Research: A Research Impact Framework', BMC Health Services Research, 6: 134.
30. Lavis, J., et al. (2003) 'Measuring the Impact of Health Research', Journal of Health Service Research and Policy, 8/3: 166-70.
31. Lemire, S. T., et al. (2012) 'Making Contribution Analysis Work: A Practical Framework for Handling Influencing Factors and Alternative Explanations', Evaluation, 18/3: 294-309.
32. LERU (League of Eurpoean Research Universities) (2013) Research Universities and Research Assessment. Position Papers. Leuven, LERU.
33. Mayne, J. (2001) 'Addressing Attribution through Contribution Analysis: Using Performance Measures Sensibly', Canadian Journal of Program Evaluation, 16/1: 1-24.
34. - (2008) 'Contribution Analysis: An Approach to Exploring Cause and Effect', in ILAC Brief. ILAC Institutional learning and Change Institute.
35. - (2011) 'Contribution Analysis: Addressing Cause and Effect', in Forss K., Marra M. and Schwartz R. (eds), Evaluating the Complex. Transaction Publishers.
36. Meagher, L., et al. (2008) 'Flows of Knowledge, Expertise and Influence: A Method for Assessing Policy and Practice Impacts from Social Science Research', Research Evaluation, 17/3: 163-73.
37. Mitton, C., et al. (2007) 'Knowledge Transfer and Exchange: Review and Synthesis of the Literature', Milbank Quarterly, 85/4: 729-68.
38. Molas-Gallart, J. and Tang P. (2011) 'Tracing 'Productive Interactions' to Identify Social Impacts: An Example from the Social Sciences', Research Evaluation, 20/3: 219-26.
39. Molas-Gallart, J., et al. (2000) 'Assessing the Non-academic Impact of Grant-funded Socio-economic Research: Results from a Pilot Study', Research Evaluation, 9/3: 171-82.
40. Montague, S. (2009) 'Structured Contribution Analysis', in Presentation to Evaluation Summer School May. Stirling, NHS Health Scotland.
41. - (2011) 'Practical (Progress) Measurement and (Impact) Evaluation for Initiatives in Complex Environments', Performance Management Network.
42. Morton, S. (2012) 'Exploring and Assessing Research Impact', in Social Policy. Edinburgh: University of Edinburgh.
43. - (2015) 'Creating Research Impact: The Roles of Research Users in Interactive Research Mobilisation', Evidence and Policy: A Journal of Research, Debate and Practice, 11/1: 35-55.
44. Morton, S. and Flemming J. (2013) Assessing Research Impact: A Case Study of Participatory Research, p. 66. Edinburgh: Centre for Research on Families and Relationships: Research Briefing.
45. Nason, E., et al. (2007) Policy and Practice Impacts of Research Funded by the Economic and Social Research Council: A Case Study of the Future of Work Programme, Supporting Data. Santa Monica, CA: RAND Corporation.
46. Nutley, S., et al. (2007) Using Evidence: How Research can Inform Public Services. Bristol, Policy Press.
47. Patton, M. Q. (2011) Developmental Evaluation : Applying Complexity Concepts to Enhance Innovation and Use. New York: Guilford Press.
48. Penfield, T., et al. (2013) 'Assessment, Evaluations, and Definitions of Research Impact: A Review', Research Evaluation.
49. Phipps, D. (2012) 'A Report Detailing the Development of a University-Based Knowledge Mobilization Unit that Enhances Research Outreach and Engagement', Scholarly and Research Communication, 2/2.
50. Rein, M. (1976) Social science and Public Policy. Harmondsworth: Penguin Education.
51. Research Councils UK. (2011) 'Pathways to Impact', 'http://www.rcuk.ac.uk/kei/impacts/Pages/home.aspx' accessed 4 Oct 2011.
52. Richards, L. (2005) Handling Qualitative Data : A Practical Guide. London Thousand Oaks, CA: SAGE Publications.
53. Rogers, P. J. (2008) 'Using Programme Theory to Evaluate Complicated and Complex Aspects of Interventions', Evaluation, 14/1: 29-48.
54. Silverman, D. (2001) Interpreting Qualitative Data : Methods for Analyzing Talk, Text and Interaction. London: Sage.
55. Smith, K. E. (2007) 'Health Inequalities in Scotland and England: The Contrasting Journeys of Ideas From Research Into Policy', Social Science and Medicine, 64/7: 1438-49.
56. Spaapen, J. and van Drooge L. (2011) 'Introducing 'Productive Interactions' in Social Impact Assessment', Research Evaluation, 20/3: 211-18.
57. Van De Ven, A. H. and Johnson P. E. (2006) 'Knowledge For Theory and Practice', Academy of Management Review, 31/4: 802-21.
58. van Eerd, D., et al. (2011) A Systematic Review of the Quality and Types of Instruments Used to Assess KTE Implementation and Impact. Toronto: Institute for Work and Health.
59. Ward, V., et al. (2009) 'Developing a Framework for Transferring Knowledge Into Action: A Thematic Analysis of the Literature', J Health Serv Res Policy, 14/3: 156-64.
60. Weiss, C. H. (1995) 'Chapter 3 The Haphazard Connection: Social Science and Public Policy', International Journal of Educational Research, 23/2: 137-50.
61. Wimbush, E. and Beeston C. (2010) 'Contribution Analysis:What is it and What Does it Offer Impact Evaluation?', in The Evaluator, pp 19-24. Spring.