An approach to measuring and encouraging research translation and research impact

Health Research Policy and Systems

Volumn 14, Issue 1, 2016, Pages

  Searles, Andrew ^a,b   Doran, Chris ^g   Attia, John ^a,b,c   Knight, Darryl ^a,e   Wiggers, John ^a,b,c   Deeming, Simon ^a,b   Mattes, Joerg ^a,f   Webb, Brad ^a   Hannan, Steve ^e   Ling, Rod ^a,b   Edmunds, Kim ^a,b,d   Reeves, Penny ^a,b   Nilsson, Michael ^a,b,c  

^a HUNTER MEDICAL RESEARCH INSTITUTE   (Australia)

^b UNIVERSITY OF NEWCASTLE   (Australia)

^c JOHN HUNTER HOSPITAL   (Australia)

^d EDITH COWAN UNIVERSITY   (Australia)

^e UNIVERSITY OF NEWCASTLE   (Australia)

^f JOHN HUNTER CHILDREN S HOSPITAL   (Australia)

^g CENTRAL QUEENSLAND UNIVERSITY   (Australia)

Author keywords

Evaluation; Outcome measurement; Outcome research; Performance monitoring and feedback; Research impact; Research translation

Indexed keywords

CONCEPTUAL FRAMEWORK; FUNDING; HUMAN; INVESTMENT; LOGIC; MEDICAL RESEARCH; MODEL; MONITORING; NARRATIVE; OUTCOME ASSESSMENT; MASS COMMUNICATION; PROCEDURES; PROGRAM EVALUATION; STANDARDS; TRANSLATIONAL RESEARCH;

DIFFUSION OF INNOVATION; HUMANS; PROGRAM EVALUATION; TRANSLATIONAL MEDICAL RESEARCH;

EID: 84981287419     PISSN: None     EISSN: 14784505     Source Type: Journal    
DOI: 10.1186/s12961-016-0131-2     Document Type: Article

References (51)

1. Neta G, Glasgow RE, Carpenter CR, Grimshaw JM, Rabin BA, Fernandez ME, et al. A framework for enhancing the value of research for dissemination and implementation. Am J Public Health. 2015;105(1):49-57. doi: 10.2105/AJPH.2014.302206.
2. Grimshaw J, Eccles M, Lavis J, Hill S, Squires J. Knowledge translation of research findings. Implement Sci. 2012;7:50.
3. Chalmers I, Bracken MB, Djulbegovic B, Garattini S, Grant J, Gülmezoglu AM, et al. How to increase value and reduce waste when research priorities are set. Lancet. 2014;383(9912):156-65.
4. Ioannidis JPA, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, et al. Increasing value and reducing waste in research design, conduct, and analysis. Lancet. 2014;383(9912):166-75.
5. Macleod MR, Michie S, Roberts I, Dirnagl U, Chalmers I, Ioannidis JPA, et al. Biomedical research: increasing value, reducing waste. Lancet. 2014;383(9912):101-4.
6. Graham KER, Chorzempa HL, Valentine PA, Magnan J. Evaluating health research impact: development and implementation of the Alberta Innovates - Health Solutions impact framework. Res Eval. 2012;21(5):354-67.
7. Grol R. Successes and failures in the implementation of evidence-based guidelines for clinical practice. Med Care. 2001;39(8 Suppl 2):II46-54.
8. Proctor E, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009;36(1):24-34. doi: 10.1007/s10488-008-0197-4.
9. Green LW, Glasgow RE. Evaluating the relevance, generalization, and applicability of research: issues in external validation and translation methodology. Eval Health Prof. 2006;29(1):126-53. doi: 10.1177/0163278705284445.
10. Rubio DM, Schoenbaum E, Lee L, Schteingart D, Marantz P, Anderson K, et al. Defining translational research: implications for training. Acad Med. 2010;85(3):470-5.
11. Woolf SH. The meaning of translational research and why it matters. JAMA. 2008;299(2):211-3. doi: 10.1001/jama.2007.26.
12. McKibbon KA, Lokker C, Wilczynski NL, Ciliska D, Dobbins M, Davis DA, et al. A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a Tower of Babel? Implement Sci. 2010;5:16. doi: 10.1186/1748-5908-5-16.
13. Tetroe JM, Graham ID, Foy R, Robinson N, Eccles MP, Wensing M, et al. Health research funding agencies' support and promotion of knowledge translation: an international study. Milbank Q. 2008;86(1):125-55. doi: 10.1111/j.1468-0009.2007.00515.x.
14. Penfield T, Baker MJ, Scoble R, Wykes MC. Assessment, evaluations, and definitions of research impact: a review. Research Evaluation. 2014;23(1):21-32. doi: 10.1093/reseval/rvt021.
15. Doran C, Searles A, Nilsson M, Webb B, Deeming S. HMRI Framework to Assess the Impact from Translational health research (FAIT). Sydney: 4th Annual NHMRC Symposium on Research Translation; 2015.
16. Banzi R, Moja L, Pistotti V, Facchini A, Liberati A. Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviews. Health Res Policy Syst. 2011;9:26. doi: 10.1186/1478-4505-9-26.
17. Milat AJ, Bauman AE, Redman S. A narrative review of research impact assessment models and methods. Health Res Policy Syst. 2015;13:18. doi: 10.1186/s12961-015-0003-1.
18. Greenhalgh T, Raftery J, Hanney S, Glover M. Research impact: a narrative review. BMC Med. 2016;14:78. doi: 10.1186/s12916-016-0620-8.
19. Yazdizadeh B, Majdzadeh R, Salmasian H. Systematic review of methods for evaluating healthcare research economic impact. Health Res Policy Syst. 2010;8:6.
20. Buxton M, Hanney S. How can payback from health services research be assessed? J Health Serv Res Policy. 1996;1(1):35-43.
21. Buxton M, Hanney S. Evaluating the NHS research and development programme: will the programme give value for money? J R Soc Med. 1998;91(35 Suppl):2-6. doi: 10.1177/0141076898091s3502.
22. Buxton M, Hanney S, Packwood T, Roberts S, Youll P. Getting research into practice: assessing benefits from department of health and national health service research & development. Public Money Manage. 2000;20(4):29-34. doi: 10.1111/1467-9302.00233.
23. Hanney S, Buxton M, Green C, Coulson D, Raftery J. An assessment of the impact of the NHS Health Technology Assessment Programme. Health Technol Assess. 2007;11(53):iii-iv. ix-xi, 1-180.
24. Hanney S, Gonzalez-Block M, Buxton M, Kogan M. The utilisation of health research in policy-making: concepts, examples and methods of assessment. Health Res Policy Syst. 2003;1:2.
25. Hanney S, Packwood T, Buxton M. Evaluating the benefits from health research and development centres: a categorization, a model and examples of application. Evaluation. 2000;6(2):137-60. doi: 10.1177/13563890022209181.
26. Milat AJ, Laws R, King L, Newson R, Rychetnik L, Rissel C, et al. Policy and practice impacts of applied research: a case study analysis of the New South Wales Health Promotion Demonstration Research Grants Scheme 2000-2006. Health Res Policy Syst. 2013;11:5. doi: 10.1186/1478-4505-11-5.
27. Social Ventures Australia Consulting. Social return on investment: lessons learned in Australia. Prepared for Investing in Impact Partnership (Social Ventures Australia, Centre for Social Impact, PricewaterhouseCoopers); 2012.
28. Access Economics. Exceptional Returns: The value of Investing in Health R&D in Australia II. Sydney: Prepared for the Australian Society for Medical Research; 2008.
29. Deloitte Access Economics. Returns on funded Research and Development. Sydney: Prepared for the Australian Society for Medical Research; 2011.
30. Deloitte Access Economics. Extrapolated returns on investment in NHMRC medical research. Sydney: Published on behalf of Australian Society for Medical Research; 2012.
31. Grant J, Brutscher P-B, Kirk SE, Butler L, Wooding S. Capturing Research Impacts: A review of international practice. London: RAND Corporation for the Higher Education Funding Council for England 2010.
32. Morton S. Progressing research impact assessment: A 'contributions' approach. Res Eval. 2015;24(4):405-19. doi: 10.1093/reseval/rvv016.
33. Cozzens SE, Bobb K, Bortagaray I. Evaluating the distributional consequences of science and technology policies and programs. Res Eval. 2002;11(2):101-7. doi: 10.3152/147154402781776899.
34. Greenhalgh T, Fahy N. Research impact in the community-based health sciences: an analysis of 162 case studies from the 2014 UK Research Excellence Framework. BMC Med. 2015;13:232. doi: 10.1186/s12916-015-0467-4.
35. Lavis J, Ross S, McLeod C, Gildiner A. Measuring the impact of health research. J Health Serv Res Policy. 2003;8(3):165-70. doi: 10.1258/135581903322029520.
36. Ward V, House A, Hamer S. Knowledge brokering: the missing link in the evidence to action chain? Evid Policy. 2009;5(3):267-79. doi: 10.1332/174426409X463811.
37. Wooding S, Hanney S, Buxton M, Grant J. Payback arising from research funding: evaluation of the Arthritis Research Campaign. Rheumatology (Oxford). 2005;44(9):1145-56. doi: 10.1093/rheumatology/keh708.
38. Yoong SL, Clinton-McHarg T, Wolfenden L. Systematic reviews examining implementation of research into practice and impact on population health are needed. J Clin Epidemiol. 2015;68:788-91. doi: 10.1016/j.jclinepi.2014.12.008.
39. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O'Brien MA, Johansen M, Grimshaw J, Oxman AD. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6:CD000259. doi: 10.1002/14651858.CD000259.pub3.
40. Berwick D, James B, Coye MJ. Connections between quality measurement and improvement. Med Care. 2003;41(1 Suppl):I30-8.
41. Behn RD. Why measure performance? Different purposes require different measures. Public Adm Rev. 2003;63(5):586-606. doi: 10.1111/1540-6210.00322.
42. Neely A, Gregory M, Platts K. Performance measurement system design. Int J Oper Prod Manage. 2005;25(12):1228-63. doi: 10.1108/01443570510633639.
43. Dumond J. Define-Measure-Improve: The Change Methodology That Has Propelled the Army's Successful Velocity Management Initiative. Santa Monica, CA: RAND Corporation; 2000.
44. Ward V, Smith S, Foy R, House A, Hamer S. Planning for knowledge translation: a researcher's guide. Evid Policy. 2010;6(4):527-41. doi: 10.1332/174426410X535882.
45. Washington University School of Medicine in St. Louis Bernard Becker Medical Library. The Becker List: Impact Indicators. Washington University School of Medicine, Washington. 2014. https://becker.wustl.edu/impact-assessment. Accessed 15 May 2014.
46. Hanney SR, Castle-Clarke S, Grant J, Guthrie S, Henshall C, Mestre-Ferrandiz J, et al. How long does biomedical research take? Studying the time taken between biomedical and health research and its translation into products, policy, and practice. Health Res Policy Syst. 2015;13:1. doi: 10.1186/1478-4505-13-1.
47. Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014;14:2. doi: 10.1186/1472-6963-14-2.
48. Wooding S, Hanney SR, Pollitt A, Grant J, Buxton MJ. Understanding factors associated with the translation of cardiovascular research: a multinational case study approach. Implementation Sci. 2014;9:47. doi: 10.1186/1748-5908-9-47.
49. Australian Government. Department of Industry Innovation and Science. Canberra: Cooperative Research Centres; 2016. http://www.industry.gov.au/industry/IndustryInitiatives/IndustryResearchCollaboration/CRC/Pages/default.aspx. Accessed 29 June 2016.
50. Linden B. Basic Blue Skies Research in the UK: Are we losing out? J Biomed Discov Collab. 2008;3:3. doi: 10.1186/1747-5333-3-3.
51. Bornmann L. Measuring the societal impact of research. Eur Mol Biol. 2012;13(8):673-6.