A narrative review of research impact assessment models and methods

Health Research Policy and Systems

Volumn 13, Issue 1, 2015, Pages

  Milat, Andrew J ^a,b   Bauman, Adrian E ^b   Redman, Sally ^b,c  

^a NEW SOUTH WALES MINISTRY OF HEALTH   (Australia)

^b UNIVERSITY OF SYDNEY   (Australia)

^c SAX INSTITUTE   (Australia)

Author keywords

Policy and practice impact; Research impact; Research returns

Indexed keywords

ASSESSMENT OF HUMANS; BASIC RESEARCH; CASE STUDY; CITATION ANALYSIS; CLINICAL TRIAL (TOPIC); CONCEPTUAL FRAMEWORK; HEALTH CARE POLICY; HEALTH PROMOTION; HEALTH SERVICES RESEARCH; HUMAN; MEDICAL RESEARCH; POLICY; PUBLIC HEALTH; PUBLIC HEALTH SERVICE; RESEARCH; RESEARCH IMPACT ASSESSMENT; REVIEW; SYSTEMATIC REVIEW (TOPIC); TRANSLATIONAL RESEARCH; HEALTH IMPACT ASSESSMENT; THEORETICAL MODEL;

HEALTH IMPACT ASSESSMENT; MODELS, THEORETICAL; PUBLIC HEALTH; RESEARCH;

EID: 84925688615     PISSN: None     EISSN: 14784505     Source Type: Journal    
DOI: 10.1186/s12961-015-0003-1     Document Type: Review

References (49)

1. Anderson W, Papadakis E. Research to improve health practice and policy. Med J Aust. 2009;191(11/12):646-7.
2. Cooksey D. A review of UK health research funding. London: HMSO; 2006.
3. Health and Medical Research Strategic Review Committee. The virtuous cycle: working together for health and medical research. Canberra: Commonwealth of Australia; 1998.
4. National Health and Medical Research Council Public Health Advisory Committee. Report of the Review of Public Health Research Funding in Australia. Canberra: NHMRC; 2008.
5. Campbell DM. Increasing the use of evidence in health policy: practice and views of policy makers and researchers. Aust New Zealand Health Policy. 2009;6:21.
6. Wells R, Whitworth JA. Assessing outcomes of health and medical research: do we measure what counts or count what we can measure? Aust New Zealand Health Policy. 2007;4:14.
7. Australian Government Australian Research Council. Excellence in Research in Australia 2012. Canberra: Australian Research Council; 2012.
8. Kuruvilla S, Mays N, Walt G. Describing the impact of health services and policy research. J Health Serv Res Policy. 2007;12 Suppl 1:S1. -23-31.
9. Weiss AP. Measuring the impact of medical research: moving from outputs to outcomes. Am J Psychiatr. 2007;164(2):206-14.
10. Bornmann L. Measuring the societal impact of research. Eur Mol Biol Organ. 2012;13(8):673-6.
11. Holbrook JB. Re-assessing the science-society relation: The case of the US National Science Foundation's broader impacts merit review criterion (1997-2011). In: Frodeman R, Holbrook JB, Mitcham C, Xiaonan H, editors. Peer Review, Research Integrity, and the Governance of Science-Practice, Theory, and Current Discussions. Dalian: People's Publishing House and Dalian University of Technology; 2012. p. 328-62.
12. Holbrook JB, Frodeman R. Science's social effects. Issues in Science and Technology. 2007. http://issues.org/23-3/p_frodeman-3/ .
13. Banzi R, Moja L, Pistotti V, Facchini A, Liberati A. Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviews. health Res Policy Syst. 2011;9:26.
14. Boaz A, Fitzpatrick S, Shaw B. Assessing the impact of research on policy: A review of the literature for a project on bridging research and policy through outcome evaluation. London: Policy Studies Institute London; 2008.
15. Aymerich M, Carrion C, Gallo P, Garcia M, López-Bermejo A, Quesada M, et al. Measuring the payback of research activities: a feasible ex-post evaluation methodology in epidemiology and public health. Soc Sci Med. 2012;75(3):505-10.
16. Barber R, Boote JD, Parry GD, Cooper CL, Yeeles P, Cook S. Can the impact of public involvement on research be evaluated? A mixed methods study. Health Expect. 2012;15(3):229-41.
17. Barker K, The UK. Research Assessment Exercise: the evolution of a national research evaluation system. Res Eval. 2007;16(1):3-12.
18. Boyack KW, Jordan P. Metrics associated with NIH funding: a high-level view. J Am Med Inform Assoc. 2011;18(4):423-31.
19. Buxton M, Hanney S, Morris S, Sundmacher L, Mestre-Ferrandiz J, Garau M, et al. Medical research: what's it worth. Estimating the economic benefits from medical research in the UK. Report for MRC, Wellcome Trust and the Academy of Medical Sciences. 2008. http://www.wellcome.ac.uk/stellent/groups/corporatesite/@sitestudioobjects/documents/web_document/wtx052110.pdf .
20. Buykx P, Humphreys J, Wakerman J, Perkins D, Lyle D, McGrail M, et al. 'Making evidence count': A framework to monitor the impact of health services research. Aust J Rural Health. 2012;20(2):51-8.
21. Deloitte Access Economics. Extrapolated returns on investment in NHMRC medical research. Canberra: Australian Society for Medical Research; 2012.
22. Derrick GE, Haynes A, Chapman S, Hall WD. The association between four citation metrics and peer rankings of research influence of Australian researchers in six fields of public health. PLoS One. 2011;6(4):e18521.
23. Franks AL, Simoes EJ, Singh R, Gray BS. Assessing prevention research impact: a bibliometric analysis. Am J Prev Med. 2006;30(3):211-6.
24. Graham KE, Chorzempa HL, Valentine PA, Magnan J. Evaluating health research impact: development and implementation of the Alberta Innovates-Health Solutions impact framework. Res Eval. 2012;21(5):354-67.
25. Canadian Institutes of Health Research. Developing a CIHR framework to measure the impact of health research. Ottawa: Canadian Institutes of Health Research; 2005.
26. Group of Eight. Excellence in innovation: research impacting our nation's future - assessing the benefits. Adelaide: Australian Technology Network of Universities; 2012.
27. Hanney S. An assessment of the impact of the NHS Health Technology Assessment Programme. Southampton: National Coordinating Centre for Health Technology Assessment, University of Southampton; 2007.
28. Higher Education Funding Council for England. Panel criteria and working methods. London: Higher Education Funding Council for England; 2012.
29. Kalucy EC, Jackson-Bowers E, McIntyre E, Reed R. The feasibility of determining the impact of primary health care research projects using the Payback Framework. Health Res Policy Syst. 2009;7:11.
30. Kuruvilla S, Mays N, Pleasant A, Walt G. Describing the impact of health research: a Research Impact Framework. BMC Health Serv Res. 2006;6(1):134.
31. Kwan P, Johnston J, Fung AYK, Chong DSY, Collins RA, Lo SV. A systematic evaluation of payback of publicly funded health and health services research in Hong Kong. BMC Health Serv Res. 2007;7(1):121.
32. Landry R, Amara N, Lamari M. Climbing the ladder of research utilization: Evidence from social science research. Sci Commun. 2001;22:396-422.
33. Lavis J, Ross S, McLeod C, Gildiner A. Measuring the impact of health research. J Health Serv Res Policy. 2003;8(3):165-70.
34. Laws R, King L, Hardy LL, Milat AJ, Rissel C, Newson R, et al. Utilization of a population health survey in policy and practice: a case study. Health Res Policy Syst. 2013;11:4.
35. Liebow E, Phelps J, Van Houten B, Rose S, Orians C, Cohen J, et al. Toward the assessment of scientific and public health impacts of the National Institute of Environmental Health Sciences Extramural Asthma Research Program using available data. Environ Health Perspect. 2009;117(7):1147.
36. Milat AJ, Laws R, King L, Newson R, Rychetnik L, Rissel C, et al. Policy and practice impacts of applied research: a case study analysis of the New South Wales Health Promotion Demonstration Research Grants Scheme 2000-2006. Health Res Policy Syst. 2013;11:5.
37. National Institutes of Health. Cost savings resulting from NIH research support. Bethesda, MD: United States Department of Health and Human Services National Institute of Health; 1993.
38. Ovseiko PV, Oancea A, Buchan AM. Assessing research impact in academic clinical medicine: a study using Research Excellence Framework pilot impact indicators. BMC Health Serv Res. 2012;12:478.
39. Schapper CC, Dwyer T, Tregear GW, Aitken M, Clay MA. Research performance evaluation: the experience of an independent medical research institute. Aust Health Rev. 2012;36(2):218-23.
40. Spoth RL, Schainker LM, Hiller-Sturmhöefel S. Translating family-focused prevention science into public health impact: illustrations from partnership-based research. Alcohol Res Health. 2011;34(2):188.
41. Sullivan R, Lewison G, Purushotham AD. An analysis of research activity in major UK cancer centres. Eur J Cancer. 2011;47(4):536-44.
42. Taylor J, Bradbury-Jones C. International principles of social impact assessment: lessons for research? J Res Nurs. 2011;16(2):133-45.
43. Warner KE, Tam J. The impact of tobacco control research on policy: 20 years of progress. Tob Control. 2012;21(2):103-9.
44. Wooding S, Hanney S, Buxton M, Grant J. The returns from arthritis research. Volume 1: Approach analysis and recommendations. Netherlands: RAND Europe; 2004.
45. Buxton M, Hanney S. How can payback from health services research be assessed? J Health Serv Res Policy. 1996;1(1):35-43.
46. Higher Education Funding Council for England. Decisions on assessing research impact. Bristol: Higher Education Funding Council for England; 2011.
47. Grant J, Brutscher P-B, Kirk SE, Butler L, Wooding S. Capturing research impacts: a review of international practice. Documented Briefing. RAND Corporation; 2010. http://www.rand.org/pubs/documented_briefings/DB578.html .
48. Murphy KM, Topel RH. Measuring the gains from medical research: an economic approach. Chicago: University of Chicago Press; 2010.
49. Balas EA, Boren SA. Managing clinical knowledge for health care improvement. In: Bemmel J, McCray AT, editors. Yearbook of Medical Informatics 2000: Patient-Centered Systems. Stuttgart, Germany: Schattauer Verlagsgesellschaft mbH; 2000. p. 65-70.