Correction: Beyond Academia-Interrogating Research Impact in the Research Excellence Framework (PLoS ONE (2016) 11:12 (e0168533) DOI: 10.1371/journal.pone.0168533);Beyond academia - Interrogating research impact in the research excellence framework

PLoS ONE

Volumn 11, Issue 12, 2016, Pages

  Terämä, Emma ^a   Smallman, Melanie ^a   Lock, Simon J ^a   Johnson, Charlotte ^a   Austwick, Martin Zaltz ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EXERCISE; FUNDING; HUMAN; MINING; UNIVERSITY; ECONOMICS; ENGLAND; FINANCIAL MANAGEMENT; MEDICAL RESEARCH; PROCEDURES; QUALITY CONTROL; STANDARDS;

BIOMEDICAL RESEARCH; CAPITAL FINANCING; ENGLAND; HUMANS; QUALITY CONTROL; UNIVERSITIES;

EID: 85006920545     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0172817     Document Type: Erratum

References (46)

1. Engines of growth. The impact of research at Russell Group universities Russell Group Impact Series- Part 3. 2015; available online at: http://www.russellgroup.ac.uk/media/5324/engines-of-growth.pdf Last accessed June 20, 2016.
2. Oancea A. Buzzwords and values: The prominence of 'impact' in UK research policy and governance. Research Trends 2013; 33: 6-9.
3. REF (2014a). Panel criteria and working methods. REF 01.2012. Available online at http://www.ref.ac. uk/pubs/2012-01/. Last accessed 22 April 2015.
4. REF (2014b). Decisions on assessing research impact. Research excellence framework 01.2011. Available online at: http://www.ref.ac.uk/media/ref/content/pub/decisionsonassessingresearchimpact/01-11.pdf (Last accessed May 21, 2015).
5. REF (2014c). Assessment framework and guidance on submissions. Research excellence framework 02.2011. Available online at: http://www.ref.ac.uk/media/ref/content/pub/assessmentframeworkandguidanceonsubmissions/GOS%20including%20addendum.pdf (Last accessed July 1, 2015).
6. REF (2012). Panel criteria and working methods. http://www.ref.ac.uk/pubs/2012-01/
7. Francis B. Increasing impact? An analysis of issues raised by the impact agenda in educational research. Scottish Educational Review. 2011; 43(2): 4-16.
8. Pain R, Kesby M, Askins K. Geographies of impact: power, participation and potential. Area. 2011; 43 (2), 183-188.
9. Parker J, van Teijlingen E. The Research Excellence Framework (REF): assessing the impact of social work research on society. Practice. 2012; 24(1): 41-52.
10. Smith S, Ward V, House A. "Impact" in the proposals for the UK's Research Excellence Framework: Shifting the boundaries of academic autonomy. Research Policy. 2011; 40(10): 1369-1379.
11. Martin BR. The Research Excellence Framework and the "impact agenda": are we creating a Frankenstein monster? Research Evaluation. 2011; 20(3): 247-254.
12. Slater T. Impacted geographers: a response to Pain, Kesby and Askins. Area. 2012; 44(1): 117-119.
13. Pettigrew AM. Scholarship with Impact. British Journal of Management. 2011; 22(3): 347-354.
14. Phillips R. The impact agenda and geographies of curiosity. Transactions of the Institute of British Geographers. 2011; 35(4): 447-452.
15. Watermeyer R. Impact in the REF: issues and obstacles. Studies in Higher Education, 2014; 1-16.
16. Firth J, Shapiro DA, Parry G. The impact of research on the practice of psychotherapy. British Journal of Psychotherapy. 1986; 2(3):169-179.
17. Lomas J. (Finding audiences, changing beliefs: the structure of research use in Canadian health policy. Journal of Health Politics, Policy and Law. 1990; 15(3): 525-542. PMID: 2273216
18. Niemann HJ, Zerna W. Impact of research on development of large cooling towers. Engineering Structures. 1986; 8(2): 74-86.
19. Sherman LW, Cohn EG. The impact of research on legal policy: The Minneapolis domestic violence experiment. Law and Society Review. 1989: 117-144.
20. Suppes P. Impact of Research on Education: Some Case Studies. 1978. Retrieved from http://eric.ed. gov/?id=ED160599
21. Vielle JP. The Impact of Research on Educational Change. Prospects: Quarterly Review of Education. 1981; 11(3): 313-25.
22. Oancea A. Interpretations of Research Impact in Seven Disciplines European Educational Research Journal Volume 2013; 12 Number 2.
23. Bell S, Shaw B, Boaz A. Real-world approaches to assessing the impact of environmental research on policy. Res. Eval. 2011; 20: 227-237.
24. Klautzer L, Hanney S, Nason E, Rubin J, Grant J, Wooding S. Assessing policy and practice impacts of social science research: the application of the Payback Framework to assess the Future of Work programme. Research Evaluation. 2011; 20(3): 201-209.
25. Penfield T, Baker MJ, Scoble R, Wykes MC. Assessment, evaluations, and definitions of research impact: A review. Research Evaluation, 2013: rvt021.
26. Sá CM, Kretz A, Sigurdson K. Accountability, performance assessment, and evaluation: Policy pressures and responses from research councils. Research Evaluation, 2013; 22(2): 105-117.
27. Wilsdon J, Allen L, Belfiore E, Campbell P, Curry S, Hill S, et al. The Metric Tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management. 2015.
28. HEFCE. Research Excellence Framework impact pilot exercise: Findings of the expert panels. A report to the UK higher education funding bodies by the chairs of the impact pilot panels. November 2010.
29. REF Research Impact Pilot Exercise Lessons-Learned Project: Feedback on Pilot Submissions. Final report. November 2010. By Technopolis for HEFCE.
30. Watermeyer R. From Engagement to Impact? Articulating the Public Value of Academic Research. Tertiary Education and Management, 2012; 18(2): 115-130.
31. Derrick GE, Samuel GN. The evaluation scale: exploring decisions about societal impact in peer review panels. Minerva. 2016 Mar 1; 54(1):75-97.
32. Huutoniemi K. Communicating and compromising on disciplinary expertise in the peer review of research proposals. Social Studies of Science. 2012. 42(6) 897-921.
33. Luukkonen T. Conservatism and risk-taking in peer review: Emerging ERC practices. Research Evaluation. 2012. 21(1) 48-60.
34. RAND. Assessing impact submissions for REF 2014: an evaluation by C. Manville et al. for HEFCE, SFC, HEFCW and DEL-March 2015. RR-1032-HEFCE.
35. RAND 2014. Preparing impact submissions for REF 2014: An evaluation: Findings and observations. Catriona Manville, Molly Morgan Jones, Michael Frearson, Sophie Castle-Clarke, Marie-Louise Henham, Salil Gunashekar, Jonathan Grant. http://www.rand.org/randeurope/research/projects/hefceref2014- impact.html
36. King's College, London and Digital Science. The nature, scale and beneficiaries of research impact: An initial analysis of Research Excellence Framework (REF) 2014 impact case studies, Research Report 2015/01. HEFCE, March 2015.
37. REF2014: Results. Research Excellence Framework. 2014 Available online at: http://results.ref.ac.uk/(Last accessed Aug 26, 2015).
38. Ratinaud P. IRAMUTEQ: Interface de R pour les Analyses Multidimensionnelles de Textes et de Questionnaires [Computer software]. 2009. Retrieved from http://www.iramuteq.org. Last accessed 22.4.2015
39. Chartier JF, Meunier JG. Text mining methods for social representation analysis in Large Corpora. Papers on Social Representations. 2011; 20(37): 1-47.
40. Sahlgren M. The Word-Space Model: Using distributional analysis to represent syntagmatic and paradigmatic relations between words in high-dimensional vector spaces. [PhD thesis]. Stockholm University. 2006.
41. Bara J, Weale A and Bicquelet A. Analysing parliamentary debate with computer assistance. Swiss Political Science Review. 2007; 13(4): 577-605.
42. Kronberger N and Wagner W. Keywords in context: Statistical analysis of text features. In: BauerM and Gaskell G (eds) Qualitative Researching with Text, Image and Sound: A Practical Handbook for Social Research. London: SAGE. 2000. p. 299-317.
43. Mutombo E. A bird's eye view on the EC environmental policy. In: 1st international conference on public policy, Grenoble. 2013. Available at: http://www.icpublicpolicy.org/IMG/pdf/panel17-s1-mutombo.pdf
44. Stoneman P, Sturgis P, Allum N. Exploring public discourses about emerging technologies through statistical clustering of open-ended survey questions. Public Understanding of Science. 2013; 22(7): 850-868. doi: 10.1177/0963662512441569 PMID: 23825238
45. Bholat, David, Hansen, Stephen, Santos, Pedro and Schonhardt-Bailey, Cheryl (2015) Text mining for central banks: handbook. Centre for Central Banking Studies (33). pp. 1-19. ISSN 1756-7270
46. Wooding S, Van Leeuwen TN, Parks S, Kapur S, Grant J. 2015. UK Doubles Its "World-Leading" Research in Life Sciences and Medicine in Six Years: Testing the Claim? PlosOne